2026-02-17T21:10:40.321 INFO:root:teuthology version: 0.0.1.dev31+g5f66ecfb3 2026-02-17T21:10:40.334 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T21:10:40.415 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53902 branch: wip-yuri6-testing-2026-02-17-1732-squid description: rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} email: null first_in_suite: false flavor: default job_id: '53902' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri6-testing-2026-02-17-1732-squid ceph: conf: client: debug monc: 20 debug ms: 1 debug objecter: 20 debug rados: 20 global: mon client directed command retry: 5 mon election default strategy: 1 ms inject socket failures: 5000 ms type: async osd heartbeat grace: 160 osd op thread timeout: 150 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osd crush smoke test: false mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 mon warn on pool no app: false paxos service trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 1 debug bluestore: 1 debug monc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd class default list: '*' osd class load list: '*' osd client watch timeout: 240 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd fast shutdown: false osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd memory target: 1610612736 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - reached quota - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(SLOW_OPS\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(OBJECT_MISPLACED\) - slow request - overall HEALTH_ - \(PG_ - \(MON_DOWN\) - \(SLOW_OPS\) - slow request - OSD bench result sha1: d855f53b89fdcec760fd9232a5fb55ed4fb111a1 stop-daemons-timeout: 1200 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: debuginfo: true flavor: default sha1: d855f53b89fdcec760fd9232a5fb55ed4fb111a1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri6-testing-2026-02-17-1732-squid sha1: d855f53b89fdcec760fd9232a5fb55ed4fb111a1 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - osd.0 - osd.4 - osd.8 - osd.12 - - mon.b - osd.1 - osd.5 - osd.9 - osd.13 - - mon.c - osd.2 - osd.6 - osd.10 - osd.14 - - mgr.x - osd.3 - osd.7 - osd.11 - osd.15 - client.0 seed: 2987 sha1: d855f53b89fdcec760fd9232a5fb55ed4fb111a1 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri6-testing-2026-02-17-1732-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: d855f53b89fdcec760fd9232a5fb55ed4fb111a1 targets: trial005.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIbBzjCl5jjcVxcum2l11FvJYPRMYGVICtOnxjjUeVXVZxSkimDH5nuyWI5nmxwKm499JWuozUWHy6FJWVDVp2I= trial119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNoEGeFq8aMsJVhcfasn4xIX1O4cFT4F+pOUthAjKWqpvco2UUfFZMVSEgLlLZPymfAJ/+Hi7iATbDPAdkCa0VM= trial135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBb94oSTPjlu7RURV7ty8IS6V01lskewUwsOpSay9jtRVVDzUGFR+RDcl22Am+9igPvcpn73okxnTa78AdyVkDc= trial176.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIIgB2Egc9wWA8Dddrue98c3pwAjnOeSAyrNUeYnQS3u/FTb1aHthG45iTLgznnLHVK5oEqiqTiTH7u0Y5HsstE= tasks: - install: null - ceph: null - workunit: clients: client.0: - rados/test.sh env: ALLOW_TIMEOUTS: '1' timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - '-- Don''t run this test on tiny clusters if py_len(yaml.roles) < 4 then reject() end ' teuthology_branch: reimage-ssh-down teuthology_sha1: 5f66ecfb34c0370410e78b3ee641753d19da653b timestamp: 2026-02-17_20:43:43 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T21:10:40.415 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa; will attempt to use it 2026-02-17T21:10:40.416 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa/tasks 2026-02-17T21:10:40.416 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T21:10:40.417 INFO:teuthology.task.internal:Checking packages... 2026-02-17T21:10:40.417 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd855f53b89fdcec760fd9232a5fb55ed4fb111a1' 2026-02-17T21:10:40.417 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T21:10:40.417 INFO:teuthology.packaging:ref: None 2026-02-17T21:10:40.417 INFO:teuthology.packaging:tag: None 2026-02-17T21:10:40.418 INFO:teuthology.packaging:branch: wip-yuri6-testing-2026-02-17-1732-squid 2026-02-17T21:10:40.418 INFO:teuthology.packaging:sha1: d855f53b89fdcec760fd9232a5fb55ed4fb111a1 2026-02-17T21:10:40.418 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri6-testing-2026-02-17-1732-squid 2026-02-17T21:10:40.540 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-679.gd855f53b 2026-02-17T21:10:40.541 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T21:10:40.552 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T21:10:40.553 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T21:10:40.570 INFO:teuthology.task.internal:Saving configuration 2026-02-17T21:10:40.582 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T21:10:40.595 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T21:10:40.673 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial005.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53902', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 21:06:50.087373', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIbBzjCl5jjcVxcum2l11FvJYPRMYGVICtOnxjjUeVXVZxSkimDH5nuyWI5nmxwKm499JWuozUWHy6FJWVDVp2I='} 2026-02-17T21:10:40.729 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial119.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53902', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 21:06:50.086439', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNoEGeFq8aMsJVhcfasn4xIX1O4cFT4F+pOUthAjKWqpvco2UUfFZMVSEgLlLZPymfAJ/+Hi7iATbDPAdkCa0VM='} 2026-02-17T21:10:40.784 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial135.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53902', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 21:06:50.087716', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBb94oSTPjlu7RURV7ty8IS6V01lskewUwsOpSay9jtRVVDzUGFR+RDcl22Am+9igPvcpn73okxnTa78AdyVkDc='} 2026-02-17T21:10:40.838 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial176.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53902', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 21:06:50.087032', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIIgB2Egc9wWA8Dddrue98c3pwAjnOeSAyrNUeYnQS3u/FTb1aHthG45iTLgznnLHVK5oEqiqTiTH7u0Y5HsstE='} 2026-02-17T21:10:40.838 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T21:10:40.850 INFO:teuthology.task.internal:roles: ubuntu@trial005.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'] 2026-02-17T21:10:40.850 INFO:teuthology.task.internal:roles: ubuntu@trial119.front.sepia.ceph.com - ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'] 2026-02-17T21:10:40.850 INFO:teuthology.task.internal:roles: ubuntu@trial135.front.sepia.ceph.com - ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'] 2026-02-17T21:10:40.850 INFO:teuthology.task.internal:roles: ubuntu@trial176.front.sepia.ceph.com - ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0'] 2026-02-17T21:10:40.850 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T21:10:41.100 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe9b62054e0>, signals=[15]) 2026-02-17T21:10:41.100 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T21:10:41.112 INFO:teuthology.task.internal:Opening connections... 2026-02-17T21:10:41.112 DEBUG:teuthology.task.internal:connecting to ubuntu@trial005.front.sepia.ceph.com 2026-02-17T21:10:41.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T21:10:41.174 DEBUG:teuthology.task.internal:connecting to ubuntu@trial119.front.sepia.ceph.com 2026-02-17T21:10:41.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T21:10:41.238 DEBUG:teuthology.task.internal:connecting to ubuntu@trial135.front.sepia.ceph.com 2026-02-17T21:10:41.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T21:10:41.299 DEBUG:teuthology.task.internal:connecting to ubuntu@trial176.front.sepia.ceph.com 2026-02-17T21:10:41.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T21:10:41.363 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T21:10:41.375 DEBUG:teuthology.orchestra.run.trial005:> uname -m 2026-02-17T21:10:41.392 INFO:teuthology.orchestra.run.trial005.stdout:x86_64 2026-02-17T21:10:41.392 DEBUG:teuthology.orchestra.run.trial005:> cat /etc/os-release 2026-02-17T21:10:41.449 INFO:teuthology.orchestra.run.trial005.stdout:NAME="CentOS Stream" 2026-02-17T21:10:41.449 INFO:teuthology.orchestra.run.trial005.stdout:VERSION="9" 2026-02-17T21:10:41.449 INFO:teuthology.orchestra.run.trial005.stdout:ID="centos" 2026-02-17T21:10:41.449 INFO:teuthology.orchestra.run.trial005.stdout:ID_LIKE="rhel fedora" 2026-02-17T21:10:41.449 INFO:teuthology.orchestra.run.trial005.stdout:VERSION_ID="9" 2026-02-17T21:10:41.449 INFO:teuthology.orchestra.run.trial005.stdout:PLATFORM_ID="platform:el9" 2026-02-17T21:10:41.449 INFO:teuthology.orchestra.run.trial005.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T21:10:41.449 INFO:teuthology.orchestra.run.trial005.stdout:ANSI_COLOR="0;31" 2026-02-17T21:10:41.449 INFO:teuthology.orchestra.run.trial005.stdout:LOGO="fedora-logo-icon" 2026-02-17T21:10:41.449 INFO:teuthology.orchestra.run.trial005.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T21:10:41.449 INFO:teuthology.orchestra.run.trial005.stdout:HOME_URL="https://centos.org/" 2026-02-17T21:10:41.449 INFO:teuthology.orchestra.run.trial005.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T21:10:41.449 INFO:teuthology.orchestra.run.trial005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T21:10:41.449 INFO:teuthology.orchestra.run.trial005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T21:10:41.450 INFO:teuthology.lock.ops:Updating trial005.front.sepia.ceph.com on lock server 2026-02-17T21:10:41.526 DEBUG:teuthology.orchestra.run.trial119:> uname -m 2026-02-17T21:10:41.543 INFO:teuthology.orchestra.run.trial119.stdout:x86_64 2026-02-17T21:10:41.543 DEBUG:teuthology.orchestra.run.trial119:> cat /etc/os-release 2026-02-17T21:10:41.600 INFO:teuthology.orchestra.run.trial119.stdout:NAME="CentOS Stream" 2026-02-17T21:10:41.600 INFO:teuthology.orchestra.run.trial119.stdout:VERSION="9" 2026-02-17T21:10:41.600 INFO:teuthology.orchestra.run.trial119.stdout:ID="centos" 2026-02-17T21:10:41.600 INFO:teuthology.orchestra.run.trial119.stdout:ID_LIKE="rhel fedora" 2026-02-17T21:10:41.600 INFO:teuthology.orchestra.run.trial119.stdout:VERSION_ID="9" 2026-02-17T21:10:41.600 INFO:teuthology.orchestra.run.trial119.stdout:PLATFORM_ID="platform:el9" 2026-02-17T21:10:41.600 INFO:teuthology.orchestra.run.trial119.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T21:10:41.600 INFO:teuthology.orchestra.run.trial119.stdout:ANSI_COLOR="0;31" 2026-02-17T21:10:41.601 INFO:teuthology.orchestra.run.trial119.stdout:LOGO="fedora-logo-icon" 2026-02-17T21:10:41.601 INFO:teuthology.orchestra.run.trial119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T21:10:41.601 INFO:teuthology.orchestra.run.trial119.stdout:HOME_URL="https://centos.org/" 2026-02-17T21:10:41.601 INFO:teuthology.orchestra.run.trial119.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T21:10:41.601 INFO:teuthology.orchestra.run.trial119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T21:10:41.601 INFO:teuthology.orchestra.run.trial119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T21:10:41.601 INFO:teuthology.lock.ops:Updating trial119.front.sepia.ceph.com on lock server 2026-02-17T21:10:41.684 DEBUG:teuthology.orchestra.run.trial135:> uname -m 2026-02-17T21:10:41.700 INFO:teuthology.orchestra.run.trial135.stdout:x86_64 2026-02-17T21:10:41.701 DEBUG:teuthology.orchestra.run.trial135:> cat /etc/os-release 2026-02-17T21:10:41.756 INFO:teuthology.orchestra.run.trial135.stdout:NAME="CentOS Stream" 2026-02-17T21:10:41.756 INFO:teuthology.orchestra.run.trial135.stdout:VERSION="9" 2026-02-17T21:10:41.756 INFO:teuthology.orchestra.run.trial135.stdout:ID="centos" 2026-02-17T21:10:41.756 INFO:teuthology.orchestra.run.trial135.stdout:ID_LIKE="rhel fedora" 2026-02-17T21:10:41.756 INFO:teuthology.orchestra.run.trial135.stdout:VERSION_ID="9" 2026-02-17T21:10:41.756 INFO:teuthology.orchestra.run.trial135.stdout:PLATFORM_ID="platform:el9" 2026-02-17T21:10:41.756 INFO:teuthology.orchestra.run.trial135.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T21:10:41.756 INFO:teuthology.orchestra.run.trial135.stdout:ANSI_COLOR="0;31" 2026-02-17T21:10:41.756 INFO:teuthology.orchestra.run.trial135.stdout:LOGO="fedora-logo-icon" 2026-02-17T21:10:41.756 INFO:teuthology.orchestra.run.trial135.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T21:10:41.756 INFO:teuthology.orchestra.run.trial135.stdout:HOME_URL="https://centos.org/" 2026-02-17T21:10:41.756 INFO:teuthology.orchestra.run.trial135.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T21:10:41.756 INFO:teuthology.orchestra.run.trial135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T21:10:41.756 INFO:teuthology.orchestra.run.trial135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T21:10:41.757 INFO:teuthology.lock.ops:Updating trial135.front.sepia.ceph.com on lock server 2026-02-17T21:10:41.833 DEBUG:teuthology.orchestra.run.trial176:> uname -m 2026-02-17T21:10:41.850 INFO:teuthology.orchestra.run.trial176.stdout:x86_64 2026-02-17T21:10:41.851 DEBUG:teuthology.orchestra.run.trial176:> cat /etc/os-release 2026-02-17T21:10:41.908 INFO:teuthology.orchestra.run.trial176.stdout:NAME="CentOS Stream" 2026-02-17T21:10:41.908 INFO:teuthology.orchestra.run.trial176.stdout:VERSION="9" 2026-02-17T21:10:41.908 INFO:teuthology.orchestra.run.trial176.stdout:ID="centos" 2026-02-17T21:10:41.908 INFO:teuthology.orchestra.run.trial176.stdout:ID_LIKE="rhel fedora" 2026-02-17T21:10:41.908 INFO:teuthology.orchestra.run.trial176.stdout:VERSION_ID="9" 2026-02-17T21:10:41.908 INFO:teuthology.orchestra.run.trial176.stdout:PLATFORM_ID="platform:el9" 2026-02-17T21:10:41.908 INFO:teuthology.orchestra.run.trial176.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T21:10:41.908 INFO:teuthology.orchestra.run.trial176.stdout:ANSI_COLOR="0;31" 2026-02-17T21:10:41.908 INFO:teuthology.orchestra.run.trial176.stdout:LOGO="fedora-logo-icon" 2026-02-17T21:10:41.908 INFO:teuthology.orchestra.run.trial176.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T21:10:41.908 INFO:teuthology.orchestra.run.trial176.stdout:HOME_URL="https://centos.org/" 2026-02-17T21:10:41.908 INFO:teuthology.orchestra.run.trial176.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T21:10:41.908 INFO:teuthology.orchestra.run.trial176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T21:10:41.908 INFO:teuthology.orchestra.run.trial176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T21:10:41.909 INFO:teuthology.lock.ops:Updating trial176.front.sepia.ceph.com on lock server 2026-02-17T21:10:41.991 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T21:10:42.004 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T21:10:42.015 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T21:10:42.015 DEBUG:teuthology.orchestra.run.trial005:> test '!' -e /home/ubuntu/cephtest 2026-02-17T21:10:42.017 DEBUG:teuthology.orchestra.run.trial119:> test '!' -e /home/ubuntu/cephtest 2026-02-17T21:10:42.019 DEBUG:teuthology.orchestra.run.trial135:> test '!' -e /home/ubuntu/cephtest 2026-02-17T21:10:42.020 DEBUG:teuthology.orchestra.run.trial176:> test '!' -e /home/ubuntu/cephtest 2026-02-17T21:10:42.036 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T21:10:42.047 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T21:10:42.047 DEBUG:teuthology.orchestra.run.trial005:> test -z $(ls -A /var/lib/ceph) 2026-02-17T21:10:42.073 DEBUG:teuthology.orchestra.run.trial119:> test -z $(ls -A /var/lib/ceph) 2026-02-17T21:10:42.075 DEBUG:teuthology.orchestra.run.trial135:> test -z $(ls -A /var/lib/ceph) 2026-02-17T21:10:42.077 DEBUG:teuthology.orchestra.run.trial176:> test -z $(ls -A /var/lib/ceph) 2026-02-17T21:10:42.094 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T21:10:42.332 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T21:10:42.352 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-17T21:10:42.352 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mon.b': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mon.c': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-17T21:10:42.352 DEBUG:teuthology.orchestra.run.trial005:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T21:10:42.352 DEBUG:teuthology.orchestra.run.trial119:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T21:10:42.352 DEBUG:teuthology.orchestra.run.trial135:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T21:10:42.353 DEBUG:teuthology.orchestra.run.trial176:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T21:10:42.367 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:10:42.367 DEBUG:teuthology.orchestra.run.trial135:> uname -r 2026-02-17T21:10:42.368 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:10:42.368 DEBUG:teuthology.orchestra.run.trial005:> uname -r 2026-02-17T21:10:42.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:10:42.369 DEBUG:teuthology.orchestra.run.trial176:> uname -r 2026-02-17T21:10:42.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:10:42.369 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-17T21:10:42.423 INFO:teuthology.orchestra.run.trial135.stdout:5.14.0-645.el9.x86_64 2026-02-17T21:10:42.423 INFO:teuthology.task.kernel:Running kernel on trial135: 5.14.0-645.el9.x86_64 2026-02-17T21:10:42.423 DEBUG:teuthology.orchestra.run.trial135:> sudo yum install -y kernel 2026-02-17T21:10:42.424 INFO:teuthology.orchestra.run.trial005.stdout:5.14.0-645.el9.x86_64 2026-02-17T21:10:42.424 INFO:teuthology.task.kernel:Running kernel on trial005: 5.14.0-645.el9.x86_64 2026-02-17T21:10:42.424 DEBUG:teuthology.orchestra.run.trial005:> sudo yum install -y kernel 2026-02-17T21:10:42.424 INFO:teuthology.orchestra.run.trial119.stdout:5.14.0-645.el9.x86_64 2026-02-17T21:10:42.425 INFO:teuthology.task.kernel:Running kernel on trial119: 5.14.0-645.el9.x86_64 2026-02-17T21:10:42.425 DEBUG:teuthology.orchestra.run.trial119:> sudo yum install -y kernel 2026-02-17T21:10:42.426 INFO:teuthology.orchestra.run.trial176.stdout:5.14.0-645.el9.x86_64 2026-02-17T21:10:42.426 INFO:teuthology.task.kernel:Running kernel on trial176: 5.14.0-645.el9.x86_64 2026-02-17T21:10:42.426 DEBUG:teuthology.orchestra.run.trial176:> sudo yum install -y kernel 2026-02-17T21:10:43.033 INFO:teuthology.orchestra.run.trial135.stdout:CentOS Stream 9 - BaseOS 37 MB/s | 8.9 MB 00:00 2026-02-17T21:10:43.154 INFO:teuthology.orchestra.run.trial176.stdout:CentOS Stream 9 - BaseOS 24 MB/s | 8.9 MB 00:00 2026-02-17T21:10:43.515 INFO:teuthology.orchestra.run.trial005.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-17T21:10:46.173 INFO:teuthology.orchestra.run.trial135.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-17T21:10:46.747 INFO:teuthology.orchestra.run.trial005.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 27 MB 00:02 2026-02-17T21:10:49.450 INFO:teuthology.orchestra.run.trial176.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 27 MB 00:05 2026-02-17T21:10:50.356 INFO:teuthology.orchestra.run.trial005.stdout:CentOS Stream 9 - CRB 6.2 MB/s | 7.8 MB 00:01 2026-02-17T21:10:51.218 INFO:teuthology.orchestra.run.trial005.stdout:CentOS Stream 9 - Extras packages 144 kB/s | 20 kB 00:00 2026-02-17T21:10:51.444 INFO:teuthology.orchestra.run.trial119.stdout:CentOS Stream 9 - BaseOS 1.0 MB/s | 8.9 MB 00:08 2026-02-17T21:10:52.132 INFO:teuthology.orchestra.run.trial005.stdout:Extra Packages for Enterprise Linux 24 MB/s | 20 MB 00:00 2026-02-17T21:10:53.633 INFO:teuthology.orchestra.run.trial176.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 7.8 MB 00:01 2026-02-17T21:10:54.492 INFO:teuthology.orchestra.run.trial119.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-17T21:10:54.737 INFO:teuthology.orchestra.run.trial176.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 20 kB 00:00 2026-02-17T21:10:55.274 INFO:teuthology.orchestra.run.trial005.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-17T21:10:55.575 INFO:teuthology.orchestra.run.trial176.stdout:Extra Packages for Enterprise Linux 26 MB/s | 20 MB 00:00 2026-02-17T21:10:56.286 INFO:teuthology.orchestra.run.trial005.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T21:10:56.307 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:10:56.309 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:10:56.309 INFO:teuthology.orchestra.run.trial005.stdout: Package Architecture Version Repository Size 2026-02-17T21:10:56.309 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:10:56.309 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:10:56.309 INFO:teuthology.orchestra.run.trial005.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T21:10:56.310 INFO:teuthology.orchestra.run.trial005.stdout:Installing dependencies: 2026-02-17T21:10:56.310 INFO:teuthology.orchestra.run.trial005.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T21:10:56.310 INFO:teuthology.orchestra.run.trial005.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T21:10:56.310 INFO:teuthology.orchestra.run.trial005.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T21:10:56.310 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:10:56.310 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:10:56.310 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:10:56.310 INFO:teuthology.orchestra.run.trial005.stdout:Install 4 Packages 2026-02-17T21:10:56.310 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:10:56.310 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 88 M 2026-02-17T21:10:56.311 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 135 M 2026-02-17T21:10:56.311 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:10:57.453 INFO:teuthology.orchestra.run.trial135.stdout:CentOS Stream 9 - CRB 892 kB/s | 7.8 MB 00:08 2026-02-17T21:10:57.702 INFO:teuthology.orchestra.run.trial005.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 613 kB/s | 803 kB 00:01 2026-02-17T21:10:58.245 INFO:teuthology.orchestra.run.trial119.stdout:CentOS Stream 9 - CRB 5.6 MB/s | 7.8 MB 00:01 2026-02-17T21:10:58.802 INFO:teuthology.orchestra.run.trial176.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-17T21:10:59.266 INFO:teuthology.orchestra.run.trial135.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-17T21:10:59.688 INFO:teuthology.orchestra.run.trial135.stdout:Extra Packages for Enterprise Linux 56 MB/s | 20 MB 00:00 2026-02-17T21:10:59.827 INFO:teuthology.orchestra.run.trial176.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T21:10:59.849 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:10:59.850 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:10:59.851 INFO:teuthology.orchestra.run.trial176.stdout: Package Architecture Version Repository Size 2026-02-17T21:10:59.851 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:10:59.851 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:10:59.851 INFO:teuthology.orchestra.run.trial176.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T21:10:59.851 INFO:teuthology.orchestra.run.trial176.stdout:Installing dependencies: 2026-02-17T21:10:59.851 INFO:teuthology.orchestra.run.trial176.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T21:10:59.851 INFO:teuthology.orchestra.run.trial176.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T21:10:59.851 INFO:teuthology.orchestra.run.trial176.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T21:10:59.851 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:10:59.851 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:10:59.851 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:10:59.852 INFO:teuthology.orchestra.run.trial176.stdout:Install 4 Packages 2026-02-17T21:10:59.852 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:10:59.852 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 88 M 2026-02-17T21:10:59.852 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 135 M 2026-02-17T21:10:59.852 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:10:59.866 INFO:teuthology.orchestra.run.trial119.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 20 kB 00:00 2026-02-17T21:11:00.270 INFO:teuthology.orchestra.run.trial176.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 5.0 MB/s | 803 kB 00:00 2026-02-17T21:11:00.311 INFO:teuthology.orchestra.run.trial176.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 86 MB/s | 17 MB 00:00 2026-02-17T21:11:00.448 INFO:teuthology.orchestra.run.trial119.stdout:Extra Packages for Enterprise Linux 39 MB/s | 20 MB 00:00 2026-02-17T21:11:00.473 INFO:teuthology.orchestra.run.trial176.stdout:(3/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 110 MB/s | 40 MB 00:00 2026-02-17T21:11:00.531 INFO:teuthology.orchestra.run.trial176.stdout:(4/4): kernel-modules-core-5.14.0-681.el9.x86_6 119 MB/s | 31 MB 00:00 2026-02-17T21:11:00.533 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:11:00.533 INFO:teuthology.orchestra.run.trial176.stdout:Total 129 MB/s | 88 MB 00:00 2026-02-17T21:11:00.726 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:11:00.931 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:11:00.932 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:11:01.280 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:11:01.280 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:11:02.370 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:11:02.656 INFO:teuthology.orchestra.run.trial176.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T21:11:02.676 INFO:teuthology.orchestra.run.trial176.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T21:11:02.911 INFO:teuthology.orchestra.run.trial135.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-17T21:11:03.043 INFO:teuthology.orchestra.run.trial005.stdout:(2/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 6.0 MB/s | 40 MB 00:06 2026-02-17T21:11:03.661 INFO:teuthology.orchestra.run.trial119.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-17T21:11:03.921 INFO:teuthology.orchestra.run.trial135.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T21:11:03.943 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:11:03.943 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:11:03.943 INFO:teuthology.orchestra.run.trial135.stdout: Package Architecture Version Repository Size 2026-02-17T21:11:03.943 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:11:03.944 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:11:03.944 INFO:teuthology.orchestra.run.trial135.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T21:11:03.944 INFO:teuthology.orchestra.run.trial135.stdout:Installing dependencies: 2026-02-17T21:11:03.944 INFO:teuthology.orchestra.run.trial135.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T21:11:03.944 INFO:teuthology.orchestra.run.trial135.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T21:11:03.944 INFO:teuthology.orchestra.run.trial135.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T21:11:03.944 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:11:03.944 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:11:03.944 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:11:03.944 INFO:teuthology.orchestra.run.trial135.stdout:Install 4 Packages 2026-02-17T21:11:03.944 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:11:03.944 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 88 M 2026-02-17T21:11:03.944 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 135 M 2026-02-17T21:11:03.944 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:11:04.271 INFO:teuthology.orchestra.run.trial135.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 11 MB/s | 803 kB 00:00 2026-02-17T21:11:04.378 INFO:teuthology.orchestra.run.trial135.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 97 MB/s | 17 MB 00:00 2026-02-17T21:11:04.455 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T21:11:04.483 INFO:teuthology.orchestra.run.trial176.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T21:11:04.515 INFO:teuthology.orchestra.run.trial135.stdout:(3/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 126 MB/s | 40 MB 00:00 2026-02-17T21:11:04.566 INFO:teuthology.orchestra.run.trial135.stdout:(4/4): kernel-modules-core-5.14.0-681.el9.x86_6 105 MB/s | 31 MB 00:00 2026-02-17T21:11:04.568 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:11:04.568 INFO:teuthology.orchestra.run.trial135.stdout:Total 142 MB/s | 88 MB 00:00 2026-02-17T21:11:04.680 INFO:teuthology.orchestra.run.trial119.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T21:11:04.702 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:11:04.703 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:11:04.703 INFO:teuthology.orchestra.run.trial119.stdout: Package Architecture Version Repository Size 2026-02-17T21:11:04.703 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:11:04.703 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:11:04.703 INFO:teuthology.orchestra.run.trial119.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T21:11:04.703 INFO:teuthology.orchestra.run.trial119.stdout:Installing dependencies: 2026-02-17T21:11:04.703 INFO:teuthology.orchestra.run.trial119.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T21:11:04.703 INFO:teuthology.orchestra.run.trial119.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T21:11:04.703 INFO:teuthology.orchestra.run.trial119.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T21:11:04.703 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:11:04.703 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:11:04.703 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:11:04.703 INFO:teuthology.orchestra.run.trial119.stdout:Install 4 Packages 2026-02-17T21:11:04.703 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:11:04.703 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 88 M 2026-02-17T21:11:04.703 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 135 M 2026-02-17T21:11:04.703 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:11:04.756 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:11:04.960 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:11:04.960 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:11:05.310 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:11:05.310 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:11:06.158 INFO:teuthology.orchestra.run.trial119.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 586 kB/s | 803 kB 00:01 2026-02-17T21:11:06.405 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:11:06.691 INFO:teuthology.orchestra.run.trial135.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T21:11:06.710 INFO:teuthology.orchestra.run.trial135.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T21:11:07.504 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T21:11:07.511 INFO:teuthology.orchestra.run.trial176.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T21:11:08.495 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T21:11:08.524 INFO:teuthology.orchestra.run.trial135.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T21:11:10.016 INFO:teuthology.orchestra.run.trial119.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 3.3 MB/s | 17 MB 00:05 2026-02-17T21:11:10.545 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T21:11:11.544 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T21:11:11.550 INFO:teuthology.orchestra.run.trial135.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T21:11:14.584 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T21:11:16.676 INFO:teuthology.orchestra.run.trial005.stdout:(3/4): kernel-core-5.14.0-681.el9.x86_64.rpm 863 kB/s | 17 MB 00:20 2026-02-17T21:11:33.118 INFO:teuthology.orchestra.run.trial005.stdout:(4/4): kernel-modules-core-5.14.0-681.el9.x86_6 892 kB/s | 31 MB 00:35 2026-02-17T21:11:33.120 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:11:33.120 INFO:teuthology.orchestra.run.trial005.stdout:Total 2.4 MB/s | 88 MB 00:36 2026-02-17T21:11:33.307 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:11:33.510 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:11:33.511 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:11:33.859 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:11:33.859 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:11:34.949 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:11:35.232 INFO:teuthology.orchestra.run.trial005.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T21:11:35.250 INFO:teuthology.orchestra.run.trial005.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T21:11:37.029 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T21:11:37.057 INFO:teuthology.orchestra.run.trial005.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T21:11:40.087 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T21:11:40.093 INFO:teuthology.orchestra.run.trial005.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T21:11:40.924 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T21:11:40.946 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T21:11:41.114 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T21:11:41.115 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T21:11:41.115 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T21:11:41.115 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T21:11:41.166 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T21:11:41.166 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:11:41.166 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:11:41.167 INFO:teuthology.orchestra.run.trial176.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T21:11:41.167 INFO:teuthology.orchestra.run.trial176.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T21:11:41.167 INFO:teuthology.orchestra.run.trial176.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T21:11:41.167 INFO:teuthology.orchestra.run.trial176.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T21:11:41.167 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:11:41.167 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:11:41.224 DEBUG:teuthology.orchestra.run.trial176:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T21:11:41.254 INFO:teuthology.orchestra.run.trial176.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T21:11:41.255 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T21:11:41.255 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T21:11:41.255 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T21:11:41.255 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T21:11:41.256 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2026-02-17T21:11:41.256 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial176.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T21:11:41.256 DEBUG:teuthology.orchestra.run.trial176:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T21:11:41.265 INFO:teuthology.orchestra.run.trial119.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 900 kB/s | 31 MB 00:35 2026-02-17T21:11:41.323 INFO:teuthology.orchestra.run.trial176.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T21:11:41.324 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T21:11:41.325 DEBUG:teuthology.orchestra.run.trial176:> sudo rpm -qi grub2-tools 2026-02-17T21:11:41.393 INFO:teuthology.orchestra.run.trial176.stdout:Name : grub2-tools 2026-02-17T21:11:41.393 INFO:teuthology.orchestra.run.trial176.stdout:Epoch : 1 2026-02-17T21:11:41.393 INFO:teuthology.orchestra.run.trial176.stdout:Version : 2.06 2026-02-17T21:11:41.393 INFO:teuthology.orchestra.run.trial176.stdout:Release : 118.el9 2026-02-17T21:11:41.393 INFO:teuthology.orchestra.run.trial176.stdout:Architecture: x86_64 2026-02-17T21:11:41.393 INFO:teuthology.orchestra.run.trial176.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T21:11:41.394 INFO:teuthology.orchestra.run.trial176.stdout:Group : Unspecified 2026-02-17T21:11:41.394 INFO:teuthology.orchestra.run.trial176.stdout:Size : 8393909 2026-02-17T21:11:41.394 INFO:teuthology.orchestra.run.trial176.stdout:License : GPLv3+ 2026-02-17T21:11:41.394 INFO:teuthology.orchestra.run.trial176.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T21:11:41.394 INFO:teuthology.orchestra.run.trial176.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T21:11:41.394 INFO:teuthology.orchestra.run.trial176.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T21:11:41.394 INFO:teuthology.orchestra.run.trial176.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T21:11:41.394 INFO:teuthology.orchestra.run.trial176.stdout:Packager : builder@centos.org 2026-02-17T21:11:41.394 INFO:teuthology.orchestra.run.trial176.stdout:Vendor : CentOS 2026-02-17T21:11:41.394 INFO:teuthology.orchestra.run.trial176.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T21:11:41.394 INFO:teuthology.orchestra.run.trial176.stdout:Summary : Support tools for GRUB. 2026-02-17T21:11:41.395 INFO:teuthology.orchestra.run.trial176.stdout:Description : 2026-02-17T21:11:41.395 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:11:41.395 INFO:teuthology.orchestra.run.trial176.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T21:11:41.395 INFO:teuthology.orchestra.run.trial176.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T21:11:41.395 INFO:teuthology.orchestra.run.trial176.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T21:11:41.395 INFO:teuthology.orchestra.run.trial176.stdout:hardware devices. 2026-02-17T21:11:41.395 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:11:41.395 INFO:teuthology.orchestra.run.trial176.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T21:11:41.396 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T21:11:41.397 INFO:teuthology.task.kernel:Updating grub on trial176 to boot 5.14.0-681.el9.x86_64 2026-02-17T21:11:41.397 DEBUG:teuthology.orchestra.run.trial176:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T21:11:41.460 INFO:teuthology.orchestra.run.trial176.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T21:11:41.461 DEBUG:teuthology.orchestra.run.trial176:> sudo command -v grubby && echo yes || echo no 2026-02-17T21:11:41.525 INFO:teuthology.orchestra.run.trial176.stdout:/sbin/grubby 2026-02-17T21:11:41.527 INFO:teuthology.orchestra.run.trial176.stdout:yes 2026-02-17T21:11:41.527 DEBUG:teuthology.orchestra.run.trial176:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T21:11:41.592 INFO:teuthology.orchestra.run.trial176.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T21:11:41.594 DEBUG:teuthology.orchestra.run.trial176:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T21:11:41.666 DEBUG:teuthology.orchestra.run.trial176:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T21:11:41.881 INFO:teuthology.orchestra.run.trial176.stderr:Generating grub configuration file ... 2026-02-17T21:11:41.946 INFO:teuthology.orchestra.run.trial176.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T21:11:41.952 INFO:teuthology.orchestra.run.trial176.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T21:11:42.204 INFO:teuthology.orchestra.run.trial176.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T21:11:42.210 INFO:teuthology.orchestra.run.trial176.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T21:11:42.241 INFO:teuthology.orchestra.run.trial176.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T21:11:42.247 INFO:teuthology.orchestra.run.trial176.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T21:11:42.270 INFO:teuthology.orchestra.run.trial176.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T21:11:42.276 INFO:teuthology.orchestra.run.trial176.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T21:11:42.361 INFO:teuthology.orchestra.run.trial176.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T21:11:42.369 INFO:teuthology.orchestra.run.trial176.stderr:done 2026-02-17T21:11:42.371 DEBUG:teuthology.orchestra.run.trial176:> test -d /sys/firmware/efi 2026-02-17T21:11:42.387 DEBUG:teuthology.orchestra.run.trial176:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T21:11:42.452 INFO:teuthology.orchestra.run.trial176.stdout:/boot/efi/EFI/BOOT 2026-02-17T21:11:42.452 INFO:teuthology.orchestra.run.trial176.stdout:/boot/efi/EFI/centos 2026-02-17T21:11:42.454 DEBUG:teuthology.orchestra.run.trial176:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T21:11:42.520 INFO:teuthology.orchestra.run.trial176.stdout:no 2026-02-17T21:11:42.520 DEBUG:teuthology.orchestra.run.trial176:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T21:11:42.583 INFO:teuthology.orchestra.run.trial176.stdout:yes 2026-02-17T21:11:42.584 DEBUG:teuthology.orchestra.run.trial176:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T21:11:42.648 DEBUG:teuthology.orchestra.run.trial176:> sudo shutdown -r now 2026-02-17T21:11:42.720 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-17T21:11:43.134 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T21:11:44.906 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T21:11:44.927 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T21:11:44.994 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T21:11:44.995 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T21:11:44.995 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T21:11:44.995 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T21:11:45.048 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T21:11:45.048 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:11:45.048 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:11:45.048 INFO:teuthology.orchestra.run.trial135.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T21:11:45.049 INFO:teuthology.orchestra.run.trial135.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T21:11:45.049 INFO:teuthology.orchestra.run.trial135.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T21:11:45.049 INFO:teuthology.orchestra.run.trial135.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T21:11:45.049 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:11:45.049 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:11:45.108 DEBUG:teuthology.orchestra.run.trial135:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T21:11:45.134 INFO:teuthology.orchestra.run.trial135.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T21:11:45.135 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T21:11:45.135 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T21:11:45.135 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T21:11:45.135 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T21:11:45.135 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2026-02-17T21:11:45.135 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial135.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T21:11:45.136 DEBUG:teuthology.orchestra.run.trial135:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T21:11:45.198 INFO:teuthology.orchestra.run.trial135.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T21:11:45.200 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T21:11:45.200 DEBUG:teuthology.orchestra.run.trial135:> sudo rpm -qi grub2-tools 2026-02-17T21:11:45.270 INFO:teuthology.orchestra.run.trial135.stdout:Name : grub2-tools 2026-02-17T21:11:45.271 INFO:teuthology.orchestra.run.trial135.stdout:Epoch : 1 2026-02-17T21:11:45.271 INFO:teuthology.orchestra.run.trial135.stdout:Version : 2.06 2026-02-17T21:11:45.271 INFO:teuthology.orchestra.run.trial135.stdout:Release : 118.el9 2026-02-17T21:11:45.271 INFO:teuthology.orchestra.run.trial135.stdout:Architecture: x86_64 2026-02-17T21:11:45.271 INFO:teuthology.orchestra.run.trial135.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T21:11:45.271 INFO:teuthology.orchestra.run.trial135.stdout:Group : Unspecified 2026-02-17T21:11:45.271 INFO:teuthology.orchestra.run.trial135.stdout:Size : 8393909 2026-02-17T21:11:45.271 INFO:teuthology.orchestra.run.trial135.stdout:License : GPLv3+ 2026-02-17T21:11:45.271 INFO:teuthology.orchestra.run.trial135.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T21:11:45.272 INFO:teuthology.orchestra.run.trial135.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T21:11:45.272 INFO:teuthology.orchestra.run.trial135.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T21:11:45.272 INFO:teuthology.orchestra.run.trial135.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T21:11:45.272 INFO:teuthology.orchestra.run.trial135.stdout:Packager : builder@centos.org 2026-02-17T21:11:45.272 INFO:teuthology.orchestra.run.trial135.stdout:Vendor : CentOS 2026-02-17T21:11:45.272 INFO:teuthology.orchestra.run.trial135.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T21:11:45.272 INFO:teuthology.orchestra.run.trial135.stdout:Summary : Support tools for GRUB. 2026-02-17T21:11:45.272 INFO:teuthology.orchestra.run.trial135.stdout:Description : 2026-02-17T21:11:45.272 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:11:45.272 INFO:teuthology.orchestra.run.trial135.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T21:11:45.272 INFO:teuthology.orchestra.run.trial135.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T21:11:45.273 INFO:teuthology.orchestra.run.trial135.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T21:11:45.273 INFO:teuthology.orchestra.run.trial135.stdout:hardware devices. 2026-02-17T21:11:45.273 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:11:45.273 INFO:teuthology.orchestra.run.trial135.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T21:11:45.274 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T21:11:45.274 INFO:teuthology.task.kernel:Updating grub on trial135 to boot 5.14.0-681.el9.x86_64 2026-02-17T21:11:45.274 DEBUG:teuthology.orchestra.run.trial135:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T21:11:45.337 INFO:teuthology.orchestra.run.trial135.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T21:11:45.338 DEBUG:teuthology.orchestra.run.trial135:> sudo command -v grubby && echo yes || echo no 2026-02-17T21:11:45.401 INFO:teuthology.orchestra.run.trial135.stdout:/sbin/grubby 2026-02-17T21:11:45.403 INFO:teuthology.orchestra.run.trial135.stdout:yes 2026-02-17T21:11:45.403 DEBUG:teuthology.orchestra.run.trial135:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T21:11:45.467 INFO:teuthology.orchestra.run.trial135.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T21:11:45.468 DEBUG:teuthology.orchestra.run.trial135:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T21:11:45.540 DEBUG:teuthology.orchestra.run.trial135:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T21:11:45.750 INFO:teuthology.orchestra.run.trial135.stderr:Generating grub configuration file ... 2026-02-17T21:11:45.813 INFO:teuthology.orchestra.run.trial135.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T21:11:45.819 INFO:teuthology.orchestra.run.trial135.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T21:11:46.065 INFO:teuthology.orchestra.run.trial135.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T21:11:46.072 INFO:teuthology.orchestra.run.trial135.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T21:11:46.103 INFO:teuthology.orchestra.run.trial135.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T21:11:46.110 INFO:teuthology.orchestra.run.trial135.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T21:11:46.134 INFO:teuthology.orchestra.run.trial135.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T21:11:46.141 INFO:teuthology.orchestra.run.trial135.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T21:11:46.221 INFO:teuthology.orchestra.run.trial135.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T21:11:46.230 INFO:teuthology.orchestra.run.trial135.stderr:done 2026-02-17T21:11:46.232 DEBUG:teuthology.orchestra.run.trial135:> test -d /sys/firmware/efi 2026-02-17T21:11:46.248 DEBUG:teuthology.orchestra.run.trial135:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T21:11:46.312 INFO:teuthology.orchestra.run.trial135.stdout:/boot/efi/EFI/BOOT 2026-02-17T21:11:46.312 INFO:teuthology.orchestra.run.trial135.stdout:/boot/efi/EFI/centos 2026-02-17T21:11:46.314 DEBUG:teuthology.orchestra.run.trial135:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T21:11:46.380 INFO:teuthology.orchestra.run.trial135.stdout:no 2026-02-17T21:11:46.380 DEBUG:teuthology.orchestra.run.trial135:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T21:11:46.446 INFO:teuthology.orchestra.run.trial135.stdout:yes 2026-02-17T21:11:46.447 DEBUG:teuthology.orchestra.run.trial135:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T21:11:46.511 DEBUG:teuthology.orchestra.run.trial135:> sudo shutdown -r now 2026-02-17T21:11:50.636 INFO:teuthology.orchestra.run.trial119.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 884 kB/s | 40 MB 00:45 2026-02-17T21:11:50.638 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:11:50.638 INFO:teuthology.orchestra.run.trial119.stdout:Total 1.9 MB/s | 88 MB 00:45 2026-02-17T21:11:50.827 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:11:51.037 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:11:51.037 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:11:51.384 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:11:51.385 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:11:52.471 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:11:52.751 INFO:teuthology.orchestra.run.trial119.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T21:11:52.770 INFO:teuthology.orchestra.run.trial119.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T21:11:54.551 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T21:11:54.580 INFO:teuthology.orchestra.run.trial119.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T21:11:57.666 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T21:11:57.672 INFO:teuthology.orchestra.run.trial119.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T21:12:00.709 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T21:12:12.690 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2026-02-17T21:12:12.691 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial176.front.sepia.ceph.com' 2026-02-17T21:12:12.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T21:12:13.342 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T21:12:13.364 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T21:12:13.431 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T21:12:13.431 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T21:12:13.431 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T21:12:13.431 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T21:12:13.483 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T21:12:13.484 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:12:13.484 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:12:13.484 INFO:teuthology.orchestra.run.trial005.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T21:12:13.484 INFO:teuthology.orchestra.run.trial005.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T21:12:13.484 INFO:teuthology.orchestra.run.trial005.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T21:12:13.484 INFO:teuthology.orchestra.run.trial005.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T21:12:13.484 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:12:13.484 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:12:13.541 DEBUG:teuthology.orchestra.run.trial005:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T21:12:13.566 INFO:teuthology.orchestra.run.trial005.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T21:12:13.568 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T21:12:13.568 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T21:12:13.568 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T21:12:13.568 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T21:12:13.568 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T21:12:13.568 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial005.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T21:12:13.569 DEBUG:teuthology.orchestra.run.trial005:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T21:12:13.630 INFO:teuthology.orchestra.run.trial005.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T21:12:13.631 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T21:12:13.631 DEBUG:teuthology.orchestra.run.trial005:> sudo rpm -qi grub2-tools 2026-02-17T21:12:13.699 INFO:teuthology.orchestra.run.trial005.stdout:Name : grub2-tools 2026-02-17T21:12:13.700 INFO:teuthology.orchestra.run.trial005.stdout:Epoch : 1 2026-02-17T21:12:13.700 INFO:teuthology.orchestra.run.trial005.stdout:Version : 2.06 2026-02-17T21:12:13.700 INFO:teuthology.orchestra.run.trial005.stdout:Release : 118.el9 2026-02-17T21:12:13.700 INFO:teuthology.orchestra.run.trial005.stdout:Architecture: x86_64 2026-02-17T21:12:13.700 INFO:teuthology.orchestra.run.trial005.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T21:12:13.700 INFO:teuthology.orchestra.run.trial005.stdout:Group : Unspecified 2026-02-17T21:12:13.700 INFO:teuthology.orchestra.run.trial005.stdout:Size : 8393909 2026-02-17T21:12:13.700 INFO:teuthology.orchestra.run.trial005.stdout:License : GPLv3+ 2026-02-17T21:12:13.700 INFO:teuthology.orchestra.run.trial005.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T21:12:13.700 INFO:teuthology.orchestra.run.trial005.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T21:12:13.700 INFO:teuthology.orchestra.run.trial005.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T21:12:13.701 INFO:teuthology.orchestra.run.trial005.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T21:12:13.701 INFO:teuthology.orchestra.run.trial005.stdout:Packager : builder@centos.org 2026-02-17T21:12:13.701 INFO:teuthology.orchestra.run.trial005.stdout:Vendor : CentOS 2026-02-17T21:12:13.701 INFO:teuthology.orchestra.run.trial005.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T21:12:13.701 INFO:teuthology.orchestra.run.trial005.stdout:Summary : Support tools for GRUB. 2026-02-17T21:12:13.701 INFO:teuthology.orchestra.run.trial005.stdout:Description : 2026-02-17T21:12:13.701 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:12:13.701 INFO:teuthology.orchestra.run.trial005.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T21:12:13.701 INFO:teuthology.orchestra.run.trial005.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T21:12:13.701 INFO:teuthology.orchestra.run.trial005.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T21:12:13.701 INFO:teuthology.orchestra.run.trial005.stdout:hardware devices. 2026-02-17T21:12:13.701 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:12:13.702 INFO:teuthology.orchestra.run.trial005.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T21:12:13.703 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T21:12:13.703 INFO:teuthology.task.kernel:Updating grub on trial005 to boot 5.14.0-681.el9.x86_64 2026-02-17T21:12:13.703 DEBUG:teuthology.orchestra.run.trial005:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T21:12:13.765 INFO:teuthology.orchestra.run.trial005.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T21:12:13.767 DEBUG:teuthology.orchestra.run.trial005:> sudo command -v grubby && echo yes || echo no 2026-02-17T21:12:13.831 INFO:teuthology.orchestra.run.trial005.stdout:/sbin/grubby 2026-02-17T21:12:13.832 INFO:teuthology.orchestra.run.trial005.stdout:yes 2026-02-17T21:12:13.833 DEBUG:teuthology.orchestra.run.trial005:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T21:12:13.895 INFO:teuthology.orchestra.run.trial005.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T21:12:13.897 DEBUG:teuthology.orchestra.run.trial005:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T21:12:13.970 DEBUG:teuthology.orchestra.run.trial005:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T21:12:14.177 INFO:teuthology.orchestra.run.trial005.stderr:Generating grub configuration file ... 2026-02-17T21:12:14.239 INFO:teuthology.orchestra.run.trial005.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T21:12:14.246 INFO:teuthology.orchestra.run.trial005.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T21:12:14.492 INFO:teuthology.orchestra.run.trial005.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T21:12:14.498 INFO:teuthology.orchestra.run.trial005.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T21:12:14.530 INFO:teuthology.orchestra.run.trial005.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T21:12:14.537 INFO:teuthology.orchestra.run.trial005.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T21:12:14.559 INFO:teuthology.orchestra.run.trial005.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T21:12:14.566 INFO:teuthology.orchestra.run.trial005.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T21:12:14.647 INFO:teuthology.orchestra.run.trial005.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T21:12:14.655 INFO:teuthology.orchestra.run.trial005.stderr:done 2026-02-17T21:12:14.657 DEBUG:teuthology.orchestra.run.trial005:> test -d /sys/firmware/efi 2026-02-17T21:12:14.673 DEBUG:teuthology.orchestra.run.trial005:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T21:12:14.738 INFO:teuthology.orchestra.run.trial005.stdout:/boot/efi/EFI/BOOT 2026-02-17T21:12:14.738 INFO:teuthology.orchestra.run.trial005.stdout:/boot/efi/EFI/centos 2026-02-17T21:12:14.740 DEBUG:teuthology.orchestra.run.trial005:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T21:12:14.807 INFO:teuthology.orchestra.run.trial005.stdout:no 2026-02-17T21:12:14.807 DEBUG:teuthology.orchestra.run.trial005:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T21:12:14.871 INFO:teuthology.orchestra.run.trial005.stdout:yes 2026-02-17T21:12:14.872 DEBUG:teuthology.orchestra.run.trial005:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T21:12:14.935 DEBUG:teuthology.orchestra.run.trial005:> sudo shutdown -r now 2026-02-17T21:12:15.008 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-17T21:12:16.553 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-17T21:12:16.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial135.front.sepia.ceph.com' 2026-02-17T21:12:16.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T21:12:30.989 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T21:12:31.010 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T21:12:31.074 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T21:12:31.075 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T21:12:31.075 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T21:12:31.075 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T21:12:31.126 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T21:12:31.126 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:12:31.126 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:12:31.126 INFO:teuthology.orchestra.run.trial119.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T21:12:31.126 INFO:teuthology.orchestra.run.trial119.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T21:12:31.127 INFO:teuthology.orchestra.run.trial119.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T21:12:31.127 INFO:teuthology.orchestra.run.trial119.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T21:12:31.127 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:12:31.127 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:12:31.182 DEBUG:teuthology.orchestra.run.trial119:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T21:12:31.210 INFO:teuthology.orchestra.run.trial119.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T21:12:31.210 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T21:12:31.211 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T21:12:31.211 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T21:12:31.211 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T21:12:31.211 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-17T21:12:31.211 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial119.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T21:12:31.211 DEBUG:teuthology.orchestra.run.trial119:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T21:12:31.274 INFO:teuthology.orchestra.run.trial119.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T21:12:31.275 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T21:12:31.275 DEBUG:teuthology.orchestra.run.trial119:> sudo rpm -qi grub2-tools 2026-02-17T21:12:31.342 INFO:teuthology.orchestra.run.trial119.stdout:Name : grub2-tools 2026-02-17T21:12:31.342 INFO:teuthology.orchestra.run.trial119.stdout:Epoch : 1 2026-02-17T21:12:31.342 INFO:teuthology.orchestra.run.trial119.stdout:Version : 2.06 2026-02-17T21:12:31.343 INFO:teuthology.orchestra.run.trial119.stdout:Release : 118.el9 2026-02-17T21:12:31.343 INFO:teuthology.orchestra.run.trial119.stdout:Architecture: x86_64 2026-02-17T21:12:31.343 INFO:teuthology.orchestra.run.trial119.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T21:12:31.343 INFO:teuthology.orchestra.run.trial119.stdout:Group : Unspecified 2026-02-17T21:12:31.343 INFO:teuthology.orchestra.run.trial119.stdout:Size : 8393909 2026-02-17T21:12:31.343 INFO:teuthology.orchestra.run.trial119.stdout:License : GPLv3+ 2026-02-17T21:12:31.343 INFO:teuthology.orchestra.run.trial119.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T21:12:31.343 INFO:teuthology.orchestra.run.trial119.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T21:12:31.343 INFO:teuthology.orchestra.run.trial119.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T21:12:31.343 INFO:teuthology.orchestra.run.trial119.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T21:12:31.343 INFO:teuthology.orchestra.run.trial119.stdout:Packager : builder@centos.org 2026-02-17T21:12:31.344 INFO:teuthology.orchestra.run.trial119.stdout:Vendor : CentOS 2026-02-17T21:12:31.344 INFO:teuthology.orchestra.run.trial119.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T21:12:31.344 INFO:teuthology.orchestra.run.trial119.stdout:Summary : Support tools for GRUB. 2026-02-17T21:12:31.344 INFO:teuthology.orchestra.run.trial119.stdout:Description : 2026-02-17T21:12:31.344 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:12:31.344 INFO:teuthology.orchestra.run.trial119.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T21:12:31.344 INFO:teuthology.orchestra.run.trial119.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T21:12:31.344 INFO:teuthology.orchestra.run.trial119.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T21:12:31.344 INFO:teuthology.orchestra.run.trial119.stdout:hardware devices. 2026-02-17T21:12:31.344 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:12:31.344 INFO:teuthology.orchestra.run.trial119.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T21:12:31.345 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T21:12:31.346 INFO:teuthology.task.kernel:Updating grub on trial119 to boot 5.14.0-681.el9.x86_64 2026-02-17T21:12:31.346 DEBUG:teuthology.orchestra.run.trial119:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T21:12:31.409 INFO:teuthology.orchestra.run.trial119.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T21:12:31.410 DEBUG:teuthology.orchestra.run.trial119:> sudo command -v grubby && echo yes || echo no 2026-02-17T21:12:31.474 INFO:teuthology.orchestra.run.trial119.stdout:/sbin/grubby 2026-02-17T21:12:31.475 INFO:teuthology.orchestra.run.trial119.stdout:yes 2026-02-17T21:12:31.476 DEBUG:teuthology.orchestra.run.trial119:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T21:12:31.540 INFO:teuthology.orchestra.run.trial119.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T21:12:31.540 DEBUG:teuthology.orchestra.run.trial119:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T21:12:31.615 DEBUG:teuthology.orchestra.run.trial119:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T21:12:31.828 INFO:teuthology.orchestra.run.trial119.stderr:Generating grub configuration file ... 2026-02-17T21:12:31.891 INFO:teuthology.orchestra.run.trial119.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T21:12:31.898 INFO:teuthology.orchestra.run.trial119.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T21:12:32.150 INFO:teuthology.orchestra.run.trial119.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T21:12:32.157 INFO:teuthology.orchestra.run.trial119.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T21:12:32.189 INFO:teuthology.orchestra.run.trial119.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T21:12:32.196 INFO:teuthology.orchestra.run.trial119.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T21:12:32.219 INFO:teuthology.orchestra.run.trial119.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T21:12:32.225 INFO:teuthology.orchestra.run.trial119.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T21:12:32.308 INFO:teuthology.orchestra.run.trial119.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T21:12:32.316 INFO:teuthology.orchestra.run.trial119.stderr:done 2026-02-17T21:12:32.318 DEBUG:teuthology.orchestra.run.trial119:> test -d /sys/firmware/efi 2026-02-17T21:12:32.334 DEBUG:teuthology.orchestra.run.trial119:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T21:12:32.400 INFO:teuthology.orchestra.run.trial119.stdout:/boot/efi/EFI/BOOT 2026-02-17T21:12:32.400 INFO:teuthology.orchestra.run.trial119.stdout:/boot/efi/EFI/centos 2026-02-17T21:12:32.402 DEBUG:teuthology.orchestra.run.trial119:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T21:12:32.469 INFO:teuthology.orchestra.run.trial119.stdout:no 2026-02-17T21:12:32.470 DEBUG:teuthology.orchestra.run.trial119:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T21:12:32.534 INFO:teuthology.orchestra.run.trial119.stdout:yes 2026-02-17T21:12:32.535 DEBUG:teuthology.orchestra.run.trial119:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T21:12:32.599 DEBUG:teuthology.orchestra.run.trial119:> sudo shutdown -r now 2026-02-17T21:12:44.991 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T21:12:44.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial005.front.sepia.ceph.com' 2026-02-17T21:12:44.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T21:13:02.647 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-17T21:13:02.648 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-17T21:13:02.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T21:13:12.705 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T21:13:16.560 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T21:13:21.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial176.front.sepia.ceph.com' 2026-02-17T21:13:21.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T21:13:21.884 DEBUG:teuthology.orchestra.run.trial176:> true 2026-02-17T21:13:22.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial176.front.sepia.ceph.com' 2026-02-17T21:13:22.034 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-681.el9.x86_64"... 2026-02-17T21:13:22.034 DEBUG:teuthology.orchestra.run.trial176:> uname -r 2026-02-17T21:13:22.091 INFO:teuthology.orchestra.run.trial176.stdout:5.14.0-681.el9.x86_64 2026-02-17T21:13:22.091 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T21:13:22.091 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T21:13:22.091 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T21:13:23.093 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2026-02-17T21:13:23.093 DEBUG:teuthology.orchestra.run.trial176:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T21:13:23.123 INFO:teuthology.orchestra.run.trial176.stdout:ttyS1 2026-02-17T21:13:23.143 DEBUG:teuthology.parallel:result is None 2026-02-17T21:13:25.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial135.front.sepia.ceph.com' 2026-02-17T21:13:25.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T21:13:25.697 DEBUG:teuthology.orchestra.run.trial135:> true 2026-02-17T21:13:25.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial135.front.sepia.ceph.com' 2026-02-17T21:13:25.853 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-681.el9.x86_64"... 2026-02-17T21:13:25.853 DEBUG:teuthology.orchestra.run.trial135:> uname -r 2026-02-17T21:13:25.908 INFO:teuthology.orchestra.run.trial135.stdout:5.14.0-681.el9.x86_64 2026-02-17T21:13:25.908 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T21:13:25.908 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T21:13:25.908 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T21:13:26.909 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2026-02-17T21:13:26.909 DEBUG:teuthology.orchestra.run.trial135:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T21:13:26.939 INFO:teuthology.orchestra.run.trial135.stdout:ttyS1 2026-02-17T21:13:26.966 DEBUG:teuthology.parallel:result is None 2026-02-17T21:13:44.994 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T21:13:53.995 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial005.front.sepia.ceph.com' 2026-02-17T21:13:53.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T21:13:54.133 DEBUG:teuthology.orchestra.run.trial005:> true 2026-02-17T21:13:54.284 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial005.front.sepia.ceph.com' 2026-02-17T21:13:54.284 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-681.el9.x86_64"... 2026-02-17T21:13:54.284 DEBUG:teuthology.orchestra.run.trial005:> uname -r 2026-02-17T21:13:54.340 INFO:teuthology.orchestra.run.trial005.stdout:5.14.0-681.el9.x86_64 2026-02-17T21:13:54.341 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T21:13:54.341 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T21:13:54.341 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T21:13:55.342 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T21:13:55.342 DEBUG:teuthology.orchestra.run.trial005:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T21:13:55.373 INFO:teuthology.orchestra.run.trial005.stdout:ttyS1 2026-02-17T21:13:55.395 DEBUG:teuthology.parallel:result is None 2026-02-17T21:14:02.650 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T21:14:11.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-17T21:14:11.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T21:14:11.791 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-17T21:14:11.934 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-17T21:14:11.934 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-681.el9.x86_64"... 2026-02-17T21:14:11.934 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-17T21:14:11.989 INFO:teuthology.orchestra.run.trial119.stdout:5.14.0-681.el9.x86_64 2026-02-17T21:14:11.990 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T21:14:11.990 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T21:14:11.990 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T21:14:12.991 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2026-02-17T21:14:12.991 DEBUG:teuthology.orchestra.run.trial119:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T21:14:13.020 INFO:teuthology.orchestra.run.trial119.stdout:ttyS1 2026-02-17T21:14:13.049 DEBUG:teuthology.parallel:result is None 2026-02-17T21:14:13.050 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T21:14:13.060 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T21:14:13.061 DEBUG:teuthology.orchestra.run.trial005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T21:14:13.063 DEBUG:teuthology.orchestra.run.trial119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T21:14:13.091 DEBUG:teuthology.orchestra.run.trial135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T21:14:13.094 DEBUG:teuthology.orchestra.run.trial176:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T21:14:13.112 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T21:14:13.124 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T21:14:13.139 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T21:14:13.139 DEBUG:teuthology.orchestra.run.trial005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T21:14:13.142 DEBUG:teuthology.orchestra.run.trial119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T21:14:13.150 DEBUG:teuthology.orchestra.run.trial135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T21:14:13.153 DEBUG:teuthology.orchestra.run.trial176:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T21:14:13.183 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T21:14:13.195 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T21:14:13.196 DEBUG:teuthology.orchestra.run.trial005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T21:14:13.200 DEBUG:teuthology.orchestra.run.trial119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T21:14:13.207 DEBUG:teuthology.orchestra.run.trial135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T21:14:13.210 DEBUG:teuthology.orchestra.run.trial176:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T21:14:13.222 INFO:teuthology.orchestra.run.trial005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T21:14:13.229 INFO:teuthology.orchestra.run.trial119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T21:14:13.230 INFO:teuthology.orchestra.run.trial005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T21:14:13.231 INFO:teuthology.orchestra.run.trial135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T21:14:13.236 INFO:teuthology.orchestra.run.trial176.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T21:14:13.237 INFO:teuthology.orchestra.run.trial119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T21:14:13.240 INFO:teuthology.orchestra.run.trial135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T21:14:13.245 INFO:teuthology.orchestra.run.trial176.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T21:14:13.246 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T21:14:13.259 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T21:14:13.259 DEBUG:teuthology.orchestra.run.trial005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T21:14:13.274 DEBUG:teuthology.orchestra.run.trial119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T21:14:13.281 DEBUG:teuthology.orchestra.run.trial135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T21:14:13.285 DEBUG:teuthology.orchestra.run.trial176:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T21:14:13.310 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T21:14:13.323 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T21:14:13.324 DEBUG:teuthology.orchestra.run.trial005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T21:14:13.340 DEBUG:teuthology.orchestra.run.trial119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T21:14:13.344 DEBUG:teuthology.orchestra.run.trial135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T21:14:13.349 DEBUG:teuthology.orchestra.run.trial176:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T21:14:13.366 DEBUG:teuthology.orchestra.run.trial005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T21:14:13.514 DEBUG:teuthology.orchestra.run.trial005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T21:14:13.539 DEBUG:teuthology.orchestra.run.trial005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T21:14:13.686 DEBUG:teuthology.orchestra.run.trial005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T21:14:13.710 DEBUG:teuthology.orchestra.run.trial005:> set -ex 2026-02-17T21:14:13.710 DEBUG:teuthology.orchestra.run.trial005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T21:14:13.772 DEBUG:teuthology.orchestra.run.trial119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T21:14:13.854 DEBUG:teuthology.orchestra.run.trial119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T21:14:13.879 DEBUG:teuthology.orchestra.run.trial119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T21:14:13.999 DEBUG:teuthology.orchestra.run.trial119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T21:14:14.022 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T21:14:14.022 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T21:14:14.086 DEBUG:teuthology.orchestra.run.trial135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T21:14:14.167 DEBUG:teuthology.orchestra.run.trial135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T21:14:14.192 DEBUG:teuthology.orchestra.run.trial135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T21:14:14.320 DEBUG:teuthology.orchestra.run.trial135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T21:14:14.344 DEBUG:teuthology.orchestra.run.trial135:> set -ex 2026-02-17T21:14:14.344 DEBUG:teuthology.orchestra.run.trial135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T21:14:14.407 DEBUG:teuthology.orchestra.run.trial176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T21:14:14.512 DEBUG:teuthology.orchestra.run.trial176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T21:14:14.537 DEBUG:teuthology.orchestra.run.trial176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T21:14:14.672 DEBUG:teuthology.orchestra.run.trial176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T21:14:14.696 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T21:14:14.696 DEBUG:teuthology.orchestra.run.trial176:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T21:14:14.760 DEBUG:teuthology.orchestra.run.trial005:> sudo service rsyslog restart 2026-02-17T21:14:14.763 DEBUG:teuthology.orchestra.run.trial119:> sudo service rsyslog restart 2026-02-17T21:14:14.767 DEBUG:teuthology.orchestra.run.trial135:> sudo service rsyslog restart 2026-02-17T21:14:14.769 DEBUG:teuthology.orchestra.run.trial176:> sudo service rsyslog restart 2026-02-17T21:14:14.789 INFO:teuthology.orchestra.run.trial005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T21:14:14.793 INFO:teuthology.orchestra.run.trial119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T21:14:14.795 INFO:teuthology.orchestra.run.trial135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T21:14:14.828 INFO:teuthology.orchestra.run.trial176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T21:14:15.309 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T21:14:15.322 INFO:teuthology.task.internal:Starting timer... 2026-02-17T21:14:15.322 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T21:14:15.344 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T21:14:15.361 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2026-02-17T21:14:15.361 DEBUG:teuthology.orchestra.run.trial005:> sudo service auditd rotate 2026-02-17T21:14:15.391 INFO:teuthology.orchestra.run.trial005.stdout:Rotating logs: 2026-02-17T21:14:15.393 DEBUG:teuthology.orchestra.run.trial119:> sudo service auditd rotate 2026-02-17T21:14:15.422 INFO:teuthology.orchestra.run.trial119.stdout:Rotating logs: 2026-02-17T21:14:15.423 DEBUG:teuthology.orchestra.run.trial135:> sudo service auditd rotate 2026-02-17T21:14:15.453 INFO:teuthology.orchestra.run.trial135.stdout:Rotating logs: 2026-02-17T21:14:15.455 DEBUG:teuthology.orchestra.run.trial176:> sudo service auditd rotate 2026-02-17T21:14:15.484 INFO:teuthology.orchestra.run.trial176.stdout:Rotating logs: 2026-02-17T21:14:15.485 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T21:14:15.485 DEBUG:teuthology.orchestra.run.trial005:> /usr/sbin/getenforce 2026-02-17T21:14:15.504 INFO:teuthology.orchestra.run.trial005.stdout:Permissive 2026-02-17T21:14:15.504 DEBUG:teuthology.orchestra.run.trial119:> /usr/sbin/getenforce 2026-02-17T21:14:15.523 INFO:teuthology.orchestra.run.trial119.stdout:Permissive 2026-02-17T21:14:15.524 DEBUG:teuthology.orchestra.run.trial135:> /usr/sbin/getenforce 2026-02-17T21:14:15.543 INFO:teuthology.orchestra.run.trial135.stdout:Permissive 2026-02-17T21:14:15.544 DEBUG:teuthology.orchestra.run.trial176:> /usr/sbin/getenforce 2026-02-17T21:14:15.562 INFO:teuthology.orchestra.run.trial176.stdout:Permissive 2026-02-17T21:14:15.563 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial005.front.sepia.ceph.com': 'permissive', 'ubuntu@trial119.front.sepia.ceph.com': 'permissive', 'ubuntu@trial135.front.sepia.ceph.com': 'permissive', 'ubuntu@trial176.front.sepia.ceph.com': 'permissive'} 2026-02-17T21:14:15.563 DEBUG:teuthology.orchestra.run.trial005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T21:14:15.589 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:14:15.589 DEBUG:teuthology.orchestra.run.trial119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T21:14:15.613 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:14:15.614 DEBUG:teuthology.orchestra.run.trial135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T21:14:15.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:14:15.641 DEBUG:teuthology.orchestra.run.trial176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T21:14:15.666 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:14:15.666 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T21:14:15.666 DEBUG:teuthology.orchestra.run.trial005:> sudo /usr/sbin/setenforce permissive 2026-02-17T21:14:15.690 DEBUG:teuthology.orchestra.run.trial119:> sudo /usr/sbin/setenforce permissive 2026-02-17T21:14:15.715 DEBUG:teuthology.orchestra.run.trial135:> sudo /usr/sbin/setenforce permissive 2026-02-17T21:14:15.740 DEBUG:teuthology.orchestra.run.trial176:> sudo /usr/sbin/setenforce permissive 2026-02-17T21:14:15.765 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T21:14:15.783 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-17T21:14:15.785 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-17T21:14:15.889 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T21:14:15.899 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T21:14:15.900 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial005.front.sepia.ceph.com,trial119.front.sepia.ceph.com,trial135.front.sepia.ceph.com,trial176.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T21:15:49.922 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial005.front.sepia.ceph.com'), Remote(name='ubuntu@trial119.front.sepia.ceph.com'), Remote(name='ubuntu@trial135.front.sepia.ceph.com'), Remote(name='ubuntu@trial176.front.sepia.ceph.com')] 2026-02-17T21:15:49.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial005.front.sepia.ceph.com' 2026-02-17T21:15:49.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T21:15:50.038 DEBUG:teuthology.orchestra.run.trial005:> true 2026-02-17T21:15:50.115 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial005.front.sepia.ceph.com' 2026-02-17T21:15:50.116 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-17T21:15:50.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T21:15:50.215 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-17T21:15:50.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-17T21:15:50.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial135.front.sepia.ceph.com' 2026-02-17T21:15:50.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T21:15:50.383 DEBUG:teuthology.orchestra.run.trial135:> true 2026-02-17T21:15:50.458 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial135.front.sepia.ceph.com' 2026-02-17T21:15:50.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial176.front.sepia.ceph.com' 2026-02-17T21:15:50.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T21:15:50.544 DEBUG:teuthology.orchestra.run.trial176:> true 2026-02-17T21:15:50.624 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial176.front.sepia.ceph.com' 2026-02-17T21:15:50.624 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T21:15:50.638 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T21:15:50.638 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T21:15:50.639 DEBUG:teuthology.orchestra.run.trial005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T21:15:50.641 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T21:15:50.642 DEBUG:teuthology.orchestra.run.trial119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T21:15:50.644 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T21:15:50.644 DEBUG:teuthology.orchestra.run.trial135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T21:15:50.646 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T21:15:50.646 DEBUG:teuthology.orchestra.run.trial176:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T21:15:50.668 INFO:teuthology.orchestra.run.trial005.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T21:15:50.669 INFO:teuthology.orchestra.run.trial119.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T21:15:50.672 INFO:teuthology.orchestra.run.trial135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T21:15:50.680 INFO:teuthology.orchestra.run.trial005.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T21:15:50.681 INFO:teuthology.orchestra.run.trial119.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T21:15:50.684 INFO:teuthology.orchestra.run.trial135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T21:15:50.690 INFO:teuthology.orchestra.run.trial176.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T21:15:50.700 INFO:teuthology.orchestra.run.trial005.stderr:sudo: ntpd: command not found 2026-02-17T21:15:50.701 INFO:teuthology.orchestra.run.trial119.stderr:sudo: ntpd: command not found 2026-02-17T21:15:50.702 INFO:teuthology.orchestra.run.trial176.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T21:15:50.703 INFO:teuthology.orchestra.run.trial135.stderr:sudo: ntpd: command not found 2026-02-17T21:15:50.710 INFO:teuthology.orchestra.run.trial005.stdout:506 Cannot talk to daemon 2026-02-17T21:15:50.710 INFO:teuthology.orchestra.run.trial119.stdout:506 Cannot talk to daemon 2026-02-17T21:15:50.712 INFO:teuthology.orchestra.run.trial135.stdout:506 Cannot talk to daemon 2026-02-17T21:15:50.721 INFO:teuthology.orchestra.run.trial005.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T21:15:50.722 INFO:teuthology.orchestra.run.trial176.stderr:sudo: ntpd: command not found 2026-02-17T21:15:50.723 INFO:teuthology.orchestra.run.trial119.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T21:15:50.724 INFO:teuthology.orchestra.run.trial135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T21:15:50.731 INFO:teuthology.orchestra.run.trial176.stdout:506 Cannot talk to daemon 2026-02-17T21:15:50.733 INFO:teuthology.orchestra.run.trial005.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T21:15:50.734 INFO:teuthology.orchestra.run.trial119.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T21:15:50.735 INFO:teuthology.orchestra.run.trial135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T21:15:50.743 INFO:teuthology.orchestra.run.trial176.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T21:15:50.753 INFO:teuthology.orchestra.run.trial176.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T21:15:50.776 INFO:teuthology.orchestra.run.trial119.stderr:bash: line 1: ntpq: command not found 2026-02-17T21:15:50.777 INFO:teuthology.orchestra.run.trial005.stderr:bash: line 1: ntpq: command not found 2026-02-17T21:15:50.778 INFO:teuthology.orchestra.run.trial135.stderr:bash: line 1: ntpq: command not found 2026-02-17T21:15:50.795 INFO:teuthology.orchestra.run.trial119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T21:15:50.795 INFO:teuthology.orchestra.run.trial119.stdout:=============================================================================== 2026-02-17T21:15:50.795 INFO:teuthology.orchestra.run.trial119.stdout:^? 172-235-154-118.ip.linod> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T21:15:50.795 INFO:teuthology.orchestra.run.trial119.stdout:^? s2-b.time.mci1.us.rozint> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T21:15:50.795 INFO:teuthology.orchestra.run.trial119.stdout:^? jmpxus.no.sigint.today 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T21:15:50.795 INFO:teuthology.orchestra.run.trial119.stdout:^? lax1.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T21:15:50.797 INFO:teuthology.orchestra.run.trial135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T21:15:50.797 INFO:teuthology.orchestra.run.trial135.stdout:=============================================================================== 2026-02-17T21:15:50.797 INFO:teuthology.orchestra.run.trial135.stdout:^? 66.42.71.197.vultruserco> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T21:15:50.797 INFO:teuthology.orchestra.run.trial135.stdout:^? pool-138-89-14-60.mad.ea> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T21:15:50.797 INFO:teuthology.orchestra.run.trial135.stdout:^? 69-10-208-170.rainiercon> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T21:15:50.797 INFO:teuthology.orchestra.run.trial135.stdout:^? 50.205.57.38 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T21:15:50.799 INFO:teuthology.orchestra.run.trial176.stderr:bash: line 1: ntpq: command not found 2026-02-17T21:15:50.816 INFO:teuthology.orchestra.run.trial005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T21:15:50.816 INFO:teuthology.orchestra.run.trial005.stdout:=============================================================================== 2026-02-17T21:15:50.816 INFO:teuthology.orchestra.run.trial005.stdout:^? 170-187-142-180.ip.linod> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T21:15:50.816 INFO:teuthology.orchestra.run.trial005.stdout:^? 204.2.134.172 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T21:15:50.816 INFO:teuthology.orchestra.run.trial005.stdout:^? time.cloudflare.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T21:15:50.817 INFO:teuthology.orchestra.run.trial005.stdout:^? 66.59.198.178 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T21:15:50.820 INFO:teuthology.orchestra.run.trial176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T21:15:50.820 INFO:teuthology.orchestra.run.trial176.stdout:=============================================================================== 2026-02-17T21:15:50.820 INFO:teuthology.orchestra.run.trial176.stdout:^? 24-111-79-186-dynamic.mi> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T21:15:50.820 INFO:teuthology.orchestra.run.trial176.stdout:^? owners.kjsl.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T21:15:50.820 INFO:teuthology.orchestra.run.trial176.stdout:^? ntp11.kernfusion.at 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T21:15:50.821 INFO:teuthology.orchestra.run.trial176.stdout:^? 144.202.62.209.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T21:15:50.821 INFO:teuthology.run_tasks:Running task install... 2026-02-17T21:15:50.835 DEBUG:teuthology.task.install:project ceph 2026-02-17T21:15:50.835 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'd855f53b89fdcec760fd9232a5fb55ed4fb111a1'}} 2026-02-17T21:15:50.835 DEBUG:teuthology.task.install:config {'debuginfo': True, 'flavor': 'default', 'sha1': 'd855f53b89fdcec760fd9232a5fb55ed4fb111a1'} 2026-02-17T21:15:50.836 INFO:teuthology.task.install:Using flavor: default 2026-02-17T21:15:50.844 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2026-02-17T21:15:50.844 INFO:teuthology.task.install:extra packages: [] 2026-02-17T21:15:50.845 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd855f53b89fdcec760fd9232a5fb55ed4fb111a1', 'tag': None, 'wait_for_package': False} 2026-02-17T21:15:50.846 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d855f53b89fdcec760fd9232a5fb55ed4fb111a1 2026-02-17T21:15:50.848 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd855f53b89fdcec760fd9232a5fb55ed4fb111a1', 'tag': None, 'wait_for_package': False} 2026-02-17T21:15:50.849 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d855f53b89fdcec760fd9232a5fb55ed4fb111a1 2026-02-17T21:15:50.850 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd855f53b89fdcec760fd9232a5fb55ed4fb111a1', 'tag': None, 'wait_for_package': False} 2026-02-17T21:15:50.851 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d855f53b89fdcec760fd9232a5fb55ed4fb111a1 2026-02-17T21:15:50.852 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd855f53b89fdcec760fd9232a5fb55ed4fb111a1', 'tag': None, 'wait_for_package': False} 2026-02-17T21:15:50.852 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d855f53b89fdcec760fd9232a5fb55ed4fb111a1 2026-02-17T21:15:51.097 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/ 2026-02-17T21:15:51.098 INFO:teuthology.task.install.rpm:Package version is 19.2.3-679.gd855f53b 2026-02-17T21:15:51.100 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/ 2026-02-17T21:15:51.100 INFO:teuthology.task.install.rpm:Package version is 19.2.3-679.gd855f53b 2026-02-17T21:15:51.100 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/ 2026-02-17T21:15:51.100 INFO:teuthology.task.install.rpm:Package version is 19.2.3-679.gd855f53b 2026-02-17T21:15:51.106 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/ 2026-02-17T21:15:51.106 INFO:teuthology.task.install.rpm:Package version is 19.2.3-679.gd855f53b 2026-02-17T21:15:51.327 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T21:15:51.327 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T21:15:51.327 DEBUG:teuthology.orchestra.run.trial176:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T21:15:51.329 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T21:15:51.330 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T21:15:51.330 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T21:15:51.330 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T21:15:51.330 DEBUG:teuthology.orchestra.run.trial005:> set -ex 2026-02-17T21:15:51.330 DEBUG:teuthology.orchestra.run.trial005:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T21:15:51.337 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T21:15:51.337 DEBUG:teuthology.orchestra.run.trial135:> set -ex 2026-02-17T21:15:51.337 DEBUG:teuthology.orchestra.run.trial135:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T21:15:51.355 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-17T21:15:51.355 DEBUG:teuthology.orchestra.run.trial119:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T21:15:51.355 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-17T21:15:51.356 DEBUG:teuthology.orchestra.run.trial176:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T21:15:51.356 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-17T21:15:51.356 DEBUG:teuthology.orchestra.run.trial005:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T21:15:51.362 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-17T21:15:51.362 DEBUG:teuthology.orchestra.run.trial135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T21:15:51.419 DEBUG:teuthology.orchestra.run.trial176:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T21:15:51.421 DEBUG:teuthology.orchestra.run.trial119:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T21:15:51.421 DEBUG:teuthology.orchestra.run.trial005:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T21:15:51.426 DEBUG:teuthology.orchestra.run.trial135:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T21:15:51.493 DEBUG:teuthology.orchestra.run.trial119:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T21:15:51.495 DEBUG:teuthology.orchestra.run.trial005:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T21:15:51.495 DEBUG:teuthology.orchestra.run.trial176:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T21:15:51.498 DEBUG:teuthology.orchestra.run.trial135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T21:15:51.558 INFO:teuthology.orchestra.run.trial119.stdout:check_obsoletes = 1 2026-02-17T21:15:51.558 INFO:teuthology.orchestra.run.trial176.stdout:check_obsoletes = 1 2026-02-17T21:15:51.559 DEBUG:teuthology.orchestra.run.trial119:> sudo yum clean all 2026-02-17T21:15:51.560 INFO:teuthology.orchestra.run.trial005.stdout:check_obsoletes = 1 2026-02-17T21:15:51.561 DEBUG:teuthology.orchestra.run.trial176:> sudo yum clean all 2026-02-17T21:15:51.563 INFO:teuthology.orchestra.run.trial135.stdout:check_obsoletes = 1 2026-02-17T21:15:51.564 DEBUG:teuthology.orchestra.run.trial005:> sudo yum clean all 2026-02-17T21:15:51.564 DEBUG:teuthology.orchestra.run.trial135:> sudo yum clean all 2026-02-17T21:15:51.709 INFO:teuthology.orchestra.run.trial119.stdout:41 files removed 2026-02-17T21:15:51.710 INFO:teuthology.orchestra.run.trial135.stdout:41 files removed 2026-02-17T21:15:51.712 INFO:teuthology.orchestra.run.trial176.stdout:41 files removed 2026-02-17T21:15:51.712 INFO:teuthology.orchestra.run.trial005.stdout:41 files removed 2026-02-17T21:15:51.723 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-radosgw 2026-02-17T21:15:51.725 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install ceph-radosgw 2026-02-17T21:15:51.727 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install ceph-radosgw 2026-02-17T21:15:51.729 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-radosgw 2026-02-17T21:15:51.991 INFO:teuthology.orchestra.run.trial119.stdout:ceph packages for x86_64 684 kB/s | 86 kB 00:00 2026-02-17T21:15:51.998 INFO:teuthology.orchestra.run.trial135.stdout:ceph packages for x86_64 670 kB/s | 86 kB 00:00 2026-02-17T21:15:52.000 INFO:teuthology.orchestra.run.trial176.stdout:ceph packages for x86_64 684 kB/s | 86 kB 00:00 2026-02-17T21:15:52.001 INFO:teuthology.orchestra.run.trial005.stdout:ceph packages for x86_64 665 kB/s | 86 kB 00:00 2026-02-17T21:15:52.122 INFO:teuthology.orchestra.run.trial119.stdout:ceph noarch packages 114 kB/s | 12 kB 00:00 2026-02-17T21:15:52.128 INFO:teuthology.orchestra.run.trial135.stdout:ceph noarch packages 114 kB/s | 12 kB 00:00 2026-02-17T21:15:52.130 INFO:teuthology.orchestra.run.trial176.stdout:ceph noarch packages 115 kB/s | 12 kB 00:00 2026-02-17T21:15:52.132 INFO:teuthology.orchestra.run.trial005.stdout:ceph noarch packages 113 kB/s | 12 kB 00:00 2026-02-17T21:15:52.247 INFO:teuthology.orchestra.run.trial119.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-17T21:15:52.253 INFO:teuthology.orchestra.run.trial135.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-17T21:15:52.255 INFO:teuthology.orchestra.run.trial176.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-17T21:15:52.258 INFO:teuthology.orchestra.run.trial005.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-17T21:15:53.250 INFO:teuthology.orchestra.run.trial135.stdout:CentOS Stream 9 - BaseOS 9.1 MB/s | 8.9 MB 00:00 2026-02-17T21:15:53.928 INFO:teuthology.orchestra.run.trial119.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 8.9 MB 00:01 2026-02-17T21:15:56.032 INFO:teuthology.orchestra.run.trial176.stdout:CentOS Stream 9 - BaseOS 2.4 MB/s | 8.9 MB 00:03 2026-02-17T21:15:57.025 INFO:teuthology.orchestra.run.trial135.stdout:CentOS Stream 9 - AppStream 8.3 MB/s | 27 MB 00:03 2026-02-17T21:15:57.140 INFO:teuthology.orchestra.run.trial119.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-17T21:15:58.872 INFO:teuthology.orchestra.run.trial005.stdout:CentOS Stream 9 - BaseOS 1.3 MB/s | 8.9 MB 00:06 2026-02-17T21:16:00.275 INFO:teuthology.orchestra.run.trial135.stdout:CentOS Stream 9 - CRB 8.8 MB/s | 7.8 MB 00:00 2026-02-17T21:16:00.874 INFO:teuthology.orchestra.run.trial119.stdout:CentOS Stream 9 - CRB 5.8 MB/s | 7.8 MB 00:01 2026-02-17T21:16:01.804 INFO:teuthology.orchestra.run.trial119.stdout:CentOS Stream 9 - Extras packages 99 kB/s | 20 kB 00:00 2026-02-17T21:16:02.102 INFO:teuthology.orchestra.run.trial119.stdout:Extra Packages for Enterprise Linux 87 MB/s | 20 MB 00:00 2026-02-17T21:16:02.299 INFO:teuthology.orchestra.run.trial176.stdout:CentOS Stream 9 - AppStream 4.7 MB/s | 27 MB 00:05 2026-02-17T21:16:02.335 INFO:teuthology.orchestra.run.trial135.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 20 kB 00:01 2026-02-17T21:16:03.334 INFO:teuthology.orchestra.run.trial135.stdout:Extra Packages for Enterprise Linux 22 MB/s | 20 MB 00:00 2026-02-17T21:16:05.341 INFO:teuthology.orchestra.run.trial119.stdout:lab-extras 1.4 MB/s | 50 kB 00:00 2026-02-17T21:16:05.929 INFO:teuthology.orchestra.run.trial176.stdout:CentOS Stream 9 - CRB 6.3 MB/s | 7.8 MB 00:01 2026-02-17T21:16:06.486 INFO:teuthology.orchestra.run.trial135.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-17T21:16:06.553 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:06.555 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:06.555 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repository Size 2026-02-17T21:16:06.555 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:06.555 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:16:06.555 INFO:teuthology.orchestra.run.trial119.stdout: ceph-radosgw x86_64 2:19.2.3-679.gd855f53b.el9 ceph 11 M 2026-02-17T21:16:06.555 INFO:teuthology.orchestra.run.trial119.stdout:Upgrading: 2026-02-17T21:16:06.555 INFO:teuthology.orchestra.run.trial119.stdout: librados2 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 3.4 M 2026-02-17T21:16:06.555 INFO:teuthology.orchestra.run.trial119.stdout: librbd1 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 3.2 M 2026-02-17T21:16:06.555 INFO:teuthology.orchestra.run.trial119.stdout:Installing dependencies: 2026-02-17T21:16:06.555 INFO:teuthology.orchestra.run.trial119.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T21:16:06.556 INFO:teuthology.orchestra.run.trial119.stdout: ceph-base x86_64 2:19.2.3-679.gd855f53b.el9 ceph 5.5 M 2026-02-17T21:16:06.556 INFO:teuthology.orchestra.run.trial119.stdout: ceph-common x86_64 2:19.2.3-679.gd855f53b.el9 ceph 22 M 2026-02-17T21:16:06.556 INFO:teuthology.orchestra.run.trial119.stdout: ceph-selinux x86_64 2:19.2.3-679.gd855f53b.el9 ceph 25 k 2026-02-17T21:16:06.556 INFO:teuthology.orchestra.run.trial119.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T21:16:06.556 INFO:teuthology.orchestra.run.trial119.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T21:16:06.556 INFO:teuthology.orchestra.run.trial119.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T21:16:06.556 INFO:teuthology.orchestra.run.trial119.stdout: libcephfs2 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.0 M 2026-02-17T21:16:06.556 INFO:teuthology.orchestra.run.trial119.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T21:16:06.556 INFO:teuthology.orchestra.run.trial119.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T21:16:06.556 INFO:teuthology.orchestra.run.trial119.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T21:16:06.556 INFO:teuthology.orchestra.run.trial119.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T21:16:06.556 INFO:teuthology.orchestra.run.trial119.stdout: libradosstriper1 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 504 k 2026-02-17T21:16:06.556 INFO:teuthology.orchestra.run.trial119.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T21:16:06.557 INFO:teuthology.orchestra.run.trial119.stdout: librgw2 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 5.4 M 2026-02-17T21:16:06.557 INFO:teuthology.orchestra.run.trial119.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T21:16:06.557 INFO:teuthology.orchestra.run.trial119.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T21:16:06.557 INFO:teuthology.orchestra.run.trial119.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T21:16:06.557 INFO:teuthology.orchestra.run.trial119.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T21:16:06.557 INFO:teuthology.orchestra.run.trial119.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T21:16:06.557 INFO:teuthology.orchestra.run.trial119.stdout: python3-ceph-argparse x86_64 2:19.2.3-679.gd855f53b.el9 ceph 45 k 2026-02-17T21:16:06.557 INFO:teuthology.orchestra.run.trial119.stdout: python3-ceph-common x86_64 2:19.2.3-679.gd855f53b.el9 ceph 142 k 2026-02-17T21:16:06.557 INFO:teuthology.orchestra.run.trial119.stdout: python3-cephfs x86_64 2:19.2.3-679.gd855f53b.el9 ceph 165 k 2026-02-17T21:16:06.557 INFO:teuthology.orchestra.run.trial119.stdout: python3-rados x86_64 2:19.2.3-679.gd855f53b.el9 ceph 322 k 2026-02-17T21:16:06.557 INFO:teuthology.orchestra.run.trial119.stdout: python3-rbd x86_64 2:19.2.3-679.gd855f53b.el9 ceph 303 k 2026-02-17T21:16:06.557 INFO:teuthology.orchestra.run.trial119.stdout: python3-rgw x86_64 2:19.2.3-679.gd855f53b.el9 ceph 100 k 2026-02-17T21:16:06.557 INFO:teuthology.orchestra.run.trial119.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T21:16:06.558 INFO:teuthology.orchestra.run.trial119.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T21:16:06.558 INFO:teuthology.orchestra.run.trial119.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T21:16:06.558 INFO:teuthology.orchestra.run.trial119.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T21:16:06.558 INFO:teuthology.orchestra.run.trial119.stdout:Installing weak dependencies: 2026-02-17T21:16:06.558 INFO:teuthology.orchestra.run.trial119.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T21:16:06.558 INFO:teuthology.orchestra.run.trial119.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T21:16:06.558 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:06.558 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:16:06.558 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:06.558 INFO:teuthology.orchestra.run.trial119.stdout:Install 33 Packages 2026-02-17T21:16:06.558 INFO:teuthology.orchestra.run.trial119.stdout:Upgrade 2 Packages 2026-02-17T21:16:06.559 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:06.559 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 63 M 2026-02-17T21:16:06.559 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:16:07.315 INFO:teuthology.orchestra.run.trial119.stdout:(1/35): ceph-base-19.2.3-679.gd855f53b.el9.x86_ 16 MB/s | 5.5 MB 00:00 2026-02-17T21:16:07.354 INFO:teuthology.orchestra.run.trial119.stdout:(2/35): ceph-selinux-19.2.3-679.gd855f53b.el9.x 647 kB/s | 25 kB 00:00 2026-02-17T21:16:07.414 INFO:teuthology.orchestra.run.trial119.stdout:(3/35): libcephfs2-19.2.3-679.gd855f53b.el9.x86 16 MB/s | 1.0 MB 00:00 2026-02-17T21:16:07.466 INFO:teuthology.orchestra.run.trial119.stdout:(4/35): libradosstriper1-19.2.3-679.gd855f53b.e 9.6 MB/s | 504 kB 00:00 2026-02-17T21:16:07.478 INFO:teuthology.orchestra.run.trial176.stdout:CentOS Stream 9 - Extras packages 24 kB/s | 20 kB 00:00 2026-02-17T21:16:07.574 INFO:teuthology.orchestra.run.trial119.stdout:(5/35): ceph-radosgw-19.2.3-679.gd855f53b.el9.x 18 MB/s | 11 MB 00:00 2026-02-17T21:16:07.617 INFO:teuthology.orchestra.run.trial119.stdout:(6/35): python3-ceph-argparse-19.2.3-679.gd855f 1.0 MB/s | 45 kB 00:00 2026-02-17T21:16:07.670 INFO:teuthology.orchestra.run.trial119.stdout:(7/35): python3-ceph-common-19.2.3-679.gd855f53 2.6 MB/s | 142 kB 00:00 2026-02-17T21:16:07.706 INFO:teuthology.orchestra.run.trial119.stdout:(8/35): librgw2-19.2.3-679.gd855f53b.el9.x86_64 22 MB/s | 5.4 MB 00:00 2026-02-17T21:16:07.712 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:07.714 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:07.714 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repository Size 2026-02-17T21:16:07.714 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:07.714 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:16:07.714 INFO:teuthology.orchestra.run.trial135.stdout: ceph-radosgw x86_64 2:19.2.3-679.gd855f53b.el9 ceph 11 M 2026-02-17T21:16:07.714 INFO:teuthology.orchestra.run.trial135.stdout:Upgrading: 2026-02-17T21:16:07.715 INFO:teuthology.orchestra.run.trial135.stdout: librados2 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 3.4 M 2026-02-17T21:16:07.715 INFO:teuthology.orchestra.run.trial135.stdout: librbd1 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 3.2 M 2026-02-17T21:16:07.715 INFO:teuthology.orchestra.run.trial135.stdout:Installing dependencies: 2026-02-17T21:16:07.715 INFO:teuthology.orchestra.run.trial135.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T21:16:07.715 INFO:teuthology.orchestra.run.trial135.stdout: ceph-base x86_64 2:19.2.3-679.gd855f53b.el9 ceph 5.5 M 2026-02-17T21:16:07.715 INFO:teuthology.orchestra.run.trial135.stdout: ceph-common x86_64 2:19.2.3-679.gd855f53b.el9 ceph 22 M 2026-02-17T21:16:07.715 INFO:teuthology.orchestra.run.trial135.stdout: ceph-selinux x86_64 2:19.2.3-679.gd855f53b.el9 ceph 25 k 2026-02-17T21:16:07.715 INFO:teuthology.orchestra.run.trial135.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T21:16:07.715 INFO:teuthology.orchestra.run.trial135.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T21:16:07.715 INFO:teuthology.orchestra.run.trial135.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T21:16:07.715 INFO:teuthology.orchestra.run.trial135.stdout: libcephfs2 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.0 M 2026-02-17T21:16:07.715 INFO:teuthology.orchestra.run.trial135.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T21:16:07.716 INFO:teuthology.orchestra.run.trial135.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T21:16:07.716 INFO:teuthology.orchestra.run.trial135.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T21:16:07.716 INFO:teuthology.orchestra.run.trial135.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T21:16:07.716 INFO:teuthology.orchestra.run.trial135.stdout: libradosstriper1 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 504 k 2026-02-17T21:16:07.716 INFO:teuthology.orchestra.run.trial135.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T21:16:07.716 INFO:teuthology.orchestra.run.trial135.stdout: librgw2 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 5.4 M 2026-02-17T21:16:07.716 INFO:teuthology.orchestra.run.trial135.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T21:16:07.716 INFO:teuthology.orchestra.run.trial135.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T21:16:07.716 INFO:teuthology.orchestra.run.trial135.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T21:16:07.716 INFO:teuthology.orchestra.run.trial135.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T21:16:07.716 INFO:teuthology.orchestra.run.trial135.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T21:16:07.716 INFO:teuthology.orchestra.run.trial135.stdout: python3-ceph-argparse x86_64 2:19.2.3-679.gd855f53b.el9 ceph 45 k 2026-02-17T21:16:07.716 INFO:teuthology.orchestra.run.trial135.stdout: python3-ceph-common x86_64 2:19.2.3-679.gd855f53b.el9 ceph 142 k 2026-02-17T21:16:07.716 INFO:teuthology.orchestra.run.trial135.stdout: python3-cephfs x86_64 2:19.2.3-679.gd855f53b.el9 ceph 165 k 2026-02-17T21:16:07.717 INFO:teuthology.orchestra.run.trial135.stdout: python3-rados x86_64 2:19.2.3-679.gd855f53b.el9 ceph 322 k 2026-02-17T21:16:07.717 INFO:teuthology.orchestra.run.trial135.stdout: python3-rbd x86_64 2:19.2.3-679.gd855f53b.el9 ceph 303 k 2026-02-17T21:16:07.717 INFO:teuthology.orchestra.run.trial135.stdout: python3-rgw x86_64 2:19.2.3-679.gd855f53b.el9 ceph 100 k 2026-02-17T21:16:07.717 INFO:teuthology.orchestra.run.trial135.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T21:16:07.717 INFO:teuthology.orchestra.run.trial135.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T21:16:07.717 INFO:teuthology.orchestra.run.trial135.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T21:16:07.717 INFO:teuthology.orchestra.run.trial135.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T21:16:07.717 INFO:teuthology.orchestra.run.trial135.stdout:Installing weak dependencies: 2026-02-17T21:16:07.717 INFO:teuthology.orchestra.run.trial135.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T21:16:07.717 INFO:teuthology.orchestra.run.trial135.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T21:16:07.717 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:07.717 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:16:07.718 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:07.718 INFO:teuthology.orchestra.run.trial135.stdout:Install 33 Packages 2026-02-17T21:16:07.718 INFO:teuthology.orchestra.run.trial135.stdout:Upgrade 2 Packages 2026-02-17T21:16:07.718 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:07.718 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 63 M 2026-02-17T21:16:07.719 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:16:07.722 INFO:teuthology.orchestra.run.trial119.stdout:(9/35): python3-cephfs-19.2.3-679.gd855f53b.el9 3.1 MB/s | 165 kB 00:00 2026-02-17T21:16:07.742 INFO:teuthology.orchestra.run.trial119.stdout:(10/35): python3-rados-19.2.3-679.gd855f53b.el9 8.8 MB/s | 322 kB 00:00 2026-02-17T21:16:07.761 INFO:teuthology.orchestra.run.trial119.stdout:(11/35): python3-rbd-19.2.3-679.gd855f53b.el9.x 7.5 MB/s | 303 kB 00:00 2026-02-17T21:16:07.777 INFO:teuthology.orchestra.run.trial119.stdout:(12/35): python3-rgw-19.2.3-679.gd855f53b.el9.x 2.8 MB/s | 100 kB 00:00 2026-02-17T21:16:07.838 INFO:teuthology.orchestra.run.trial119.stdout:(13/35): mailcap-2.1.49-5.el9.noarch.rpm 436 kB/s | 33 kB 00:00 2026-02-17T21:16:07.843 INFO:teuthology.orchestra.run.trial119.stdout:(14/35): nvme-cli-2.13-1.el9.x86_64.rpm 17 MB/s | 1.1 MB 00:00 2026-02-17T21:16:07.876 INFO:teuthology.orchestra.run.trial119.stdout:(15/35): ceph-common-19.2.3-679.gd855f53b.el9.x 24 MB/s | 22 MB 00:00 2026-02-17T21:16:07.879 INFO:teuthology.orchestra.run.trial119.stdout:(16/35): pciutils-3.7.0-7.el9.x86_64.rpm 2.2 MB/s | 93 kB 00:00 2026-02-17T21:16:07.940 INFO:teuthology.orchestra.run.trial119.stdout:(17/35): boost-program-options-1.75.0-13.el9.x8 1.1 MB/s | 104 kB 00:00 2026-02-17T21:16:07.949 INFO:teuthology.orchestra.run.trial176.stdout:Extra Packages for Enterprise Linux 50 MB/s | 20 MB 00:00 2026-02-17T21:16:07.961 INFO:teuthology.orchestra.run.trial119.stdout:(18/35): libnbd-1.20.3-4.el9.x86_64.rpm 1.9 MB/s | 164 kB 00:00 2026-02-17T21:16:07.962 INFO:teuthology.orchestra.run.trial119.stdout:(19/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.0 MB/s | 45 kB 00:00 2026-02-17T21:16:07.964 INFO:teuthology.orchestra.run.trial119.stdout:(20/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.8 MB/s | 160 kB 00:00 2026-02-17T21:16:08.006 INFO:teuthology.orchestra.run.trial119.stdout:(21/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.5 MB/s | 292 kB 00:00 2026-02-17T21:16:08.010 INFO:teuthology.orchestra.run.trial119.stdout:(22/35): qatlib-25.08.0-2.el9.x86_64.rpm 5.1 MB/s | 240 kB 00:00 2026-02-17T21:16:08.028 INFO:teuthology.orchestra.run.trial119.stdout:(23/35): qatlib-service-25.08.0-2.el9.x86_64.rp 1.7 MB/s | 37 kB 00:00 2026-02-17T21:16:08.032 INFO:teuthology.orchestra.run.trial119.stdout:(24/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.9 MB/s | 66 kB 00:00 2026-02-17T21:16:08.035 INFO:teuthology.orchestra.run.trial119.stdout:(25/35): librdkafka-1.6.1-102.el9.x86_64.rpm 8.8 MB/s | 662 kB 00:00 2026-02-17T21:16:08.144 INFO:teuthology.orchestra.run.trial119.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 227 kB/s | 25 kB 00:00 2026-02-17T21:16:08.214 INFO:teuthology.orchestra.run.trial119.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 703 kB/s | 49 kB 00:00 2026-02-17T21:16:08.258 INFO:teuthology.orchestra.run.trial119.stdout:(28/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.3 MB/s | 308 kB 00:00 2026-02-17T21:16:08.265 INFO:teuthology.orchestra.run.trial119.stdout:(29/35): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2026-02-17T21:16:08.350 INFO:teuthology.orchestra.run.trial119.stdout:(30/35): re2-20211101-20.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2026-02-17T21:16:08.361 INFO:teuthology.orchestra.run.trial119.stdout:(31/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 7.9 MB/s | 838 kB 00:00 2026-02-17T21:16:08.394 INFO:teuthology.orchestra.run.trial119.stdout:(32/35): libarrow-9.0.0-15.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2026-02-17T21:16:08.487 INFO:teuthology.orchestra.run.trial119.stdout:(33/35): thrift-0.15.0-4.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2026-02-17T21:16:08.669 INFO:teuthology.orchestra.run.trial135.stdout:(1/35): ceph-base-19.2.3-679.gd855f53b.el9.x86_ 13 MB/s | 5.5 MB 00:00 2026-02-17T21:16:08.719 INFO:teuthology.orchestra.run.trial135.stdout:(2/35): ceph-selinux-19.2.3-679.gd855f53b.el9.x 498 kB/s | 25 kB 00:00 2026-02-17T21:16:08.721 INFO:teuthology.orchestra.run.trial119.stdout:(34/35): librbd1-19.2.3-679.gd855f53b.el9.x86_6 9.7 MB/s | 3.2 MB 00:00 2026-02-17T21:16:08.726 INFO:teuthology.orchestra.run.trial119.stdout:(35/35): librados2-19.2.3-679.gd855f53b.el9.x86 9.4 MB/s | 3.4 MB 00:00 2026-02-17T21:16:08.728 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:08.728 INFO:teuthology.orchestra.run.trial119.stdout:Total 29 MB/s | 63 MB 00:02 2026-02-17T21:16:08.787 INFO:teuthology.orchestra.run.trial135.stdout:(3/35): libcephfs2-19.2.3-679.gd855f53b.el9.x86 14 MB/s | 1.0 MB 00:00 2026-02-17T21:16:08.822 INFO:teuthology.orchestra.run.trial135.stdout:(4/35): libradosstriper1-19.2.3-679.gd855f53b.e 14 MB/s | 504 kB 00:00 2026-02-17T21:16:08.829 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:16:08.848 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:16:08.848 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:16:08.974 INFO:teuthology.orchestra.run.trial135.stdout:(5/35): ceph-radosgw-19.2.3-679.gd855f53b.el9.x 15 MB/s | 11 MB 00:00 2026-02-17T21:16:09.003 INFO:teuthology.orchestra.run.trial135.stdout:(6/35): python3-ceph-argparse-19.2.3-679.gd855f 1.5 MB/s | 45 kB 00:00 2026-02-17T21:16:09.033 INFO:teuthology.orchestra.run.trial135.stdout:(7/35): python3-ceph-common-19.2.3-679.gd855f53 4.6 MB/s | 142 kB 00:00 2026-02-17T21:16:09.063 INFO:teuthology.orchestra.run.trial135.stdout:(8/35): librgw2-19.2.3-679.gd855f53b.el9.x86_64 22 MB/s | 5.4 MB 00:00 2026-02-17T21:16:09.064 INFO:teuthology.orchestra.run.trial135.stdout:(9/35): python3-cephfs-19.2.3-679.gd855f53b.el9 5.2 MB/s | 165 kB 00:00 2026-02-17T21:16:09.083 INFO:teuthology.orchestra.run.trial135.stdout:(10/35): python3-rados-19.2.3-679.gd855f53b.el9 16 MB/s | 322 kB 00:00 2026-02-17T21:16:09.089 INFO:teuthology.orchestra.run.trial135.stdout:(11/35): python3-rbd-19.2.3-679.gd855f53b.el9.x 12 MB/s | 303 kB 00:00 2026-02-17T21:16:09.099 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:16:09.099 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:16:09.103 INFO:teuthology.orchestra.run.trial135.stdout:(12/35): python3-rgw-19.2.3-679.gd855f53b.el9.x 4.8 MB/s | 100 kB 00:00 2026-02-17T21:16:09.159 INFO:teuthology.orchestra.run.trial135.stdout:(13/35): mailcap-2.1.49-5.el9.noarch.rpm 475 kB/s | 33 kB 00:00 2026-02-17T21:16:09.175 INFO:teuthology.orchestra.run.trial135.stdout:(14/35): nvme-cli-2.13-1.el9.x86_64.rpm 15 MB/s | 1.1 MB 00:00 2026-02-17T21:16:09.191 INFO:teuthology.orchestra.run.trial135.stdout:(15/35): pciutils-3.7.0-7.el9.x86_64.rpm 2.9 MB/s | 93 kB 00:00 2026-02-17T21:16:09.197 INFO:teuthology.orchestra.run.trial135.stdout:(16/35): boost-program-options-1.75.0-13.el9.x8 4.8 MB/s | 104 kB 00:00 2026-02-17T21:16:09.206 INFO:teuthology.orchestra.run.trial135.stdout:(17/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 18 MB/s | 160 kB 00:00 2026-02-17T21:16:09.208 INFO:teuthology.orchestra.run.trial135.stdout:(18/35): libnbd-1.20.3-4.el9.x86_64.rpm 9.0 MB/s | 164 kB 00:00 2026-02-17T21:16:09.210 INFO:teuthology.orchestra.run.trial135.stdout:(19/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 10 MB/s | 45 kB 00:00 2026-02-17T21:16:09.244 INFO:teuthology.orchestra.run.trial135.stdout:(20/35): ceph-common-19.2.3-679.gd855f53b.el9.x 22 MB/s | 22 MB 00:01 2026-02-17T21:16:09.245 INFO:teuthology.orchestra.run.trial135.stdout:(21/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 8.3 MB/s | 292 kB 00:00 2026-02-17T21:16:09.249 INFO:teuthology.orchestra.run.trial135.stdout:(22/35): qatlib-service-25.08.0-2.el9.x86_64.rp 8.6 MB/s | 37 kB 00:00 2026-02-17T21:16:09.254 INFO:teuthology.orchestra.run.trial135.stdout:(23/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 15 MB/s | 66 kB 00:00 2026-02-17T21:16:09.258 INFO:teuthology.orchestra.run.trial135.stdout:(24/35): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2026-02-17T21:16:09.264 INFO:teuthology.orchestra.run.trial135.stdout:(25/35): qatlib-25.08.0-2.el9.x86_64.rpm 11 MB/s | 240 kB 00:00 2026-02-17T21:16:09.358 INFO:teuthology.orchestra.run.trial135.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 265 kB/s | 25 kB 00:00 2026-02-17T21:16:09.390 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:16:09.399 INFO:teuthology.orchestra.run.trial119.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T21:16:09.401 INFO:teuthology.orchestra.run.trial119.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T21:16:09.413 INFO:teuthology.orchestra.run.trial119.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T21:16:09.421 INFO:teuthology.orchestra.run.trial135.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 776 kB/s | 49 kB 00:00 2026-02-17T21:16:09.449 INFO:teuthology.orchestra.run.trial135.stdout:(28/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.5 MB/s | 308 kB 00:00 2026-02-17T21:16:09.454 INFO:teuthology.orchestra.run.trial135.stdout:(29/35): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2026-02-17T21:16:09.518 INFO:teuthology.orchestra.run.trial135.stdout:(30/35): re2-20211101-20.el9.x86_64.rpm 2.9 MB/s | 191 kB 00:00 2026-02-17T21:16:09.547 INFO:teuthology.orchestra.run.trial135.stdout:(31/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 8.4 MB/s | 838 kB 00:00 2026-02-17T21:16:09.563 INFO:teuthology.orchestra.run.trial119.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T21:16:09.569 INFO:teuthology.orchestra.run.trial119.stdout: Upgrading : librados2-2:19.2.3-679.gd855f53b.el9.x86_64 5/37 2026-02-17T21:16:09.599 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: librados2-2:19.2.3-679.gd855f53b.el9.x86_64 5/37 2026-02-17T21:16:09.622 INFO:teuthology.orchestra.run.trial135.stdout:(32/35): librados2-19.2.3-679.gd855f53b.el9.x86 46 MB/s | 3.4 MB 00:00 2026-02-17T21:16:09.644 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 6/37 2026-02-17T21:16:09.645 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 7/37 2026-02-17T21:16:09.657 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 7/37 2026-02-17T21:16:09.661 INFO:teuthology.orchestra.run.trial119.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T21:16:09.669 INFO:teuthology.orchestra.run.trial135.stdout:(33/35): libarrow-9.0.0-15.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2026-02-17T21:16:09.670 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-ceph-argparse-2:19.2.3-679.gd855f53b.el9.x 9/37 2026-02-17T21:16:09.672 INFO:teuthology.orchestra.run.trial135.stdout:(34/35): thrift-0.15.0-4.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2026-02-17T21:16:09.682 INFO:teuthology.orchestra.run.trial135.stdout:(35/35): librbd1-19.2.3-679.gd855f53b.el9.x86_6 53 MB/s | 3.2 MB 00:00 2026-02-17T21:16:09.684 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:09.684 INFO:teuthology.orchestra.run.trial135.stdout:Total 32 MB/s | 63 MB 00:01 2026-02-17T21:16:09.692 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 10/37 2026-02-17T21:16:09.693 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 11/37 2026-02-17T21:16:09.706 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 11/37 2026-02-17T21:16:09.742 INFO:teuthology.orchestra.run.trial119.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T21:16:09.746 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T21:16:09.754 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T21:16:09.756 INFO:teuthology.orchestra.run.trial119.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T21:16:09.760 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T21:16:09.764 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T21:16:09.787 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:16:09.805 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:16:09.806 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:16:09.903 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T21:16:09.904 INFO:teuthology.orchestra.run.trial119.stdout: Upgrading : librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 19/37 2026-02-17T21:16:09.930 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 19/37 2026-02-17T21:16:09.932 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 20/37 2026-02-17T21:16:09.939 INFO:teuthology.orchestra.run.trial119.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T21:16:10.054 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:16:10.055 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:16:10.161 INFO:teuthology.orchestra.run.trial119.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T21:16:10.162 INFO:teuthology.orchestra.run.trial119.stdout: Installing : librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 23/37 2026-02-17T21:16:10.171 INFO:teuthology.orchestra.run.trial005.stdout:CentOS Stream 9 - AppStream 2.5 MB/s | 27 MB 00:10 2026-02-17T21:16:10.178 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 23/37 2026-02-17T21:16:10.182 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 24/37 2026-02-17T21:16:10.186 INFO:teuthology.orchestra.run.trial119.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T21:16:10.189 INFO:teuthology.orchestra.run.trial119.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T21:16:10.189 INFO:teuthology.orchestra.run.trial119.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T21:16:10.208 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T21:16:10.321 INFO:teuthology.orchestra.run.trial119.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T21:16:10.323 INFO:teuthology.orchestra.run.trial119.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T21:16:10.343 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:16:10.352 INFO:teuthology.orchestra.run.trial135.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T21:16:10.355 INFO:teuthology.orchestra.run.trial135.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T21:16:10.366 INFO:teuthology.orchestra.run.trial135.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T21:16:10.518 INFO:teuthology.orchestra.run.trial135.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T21:16:10.523 INFO:teuthology.orchestra.run.trial135.stdout: Upgrading : librados2-2:19.2.3-679.gd855f53b.el9.x86_64 5/37 2026-02-17T21:16:10.556 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: librados2-2:19.2.3-679.gd855f53b.el9.x86_64 5/37 2026-02-17T21:16:10.598 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 6/37 2026-02-17T21:16:10.599 INFO:teuthology.orchestra.run.trial135.stdout: Installing : libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 7/37 2026-02-17T21:16:10.600 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T21:16:10.601 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T21:16:10.601 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:10.611 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 7/37 2026-02-17T21:16:10.616 INFO:teuthology.orchestra.run.trial135.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T21:16:10.624 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-ceph-argparse-2:19.2.3-679.gd855f53b.el9.x 9/37 2026-02-17T21:16:10.636 INFO:teuthology.orchestra.run.trial119.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T21:16:10.638 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-ceph-common-2:19.2.3-679.gd855f53b.el9.x86 31/37 2026-02-17T21:16:10.646 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 10/37 2026-02-17T21:16:10.647 INFO:teuthology.orchestra.run.trial135.stdout: Installing : libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 11/37 2026-02-17T21:16:10.660 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 11/37 2026-02-17T21:16:10.691 INFO:teuthology.orchestra.run.trial135.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T21:16:10.695 INFO:teuthology.orchestra.run.trial135.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T21:16:10.702 INFO:teuthology.orchestra.run.trial135.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T21:16:10.704 INFO:teuthology.orchestra.run.trial135.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T21:16:10.707 INFO:teuthology.orchestra.run.trial135.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T21:16:10.711 INFO:teuthology.orchestra.run.trial135.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T21:16:10.851 INFO:teuthology.orchestra.run.trial135.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T21:16:10.852 INFO:teuthology.orchestra.run.trial135.stdout: Upgrading : librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 19/37 2026-02-17T21:16:10.877 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 19/37 2026-02-17T21:16:10.879 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 20/37 2026-02-17T21:16:10.885 INFO:teuthology.orchestra.run.trial135.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T21:16:11.109 INFO:teuthology.orchestra.run.trial135.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T21:16:11.111 INFO:teuthology.orchestra.run.trial135.stdout: Installing : librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 23/37 2026-02-17T21:16:11.126 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 23/37 2026-02-17T21:16:11.132 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 24/37 2026-02-17T21:16:11.138 INFO:teuthology.orchestra.run.trial135.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T21:16:11.140 INFO:teuthology.orchestra.run.trial135.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T21:16:11.141 INFO:teuthology.orchestra.run.trial135.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T21:16:11.159 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T21:16:11.187 INFO:teuthology.orchestra.run.trial176.stdout:lab-extras 1.4 MB/s | 50 kB 00:00 2026-02-17T21:16:11.273 INFO:teuthology.orchestra.run.trial135.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T21:16:11.275 INFO:teuthology.orchestra.run.trial135.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T21:16:11.546 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T21:16:11.546 INFO:teuthology.orchestra.run.trial135.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T21:16:11.546 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:11.582 INFO:teuthology.orchestra.run.trial135.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T21:16:11.584 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-ceph-common-2:19.2.3-679.gd855f53b.el9.x86 31/37 2026-02-17T21:16:11.616 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 32/37 2026-02-17T21:16:11.619 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 32/37 2026-02-17T21:16:11.903 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 32/37 2026-02-17T21:16:11.906 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 33/37 2026-02-17T21:16:11.951 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 33/37 2026-02-17T21:16:11.951 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T21:16:11.951 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T21:16:11.951 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:11.954 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 34/37 2026-02-17T21:16:12.401 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:12.403 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:12.403 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repository Size 2026-02-17T21:16:12.403 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:12.403 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:16:12.403 INFO:teuthology.orchestra.run.trial176.stdout: ceph-radosgw x86_64 2:19.2.3-679.gd855f53b.el9 ceph 11 M 2026-02-17T21:16:12.403 INFO:teuthology.orchestra.run.trial176.stdout:Upgrading: 2026-02-17T21:16:12.403 INFO:teuthology.orchestra.run.trial176.stdout: librados2 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 3.4 M 2026-02-17T21:16:12.403 INFO:teuthology.orchestra.run.trial176.stdout: librbd1 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 3.2 M 2026-02-17T21:16:12.404 INFO:teuthology.orchestra.run.trial176.stdout:Installing dependencies: 2026-02-17T21:16:12.404 INFO:teuthology.orchestra.run.trial176.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T21:16:12.404 INFO:teuthology.orchestra.run.trial176.stdout: ceph-base x86_64 2:19.2.3-679.gd855f53b.el9 ceph 5.5 M 2026-02-17T21:16:12.404 INFO:teuthology.orchestra.run.trial176.stdout: ceph-common x86_64 2:19.2.3-679.gd855f53b.el9 ceph 22 M 2026-02-17T21:16:12.404 INFO:teuthology.orchestra.run.trial176.stdout: ceph-selinux x86_64 2:19.2.3-679.gd855f53b.el9 ceph 25 k 2026-02-17T21:16:12.404 INFO:teuthology.orchestra.run.trial176.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T21:16:12.404 INFO:teuthology.orchestra.run.trial176.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T21:16:12.404 INFO:teuthology.orchestra.run.trial176.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T21:16:12.404 INFO:teuthology.orchestra.run.trial176.stdout: libcephfs2 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.0 M 2026-02-17T21:16:12.404 INFO:teuthology.orchestra.run.trial176.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T21:16:12.404 INFO:teuthology.orchestra.run.trial176.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T21:16:12.404 INFO:teuthology.orchestra.run.trial176.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T21:16:12.405 INFO:teuthology.orchestra.run.trial176.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T21:16:12.405 INFO:teuthology.orchestra.run.trial176.stdout: libradosstriper1 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 504 k 2026-02-17T21:16:12.405 INFO:teuthology.orchestra.run.trial176.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T21:16:12.405 INFO:teuthology.orchestra.run.trial176.stdout: librgw2 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 5.4 M 2026-02-17T21:16:12.405 INFO:teuthology.orchestra.run.trial176.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T21:16:12.405 INFO:teuthology.orchestra.run.trial176.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T21:16:12.405 INFO:teuthology.orchestra.run.trial176.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T21:16:12.405 INFO:teuthology.orchestra.run.trial176.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T21:16:12.405 INFO:teuthology.orchestra.run.trial176.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T21:16:12.405 INFO:teuthology.orchestra.run.trial176.stdout: python3-ceph-argparse x86_64 2:19.2.3-679.gd855f53b.el9 ceph 45 k 2026-02-17T21:16:12.405 INFO:teuthology.orchestra.run.trial176.stdout: python3-ceph-common x86_64 2:19.2.3-679.gd855f53b.el9 ceph 142 k 2026-02-17T21:16:12.405 INFO:teuthology.orchestra.run.trial176.stdout: python3-cephfs x86_64 2:19.2.3-679.gd855f53b.el9 ceph 165 k 2026-02-17T21:16:12.405 INFO:teuthology.orchestra.run.trial176.stdout: python3-rados x86_64 2:19.2.3-679.gd855f53b.el9 ceph 322 k 2026-02-17T21:16:12.406 INFO:teuthology.orchestra.run.trial176.stdout: python3-rbd x86_64 2:19.2.3-679.gd855f53b.el9 ceph 303 k 2026-02-17T21:16:12.406 INFO:teuthology.orchestra.run.trial176.stdout: python3-rgw x86_64 2:19.2.3-679.gd855f53b.el9 ceph 100 k 2026-02-17T21:16:12.406 INFO:teuthology.orchestra.run.trial176.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T21:16:12.406 INFO:teuthology.orchestra.run.trial176.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T21:16:12.406 INFO:teuthology.orchestra.run.trial176.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T21:16:12.406 INFO:teuthology.orchestra.run.trial176.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T21:16:12.406 INFO:teuthology.orchestra.run.trial176.stdout:Installing weak dependencies: 2026-02-17T21:16:12.406 INFO:teuthology.orchestra.run.trial176.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T21:16:12.406 INFO:teuthology.orchestra.run.trial176.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T21:16:12.406 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:12.406 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:16:12.406 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:12.407 INFO:teuthology.orchestra.run.trial176.stdout:Install 33 Packages 2026-02-17T21:16:12.407 INFO:teuthology.orchestra.run.trial176.stdout:Upgrade 2 Packages 2026-02-17T21:16:12.407 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:12.407 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 63 M 2026-02-17T21:16:12.407 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:16:12.565 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 32/37 2026-02-17T21:16:12.568 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 32/37 2026-02-17T21:16:12.854 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 32/37 2026-02-17T21:16:12.857 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 33/37 2026-02-17T21:16:12.896 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 33/37 2026-02-17T21:16:12.896 INFO:teuthology.orchestra.run.trial135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T21:16:12.896 INFO:teuthology.orchestra.run.trial135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T21:16:12.896 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:12.899 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 34/37 2026-02-17T21:16:13.025 INFO:teuthology.orchestra.run.trial005.stdout:CentOS Stream 9 - CRB 16 MB/s | 7.8 MB 00:00 2026-02-17T21:16:13.378 INFO:teuthology.orchestra.run.trial176.stdout:(1/35): ceph-base-19.2.3-679.gd855f53b.el9.x86_ 18 MB/s | 5.5 MB 00:00 2026-02-17T21:16:13.410 INFO:teuthology.orchestra.run.trial176.stdout:(2/35): ceph-selinux-19.2.3-679.gd855f53b.el9.x 778 kB/s | 25 kB 00:00 2026-02-17T21:16:13.465 INFO:teuthology.orchestra.run.trial176.stdout:(3/35): libcephfs2-19.2.3-679.gd855f53b.el9.x86 18 MB/s | 1.0 MB 00:00 2026-02-17T21:16:13.510 INFO:teuthology.orchestra.run.trial176.stdout:(4/35): libradosstriper1-19.2.3-679.gd855f53b.e 11 MB/s | 504 kB 00:00 2026-02-17T21:16:13.736 INFO:teuthology.orchestra.run.trial176.stdout:(5/35): ceph-radosgw-19.2.3-679.gd855f53b.el9.x 16 MB/s | 11 MB 00:00 2026-02-17T21:16:13.762 INFO:teuthology.orchestra.run.trial176.stdout:(6/35): librgw2-19.2.3-679.gd855f53b.el9.x86_64 21 MB/s | 5.4 MB 00:00 2026-02-17T21:16:13.766 INFO:teuthology.orchestra.run.trial176.stdout:(7/35): python3-ceph-argparse-19.2.3-679.gd855f 1.4 MB/s | 45 kB 00:00 2026-02-17T21:16:13.790 INFO:teuthology.orchestra.run.trial176.stdout:(8/35): python3-ceph-common-19.2.3-679.gd855f53 5.0 MB/s | 142 kB 00:00 2026-02-17T21:16:13.796 INFO:teuthology.orchestra.run.trial176.stdout:(9/35): python3-cephfs-19.2.3-679.gd855f53b.el9 5.4 MB/s | 165 kB 00:00 2026-02-17T21:16:13.825 INFO:teuthology.orchestra.run.trial176.stdout:(10/35): python3-rados-19.2.3-679.gd855f53b.el9 9.0 MB/s | 322 kB 00:00 2026-02-17T21:16:13.832 INFO:teuthology.orchestra.run.trial176.stdout:(11/35): python3-rbd-19.2.3-679.gd855f53b.el9.x 8.2 MB/s | 303 kB 00:00 2026-02-17T21:16:13.858 INFO:teuthology.orchestra.run.trial176.stdout:(12/35): python3-rgw-19.2.3-679.gd855f53b.el9.x 2.9 MB/s | 100 kB 00:00 2026-02-17T21:16:13.900 INFO:teuthology.orchestra.run.trial176.stdout:(13/35): mailcap-2.1.49-5.el9.noarch.rpm 495 kB/s | 33 kB 00:00 2026-02-17T21:16:13.937 INFO:teuthology.orchestra.run.trial005.stdout:CentOS Stream 9 - Extras packages 107 kB/s | 20 kB 00:00 2026-02-17T21:16:13.957 INFO:teuthology.orchestra.run.trial176.stdout:(14/35): ceph-common-19.2.3-679.gd855f53b.el9.x 24 MB/s | 22 MB 00:00 2026-02-17T21:16:13.957 INFO:teuthology.orchestra.run.trial176.stdout:(15/35): pciutils-3.7.0-7.el9.x86_64.rpm 1.6 MB/s | 93 kB 00:00 2026-02-17T21:16:13.987 INFO:teuthology.orchestra.run.trial176.stdout:(16/35): nvme-cli-2.13-1.el9.x86_64.rpm 8.5 MB/s | 1.1 MB 00:00 2026-02-17T21:16:14.085 INFO:teuthology.orchestra.run.trial176.stdout:(17/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2026-02-17T21:16:14.106 INFO:teuthology.orchestra.run.trial176.stdout:(18/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.1 MB/s | 45 kB 00:00 2026-02-17T21:16:14.167 INFO:teuthology.orchestra.run.trial176.stdout:(19/35): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2026-02-17T21:16:14.190 INFO:teuthology.orchestra.run.trial176.stdout:(20/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 13 MB/s | 292 kB 00:00 2026-02-17T21:16:14.212 INFO:teuthology.orchestra.run.trial176.stdout:(21/35): qatlib-25.08.0-2.el9.x86_64.rpm 11 MB/s | 240 kB 00:00 2026-02-17T21:16:14.233 INFO:teuthology.orchestra.run.trial176.stdout:(22/35): qatlib-service-25.08.0-2.el9.x86_64.rp 1.8 MB/s | 37 kB 00:00 2026-02-17T21:16:14.254 INFO:teuthology.orchestra.run.trial176.stdout:(23/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 3.1 MB/s | 66 kB 00:00 2026-02-17T21:16:14.419 INFO:teuthology.orchestra.run.trial176.stdout:(24/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.8 MB/s | 308 kB 00:00 2026-02-17T21:16:14.503 INFO:teuthology.orchestra.run.trial005.stdout:Extra Packages for Enterprise Linux 40 MB/s | 20 MB 00:00 2026-02-17T21:16:14.643 INFO:teuthology.orchestra.run.trial176.stdout:(25/35): libarrow-9.0.0-15.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2026-02-17T21:16:14.665 INFO:teuthology.orchestra.run.trial176.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.1 MB/s | 25 kB 00:00 2026-02-17T21:16:14.689 INFO:teuthology.orchestra.run.trial176.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2026-02-17T21:16:14.705 INFO:teuthology.orchestra.run.trial176.stdout:(28/35): boost-program-options-1.75.0-13.el9.x8 139 kB/s | 104 kB 00:00 2026-02-17T21:16:14.713 INFO:teuthology.orchestra.run.trial176.stdout:(29/35): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2026-02-17T21:16:14.742 INFO:teuthology.orchestra.run.trial176.stdout:(30/35): re2-20211101-20.el9.x86_64.rpm 6.5 MB/s | 191 kB 00:00 2026-02-17T21:16:14.855 INFO:teuthology.orchestra.run.trial176.stdout:(31/35): thrift-0.15.0-4.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2026-02-17T21:16:14.901 INFO:teuthology.orchestra.run.trial176.stdout:(32/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 4.2 MB/s | 838 kB 00:00 2026-02-17T21:16:14.941 INFO:teuthology.orchestra.run.trial176.stdout:(33/35): librados2-19.2.3-679.gd855f53b.el9.x86 40 MB/s | 3.4 MB 00:00 2026-02-17T21:16:14.998 INFO:teuthology.orchestra.run.trial176.stdout:(34/35): librbd1-19.2.3-679.gd855f53b.el9.x86_6 33 MB/s | 3.2 MB 00:00 2026-02-17T21:16:15.371 INFO:teuthology.orchestra.run.trial176.stdout:(35/35): libnbd-1.20.3-4.el9.x86_64.rpm 116 kB/s | 164 kB 00:01 2026-02-17T21:16:15.376 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:15.376 INFO:teuthology.orchestra.run.trial176.stdout:Total 21 MB/s | 63 MB 00:02 2026-02-17T21:16:15.481 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:16:15.501 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:16:15.501 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:16:15.753 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:16:15.753 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:16:16.044 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:16:16.053 INFO:teuthology.orchestra.run.trial176.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T21:16:16.056 INFO:teuthology.orchestra.run.trial176.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T21:16:16.067 INFO:teuthology.orchestra.run.trial176.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T21:16:16.217 INFO:teuthology.orchestra.run.trial176.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T21:16:16.221 INFO:teuthology.orchestra.run.trial176.stdout: Upgrading : librados2-2:19.2.3-679.gd855f53b.el9.x86_64 5/37 2026-02-17T21:16:16.249 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: librados2-2:19.2.3-679.gd855f53b.el9.x86_64 5/37 2026-02-17T21:16:16.291 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 6/37 2026-02-17T21:16:16.292 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 7/37 2026-02-17T21:16:16.304 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 7/37 2026-02-17T21:16:16.308 INFO:teuthology.orchestra.run.trial176.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T21:16:16.317 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-ceph-argparse-2:19.2.3-679.gd855f53b.el9.x 9/37 2026-02-17T21:16:16.339 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 10/37 2026-02-17T21:16:16.339 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 11/37 2026-02-17T21:16:16.352 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 11/37 2026-02-17T21:16:16.383 INFO:teuthology.orchestra.run.trial176.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T21:16:16.387 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T21:16:16.393 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T21:16:16.395 INFO:teuthology.orchestra.run.trial176.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T21:16:16.398 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T21:16:16.403 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T21:16:16.444 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 34/37 2026-02-17T21:16:16.444 INFO:teuthology.orchestra.run.trial119.stdout:skipping the directory /sys 2026-02-17T21:16:16.444 INFO:teuthology.orchestra.run.trial119.stdout:skipping the directory /proc 2026-02-17T21:16:16.444 INFO:teuthology.orchestra.run.trial119.stdout:skipping the directory /mnt 2026-02-17T21:16:16.444 INFO:teuthology.orchestra.run.trial119.stdout:skipping the directory /var/tmp 2026-02-17T21:16:16.444 INFO:teuthology.orchestra.run.trial119.stdout:skipping the directory /home 2026-02-17T21:16:16.445 INFO:teuthology.orchestra.run.trial119.stdout:skipping the directory /root 2026-02-17T21:16:16.445 INFO:teuthology.orchestra.run.trial119.stdout:skipping the directory /tmp 2026-02-17T21:16:16.445 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:16.543 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T21:16:16.544 INFO:teuthology.orchestra.run.trial176.stdout: Upgrading : librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 19/37 2026-02-17T21:16:16.569 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 19/37 2026-02-17T21:16:16.572 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 20/37 2026-02-17T21:16:16.578 INFO:teuthology.orchestra.run.trial176.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T21:16:16.803 INFO:teuthology.orchestra.run.trial176.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T21:16:16.804 INFO:teuthology.orchestra.run.trial176.stdout: Installing : librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 23/37 2026-02-17T21:16:16.820 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 23/37 2026-02-17T21:16:16.824 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 24/37 2026-02-17T21:16:16.828 INFO:teuthology.orchestra.run.trial176.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T21:16:16.831 INFO:teuthology.orchestra.run.trial176.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T21:16:16.831 INFO:teuthology.orchestra.run.trial176.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T21:16:16.851 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T21:16:16.891 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 35/37 2026-02-17T21:16:16.914 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 35/37 2026-02-17T21:16:16.914 INFO:teuthology.orchestra.run.trial119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:16.915 INFO:teuthology.orchestra.run.trial119.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T21:16:16.915 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T21:16:16.915 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T21:16:16.915 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:16.916 INFO:teuthology.orchestra.run.trial119.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T21:16:16.929 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T21:16:16.929 INFO:teuthology.orchestra.run.trial119.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T21:16:16.964 INFO:teuthology.orchestra.run.trial176.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T21:16:16.967 INFO:teuthology.orchestra.run.trial176.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T21:16:16.985 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T21:16:16.985 INFO:teuthology.orchestra.run.trial119.stdout:Creating group 'qat' with GID 992. 2026-02-17T21:16:16.985 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:17.242 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 1/37 2026-02-17T21:16:17.242 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 2/37 2026-02-17T21:16:17.242 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 3/37 2026-02-17T21:16:17.242 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 4/37 2026-02-17T21:16:17.243 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 5/37 2026-02-17T21:16:17.243 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 6/37 2026-02-17T21:16:17.243 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 7/37 2026-02-17T21:16:17.243 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-ceph-argparse-2:19.2.3-679.gd855f53b.el9.x 8/37 2026-02-17T21:16:17.243 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-ceph-common-2:19.2.3-679.gd855f53b.el9.x86 9/37 2026-02-17T21:16:17.243 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 10/37 2026-02-17T21:16:17.243 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 11/37 2026-02-17T21:16:17.243 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 12/37 2026-02-17T21:16:17.243 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 13/37 2026-02-17T21:16:17.243 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T21:16:17.243 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T21:16:17.243 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T21:16:17.243 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T21:16:17.244 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T21:16:17.244 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T21:16:17.244 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T21:16:17.244 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T21:16:17.244 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T21:16:17.244 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T21:16:17.244 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T21:16:17.244 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T21:16:17.244 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T21:16:17.244 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T21:16:17.244 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T21:16:17.244 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T21:16:17.245 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T21:16:17.245 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T21:16:17.245 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T21:16:17.245 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T21:16:17.245 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : librados2-2:19.2.3-679.gd855f53b.el9.x86_64 34/37 2026-02-17T21:16:17.245 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T21:16:17.245 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 36/37 2026-02-17T21:16:17.249 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T21:16:17.249 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T21:16:17.249 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:17.287 INFO:teuthology.orchestra.run.trial176.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T21:16:17.289 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-ceph-common-2:19.2.3-679.gd855f53b.el9.x86 31/37 2026-02-17T21:16:17.298 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T21:16:17.299 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:17.299 INFO:teuthology.orchestra.run.trial119.stdout:Upgraded: 2026-02-17T21:16:17.299 INFO:teuthology.orchestra.run.trial119.stdout: librados2-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:17.299 INFO:teuthology.orchestra.run.trial119.stdout: librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:17.299 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:16:17.299 INFO:teuthology.orchestra.run.trial119.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T21:16:17.299 INFO:teuthology.orchestra.run.trial119.stdout: ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:17.299 INFO:teuthology.orchestra.run.trial119.stdout: ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:17.299 INFO:teuthology.orchestra.run.trial119.stdout: ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:17.299 INFO:teuthology.orchestra.run.trial119.stdout: ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:17.300 INFO:teuthology.orchestra.run.trial119.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T21:16:17.300 INFO:teuthology.orchestra.run.trial119.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T21:16:17.300 INFO:teuthology.orchestra.run.trial119.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T21:16:17.300 INFO:teuthology.orchestra.run.trial119.stdout: libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:17.300 INFO:teuthology.orchestra.run.trial119.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T21:16:17.300 INFO:teuthology.orchestra.run.trial119.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T21:16:17.300 INFO:teuthology.orchestra.run.trial119.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T21:16:17.300 INFO:teuthology.orchestra.run.trial119.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T21:16:17.300 INFO:teuthology.orchestra.run.trial119.stdout: libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:17.300 INFO:teuthology.orchestra.run.trial119.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T21:16:17.300 INFO:teuthology.orchestra.run.trial119.stdout: librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:17.300 INFO:teuthology.orchestra.run.trial119.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T21:16:17.301 INFO:teuthology.orchestra.run.trial119.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T21:16:17.301 INFO:teuthology.orchestra.run.trial119.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T21:16:17.301 INFO:teuthology.orchestra.run.trial119.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T21:16:17.301 INFO:teuthology.orchestra.run.trial119.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T21:16:17.301 INFO:teuthology.orchestra.run.trial119.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T21:16:17.301 INFO:teuthology.orchestra.run.trial119.stdout: python3-ceph-argparse-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:17.301 INFO:teuthology.orchestra.run.trial119.stdout: python3-ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:17.301 INFO:teuthology.orchestra.run.trial119.stdout: python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:17.301 INFO:teuthology.orchestra.run.trial119.stdout: python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:17.301 INFO:teuthology.orchestra.run.trial119.stdout: python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:17.301 INFO:teuthology.orchestra.run.trial119.stdout: python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:17.301 INFO:teuthology.orchestra.run.trial119.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T21:16:17.302 INFO:teuthology.orchestra.run.trial119.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T21:16:17.302 INFO:teuthology.orchestra.run.trial119.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T21:16:17.302 INFO:teuthology.orchestra.run.trial119.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T21:16:17.302 INFO:teuthology.orchestra.run.trial119.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T21:16:17.302 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:17.302 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:16:17.340 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-test 2026-02-17T21:16:17.414 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 34/37 2026-02-17T21:16:17.414 INFO:teuthology.orchestra.run.trial135.stdout:skipping the directory /sys 2026-02-17T21:16:17.414 INFO:teuthology.orchestra.run.trial135.stdout:skipping the directory /proc 2026-02-17T21:16:17.414 INFO:teuthology.orchestra.run.trial135.stdout:skipping the directory /mnt 2026-02-17T21:16:17.414 INFO:teuthology.orchestra.run.trial135.stdout:skipping the directory /var/tmp 2026-02-17T21:16:17.414 INFO:teuthology.orchestra.run.trial135.stdout:skipping the directory /home 2026-02-17T21:16:17.415 INFO:teuthology.orchestra.run.trial135.stdout:skipping the directory /root 2026-02-17T21:16:17.415 INFO:teuthology.orchestra.run.trial135.stdout:skipping the directory /tmp 2026-02-17T21:16:17.415 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:17.649 INFO:teuthology.orchestra.run.trial005.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-17T21:16:17.653 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:12 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:16:17.733 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:17.734 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:17.734 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repository Size 2026-02-17T21:16:17.734 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:17.735 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:16:17.735 INFO:teuthology.orchestra.run.trial119.stdout: ceph-test x86_64 2:19.2.3-679.gd855f53b.el9 ceph 50 M 2026-02-17T21:16:17.735 INFO:teuthology.orchestra.run.trial119.stdout:Installing dependencies: 2026-02-17T21:16:17.735 INFO:teuthology.orchestra.run.trial119.stdout: libcephsqlite x86_64 2:19.2.3-679.gd855f53b.el9 ceph 163 k 2026-02-17T21:16:17.735 INFO:teuthology.orchestra.run.trial119.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T21:16:17.735 INFO:teuthology.orchestra.run.trial119.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T21:16:17.735 INFO:teuthology.orchestra.run.trial119.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T21:16:17.735 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:17.735 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:16:17.735 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:17.735 INFO:teuthology.orchestra.run.trial119.stdout:Install 5 Packages 2026-02-17T21:16:17.736 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:17.736 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 50 M 2026-02-17T21:16:17.736 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 212 M 2026-02-17T21:16:17.736 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:16:17.864 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 35/37 2026-02-17T21:16:17.880 INFO:teuthology.orchestra.run.trial119.stdout:(1/5): libcephsqlite-19.2.3-679.gd855f53b.el9.x 1.8 MB/s | 163 kB 00:00 2026-02-17T21:16:17.887 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 35/37 2026-02-17T21:16:17.887 INFO:teuthology.orchestra.run.trial135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:17.887 INFO:teuthology.orchestra.run.trial135.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T21:16:17.888 INFO:teuthology.orchestra.run.trial135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T21:16:17.888 INFO:teuthology.orchestra.run.trial135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T21:16:17.888 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:17.889 INFO:teuthology.orchestra.run.trial135.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T21:16:17.902 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T21:16:17.902 INFO:teuthology.orchestra.run.trial135.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T21:16:17.957 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T21:16:17.957 INFO:teuthology.orchestra.run.trial135.stdout:Creating group 'qat' with GID 992. 2026-02-17T21:16:17.957 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:18.228 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 1/37 2026-02-17T21:16:18.228 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 2/37 2026-02-17T21:16:18.228 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 3/37 2026-02-17T21:16:18.229 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 4/37 2026-02-17T21:16:18.229 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 5/37 2026-02-17T21:16:18.229 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 6/37 2026-02-17T21:16:18.229 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 7/37 2026-02-17T21:16:18.229 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-ceph-argparse-2:19.2.3-679.gd855f53b.el9.x 8/37 2026-02-17T21:16:18.229 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-ceph-common-2:19.2.3-679.gd855f53b.el9.x86 9/37 2026-02-17T21:16:18.229 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 10/37 2026-02-17T21:16:18.229 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 11/37 2026-02-17T21:16:18.229 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 12/37 2026-02-17T21:16:18.229 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 13/37 2026-02-17T21:16:18.229 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T21:16:18.229 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T21:16:18.230 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T21:16:18.230 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T21:16:18.230 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T21:16:18.230 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T21:16:18.230 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T21:16:18.230 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T21:16:18.230 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T21:16:18.230 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T21:16:18.230 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T21:16:18.230 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T21:16:18.230 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T21:16:18.231 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T21:16:18.231 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T21:16:18.231 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T21:16:18.231 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T21:16:18.231 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T21:16:18.231 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T21:16:18.231 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T21:16:18.232 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : librados2-2:19.2.3-679.gd855f53b.el9.x86_64 34/37 2026-02-17T21:16:18.232 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T21:16:18.232 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 36/37 2026-02-17T21:16:18.269 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 32/37 2026-02-17T21:16:18.271 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 32/37 2026-02-17T21:16:18.284 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T21:16:18.284 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:18.284 INFO:teuthology.orchestra.run.trial135.stdout:Upgraded: 2026-02-17T21:16:18.284 INFO:teuthology.orchestra.run.trial135.stdout: librados2-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:18.284 INFO:teuthology.orchestra.run.trial135.stdout: librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:18.284 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:16:18.284 INFO:teuthology.orchestra.run.trial135.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T21:16:18.284 INFO:teuthology.orchestra.run.trial135.stdout: ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:18.285 INFO:teuthology.orchestra.run.trial135.stdout: ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:18.285 INFO:teuthology.orchestra.run.trial135.stdout: ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:18.285 INFO:teuthology.orchestra.run.trial135.stdout: ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:18.285 INFO:teuthology.orchestra.run.trial135.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T21:16:18.285 INFO:teuthology.orchestra.run.trial135.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T21:16:18.285 INFO:teuthology.orchestra.run.trial135.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T21:16:18.285 INFO:teuthology.orchestra.run.trial135.stdout: libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:18.285 INFO:teuthology.orchestra.run.trial135.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T21:16:18.285 INFO:teuthology.orchestra.run.trial135.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T21:16:18.285 INFO:teuthology.orchestra.run.trial135.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T21:16:18.285 INFO:teuthology.orchestra.run.trial135.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T21:16:18.285 INFO:teuthology.orchestra.run.trial135.stdout: libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:18.285 INFO:teuthology.orchestra.run.trial135.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T21:16:18.285 INFO:teuthology.orchestra.run.trial135.stdout: librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:18.285 INFO:teuthology.orchestra.run.trial135.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T21:16:18.285 INFO:teuthology.orchestra.run.trial135.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T21:16:18.285 INFO:teuthology.orchestra.run.trial135.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T21:16:18.285 INFO:teuthology.orchestra.run.trial135.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T21:16:18.285 INFO:teuthology.orchestra.run.trial135.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T21:16:18.286 INFO:teuthology.orchestra.run.trial135.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T21:16:18.286 INFO:teuthology.orchestra.run.trial135.stdout: python3-ceph-argparse-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:18.286 INFO:teuthology.orchestra.run.trial135.stdout: python3-ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:18.286 INFO:teuthology.orchestra.run.trial135.stdout: python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:18.286 INFO:teuthology.orchestra.run.trial135.stdout: python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:18.286 INFO:teuthology.orchestra.run.trial135.stdout: python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:18.286 INFO:teuthology.orchestra.run.trial135.stdout: python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:18.286 INFO:teuthology.orchestra.run.trial135.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T21:16:18.286 INFO:teuthology.orchestra.run.trial135.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T21:16:18.286 INFO:teuthology.orchestra.run.trial135.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T21:16:18.286 INFO:teuthology.orchestra.run.trial135.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T21:16:18.286 INFO:teuthology.orchestra.run.trial135.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T21:16:18.286 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:18.286 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:18.327 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install ceph-test 2026-02-17T21:16:18.552 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 32/37 2026-02-17T21:16:18.555 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 33/37 2026-02-17T21:16:18.595 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 33/37 2026-02-17T21:16:18.595 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T21:16:18.595 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T21:16:18.595 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:18.599 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 34/37 2026-02-17T21:16:18.645 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:12 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:18.660 INFO:teuthology.orchestra.run.trial119.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 269 kB/s | 233 kB 00:00 2026-02-17T21:16:18.727 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:18.728 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:18.728 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repository Size 2026-02-17T21:16:18.728 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:18.728 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:16:18.728 INFO:teuthology.orchestra.run.trial135.stdout: ceph-test x86_64 2:19.2.3-679.gd855f53b.el9 ceph 50 M 2026-02-17T21:16:18.728 INFO:teuthology.orchestra.run.trial135.stdout:Installing dependencies: 2026-02-17T21:16:18.728 INFO:teuthology.orchestra.run.trial135.stdout: libcephsqlite x86_64 2:19.2.3-679.gd855f53b.el9 ceph 163 k 2026-02-17T21:16:18.728 INFO:teuthology.orchestra.run.trial135.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T21:16:18.728 INFO:teuthology.orchestra.run.trial135.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T21:16:18.728 INFO:teuthology.orchestra.run.trial135.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T21:16:18.728 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:18.728 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:16:18.728 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:18.728 INFO:teuthology.orchestra.run.trial135.stdout:Install 5 Packages 2026-02-17T21:16:18.728 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:18.728 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 50 M 2026-02-17T21:16:18.728 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 212 M 2026-02-17T21:16:18.728 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:16:18.808 INFO:teuthology.orchestra.run.trial119.stdout:(3/5): ceph-test-19.2.3-679.gd855f53b.el9.x86_6 49 MB/s | 50 MB 00:01 2026-02-17T21:16:18.818 INFO:teuthology.orchestra.run.trial119.stdout:(4/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 403 kB/s | 64 kB 00:00 2026-02-17T21:16:18.871 INFO:teuthology.orchestra.run.trial135.stdout:(1/5): libcephsqlite-19.2.3-679.gd855f53b.el9.x 1.9 MB/s | 163 kB 00:00 2026-02-17T21:16:18.877 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:18.878 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:18.879 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repository Size 2026-02-17T21:16:18.879 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:18.879 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:16:18.879 INFO:teuthology.orchestra.run.trial005.stdout: ceph-radosgw x86_64 2:19.2.3-679.gd855f53b.el9 ceph 11 M 2026-02-17T21:16:18.879 INFO:teuthology.orchestra.run.trial005.stdout:Upgrading: 2026-02-17T21:16:18.879 INFO:teuthology.orchestra.run.trial005.stdout: librados2 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 3.4 M 2026-02-17T21:16:18.880 INFO:teuthology.orchestra.run.trial005.stdout: librbd1 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 3.2 M 2026-02-17T21:16:18.880 INFO:teuthology.orchestra.run.trial005.stdout:Installing dependencies: 2026-02-17T21:16:18.880 INFO:teuthology.orchestra.run.trial005.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T21:16:18.880 INFO:teuthology.orchestra.run.trial005.stdout: ceph-base x86_64 2:19.2.3-679.gd855f53b.el9 ceph 5.5 M 2026-02-17T21:16:18.880 INFO:teuthology.orchestra.run.trial005.stdout: ceph-common x86_64 2:19.2.3-679.gd855f53b.el9 ceph 22 M 2026-02-17T21:16:18.880 INFO:teuthology.orchestra.run.trial005.stdout: ceph-selinux x86_64 2:19.2.3-679.gd855f53b.el9 ceph 25 k 2026-02-17T21:16:18.880 INFO:teuthology.orchestra.run.trial005.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T21:16:18.880 INFO:teuthology.orchestra.run.trial005.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T21:16:18.880 INFO:teuthology.orchestra.run.trial005.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T21:16:18.880 INFO:teuthology.orchestra.run.trial005.stdout: libcephfs2 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.0 M 2026-02-17T21:16:18.880 INFO:teuthology.orchestra.run.trial005.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T21:16:18.881 INFO:teuthology.orchestra.run.trial005.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T21:16:18.881 INFO:teuthology.orchestra.run.trial005.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T21:16:18.881 INFO:teuthology.orchestra.run.trial005.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T21:16:18.881 INFO:teuthology.orchestra.run.trial005.stdout: libradosstriper1 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 504 k 2026-02-17T21:16:18.881 INFO:teuthology.orchestra.run.trial005.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T21:16:18.881 INFO:teuthology.orchestra.run.trial005.stdout: librgw2 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 5.4 M 2026-02-17T21:16:18.881 INFO:teuthology.orchestra.run.trial005.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T21:16:18.881 INFO:teuthology.orchestra.run.trial005.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T21:16:18.881 INFO:teuthology.orchestra.run.trial005.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T21:16:18.881 INFO:teuthology.orchestra.run.trial005.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T21:16:18.882 INFO:teuthology.orchestra.run.trial005.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T21:16:18.882 INFO:teuthology.orchestra.run.trial005.stdout: python3-ceph-argparse x86_64 2:19.2.3-679.gd855f53b.el9 ceph 45 k 2026-02-17T21:16:18.882 INFO:teuthology.orchestra.run.trial005.stdout: python3-ceph-common x86_64 2:19.2.3-679.gd855f53b.el9 ceph 142 k 2026-02-17T21:16:18.882 INFO:teuthology.orchestra.run.trial005.stdout: python3-cephfs x86_64 2:19.2.3-679.gd855f53b.el9 ceph 165 k 2026-02-17T21:16:18.882 INFO:teuthology.orchestra.run.trial005.stdout: python3-rados x86_64 2:19.2.3-679.gd855f53b.el9 ceph 322 k 2026-02-17T21:16:18.882 INFO:teuthology.orchestra.run.trial005.stdout: python3-rbd x86_64 2:19.2.3-679.gd855f53b.el9 ceph 303 k 2026-02-17T21:16:18.882 INFO:teuthology.orchestra.run.trial005.stdout: python3-rgw x86_64 2:19.2.3-679.gd855f53b.el9 ceph 100 k 2026-02-17T21:16:18.882 INFO:teuthology.orchestra.run.trial005.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T21:16:18.882 INFO:teuthology.orchestra.run.trial005.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T21:16:18.882 INFO:teuthology.orchestra.run.trial005.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T21:16:18.883 INFO:teuthology.orchestra.run.trial005.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T21:16:18.883 INFO:teuthology.orchestra.run.trial005.stdout:Installing weak dependencies: 2026-02-17T21:16:18.883 INFO:teuthology.orchestra.run.trial005.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T21:16:18.883 INFO:teuthology.orchestra.run.trial005.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T21:16:18.883 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:18.883 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:16:18.883 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:18.883 INFO:teuthology.orchestra.run.trial005.stdout:Install 33 Packages 2026-02-17T21:16:18.883 INFO:teuthology.orchestra.run.trial005.stdout:Upgrade 2 Packages 2026-02-17T21:16:18.883 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:18.884 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 63 M 2026-02-17T21:16:18.884 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:16:18.906 INFO:teuthology.orchestra.run.trial119.stdout:(5/5): socat-1.7.4.1-8.el9.x86_64.rpm 296 kB/s | 303 kB 00:01 2026-02-17T21:16:18.911 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:18.911 INFO:teuthology.orchestra.run.trial119.stdout:Total 43 MB/s | 50 MB 00:01 2026-02-17T21:16:18.938 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:16:18.942 INFO:teuthology.orchestra.run.trial135.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 1.5 MB/s | 233 kB 00:00 2026-02-17T21:16:18.948 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:16:18.948 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:16:18.971 INFO:teuthology.orchestra.run.trial135.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.2 MB/s | 64 kB 00:00 2026-02-17T21:16:19.033 INFO:teuthology.orchestra.run.trial135.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 1.8 MB/s | 303 kB 00:00 2026-02-17T21:16:19.135 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:16:19.135 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:16:19.344 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:16:19.350 INFO:teuthology.orchestra.run.trial119.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T21:16:19.354 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T21:16:19.363 INFO:teuthology.orchestra.run.trial119.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T21:16:19.363 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 4/5 2026-02-17T21:16:19.814 INFO:teuthology.orchestra.run.trial135.stdout:(5/5): ceph-test-19.2.3-679.gd855f53b.el9.x86_6 48 MB/s | 50 MB 00:01 2026-02-17T21:16:19.816 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:19.816 INFO:teuthology.orchestra.run.trial135.stdout:Total 46 MB/s | 50 MB 00:01 2026-02-17T21:16:19.843 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:16:19.852 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:16:19.852 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:16:19.964 INFO:teuthology.orchestra.run.trial005.stdout:(1/35): ceph-base-19.2.3-679.gd855f53b.el9.x86_ 9.5 MB/s | 5.5 MB 00:00 2026-02-17T21:16:19.991 INFO:teuthology.orchestra.run.trial005.stdout:(2/35): ceph-selinux-19.2.3-679.gd855f53b.el9.x 915 kB/s | 25 kB 00:00 2026-02-17T21:16:20.040 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:16:20.040 INFO:teuthology.orchestra.run.trial005.stdout:(3/35): libcephfs2-19.2.3-679.gd855f53b.el9.x86 20 MB/s | 1.0 MB 00:00 2026-02-17T21:16:20.040 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:16:20.080 INFO:teuthology.orchestra.run.trial005.stdout:(4/35): libradosstriper1-19.2.3-679.gd855f53b.e 12 MB/s | 504 kB 00:00 2026-02-17T21:16:20.251 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:16:20.257 INFO:teuthology.orchestra.run.trial135.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T21:16:20.261 INFO:teuthology.orchestra.run.trial135.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T21:16:20.271 INFO:teuthology.orchestra.run.trial135.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T21:16:20.272 INFO:teuthology.orchestra.run.trial135.stdout: Installing : libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 4/5 2026-02-17T21:16:20.348 INFO:teuthology.orchestra.run.trial005.stdout:(5/35): librgw2-19.2.3-679.gd855f53b.el9.x86_64 20 MB/s | 5.4 MB 00:00 2026-02-17T21:16:20.389 INFO:teuthology.orchestra.run.trial005.stdout:(6/35): python3-ceph-argparse-19.2.3-679.gd855f 1.1 MB/s | 45 kB 00:00 2026-02-17T21:16:20.433 INFO:teuthology.orchestra.run.trial005.stdout:(7/35): python3-ceph-common-19.2.3-679.gd855f53 3.2 MB/s | 142 kB 00:00 2026-02-17T21:16:20.448 INFO:teuthology.orchestra.run.trial005.stdout:(8/35): ceph-radosgw-19.2.3-679.gd855f53b.el9.x 10 MB/s | 11 MB 00:01 2026-02-17T21:16:20.465 INFO:teuthology.orchestra.run.trial005.stdout:(9/35): python3-cephfs-19.2.3-679.gd855f53b.el9 5.1 MB/s | 165 kB 00:00 2026-02-17T21:16:20.485 INFO:teuthology.orchestra.run.trial005.stdout:(10/35): python3-rados-19.2.3-679.gd855f53b.el9 8.5 MB/s | 322 kB 00:00 2026-02-17T21:16:20.505 INFO:teuthology.orchestra.run.trial005.stdout:(11/35): python3-rbd-19.2.3-679.gd855f53b.el9.x 7.4 MB/s | 303 kB 00:00 2026-02-17T21:16:20.522 INFO:teuthology.orchestra.run.trial005.stdout:(12/35): python3-rgw-19.2.3-679.gd855f53b.el9.x 2.6 MB/s | 100 kB 00:00 2026-02-17T21:16:20.561 INFO:teuthology.orchestra.run.trial005.stdout:(13/35): ceph-common-19.2.3-679.gd855f53b.el9.x 18 MB/s | 22 MB 00:01 2026-02-17T21:16:20.562 INFO:teuthology.orchestra.run.trial005.stdout:(14/35): mailcap-2.1.49-5.el9.noarch.rpm 585 kB/s | 33 kB 00:00 2026-02-17T21:16:20.596 INFO:teuthology.orchestra.run.trial005.stdout:(15/35): pciutils-3.7.0-7.el9.x86_64.rpm 2.6 MB/s | 93 kB 00:00 2026-02-17T21:16:20.602 INFO:teuthology.orchestra.run.trial005.stdout:(16/35): nvme-cli-2.13-1.el9.x86_64.rpm 14 MB/s | 1.1 MB 00:00 2026-02-17T21:16:20.743 INFO:teuthology.orchestra.run.trial005.stdout:(17/35): boost-program-options-1.75.0-13.el9.x8 573 kB/s | 104 kB 00:00 2026-02-17T21:16:20.759 INFO:teuthology.orchestra.run.trial005.stdout:(18/35): libnbd-1.20.3-4.el9.x86_64.rpm 1.0 MB/s | 164 kB 00:00 2026-02-17T21:16:20.763 INFO:teuthology.orchestra.run.trial005.stdout:(19/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 992 kB/s | 160 kB 00:00 2026-02-17T21:16:20.776 INFO:teuthology.orchestra.run.trial005.stdout:(20/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.4 MB/s | 45 kB 00:00 2026-02-17T21:16:20.840 INFO:teuthology.orchestra.run.trial005.stdout:(21/35): qatlib-25.08.0-2.el9.x86_64.rpm 3.6 MB/s | 240 kB 00:00 2026-02-17T21:16:20.846 INFO:teuthology.orchestra.run.trial005.stdout:(22/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.5 MB/s | 292 kB 00:00 2026-02-17T21:16:20.872 INFO:teuthology.orchestra.run.trial005.stdout:(23/35): qatlib-service-25.08.0-2.el9.x86_64.rp 1.2 MB/s | 37 kB 00:00 2026-02-17T21:16:20.888 INFO:teuthology.orchestra.run.trial005.stdout:(24/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 1.5 MB/s | 66 kB 00:00 2026-02-17T21:16:20.893 INFO:teuthology.orchestra.run.trial005.stdout:(25/35): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2026-02-17T21:16:21.029 INFO:teuthology.orchestra.run.trial005.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 183 kB/s | 25 kB 00:00 2026-02-17T21:16:21.118 INFO:teuthology.orchestra.run.trial005.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 551 kB/s | 49 kB 00:00 2026-02-17T21:16:21.131 INFO:teuthology.orchestra.run.trial005.stdout:(28/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.2 MB/s | 308 kB 00:00 2026-02-17T21:16:21.174 INFO:teuthology.orchestra.run.trial005.stdout:(29/35): libunwind-1.6.2-1.el9.x86_64.rpm 1.2 MB/s | 67 kB 00:00 2026-02-17T21:16:21.247 INFO:teuthology.orchestra.run.trial005.stdout:(30/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 7.1 MB/s | 838 kB 00:00 2026-02-17T21:16:21.267 INFO:teuthology.orchestra.run.trial005.stdout:(31/35): libarrow-9.0.0-15.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2026-02-17T21:16:21.268 INFO:teuthology.orchestra.run.trial005.stdout:(32/35): re2-20211101-20.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2026-02-17T21:16:21.356 INFO:teuthology.orchestra.run.trial005.stdout:(33/35): thrift-0.15.0-4.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2026-02-17T21:16:21.564 INFO:teuthology.orchestra.run.trial005.stdout:(34/35): librbd1-19.2.3-679.gd855f53b.el9.x86_6 11 MB/s | 3.2 MB 00:00 2026-02-17T21:16:21.579 INFO:teuthology.orchestra.run.trial005.stdout:(35/35): librados2-19.2.3-679.gd855f53b.el9.x86 11 MB/s | 3.4 MB 00:00 2026-02-17T21:16:21.581 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:21.581 INFO:teuthology.orchestra.run.trial005.stdout:Total 23 MB/s | 63 MB 00:02 2026-02-17T21:16:21.659 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 4/5 2026-02-17T21:16:21.677 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 5/5 2026-02-17T21:16:21.681 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:16:21.698 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:16:21.698 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:16:21.907 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 5/5 2026-02-17T21:16:21.907 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 1/5 2026-02-17T21:16:21.908 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 2/5 2026-02-17T21:16:21.908 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T21:16:21.908 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T21:16:21.947 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:16:21.948 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:16:21.959 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T21:16:21.959 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:21.960 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:16:21.960 INFO:teuthology.orchestra.run.trial119.stdout: ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:21.960 INFO:teuthology.orchestra.run.trial119.stdout: libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:21.960 INFO:teuthology.orchestra.run.trial119.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T21:16:21.960 INFO:teuthology.orchestra.run.trial119.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T21:16:21.960 INFO:teuthology.orchestra.run.trial119.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T21:16:21.960 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:21.960 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:16:21.994 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph 2026-02-17T21:16:22.242 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:16:22.250 INFO:teuthology.orchestra.run.trial005.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T21:16:22.253 INFO:teuthology.orchestra.run.trial005.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T21:16:22.264 INFO:teuthology.orchestra.run.trial005.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T21:16:22.301 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:17 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:16:22.386 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:22.389 INFO:teuthology.orchestra.run.trial119.stdout:====================================================================================== 2026-02-17T21:16:22.389 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repository Size 2026-02-17T21:16:22.389 INFO:teuthology.orchestra.run.trial119.stdout:====================================================================================== 2026-02-17T21:16:22.389 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:16:22.389 INFO:teuthology.orchestra.run.trial119.stdout: ceph x86_64 2:19.2.3-679.gd855f53b.el9 ceph 6.5 k 2026-02-17T21:16:22.389 INFO:teuthology.orchestra.run.trial119.stdout:Installing dependencies: 2026-02-17T21:16:22.389 INFO:teuthology.orchestra.run.trial119.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T21:16:22.389 INFO:teuthology.orchestra.run.trial119.stdout: ceph-grafana-dashboards noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 31 k 2026-02-17T21:16:22.389 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mds x86_64 2:19.2.3-679.gd855f53b.el9 ceph 2.4 M 2026-02-17T21:16:22.389 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.1 M 2026-02-17T21:16:22.389 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-modules-core noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 253 k 2026-02-17T21:16:22.389 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mon x86_64 2:19.2.3-679.gd855f53b.el9 ceph 4.7 M 2026-02-17T21:16:22.389 INFO:teuthology.orchestra.run.trial119.stdout: ceph-osd x86_64 2:19.2.3-679.gd855f53b.el9 ceph 17 M 2026-02-17T21:16:22.389 INFO:teuthology.orchestra.run.trial119.stdout: ceph-prometheus-alerts noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 17 k 2026-02-17T21:16:22.389 INFO:teuthology.orchestra.run.trial119.stdout: cephadm noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 769 k 2026-02-17T21:16:22.389 INFO:teuthology.orchestra.run.trial119.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T21:16:22.390 INFO:teuthology.orchestra.run.trial119.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T21:16:22.390 INFO:teuthology.orchestra.run.trial119.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T21:16:22.390 INFO:teuthology.orchestra.run.trial119.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T21:16:22.390 INFO:teuthology.orchestra.run.trial119.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T21:16:22.390 INFO:teuthology.orchestra.run.trial119.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T21:16:22.390 INFO:teuthology.orchestra.run.trial119.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T21:16:22.390 INFO:teuthology.orchestra.run.trial119.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T21:16:22.390 INFO:teuthology.orchestra.run.trial119.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T21:16:22.390 INFO:teuthology.orchestra.run.trial119.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T21:16:22.390 INFO:teuthology.orchestra.run.trial119.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T21:16:22.390 INFO:teuthology.orchestra.run.trial119.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T21:16:22.390 INFO:teuthology.orchestra.run.trial119.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T21:16:22.390 INFO:teuthology.orchestra.run.trial119.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T21:16:22.390 INFO:teuthology.orchestra.run.trial119.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T21:16:22.390 INFO:teuthology.orchestra.run.trial119.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T21:16:22.390 INFO:teuthology.orchestra.run.trial119.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T21:16:22.390 INFO:teuthology.orchestra.run.trial119.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T21:16:22.390 INFO:teuthology.orchestra.run.trial119.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T21:16:22.390 INFO:teuthology.orchestra.run.trial119.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T21:16:22.390 INFO:teuthology.orchestra.run.trial119.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T21:16:22.390 INFO:teuthology.orchestra.run.trial119.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T21:16:22.390 INFO:teuthology.orchestra.run.trial119.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T21:16:22.391 INFO:teuthology.orchestra.run.trial119.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T21:16:22.391 INFO:teuthology.orchestra.run.trial119.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T21:16:22.391 INFO:teuthology.orchestra.run.trial119.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T21:16:22.391 INFO:teuthology.orchestra.run.trial119.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T21:16:22.391 INFO:teuthology.orchestra.run.trial119.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T21:16:22.391 INFO:teuthology.orchestra.run.trial119.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T21:16:22.391 INFO:teuthology.orchestra.run.trial119.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T21:16:22.391 INFO:teuthology.orchestra.run.trial119.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T21:16:22.391 INFO:teuthology.orchestra.run.trial119.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T21:16:22.391 INFO:teuthology.orchestra.run.trial119.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T21:16:22.391 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T21:16:22.391 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T21:16:22.391 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T21:16:22.391 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T21:16:22.391 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T21:16:22.391 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T21:16:22.391 INFO:teuthology.orchestra.run.trial119.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T21:16:22.391 INFO:teuthology.orchestra.run.trial119.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T21:16:22.391 INFO:teuthology.orchestra.run.trial119.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T21:16:22.391 INFO:teuthology.orchestra.run.trial119.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T21:16:22.391 INFO:teuthology.orchestra.run.trial119.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T21:16:22.391 INFO:teuthology.orchestra.run.trial119.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T21:16:22.391 INFO:teuthology.orchestra.run.trial119.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T21:16:22.392 INFO:teuthology.orchestra.run.trial119.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T21:16:22.392 INFO:teuthology.orchestra.run.trial119.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T21:16:22.392 INFO:teuthology.orchestra.run.trial119.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T21:16:22.392 INFO:teuthology.orchestra.run.trial119.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T21:16:22.392 INFO:teuthology.orchestra.run.trial119.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T21:16:22.392 INFO:teuthology.orchestra.run.trial119.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T21:16:22.392 INFO:teuthology.orchestra.run.trial119.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T21:16:22.392 INFO:teuthology.orchestra.run.trial119.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T21:16:22.392 INFO:teuthology.orchestra.run.trial119.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T21:16:22.392 INFO:teuthology.orchestra.run.trial119.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T21:16:22.392 INFO:teuthology.orchestra.run.trial119.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T21:16:22.392 INFO:teuthology.orchestra.run.trial119.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T21:16:22.392 INFO:teuthology.orchestra.run.trial119.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T21:16:22.392 INFO:teuthology.orchestra.run.trial119.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T21:16:22.392 INFO:teuthology.orchestra.run.trial119.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T21:16:22.392 INFO:teuthology.orchestra.run.trial119.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T21:16:22.392 INFO:teuthology.orchestra.run.trial119.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T21:16:22.392 INFO:teuthology.orchestra.run.trial119.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T21:16:22.392 INFO:teuthology.orchestra.run.trial119.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T21:16:22.392 INFO:teuthology.orchestra.run.trial119.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T21:16:22.392 INFO:teuthology.orchestra.run.trial119.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T21:16:22.392 INFO:teuthology.orchestra.run.trial119.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T21:16:22.393 INFO:teuthology.orchestra.run.trial119.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T21:16:22.393 INFO:teuthology.orchestra.run.trial119.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T21:16:22.393 INFO:teuthology.orchestra.run.trial119.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T21:16:22.393 INFO:teuthology.orchestra.run.trial119.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T21:16:22.393 INFO:teuthology.orchestra.run.trial119.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T21:16:22.393 INFO:teuthology.orchestra.run.trial119.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T21:16:22.393 INFO:teuthology.orchestra.run.trial119.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T21:16:22.393 INFO:teuthology.orchestra.run.trial119.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T21:16:22.393 INFO:teuthology.orchestra.run.trial119.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T21:16:22.393 INFO:teuthology.orchestra.run.trial119.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T21:16:22.393 INFO:teuthology.orchestra.run.trial119.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T21:16:22.393 INFO:teuthology.orchestra.run.trial119.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T21:16:22.393 INFO:teuthology.orchestra.run.trial119.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T21:16:22.393 INFO:teuthology.orchestra.run.trial119.stdout:Installing weak dependencies: 2026-02-17T21:16:22.393 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-cephadm noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 150 k 2026-02-17T21:16:22.393 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-dashboard noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 3.8 M 2026-02-17T21:16:22.393 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 7.4 M 2026-02-17T21:16:22.393 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 22 k 2026-02-17T21:16:22.393 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-rook noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 49 k 2026-02-17T21:16:22.393 INFO:teuthology.orchestra.run.trial119.stdout: ceph-volume noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 299 k 2026-02-17T21:16:22.393 INFO:teuthology.orchestra.run.trial119.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T21:16:22.393 INFO:teuthology.orchestra.run.trial119.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T21:16:22.393 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:22.394 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:16:22.394 INFO:teuthology.orchestra.run.trial119.stdout:====================================================================================== 2026-02-17T21:16:22.394 INFO:teuthology.orchestra.run.trial119.stdout:Install 99 Packages 2026-02-17T21:16:22.394 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:22.394 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 95 M 2026-02-17T21:16:22.394 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 520 M 2026-02-17T21:16:22.394 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:16:22.414 INFO:teuthology.orchestra.run.trial005.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T21:16:22.419 INFO:teuthology.orchestra.run.trial005.stdout: Upgrading : librados2-2:19.2.3-679.gd855f53b.el9.x86_64 5/37 2026-02-17T21:16:22.450 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: librados2-2:19.2.3-679.gd855f53b.el9.x86_64 5/37 2026-02-17T21:16:22.493 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 6/37 2026-02-17T21:16:22.494 INFO:teuthology.orchestra.run.trial005.stdout: Installing : libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 7/37 2026-02-17T21:16:22.506 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 7/37 2026-02-17T21:16:22.511 INFO:teuthology.orchestra.run.trial005.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T21:16:22.520 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-ceph-argparse-2:19.2.3-679.gd855f53b.el9.x 9/37 2026-02-17T21:16:22.527 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 4/5 2026-02-17T21:16:22.542 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 10/37 2026-02-17T21:16:22.543 INFO:teuthology.orchestra.run.trial005.stdout: Installing : libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 11/37 2026-02-17T21:16:22.545 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 5/5 2026-02-17T21:16:22.556 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 11/37 2026-02-17T21:16:22.586 INFO:teuthology.orchestra.run.trial005.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T21:16:22.590 INFO:teuthology.orchestra.run.trial005.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T21:16:22.597 INFO:teuthology.orchestra.run.trial005.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T21:16:22.599 INFO:teuthology.orchestra.run.trial005.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T21:16:22.602 INFO:teuthology.orchestra.run.trial005.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T21:16:22.607 INFO:teuthology.orchestra.run.trial005.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T21:16:22.745 INFO:teuthology.orchestra.run.trial005.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T21:16:22.746 INFO:teuthology.orchestra.run.trial005.stdout: Upgrading : librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 19/37 2026-02-17T21:16:22.763 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 5/5 2026-02-17T21:16:22.763 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 1/5 2026-02-17T21:16:22.763 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 2/5 2026-02-17T21:16:22.764 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T21:16:22.764 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T21:16:22.772 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 19/37 2026-02-17T21:16:22.774 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 20/37 2026-02-17T21:16:22.780 INFO:teuthology.orchestra.run.trial005.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T21:16:22.817 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T21:16:22.817 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:22.817 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:16:22.817 INFO:teuthology.orchestra.run.trial135.stdout: ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:22.817 INFO:teuthology.orchestra.run.trial135.stdout: libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:22.817 INFO:teuthology.orchestra.run.trial135.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T21:16:22.817 INFO:teuthology.orchestra.run.trial135.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T21:16:22.817 INFO:teuthology.orchestra.run.trial135.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T21:16:22.818 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:22.818 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:22.851 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install ceph 2026-02-17T21:16:23.004 INFO:teuthology.orchestra.run.trial005.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T21:16:23.005 INFO:teuthology.orchestra.run.trial005.stdout: Installing : librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 23/37 2026-02-17T21:16:23.011 INFO:teuthology.orchestra.run.trial119.stdout:(1/99): ceph-mgr-19.2.3-679.gd855f53b.el9.x86_6 8.3 MB/s | 1.1 MB 00:00 2026-02-17T21:16:23.021 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 23/37 2026-02-17T21:16:23.025 INFO:teuthology.orchestra.run.trial119.stdout:(2/99): ceph-mds-19.2.3-679.gd855f53b.el9.x86_6 17 MB/s | 2.4 MB 00:00 2026-02-17T21:16:23.027 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 24/37 2026-02-17T21:16:23.034 INFO:teuthology.orchestra.run.trial005.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T21:16:23.036 INFO:teuthology.orchestra.run.trial005.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T21:16:23.037 INFO:teuthology.orchestra.run.trial005.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T21:16:23.055 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T21:16:23.074 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 34/37 2026-02-17T21:16:23.074 INFO:teuthology.orchestra.run.trial176.stdout:skipping the directory /sys 2026-02-17T21:16:23.075 INFO:teuthology.orchestra.run.trial176.stdout:skipping the directory /proc 2026-02-17T21:16:23.075 INFO:teuthology.orchestra.run.trial176.stdout:skipping the directory /mnt 2026-02-17T21:16:23.075 INFO:teuthology.orchestra.run.trial176.stdout:skipping the directory /var/tmp 2026-02-17T21:16:23.075 INFO:teuthology.orchestra.run.trial176.stdout:skipping the directory /home 2026-02-17T21:16:23.075 INFO:teuthology.orchestra.run.trial176.stdout:skipping the directory /root 2026-02-17T21:16:23.075 INFO:teuthology.orchestra.run.trial176.stdout:skipping the directory /tmp 2026-02-17T21:16:23.075 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:23.160 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:17 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:23.168 INFO:teuthology.orchestra.run.trial005.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T21:16:23.171 INFO:teuthology.orchestra.run.trial005.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T21:16:23.222 INFO:teuthology.orchestra.run.trial119.stdout:(3/99): ceph-mon-19.2.3-679.gd855f53b.el9.x86_6 22 MB/s | 4.7 MB 00:00 2026-02-17T21:16:23.245 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:23.248 INFO:teuthology.orchestra.run.trial135.stdout:====================================================================================== 2026-02-17T21:16:23.248 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repository Size 2026-02-17T21:16:23.248 INFO:teuthology.orchestra.run.trial135.stdout:====================================================================================== 2026-02-17T21:16:23.248 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:16:23.248 INFO:teuthology.orchestra.run.trial135.stdout: ceph x86_64 2:19.2.3-679.gd855f53b.el9 ceph 6.5 k 2026-02-17T21:16:23.248 INFO:teuthology.orchestra.run.trial135.stdout:Installing dependencies: 2026-02-17T21:16:23.248 INFO:teuthology.orchestra.run.trial135.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T21:16:23.249 INFO:teuthology.orchestra.run.trial135.stdout: ceph-grafana-dashboards noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 31 k 2026-02-17T21:16:23.249 INFO:teuthology.orchestra.run.trial135.stdout: ceph-mds x86_64 2:19.2.3-679.gd855f53b.el9 ceph 2.4 M 2026-02-17T21:16:23.249 INFO:teuthology.orchestra.run.trial135.stdout: ceph-mgr x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.1 M 2026-02-17T21:16:23.249 INFO:teuthology.orchestra.run.trial135.stdout: ceph-mgr-modules-core noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 253 k 2026-02-17T21:16:23.249 INFO:teuthology.orchestra.run.trial135.stdout: ceph-mon x86_64 2:19.2.3-679.gd855f53b.el9 ceph 4.7 M 2026-02-17T21:16:23.249 INFO:teuthology.orchestra.run.trial135.stdout: ceph-osd x86_64 2:19.2.3-679.gd855f53b.el9 ceph 17 M 2026-02-17T21:16:23.249 INFO:teuthology.orchestra.run.trial135.stdout: ceph-prometheus-alerts noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 17 k 2026-02-17T21:16:23.249 INFO:teuthology.orchestra.run.trial135.stdout: cephadm noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 769 k 2026-02-17T21:16:23.249 INFO:teuthology.orchestra.run.trial135.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T21:16:23.250 INFO:teuthology.orchestra.run.trial135.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T21:16:23.250 INFO:teuthology.orchestra.run.trial135.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T21:16:23.250 INFO:teuthology.orchestra.run.trial135.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T21:16:23.250 INFO:teuthology.orchestra.run.trial135.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T21:16:23.250 INFO:teuthology.orchestra.run.trial135.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T21:16:23.250 INFO:teuthology.orchestra.run.trial135.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T21:16:23.250 INFO:teuthology.orchestra.run.trial135.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T21:16:23.250 INFO:teuthology.orchestra.run.trial135.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T21:16:23.250 INFO:teuthology.orchestra.run.trial135.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T21:16:23.250 INFO:teuthology.orchestra.run.trial135.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T21:16:23.250 INFO:teuthology.orchestra.run.trial135.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T21:16:23.251 INFO:teuthology.orchestra.run.trial135.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T21:16:23.251 INFO:teuthology.orchestra.run.trial135.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T21:16:23.251 INFO:teuthology.orchestra.run.trial135.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T21:16:23.251 INFO:teuthology.orchestra.run.trial135.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T21:16:23.251 INFO:teuthology.orchestra.run.trial135.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T21:16:23.251 INFO:teuthology.orchestra.run.trial135.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T21:16:23.251 INFO:teuthology.orchestra.run.trial135.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T21:16:23.251 INFO:teuthology.orchestra.run.trial135.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T21:16:23.251 INFO:teuthology.orchestra.run.trial135.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T21:16:23.251 INFO:teuthology.orchestra.run.trial135.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T21:16:23.251 INFO:teuthology.orchestra.run.trial135.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T21:16:23.252 INFO:teuthology.orchestra.run.trial135.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T21:16:23.252 INFO:teuthology.orchestra.run.trial135.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T21:16:23.252 INFO:teuthology.orchestra.run.trial135.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T21:16:23.252 INFO:teuthology.orchestra.run.trial135.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T21:16:23.252 INFO:teuthology.orchestra.run.trial135.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T21:16:23.252 INFO:teuthology.orchestra.run.trial135.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T21:16:23.252 INFO:teuthology.orchestra.run.trial135.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T21:16:23.252 INFO:teuthology.orchestra.run.trial135.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T21:16:23.252 INFO:teuthology.orchestra.run.trial135.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T21:16:23.252 INFO:teuthology.orchestra.run.trial135.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T21:16:23.253 INFO:teuthology.orchestra.run.trial135.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T21:16:23.253 INFO:teuthology.orchestra.run.trial135.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T21:16:23.253 INFO:teuthology.orchestra.run.trial135.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T21:16:23.253 INFO:teuthology.orchestra.run.trial135.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T21:16:23.253 INFO:teuthology.orchestra.run.trial135.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T21:16:23.253 INFO:teuthology.orchestra.run.trial135.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T21:16:23.253 INFO:teuthology.orchestra.run.trial135.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T21:16:23.253 INFO:teuthology.orchestra.run.trial135.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T21:16:23.253 INFO:teuthology.orchestra.run.trial135.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T21:16:23.253 INFO:teuthology.orchestra.run.trial135.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T21:16:23.253 INFO:teuthology.orchestra.run.trial135.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T21:16:23.254 INFO:teuthology.orchestra.run.trial135.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T21:16:23.254 INFO:teuthology.orchestra.run.trial135.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T21:16:23.254 INFO:teuthology.orchestra.run.trial135.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T21:16:23.254 INFO:teuthology.orchestra.run.trial135.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T21:16:23.254 INFO:teuthology.orchestra.run.trial135.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T21:16:23.254 INFO:teuthology.orchestra.run.trial135.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T21:16:23.254 INFO:teuthology.orchestra.run.trial135.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T21:16:23.254 INFO:teuthology.orchestra.run.trial135.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T21:16:23.254 INFO:teuthology.orchestra.run.trial135.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T21:16:23.254 INFO:teuthology.orchestra.run.trial135.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T21:16:23.254 INFO:teuthology.orchestra.run.trial135.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T21:16:23.255 INFO:teuthology.orchestra.run.trial135.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T21:16:23.255 INFO:teuthology.orchestra.run.trial135.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T21:16:23.255 INFO:teuthology.orchestra.run.trial135.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T21:16:23.255 INFO:teuthology.orchestra.run.trial135.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T21:16:23.255 INFO:teuthology.orchestra.run.trial135.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T21:16:23.255 INFO:teuthology.orchestra.run.trial135.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T21:16:23.255 INFO:teuthology.orchestra.run.trial135.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T21:16:23.255 INFO:teuthology.orchestra.run.trial135.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T21:16:23.255 INFO:teuthology.orchestra.run.trial135.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T21:16:23.255 INFO:teuthology.orchestra.run.trial135.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T21:16:23.256 INFO:teuthology.orchestra.run.trial135.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T21:16:23.256 INFO:teuthology.orchestra.run.trial135.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T21:16:23.256 INFO:teuthology.orchestra.run.trial135.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T21:16:23.256 INFO:teuthology.orchestra.run.trial135.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T21:16:23.256 INFO:teuthology.orchestra.run.trial135.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T21:16:23.256 INFO:teuthology.orchestra.run.trial135.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T21:16:23.256 INFO:teuthology.orchestra.run.trial135.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T21:16:23.256 INFO:teuthology.orchestra.run.trial135.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T21:16:23.256 INFO:teuthology.orchestra.run.trial135.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T21:16:23.256 INFO:teuthology.orchestra.run.trial135.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T21:16:23.256 INFO:teuthology.orchestra.run.trial135.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T21:16:23.257 INFO:teuthology.orchestra.run.trial135.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T21:16:23.257 INFO:teuthology.orchestra.run.trial135.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T21:16:23.257 INFO:teuthology.orchestra.run.trial135.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T21:16:23.257 INFO:teuthology.orchestra.run.trial135.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T21:16:23.257 INFO:teuthology.orchestra.run.trial135.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T21:16:23.257 INFO:teuthology.orchestra.run.trial135.stdout:Installing weak dependencies: 2026-02-17T21:16:23.257 INFO:teuthology.orchestra.run.trial135.stdout: ceph-mgr-cephadm noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 150 k 2026-02-17T21:16:23.257 INFO:teuthology.orchestra.run.trial135.stdout: ceph-mgr-dashboard noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 3.8 M 2026-02-17T21:16:23.257 INFO:teuthology.orchestra.run.trial135.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 7.4 M 2026-02-17T21:16:23.257 INFO:teuthology.orchestra.run.trial135.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 22 k 2026-02-17T21:16:23.258 INFO:teuthology.orchestra.run.trial135.stdout: ceph-mgr-rook noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 49 k 2026-02-17T21:16:23.258 INFO:teuthology.orchestra.run.trial135.stdout: ceph-volume noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 299 k 2026-02-17T21:16:23.258 INFO:teuthology.orchestra.run.trial135.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T21:16:23.258 INFO:teuthology.orchestra.run.trial135.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T21:16:23.258 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:23.258 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:16:23.258 INFO:teuthology.orchestra.run.trial135.stdout:====================================================================================== 2026-02-17T21:16:23.258 INFO:teuthology.orchestra.run.trial135.stdout:Install 99 Packages 2026-02-17T21:16:23.258 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:23.259 INFO:teuthology.orchestra.run.trial119.stdout:(4/99): ceph-grafana-dashboards-19.2.3-679.gd85 954 kB/s | 31 kB 00:00 2026-02-17T21:16:23.260 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 95 M 2026-02-17T21:16:23.260 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 520 M 2026-02-17T21:16:23.260 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:16:23.292 INFO:teuthology.orchestra.run.trial119.stdout:(5/99): ceph-mgr-cephadm-19.2.3-679.gd855f53b.e 4.0 MB/s | 150 kB 00:00 2026-02-17T21:16:23.449 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T21:16:23.449 INFO:teuthology.orchestra.run.trial005.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T21:16:23.449 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:23.465 INFO:teuthology.orchestra.run.trial119.stdout:(6/99): ceph-osd-19.2.3-679.gd855f53b.el9.x86_6 39 MB/s | 17 MB 00:00 2026-02-17T21:16:23.472 INFO:teuthology.orchestra.run.trial119.stdout:(7/99): ceph-mgr-dashboard-19.2.3-679.gd855f53b 21 MB/s | 3.8 MB 00:00 2026-02-17T21:16:23.483 INFO:teuthology.orchestra.run.trial005.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T21:16:23.485 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-ceph-common-2:19.2.3-679.gd855f53b.el9.x86 31/37 2026-02-17T21:16:23.507 INFO:teuthology.orchestra.run.trial119.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-679.gd855f53b 623 kB/s | 22 kB 00:00 2026-02-17T21:16:23.529 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 35/37 2026-02-17T21:16:23.553 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 35/37 2026-02-17T21:16:23.553 INFO:teuthology.orchestra.run.trial176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:23.553 INFO:teuthology.orchestra.run.trial176.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T21:16:23.553 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T21:16:23.553 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T21:16:23.553 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:23.555 INFO:teuthology.orchestra.run.trial176.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T21:16:23.557 INFO:teuthology.orchestra.run.trial119.stdout:(9/99): ceph-mgr-modules-core-19.2.3-679.gd855f 5.0 MB/s | 253 kB 00:00 2026-02-17T21:16:23.567 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T21:16:23.567 INFO:teuthology.orchestra.run.trial176.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T21:16:23.607 INFO:teuthology.orchestra.run.trial119.stdout:(10/99): ceph-mgr-diskprediction-local-19.2.3-6 52 MB/s | 7.4 MB 00:00 2026-02-17T21:16:23.608 INFO:teuthology.orchestra.run.trial119.stdout:(11/99): ceph-mgr-rook-19.2.3-679.gd855f53b.el9 968 kB/s | 49 kB 00:00 2026-02-17T21:16:23.619 INFO:teuthology.orchestra.run.trial119.stdout:(12/99): ceph-prometheus-alerts-19.2.3-679.gd85 1.4 MB/s | 17 kB 00:00 2026-02-17T21:16:23.622 INFO:teuthology.orchestra.run.trial119.stdout:(13/99): ceph-volume-19.2.3-679.gd855f53b.el9.n 21 MB/s | 299 kB 00:00 2026-02-17T21:16:23.622 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T21:16:23.623 INFO:teuthology.orchestra.run.trial176.stdout:Creating group 'qat' with GID 992. 2026-02-17T21:16:23.623 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:23.634 INFO:teuthology.orchestra.run.trial119.stdout:(14/99): cephadm-19.2.3-679.gd855f53b.el9.noarc 50 MB/s | 769 kB 00:00 2026-02-17T21:16:23.861 INFO:teuthology.orchestra.run.trial135.stdout:(1/99): ceph-19.2.3-679.gd855f53b.el9.x86_64.rp 114 kB/s | 6.5 kB 00:00 2026-02-17T21:16:23.903 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 1/37 2026-02-17T21:16:23.903 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 2/37 2026-02-17T21:16:23.903 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 3/37 2026-02-17T21:16:23.903 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 4/37 2026-02-17T21:16:23.903 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 5/37 2026-02-17T21:16:23.903 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 6/37 2026-02-17T21:16:23.903 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 7/37 2026-02-17T21:16:23.904 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-ceph-argparse-2:19.2.3-679.gd855f53b.el9.x 8/37 2026-02-17T21:16:23.904 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-ceph-common-2:19.2.3-679.gd855f53b.el9.x86 9/37 2026-02-17T21:16:23.904 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 10/37 2026-02-17T21:16:23.904 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 11/37 2026-02-17T21:16:23.904 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 12/37 2026-02-17T21:16:23.904 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 13/37 2026-02-17T21:16:23.904 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T21:16:23.904 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T21:16:23.904 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T21:16:23.904 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T21:16:23.904 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T21:16:23.904 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T21:16:23.904 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T21:16:23.905 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T21:16:23.905 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T21:16:23.905 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T21:16:23.905 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T21:16:23.905 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T21:16:23.905 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T21:16:23.905 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T21:16:23.905 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T21:16:23.905 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T21:16:23.905 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T21:16:23.905 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T21:16:23.905 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T21:16:23.906 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T21:16:23.906 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : librados2-2:19.2.3-679.gd855f53b.el9.x86_64 34/37 2026-02-17T21:16:23.906 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T21:16:23.906 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 36/37 2026-02-17T21:16:23.935 INFO:teuthology.orchestra.run.trial135.stdout:(2/99): ceph-mgr-19.2.3-679.gd855f53b.el9.x86_6 8.2 MB/s | 1.1 MB 00:00 2026-02-17T21:16:23.956 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T21:16:23.956 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:23.957 INFO:teuthology.orchestra.run.trial176.stdout:Upgraded: 2026-02-17T21:16:23.957 INFO:teuthology.orchestra.run.trial176.stdout: librados2-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:23.957 INFO:teuthology.orchestra.run.trial176.stdout: librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:23.957 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:16:23.957 INFO:teuthology.orchestra.run.trial176.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T21:16:23.957 INFO:teuthology.orchestra.run.trial176.stdout: ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:23.957 INFO:teuthology.orchestra.run.trial176.stdout: ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:23.957 INFO:teuthology.orchestra.run.trial176.stdout: ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:23.957 INFO:teuthology.orchestra.run.trial176.stdout: ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:23.958 INFO:teuthology.orchestra.run.trial176.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T21:16:23.958 INFO:teuthology.orchestra.run.trial176.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T21:16:23.958 INFO:teuthology.orchestra.run.trial176.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T21:16:23.958 INFO:teuthology.orchestra.run.trial176.stdout: libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:23.958 INFO:teuthology.orchestra.run.trial176.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T21:16:23.958 INFO:teuthology.orchestra.run.trial176.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T21:16:23.958 INFO:teuthology.orchestra.run.trial176.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T21:16:23.958 INFO:teuthology.orchestra.run.trial176.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T21:16:23.958 INFO:teuthology.orchestra.run.trial176.stdout: libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:23.958 INFO:teuthology.orchestra.run.trial176.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T21:16:23.958 INFO:teuthology.orchestra.run.trial176.stdout: librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:23.958 INFO:teuthology.orchestra.run.trial176.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T21:16:23.959 INFO:teuthology.orchestra.run.trial176.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T21:16:23.959 INFO:teuthology.orchestra.run.trial176.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T21:16:23.959 INFO:teuthology.orchestra.run.trial176.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T21:16:23.959 INFO:teuthology.orchestra.run.trial176.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T21:16:23.959 INFO:teuthology.orchestra.run.trial176.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T21:16:23.959 INFO:teuthology.orchestra.run.trial176.stdout: python3-ceph-argparse-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:23.959 INFO:teuthology.orchestra.run.trial176.stdout: python3-ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:23.959 INFO:teuthology.orchestra.run.trial176.stdout: python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:23.959 INFO:teuthology.orchestra.run.trial176.stdout: python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:23.959 INFO:teuthology.orchestra.run.trial176.stdout: python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:23.959 INFO:teuthology.orchestra.run.trial176.stdout: python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:23.959 INFO:teuthology.orchestra.run.trial176.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T21:16:23.959 INFO:teuthology.orchestra.run.trial176.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T21:16:23.960 INFO:teuthology.orchestra.run.trial176.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T21:16:23.960 INFO:teuthology.orchestra.run.trial176.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T21:16:23.960 INFO:teuthology.orchestra.run.trial176.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T21:16:23.960 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:23.960 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:16:23.960 INFO:teuthology.orchestra.run.trial135.stdout:(3/99): ceph-mds-19.2.3-679.gd855f53b.el9.x86_6 16 MB/s | 2.4 MB 00:00 2026-02-17T21:16:23.980 INFO:teuthology.orchestra.run.trial135.stdout:(4/99): ceph-grafana-dashboards-19.2.3-679.gd85 1.3 MB/s | 31 kB 00:00 2026-02-17T21:16:23.997 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-test 2026-02-17T21:16:24.007 INFO:teuthology.orchestra.run.trial135.stdout:(5/99): ceph-mgr-cephadm-19.2.3-679.gd855f53b.e 5.5 MB/s | 150 kB 00:00 2026-02-17T21:16:24.071 INFO:teuthology.orchestra.run.trial119.stdout:(15/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 93 kB/s | 40 kB 00:00 2026-02-17T21:16:24.158 INFO:teuthology.orchestra.run.trial135.stdout:(6/99): ceph-mgr-dashboard-19.2.3-679.gd855f53b 25 MB/s | 3.8 MB 00:00 2026-02-17T21:16:24.302 INFO:teuthology.orchestra.run.trial135.stdout:(7/99): ceph-mon-19.2.3-679.gd855f53b.el9.x86_6 11 MB/s | 4.7 MB 00:00 2026-02-17T21:16:24.303 INFO:teuthology.orchestra.run.trial119.stdout:(16/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 514 kB/s | 350 kB 00:00 2026-02-17T21:16:24.307 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:13 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:16:24.354 INFO:teuthology.orchestra.run.trial135.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-679.gd855f53b 425 kB/s | 22 kB 00:00 2026-02-17T21:16:24.387 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:24.388 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:24.388 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repository Size 2026-02-17T21:16:24.388 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:24.388 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:16:24.388 INFO:teuthology.orchestra.run.trial176.stdout: ceph-test x86_64 2:19.2.3-679.gd855f53b.el9 ceph 50 M 2026-02-17T21:16:24.388 INFO:teuthology.orchestra.run.trial176.stdout:Installing dependencies: 2026-02-17T21:16:24.388 INFO:teuthology.orchestra.run.trial176.stdout: libcephsqlite x86_64 2:19.2.3-679.gd855f53b.el9 ceph 163 k 2026-02-17T21:16:24.388 INFO:teuthology.orchestra.run.trial176.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T21:16:24.389 INFO:teuthology.orchestra.run.trial176.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T21:16:24.389 INFO:teuthology.orchestra.run.trial176.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T21:16:24.389 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:24.389 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:16:24.389 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:24.389 INFO:teuthology.orchestra.run.trial176.stdout:Install 5 Packages 2026-02-17T21:16:24.389 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:24.389 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 50 M 2026-02-17T21:16:24.389 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 212 M 2026-02-17T21:16:24.389 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:16:24.415 INFO:teuthology.orchestra.run.trial135.stdout:(9/99): ceph-mgr-modules-core-19.2.3-679.gd855f 4.1 MB/s | 253 kB 00:00 2026-02-17T21:16:24.437 INFO:teuthology.orchestra.run.trial135.stdout:(10/99): ceph-mgr-diskprediction-local-19.2.3-6 26 MB/s | 7.4 MB 00:00 2026-02-17T21:16:24.453 INFO:teuthology.orchestra.run.trial135.stdout:(11/99): ceph-mgr-rook-19.2.3-679.gd855f53b.el9 1.3 MB/s | 49 kB 00:00 2026-02-17T21:16:24.458 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 32/37 2026-02-17T21:16:24.460 INFO:teuthology.orchestra.run.trial135.stdout:(12/99): ceph-prometheus-alerts-19.2.3-679.gd85 727 kB/s | 17 kB 00:00 2026-02-17T21:16:24.461 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 32/37 2026-02-17T21:16:24.479 INFO:teuthology.orchestra.run.trial119.stdout:(17/99): libconfig-1.7.2-9.el9.x86_64.rpm 176 kB/s | 72 kB 00:00 2026-02-17T21:16:24.486 INFO:teuthology.orchestra.run.trial135.stdout:(13/99): ceph-volume-19.2.3-679.gd855f53b.el9.n 8.8 MB/s | 299 kB 00:00 2026-02-17T21:16:24.508 INFO:teuthology.orchestra.run.trial135.stdout:(14/99): cephadm-19.2.3-679.gd855f53b.el9.noarc 16 MB/s | 769 kB 00:00 2026-02-17T21:16:24.557 INFO:teuthology.orchestra.run.trial135.stdout:(15/99): ceph-osd-19.2.3-679.gd855f53b.el9.x86_ 27 MB/s | 17 MB 00:00 2026-02-17T21:16:24.561 INFO:teuthology.orchestra.run.trial119.stdout:(18/99): libgfortran-11.5.0-14.el9.x86_64.rpm 3.0 MB/s | 794 kB 00:00 2026-02-17T21:16:24.584 INFO:teuthology.orchestra.run.trial176.stdout:(1/5): libcephsqlite-19.2.3-679.gd855f53b.el9.x 1.2 MB/s | 163 kB 00:00 2026-02-17T21:16:24.663 INFO:teuthology.orchestra.run.trial119.stdout:(19/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.4 MB/s | 253 kB 00:00 2026-02-17T21:16:24.744 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 32/37 2026-02-17T21:16:24.747 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 33/37 2026-02-17T21:16:24.787 INFO:teuthology.orchestra.run.trial135.stdout:(16/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 145 kB/s | 40 kB 00:00 2026-02-17T21:16:24.789 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 33/37 2026-02-17T21:16:24.789 INFO:teuthology.orchestra.run.trial005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T21:16:24.789 INFO:teuthology.orchestra.run.trial005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T21:16:24.789 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:24.793 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 34/37 2026-02-17T21:16:24.844 INFO:teuthology.orchestra.run.trial119.stdout:(20/99): python3-cryptography-36.0.1-5.el9.x86_ 6.9 MB/s | 1.2 MB 00:00 2026-02-17T21:16:24.914 INFO:teuthology.orchestra.run.trial135.stdout:(17/99): libconfig-1.7.2-9.el9.x86_64.rpm 202 kB/s | 72 kB 00:00 2026-02-17T21:16:24.945 INFO:teuthology.orchestra.run.trial119.stdout:(21/99): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2026-02-17T21:16:25.029 INFO:teuthology.orchestra.run.trial135.stdout:(18/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 646 kB/s | 350 kB 00:00 2026-02-17T21:16:25.047 INFO:teuthology.orchestra.run.trial119.stdout:(22/99): python3-pycparser-2.20-6.el9.noarch.rp 1.3 MB/s | 135 kB 00:00 2026-02-17T21:16:25.093 INFO:teuthology.orchestra.run.trial176.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 362 kB/s | 233 kB 00:00 2026-02-17T21:16:25.121 INFO:teuthology.orchestra.run.trial119.stdout:(23/99): libquadmath-11.5.0-14.el9.x86_64.rpm 288 kB/s | 184 kB 00:00 2026-02-17T21:16:25.144 INFO:teuthology.orchestra.run.trial135.stdout:(19/99): libquadmath-11.5.0-14.el9.x86_64.rpm 802 kB/s | 184 kB 00:00 2026-02-17T21:16:25.145 INFO:teuthology.orchestra.run.trial135.stdout:(20/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2026-02-17T21:16:25.147 INFO:teuthology.orchestra.run.trial119.stdout:(24/99): python3-pyparsing-2.4.7-9.el9.noarch.r 1.5 MB/s | 150 kB 00:00 2026-02-17T21:16:25.177 INFO:teuthology.orchestra.run.trial176.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 761 kB/s | 64 kB 00:00 2026-02-17T21:16:25.225 INFO:teuthology.orchestra.run.trial135.stdout:(21/99): libgfortran-11.5.0-14.el9.x86_64.rpm 1.8 MB/s | 794 kB 00:00 2026-02-17T21:16:25.239 INFO:teuthology.orchestra.run.trial135.stdout:(22/99): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2026-02-17T21:16:25.248 INFO:teuthology.orchestra.run.trial119.stdout:(25/99): python3-urllib3-1.26.5-7.el9.noarch.rp 2.1 MB/s | 218 kB 00:00 2026-02-17T21:16:25.295 INFO:teuthology.orchestra.run.trial176.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 427 kB/s | 303 kB 00:00 2026-02-17T21:16:25.313 INFO:teuthology.orchestra.run.trial135.stdout:(23/99): python3-pycparser-2.20-6.el9.noarch.rp 1.5 MB/s | 135 kB 00:00 2026-02-17T21:16:25.340 INFO:teuthology.orchestra.run.trial135.stdout:(24/99): python3-pyparsing-2.4.7-9.el9.noarch.r 1.5 MB/s | 150 kB 00:00 2026-02-17T21:16:25.349 INFO:teuthology.orchestra.run.trial119.stdout:(26/99): unzip-6.0-59.el9.x86_64.rpm 1.8 MB/s | 182 kB 00:00 2026-02-17T21:16:25.400 INFO:teuthology.orchestra.run.trial135.stdout:(25/99): python3-requests-2.25.1-10.el9.noarch. 1.4 MB/s | 126 kB 00:00 2026-02-17T21:16:25.450 INFO:teuthology.orchestra.run.trial119.stdout:(27/99): zip-3.0-35.el9.x86_64.rpm 2.6 MB/s | 266 kB 00:00 2026-02-17T21:16:25.453 INFO:teuthology.orchestra.run.trial135.stdout:(26/99): python3-urllib3-1.26.5-7.el9.noarch.rp 1.9 MB/s | 218 kB 00:00 2026-02-17T21:16:25.461 INFO:teuthology.orchestra.run.trial135.stdout:(27/99): python3-cryptography-36.0.1-5.el9.x86_ 3.9 MB/s | 1.2 MB 00:00 2026-02-17T21:16:25.475 INFO:teuthology.orchestra.run.trial119.stdout:(28/99): flexiblas-3.0.4-9.el9.x86_64.rpm 1.1 MB/s | 30 kB 00:00 2026-02-17T21:16:25.489 INFO:teuthology.orchestra.run.trial135.stdout:(28/99): unzip-6.0-59.el9.x86_64.rpm 2.0 MB/s | 182 kB 00:00 2026-02-17T21:16:25.516 INFO:teuthology.orchestra.run.trial176.stdout:(5/5): ceph-test-19.2.3-679.gd855f53b.el9.x86_6 46 MB/s | 50 MB 00:01 2026-02-17T21:16:25.518 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:25.519 INFO:teuthology.orchestra.run.trial176.stdout:Total 45 MB/s | 50 MB 00:01 2026-02-17T21:16:25.530 INFO:teuthology.orchestra.run.trial119.stdout:(29/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 54 MB/s | 3.0 MB 00:00 2026-02-17T21:16:25.531 INFO:teuthology.orchestra.run.trial119.stdout:(30/99): python3-requests-2.25.1-10.el9.noarch. 308 kB/s | 126 kB 00:00 2026-02-17T21:16:25.539 INFO:teuthology.orchestra.run.trial119.stdout:(31/99): flexiblas-openblas-openmp-3.0.4-9.el9. 1.7 MB/s | 15 kB 00:00 2026-02-17T21:16:25.547 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:16:25.549 INFO:teuthology.orchestra.run.trial119.stdout:(32/99): lua-5.4.4-4.el9.x86_64.rpm 19 MB/s | 188 kB 00:00 2026-02-17T21:16:25.556 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:16:25.556 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:16:25.558 INFO:teuthology.orchestra.run.trial119.stdout:(33/99): openblas-0.3.29-1.el9.x86_64.rpm 4.8 MB/s | 42 kB 00:00 2026-02-17T21:16:25.572 INFO:teuthology.orchestra.run.trial135.stdout:(29/99): zip-3.0-35.el9.x86_64.rpm 2.2 MB/s | 266 kB 00:00 2026-02-17T21:16:25.576 INFO:teuthology.orchestra.run.trial119.stdout:(34/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 5.3 MB/s | 246 kB 00:00 2026-02-17T21:16:25.585 INFO:teuthology.orchestra.run.trial119.stdout:(35/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 194 MB/s | 5.3 MB 00:00 2026-02-17T21:16:25.610 INFO:teuthology.orchestra.run.trial119.stdout:(36/99): protobuf-3.14.0-17.el9.x86_64.rpm 30 MB/s | 1.0 MB 00:00 2026-02-17T21:16:25.614 INFO:teuthology.orchestra.run.trial135.stdout:(30/99): flexiblas-3.0.4-9.el9.x86_64.rpm 194 kB/s | 30 kB 00:00 2026-02-17T21:16:25.614 INFO:teuthology.orchestra.run.trial135.stdout:(31/99): flexiblas-openblas-openmp-3.0.4-9.el9. 357 kB/s | 15 kB 00:00 2026-02-17T21:16:25.618 INFO:teuthology.orchestra.run.trial119.stdout:(37/99): python3-babel-2.9.1-2.el9.noarch.rpm 180 MB/s | 6.0 MB 00:00 2026-02-17T21:16:25.621 INFO:teuthology.orchestra.run.trial119.stdout:(38/99): python3-devel-3.9.25-2.el9.x86_64.rpm 21 MB/s | 244 kB 00:00 2026-02-17T21:16:25.630 INFO:teuthology.orchestra.run.trial119.stdout:(39/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 22 MB/s | 249 kB 00:00 2026-02-17T21:16:25.633 INFO:teuthology.orchestra.run.trial119.stdout:(40/99): python3-libstoragemgmt-1.10.1-1.el9.x8 15 MB/s | 177 kB 00:00 2026-02-17T21:16:25.644 INFO:teuthology.orchestra.run.trial119.stdout:(41/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 89 MB/s | 1.2 MB 00:00 2026-02-17T21:16:25.644 INFO:teuthology.orchestra.run.trial119.stdout:(42/99): python3-mako-1.1.4-6.el9.noarch.rpm 15 MB/s | 172 kB 00:00 2026-02-17T21:16:25.653 INFO:teuthology.orchestra.run.trial119.stdout:(43/99): python3-markupsafe-1.1.1-12.el9.x86_64 3.7 MB/s | 35 kB 00:00 2026-02-17T21:16:25.664 INFO:teuthology.orchestra.run.trial119.stdout:(44/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 40 MB/s | 442 kB 00:00 2026-02-17T21:16:25.668 INFO:teuthology.orchestra.run.trial135.stdout:(32/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 17 MB/s | 3.0 MB 00:00 2026-02-17T21:16:25.674 INFO:teuthology.orchestra.run.trial119.stdout:(45/99): python3-packaging-20.9-5.el9.noarch.rp 7.8 MB/s | 77 kB 00:00 2026-02-17T21:16:25.684 INFO:teuthology.orchestra.run.trial119.stdout:(46/99): python3-protobuf-3.14.0-17.el9.noarch. 26 MB/s | 267 kB 00:00 2026-02-17T21:16:25.695 INFO:teuthology.orchestra.run.trial119.stdout:(47/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 15 MB/s | 159 kB 00:00 2026-02-17T21:16:25.706 INFO:teuthology.orchestra.run.trial119.stdout:(48/99): python3-pyasn1-modules-0.4.8-6.el9.noa 25 MB/s | 279 kB 00:00 2026-02-17T21:16:25.715 INFO:teuthology.orchestra.run.trial119.stdout:(49/99): python3-requests-oauthlib-1.3.0-12.el9 5.7 MB/s | 54 kB 00:00 2026-02-17T21:16:25.722 INFO:teuthology.orchestra.run.trial135.stdout:(33/99): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2026-02-17T21:16:25.733 INFO:teuthology.orchestra.run.trial135.stdout:(34/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.0 MB/s | 246 kB 00:00 2026-02-17T21:16:25.741 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:16:25.742 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:16:25.749 INFO:teuthology.orchestra.run.trial135.stdout:(35/99): openblas-0.3.29-1.el9.x86_64.rpm 521 kB/s | 42 kB 00:00 2026-02-17T21:16:25.779 INFO:teuthology.orchestra.run.trial119.stdout:(50/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 46 MB/s | 6.1 MB 00:00 2026-02-17T21:16:25.788 INFO:teuthology.orchestra.run.trial119.stdout:(51/99): python3-toml-0.10.2-6.el9.noarch.rpm 4.4 MB/s | 42 kB 00:00 2026-02-17T21:16:25.814 INFO:teuthology.orchestra.run.trial119.stdout:(52/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 195 MB/s | 19 MB 00:00 2026-02-17T21:16:25.815 INFO:teuthology.orchestra.run.trial119.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 7.0 MB/s | 189 kB 00:00 2026-02-17T21:16:25.823 INFO:teuthology.orchestra.run.trial119.stdout:(54/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 10 MB/s | 90 kB 00:00 2026-02-17T21:16:25.838 INFO:teuthology.orchestra.run.trial135.stdout:(36/99): protobuf-3.14.0-17.el9.x86_64.rpm 9.9 MB/s | 1.0 MB 00:00 2026-02-17T21:16:25.877 INFO:teuthology.orchestra.run.trial119.stdout:(55/99): lua-devel-5.4.4-4.el9.x86_64.rpm 363 kB/s | 22 kB 00:00 2026-02-17T21:16:25.908 INFO:teuthology.orchestra.run.trial119.stdout:(56/99): protobuf-compiler-3.14.0-17.el9.x86_64 9.9 MB/s | 862 kB 00:00 2026-02-17T21:16:25.949 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:16:25.954 INFO:teuthology.orchestra.run.trial176.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T21:16:25.958 INFO:teuthology.orchestra.run.trial135.stdout:(37/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 22 MB/s | 5.3 MB 00:00 2026-02-17T21:16:25.958 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T21:16:25.966 INFO:teuthology.orchestra.run.trial176.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T21:16:25.967 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 4/5 2026-02-17T21:16:26.024 INFO:teuthology.orchestra.run.trial135.stdout:(38/99): python3-devel-3.9.25-2.el9.x86_64.rpm 1.3 MB/s | 244 kB 00:00 2026-02-17T21:16:26.063 INFO:teuthology.orchestra.run.trial135.stdout:(39/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 2.3 MB/s | 249 kB 00:00 2026-02-17T21:16:26.088 INFO:teuthology.orchestra.run.trial135.stdout:(40/99): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2026-02-17T21:16:26.117 INFO:teuthology.orchestra.run.trial135.stdout:(41/99): python3-libstoragemgmt-1.10.1-1.el9.x8 1.9 MB/s | 177 kB 00:00 2026-02-17T21:16:26.159 INFO:teuthology.orchestra.run.trial119.stdout:(57/99): grpc-data-1.46.7-10.el9.noarch.rpm 77 kB/s | 19 kB 00:00 2026-02-17T21:16:26.161 INFO:teuthology.orchestra.run.trial135.stdout:(42/99): python3-mako-1.1.4-6.el9.noarch.rpm 2.3 MB/s | 172 kB 00:00 2026-02-17T21:16:26.174 INFO:teuthology.orchestra.run.trial135.stdout:(43/99): python3-markupsafe-1.1.1-12.el9.x86_64 617 kB/s | 35 kB 00:00 2026-02-17T21:16:26.175 INFO:teuthology.orchestra.run.trial135.stdout:(44/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 11 MB/s | 1.2 MB 00:00 2026-02-17T21:16:26.246 INFO:teuthology.orchestra.run.trial135.stdout:(45/99): python3-packaging-20.9-5.el9.noarch.rp 1.1 MB/s | 77 kB 00:00 2026-02-17T21:16:26.289 INFO:teuthology.orchestra.run.trial135.stdout:(46/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 3.7 MB/s | 442 kB 00:00 2026-02-17T21:16:26.361 INFO:teuthology.orchestra.run.trial135.stdout:(47/99): python3-protobuf-3.14.0-17.el9.noarch. 2.3 MB/s | 267 kB 00:00 2026-02-17T21:16:26.369 INFO:teuthology.orchestra.run.trial119.stdout:(58/99): luarocks-3.9.2-5.el9.noarch.rpm 722 kB/s | 151 kB 00:00 2026-02-17T21:16:26.371 INFO:teuthology.orchestra.run.trial135.stdout:(48/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2026-02-17T21:16:26.389 INFO:teuthology.orchestra.run.trial119.stdout:(59/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.1 MB/s | 551 kB 00:00 2026-02-17T21:16:26.440 INFO:teuthology.orchestra.run.trial135.stdout:(49/99): python3-requests-oauthlib-1.3.0-12.el9 784 kB/s | 54 kB 00:00 2026-02-17T21:16:26.452 INFO:teuthology.orchestra.run.trial119.stdout:(60/99): python3-autocommand-2.2.2-8.el9.noarch 472 kB/s | 29 kB 00:00 2026-02-17T21:16:26.458 INFO:teuthology.orchestra.run.trial135.stdout:(50/99): python3-pyasn1-modules-0.4.8-6.el9.noa 2.8 MB/s | 279 kB 00:00 2026-02-17T21:16:26.501 INFO:teuthology.orchestra.run.trial135.stdout:(51/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 18 MB/s | 6.1 MB 00:00 2026-02-17T21:16:26.513 INFO:teuthology.orchestra.run.trial135.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 761 kB/s | 42 kB 00:00 2026-02-17T21:16:26.516 INFO:teuthology.orchestra.run.trial119.stdout:(61/99): python3-backports-tarfile-1.2.0-1.el9. 936 kB/s | 60 kB 00:00 2026-02-17T21:16:26.563 INFO:teuthology.orchestra.run.trial119.stdout:(62/99): python3-asyncssh-2.13.2-5.el9.noarch.r 2.8 MB/s | 548 kB 00:00 2026-02-17T21:16:26.575 INFO:teuthology.orchestra.run.trial135.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 2.5 MB/s | 189 kB 00:00 2026-02-17T21:16:26.578 INFO:teuthology.orchestra.run.trial135.stdout:(54/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 1.4 MB/s | 90 kB 00:00 2026-02-17T21:16:26.579 INFO:teuthology.orchestra.run.trial119.stdout:(63/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 686 kB/s | 43 kB 00:00 2026-02-17T21:16:26.600 INFO:teuthology.orchestra.run.trial135.stdout:(55/99): lua-devel-5.4.4-4.el9.x86_64.rpm 914 kB/s | 22 kB 00:00 2026-02-17T21:16:26.625 INFO:teuthology.orchestra.run.trial119.stdout:(64/99): python3-cachetools-4.2.4-1.el9.noarch. 516 kB/s | 32 kB 00:00 2026-02-17T21:16:26.636 INFO:teuthology.orchestra.run.trial135.stdout:(56/99): protobuf-compiler-3.14.0-17.el9.x86_64 15 MB/s | 862 kB 00:00 2026-02-17T21:16:26.641 INFO:teuthology.orchestra.run.trial119.stdout:(65/99): python3-certifi-2023.05.07-4.el9.noarc 230 kB/s | 14 kB 00:00 2026-02-17T21:16:26.697 INFO:teuthology.orchestra.run.trial119.stdout:(66/99): python3-cheroot-10.0.1-4.el9.noarch.rp 2.3 MB/s | 173 kB 00:00 2026-02-17T21:16:26.728 INFO:teuthology.orchestra.run.trial119.stdout:(67/99): python3-cherrypy-18.6.1-2.el9.noarch.r 4.0 MB/s | 358 kB 00:00 2026-02-17T21:16:26.775 INFO:teuthology.orchestra.run.trial119.stdout:(68/99): python3-google-auth-2.45.0-1.el9.noarc 3.2 MB/s | 254 kB 00:00 2026-02-17T21:16:26.845 INFO:teuthology.orchestra.run.trial119.stdout:(69/99): python3-grpcio-tools-1.46.7-10.el9.x86 2.0 MB/s | 144 kB 00:00 2026-02-17T21:16:26.912 INFO:teuthology.orchestra.run.trial135.stdout:(57/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 41 MB/s | 19 MB 00:00 2026-02-17T21:16:26.913 INFO:teuthology.orchestra.run.trial135.stdout:(58/99): grpc-data-1.46.7-10.el9.noarch.rpm 70 kB/s | 19 kB 00:00 2026-02-17T21:16:26.914 INFO:teuthology.orchestra.run.trial119.stdout:(70/99): python3-influxdb-5.3.1-1.el9.noarch.rp 2.0 MB/s | 139 kB 00:00 2026-02-17T21:16:26.922 INFO:teuthology.orchestra.run.trial119.stdout:(71/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 11 MB/s | 2.0 MB 00:00 2026-02-17T21:16:26.978 INFO:teuthology.orchestra.run.trial119.stdout:(72/99): python3-isodate-0.6.1-3.el9.noarch.rpm 885 kB/s | 56 kB 00:00 2026-02-17T21:16:26.983 INFO:teuthology.orchestra.run.trial119.stdout:(73/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 175 kB/s | 11 kB 00:00 2026-02-17T21:16:27.039 INFO:teuthology.orchestra.run.trial119.stdout:(74/99): python3-jaraco-classes-3.2.1-5.el9.noa 287 kB/s | 18 kB 00:00 2026-02-17T21:16:27.045 INFO:teuthology.orchestra.run.trial119.stdout:(75/99): python3-jaraco-collections-3.0.0-8.el9 379 kB/s | 23 kB 00:00 2026-02-17T21:16:27.101 INFO:teuthology.orchestra.run.trial119.stdout:(76/99): python3-jaraco-context-6.0.1-3.el9.noa 320 kB/s | 20 kB 00:00 2026-02-17T21:16:27.106 INFO:teuthology.orchestra.run.trial119.stdout:(77/99): python3-jaraco-functools-3.5.0-2.el9.n 318 kB/s | 19 kB 00:00 2026-02-17T21:16:27.148 INFO:teuthology.orchestra.run.trial135.stdout:(59/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.0 MB/s | 551 kB 00:00 2026-02-17T21:16:27.162 INFO:teuthology.orchestra.run.trial119.stdout:(78/99): python3-jaraco-text-4.0.0-2.el9.noarch 430 kB/s | 26 kB 00:00 2026-02-17T21:16:27.187 INFO:teuthology.orchestra.run.trial119.stdout:(79/99): python3-kubernetes-26.1.0-3.el9.noarch 13 MB/s | 1.0 MB 00:00 2026-02-17T21:16:27.215 INFO:teuthology.orchestra.run.trial135.stdout:(60/99): python3-autocommand-2.2.2-8.el9.noarch 440 kB/s | 29 kB 00:00 2026-02-17T21:16:27.225 INFO:teuthology.orchestra.run.trial119.stdout:(80/99): python3-logutils-0.3.5-21.el9.noarch.r 731 kB/s | 46 kB 00:00 2026-02-17T21:16:27.249 INFO:teuthology.orchestra.run.trial119.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 1.2 MB/s | 79 kB 00:00 2026-02-17T21:16:27.268 INFO:teuthology.orchestra.run.trial135.stdout:(61/99): python3-asyncssh-2.13.2-5.el9.noarch.r 1.5 MB/s | 548 kB 00:00 2026-02-17T21:16:27.284 INFO:teuthology.orchestra.run.trial135.stdout:(62/99): python3-backports-tarfile-1.2.0-1.el9. 872 kB/s | 60 kB 00:00 2026-02-17T21:16:27.291 INFO:teuthology.orchestra.run.trial119.stdout:(82/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.3 MB/s | 86 kB 00:00 2026-02-17T21:16:27.310 INFO:teuthology.orchestra.run.trial119.stdout:(83/99): python3-natsort-7.1.1-5.el9.noarch.rpm 943 kB/s | 58 kB 00:00 2026-02-17T21:16:27.337 INFO:teuthology.orchestra.run.trial135.stdout:(63/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 622 kB/s | 43 kB 00:00 2026-02-17T21:16:27.348 INFO:teuthology.orchestra.run.trial135.stdout:(64/99): luarocks-3.9.2-5.el9.noarch.rpm 347 kB/s | 151 kB 00:00 2026-02-17T21:16:27.351 INFO:teuthology.orchestra.run.trial135.stdout:(65/99): python3-cachetools-4.2.4-1.el9.noarch. 480 kB/s | 32 kB 00:00 2026-02-17T21:16:27.370 INFO:teuthology.orchestra.run.trial119.stdout:(84/99): python3-pecan-1.4.2-3.el9.noarch.rpm 3.4 MB/s | 272 kB 00:00 2026-02-17T21:16:27.371 INFO:teuthology.orchestra.run.trial119.stdout:(85/99): python3-portend-3.1.0-2.el9.noarch.rpm 269 kB/s | 16 kB 00:00 2026-02-17T21:16:27.405 INFO:teuthology.orchestra.run.trial135.stdout:(66/99): python3-certifi-2023.05.07-4.el9.noarc 209 kB/s | 14 kB 00:00 2026-02-17T21:16:27.433 INFO:teuthology.orchestra.run.trial119.stdout:(86/99): python3-repoze-lru-0.7-16.el9.noarch.r 504 kB/s | 31 kB 00:00 2026-02-17T21:16:27.436 INFO:teuthology.orchestra.run.trial119.stdout:(87/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2026-02-17T21:16:27.445 INFO:teuthology.orchestra.run.trial135.stdout:(67/99): python3-cherrypy-18.6.1-2.el9.noarch.r 3.7 MB/s | 358 kB 00:00 2026-02-17T21:16:27.476 INFO:teuthology.orchestra.run.trial135.stdout:(68/99): python3-cheroot-10.0.1-4.el9.noarch.rp 1.3 MB/s | 173 kB 00:00 2026-02-17T21:16:27.493 INFO:teuthology.orchestra.run.trial135.stdout:(69/99): python3-google-auth-2.45.0-1.el9.noarc 2.8 MB/s | 254 kB 00:00 2026-02-17T21:16:27.496 INFO:teuthology.orchestra.run.trial119.stdout:(88/99): python3-routes-2.5.1-5.el9.noarch.rpm 2.9 MB/s | 188 kB 00:00 2026-02-17T21:16:27.500 INFO:teuthology.orchestra.run.trial119.stdout:(89/99): python3-rsa-4.9-2.el9.noarch.rpm 921 kB/s | 59 kB 00:00 2026-02-17T21:16:27.559 INFO:teuthology.orchestra.run.trial119.stdout:(90/99): python3-saml-1.16.0-1.el9.noarch.rpm 2.0 MB/s | 125 kB 00:00 2026-02-17T21:16:27.563 INFO:teuthology.orchestra.run.trial119.stdout:(91/99): python3-tempora-5.0.0-2.el9.noarch.rpm 572 kB/s | 36 kB 00:00 2026-02-17T21:16:27.571 INFO:teuthology.orchestra.run.trial135.stdout:(70/99): python3-influxdb-5.3.1-1.el9.noarch.rp 1.7 MB/s | 139 kB 00:00 2026-02-17T21:16:27.601 INFO:teuthology.orchestra.run.trial135.stdout:(71/99): python3-grpcio-tools-1.46.7-10.el9.x86 1.1 MB/s | 144 kB 00:00 2026-02-17T21:16:27.621 INFO:teuthology.orchestra.run.trial119.stdout:(92/99): python3-typing-extensions-4.15.0-1.el9 1.4 MB/s | 86 kB 00:00 2026-02-17T21:16:27.638 INFO:teuthology.orchestra.run.trial119.stdout:(93/99): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2026-02-17T21:16:27.642 INFO:teuthology.orchestra.run.trial135.stdout:(72/99): python3-isodate-0.6.1-3.el9.noarch.rpm 791 kB/s | 56 kB 00:00 2026-02-17T21:16:27.657 INFO:teuthology.orchestra.run.trial135.stdout:(73/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 9.6 MB/s | 2.0 MB 00:00 2026-02-17T21:16:27.684 INFO:teuthology.orchestra.run.trial119.stdout:(94/99): python3-websocket-client-1.2.3-2.el9.n 1.4 MB/s | 90 kB 00:00 2026-02-17T21:16:27.698 INFO:teuthology.orchestra.run.trial135.stdout:(74/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 110 kB/s | 11 kB 00:00 2026-02-17T21:16:27.710 INFO:teuthology.orchestra.run.trial135.stdout:(75/99): python3-jaraco-classes-3.2.1-5.el9.noa 260 kB/s | 18 kB 00:00 2026-02-17T21:16:27.723 INFO:teuthology.orchestra.run.trial135.stdout:(76/99): python3-jaraco-collections-3.0.0-8.el9 354 kB/s | 23 kB 00:00 2026-02-17T21:16:27.728 INFO:teuthology.orchestra.run.trial119.stdout:(95/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.7 MB/s | 427 kB 00:00 2026-02-17T21:16:27.745 INFO:teuthology.orchestra.run.trial119.stdout:(96/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 790 kB/s | 48 kB 00:00 2026-02-17T21:16:27.778 INFO:teuthology.orchestra.run.trial135.stdout:(77/99): python3-jaraco-functools-3.5.0-2.el9.n 286 kB/s | 19 kB 00:00 2026-02-17T21:16:27.780 INFO:teuthology.orchestra.run.trial135.stdout:(78/99): python3-jaraco-context-6.0.1-3.el9.noa 237 kB/s | 20 kB 00:00 2026-02-17T21:16:27.788 INFO:teuthology.orchestra.run.trial135.stdout:(79/99): python3-jaraco-text-4.0.0-2.el9.noarch 402 kB/s | 26 kB 00:00 2026-02-17T21:16:27.789 INFO:teuthology.orchestra.run.trial119.stdout:(97/99): python3-xmltodict-0.12.0-15.el9.noarch 361 kB/s | 22 kB 00:00 2026-02-17T21:16:27.807 INFO:teuthology.orchestra.run.trial119.stdout:(98/99): python3-zc-lockfile-2.0-10.el9.noarch. 321 kB/s | 20 kB 00:00 2026-02-17T21:16:27.855 INFO:teuthology.orchestra.run.trial135.stdout:(80/99): python3-more-itertools-8.12.0-2.el9.no 1.2 MB/s | 79 kB 00:00 2026-02-17T21:16:27.888 INFO:teuthology.orchestra.run.trial135.stdout:(81/99): python3-logutils-0.3.5-21.el9.noarch.r 430 kB/s | 46 kB 00:00 2026-02-17T21:16:27.927 INFO:teuthology.orchestra.run.trial135.stdout:(82/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.2 MB/s | 86 kB 00:00 2026-02-17T21:16:27.932 INFO:teuthology.orchestra.run.trial135.stdout:(83/99): python3-kubernetes-26.1.0-3.el9.noarch 6.6 MB/s | 1.0 MB 00:00 2026-02-17T21:16:27.986 INFO:teuthology.orchestra.run.trial135.stdout:(84/99): python3-natsort-7.1.1-5.el9.noarch.rpm 588 kB/s | 58 kB 00:00 2026-02-17T21:16:27.998 INFO:teuthology.orchestra.run.trial135.stdout:(85/99): python3-pecan-1.4.2-3.el9.noarch.rpm 3.7 MB/s | 272 kB 00:00 2026-02-17T21:16:27.999 INFO:teuthology.orchestra.run.trial135.stdout:(86/99): python3-portend-3.1.0-2.el9.noarch.rpm 244 kB/s | 16 kB 00:00 2026-02-17T21:16:28.064 INFO:teuthology.orchestra.run.trial135.stdout:(87/99): python3-repoze-lru-0.7-16.el9.noarch.r 469 kB/s | 31 kB 00:00 2026-02-17T21:16:28.072 INFO:teuthology.orchestra.run.trial135.stdout:(88/99): python3-routes-2.5.1-5.el9.noarch.rpm 2.6 MB/s | 188 kB 00:00 2026-02-17T21:16:28.076 INFO:teuthology.orchestra.run.trial135.stdout:(89/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.0 MB/s | 90 kB 00:00 2026-02-17T21:16:28.130 INFO:teuthology.orchestra.run.trial135.stdout:(90/99): python3-rsa-4.9-2.el9.noarch.rpm 896 kB/s | 59 kB 00:00 2026-02-17T21:16:28.142 INFO:teuthology.orchestra.run.trial135.stdout:(91/99): python3-saml-1.16.0-1.el9.noarch.rpm 1.7 MB/s | 125 kB 00:00 2026-02-17T21:16:28.152 INFO:teuthology.orchestra.run.trial135.stdout:(92/99): python3-tempora-5.0.0-2.el9.noarch.rpm 472 kB/s | 36 kB 00:00 2026-02-17T21:16:28.196 INFO:teuthology.orchestra.run.trial135.stdout:(93/99): python3-typing-extensions-4.15.0-1.el9 1.3 MB/s | 86 kB 00:00 2026-02-17T21:16:28.211 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 4/5 2026-02-17T21:16:28.216 INFO:teuthology.orchestra.run.trial135.stdout:(94/99): python3-webob-1.8.8-2.el9.noarch.rpm 3.1 MB/s | 230 kB 00:00 2026-02-17T21:16:28.229 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 5/5 2026-02-17T21:16:28.252 INFO:teuthology.orchestra.run.trial135.stdout:(95/99): python3-websocket-client-1.2.3-2.el9.n 895 kB/s | 90 kB 00:00 2026-02-17T21:16:28.271 INFO:teuthology.orchestra.run.trial135.stdout:(96/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.6 MB/s | 427 kB 00:00 2026-02-17T21:16:28.284 INFO:teuthology.orchestra.run.trial135.stdout:(97/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 713 kB/s | 48 kB 00:00 2026-02-17T21:16:28.337 INFO:teuthology.orchestra.run.trial135.stdout:(98/99): python3-zc-lockfile-2.0-10.el9.noarch. 302 kB/s | 20 kB 00:00 2026-02-17T21:16:28.342 INFO:teuthology.orchestra.run.trial135.stdout:(99/99): python3-xmltodict-0.12.0-15.el9.noarch 248 kB/s | 22 kB 00:00 2026-02-17T21:16:28.344 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:28.344 INFO:teuthology.orchestra.run.trial135.stdout:Total 19 MB/s | 95 MB 00:05 2026-02-17T21:16:28.464 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 5/5 2026-02-17T21:16:28.465 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 1/5 2026-02-17T21:16:28.465 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 2/5 2026-02-17T21:16:28.465 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T21:16:28.465 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T21:16:28.517 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T21:16:28.517 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:28.517 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:16:28.517 INFO:teuthology.orchestra.run.trial176.stdout: ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:28.517 INFO:teuthology.orchestra.run.trial176.stdout: libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:28.517 INFO:teuthology.orchestra.run.trial176.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T21:16:28.517 INFO:teuthology.orchestra.run.trial176.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T21:16:28.517 INFO:teuthology.orchestra.run.trial176.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T21:16:28.518 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:28.518 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:16:28.550 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph 2026-02-17T21:16:28.757 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:16:28.796 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:16:28.796 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:16:28.850 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:17 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:16:28.934 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:28.937 INFO:teuthology.orchestra.run.trial176.stdout:====================================================================================== 2026-02-17T21:16:28.937 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repository Size 2026-02-17T21:16:28.937 INFO:teuthology.orchestra.run.trial176.stdout:====================================================================================== 2026-02-17T21:16:28.937 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:16:28.937 INFO:teuthology.orchestra.run.trial176.stdout: ceph x86_64 2:19.2.3-679.gd855f53b.el9 ceph 6.5 k 2026-02-17T21:16:28.937 INFO:teuthology.orchestra.run.trial176.stdout:Installing dependencies: 2026-02-17T21:16:28.937 INFO:teuthology.orchestra.run.trial176.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T21:16:28.938 INFO:teuthology.orchestra.run.trial176.stdout: ceph-grafana-dashboards noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 31 k 2026-02-17T21:16:28.938 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mds x86_64 2:19.2.3-679.gd855f53b.el9 ceph 2.4 M 2026-02-17T21:16:28.938 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.1 M 2026-02-17T21:16:28.938 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-modules-core noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 253 k 2026-02-17T21:16:28.938 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mon x86_64 2:19.2.3-679.gd855f53b.el9 ceph 4.7 M 2026-02-17T21:16:28.938 INFO:teuthology.orchestra.run.trial176.stdout: ceph-osd x86_64 2:19.2.3-679.gd855f53b.el9 ceph 17 M 2026-02-17T21:16:28.938 INFO:teuthology.orchestra.run.trial176.stdout: ceph-prometheus-alerts noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 17 k 2026-02-17T21:16:28.938 INFO:teuthology.orchestra.run.trial176.stdout: cephadm noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 769 k 2026-02-17T21:16:28.938 INFO:teuthology.orchestra.run.trial176.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T21:16:28.938 INFO:teuthology.orchestra.run.trial176.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T21:16:28.938 INFO:teuthology.orchestra.run.trial176.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T21:16:28.938 INFO:teuthology.orchestra.run.trial176.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T21:16:28.939 INFO:teuthology.orchestra.run.trial176.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T21:16:28.939 INFO:teuthology.orchestra.run.trial176.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T21:16:28.939 INFO:teuthology.orchestra.run.trial176.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T21:16:28.939 INFO:teuthology.orchestra.run.trial176.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T21:16:28.939 INFO:teuthology.orchestra.run.trial176.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T21:16:28.939 INFO:teuthology.orchestra.run.trial176.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T21:16:28.939 INFO:teuthology.orchestra.run.trial176.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T21:16:28.939 INFO:teuthology.orchestra.run.trial176.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T21:16:28.939 INFO:teuthology.orchestra.run.trial176.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T21:16:28.939 INFO:teuthology.orchestra.run.trial176.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T21:16:28.939 INFO:teuthology.orchestra.run.trial176.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T21:16:28.939 INFO:teuthology.orchestra.run.trial176.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T21:16:28.940 INFO:teuthology.orchestra.run.trial176.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T21:16:28.940 INFO:teuthology.orchestra.run.trial176.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T21:16:28.940 INFO:teuthology.orchestra.run.trial176.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T21:16:28.940 INFO:teuthology.orchestra.run.trial176.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T21:16:28.940 INFO:teuthology.orchestra.run.trial176.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T21:16:28.940 INFO:teuthology.orchestra.run.trial176.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T21:16:28.940 INFO:teuthology.orchestra.run.trial176.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T21:16:28.940 INFO:teuthology.orchestra.run.trial176.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T21:16:28.940 INFO:teuthology.orchestra.run.trial176.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T21:16:28.940 INFO:teuthology.orchestra.run.trial176.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T21:16:28.940 INFO:teuthology.orchestra.run.trial176.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T21:16:28.940 INFO:teuthology.orchestra.run.trial176.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T21:16:28.940 INFO:teuthology.orchestra.run.trial176.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T21:16:28.941 INFO:teuthology.orchestra.run.trial176.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T21:16:28.941 INFO:teuthology.orchestra.run.trial176.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T21:16:28.941 INFO:teuthology.orchestra.run.trial176.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T21:16:28.941 INFO:teuthology.orchestra.run.trial176.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T21:16:28.941 INFO:teuthology.orchestra.run.trial176.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T21:16:28.941 INFO:teuthology.orchestra.run.trial176.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T21:16:28.941 INFO:teuthology.orchestra.run.trial176.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T21:16:28.941 INFO:teuthology.orchestra.run.trial176.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T21:16:28.941 INFO:teuthology.orchestra.run.trial176.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T21:16:28.941 INFO:teuthology.orchestra.run.trial176.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T21:16:28.941 INFO:teuthology.orchestra.run.trial176.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T21:16:28.941 INFO:teuthology.orchestra.run.trial176.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T21:16:28.941 INFO:teuthology.orchestra.run.trial176.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T21:16:28.942 INFO:teuthology.orchestra.run.trial176.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T21:16:28.942 INFO:teuthology.orchestra.run.trial176.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T21:16:28.942 INFO:teuthology.orchestra.run.trial176.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T21:16:28.942 INFO:teuthology.orchestra.run.trial176.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T21:16:28.942 INFO:teuthology.orchestra.run.trial176.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T21:16:28.942 INFO:teuthology.orchestra.run.trial176.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T21:16:28.942 INFO:teuthology.orchestra.run.trial176.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T21:16:28.942 INFO:teuthology.orchestra.run.trial176.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T21:16:28.942 INFO:teuthology.orchestra.run.trial176.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T21:16:28.942 INFO:teuthology.orchestra.run.trial176.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T21:16:28.942 INFO:teuthology.orchestra.run.trial176.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T21:16:28.942 INFO:teuthology.orchestra.run.trial176.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T21:16:28.942 INFO:teuthology.orchestra.run.trial176.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T21:16:28.943 INFO:teuthology.orchestra.run.trial176.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T21:16:28.943 INFO:teuthology.orchestra.run.trial176.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T21:16:28.943 INFO:teuthology.orchestra.run.trial176.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T21:16:28.943 INFO:teuthology.orchestra.run.trial176.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T21:16:28.943 INFO:teuthology.orchestra.run.trial176.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T21:16:28.943 INFO:teuthology.orchestra.run.trial176.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T21:16:28.943 INFO:teuthology.orchestra.run.trial176.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T21:16:28.943 INFO:teuthology.orchestra.run.trial176.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T21:16:28.943 INFO:teuthology.orchestra.run.trial176.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T21:16:28.943 INFO:teuthology.orchestra.run.trial176.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T21:16:28.943 INFO:teuthology.orchestra.run.trial176.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T21:16:28.943 INFO:teuthology.orchestra.run.trial176.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T21:16:28.943 INFO:teuthology.orchestra.run.trial176.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T21:16:28.944 INFO:teuthology.orchestra.run.trial176.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T21:16:28.944 INFO:teuthology.orchestra.run.trial176.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T21:16:28.944 INFO:teuthology.orchestra.run.trial176.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T21:16:28.944 INFO:teuthology.orchestra.run.trial176.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T21:16:28.944 INFO:teuthology.orchestra.run.trial176.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T21:16:28.944 INFO:teuthology.orchestra.run.trial176.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T21:16:28.944 INFO:teuthology.orchestra.run.trial176.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T21:16:28.944 INFO:teuthology.orchestra.run.trial176.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T21:16:28.944 INFO:teuthology.orchestra.run.trial176.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T21:16:28.944 INFO:teuthology.orchestra.run.trial176.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T21:16:28.944 INFO:teuthology.orchestra.run.trial176.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T21:16:28.944 INFO:teuthology.orchestra.run.trial176.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T21:16:28.945 INFO:teuthology.orchestra.run.trial176.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T21:16:28.945 INFO:teuthology.orchestra.run.trial176.stdout:Installing weak dependencies: 2026-02-17T21:16:28.945 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-cephadm noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 150 k 2026-02-17T21:16:28.945 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-dashboard noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 3.8 M 2026-02-17T21:16:28.945 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 7.4 M 2026-02-17T21:16:28.945 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 22 k 2026-02-17T21:16:28.945 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-rook noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 49 k 2026-02-17T21:16:28.945 INFO:teuthology.orchestra.run.trial176.stdout: ceph-volume noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 299 k 2026-02-17T21:16:28.945 INFO:teuthology.orchestra.run.trial176.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T21:16:28.945 INFO:teuthology.orchestra.run.trial176.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T21:16:28.945 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:28.945 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:16:28.945 INFO:teuthology.orchestra.run.trial176.stdout:====================================================================================== 2026-02-17T21:16:28.946 INFO:teuthology.orchestra.run.trial176.stdout:Install 99 Packages 2026-02-17T21:16:28.946 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:28.946 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 95 M 2026-02-17T21:16:28.947 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 520 M 2026-02-17T21:16:28.947 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:16:29.211 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:16:29.211 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:16:29.348 INFO:teuthology.orchestra.run.trial119.stdout:(99/99): ceph-19.2.3-679.gd855f53b.el9.x86_64.r 1.0 kB/s | 6.5 kB 00:06 2026-02-17T21:16:29.352 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:29.352 INFO:teuthology.orchestra.run.trial119.stdout:Total 14 MB/s | 95 MB 00:06 2026-02-17T21:16:29.366 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 34/37 2026-02-17T21:16:29.366 INFO:teuthology.orchestra.run.trial005.stdout:skipping the directory /sys 2026-02-17T21:16:29.366 INFO:teuthology.orchestra.run.trial005.stdout:skipping the directory /proc 2026-02-17T21:16:29.366 INFO:teuthology.orchestra.run.trial005.stdout:skipping the directory /mnt 2026-02-17T21:16:29.366 INFO:teuthology.orchestra.run.trial005.stdout:skipping the directory /var/tmp 2026-02-17T21:16:29.366 INFO:teuthology.orchestra.run.trial005.stdout:skipping the directory /home 2026-02-17T21:16:29.366 INFO:teuthology.orchestra.run.trial005.stdout:skipping the directory /root 2026-02-17T21:16:29.366 INFO:teuthology.orchestra.run.trial005.stdout:skipping the directory /tmp 2026-02-17T21:16:29.367 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:29.650 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:16:29.652 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T21:16:29.684 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T21:16:29.690 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T21:16:29.712 INFO:teuthology.orchestra.run.trial135.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T21:16:29.718 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T21:16:29.752 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T21:16:29.761 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T21:16:29.766 INFO:teuthology.orchestra.run.trial135.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T21:16:29.769 INFO:teuthology.orchestra.run.trial135.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T21:16:29.774 INFO:teuthology.orchestra.run.trial135.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T21:16:29.790 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:16:29.798 INFO:teuthology.orchestra.run.trial135.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T21:16:29.811 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T21:16:29.814 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T21:16:29.815 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 35/37 2026-02-17T21:16:29.820 INFO:teuthology.orchestra.run.trial135.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T21:16:29.822 INFO:teuthology.orchestra.run.trial135.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T21:16:29.830 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:16:29.830 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:16:29.830 INFO:teuthology.orchestra.run.trial176.stdout:(1/99): ceph-19.2.3-679.gd855f53b.el9.x86_64.rp 131 kB/s | 6.5 kB 00:00 2026-02-17T21:16:29.833 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T21:16:29.839 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 35/37 2026-02-17T21:16:29.839 INFO:teuthology.orchestra.run.trial005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:29.839 INFO:teuthology.orchestra.run.trial005.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T21:16:29.839 INFO:teuthology.orchestra.run.trial005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T21:16:29.839 INFO:teuthology.orchestra.run.trial005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T21:16:29.839 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:29.840 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T21:16:29.841 INFO:teuthology.orchestra.run.trial005.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T21:16:29.854 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T21:16:29.854 INFO:teuthology.orchestra.run.trial005.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T21:16:29.865 INFO:teuthology.orchestra.run.trial135.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T21:16:29.868 INFO:teuthology.orchestra.run.trial135.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T21:16:29.875 INFO:teuthology.orchestra.run.trial135.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T21:16:29.900 INFO:teuthology.orchestra.run.trial135.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T21:16:29.910 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T21:16:29.910 INFO:teuthology.orchestra.run.trial005.stdout:Creating group 'qat' with GID 992. 2026-02-17T21:16:29.910 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:29.922 INFO:teuthology.orchestra.run.trial176.stdout:(2/99): ceph-mgr-19.2.3-679.gd855f53b.el9.x86_6 7.6 MB/s | 1.1 MB 00:00 2026-02-17T21:16:29.950 INFO:teuthology.orchestra.run.trial176.stdout:(3/99): ceph-mds-19.2.3-679.gd855f53b.el9.x86_6 14 MB/s | 2.4 MB 00:00 2026-02-17T21:16:29.953 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T21:16:29.966 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T21:16:29.968 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T21:16:29.973 INFO:teuthology.orchestra.run.trial135.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T21:16:29.978 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T21:16:29.983 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T21:16:29.984 INFO:teuthology.orchestra.run.trial176.stdout:(4/99): ceph-grafana-dashboards-19.2.3-679.gd85 920 kB/s | 31 kB 00:00 2026-02-17T21:16:29.986 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T21:16:30.001 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T21:16:30.019 INFO:teuthology.orchestra.run.trial176.stdout:(5/99): ceph-mgr-cephadm-19.2.3-679.gd855f53b.e 4.2 MB/s | 150 kB 00:00 2026-02-17T21:16:30.022 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T21:16:30.027 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T21:16:30.032 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T21:16:30.044 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T21:16:30.050 INFO:teuthology.orchestra.run.trial176.stdout:(6/99): ceph-mon-19.2.3-679.gd855f53b.el9.x86_6 22 MB/s | 4.7 MB 00:00 2026-02-17T21:16:30.053 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T21:16:30.061 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T21:16:30.081 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T21:16:30.090 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T21:16:30.145 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T21:16:30.158 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T21:16:30.172 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 1/37 2026-02-17T21:16:30.173 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 2/37 2026-02-17T21:16:30.173 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 3/37 2026-02-17T21:16:30.173 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 4/37 2026-02-17T21:16:30.173 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 5/37 2026-02-17T21:16:30.173 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 6/37 2026-02-17T21:16:30.173 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 7/37 2026-02-17T21:16:30.173 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-ceph-argparse-2:19.2.3-679.gd855f53b.el9.x 8/37 2026-02-17T21:16:30.173 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-ceph-common-2:19.2.3-679.gd855f53b.el9.x86 9/37 2026-02-17T21:16:30.173 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 10/37 2026-02-17T21:16:30.174 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 11/37 2026-02-17T21:16:30.174 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 12/37 2026-02-17T21:16:30.174 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 13/37 2026-02-17T21:16:30.174 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T21:16:30.174 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T21:16:30.174 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T21:16:30.174 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T21:16:30.174 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T21:16:30.174 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T21:16:30.174 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T21:16:30.174 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T21:16:30.174 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T21:16:30.175 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T21:16:30.175 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T21:16:30.175 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T21:16:30.175 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T21:16:30.175 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T21:16:30.175 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T21:16:30.175 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T21:16:30.175 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T21:16:30.175 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T21:16:30.175 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T21:16:30.175 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T21:16:30.175 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : librados2-2:19.2.3-679.gd855f53b.el9.x86_64 34/37 2026-02-17T21:16:30.175 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T21:16:30.176 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 36/37 2026-02-17T21:16:30.176 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T21:16:30.178 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T21:16:30.186 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T21:16:30.192 INFO:teuthology.orchestra.run.trial176.stdout:(7/99): ceph-mgr-dashboard-19.2.3-679.gd855f53b 22 MB/s | 3.8 MB 00:00 2026-02-17T21:16:30.227 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T21:16:30.228 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T21:16:30.228 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:30.228 INFO:teuthology.orchestra.run.trial005.stdout:Upgraded: 2026-02-17T21:16:30.228 INFO:teuthology.orchestra.run.trial005.stdout: librados2-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:30.228 INFO:teuthology.orchestra.run.trial005.stdout: librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:30.229 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:16:30.229 INFO:teuthology.orchestra.run.trial005.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T21:16:30.229 INFO:teuthology.orchestra.run.trial005.stdout: ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:30.229 INFO:teuthology.orchestra.run.trial005.stdout: ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:30.229 INFO:teuthology.orchestra.run.trial005.stdout: ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:30.229 INFO:teuthology.orchestra.run.trial005.stdout: ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:30.229 INFO:teuthology.orchestra.run.trial005.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T21:16:30.229 INFO:teuthology.orchestra.run.trial005.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T21:16:30.229 INFO:teuthology.orchestra.run.trial005.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T21:16:30.229 INFO:teuthology.orchestra.run.trial005.stdout: libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:30.229 INFO:teuthology.orchestra.run.trial005.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T21:16:30.229 INFO:teuthology.orchestra.run.trial005.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T21:16:30.230 INFO:teuthology.orchestra.run.trial005.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T21:16:30.230 INFO:teuthology.orchestra.run.trial005.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T21:16:30.230 INFO:teuthology.orchestra.run.trial005.stdout: libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:30.230 INFO:teuthology.orchestra.run.trial005.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T21:16:30.230 INFO:teuthology.orchestra.run.trial005.stdout: librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:30.230 INFO:teuthology.orchestra.run.trial005.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T21:16:30.230 INFO:teuthology.orchestra.run.trial005.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T21:16:30.230 INFO:teuthology.orchestra.run.trial005.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T21:16:30.230 INFO:teuthology.orchestra.run.trial005.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T21:16:30.230 INFO:teuthology.orchestra.run.trial005.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T21:16:30.230 INFO:teuthology.orchestra.run.trial005.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T21:16:30.231 INFO:teuthology.orchestra.run.trial005.stdout: python3-ceph-argparse-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:30.231 INFO:teuthology.orchestra.run.trial005.stdout: python3-ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:30.231 INFO:teuthology.orchestra.run.trial005.stdout: python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:30.231 INFO:teuthology.orchestra.run.trial005.stdout: python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:30.231 INFO:teuthology.orchestra.run.trial005.stdout: python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:30.231 INFO:teuthology.orchestra.run.trial005.stdout: python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:30.231 INFO:teuthology.orchestra.run.trial005.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T21:16:30.231 INFO:teuthology.orchestra.run.trial005.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T21:16:30.231 INFO:teuthology.orchestra.run.trial005.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T21:16:30.231 INFO:teuthology.orchestra.run.trial005.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T21:16:30.232 INFO:teuthology.orchestra.run.trial005.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T21:16:30.232 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:30.232 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:16:30.232 INFO:teuthology.orchestra.run.trial176.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-679.gd855f53b 555 kB/s | 22 kB 00:00 2026-02-17T21:16:30.245 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:16:30.245 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:16:30.269 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install ceph-test 2026-02-17T21:16:30.278 INFO:teuthology.orchestra.run.trial176.stdout:(9/99): ceph-mgr-modules-core-19.2.3-679.gd855f 5.3 MB/s | 253 kB 00:00 2026-02-17T21:16:30.322 INFO:teuthology.orchestra.run.trial176.stdout:(10/99): ceph-mgr-rook-19.2.3-679.gd855f53b.el9 1.1 MB/s | 49 kB 00:00 2026-02-17T21:16:30.366 INFO:teuthology.orchestra.run.trial176.stdout:(11/99): ceph-mgr-diskprediction-local-19.2.3-6 23 MB/s | 7.4 MB 00:00 2026-02-17T21:16:30.367 INFO:teuthology.orchestra.run.trial176.stdout:(12/99): ceph-prometheus-alerts-19.2.3-679.gd85 375 kB/s | 17 kB 00:00 2026-02-17T21:16:30.394 INFO:teuthology.orchestra.run.trial176.stdout:(13/99): ceph-volume-19.2.3-679.gd855f53b.el9.n 11 MB/s | 299 kB 00:00 2026-02-17T21:16:30.410 INFO:teuthology.orchestra.run.trial176.stdout:(14/99): cephadm-19.2.3-679.gd855f53b.el9.noarc 18 MB/s | 769 kB 00:00 2026-02-17T21:16:30.497 INFO:teuthology.orchestra.run.trial176.stdout:(15/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 465 kB/s | 40 kB 00:00 2026-02-17T21:16:30.534 INFO:teuthology.orchestra.run.trial176.stdout:(16/99): ceph-osd-19.2.3-679.gd855f53b.el9.x86_ 28 MB/s | 17 MB 00:00 2026-02-17T21:16:30.559 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T21:16:30.564 INFO:teuthology.orchestra.run.trial176.stdout:(17/99): libconfig-1.7.2-9.el9.x86_64.rpm 1.0 MB/s | 72 kB 00:00 2026-02-17T21:16:30.567 INFO:teuthology.orchestra.run.trial176.stdout:(18/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 2.0 MB/s | 350 kB 00:00 2026-02-17T21:16:30.569 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T21:16:30.573 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T21:16:30.579 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T21:16:30.579 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:13 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:16:30.580 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T21:16:30.604 INFO:teuthology.orchestra.run.trial176.stdout:(19/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 6.8 MB/s | 253 kB 00:00 2026-02-17T21:16:30.608 INFO:teuthology.orchestra.run.trial135.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T21:16:30.635 INFO:teuthology.orchestra.run.trial176.stdout:(20/99): libquadmath-11.5.0-14.el9.x86_64.rpm 2.5 MB/s | 184 kB 00:00 2026-02-17T21:16:30.653 INFO:teuthology.orchestra.run.trial135.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T21:16:30.659 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T21:16:30.660 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:30.661 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:30.661 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repository Size 2026-02-17T21:16:30.661 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:30.661 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:16:30.661 INFO:teuthology.orchestra.run.trial005.stdout: ceph-test x86_64 2:19.2.3-679.gd855f53b.el9 ceph 50 M 2026-02-17T21:16:30.661 INFO:teuthology.orchestra.run.trial005.stdout:Installing dependencies: 2026-02-17T21:16:30.661 INFO:teuthology.orchestra.run.trial005.stdout: libcephsqlite x86_64 2:19.2.3-679.gd855f53b.el9 ceph 163 k 2026-02-17T21:16:30.661 INFO:teuthology.orchestra.run.trial005.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T21:16:30.661 INFO:teuthology.orchestra.run.trial005.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T21:16:30.662 INFO:teuthology.orchestra.run.trial005.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T21:16:30.662 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:30.662 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:16:30.662 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:30.662 INFO:teuthology.orchestra.run.trial005.stdout:Install 5 Packages 2026-02-17T21:16:30.662 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:30.662 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 50 M 2026-02-17T21:16:30.662 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 212 M 2026-02-17T21:16:30.662 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:16:30.663 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T21:16:30.669 INFO:teuthology.orchestra.run.trial176.stdout:(21/99): python3-ply-3.11-14.el9.noarch.rpm 3.1 MB/s | 106 kB 00:00 2026-02-17T21:16:30.669 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T21:16:30.672 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T21:16:30.679 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T21:16:30.682 INFO:teuthology.orchestra.run.trial176.stdout:(22/99): python3-cryptography-36.0.1-5.el9.x86_ 16 MB/s | 1.2 MB 00:00 2026-02-17T21:16:30.683 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T21:16:30.687 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:16:30.689 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T21:16:30.704 INFO:teuthology.orchestra.run.trial176.stdout:(23/99): python3-pycparser-2.20-6.el9.noarch.rp 3.7 MB/s | 135 kB 00:00 2026-02-17T21:16:30.710 INFO:teuthology.orchestra.run.trial176.stdout:(24/99): python3-pyparsing-2.4.7-9.el9.noarch.r 5.3 MB/s | 150 kB 00:00 2026-02-17T21:16:30.711 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T21:16:30.720 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T21:16:30.721 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T21:16:30.725 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T21:16:30.730 INFO:teuthology.orchestra.run.trial176.stdout:(25/99): libgfortran-11.5.0-14.el9.x86_64.rpm 4.0 MB/s | 794 kB 00:00 2026-02-17T21:16:30.740 INFO:teuthology.orchestra.run.trial176.stdout:(26/99): python3-requests-2.25.1-10.el9.noarch. 3.4 MB/s | 126 kB 00:00 2026-02-17T21:16:30.741 INFO:teuthology.orchestra.run.trial176.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 6.9 MB/s | 218 kB 00:00 2026-02-17T21:16:30.746 INFO:teuthology.orchestra.run.trial119.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T21:16:30.752 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T21:16:30.757 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T21:16:30.758 INFO:teuthology.orchestra.run.trial176.stdout:(28/99): unzip-6.0-59.el9.x86_64.rpm 6.3 MB/s | 182 kB 00:00 2026-02-17T21:16:30.769 INFO:teuthology.orchestra.run.trial176.stdout:(29/99): zip-3.0-35.el9.x86_64.rpm 9.4 MB/s | 266 kB 00:00 2026-02-17T21:16:30.785 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T21:16:30.795 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T21:16:30.800 INFO:teuthology.orchestra.run.trial119.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T21:16:30.802 INFO:teuthology.orchestra.run.trial119.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T21:16:30.807 INFO:teuthology.orchestra.run.trial119.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T21:16:30.809 INFO:teuthology.orchestra.run.trial005.stdout:(1/5): libcephsqlite-19.2.3-679.gd855f53b.el9.x 1.9 MB/s | 163 kB 00:00 2026-02-17T21:16:30.830 INFO:teuthology.orchestra.run.trial119.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T21:16:30.843 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T21:16:30.846 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T21:16:30.852 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T21:16:30.854 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T21:16:30.865 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T21:16:30.871 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T21:16:30.876 INFO:teuthology.orchestra.run.trial005.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 1.5 MB/s | 233 kB 00:00 2026-02-17T21:16:30.896 INFO:teuthology.orchestra.run.trial119.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T21:16:30.899 INFO:teuthology.orchestra.run.trial119.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T21:16:30.905 INFO:teuthology.orchestra.run.trial005.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.2 MB/s | 64 kB 00:00 2026-02-17T21:16:30.906 INFO:teuthology.orchestra.run.trial119.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T21:16:30.930 INFO:teuthology.orchestra.run.trial119.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T21:16:30.970 INFO:teuthology.orchestra.run.trial005.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 1.8 MB/s | 303 kB 00:00 2026-02-17T21:16:30.982 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T21:16:30.986 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T21:16:30.994 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T21:16:30.998 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T21:16:30.999 INFO:teuthology.orchestra.run.trial176.stdout:(30/99): flexiblas-3.0.4-9.el9.x86_64.rpm 115 kB/s | 30 kB 00:00 2026-02-17T21:16:31.003 INFO:teuthology.orchestra.run.trial176.stdout:(31/99): flexiblas-openblas-openmp-3.0.4-9.el9. 63 kB/s | 15 kB 00:00 2026-02-17T21:16:31.005 INFO:teuthology.orchestra.run.trial119.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T21:16:31.010 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T21:16:31.010 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T21:16:31.014 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T21:16:31.015 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T21:16:31.018 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T21:16:31.032 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T21:16:31.053 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T21:16:31.058 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T21:16:31.063 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T21:16:31.072 INFO:teuthology.orchestra.run.trial135.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T21:16:31.074 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T21:16:31.074 INFO:teuthology.orchestra.run.trial135.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T21:16:31.083 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T21:16:31.089 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T21:16:31.095 INFO:teuthology.orchestra.run.trial135.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T21:16:31.109 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T21:16:31.118 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T21:16:31.172 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T21:16:31.184 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T21:16:31.200 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T21:16:31.204 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T21:16:31.212 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T21:16:31.252 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T21:16:31.321 INFO:teuthology.orchestra.run.trial176.stdout:(32/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 767 kB/s | 246 kB 00:00 2026-02-17T21:16:31.329 INFO:teuthology.orchestra.run.trial176.stdout:(33/99): lua-5.4.4-4.el9.x86_64.rpm 578 kB/s | 188 kB 00:00 2026-02-17T21:16:31.407 INFO:teuthology.orchestra.run.trial176.stdout:(34/99): openblas-0.3.29-1.el9.x86_64.rpm 491 kB/s | 42 kB 00:00 2026-02-17T21:16:31.428 INFO:teuthology.orchestra.run.trial135.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T21:16:31.503 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T21:16:31.543 INFO:teuthology.orchestra.run.trial176.stdout:(35/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 3.8 MB/s | 3.0 MB 00:00 2026-02-17T21:16:31.576 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T21:16:31.586 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T21:16:31.590 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T21:16:31.596 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T21:16:31.597 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T21:16:31.625 INFO:teuthology.orchestra.run.trial119.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T21:16:31.665 INFO:teuthology.orchestra.run.trial176.stdout:(36/99): protobuf-3.14.0-17.el9.x86_64.rpm 3.9 MB/s | 1.0 MB 00:00 2026-02-17T21:16:31.668 INFO:teuthology.orchestra.run.trial119.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T21:16:31.675 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T21:16:31.678 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T21:16:31.684 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T21:16:31.688 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T21:16:31.695 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T21:16:31.698 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T21:16:31.726 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T21:16:31.735 INFO:teuthology.orchestra.run.trial005.stdout:(5/5): ceph-test-19.2.3-679.gd855f53b.el9.x86_6 49 MB/s | 50 MB 00:01 2026-02-17T21:16:31.735 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T21:16:31.736 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:31.737 INFO:teuthology.orchestra.run.trial005.stdout:Total 47 MB/s | 50 MB 00:01 2026-02-17T21:16:31.755 INFO:teuthology.orchestra.run.trial176.stdout:(37/99): python3-devel-3.9.25-2.el9.x86_64.rpm 2.7 MB/s | 244 kB 00:00 2026-02-17T21:16:31.763 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:16:31.765 INFO:teuthology.orchestra.run.trial176.stdout:(38/99): python3-babel-2.9.1-2.el9.noarch.rpm 27 MB/s | 6.0 MB 00:00 2026-02-17T21:16:31.770 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T21:16:31.772 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:16:31.772 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:16:31.810 INFO:teuthology.orchestra.run.trial176.stdout:(39/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 11 MB/s | 5.3 MB 00:00 2026-02-17T21:16:31.845 INFO:teuthology.orchestra.run.trial176.stdout:(40/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 2.7 MB/s | 249 kB 00:00 2026-02-17T21:16:31.846 INFO:teuthology.orchestra.run.trial176.stdout:(41/99): python3-libstoragemgmt-1.10.1-1.el9.x8 2.1 MB/s | 177 kB 00:00 2026-02-17T21:16:31.902 INFO:teuthology.orchestra.run.trial176.stdout:(42/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 13 MB/s | 1.2 MB 00:00 2026-02-17T21:16:31.926 INFO:teuthology.orchestra.run.trial176.stdout:(43/99): python3-markupsafe-1.1.1-12.el9.x86_64 437 kB/s | 35 kB 00:00 2026-02-17T21:16:31.931 INFO:teuthology.orchestra.run.trial176.stdout:(44/99): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 172 kB 00:00 2026-02-17T21:16:31.956 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:16:31.956 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:16:31.994 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T21:16:32.009 INFO:teuthology.orchestra.run.trial176.stdout:(45/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 5.2 MB/s | 442 kB 00:00 2026-02-17T21:16:32.013 INFO:teuthology.orchestra.run.trial176.stdout:(46/99): python3-packaging-20.9-5.el9.noarch.rp 945 kB/s | 77 kB 00:00 2026-02-17T21:16:32.018 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T21:16:32.021 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T21:16:32.080 INFO:teuthology.orchestra.run.trial119.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T21:16:32.082 INFO:teuthology.orchestra.run.trial119.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T21:16:32.090 INFO:teuthology.orchestra.run.trial176.stdout:(47/99): python3-protobuf-3.14.0-17.el9.noarch. 3.2 MB/s | 267 kB 00:00 2026-02-17T21:16:32.099 INFO:teuthology.orchestra.run.trial176.stdout:(48/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 31 MB/s | 6.1 MB 00:00 2026-02-17T21:16:32.100 INFO:teuthology.orchestra.run.trial176.stdout:(49/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.8 MB/s | 159 kB 00:00 2026-02-17T21:16:32.104 INFO:teuthology.orchestra.run.trial119.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T21:16:32.168 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:16:32.172 INFO:teuthology.orchestra.run.trial176.stdout:(50/99): python3-pyasn1-modules-0.4.8-6.el9.noa 3.3 MB/s | 279 kB 00:00 2026-02-17T21:16:32.174 INFO:teuthology.orchestra.run.trial005.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T21:16:32.178 INFO:teuthology.orchestra.run.trial005.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T21:16:32.179 INFO:teuthology.orchestra.run.trial176.stdout:(51/99): python3-requests-oauthlib-1.3.0-12.el9 672 kB/s | 54 kB 00:00 2026-02-17T21:16:32.186 INFO:teuthology.orchestra.run.trial005.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T21:16:32.187 INFO:teuthology.orchestra.run.trial005.stdout: Installing : libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 4/5 2026-02-17T21:16:32.190 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T21:16:32.207 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T21:16:32.217 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T21:16:32.224 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T21:16:32.238 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T21:16:32.252 INFO:teuthology.orchestra.run.trial176.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 523 kB/s | 42 kB 00:00 2026-02-17T21:16:32.254 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T21:16:32.259 INFO:teuthology.orchestra.run.trial176.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 2.3 MB/s | 189 kB 00:00 2026-02-17T21:16:32.275 INFO:teuthology.orchestra.run.trial176.stdout:(54/99): lua-devel-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 22 kB 00:00 2026-02-17T21:16:32.295 INFO:teuthology.orchestra.run.trial176.stdout:(55/99): protobuf-compiler-3.14.0-17.el9.x86_64 43 MB/s | 862 kB 00:00 2026-02-17T21:16:32.330 INFO:teuthology.orchestra.run.trial176.stdout:(56/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 15 MB/s | 551 kB 00:00 2026-02-17T21:16:32.331 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T21:16:32.332 INFO:teuthology.orchestra.run.trial176.stdout:(57/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 1.1 MB/s | 90 kB 00:00 2026-02-17T21:16:32.333 INFO:teuthology.orchestra.run.trial176.stdout:(58/99): grpc-data-1.46.7-10.el9.noarch.rpm 5.8 MB/s | 19 kB 00:00 2026-02-17T21:16:32.335 INFO:teuthology.orchestra.run.trial176.stdout:(59/99): luarocks-3.9.2-5.el9.noarch.rpm 40 MB/s | 151 kB 00:00 2026-02-17T21:16:32.340 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T21:16:32.341 INFO:teuthology.orchestra.run.trial176.stdout:(60/99): python3-asyncssh-2.13.2-5.el9.noarch.r 76 MB/s | 548 kB 00:00 2026-02-17T21:16:32.341 INFO:teuthology.orchestra.run.trial176.stdout:(61/99): python3-autocommand-2.2.2-8.el9.noarch 5.8 MB/s | 29 kB 00:00 2026-02-17T21:16:32.344 INFO:teuthology.orchestra.run.trial176.stdout:(62/99): python3-backports-tarfile-1.2.0-1.el9. 16 MB/s | 60 kB 00:00 2026-02-17T21:16:32.345 INFO:teuthology.orchestra.run.trial176.stdout:(63/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 11 MB/s | 43 kB 00:00 2026-02-17T21:16:32.348 INFO:teuthology.orchestra.run.trial176.stdout:(64/99): python3-cachetools-4.2.4-1.el9.noarch. 9.2 MB/s | 32 kB 00:00 2026-02-17T21:16:32.348 INFO:teuthology.orchestra.run.trial176.stdout:(65/99): python3-certifi-2023.05.07-4.el9.noarc 3.8 MB/s | 14 kB 00:00 2026-02-17T21:16:32.352 INFO:teuthology.orchestra.run.trial176.stdout:(66/99): python3-cheroot-10.0.1-4.el9.noarch.rp 45 MB/s | 173 kB 00:00 2026-02-17T21:16:32.353 INFO:teuthology.orchestra.run.trial176.stdout:(67/99): python3-cherrypy-18.6.1-2.el9.noarch.r 73 MB/s | 358 kB 00:00 2026-02-17T21:16:32.357 INFO:teuthology.orchestra.run.trial176.stdout:(68/99): python3-google-auth-2.45.0-1.el9.noarc 61 MB/s | 254 kB 00:00 2026-02-17T21:16:32.364 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T21:16:32.368 INFO:teuthology.orchestra.run.trial176.stdout:(69/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 136 MB/s | 2.0 MB 00:00 2026-02-17T21:16:32.369 INFO:teuthology.orchestra.run.trial176.stdout:(70/99): python3-grpcio-tools-1.46.7-10.el9.x86 12 MB/s | 144 kB 00:00 2026-02-17T21:16:32.372 INFO:teuthology.orchestra.run.trial176.stdout:(71/99): python3-influxdb-5.3.1-1.el9.noarch.rp 37 MB/s | 139 kB 00:00 2026-02-17T21:16:32.373 INFO:teuthology.orchestra.run.trial176.stdout:(72/99): python3-isodate-0.6.1-3.el9.noarch.rpm 15 MB/s | 56 kB 00:00 2026-02-17T21:16:32.376 INFO:teuthology.orchestra.run.trial176.stdout:(73/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 3.1 MB/s | 11 kB 00:00 2026-02-17T21:16:32.376 INFO:teuthology.orchestra.run.trial176.stdout:(74/99): python3-jaraco-classes-3.2.1-5.el9.noa 5.1 MB/s | 18 kB 00:00 2026-02-17T21:16:32.379 INFO:teuthology.orchestra.run.trial176.stdout:(75/99): python3-jaraco-collections-3.0.0-8.el9 6.8 MB/s | 23 kB 00:00 2026-02-17T21:16:32.380 INFO:teuthology.orchestra.run.trial176.stdout:(76/99): python3-jaraco-context-6.0.1-3.el9.noa 5.7 MB/s | 20 kB 00:00 2026-02-17T21:16:32.383 INFO:teuthology.orchestra.run.trial176.stdout:(77/99): python3-jaraco-functools-3.5.0-2.el9.n 5.5 MB/s | 19 kB 00:00 2026-02-17T21:16:32.384 INFO:teuthology.orchestra.run.trial176.stdout:(78/99): python3-jaraco-text-4.0.0-2.el9.noarch 7.4 MB/s | 26 kB 00:00 2026-02-17T21:16:32.391 INFO:teuthology.orchestra.run.trial176.stdout:(79/99): python3-kubernetes-26.1.0-3.el9.noarch 127 MB/s | 1.0 MB 00:00 2026-02-17T21:16:32.391 INFO:teuthology.orchestra.run.trial176.stdout:(80/99): python3-logutils-0.3.5-21.el9.noarch.r 5.7 MB/s | 46 kB 00:00 2026-02-17T21:16:32.394 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T21:16:32.395 INFO:teuthology.orchestra.run.trial176.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 21 MB/s | 79 kB 00:00 2026-02-17T21:16:32.396 INFO:teuthology.orchestra.run.trial176.stdout:(82/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 20 MB/s | 86 kB 00:00 2026-02-17T21:16:32.399 INFO:teuthology.orchestra.run.trial176.stdout:(83/99): python3-natsort-7.1.1-5.el9.noarch.rpm 16 MB/s | 58 kB 00:00 2026-02-17T21:16:32.400 INFO:teuthology.orchestra.run.trial176.stdout:(84/99): python3-pecan-1.4.2-3.el9.noarch.rpm 67 MB/s | 272 kB 00:00 2026-02-17T21:16:32.402 INFO:teuthology.orchestra.run.trial176.stdout:(85/99): python3-portend-3.1.0-2.el9.noarch.rpm 4.7 MB/s | 16 kB 00:00 2026-02-17T21:16:32.403 INFO:teuthology.orchestra.run.trial176.stdout:(86/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 25 MB/s | 90 kB 00:00 2026-02-17T21:16:32.406 INFO:teuthology.orchestra.run.trial176.stdout:(87/99): python3-repoze-lru-0.7-16.el9.noarch.r 8.8 MB/s | 31 kB 00:00 2026-02-17T21:16:32.407 INFO:teuthology.orchestra.run.trial176.stdout:(88/99): python3-routes-2.5.1-5.el9.noarch.rpm 51 MB/s | 188 kB 00:00 2026-02-17T21:16:32.409 INFO:teuthology.orchestra.run.trial176.stdout:(89/99): python3-rsa-4.9-2.el9.noarch.rpm 17 MB/s | 59 kB 00:00 2026-02-17T21:16:32.411 INFO:teuthology.orchestra.run.trial176.stdout:(90/99): python3-saml-1.16.0-1.el9.noarch.rpm 34 MB/s | 125 kB 00:00 2026-02-17T21:16:32.413 INFO:teuthology.orchestra.run.trial176.stdout:(91/99): python3-tempora-5.0.0-2.el9.noarch.rpm 10 MB/s | 36 kB 00:00 2026-02-17T21:16:32.414 INFO:teuthology.orchestra.run.trial176.stdout:(92/99): python3-typing-extensions-4.15.0-1.el9 25 MB/s | 86 kB 00:00 2026-02-17T21:16:32.417 INFO:teuthology.orchestra.run.trial176.stdout:(93/99): python3-webob-1.8.8-2.el9.noarch.rpm 58 MB/s | 230 kB 00:00 2026-02-17T21:16:32.418 INFO:teuthology.orchestra.run.trial176.stdout:(94/99): python3-websocket-client-1.2.3-2.el9.n 25 MB/s | 90 kB 00:00 2026-02-17T21:16:32.421 INFO:teuthology.orchestra.run.trial176.stdout:(95/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 99 MB/s | 427 kB 00:00 2026-02-17T21:16:32.423 INFO:teuthology.orchestra.run.trial176.stdout:(96/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 10 MB/s | 48 kB 00:00 2026-02-17T21:16:32.425 INFO:teuthology.orchestra.run.trial176.stdout:(97/99): python3-xmltodict-0.12.0-15.el9.noarch 6.5 MB/s | 22 kB 00:00 2026-02-17T21:16:32.427 INFO:teuthology.orchestra.run.trial176.stdout:(98/99): python3-zc-lockfile-2.0-10.el9.noarch. 5.1 MB/s | 20 kB 00:00 2026-02-17T21:16:32.429 INFO:teuthology.orchestra.run.trial119.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T21:16:32.446 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T21:16:32.452 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T21:16:32.456 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T21:16:32.457 INFO:teuthology.orchestra.run.trial135.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T21:16:32.475 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T21:16:32.475 INFO:teuthology.orchestra.run.trial135.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T21:16:32.475 INFO:teuthology.orchestra.run.trial135.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T21:16:32.475 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:32.482 INFO:teuthology.orchestra.run.trial135.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T21:16:32.503 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T21:16:32.507 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T21:16:32.508 INFO:teuthology.orchestra.run.trial135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T21:16:32.508 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:32.543 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T21:16:32.609 INFO:teuthology.orchestra.run.trial135.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T21:16:32.611 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 85/99 2026-02-17T21:16:32.624 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 85/99 2026-02-17T21:16:32.624 INFO:teuthology.orchestra.run.trial135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:32.624 INFO:teuthology.orchestra.run.trial135.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T21:16:32.625 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:32.837 INFO:teuthology.orchestra.run.trial176.stdout:(99/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 26 MB/s | 19 MB 00:00 2026-02-17T21:16:32.839 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:32.839 INFO:teuthology.orchestra.run.trial176.stdout:Total 24 MB/s | 95 MB 00:03 2026-02-17T21:16:33.174 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T21:16:33.191 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T21:16:33.201 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T21:16:33.208 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T21:16:33.221 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T21:16:33.237 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T21:16:33.253 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:16:33.290 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:16:33.291 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:16:33.312 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T21:16:33.321 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T21:16:33.338 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 86/99 2026-02-17T21:16:33.344 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T21:16:33.363 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 86/99 2026-02-17T21:16:33.363 INFO:teuthology.orchestra.run.trial135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:33.363 INFO:teuthology.orchestra.run.trial135.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T21:16:33.363 INFO:teuthology.orchestra.run.trial135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T21:16:33.363 INFO:teuthology.orchestra.run.trial135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T21:16:33.363 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:33.374 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T21:16:33.424 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: cephadm-2:19.2.3-679.gd855f53b.el9.noarch 87/99 2026-02-17T21:16:33.424 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T21:16:33.426 INFO:teuthology.orchestra.run.trial135.stdout: Installing : cephadm-2:19.2.3-679.gd855f53b.el9.noarch 87/99 2026-02-17T21:16:33.430 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T21:16:33.431 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-679.gd855f53b.el9. 88/99 2026-02-17T21:16:33.434 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T21:16:33.435 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T21:16:33.451 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-679.gd855f53b.el9 89/99 2026-02-17T21:16:33.452 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 90/99 2026-02-17T21:16:33.453 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T21:16:33.453 INFO:teuthology.orchestra.run.trial119.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T21:16:33.453 INFO:teuthology.orchestra.run.trial119.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T21:16:33.453 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:33.460 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T21:16:33.485 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T21:16:33.486 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T21:16:33.486 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:33.522 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T21:16:33.586 INFO:teuthology.orchestra.run.trial119.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T21:16:33.589 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 85/99 2026-02-17T21:16:33.602 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 85/99 2026-02-17T21:16:33.603 INFO:teuthology.orchestra.run.trial119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:33.603 INFO:teuthology.orchestra.run.trial119.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T21:16:33.603 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:33.705 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:16:33.705 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:16:33.953 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 90/99 2026-02-17T21:16:33.956 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noar 91/99 2026-02-17T21:16:34.145 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:16:34.146 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T21:16:34.177 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T21:16:34.184 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T21:16:34.205 INFO:teuthology.orchestra.run.trial176.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T21:16:34.211 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T21:16:34.244 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T21:16:34.253 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T21:16:34.258 INFO:teuthology.orchestra.run.trial176.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T21:16:34.261 INFO:teuthology.orchestra.run.trial176.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T21:16:34.265 INFO:teuthology.orchestra.run.trial176.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T21:16:34.288 INFO:teuthology.orchestra.run.trial176.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T21:16:34.301 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T21:16:34.304 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T21:16:34.310 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T21:16:34.311 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 86/99 2026-02-17T21:16:34.312 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T21:16:34.323 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T21:16:34.330 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T21:16:34.335 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 86/99 2026-02-17T21:16:34.335 INFO:teuthology.orchestra.run.trial119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:34.336 INFO:teuthology.orchestra.run.trial119.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T21:16:34.336 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T21:16:34.336 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T21:16:34.336 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:34.354 INFO:teuthology.orchestra.run.trial176.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T21:16:34.357 INFO:teuthology.orchestra.run.trial176.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T21:16:34.364 INFO:teuthology.orchestra.run.trial176.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T21:16:34.389 INFO:teuthology.orchestra.run.trial176.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T21:16:34.393 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: cephadm-2:19.2.3-679.gd855f53b.el9.noarch 87/99 2026-02-17T21:16:34.395 INFO:teuthology.orchestra.run.trial119.stdout: Installing : cephadm-2:19.2.3-679.gd855f53b.el9.noarch 87/99 2026-02-17T21:16:34.400 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-679.gd855f53b.el9. 88/99 2026-02-17T21:16:34.415 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noar 91/99 2026-02-17T21:16:34.416 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f5 92/99 2026-02-17T21:16:34.420 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-679.gd855f53b.el9 89/99 2026-02-17T21:16:34.421 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 90/99 2026-02-17T21:16:34.429 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f5 92/99 2026-02-17T21:16:34.430 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noar 93/99 2026-02-17T21:16:34.439 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T21:16:34.452 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T21:16:34.455 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T21:16:34.459 INFO:teuthology.orchestra.run.trial176.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T21:16:34.465 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T21:16:34.469 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T21:16:34.473 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T21:16:34.486 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noar 93/99 2026-02-17T21:16:34.487 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T21:16:34.508 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T21:16:34.512 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T21:16:34.517 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T21:16:34.528 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T21:16:34.536 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-679.gd855f53b.el9.n 94/99 2026-02-17T21:16:34.536 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 4/5 2026-02-17T21:16:34.537 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 95/99 2026-02-17T21:16:34.537 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T21:16:34.544 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T21:16:34.554 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 5/5 2026-02-17T21:16:34.558 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 95/99 2026-02-17T21:16:34.558 INFO:teuthology.orchestra.run.trial135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:34.558 INFO:teuthology.orchestra.run.trial135.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T21:16:34.558 INFO:teuthology.orchestra.run.trial135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T21:16:34.559 INFO:teuthology.orchestra.run.trial135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T21:16:34.559 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:34.563 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T21:16:34.570 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 96/99 2026-02-17T21:16:34.572 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T21:16:34.626 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T21:16:34.638 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T21:16:34.654 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T21:16:34.658 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T21:16:34.666 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T21:16:34.706 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T21:16:34.793 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 96/99 2026-02-17T21:16:34.794 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 5/5 2026-02-17T21:16:34.794 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 1/5 2026-02-17T21:16:34.795 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 2/5 2026-02-17T21:16:34.795 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T21:16:34.795 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T21:16:34.795 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 97/99 2026-02-17T21:16:34.815 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 97/99 2026-02-17T21:16:34.816 INFO:teuthology.orchestra.run.trial135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:34.816 INFO:teuthology.orchestra.run.trial135.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T21:16:34.816 INFO:teuthology.orchestra.run.trial135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T21:16:34.816 INFO:teuthology.orchestra.run.trial135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T21:16:34.816 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:34.847 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T21:16:34.848 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:34.848 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:16:34.848 INFO:teuthology.orchestra.run.trial005.stdout: ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:34.848 INFO:teuthology.orchestra.run.trial005.stdout: libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:34.848 INFO:teuthology.orchestra.run.trial005.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T21:16:34.848 INFO:teuthology.orchestra.run.trial005.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T21:16:34.848 INFO:teuthology.orchestra.run.trial005.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T21:16:34.848 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:34.848 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:16:34.881 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install ceph 2026-02-17T21:16:34.914 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 90/99 2026-02-17T21:16:34.917 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noar 91/99 2026-02-17T21:16:34.919 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 98/99 2026-02-17T21:16:34.939 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 98/99 2026-02-17T21:16:34.940 INFO:teuthology.orchestra.run.trial135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:34.940 INFO:teuthology.orchestra.run.trial135.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T21:16:34.940 INFO:teuthology.orchestra.run.trial135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T21:16:34.940 INFO:teuthology.orchestra.run.trial135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T21:16:34.940 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:34.958 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-2:19.2.3-679.gd855f53b.el9.x86_64 99/99 2026-02-17T21:16:35.028 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T21:16:35.038 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T21:16:35.042 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T21:16:35.048 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T21:16:35.050 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T21:16:35.077 INFO:teuthology.orchestra.run.trial176.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T21:16:35.120 INFO:teuthology.orchestra.run.trial176.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T21:16:35.127 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T21:16:35.130 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T21:16:35.136 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T21:16:35.140 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T21:16:35.147 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T21:16:35.150 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T21:16:35.178 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T21:16:35.184 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:18 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:16:35.187 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T21:16:35.222 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T21:16:35.269 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:35.272 INFO:teuthology.orchestra.run.trial005.stdout:====================================================================================== 2026-02-17T21:16:35.272 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repository Size 2026-02-17T21:16:35.272 INFO:teuthology.orchestra.run.trial005.stdout:====================================================================================== 2026-02-17T21:16:35.272 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:16:35.272 INFO:teuthology.orchestra.run.trial005.stdout: ceph x86_64 2:19.2.3-679.gd855f53b.el9 ceph 6.5 k 2026-02-17T21:16:35.272 INFO:teuthology.orchestra.run.trial005.stdout:Installing dependencies: 2026-02-17T21:16:35.272 INFO:teuthology.orchestra.run.trial005.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T21:16:35.272 INFO:teuthology.orchestra.run.trial005.stdout: ceph-grafana-dashboards noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 31 k 2026-02-17T21:16:35.273 INFO:teuthology.orchestra.run.trial005.stdout: ceph-mds x86_64 2:19.2.3-679.gd855f53b.el9 ceph 2.4 M 2026-02-17T21:16:35.273 INFO:teuthology.orchestra.run.trial005.stdout: ceph-mgr x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.1 M 2026-02-17T21:16:35.273 INFO:teuthology.orchestra.run.trial005.stdout: ceph-mgr-modules-core noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 253 k 2026-02-17T21:16:35.273 INFO:teuthology.orchestra.run.trial005.stdout: ceph-mon x86_64 2:19.2.3-679.gd855f53b.el9 ceph 4.7 M 2026-02-17T21:16:35.273 INFO:teuthology.orchestra.run.trial005.stdout: ceph-osd x86_64 2:19.2.3-679.gd855f53b.el9 ceph 17 M 2026-02-17T21:16:35.273 INFO:teuthology.orchestra.run.trial005.stdout: ceph-prometheus-alerts noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 17 k 2026-02-17T21:16:35.273 INFO:teuthology.orchestra.run.trial005.stdout: cephadm noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 769 k 2026-02-17T21:16:35.273 INFO:teuthology.orchestra.run.trial005.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T21:16:35.273 INFO:teuthology.orchestra.run.trial005.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T21:16:35.273 INFO:teuthology.orchestra.run.trial005.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T21:16:35.273 INFO:teuthology.orchestra.run.trial005.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T21:16:35.273 INFO:teuthology.orchestra.run.trial005.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T21:16:35.273 INFO:teuthology.orchestra.run.trial005.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T21:16:35.273 INFO:teuthology.orchestra.run.trial005.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T21:16:35.273 INFO:teuthology.orchestra.run.trial005.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T21:16:35.274 INFO:teuthology.orchestra.run.trial005.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T21:16:35.274 INFO:teuthology.orchestra.run.trial005.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T21:16:35.274 INFO:teuthology.orchestra.run.trial005.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T21:16:35.274 INFO:teuthology.orchestra.run.trial005.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T21:16:35.274 INFO:teuthology.orchestra.run.trial005.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T21:16:35.274 INFO:teuthology.orchestra.run.trial005.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T21:16:35.274 INFO:teuthology.orchestra.run.trial005.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T21:16:35.274 INFO:teuthology.orchestra.run.trial005.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T21:16:35.274 INFO:teuthology.orchestra.run.trial005.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T21:16:35.274 INFO:teuthology.orchestra.run.trial005.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T21:16:35.274 INFO:teuthology.orchestra.run.trial005.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T21:16:35.274 INFO:teuthology.orchestra.run.trial005.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T21:16:35.274 INFO:teuthology.orchestra.run.trial005.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T21:16:35.274 INFO:teuthology.orchestra.run.trial005.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T21:16:35.274 INFO:teuthology.orchestra.run.trial005.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T21:16:35.274 INFO:teuthology.orchestra.run.trial005.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T21:16:35.275 INFO:teuthology.orchestra.run.trial005.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T21:16:35.275 INFO:teuthology.orchestra.run.trial005.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T21:16:35.275 INFO:teuthology.orchestra.run.trial005.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T21:16:35.275 INFO:teuthology.orchestra.run.trial005.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T21:16:35.275 INFO:teuthology.orchestra.run.trial005.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T21:16:35.275 INFO:teuthology.orchestra.run.trial005.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T21:16:35.275 INFO:teuthology.orchestra.run.trial005.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T21:16:35.275 INFO:teuthology.orchestra.run.trial005.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T21:16:35.275 INFO:teuthology.orchestra.run.trial005.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T21:16:35.275 INFO:teuthology.orchestra.run.trial005.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T21:16:35.275 INFO:teuthology.orchestra.run.trial005.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T21:16:35.275 INFO:teuthology.orchestra.run.trial005.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T21:16:35.275 INFO:teuthology.orchestra.run.trial005.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T21:16:35.275 INFO:teuthology.orchestra.run.trial005.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T21:16:35.275 INFO:teuthology.orchestra.run.trial005.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T21:16:35.275 INFO:teuthology.orchestra.run.trial005.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T21:16:35.275 INFO:teuthology.orchestra.run.trial005.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T21:16:35.276 INFO:teuthology.orchestra.run.trial005.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T21:16:35.276 INFO:teuthology.orchestra.run.trial005.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T21:16:35.276 INFO:teuthology.orchestra.run.trial005.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T21:16:35.276 INFO:teuthology.orchestra.run.trial005.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T21:16:35.276 INFO:teuthology.orchestra.run.trial005.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T21:16:35.276 INFO:teuthology.orchestra.run.trial005.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T21:16:35.276 INFO:teuthology.orchestra.run.trial005.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T21:16:35.276 INFO:teuthology.orchestra.run.trial005.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T21:16:35.276 INFO:teuthology.orchestra.run.trial005.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T21:16:35.276 INFO:teuthology.orchestra.run.trial005.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T21:16:35.276 INFO:teuthology.orchestra.run.trial005.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T21:16:35.276 INFO:teuthology.orchestra.run.trial005.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T21:16:35.276 INFO:teuthology.orchestra.run.trial005.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T21:16:35.276 INFO:teuthology.orchestra.run.trial005.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T21:16:35.276 INFO:teuthology.orchestra.run.trial005.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T21:16:35.276 INFO:teuthology.orchestra.run.trial005.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T21:16:35.276 INFO:teuthology.orchestra.run.trial005.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T21:16:35.276 INFO:teuthology.orchestra.run.trial005.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T21:16:35.276 INFO:teuthology.orchestra.run.trial005.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T21:16:35.276 INFO:teuthology.orchestra.run.trial005.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T21:16:35.276 INFO:teuthology.orchestra.run.trial005.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T21:16:35.277 INFO:teuthology.orchestra.run.trial005.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T21:16:35.277 INFO:teuthology.orchestra.run.trial005.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T21:16:35.277 INFO:teuthology.orchestra.run.trial005.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T21:16:35.277 INFO:teuthology.orchestra.run.trial005.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T21:16:35.277 INFO:teuthology.orchestra.run.trial005.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T21:16:35.277 INFO:teuthology.orchestra.run.trial005.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T21:16:35.277 INFO:teuthology.orchestra.run.trial005.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T21:16:35.277 INFO:teuthology.orchestra.run.trial005.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T21:16:35.277 INFO:teuthology.orchestra.run.trial005.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T21:16:35.277 INFO:teuthology.orchestra.run.trial005.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T21:16:35.277 INFO:teuthology.orchestra.run.trial005.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T21:16:35.277 INFO:teuthology.orchestra.run.trial005.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T21:16:35.277 INFO:teuthology.orchestra.run.trial005.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T21:16:35.277 INFO:teuthology.orchestra.run.trial005.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T21:16:35.277 INFO:teuthology.orchestra.run.trial005.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T21:16:35.277 INFO:teuthology.orchestra.run.trial005.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T21:16:35.277 INFO:teuthology.orchestra.run.trial005.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T21:16:35.277 INFO:teuthology.orchestra.run.trial005.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T21:16:35.277 INFO:teuthology.orchestra.run.trial005.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T21:16:35.277 INFO:teuthology.orchestra.run.trial005.stdout:Installing weak dependencies: 2026-02-17T21:16:35.277 INFO:teuthology.orchestra.run.trial005.stdout: ceph-mgr-cephadm noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 150 k 2026-02-17T21:16:35.277 INFO:teuthology.orchestra.run.trial005.stdout: ceph-mgr-dashboard noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 3.8 M 2026-02-17T21:16:35.278 INFO:teuthology.orchestra.run.trial005.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 7.4 M 2026-02-17T21:16:35.278 INFO:teuthology.orchestra.run.trial005.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 22 k 2026-02-17T21:16:35.278 INFO:teuthology.orchestra.run.trial005.stdout: ceph-mgr-rook noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 49 k 2026-02-17T21:16:35.278 INFO:teuthology.orchestra.run.trial005.stdout: ceph-volume noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 299 k 2026-02-17T21:16:35.278 INFO:teuthology.orchestra.run.trial005.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T21:16:35.278 INFO:teuthology.orchestra.run.trial005.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T21:16:35.278 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:35.278 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:16:35.278 INFO:teuthology.orchestra.run.trial005.stdout:====================================================================================== 2026-02-17T21:16:35.278 INFO:teuthology.orchestra.run.trial005.stdout:Install 99 Packages 2026-02-17T21:16:35.278 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:35.278 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 95 M 2026-02-17T21:16:35.278 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 520 M 2026-02-17T21:16:35.278 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:16:35.373 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noar 91/99 2026-02-17T21:16:35.374 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f5 92/99 2026-02-17T21:16:35.387 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f5 92/99 2026-02-17T21:16:35.388 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noar 93/99 2026-02-17T21:16:35.444 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noar 93/99 2026-02-17T21:16:35.445 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T21:16:35.469 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T21:16:35.473 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T21:16:35.494 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-679.gd855f53b.el9.n 94/99 2026-02-17T21:16:35.495 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 95/99 2026-02-17T21:16:35.517 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 95/99 2026-02-17T21:16:35.517 INFO:teuthology.orchestra.run.trial119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:35.517 INFO:teuthology.orchestra.run.trial119.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T21:16:35.517 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T21:16:35.517 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T21:16:35.517 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:35.529 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 96/99 2026-02-17T21:16:35.531 INFO:teuthology.orchestra.run.trial176.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T21:16:35.533 INFO:teuthology.orchestra.run.trial176.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T21:16:35.555 INFO:teuthology.orchestra.run.trial176.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T21:16:35.650 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-2:19.2.3-679.gd855f53b.el9.x86_64 99/99 2026-02-17T21:16:35.650 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-2:19.2.3-679.gd855f53b.el9.x86_64 1/99 2026-02-17T21:16:35.650 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 2/99 2026-02-17T21:16:35.650 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 3/99 2026-02-17T21:16:35.651 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 4/99 2026-02-17T21:16:35.651 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 5/99 2026-02-17T21:16:35.651 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-679.gd855f53b.el9 6/99 2026-02-17T21:16:35.651 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 7/99 2026-02-17T21:16:35.651 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noar 8/99 2026-02-17T21:16:35.651 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f5 9/99 2026-02-17T21:16:35.651 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noar 10/99 2026-02-17T21:16:35.651 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-679.gd855f53b.el9.n 11/99 2026-02-17T21:16:35.651 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 12/99 2026-02-17T21:16:35.651 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-679.gd855f53b.el9. 13/99 2026-02-17T21:16:35.651 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 14/99 2026-02-17T21:16:35.651 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : cephadm-2:19.2.3-679.gd855f53b.el9.noarch 15/99 2026-02-17T21:16:35.651 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T21:16:35.651 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T21:16:35.651 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T21:16:35.651 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T21:16:35.651 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T21:16:35.651 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T21:16:35.651 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T21:16:35.651 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T21:16:35.651 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T21:16:35.651 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T21:16:35.652 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T21:16:35.652 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T21:16:35.652 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T21:16:35.652 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T21:16:35.652 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T21:16:35.652 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T21:16:35.652 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T21:16:35.652 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T21:16:35.652 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T21:16:35.652 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T21:16:35.652 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T21:16:35.652 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T21:16:35.652 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T21:16:35.652 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T21:16:35.652 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T21:16:35.652 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T21:16:35.652 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T21:16:35.652 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T21:16:35.652 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T21:16:35.652 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T21:16:35.652 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T21:16:35.652 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T21:16:35.653 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T21:16:35.653 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T21:16:35.653 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T21:16:35.653 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T21:16:35.653 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T21:16:35.653 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T21:16:35.653 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T21:16:35.653 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T21:16:35.653 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T21:16:35.653 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T21:16:35.653 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T21:16:35.653 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T21:16:35.653 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T21:16:35.653 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T21:16:35.653 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T21:16:35.653 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T21:16:35.653 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T21:16:35.653 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T21:16:35.653 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T21:16:35.653 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T21:16:35.653 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T21:16:35.653 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T21:16:35.653 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T21:16:35.654 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T21:16:35.654 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T21:16:35.654 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T21:16:35.654 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T21:16:35.654 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T21:16:35.654 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T21:16:35.654 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T21:16:35.654 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T21:16:35.654 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T21:16:35.654 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T21:16:35.654 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T21:16:35.654 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T21:16:35.654 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T21:16:35.654 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T21:16:35.654 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T21:16:35.654 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T21:16:35.654 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T21:16:35.654 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T21:16:35.654 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T21:16:35.655 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T21:16:35.655 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T21:16:35.655 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T21:16:35.655 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T21:16:35.655 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T21:16:35.655 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T21:16:35.655 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T21:16:35.655 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T21:16:35.655 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T21:16:35.718 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T21:16:35.718 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:35.718 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:16:35.718 INFO:teuthology.orchestra.run.trial135.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T21:16:35.718 INFO:teuthology.orchestra.run.trial135.stdout: ceph-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:35.718 INFO:teuthology.orchestra.run.trial135.stdout: ceph-grafana-dashboards-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:35.718 INFO:teuthology.orchestra.run.trial135.stdout: ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:35.718 INFO:teuthology.orchestra.run.trial135.stdout: ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:35.718 INFO:teuthology.orchestra.run.trial135.stdout: ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:35.718 INFO:teuthology.orchestra.run.trial135.stdout: ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:35.718 INFO:teuthology.orchestra.run.trial135.stdout: ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:35.719 INFO:teuthology.orchestra.run.trial135.stdout: ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:35.719 INFO:teuthology.orchestra.run.trial135.stdout: ceph-mgr-modules-core-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:35.719 INFO:teuthology.orchestra.run.trial135.stdout: ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:35.719 INFO:teuthology.orchestra.run.trial135.stdout: ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:35.719 INFO:teuthology.orchestra.run.trial135.stdout: ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:35.719 INFO:teuthology.orchestra.run.trial135.stdout: ceph-prometheus-alerts-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:35.719 INFO:teuthology.orchestra.run.trial135.stdout: ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:35.719 INFO:teuthology.orchestra.run.trial135.stdout: cephadm-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:35.719 INFO:teuthology.orchestra.run.trial135.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T21:16:35.719 INFO:teuthology.orchestra.run.trial135.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T21:16:35.719 INFO:teuthology.orchestra.run.trial135.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T21:16:35.719 INFO:teuthology.orchestra.run.trial135.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T21:16:35.719 INFO:teuthology.orchestra.run.trial135.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T21:16:35.719 INFO:teuthology.orchestra.run.trial135.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T21:16:35.720 INFO:teuthology.orchestra.run.trial135.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T21:16:35.720 INFO:teuthology.orchestra.run.trial135.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T21:16:35.720 INFO:teuthology.orchestra.run.trial135.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T21:16:35.720 INFO:teuthology.orchestra.run.trial135.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T21:16:35.720 INFO:teuthology.orchestra.run.trial135.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T21:16:35.720 INFO:teuthology.orchestra.run.trial135.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T21:16:35.720 INFO:teuthology.orchestra.run.trial135.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T21:16:35.720 INFO:teuthology.orchestra.run.trial135.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T21:16:35.720 INFO:teuthology.orchestra.run.trial135.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T21:16:35.720 INFO:teuthology.orchestra.run.trial135.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T21:16:35.720 INFO:teuthology.orchestra.run.trial135.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T21:16:35.720 INFO:teuthology.orchestra.run.trial135.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T21:16:35.720 INFO:teuthology.orchestra.run.trial135.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T21:16:35.720 INFO:teuthology.orchestra.run.trial135.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T21:16:35.720 INFO:teuthology.orchestra.run.trial135.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T21:16:35.721 INFO:teuthology.orchestra.run.trial135.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T21:16:35.721 INFO:teuthology.orchestra.run.trial135.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T21:16:35.721 INFO:teuthology.orchestra.run.trial135.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T21:16:35.721 INFO:teuthology.orchestra.run.trial135.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T21:16:35.721 INFO:teuthology.orchestra.run.trial135.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T21:16:35.721 INFO:teuthology.orchestra.run.trial135.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T21:16:35.721 INFO:teuthology.orchestra.run.trial135.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T21:16:35.721 INFO:teuthology.orchestra.run.trial135.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T21:16:35.721 INFO:teuthology.orchestra.run.trial135.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T21:16:35.721 INFO:teuthology.orchestra.run.trial135.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T21:16:35.721 INFO:teuthology.orchestra.run.trial135.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T21:16:35.721 INFO:teuthology.orchestra.run.trial135.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T21:16:35.721 INFO:teuthology.orchestra.run.trial135.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T21:16:35.721 INFO:teuthology.orchestra.run.trial135.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T21:16:35.721 INFO:teuthology.orchestra.run.trial135.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T21:16:35.721 INFO:teuthology.orchestra.run.trial135.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T21:16:35.722 INFO:teuthology.orchestra.run.trial135.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T21:16:35.722 INFO:teuthology.orchestra.run.trial135.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T21:16:35.722 INFO:teuthology.orchestra.run.trial135.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T21:16:35.722 INFO:teuthology.orchestra.run.trial135.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T21:16:35.722 INFO:teuthology.orchestra.run.trial135.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T21:16:35.722 INFO:teuthology.orchestra.run.trial135.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T21:16:35.722 INFO:teuthology.orchestra.run.trial135.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T21:16:35.722 INFO:teuthology.orchestra.run.trial135.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T21:16:35.722 INFO:teuthology.orchestra.run.trial135.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T21:16:35.722 INFO:teuthology.orchestra.run.trial135.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T21:16:35.722 INFO:teuthology.orchestra.run.trial135.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T21:16:35.722 INFO:teuthology.orchestra.run.trial135.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T21:16:35.722 INFO:teuthology.orchestra.run.trial135.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T21:16:35.722 INFO:teuthology.orchestra.run.trial135.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T21:16:35.722 INFO:teuthology.orchestra.run.trial135.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T21:16:35.722 INFO:teuthology.orchestra.run.trial135.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T21:16:35.722 INFO:teuthology.orchestra.run.trial135.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T21:16:35.723 INFO:teuthology.orchestra.run.trial135.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T21:16:35.723 INFO:teuthology.orchestra.run.trial135.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T21:16:35.723 INFO:teuthology.orchestra.run.trial135.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T21:16:35.723 INFO:teuthology.orchestra.run.trial135.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T21:16:35.723 INFO:teuthology.orchestra.run.trial135.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T21:16:35.723 INFO:teuthology.orchestra.run.trial135.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T21:16:35.723 INFO:teuthology.orchestra.run.trial135.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T21:16:35.723 INFO:teuthology.orchestra.run.trial135.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T21:16:35.723 INFO:teuthology.orchestra.run.trial135.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T21:16:35.723 INFO:teuthology.orchestra.run.trial135.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T21:16:35.723 INFO:teuthology.orchestra.run.trial135.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T21:16:35.723 INFO:teuthology.orchestra.run.trial135.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T21:16:35.723 INFO:teuthology.orchestra.run.trial135.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T21:16:35.723 INFO:teuthology.orchestra.run.trial135.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T21:16:35.723 INFO:teuthology.orchestra.run.trial135.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T21:16:35.723 INFO:teuthology.orchestra.run.trial135.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T21:16:35.723 INFO:teuthology.orchestra.run.trial135.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T21:16:35.724 INFO:teuthology.orchestra.run.trial135.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T21:16:35.724 INFO:teuthology.orchestra.run.trial135.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T21:16:35.724 INFO:teuthology.orchestra.run.trial135.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T21:16:35.724 INFO:teuthology.orchestra.run.trial135.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T21:16:35.724 INFO:teuthology.orchestra.run.trial135.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T21:16:35.724 INFO:teuthology.orchestra.run.trial135.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T21:16:35.724 INFO:teuthology.orchestra.run.trial135.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T21:16:35.724 INFO:teuthology.orchestra.run.trial135.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T21:16:35.724 INFO:teuthology.orchestra.run.trial135.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T21:16:35.724 INFO:teuthology.orchestra.run.trial135.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T21:16:35.724 INFO:teuthology.orchestra.run.trial135.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T21:16:35.724 INFO:teuthology.orchestra.run.trial135.stdout: zip-3.0-35.el9.x86_64 2026-02-17T21:16:35.724 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:35.724 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:35.751 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 96/99 2026-02-17T21:16:35.753 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 97/99 2026-02-17T21:16:35.775 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install ceph-base 2026-02-17T21:16:35.775 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 97/99 2026-02-17T21:16:35.775 INFO:teuthology.orchestra.run.trial119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:35.775 INFO:teuthology.orchestra.run.trial119.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T21:16:35.775 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T21:16:35.776 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T21:16:35.776 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:35.823 INFO:teuthology.orchestra.run.trial005.stdout:(1/99): ceph-19.2.3-679.gd855f53b.el9.x86_64.rp 107 kB/s | 6.5 kB 00:00 2026-02-17T21:16:35.879 INFO:teuthology.orchestra.run.trial176.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T21:16:35.880 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 98/99 2026-02-17T21:16:35.886 INFO:teuthology.orchestra.run.trial005.stdout:(2/99): ceph-mgr-19.2.3-679.gd855f53b.el9.x86_6 8.7 MB/s | 1.1 MB 00:00 2026-02-17T21:16:35.900 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 98/99 2026-02-17T21:16:35.900 INFO:teuthology.orchestra.run.trial119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:35.900 INFO:teuthology.orchestra.run.trial119.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T21:16:35.900 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T21:16:35.900 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T21:16:35.901 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:35.919 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-2:19.2.3-679.gd855f53b.el9.x86_64 99/99 2026-02-17T21:16:35.952 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T21:16:35.986 INFO:teuthology.orchestra.run.trial005.stdout:(3/99): ceph-mds-19.2.3-679.gd855f53b.el9.x86_6 11 MB/s | 2.4 MB 00:00 2026-02-17T21:16:36.027 INFO:teuthology.orchestra.run.trial005.stdout:(4/99): ceph-grafana-dashboards-19.2.3-679.gd85 749 kB/s | 31 kB 00:00 2026-02-17T21:16:36.073 INFO:teuthology.orchestra.run.trial005.stdout:(5/99): ceph-mgr-cephadm-19.2.3-679.gd855f53b.e 3.2 MB/s | 150 kB 00:00 2026-02-17T21:16:36.092 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:36.157 INFO:teuthology.orchestra.run.trial135.stdout:Package ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:36.174 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:36.175 INFO:teuthology.orchestra.run.trial135.stdout:Nothing to do. 2026-02-17T21:16:36.175 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:36.186 INFO:teuthology.orchestra.run.trial005.stdout:(6/99): ceph-mon-19.2.3-679.gd855f53b.el9.x86_6 13 MB/s | 4.7 MB 00:00 2026-02-17T21:16:36.196 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install cephadm 2026-02-17T21:16:36.336 INFO:teuthology.orchestra.run.trial005.stdout:(7/99): ceph-mgr-dashboard-19.2.3-679.gd855f53b 14 MB/s | 3.8 MB 00:00 2026-02-17T21:16:36.372 INFO:teuthology.orchestra.run.trial005.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-679.gd855f53b 608 kB/s | 22 kB 00:00 2026-02-17T21:16:36.415 INFO:teuthology.orchestra.run.trial005.stdout:(9/99): ceph-osd-19.2.3-679.gd855f53b.el9.x86_6 32 MB/s | 17 MB 00:00 2026-02-17T21:16:36.416 INFO:teuthology.orchestra.run.trial005.stdout:(10/99): ceph-mgr-modules-core-19.2.3-679.gd855 5.6 MB/s | 253 kB 00:00 2026-02-17T21:16:36.427 INFO:teuthology.orchestra.run.trial005.stdout:(11/99): ceph-mgr-rook-19.2.3-679.gd855f53b.el9 4.2 MB/s | 49 kB 00:00 2026-02-17T21:16:36.428 INFO:teuthology.orchestra.run.trial005.stdout:(12/99): ceph-prometheus-alerts-19.2.3-679.gd85 1.4 MB/s | 17 kB 00:00 2026-02-17T21:16:36.440 INFO:teuthology.orchestra.run.trial005.stdout:(13/99): ceph-volume-19.2.3-679.gd855f53b.el9.n 22 MB/s | 299 kB 00:00 2026-02-17T21:16:36.457 INFO:teuthology.orchestra.run.trial005.stdout:(14/99): cephadm-19.2.3-679.gd855f53b.el9.noarc 26 MB/s | 769 kB 00:00 2026-02-17T21:16:36.506 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:36.517 INFO:teuthology.orchestra.run.trial005.stdout:(15/99): ceph-mgr-diskprediction-local-19.2.3-6 22 MB/s | 7.4 MB 00:00 2026-02-17T21:16:36.572 INFO:teuthology.orchestra.run.trial135.stdout:Package cephadm-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T21:16:36.586 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-2:19.2.3-679.gd855f53b.el9.x86_64 99/99 2026-02-17T21:16:36.586 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-2:19.2.3-679.gd855f53b.el9.x86_64 1/99 2026-02-17T21:16:36.586 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 2/99 2026-02-17T21:16:36.586 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 3/99 2026-02-17T21:16:36.586 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 4/99 2026-02-17T21:16:36.586 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 5/99 2026-02-17T21:16:36.586 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-679.gd855f53b.el9 6/99 2026-02-17T21:16:36.586 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 7/99 2026-02-17T21:16:36.586 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noar 8/99 2026-02-17T21:16:36.586 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f5 9/99 2026-02-17T21:16:36.587 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noar 10/99 2026-02-17T21:16:36.587 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-679.gd855f53b.el9.n 11/99 2026-02-17T21:16:36.587 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 12/99 2026-02-17T21:16:36.587 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-679.gd855f53b.el9. 13/99 2026-02-17T21:16:36.587 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 14/99 2026-02-17T21:16:36.587 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : cephadm-2:19.2.3-679.gd855f53b.el9.noarch 15/99 2026-02-17T21:16:36.587 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T21:16:36.587 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T21:16:36.587 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T21:16:36.587 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T21:16:36.587 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T21:16:36.587 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T21:16:36.587 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T21:16:36.587 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T21:16:36.587 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T21:16:36.587 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T21:16:36.587 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T21:16:36.588 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T21:16:36.588 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T21:16:36.588 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T21:16:36.588 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T21:16:36.588 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T21:16:36.588 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T21:16:36.588 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T21:16:36.588 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T21:16:36.588 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T21:16:36.588 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T21:16:36.588 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T21:16:36.588 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T21:16:36.588 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T21:16:36.588 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T21:16:36.588 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T21:16:36.588 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T21:16:36.588 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T21:16:36.589 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T21:16:36.589 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T21:16:36.589 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T21:16:36.589 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T21:16:36.589 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T21:16:36.589 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T21:16:36.589 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T21:16:36.589 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T21:16:36.589 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T21:16:36.589 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T21:16:36.589 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T21:16:36.589 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T21:16:36.589 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T21:16:36.589 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T21:16:36.589 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T21:16:36.589 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T21:16:36.589 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T21:16:36.589 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T21:16:36.590 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T21:16:36.590 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T21:16:36.590 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T21:16:36.590 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T21:16:36.590 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T21:16:36.590 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T21:16:36.590 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T21:16:36.590 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T21:16:36.590 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T21:16:36.590 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T21:16:36.590 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T21:16:36.590 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T21:16:36.590 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T21:16:36.590 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T21:16:36.590 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T21:16:36.590 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T21:16:36.590 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T21:16:36.590 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T21:16:36.590 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T21:16:36.590 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T21:16:36.590 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T21:16:36.590 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T21:16:36.590 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T21:16:36.591 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T21:16:36.591 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T21:16:36.591 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T21:16:36.591 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T21:16:36.591 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T21:16:36.591 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T21:16:36.591 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T21:16:36.591 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T21:16:36.591 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T21:16:36.591 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T21:16:36.591 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T21:16:36.591 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T21:16:36.591 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T21:16:36.591 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T21:16:36.591 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:36.591 INFO:teuthology.orchestra.run.trial135.stdout:Nothing to do. 2026-02-17T21:16:36.591 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:36.611 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T21:16:36.621 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T21:16:36.638 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T21:16:36.648 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T21:16:36.650 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T21:16:36.650 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:36.651 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:16:36.651 INFO:teuthology.orchestra.run.trial119.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T21:16:36.651 INFO:teuthology.orchestra.run.trial119.stdout: ceph-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:36.651 INFO:teuthology.orchestra.run.trial119.stdout: ceph-grafana-dashboards-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:36.651 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:36.651 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:36.651 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:36.651 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:36.651 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:36.651 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:36.652 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-modules-core-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:36.652 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:36.652 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:36.652 INFO:teuthology.orchestra.run.trial119.stdout: ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:36.652 INFO:teuthology.orchestra.run.trial119.stdout: ceph-prometheus-alerts-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:36.652 INFO:teuthology.orchestra.run.trial119.stdout: ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:36.652 INFO:teuthology.orchestra.run.trial119.stdout: cephadm-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:36.652 INFO:teuthology.orchestra.run.trial119.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T21:16:36.652 INFO:teuthology.orchestra.run.trial119.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T21:16:36.652 INFO:teuthology.orchestra.run.trial119.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T21:16:36.652 INFO:teuthology.orchestra.run.trial119.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T21:16:36.652 INFO:teuthology.orchestra.run.trial119.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T21:16:36.653 INFO:teuthology.orchestra.run.trial119.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T21:16:36.653 INFO:teuthology.orchestra.run.trial119.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T21:16:36.653 INFO:teuthology.orchestra.run.trial119.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T21:16:36.653 INFO:teuthology.orchestra.run.trial119.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T21:16:36.653 INFO:teuthology.orchestra.run.trial119.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T21:16:36.653 INFO:teuthology.orchestra.run.trial119.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T21:16:36.653 INFO:teuthology.orchestra.run.trial119.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T21:16:36.653 INFO:teuthology.orchestra.run.trial119.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T21:16:36.653 INFO:teuthology.orchestra.run.trial119.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T21:16:36.653 INFO:teuthology.orchestra.run.trial119.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T21:16:36.653 INFO:teuthology.orchestra.run.trial119.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T21:16:36.654 INFO:teuthology.orchestra.run.trial119.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T21:16:36.654 INFO:teuthology.orchestra.run.trial119.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T21:16:36.654 INFO:teuthology.orchestra.run.trial119.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T21:16:36.654 INFO:teuthology.orchestra.run.trial119.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T21:16:36.654 INFO:teuthology.orchestra.run.trial119.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T21:16:36.654 INFO:teuthology.orchestra.run.trial119.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T21:16:36.654 INFO:teuthology.orchestra.run.trial119.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T21:16:36.654 INFO:teuthology.orchestra.run.trial119.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T21:16:36.654 INFO:teuthology.orchestra.run.trial119.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T21:16:36.654 INFO:teuthology.orchestra.run.trial119.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T21:16:36.654 INFO:teuthology.orchestra.run.trial119.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T21:16:36.654 INFO:teuthology.orchestra.run.trial119.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T21:16:36.655 INFO:teuthology.orchestra.run.trial119.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T21:16:36.655 INFO:teuthology.orchestra.run.trial119.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T21:16:36.655 INFO:teuthology.orchestra.run.trial119.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T21:16:36.655 INFO:teuthology.orchestra.run.trial119.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T21:16:36.655 INFO:teuthology.orchestra.run.trial119.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T21:16:36.655 INFO:teuthology.orchestra.run.trial119.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T21:16:36.655 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T21:16:36.655 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T21:16:36.655 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T21:16:36.655 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T21:16:36.655 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T21:16:36.655 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T21:16:36.655 INFO:teuthology.orchestra.run.trial119.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T21:16:36.655 INFO:teuthology.orchestra.run.trial119.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T21:16:36.656 INFO:teuthology.orchestra.run.trial119.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T21:16:36.656 INFO:teuthology.orchestra.run.trial119.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T21:16:36.656 INFO:teuthology.orchestra.run.trial119.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T21:16:36.656 INFO:teuthology.orchestra.run.trial119.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T21:16:36.656 INFO:teuthology.orchestra.run.trial119.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T21:16:36.656 INFO:teuthology.orchestra.run.trial119.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T21:16:36.656 INFO:teuthology.orchestra.run.trial119.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T21:16:36.656 INFO:teuthology.orchestra.run.trial119.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T21:16:36.656 INFO:teuthology.orchestra.run.trial119.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T21:16:36.656 INFO:teuthology.orchestra.run.trial119.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T21:16:36.656 INFO:teuthology.orchestra.run.trial119.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T21:16:36.656 INFO:teuthology.orchestra.run.trial119.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T21:16:36.656 INFO:teuthology.orchestra.run.trial119.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T21:16:36.656 INFO:teuthology.orchestra.run.trial119.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T21:16:36.656 INFO:teuthology.orchestra.run.trial119.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T21:16:36.657 INFO:teuthology.orchestra.run.trial119.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T21:16:36.657 INFO:teuthology.orchestra.run.trial119.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T21:16:36.657 INFO:teuthology.orchestra.run.trial119.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T21:16:36.657 INFO:teuthology.orchestra.run.trial119.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T21:16:36.657 INFO:teuthology.orchestra.run.trial119.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T21:16:36.657 INFO:teuthology.orchestra.run.trial119.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T21:16:36.657 INFO:teuthology.orchestra.run.trial119.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T21:16:36.657 INFO:teuthology.orchestra.run.trial119.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T21:16:36.657 INFO:teuthology.orchestra.run.trial119.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T21:16:36.657 INFO:teuthology.orchestra.run.trial119.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T21:16:36.657 INFO:teuthology.orchestra.run.trial119.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T21:16:36.657 INFO:teuthology.orchestra.run.trial119.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T21:16:36.657 INFO:teuthology.orchestra.run.trial119.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T21:16:36.657 INFO:teuthology.orchestra.run.trial119.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T21:16:36.658 INFO:teuthology.orchestra.run.trial119.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T21:16:36.658 INFO:teuthology.orchestra.run.trial119.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T21:16:36.658 INFO:teuthology.orchestra.run.trial119.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T21:16:36.658 INFO:teuthology.orchestra.run.trial119.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T21:16:36.658 INFO:teuthology.orchestra.run.trial119.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T21:16:36.658 INFO:teuthology.orchestra.run.trial119.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T21:16:36.658 INFO:teuthology.orchestra.run.trial119.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T21:16:36.658 INFO:teuthology.orchestra.run.trial119.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T21:16:36.658 INFO:teuthology.orchestra.run.trial119.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T21:16:36.658 INFO:teuthology.orchestra.run.trial119.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T21:16:36.658 INFO:teuthology.orchestra.run.trial119.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T21:16:36.658 INFO:teuthology.orchestra.run.trial119.stdout: zip-3.0-35.el9.x86_64 2026-02-17T21:16:36.658 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:36.659 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:16:36.659 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T21:16:36.668 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T21:16:36.684 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T21:16:36.707 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-base 2026-02-17T21:16:36.759 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T21:16:36.767 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T21:16:36.791 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T21:16:36.820 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T21:16:36.871 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T21:16:36.877 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T21:16:36.880 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T21:16:36.881 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T21:16:36.898 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T21:16:36.898 INFO:teuthology.orchestra.run.trial176.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T21:16:36.899 INFO:teuthology.orchestra.run.trial176.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T21:16:36.899 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:36.906 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T21:16:36.910 INFO:teuthology.orchestra.run.trial005.stdout:(16/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 89 kB/s | 40 kB 00:00 2026-02-17T21:16:36.924 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:36.931 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T21:16:36.931 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T21:16:36.931 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:36.965 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T21:16:36.997 INFO:teuthology.orchestra.run.trial005.stdout:(17/99): libconfig-1.7.2-9.el9.x86_64.rpm 150 kB/s | 72 kB 00:00 2026-02-17T21:16:37.005 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:37.006 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:37.006 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repo Size 2026-02-17T21:16:37.006 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:37.006 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:16:37.006 INFO:teuthology.orchestra.run.trial135.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-679.gd855f53b.el9 ceph 145 k 2026-02-17T21:16:37.006 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:37.007 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:16:37.007 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:37.007 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:16:37.007 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:37.007 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 145 k 2026-02-17T21:16:37.007 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 431 k 2026-02-17T21:16:37.007 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:16:37.023 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:16:37.028 INFO:teuthology.orchestra.run.trial176.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T21:16:37.030 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 85/99 2026-02-17T21:16:37.044 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 85/99 2026-02-17T21:16:37.044 INFO:teuthology.orchestra.run.trial176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:37.044 INFO:teuthology.orchestra.run.trial176.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T21:16:37.044 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:37.088 INFO:teuthology.orchestra.run.trial119.stdout:Package ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:37.092 INFO:teuthology.orchestra.run.trial135.stdout:ceph-immutable-object-cache-19.2.3-679.gd855f53 1.7 MB/s | 145 kB 00:00 2026-02-17T21:16:37.093 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:37.093 INFO:teuthology.orchestra.run.trial135.stdout:Total 1.6 MB/s | 145 kB 00:00 2026-02-17T21:16:37.093 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:16:37.097 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:16:37.097 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:16:37.105 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:37.106 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-17T21:16:37.106 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:16:37.127 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install cephadm 2026-02-17T21:16:37.129 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:16:37.129 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:16:37.159 INFO:teuthology.orchestra.run.trial005.stdout:(18/99): libquadmath-11.5.0-14.el9.x86_64.rpm 1.1 MB/s | 184 kB 00:00 2026-02-17T21:16:37.184 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:16:37.185 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.e 1/1 2026-02-17T21:16:37.208 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.e 1/1 2026-02-17T21:16:37.208 INFO:teuthology.orchestra.run.trial135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:37.208 INFO:teuthology.orchestra.run.trial135.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T21:16:37.208 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:37.311 INFO:teuthology.orchestra.run.trial005.stdout:(19/99): libgfortran-11.5.0-14.el9.x86_64.rpm 1.9 MB/s | 794 kB 00:00 2026-02-17T21:16:37.400 INFO:teuthology.orchestra.run.trial005.stdout:(20/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2026-02-17T21:16:37.439 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:16:37.477 INFO:teuthology.orchestra.run.trial005.stdout:(21/99): python3-cryptography-36.0.1-5.el9.x86_ 7.5 MB/s | 1.2 MB 00:00 2026-02-17T21:16:37.504 INFO:teuthology.orchestra.run.trial119.stdout:Package cephadm-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T21:16:37.507 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.e 1/1 2026-02-17T21:16:37.507 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:37.507 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:16:37.507 INFO:teuthology.orchestra.run.trial135.stdout: ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:37.508 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:37.508 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:37.522 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:37.522 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-17T21:16:37.522 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:16:37.535 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install ceph-mgr 2026-02-17T21:16:37.544 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T21:16:37.562 INFO:teuthology.orchestra.run.trial005.stdout:(22/99): python3-ply-3.11-14.el9.noarch.rpm 658 kB/s | 106 kB 00:00 2026-02-17T21:16:37.562 INFO:teuthology.orchestra.run.trial005.stdout:(23/99): python3-pycparser-2.20-6.el9.noarch.rp 1.6 MB/s | 135 kB 00:00 2026-02-17T21:16:37.647 INFO:teuthology.orchestra.run.trial005.stdout:(24/99): python3-pyparsing-2.4.7-9.el9.noarch.r 1.7 MB/s | 150 kB 00:00 2026-02-17T21:16:37.649 INFO:teuthology.orchestra.run.trial005.stdout:(25/99): python3-requests-2.25.1-10.el9.noarch. 1.4 MB/s | 126 kB 00:00 2026-02-17T21:16:37.733 INFO:teuthology.orchestra.run.trial005.stdout:(26/99): python3-urllib3-1.26.5-7.el9.noarch.rp 2.5 MB/s | 218 kB 00:00 2026-02-17T21:16:37.734 INFO:teuthology.orchestra.run.trial005.stdout:(27/99): unzip-6.0-59.el9.x86_64.rpm 2.1 MB/s | 182 kB 00:00 2026-02-17T21:16:37.749 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 86/99 2026-02-17T21:16:37.773 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 86/99 2026-02-17T21:16:37.773 INFO:teuthology.orchestra.run.trial176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:37.773 INFO:teuthology.orchestra.run.trial176.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T21:16:37.773 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T21:16:37.773 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T21:16:37.774 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:37.776 INFO:teuthology.orchestra.run.trial005.stdout:(28/99): flexiblas-3.0.4-9.el9.x86_64.rpm 694 kB/s | 30 kB 00:00 2026-02-17T21:16:37.818 INFO:teuthology.orchestra.run.trial005.stdout:(29/99): zip-3.0-35.el9.x86_64.rpm 3.1 MB/s | 266 kB 00:00 2026-02-17T21:16:37.831 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: cephadm-2:19.2.3-679.gd855f53b.el9.noarch 87/99 2026-02-17T21:16:37.833 INFO:teuthology.orchestra.run.trial176.stdout: Installing : cephadm-2:19.2.3-679.gd855f53b.el9.noarch 87/99 2026-02-17T21:16:37.837 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-679.gd855f53b.el9. 88/99 2026-02-17T21:16:37.844 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:37.857 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:16:37.857 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-679.gd855f53b.el9 89/99 2026-02-17T21:16:37.858 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 90/99 2026-02-17T21:16:37.861 INFO:teuthology.orchestra.run.trial005.stdout:(30/99): flexiblas-openblas-openmp-3.0.4-9.el9. 350 kB/s | 15 kB 00:00 2026-02-17T21:16:37.906 INFO:teuthology.orchestra.run.trial005.stdout:(31/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 23 MB/s | 3.0 MB 00:00 2026-02-17T21:16:37.909 INFO:teuthology.orchestra.run.trial135.stdout:Package ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:37.922 INFO:teuthology.orchestra.run.trial005.stdout:(32/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 236 kB/s | 350 kB 00:01 2026-02-17T21:16:37.927 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:37.927 INFO:teuthology.orchestra.run.trial135.stdout:Nothing to do. 2026-02-17T21:16:37.927 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:37.930 INFO:teuthology.orchestra.run.trial005.stdout:(33/99): lua-5.4.4-4.el9.x86_64.rpm 7.8 MB/s | 188 kB 00:00 2026-02-17T21:16:37.939 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:37.940 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:37.940 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-17T21:16:37.940 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:37.940 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:16:37.940 INFO:teuthology.orchestra.run.trial119.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-679.gd855f53b.el9 ceph 145 k 2026-02-17T21:16:37.940 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:37.940 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:16:37.940 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:37.941 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:16:37.941 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:37.941 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 145 k 2026-02-17T21:16:37.941 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 431 k 2026-02-17T21:16:37.941 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:16:37.947 INFO:teuthology.orchestra.run.trial005.stdout:(34/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.8 MB/s | 246 kB 00:00 2026-02-17T21:16:37.948 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T21:16:37.984 INFO:teuthology.orchestra.run.trial005.stdout:(35/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 98 MB/s | 5.3 MB 00:00 2026-02-17T21:16:37.985 INFO:teuthology.orchestra.run.trial005.stdout:(36/99): openblas-0.3.29-1.el9.x86_64.rpm 672 kB/s | 42 kB 00:00 2026-02-17T21:16:38.025 INFO:teuthology.orchestra.run.trial119.stdout:ceph-immutable-object-cache-19.2.3-679.gd855f53 1.7 MB/s | 145 kB 00:00 2026-02-17T21:16:38.026 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:38.026 INFO:teuthology.orchestra.run.trial119.stdout:Total 1.7 MB/s | 145 kB 00:00 2026-02-17T21:16:38.026 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:16:38.029 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:16:38.030 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:16:38.041 INFO:teuthology.orchestra.run.trial005.stdout:(37/99): python3-babel-2.9.1-2.el9.noarch.rpm 105 MB/s | 6.0 MB 00:00 2026-02-17T21:16:38.049 INFO:teuthology.orchestra.run.trial005.stdout:(38/99): protobuf-3.14.0-17.el9.x86_64.rpm 9.9 MB/s | 1.0 MB 00:00 2026-02-17T21:16:38.049 INFO:teuthology.orchestra.run.trial005.stdout:(39/99): python3-devel-3.9.25-2.el9.x86_64.rpm 3.7 MB/s | 244 kB 00:00 2026-02-17T21:16:38.060 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:16:38.060 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:16:38.065 INFO:teuthology.orchestra.run.trial005.stdout:(40/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 10 MB/s | 249 kB 00:00 2026-02-17T21:16:38.073 INFO:teuthology.orchestra.run.trial005.stdout:(41/99): python3-libstoragemgmt-1.10.1-1.el9.x8 7.1 MB/s | 177 kB 00:00 2026-02-17T21:16:38.090 INFO:teuthology.orchestra.run.trial005.stdout:(42/99): python3-mako-1.1.4-6.el9.noarch.rpm 7.0 MB/s | 172 kB 00:00 2026-02-17T21:16:38.096 INFO:teuthology.orchestra.run.trial005.stdout:(43/99): python3-markupsafe-1.1.1-12.el9.x86_64 1.5 MB/s | 35 kB 00:00 2026-02-17T21:16:38.115 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:16:38.116 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.e 1/1 2026-02-17T21:16:38.121 INFO:teuthology.orchestra.run.trial005.stdout:(44/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 17 MB/s | 442 kB 00:00 2026-02-17T21:16:38.135 INFO:teuthology.orchestra.run.trial005.stdout:(45/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 14 MB/s | 1.2 MB 00:00 2026-02-17T21:16:38.140 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.e 1/1 2026-02-17T21:16:38.140 INFO:teuthology.orchestra.run.trial119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:38.140 INFO:teuthology.orchestra.run.trial119.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T21:16:38.140 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:38.146 INFO:teuthology.orchestra.run.trial005.stdout:(46/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 109 MB/s | 6.1 MB 00:00 2026-02-17T21:16:38.147 INFO:teuthology.orchestra.run.trial005.stdout:(47/99): python3-packaging-20.9-5.el9.noarch.rp 3.0 MB/s | 77 kB 00:00 2026-02-17T21:16:38.160 INFO:teuthology.orchestra.run.trial005.stdout:(48/99): python3-protobuf-3.14.0-17.el9.noarch. 11 MB/s | 267 kB 00:00 2026-02-17T21:16:38.170 INFO:teuthology.orchestra.run.trial005.stdout:(49/99): python3-pyasn1-modules-0.4.8-6.el9.noa 12 MB/s | 279 kB 00:00 2026-02-17T21:16:38.171 INFO:teuthology.orchestra.run.trial005.stdout:(50/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 6.3 MB/s | 159 kB 00:00 2026-02-17T21:16:38.183 INFO:teuthology.orchestra.run.trial005.stdout:(51/99): python3-requests-oauthlib-1.3.0-12.el9 2.3 MB/s | 54 kB 00:00 2026-02-17T21:16:38.193 INFO:teuthology.orchestra.run.trial005.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 1.8 MB/s | 42 kB 00:00 2026-02-17T21:16:38.208 INFO:teuthology.orchestra.run.trial005.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 7.5 MB/s | 189 kB 00:00 2026-02-17T21:16:38.216 INFO:teuthology.orchestra.run.trial005.stdout:(54/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 4.0 MB/s | 90 kB 00:00 2026-02-17T21:16:38.253 INFO:teuthology.orchestra.run.trial005.stdout:(55/99): lua-devel-5.4.4-4.el9.x86_64.rpm 495 kB/s | 22 kB 00:00 2026-02-17T21:16:38.258 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:38.291 INFO:teuthology.orchestra.run.trial005.stdout:(56/99): protobuf-compiler-3.14.0-17.el9.x86_64 11 MB/s | 862 kB 00:00 2026-02-17T21:16:38.318 INFO:teuthology.orchestra.run.trial005.stdout:(57/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 8.4 MB/s | 551 kB 00:00 2026-02-17T21:16:38.318 INFO:teuthology.orchestra.run.trial005.stdout:(58/99): grpc-data-1.46.7-10.el9.noarch.rpm 722 kB/s | 19 kB 00:00 2026-02-17T21:16:38.322 INFO:teuthology.orchestra.run.trial135.stdout:Package ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T21:16:38.340 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:38.341 INFO:teuthology.orchestra.run.trial135.stdout:Nothing to do. 2026-02-17T21:16:38.341 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:38.346 INFO:teuthology.orchestra.run.trial005.stdout:(59/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 110 MB/s | 19 MB 00:00 2026-02-17T21:16:38.347 INFO:teuthology.orchestra.run.trial005.stdout:(60/99): luarocks-3.9.2-5.el9.noarch.rpm 5.2 MB/s | 151 kB 00:00 2026-02-17T21:16:38.351 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 90/99 2026-02-17T21:16:38.354 INFO:teuthology.orchestra.run.trial005.stdout:(61/99): python3-asyncssh-2.13.2-5.el9.noarch.r 15 MB/s | 548 kB 00:00 2026-02-17T21:16:38.355 INFO:teuthology.orchestra.run.trial005.stdout:(62/99): python3-autocommand-2.2.2-8.el9.noarch 3.5 MB/s | 29 kB 00:00 2026-02-17T21:16:38.355 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noar 91/99 2026-02-17T21:16:38.355 INFO:teuthology.orchestra.run.trial005.stdout:(63/99): python3-backports-tarfile-1.2.0-1.el9. 7.3 MB/s | 60 kB 00:00 2026-02-17T21:16:38.362 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T21:16:38.364 INFO:teuthology.orchestra.run.trial005.stdout:(64/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 5.6 MB/s | 43 kB 00:00 2026-02-17T21:16:38.364 INFO:teuthology.orchestra.run.trial005.stdout:(65/99): python3-cachetools-4.2.4-1.el9.noarch. 4.2 MB/s | 32 kB 00:00 2026-02-17T21:16:38.364 INFO:teuthology.orchestra.run.trial005.stdout:(66/99): python3-certifi-2023.05.07-4.el9.noarc 1.8 MB/s | 14 kB 00:00 2026-02-17T21:16:38.371 INFO:teuthology.orchestra.run.trial005.stdout:(67/99): python3-cheroot-10.0.1-4.el9.noarch.rp 19 MB/s | 173 kB 00:00 2026-02-17T21:16:38.374 INFO:teuthology.orchestra.run.trial005.stdout:(68/99): python3-cherrypy-18.6.1-2.el9.noarch.r 31 MB/s | 358 kB 00:00 2026-02-17T21:16:38.376 INFO:teuthology.orchestra.run.trial005.stdout:(69/99): python3-google-auth-2.45.0-1.el9.noarc 19 MB/s | 254 kB 00:00 2026-02-17T21:16:38.392 INFO:teuthology.orchestra.run.trial005.stdout:(70/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 96 MB/s | 2.0 MB 00:00 2026-02-17T21:16:38.393 INFO:teuthology.orchestra.run.trial005.stdout:(71/99): python3-grpcio-tools-1.46.7-10.el9.x86 7.4 MB/s | 144 kB 00:00 2026-02-17T21:16:38.393 INFO:teuthology.orchestra.run.trial005.stdout:(72/99): python3-influxdb-5.3.1-1.el9.noarch.rp 7.8 MB/s | 139 kB 00:00 2026-02-17T21:16:38.400 INFO:teuthology.orchestra.run.trial005.stdout:(73/99): python3-isodate-0.6.1-3.el9.noarch.rpm 7.2 MB/s | 56 kB 00:00 2026-02-17T21:16:38.401 INFO:teuthology.orchestra.run.trial005.stdout:(74/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 1.4 MB/s | 11 kB 00:00 2026-02-17T21:16:38.401 INFO:teuthology.orchestra.run.trial005.stdout:(75/99): python3-jaraco-classes-3.2.1-5.el9.noa 2.2 MB/s | 18 kB 00:00 2026-02-17T21:16:38.408 INFO:teuthology.orchestra.run.trial005.stdout:(76/99): python3-jaraco-collections-3.0.0-8.el9 3.0 MB/s | 23 kB 00:00 2026-02-17T21:16:38.408 INFO:teuthology.orchestra.run.trial005.stdout:(77/99): python3-jaraco-context-6.0.1-3.el9.noa 2.6 MB/s | 20 kB 00:00 2026-02-17T21:16:38.409 INFO:teuthology.orchestra.run.trial005.stdout:(78/99): python3-jaraco-functools-3.5.0-2.el9.n 2.6 MB/s | 19 kB 00:00 2026-02-17T21:16:38.415 INFO:teuthology.orchestra.run.trial005.stdout:(79/99): python3-jaraco-text-4.0.0-2.el9.noarch 3.5 MB/s | 26 kB 00:00 2026-02-17T21:16:38.419 INFO:teuthology.orchestra.run.trial005.stdout:(80/99): python3-kubernetes-26.1.0-3.el9.noarch 99 MB/s | 1.0 MB 00:00 2026-02-17T21:16:38.419 INFO:teuthology.orchestra.run.trial005.stdout:(81/99): python3-logutils-0.3.5-21.el9.noarch.r 4.4 MB/s | 46 kB 00:00 2026-02-17T21:16:38.423 INFO:teuthology.orchestra.run.trial005.stdout:(82/99): python3-more-itertools-8.12.0-2.el9.no 10 MB/s | 79 kB 00:00 2026-02-17T21:16:38.427 INFO:teuthology.orchestra.run.trial005.stdout:(83/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 11 MB/s | 86 kB 00:00 2026-02-17T21:16:38.427 INFO:teuthology.orchestra.run.trial005.stdout:(84/99): python3-natsort-7.1.1-5.el9.noarch.rpm 7.3 MB/s | 58 kB 00:00 2026-02-17T21:16:38.432 INFO:teuthology.orchestra.run.trial005.stdout:(85/99): python3-pecan-1.4.2-3.el9.noarch.rpm 32 MB/s | 272 kB 00:00 2026-02-17T21:16:38.434 INFO:teuthology.orchestra.run.trial005.stdout:(86/99): python3-portend-3.1.0-2.el9.noarch.rpm 2.2 MB/s | 16 kB 00:00 2026-02-17T21:16:38.435 INFO:teuthology.orchestra.run.trial005.stdout:(87/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 11 MB/s | 90 kB 00:00 2026-02-17T21:16:38.439 INFO:teuthology.orchestra.run.trial005.stdout:(88/99): python3-repoze-lru-0.7-16.el9.noarch.r 4.0 MB/s | 31 kB 00:00 2026-02-17T21:16:38.442 INFO:teuthology.orchestra.run.trial005.stdout:(89/99): python3-routes-2.5.1-5.el9.noarch.rpm 23 MB/s | 188 kB 00:00 2026-02-17T21:16:38.443 INFO:teuthology.orchestra.run.trial005.stdout:(90/99): python3-rsa-4.9-2.el9.noarch.rpm 7.2 MB/s | 59 kB 00:00 2026-02-17T21:16:38.447 INFO:teuthology.orchestra.run.trial005.stdout:(91/99): python3-saml-1.16.0-1.el9.noarch.rpm 15 MB/s | 125 kB 00:00 2026-02-17T21:16:38.449 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.e 1/1 2026-02-17T21:16:38.449 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:38.449 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:16:38.449 INFO:teuthology.orchestra.run.trial119.stdout: ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:38.449 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:38.449 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:16:38.450 INFO:teuthology.orchestra.run.trial005.stdout:(92/99): python3-tempora-5.0.0-2.el9.noarch.rpm 4.6 MB/s | 36 kB 00:00 2026-02-17T21:16:38.451 INFO:teuthology.orchestra.run.trial005.stdout:(93/99): python3-typing-extensions-4.15.0-1.el9 11 MB/s | 86 kB 00:00 2026-02-17T21:16:38.456 INFO:teuthology.orchestra.run.trial005.stdout:(94/99): python3-webob-1.8.8-2.el9.noarch.rpm 27 MB/s | 230 kB 00:00 2026-02-17T21:16:38.458 INFO:teuthology.orchestra.run.trial005.stdout:(95/99): python3-websocket-client-1.2.3-2.el9.n 11 MB/s | 90 kB 00:00 2026-02-17T21:16:38.459 INFO:teuthology.orchestra.run.trial005.stdout:(96/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 49 MB/s | 427 kB 00:00 2026-02-17T21:16:38.463 INFO:teuthology.orchestra.run.trial005.stdout:(97/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 6.3 MB/s | 48 kB 00:00 2026-02-17T21:16:38.466 INFO:teuthology.orchestra.run.trial005.stdout:(98/99): python3-xmltodict-0.12.0-15.el9.noarch 2.9 MB/s | 22 kB 00:00 2026-02-17T21:16:38.467 INFO:teuthology.orchestra.run.trial005.stdout:(99/99): python3-zc-lockfile-2.0-10.el9.noarch. 2.5 MB/s | 20 kB 00:00 2026-02-17T21:16:38.471 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:38.471 INFO:teuthology.orchestra.run.trial005.stdout:Total 30 MB/s | 95 MB 00:03 2026-02-17T21:16:38.478 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-mgr 2026-02-17T21:16:38.670 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:38.734 INFO:teuthology.orchestra.run.trial135.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T21:16:38.752 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:38.752 INFO:teuthology.orchestra.run.trial135.stdout:Nothing to do. 2026-02-17T21:16:38.752 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:38.772 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install ceph-mgr-rook 2026-02-17T21:16:38.791 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:16:38.815 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noar 91/99 2026-02-17T21:16:38.816 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f5 92/99 2026-02-17T21:16:38.828 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f5 92/99 2026-02-17T21:16:38.829 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noar 93/99 2026-02-17T21:16:38.857 INFO:teuthology.orchestra.run.trial119.stdout:Package ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:38.875 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:38.875 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-17T21:16:38.876 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:16:38.885 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noar 93/99 2026-02-17T21:16:38.898 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T21:16:38.907 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:16:38.935 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-679.gd855f53b.el9.n 94/99 2026-02-17T21:16:38.936 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 95/99 2026-02-17T21:16:38.945 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:16:38.945 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:16:38.958 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 95/99 2026-02-17T21:16:38.958 INFO:teuthology.orchestra.run.trial176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:38.958 INFO:teuthology.orchestra.run.trial176.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T21:16:38.958 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T21:16:38.958 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T21:16:38.958 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:38.970 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 96/99 2026-02-17T21:16:39.084 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:39.149 INFO:teuthology.orchestra.run.trial135.stdout:Package ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T21:16:39.167 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:39.168 INFO:teuthology.orchestra.run.trial135.stdout:Nothing to do. 2026-02-17T21:16:39.168 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:39.189 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T21:16:39.190 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 96/99 2026-02-17T21:16:39.191 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 97/99 2026-02-17T21:16:39.207 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:16:39.212 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 97/99 2026-02-17T21:16:39.212 INFO:teuthology.orchestra.run.trial176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:39.212 INFO:teuthology.orchestra.run.trial176.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T21:16:39.212 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T21:16:39.212 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T21:16:39.212 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:39.273 INFO:teuthology.orchestra.run.trial119.stdout:Package ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T21:16:39.293 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:39.293 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-17T21:16:39.293 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:16:39.315 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T21:16:39.316 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 98/99 2026-02-17T21:16:39.337 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 98/99 2026-02-17T21:16:39.337 INFO:teuthology.orchestra.run.trial176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:39.337 INFO:teuthology.orchestra.run.trial176.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T21:16:39.337 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T21:16:39.337 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T21:16:39.337 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:39.355 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-2:19.2.3-679.gd855f53b.el9.x86_64 99/99 2026-02-17T21:16:39.362 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:16:39.362 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:16:39.498 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:39.566 INFO:teuthology.orchestra.run.trial135.stdout:Package ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T21:16:39.583 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:39.584 INFO:teuthology.orchestra.run.trial135.stdout:Nothing to do. 2026-02-17T21:16:39.584 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:39.605 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install ceph-fuse 2026-02-17T21:16:39.620 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:16:39.684 INFO:teuthology.orchestra.run.trial119.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T21:16:39.702 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:39.702 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-17T21:16:39.702 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:16:39.724 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-mgr-rook 2026-02-17T21:16:39.800 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:16:39.802 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T21:16:39.833 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T21:16:39.838 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T21:16:39.859 INFO:teuthology.orchestra.run.trial005.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T21:16:39.865 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T21:16:39.899 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T21:16:39.908 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T21:16:39.913 INFO:teuthology.orchestra.run.trial005.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T21:16:39.916 INFO:teuthology.orchestra.run.trial005.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T21:16:39.919 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:39.920 INFO:teuthology.orchestra.run.trial005.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T21:16:39.943 INFO:teuthology.orchestra.run.trial005.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T21:16:39.956 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T21:16:39.959 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T21:16:39.965 INFO:teuthology.orchestra.run.trial005.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T21:16:39.967 INFO:teuthology.orchestra.run.trial005.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T21:16:39.976 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-2:19.2.3-679.gd855f53b.el9.x86_64 99/99 2026-02-17T21:16:39.977 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-2:19.2.3-679.gd855f53b.el9.x86_64 1/99 2026-02-17T21:16:39.977 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 2/99 2026-02-17T21:16:39.977 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 3/99 2026-02-17T21:16:39.977 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 4/99 2026-02-17T21:16:39.977 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 5/99 2026-02-17T21:16:39.977 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-679.gd855f53b.el9 6/99 2026-02-17T21:16:39.977 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 7/99 2026-02-17T21:16:39.977 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noar 8/99 2026-02-17T21:16:39.977 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f5 9/99 2026-02-17T21:16:39.977 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noar 10/99 2026-02-17T21:16:39.977 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-679.gd855f53b.el9.n 11/99 2026-02-17T21:16:39.977 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 12/99 2026-02-17T21:16:39.977 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-679.gd855f53b.el9. 13/99 2026-02-17T21:16:39.977 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 14/99 2026-02-17T21:16:39.977 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : cephadm-2:19.2.3-679.gd855f53b.el9.noarch 15/99 2026-02-17T21:16:39.977 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T21:16:39.977 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T21:16:39.978 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T21:16:39.978 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T21:16:39.978 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T21:16:39.978 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T21:16:39.978 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T21:16:39.978 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T21:16:39.978 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T21:16:39.978 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T21:16:39.978 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T21:16:39.978 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T21:16:39.978 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T21:16:39.978 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T21:16:39.978 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T21:16:39.978 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T21:16:39.978 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T21:16:39.978 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T21:16:39.978 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T21:16:39.978 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T21:16:39.978 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T21:16:39.978 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T21:16:39.978 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T21:16:39.979 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T21:16:39.979 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T21:16:39.979 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T21:16:39.979 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T21:16:39.979 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T21:16:39.979 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T21:16:39.979 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T21:16:39.979 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T21:16:39.979 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T21:16:39.979 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T21:16:39.979 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T21:16:39.979 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T21:16:39.979 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T21:16:39.979 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T21:16:39.979 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T21:16:39.979 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T21:16:39.979 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T21:16:39.979 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T21:16:39.979 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T21:16:39.979 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T21:16:39.979 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T21:16:39.979 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T21:16:39.979 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T21:16:39.980 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T21:16:39.980 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T21:16:39.980 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T21:16:39.980 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T21:16:39.980 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T21:16:39.980 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T21:16:39.980 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T21:16:39.980 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T21:16:39.980 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T21:16:39.980 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T21:16:39.980 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T21:16:39.980 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T21:16:39.980 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T21:16:39.980 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T21:16:39.980 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T21:16:39.980 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T21:16:39.980 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T21:16:39.980 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T21:16:39.980 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T21:16:39.980 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T21:16:39.980 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T21:16:39.980 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T21:16:39.980 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T21:16:39.981 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T21:16:39.981 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T21:16:39.981 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T21:16:39.981 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T21:16:39.981 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T21:16:39.981 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T21:16:39.981 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T21:16:39.981 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T21:16:39.981 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T21:16:39.981 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T21:16:39.981 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T21:16:39.981 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T21:16:39.981 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T21:16:39.981 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T21:16:39.981 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T21:16:39.985 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T21:16:40.002 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:40.002 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:40.002 INFO:teuthology.orchestra.run.trial135.stdout: Package Architecture Version Repository Size 2026-02-17T21:16:40.002 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:40.002 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:16:40.002 INFO:teuthology.orchestra.run.trial135.stdout: ceph-fuse x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.2 M 2026-02-17T21:16:40.003 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:40.003 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:16:40.003 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:40.003 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:16:40.003 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:40.003 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 1.2 M 2026-02-17T21:16:40.003 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 3.6 M 2026-02-17T21:16:40.003 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:16:40.009 INFO:teuthology.orchestra.run.trial005.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T21:16:40.012 INFO:teuthology.orchestra.run.trial005.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T21:16:40.019 INFO:teuthology.orchestra.run.trial005.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T21:16:40.037 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:16:40.040 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T21:16:40.040 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:40.041 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:16:40.041 INFO:teuthology.orchestra.run.trial176.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T21:16:40.041 INFO:teuthology.orchestra.run.trial176.stdout: ceph-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:40.041 INFO:teuthology.orchestra.run.trial176.stdout: ceph-grafana-dashboards-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:40.041 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:40.041 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:40.041 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:40.041 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:40.041 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:40.041 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:40.041 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-modules-core-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:40.041 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:40.041 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:40.041 INFO:teuthology.orchestra.run.trial176.stdout: ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:40.042 INFO:teuthology.orchestra.run.trial176.stdout: ceph-prometheus-alerts-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:40.042 INFO:teuthology.orchestra.run.trial176.stdout: ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:40.042 INFO:teuthology.orchestra.run.trial176.stdout: cephadm-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:40.042 INFO:teuthology.orchestra.run.trial176.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T21:16:40.042 INFO:teuthology.orchestra.run.trial176.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T21:16:40.042 INFO:teuthology.orchestra.run.trial176.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T21:16:40.042 INFO:teuthology.orchestra.run.trial176.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T21:16:40.042 INFO:teuthology.orchestra.run.trial176.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T21:16:40.042 INFO:teuthology.orchestra.run.trial176.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T21:16:40.042 INFO:teuthology.orchestra.run.trial176.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T21:16:40.042 INFO:teuthology.orchestra.run.trial176.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T21:16:40.042 INFO:teuthology.orchestra.run.trial176.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T21:16:40.042 INFO:teuthology.orchestra.run.trial176.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T21:16:40.042 INFO:teuthology.orchestra.run.trial176.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T21:16:40.042 INFO:teuthology.orchestra.run.trial176.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T21:16:40.042 INFO:teuthology.orchestra.run.trial176.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T21:16:40.043 INFO:teuthology.orchestra.run.trial176.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T21:16:40.043 INFO:teuthology.orchestra.run.trial176.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T21:16:40.043 INFO:teuthology.orchestra.run.trial176.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T21:16:40.043 INFO:teuthology.orchestra.run.trial176.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T21:16:40.043 INFO:teuthology.orchestra.run.trial176.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T21:16:40.043 INFO:teuthology.orchestra.run.trial176.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T21:16:40.043 INFO:teuthology.orchestra.run.trial176.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T21:16:40.043 INFO:teuthology.orchestra.run.trial176.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T21:16:40.043 INFO:teuthology.orchestra.run.trial176.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T21:16:40.043 INFO:teuthology.orchestra.run.trial176.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T21:16:40.043 INFO:teuthology.orchestra.run.trial176.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T21:16:40.043 INFO:teuthology.orchestra.run.trial176.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T21:16:40.043 INFO:teuthology.orchestra.run.trial176.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T21:16:40.043 INFO:teuthology.orchestra.run.trial176.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T21:16:40.043 INFO:teuthology.orchestra.run.trial176.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T21:16:40.043 INFO:teuthology.orchestra.run.trial176.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T21:16:40.044 INFO:teuthology.orchestra.run.trial176.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T21:16:40.044 INFO:teuthology.orchestra.run.trial176.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T21:16:40.044 INFO:teuthology.orchestra.run.trial176.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T21:16:40.044 INFO:teuthology.orchestra.run.trial176.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T21:16:40.044 INFO:teuthology.orchestra.run.trial176.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T21:16:40.044 INFO:teuthology.orchestra.run.trial176.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T21:16:40.044 INFO:teuthology.orchestra.run.trial176.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T21:16:40.044 INFO:teuthology.orchestra.run.trial176.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T21:16:40.044 INFO:teuthology.orchestra.run.trial176.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T21:16:40.044 INFO:teuthology.orchestra.run.trial176.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T21:16:40.044 INFO:teuthology.orchestra.run.trial176.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T21:16:40.044 INFO:teuthology.orchestra.run.trial176.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T21:16:40.044 INFO:teuthology.orchestra.run.trial176.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T21:16:40.044 INFO:teuthology.orchestra.run.trial176.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T21:16:40.044 INFO:teuthology.orchestra.run.trial176.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T21:16:40.044 INFO:teuthology.orchestra.run.trial176.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T21:16:40.044 INFO:teuthology.orchestra.run.trial176.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T21:16:40.044 INFO:teuthology.orchestra.run.trial176.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T21:16:40.045 INFO:teuthology.orchestra.run.trial176.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T21:16:40.045 INFO:teuthology.orchestra.run.trial176.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T21:16:40.045 INFO:teuthology.orchestra.run.trial176.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T21:16:40.045 INFO:teuthology.orchestra.run.trial176.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T21:16:40.045 INFO:teuthology.orchestra.run.trial176.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T21:16:40.045 INFO:teuthology.orchestra.run.trial176.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T21:16:40.045 INFO:teuthology.orchestra.run.trial176.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T21:16:40.045 INFO:teuthology.orchestra.run.trial176.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T21:16:40.045 INFO:teuthology.orchestra.run.trial176.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T21:16:40.045 INFO:teuthology.orchestra.run.trial176.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T21:16:40.045 INFO:teuthology.orchestra.run.trial176.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T21:16:40.045 INFO:teuthology.orchestra.run.trial176.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T21:16:40.045 INFO:teuthology.orchestra.run.trial176.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T21:16:40.045 INFO:teuthology.orchestra.run.trial176.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T21:16:40.045 INFO:teuthology.orchestra.run.trial176.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T21:16:40.045 INFO:teuthology.orchestra.run.trial176.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T21:16:40.045 INFO:teuthology.orchestra.run.trial176.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T21:16:40.045 INFO:teuthology.orchestra.run.trial176.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T21:16:40.045 INFO:teuthology.orchestra.run.trial176.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T21:16:40.045 INFO:teuthology.orchestra.run.trial176.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T21:16:40.045 INFO:teuthology.orchestra.run.trial176.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T21:16:40.046 INFO:teuthology.orchestra.run.trial176.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T21:16:40.046 INFO:teuthology.orchestra.run.trial176.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T21:16:40.046 INFO:teuthology.orchestra.run.trial176.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T21:16:40.046 INFO:teuthology.orchestra.run.trial176.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T21:16:40.046 INFO:teuthology.orchestra.run.trial176.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T21:16:40.046 INFO:teuthology.orchestra.run.trial176.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T21:16:40.046 INFO:teuthology.orchestra.run.trial176.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T21:16:40.046 INFO:teuthology.orchestra.run.trial176.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T21:16:40.046 INFO:teuthology.orchestra.run.trial176.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T21:16:40.046 INFO:teuthology.orchestra.run.trial176.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T21:16:40.046 INFO:teuthology.orchestra.run.trial176.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T21:16:40.046 INFO:teuthology.orchestra.run.trial176.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T21:16:40.046 INFO:teuthology.orchestra.run.trial176.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T21:16:40.046 INFO:teuthology.orchestra.run.trial176.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T21:16:40.046 INFO:teuthology.orchestra.run.trial176.stdout: zip-3.0-35.el9.x86_64 2026-02-17T21:16:40.046 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:40.046 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:16:40.046 INFO:teuthology.orchestra.run.trial005.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T21:16:40.095 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T21:16:40.096 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-base 2026-02-17T21:16:40.101 INFO:teuthology.orchestra.run.trial119.stdout:Package ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T21:16:40.108 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T21:16:40.110 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T21:16:40.115 INFO:teuthology.orchestra.run.trial005.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T21:16:40.119 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:40.120 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-17T21:16:40.120 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:16:40.121 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T21:16:40.121 INFO:teuthology.orchestra.run.trial135.stdout:ceph-fuse-19.2.3-679.gd855f53b.el9.x86_64.rpm 9.8 MB/s | 1.2 MB 00:00 2026-02-17T21:16:40.122 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:40.122 INFO:teuthology.orchestra.run.trial135.stdout:Total 9.7 MB/s | 1.2 MB 00:00 2026-02-17T21:16:40.122 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:16:40.125 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T21:16:40.126 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:16:40.126 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:16:40.128 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T21:16:40.141 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T21:16:40.143 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T21:16:40.161 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:16:40.161 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:16:40.163 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T21:16:40.168 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T21:16:40.173 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T21:16:40.184 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T21:16:40.193 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T21:16:40.199 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T21:16:40.219 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T21:16:40.227 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T21:16:40.262 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:16:40.279 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:40.282 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T21:16:40.294 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T21:16:40.309 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T21:16:40.314 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T21:16:40.321 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T21:16:40.361 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T21:16:40.402 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:16:40.452 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:16:40.466 INFO:teuthology.orchestra.run.trial176.stdout:Package ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:40.484 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:40.485 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T21:16:40.485 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:16:40.506 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install cephadm 2026-02-17T21:16:40.518 INFO:teuthology.orchestra.run.trial119.stdout:Package ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T21:16:40.519 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:40.536 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:40.536 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-17T21:16:40.537 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:16:40.558 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-fuse 2026-02-17T21:16:40.576 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:40.576 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:40.576 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:16:40.576 INFO:teuthology.orchestra.run.trial135.stdout: ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:40.576 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:40.576 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:40.605 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install ceph-volume 2026-02-17T21:16:40.686 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T21:16:40.696 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T21:16:40.700 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T21:16:40.705 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T21:16:40.707 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T21:16:40.734 INFO:teuthology.orchestra.run.trial005.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T21:16:40.778 INFO:teuthology.orchestra.run.trial005.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T21:16:40.785 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T21:16:40.788 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T21:16:40.794 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T21:16:40.797 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T21:16:40.804 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T21:16:40.808 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T21:16:40.817 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:16:40.835 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T21:16:40.845 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T21:16:40.869 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:16:40.880 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T21:16:40.881 INFO:teuthology.orchestra.run.trial176.stdout:Package cephadm-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T21:16:40.899 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:40.899 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T21:16:40.900 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:16:40.919 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:40.921 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T21:16:40.951 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:40.952 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:40.952 INFO:teuthology.orchestra.run.trial119.stdout: Package Architecture Version Repository Size 2026-02-17T21:16:40.952 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:40.952 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:16:40.953 INFO:teuthology.orchestra.run.trial119.stdout: ceph-fuse x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.2 M 2026-02-17T21:16:40.953 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:40.953 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:16:40.953 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:40.953 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:16:40.953 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:40.953 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 1.2 M 2026-02-17T21:16:40.953 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 3.6 M 2026-02-17T21:16:40.953 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:16:40.983 INFO:teuthology.orchestra.run.trial135.stdout:Package ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T21:16:41.001 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:41.002 INFO:teuthology.orchestra.run.trial135.stdout:Nothing to do. 2026-02-17T21:16:41.002 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:41.023 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install librados-devel 2026-02-17T21:16:41.070 INFO:teuthology.orchestra.run.trial119.stdout:ceph-fuse-19.2.3-679.gd855f53b.el9.x86_64.rpm 9.8 MB/s | 1.2 MB 00:00 2026-02-17T21:16:41.071 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:41.071 INFO:teuthology.orchestra.run.trial119.stdout:Total 9.7 MB/s | 1.2 MB 00:00 2026-02-17T21:16:41.071 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:16:41.074 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:16:41.074 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:16:41.104 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T21:16:41.109 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:16:41.109 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:16:41.128 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T21:16:41.131 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T21:16:41.190 INFO:teuthology.orchestra.run.trial005.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T21:16:41.191 INFO:teuthology.orchestra.run.trial005.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T21:16:41.211 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:16:41.212 INFO:teuthology.orchestra.run.trial005.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T21:16:41.228 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:41.235 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:16:41.317 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:41.318 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:41.318 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T21:16:41.318 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:41.318 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:16:41.318 INFO:teuthology.orchestra.run.trial176.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-679.gd855f53b.el9 ceph 145 k 2026-02-17T21:16:41.318 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:41.318 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:16:41.318 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:41.318 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:16:41.318 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:41.318 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 145 k 2026-02-17T21:16:41.319 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 431 k 2026-02-17T21:16:41.319 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:16:41.334 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:41.404 INFO:teuthology.orchestra.run.trial176.stdout:ceph-immutable-object-cache-19.2.3-679.gd855f53 1.7 MB/s | 145 kB 00:00 2026-02-17T21:16:41.404 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:41.404 INFO:teuthology.orchestra.run.trial176.stdout:Total 1.7 MB/s | 145 kB 00:00 2026-02-17T21:16:41.404 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:16:41.407 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:16:41.407 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:16:41.419 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:41.419 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:41.419 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repo Size 2026-02-17T21:16:41.419 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:41.419 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:16:41.419 INFO:teuthology.orchestra.run.trial135.stdout: librados-devel x86_64 2:19.2.3-679.gd855f53b.el9 ceph 126 k 2026-02-17T21:16:41.420 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:41.420 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:16:41.420 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:41.420 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:16:41.420 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:41.420 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 126 k 2026-02-17T21:16:41.420 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 456 k 2026-02-17T21:16:41.420 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:16:41.439 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:16:41.439 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:16:41.467 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:41.494 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:16:41.495 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.e 1/1 2026-02-17T21:16:41.505 INFO:teuthology.orchestra.run.trial135.stdout:librados-devel-19.2.3-679.gd855f53b.el9.x86_64. 1.5 MB/s | 126 kB 00:00 2026-02-17T21:16:41.505 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:41.505 INFO:teuthology.orchestra.run.trial135.stdout:Total 1.4 MB/s | 126 kB 00:00 2026-02-17T21:16:41.505 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:16:41.508 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:16:41.508 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:16:41.516 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.e 1/1 2026-02-17T21:16:41.516 INFO:teuthology.orchestra.run.trial176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:41.516 INFO:teuthology.orchestra.run.trial176.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T21:16:41.517 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:41.524 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:41.524 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:41.524 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:16:41.524 INFO:teuthology.orchestra.run.trial119.stdout: ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:41.524 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:41.524 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:16:41.538 INFO:teuthology.orchestra.run.trial005.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T21:16:41.538 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:16:41.538 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:16:41.553 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-volume 2026-02-17T21:16:41.593 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:16:41.609 INFO:teuthology.orchestra.run.trial135.stdout: Installing : librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:41.611 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T21:16:41.692 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:41.748 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:41.749 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:41.749 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:16:41.749 INFO:teuthology.orchestra.run.trial135.stdout: librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:41.749 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:41.749 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:41.777 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install libcephfs2 2026-02-17T21:16:41.801 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.e 1/1 2026-02-17T21:16:41.801 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:41.801 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:16:41.801 INFO:teuthology.orchestra.run.trial176.stdout: ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:41.801 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:41.801 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:16:41.830 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-mgr 2026-02-17T21:16:41.866 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:16:41.930 INFO:teuthology.orchestra.run.trial119.stdout:Package ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T21:16:41.948 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:41.948 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-17T21:16:41.949 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:16:41.970 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install librados-devel 2026-02-17T21:16:42.103 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:42.140 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:16:42.168 INFO:teuthology.orchestra.run.trial135.stdout:Package libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:42.186 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:42.187 INFO:teuthology.orchestra.run.trial135.stdout:Nothing to do. 2026-02-17T21:16:42.187 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:42.204 INFO:teuthology.orchestra.run.trial176.stdout:Package ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:42.208 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install libcephfs-devel 2026-02-17T21:16:42.222 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:42.222 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T21:16:42.222 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:16:42.244 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T21:16:42.280 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:16:42.283 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T21:16:42.300 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T21:16:42.310 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T21:16:42.316 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T21:16:42.330 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T21:16:42.346 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T21:16:42.362 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:42.362 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:42.362 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-17T21:16:42.362 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:42.363 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:16:42.363 INFO:teuthology.orchestra.run.trial119.stdout: librados-devel x86_64 2:19.2.3-679.gd855f53b.el9 ceph 126 k 2026-02-17T21:16:42.363 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:42.363 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:16:42.363 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:42.363 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:16:42.363 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:42.363 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 126 k 2026-02-17T21:16:42.363 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 456 k 2026-02-17T21:16:42.363 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:16:42.421 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T21:16:42.430 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T21:16:42.449 INFO:teuthology.orchestra.run.trial119.stdout:librados-devel-19.2.3-679.gd855f53b.el9.x86_64. 1.4 MB/s | 126 kB 00:00 2026-02-17T21:16:42.450 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:42.450 INFO:teuthology.orchestra.run.trial119.stdout:Total 1.4 MB/s | 126 kB 00:00 2026-02-17T21:16:42.450 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:16:42.452 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:16:42.452 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:16:42.453 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T21:16:42.483 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T21:16:42.483 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:16:42.483 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:16:42.523 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:42.533 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T21:16:42.537 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:16:42.539 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T21:16:42.543 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T21:16:42.544 INFO:teuthology.orchestra.run.trial005.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T21:16:42.549 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:16:42.554 INFO:teuthology.orchestra.run.trial119.stdout: Installing : librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:42.562 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T21:16:42.562 INFO:teuthology.orchestra.run.trial005.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T21:16:42.562 INFO:teuthology.orchestra.run.trial005.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T21:16:42.563 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:42.570 INFO:teuthology.orchestra.run.trial005.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T21:16:42.597 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T21:16:42.597 INFO:teuthology.orchestra.run.trial005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T21:16:42.597 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:42.606 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:42.606 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:42.607 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repo Size 2026-02-17T21:16:42.607 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:42.607 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:16:42.607 INFO:teuthology.orchestra.run.trial135.stdout: libcephfs-devel x86_64 2:19.2.3-679.gd855f53b.el9 ceph 34 k 2026-02-17T21:16:42.607 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:42.607 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:16:42.607 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:42.607 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:16:42.607 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:42.607 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 34 k 2026-02-17T21:16:42.608 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 153 k 2026-02-17T21:16:42.608 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:16:42.612 INFO:teuthology.orchestra.run.trial176.stdout:Package ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T21:16:42.630 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:42.630 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T21:16:42.630 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:16:42.633 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:42.634 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T21:16:42.650 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T21:16:42.670 INFO:teuthology.orchestra.run.trial135.stdout:libcephfs-devel-19.2.3-679.gd855f53b.el9.x86_64 535 kB/s | 34 kB 00:00 2026-02-17T21:16:42.670 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:42.670 INFO:teuthology.orchestra.run.trial135.stdout:Total 527 kB/s | 34 kB 00:00 2026-02-17T21:16:42.671 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:16:42.673 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:16:42.673 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:16:42.675 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:16:42.675 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:16:42.690 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:42.690 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:42.690 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:16:42.690 INFO:teuthology.orchestra.run.trial119.stdout: librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:42.690 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:42.690 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:16:42.695 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:16:42.699 INFO:teuthology.orchestra.run.trial005.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T21:16:42.701 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 85/99 2026-02-17T21:16:42.712 INFO:teuthology.orchestra.run.trial135.stdout: Installing : libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:42.715 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 85/99 2026-02-17T21:16:42.715 INFO:teuthology.orchestra.run.trial005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:42.715 INFO:teuthology.orchestra.run.trial005.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T21:16:42.715 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:42.718 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install libcephfs2 2026-02-17T21:16:42.770 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:42.827 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:42.827 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:42.827 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:16:42.827 INFO:teuthology.orchestra.run.trial135.stdout: libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:42.827 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:42.827 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:42.855 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install librados2 2026-02-17T21:16:42.954 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:16:43.017 INFO:teuthology.orchestra.run.trial176.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T21:16:43.035 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:43.035 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:16:43.035 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T21:16:43.035 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:16:43.056 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-mgr-rook 2026-02-17T21:16:43.101 INFO:teuthology.orchestra.run.trial119.stdout:Package libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:43.118 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:43.119 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-17T21:16:43.119 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:16:43.141 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install libcephfs-devel 2026-02-17T21:16:43.165 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:43.229 INFO:teuthology.orchestra.run.trial135.stdout:Package librados2-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:43.247 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:43.247 INFO:teuthology.orchestra.run.trial135.stdout:Nothing to do. 2026-02-17T21:16:43.247 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:43.268 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install librbd1 2026-02-17T21:16:43.362 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:16:43.414 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 86/99 2026-02-17T21:16:43.425 INFO:teuthology.orchestra.run.trial176.stdout:Package ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T21:16:43.439 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 86/99 2026-02-17T21:16:43.439 INFO:teuthology.orchestra.run.trial005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:43.439 INFO:teuthology.orchestra.run.trial005.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T21:16:43.440 INFO:teuthology.orchestra.run.trial005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T21:16:43.440 INFO:teuthology.orchestra.run.trial005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T21:16:43.440 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:43.443 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:43.444 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T21:16:43.444 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:16:43.453 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:16:43.464 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T21:16:43.500 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: cephadm-2:19.2.3-679.gd855f53b.el9.noarch 87/99 2026-02-17T21:16:43.502 INFO:teuthology.orchestra.run.trial005.stdout: Installing : cephadm-2:19.2.3-679.gd855f53b.el9.noarch 87/99 2026-02-17T21:16:43.507 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-679.gd855f53b.el9. 88/99 2026-02-17T21:16:43.526 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-679.gd855f53b.el9 89/99 2026-02-17T21:16:43.527 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 90/99 2026-02-17T21:16:43.535 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:43.536 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:43.536 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-17T21:16:43.536 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:43.537 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:16:43.537 INFO:teuthology.orchestra.run.trial119.stdout: libcephfs-devel x86_64 2:19.2.3-679.gd855f53b.el9 ceph 34 k 2026-02-17T21:16:43.537 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:43.537 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:16:43.537 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:43.537 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:16:43.537 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:43.537 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 34 k 2026-02-17T21:16:43.537 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 153 k 2026-02-17T21:16:43.537 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:16:43.574 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:43.600 INFO:teuthology.orchestra.run.trial119.stdout:libcephfs-devel-19.2.3-679.gd855f53b.el9.x86_64 530 kB/s | 34 kB 00:00 2026-02-17T21:16:43.600 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:43.601 INFO:teuthology.orchestra.run.trial119.stdout:Total 523 kB/s | 34 kB 00:00 2026-02-17T21:16:43.601 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:16:43.602 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:16:43.602 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:16:43.604 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:16:43.604 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:16:43.625 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:16:43.638 INFO:teuthology.orchestra.run.trial135.stdout:Package librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:43.642 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:43.655 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:43.656 INFO:teuthology.orchestra.run.trial135.stdout:Nothing to do. 2026-02-17T21:16:43.656 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:43.676 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install python3-rados 2026-02-17T21:16:43.701 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:43.757 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:43.757 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:43.757 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:16:43.757 INFO:teuthology.orchestra.run.trial119.stdout: libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:43.758 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:43.758 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:16:43.769 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:16:43.784 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install librados2 2026-02-17T21:16:43.832 INFO:teuthology.orchestra.run.trial176.stdout:Package ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T21:16:43.850 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:43.850 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T21:16:43.851 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:16:43.871 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-fuse 2026-02-17T21:16:43.989 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:44.017 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 90/99 2026-02-17T21:16:44.020 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noar 91/99 2026-02-17T21:16:44.053 INFO:teuthology.orchestra.run.trial135.stdout:Package python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:44.071 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:44.071 INFO:teuthology.orchestra.run.trial135.stdout:Nothing to do. 2026-02-17T21:16:44.072 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:44.090 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:16:44.093 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install python3-rgw 2026-02-17T21:16:44.154 INFO:teuthology.orchestra.run.trial119.stdout:Package librados2-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:44.172 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:44.172 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-17T21:16:44.172 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:16:44.180 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:16:44.194 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install librbd1 2026-02-17T21:16:44.262 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:44.262 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:44.262 INFO:teuthology.orchestra.run.trial176.stdout: Package Architecture Version Repository Size 2026-02-17T21:16:44.263 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:44.263 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:16:44.263 INFO:teuthology.orchestra.run.trial176.stdout: ceph-fuse x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.2 M 2026-02-17T21:16:44.263 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:44.263 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:16:44.263 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:44.263 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:16:44.263 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:44.263 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 1.2 M 2026-02-17T21:16:44.263 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 3.6 M 2026-02-17T21:16:44.263 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:16:44.381 INFO:teuthology.orchestra.run.trial176.stdout:ceph-fuse-19.2.3-679.gd855f53b.el9.x86_64.rpm 9.7 MB/s | 1.2 MB 00:00 2026-02-17T21:16:44.382 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:44.382 INFO:teuthology.orchestra.run.trial176.stdout:Total 9.6 MB/s | 1.2 MB 00:00 2026-02-17T21:16:44.382 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:16:44.386 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:16:44.386 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:16:44.400 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:44.421 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:16:44.421 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:16:44.467 INFO:teuthology.orchestra.run.trial135.stdout:Package python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:44.471 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noar 91/99 2026-02-17T21:16:44.472 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f5 92/99 2026-02-17T21:16:44.485 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:44.485 INFO:teuthology.orchestra.run.trial135.stdout:Nothing to do. 2026-02-17T21:16:44.485 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:44.486 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f5 92/99 2026-02-17T21:16:44.486 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noar 93/99 2026-02-17T21:16:44.501 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:16:44.506 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install python3-cephfs 2026-02-17T21:16:44.522 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:16:44.539 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:44.541 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noar 93/99 2026-02-17T21:16:44.567 INFO:teuthology.orchestra.run.trial119.stdout:Package librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:44.584 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:44.585 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-17T21:16:44.585 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:16:44.590 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-679.gd855f53b.el9.n 94/99 2026-02-17T21:16:44.591 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 95/99 2026-02-17T21:16:44.606 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install python3-rados 2026-02-17T21:16:44.613 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 95/99 2026-02-17T21:16:44.613 INFO:teuthology.orchestra.run.trial005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:44.613 INFO:teuthology.orchestra.run.trial005.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T21:16:44.613 INFO:teuthology.orchestra.run.trial005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T21:16:44.613 INFO:teuthology.orchestra.run.trial005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T21:16:44.613 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:44.624 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 96/99 2026-02-17T21:16:44.776 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:44.817 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:44.831 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:44.832 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:44.832 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:16:44.832 INFO:teuthology.orchestra.run.trial176.stdout: ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:44.832 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:44.832 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:16:44.841 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 96/99 2026-02-17T21:16:44.843 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 97/99 2026-02-17T21:16:44.858 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-volume 2026-02-17T21:16:44.865 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 97/99 2026-02-17T21:16:44.865 INFO:teuthology.orchestra.run.trial005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:44.865 INFO:teuthology.orchestra.run.trial005.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T21:16:44.865 INFO:teuthology.orchestra.run.trial005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T21:16:44.865 INFO:teuthology.orchestra.run.trial005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T21:16:44.865 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:44.881 INFO:teuthology.orchestra.run.trial135.stdout:Package python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:44.898 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:44.899 INFO:teuthology.orchestra.run.trial135.stdout:Nothing to do. 2026-02-17T21:16:44.899 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:44.918 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:16:44.921 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install python3-rbd 2026-02-17T21:16:44.966 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 98/99 2026-02-17T21:16:44.983 INFO:teuthology.orchestra.run.trial119.stdout:Package python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:44.987 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 98/99 2026-02-17T21:16:44.987 INFO:teuthology.orchestra.run.trial005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:44.987 INFO:teuthology.orchestra.run.trial005.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T21:16:44.987 INFO:teuthology.orchestra.run.trial005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T21:16:44.987 INFO:teuthology.orchestra.run.trial005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T21:16:44.987 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:45.001 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:45.002 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-17T21:16:45.002 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:16:45.005 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-2:19.2.3-679.gd855f53b.el9.x86_64 99/99 2026-02-17T21:16:45.024 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install python3-rgw 2026-02-17T21:16:45.166 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:16:45.229 INFO:teuthology.orchestra.run.trial176.stdout:Package ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T21:16:45.237 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:45.247 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:45.248 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T21:16:45.248 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:16:45.268 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install librados-devel 2026-02-17T21:16:45.301 INFO:teuthology.orchestra.run.trial135.stdout:Package python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:45.319 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:45.320 INFO:teuthology.orchestra.run.trial135.stdout:Nothing to do. 2026-02-17T21:16:45.320 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:45.334 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:16:45.341 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install rbd-fuse 2026-02-17T21:16:45.398 INFO:teuthology.orchestra.run.trial119.stdout:Package python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:45.416 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:45.416 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-17T21:16:45.416 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:16:45.438 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install python3-cephfs 2026-02-17T21:16:45.571 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:16:45.645 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-2:19.2.3-679.gd855f53b.el9.x86_64 99/99 2026-02-17T21:16:45.645 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-2:19.2.3-679.gd855f53b.el9.x86_64 1/99 2026-02-17T21:16:45.645 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 2/99 2026-02-17T21:16:45.645 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 3/99 2026-02-17T21:16:45.645 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 4/99 2026-02-17T21:16:45.645 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 5/99 2026-02-17T21:16:45.645 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-679.gd855f53b.el9 6/99 2026-02-17T21:16:45.645 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 7/99 2026-02-17T21:16:45.645 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noar 8/99 2026-02-17T21:16:45.645 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f5 9/99 2026-02-17T21:16:45.645 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noar 10/99 2026-02-17T21:16:45.646 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-679.gd855f53b.el9.n 11/99 2026-02-17T21:16:45.646 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 12/99 2026-02-17T21:16:45.646 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-679.gd855f53b.el9. 13/99 2026-02-17T21:16:45.646 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 14/99 2026-02-17T21:16:45.646 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : cephadm-2:19.2.3-679.gd855f53b.el9.noarch 15/99 2026-02-17T21:16:45.646 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T21:16:45.646 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T21:16:45.646 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T21:16:45.646 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T21:16:45.646 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T21:16:45.646 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T21:16:45.646 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T21:16:45.646 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T21:16:45.646 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T21:16:45.646 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T21:16:45.646 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T21:16:45.646 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T21:16:45.646 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T21:16:45.646 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T21:16:45.647 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T21:16:45.647 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T21:16:45.647 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T21:16:45.647 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T21:16:45.647 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T21:16:45.647 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T21:16:45.647 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T21:16:45.647 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T21:16:45.647 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T21:16:45.647 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T21:16:45.647 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T21:16:45.647 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T21:16:45.647 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T21:16:45.647 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T21:16:45.647 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T21:16:45.647 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T21:16:45.647 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T21:16:45.647 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T21:16:45.647 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T21:16:45.647 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T21:16:45.647 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T21:16:45.647 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T21:16:45.648 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T21:16:45.648 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T21:16:45.648 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T21:16:45.648 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T21:16:45.648 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T21:16:45.648 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T21:16:45.648 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T21:16:45.648 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T21:16:45.648 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T21:16:45.648 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T21:16:45.648 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T21:16:45.648 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T21:16:45.648 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T21:16:45.648 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T21:16:45.648 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T21:16:45.648 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T21:16:45.648 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T21:16:45.648 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T21:16:45.648 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T21:16:45.648 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T21:16:45.648 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T21:16:45.648 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T21:16:45.648 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T21:16:45.649 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T21:16:45.649 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T21:16:45.649 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T21:16:45.649 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T21:16:45.649 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T21:16:45.649 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T21:16:45.649 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T21:16:45.649 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T21:16:45.649 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T21:16:45.649 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T21:16:45.649 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T21:16:45.649 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T21:16:45.649 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T21:16:45.649 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T21:16:45.649 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T21:16:45.649 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T21:16:45.649 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T21:16:45.649 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T21:16:45.649 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T21:16:45.649 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T21:16:45.649 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T21:16:45.649 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T21:16:45.649 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T21:16:45.650 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T21:16:45.650 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:45.652 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:45.652 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:45.653 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T21:16:45.653 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:45.653 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:16:45.653 INFO:teuthology.orchestra.run.trial176.stdout: librados-devel x86_64 2:19.2.3-679.gd855f53b.el9 ceph 126 k 2026-02-17T21:16:45.653 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:45.653 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:16:45.653 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:45.653 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:16:45.653 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:45.654 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 126 k 2026-02-17T21:16:45.654 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 456 k 2026-02-17T21:16:45.654 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:16:45.710 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T21:16:45.710 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:45.710 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:16:45.710 INFO:teuthology.orchestra.run.trial005.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T21:16:45.710 INFO:teuthology.orchestra.run.trial005.stdout: ceph-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:45.710 INFO:teuthology.orchestra.run.trial005.stdout: ceph-grafana-dashboards-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:45.710 INFO:teuthology.orchestra.run.trial005.stdout: ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:45.710 INFO:teuthology.orchestra.run.trial005.stdout: ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:45.710 INFO:teuthology.orchestra.run.trial005.stdout: ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:45.710 INFO:teuthology.orchestra.run.trial005.stdout: ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:45.710 INFO:teuthology.orchestra.run.trial005.stdout: ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:45.710 INFO:teuthology.orchestra.run.trial005.stdout: ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:45.710 INFO:teuthology.orchestra.run.trial005.stdout: ceph-mgr-modules-core-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:45.710 INFO:teuthology.orchestra.run.trial005.stdout: ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:45.711 INFO:teuthology.orchestra.run.trial005.stdout: ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:45.711 INFO:teuthology.orchestra.run.trial005.stdout: ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:45.711 INFO:teuthology.orchestra.run.trial005.stdout: ceph-prometheus-alerts-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:45.711 INFO:teuthology.orchestra.run.trial005.stdout: ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:45.711 INFO:teuthology.orchestra.run.trial005.stdout: cephadm-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T21:16:45.711 INFO:teuthology.orchestra.run.trial005.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T21:16:45.711 INFO:teuthology.orchestra.run.trial005.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T21:16:45.711 INFO:teuthology.orchestra.run.trial005.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T21:16:45.711 INFO:teuthology.orchestra.run.trial005.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T21:16:45.711 INFO:teuthology.orchestra.run.trial005.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T21:16:45.711 INFO:teuthology.orchestra.run.trial005.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T21:16:45.711 INFO:teuthology.orchestra.run.trial005.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T21:16:45.711 INFO:teuthology.orchestra.run.trial005.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T21:16:45.711 INFO:teuthology.orchestra.run.trial005.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T21:16:45.711 INFO:teuthology.orchestra.run.trial005.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T21:16:45.711 INFO:teuthology.orchestra.run.trial005.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T21:16:45.711 INFO:teuthology.orchestra.run.trial005.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T21:16:45.712 INFO:teuthology.orchestra.run.trial005.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T21:16:45.712 INFO:teuthology.orchestra.run.trial005.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T21:16:45.712 INFO:teuthology.orchestra.run.trial005.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T21:16:45.712 INFO:teuthology.orchestra.run.trial005.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T21:16:45.712 INFO:teuthology.orchestra.run.trial005.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T21:16:45.712 INFO:teuthology.orchestra.run.trial005.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T21:16:45.712 INFO:teuthology.orchestra.run.trial005.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T21:16:45.712 INFO:teuthology.orchestra.run.trial005.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T21:16:45.712 INFO:teuthology.orchestra.run.trial005.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T21:16:45.712 INFO:teuthology.orchestra.run.trial005.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T21:16:45.712 INFO:teuthology.orchestra.run.trial005.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T21:16:45.712 INFO:teuthology.orchestra.run.trial005.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T21:16:45.712 INFO:teuthology.orchestra.run.trial005.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T21:16:45.712 INFO:teuthology.orchestra.run.trial005.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T21:16:45.712 INFO:teuthology.orchestra.run.trial005.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T21:16:45.712 INFO:teuthology.orchestra.run.trial005.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T21:16:45.712 INFO:teuthology.orchestra.run.trial005.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T21:16:45.712 INFO:teuthology.orchestra.run.trial005.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T21:16:45.712 INFO:teuthology.orchestra.run.trial005.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T21:16:45.712 INFO:teuthology.orchestra.run.trial005.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T21:16:45.712 INFO:teuthology.orchestra.run.trial005.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T21:16:45.713 INFO:teuthology.orchestra.run.trial005.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T21:16:45.713 INFO:teuthology.orchestra.run.trial005.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T21:16:45.713 INFO:teuthology.orchestra.run.trial005.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T21:16:45.713 INFO:teuthology.orchestra.run.trial005.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T21:16:45.713 INFO:teuthology.orchestra.run.trial005.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T21:16:45.713 INFO:teuthology.orchestra.run.trial005.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T21:16:45.713 INFO:teuthology.orchestra.run.trial005.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T21:16:45.713 INFO:teuthology.orchestra.run.trial005.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T21:16:45.713 INFO:teuthology.orchestra.run.trial005.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T21:16:45.713 INFO:teuthology.orchestra.run.trial005.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T21:16:45.713 INFO:teuthology.orchestra.run.trial005.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T21:16:45.713 INFO:teuthology.orchestra.run.trial005.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T21:16:45.713 INFO:teuthology.orchestra.run.trial005.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T21:16:45.713 INFO:teuthology.orchestra.run.trial005.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T21:16:45.713 INFO:teuthology.orchestra.run.trial005.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T21:16:45.713 INFO:teuthology.orchestra.run.trial005.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T21:16:45.713 INFO:teuthology.orchestra.run.trial005.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T21:16:45.713 INFO:teuthology.orchestra.run.trial005.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T21:16:45.713 INFO:teuthology.orchestra.run.trial005.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T21:16:45.713 INFO:teuthology.orchestra.run.trial005.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T21:16:45.713 INFO:teuthology.orchestra.run.trial005.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T21:16:45.713 INFO:teuthology.orchestra.run.trial005.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T21:16:45.714 INFO:teuthology.orchestra.run.trial005.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T21:16:45.714 INFO:teuthology.orchestra.run.trial005.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T21:16:45.714 INFO:teuthology.orchestra.run.trial005.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T21:16:45.714 INFO:teuthology.orchestra.run.trial005.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T21:16:45.714 INFO:teuthology.orchestra.run.trial005.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T21:16:45.714 INFO:teuthology.orchestra.run.trial005.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T21:16:45.714 INFO:teuthology.orchestra.run.trial005.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T21:16:45.714 INFO:teuthology.orchestra.run.trial005.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T21:16:45.714 INFO:teuthology.orchestra.run.trial005.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T21:16:45.714 INFO:teuthology.orchestra.run.trial005.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T21:16:45.714 INFO:teuthology.orchestra.run.trial005.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T21:16:45.714 INFO:teuthology.orchestra.run.trial005.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T21:16:45.714 INFO:teuthology.orchestra.run.trial005.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T21:16:45.714 INFO:teuthology.orchestra.run.trial005.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T21:16:45.714 INFO:teuthology.orchestra.run.trial005.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T21:16:45.714 INFO:teuthology.orchestra.run.trial005.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T21:16:45.714 INFO:teuthology.orchestra.run.trial005.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T21:16:45.714 INFO:teuthology.orchestra.run.trial005.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T21:16:45.714 INFO:teuthology.orchestra.run.trial005.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T21:16:45.714 INFO:teuthology.orchestra.run.trial005.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T21:16:45.714 INFO:teuthology.orchestra.run.trial005.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T21:16:45.714 INFO:teuthology.orchestra.run.trial005.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T21:16:45.714 INFO:teuthology.orchestra.run.trial005.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T21:16:45.715 INFO:teuthology.orchestra.run.trial005.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T21:16:45.715 INFO:teuthology.orchestra.run.trial005.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T21:16:45.715 INFO:teuthology.orchestra.run.trial005.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T21:16:45.715 INFO:teuthology.orchestra.run.trial005.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T21:16:45.715 INFO:teuthology.orchestra.run.trial005.stdout: zip-3.0-35.el9.x86_64 2026-02-17T21:16:45.715 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:45.715 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:16:45.730 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:45.731 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:45.731 INFO:teuthology.orchestra.run.trial135.stdout: Package Architecture Version Repository Size 2026-02-17T21:16:45.731 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:45.731 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:16:45.731 INFO:teuthology.orchestra.run.trial135.stdout: rbd-fuse x86_64 2:19.2.3-679.gd855f53b.el9 ceph 85 k 2026-02-17T21:16:45.731 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:45.731 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:16:45.731 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:45.731 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:16:45.731 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:45.731 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 85 k 2026-02-17T21:16:45.732 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 227 k 2026-02-17T21:16:45.732 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:16:45.737 INFO:teuthology.orchestra.run.trial176.stdout:librados-devel-19.2.3-679.gd855f53b.el9.x86_64. 1.5 MB/s | 126 kB 00:00 2026-02-17T21:16:45.737 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:45.737 INFO:teuthology.orchestra.run.trial176.stdout:Total 1.5 MB/s | 126 kB 00:00 2026-02-17T21:16:45.737 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:16:45.740 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:16:45.741 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:16:45.750 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:16:45.763 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install ceph-base 2026-02-17T21:16:45.771 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:16:45.771 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:16:45.804 INFO:teuthology.orchestra.run.trial135.stdout:rbd-fuse-19.2.3-679.gd855f53b.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-17T21:16:45.804 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:45.804 INFO:teuthology.orchestra.run.trial135.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-17T21:16:45.804 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:16:45.807 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:16:45.808 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:16:45.816 INFO:teuthology.orchestra.run.trial119.stdout:Package python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:45.825 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:16:45.833 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:45.834 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-17T21:16:45.834 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:16:45.838 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:16:45.838 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:16:45.841 INFO:teuthology.orchestra.run.trial176.stdout: Installing : librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:45.855 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install python3-rbd 2026-02-17T21:16:45.889 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:16:45.906 INFO:teuthology.orchestra.run.trial135.stdout: Installing : rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:45.918 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:45.977 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:45.977 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:45.977 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:16:45.977 INFO:teuthology.orchestra.run.trial176.stdout: librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:45.978 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:45.978 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:16:45.985 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:46.004 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install libcephfs2 2026-02-17T21:16:46.043 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:46.043 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:46.043 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:16:46.043 INFO:teuthology.orchestra.run.trial135.stdout: rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:46.043 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:46.043 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:46.070 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install rbd-mirror 2026-02-17T21:16:46.071 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:16:46.135 INFO:teuthology.orchestra.run.trial005.stdout:Package ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:46.152 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:46.152 INFO:teuthology.orchestra.run.trial005.stdout:Nothing to do. 2026-02-17T21:16:46.152 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:16:46.170 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:16:46.173 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install cephadm 2026-02-17T21:16:46.236 INFO:teuthology.orchestra.run.trial119.stdout:Package python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:46.254 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:46.255 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-17T21:16:46.255 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:16:46.277 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install rbd-fuse 2026-02-17T21:16:46.314 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:16:46.378 INFO:teuthology.orchestra.run.trial176.stdout:Package libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:46.382 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:46.395 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:46.396 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T21:16:46.396 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:16:46.417 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install libcephfs-devel 2026-02-17T21:16:46.465 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:46.466 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:46.466 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repo Size 2026-02-17T21:16:46.466 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:46.466 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:16:46.467 INFO:teuthology.orchestra.run.trial135.stdout: rbd-mirror x86_64 2:19.2.3-679.gd855f53b.el9 ceph 3.1 M 2026-02-17T21:16:46.467 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:46.467 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:16:46.467 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:46.467 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:16:46.467 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:46.467 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 3.1 M 2026-02-17T21:16:46.467 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 13 M 2026-02-17T21:16:46.467 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:16:46.480 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:16:46.544 INFO:teuthology.orchestra.run.trial005.stdout:Package cephadm-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T21:16:46.561 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:46.562 INFO:teuthology.orchestra.run.trial005.stdout:Nothing to do. 2026-02-17T21:16:46.562 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:16:46.583 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T21:16:46.592 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:16:46.616 INFO:teuthology.orchestra.run.trial135.stdout:rbd-mirror-19.2.3-679.gd855f53b.el9.x86_64.rpm 21 MB/s | 3.1 MB 00:00 2026-02-17T21:16:46.616 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:46.617 INFO:teuthology.orchestra.run.trial135.stdout:Total 21 MB/s | 3.1 MB 00:00 2026-02-17T21:16:46.617 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:16:46.621 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:16:46.621 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:16:46.660 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:16:46.660 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:16:46.674 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:46.675 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:46.675 INFO:teuthology.orchestra.run.trial119.stdout: Package Architecture Version Repository Size 2026-02-17T21:16:46.675 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:46.676 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:16:46.676 INFO:teuthology.orchestra.run.trial119.stdout: rbd-fuse x86_64 2:19.2.3-679.gd855f53b.el9 ceph 85 k 2026-02-17T21:16:46.676 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:46.676 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:16:46.676 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:46.676 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:16:46.676 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:46.676 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 85 k 2026-02-17T21:16:46.676 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 227 k 2026-02-17T21:16:46.677 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:16:46.726 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:16:46.749 INFO:teuthology.orchestra.run.trial119.stdout:rbd-fuse-19.2.3-679.gd855f53b.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-17T21:16:46.750 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:46.750 INFO:teuthology.orchestra.run.trial119.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-17T21:16:46.750 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:16:46.753 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:16:46.753 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:16:46.784 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:16:46.784 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:16:46.809 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:46.810 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:46.810 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T21:16:46.810 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:46.810 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:16:46.810 INFO:teuthology.orchestra.run.trial176.stdout: libcephfs-devel x86_64 2:19.2.3-679.gd855f53b.el9 ceph 34 k 2026-02-17T21:16:46.810 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:46.810 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:16:46.811 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:46.811 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:16:46.811 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:46.811 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 34 k 2026-02-17T21:16:46.811 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 153 k 2026-02-17T21:16:46.811 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:16:46.835 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:16:46.851 INFO:teuthology.orchestra.run.trial119.stdout: Installing : rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:46.852 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:16:46.854 INFO:teuthology.orchestra.run.trial135.stdout: Installing : rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:46.871 INFO:teuthology.orchestra.run.trial176.stdout:libcephfs-devel-19.2.3-679.gd855f53b.el9.x86_64 549 kB/s | 34 kB 00:00 2026-02-17T21:16:46.872 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:46.872 INFO:teuthology.orchestra.run.trial176.stdout:Total 543 kB/s | 34 kB 00:00 2026-02-17T21:16:46.872 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:16:46.873 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:16:46.873 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:16:46.875 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:16:46.875 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:16:46.876 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:46.877 INFO:teuthology.orchestra.run.trial135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:46.877 INFO:teuthology.orchestra.run.trial135.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T21:16:46.877 INFO:teuthology.orchestra.run.trial135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T21:16:46.877 INFO:teuthology.orchestra.run.trial135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T21:16:46.877 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:46.895 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:16:46.896 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:16:46.911 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:46.934 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:46.968 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:46.979 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:46.980 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:46.980 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repo Size 2026-02-17T21:16:46.980 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:46.981 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:16:46.981 INFO:teuthology.orchestra.run.trial005.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-679.gd855f53b.el9 ceph 145 k 2026-02-17T21:16:46.981 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:46.981 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:16:46.981 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:46.981 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:16:46.981 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:46.981 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 145 k 2026-02-17T21:16:46.981 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 431 k 2026-02-17T21:16:46.981 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:16:46.991 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:46.991 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:46.991 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:16:46.991 INFO:teuthology.orchestra.run.trial119.stdout: rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:46.991 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:46.991 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:16:47.020 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install rbd-mirror 2026-02-17T21:16:47.029 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:47.029 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:47.029 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:16:47.029 INFO:teuthology.orchestra.run.trial176.stdout: libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:47.030 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:47.030 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:16:47.056 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install librados2 2026-02-17T21:16:47.064 INFO:teuthology.orchestra.run.trial005.stdout:ceph-immutable-object-cache-19.2.3-679.gd855f53 1.7 MB/s | 145 kB 00:00 2026-02-17T21:16:47.065 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:47.065 INFO:teuthology.orchestra.run.trial005.stdout:Total 1.7 MB/s | 145 kB 00:00 2026-02-17T21:16:47.065 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:16:47.068 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:16:47.069 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:16:47.100 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:16:47.100 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:16:47.155 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:16:47.156 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.e 1/1 2026-02-17T21:16:47.179 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.e 1/1 2026-02-17T21:16:47.179 INFO:teuthology.orchestra.run.trial005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:47.179 INFO:teuthology.orchestra.run.trial005.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T21:16:47.179 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:47.192 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:47.192 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:47.192 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:16:47.192 INFO:teuthology.orchestra.run.trial135.stdout: rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:47.192 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:47.192 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:47.221 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install rbd-nbd 2026-02-17T21:16:47.343 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:16:47.362 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:16:47.425 INFO:teuthology.orchestra.run.trial176.stdout:Package librados2-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:47.425 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:47.426 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:47.426 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-17T21:16:47.427 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:47.427 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:16:47.427 INFO:teuthology.orchestra.run.trial119.stdout: rbd-mirror x86_64 2:19.2.3-679.gd855f53b.el9 ceph 3.1 M 2026-02-17T21:16:47.427 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:47.427 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:16:47.427 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:47.427 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:16:47.427 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:47.427 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 3.1 M 2026-02-17T21:16:47.427 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 13 M 2026-02-17T21:16:47.428 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:16:47.443 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:47.443 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T21:16:47.443 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:16:47.461 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.e 1/1 2026-02-17T21:16:47.461 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:47.462 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:16:47.462 INFO:teuthology.orchestra.run.trial005.stdout: ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:47.462 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:47.462 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:16:47.464 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install librbd1 2026-02-17T21:16:47.489 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install ceph-mgr 2026-02-17T21:16:47.531 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:47.574 INFO:teuthology.orchestra.run.trial119.stdout:rbd-mirror-19.2.3-679.gd855f53b.el9.x86_64.rpm 21 MB/s | 3.1 MB 00:00 2026-02-17T21:16:47.575 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:47.575 INFO:teuthology.orchestra.run.trial119.stdout:Total 21 MB/s | 3.1 MB 00:00 2026-02-17T21:16:47.575 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:16:47.579 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:16:47.579 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:16:47.614 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:47.615 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:47.615 INFO:teuthology.orchestra.run.trial135.stdout: Package Architecture Version Repository Size 2026-02-17T21:16:47.615 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:47.615 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:16:47.615 INFO:teuthology.orchestra.run.trial135.stdout: rbd-nbd x86_64 2:19.2.3-679.gd855f53b.el9 ceph 170 k 2026-02-17T21:16:47.615 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:47.616 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:16:47.616 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:47.616 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:16:47.616 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:47.616 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 170 k 2026-02-17T21:16:47.616 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 490 k 2026-02-17T21:16:47.616 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:16:47.618 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:16:47.618 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:16:47.700 INFO:teuthology.orchestra.run.trial135.stdout:rbd-nbd-19.2.3-679.gd855f53b.el9.x86_64.rpm 2.0 MB/s | 170 kB 00:00 2026-02-17T21:16:47.701 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:47.701 INFO:teuthology.orchestra.run.trial135.stdout:Total 1.9 MB/s | 170 kB 00:00 2026-02-17T21:16:47.701 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:16:47.704 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:16:47.704 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:16:47.736 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:16:47.737 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:16:47.768 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:16:47.792 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:16:47.805 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:16:47.809 INFO:teuthology.orchestra.run.trial135.stdout: Installing : rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:47.811 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:16:47.813 INFO:teuthology.orchestra.run.trial119.stdout: Installing : rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:47.832 INFO:teuthology.orchestra.run.trial176.stdout:Package librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:47.835 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:47.835 INFO:teuthology.orchestra.run.trial119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:47.835 INFO:teuthology.orchestra.run.trial119.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T21:16:47.835 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T21:16:47.835 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T21:16:47.835 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:47.849 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:47.850 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T21:16:47.850 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:16:47.869 INFO:teuthology.orchestra.run.trial005.stdout:Package ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:47.870 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install python3-rados 2026-02-17T21:16:47.886 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:47.887 INFO:teuthology.orchestra.run.trial005.stdout:Nothing to do. 2026-02-17T21:16:47.887 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:16:47.892 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:47.908 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T21:16:47.951 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:47.951 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:47.951 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:16:47.951 INFO:teuthology.orchestra.run.trial135.stdout: rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:47.952 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:47.952 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:47.981 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install ceph-base-debuginfo 2026-02-17T21:16:48.116 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:48.116 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:48.116 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:16:48.116 INFO:teuthology.orchestra.run.trial119.stdout: rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:48.117 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:48.117 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:16:48.145 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install rbd-nbd 2026-02-17T21:16:48.180 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:16:48.218 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:16:48.244 INFO:teuthology.orchestra.run.trial176.stdout:Package python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:48.262 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:48.263 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T21:16:48.263 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:16:48.280 INFO:teuthology.orchestra.run.trial005.stdout:Package ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T21:16:48.285 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install python3-rgw 2026-02-17T21:16:48.292 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:48.297 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:48.298 INFO:teuthology.orchestra.run.trial005.stdout:Nothing to do. 2026-02-17T21:16:48.298 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:16:48.321 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T21:16:48.374 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:48.374 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:48.375 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repo Size 2026-02-17T21:16:48.375 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:48.375 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:16:48.375 INFO:teuthology.orchestra.run.trial135.stdout: ceph-base-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 72 M 2026-02-17T21:16:48.375 INFO:teuthology.orchestra.run.trial135.stdout:Installing dependencies: 2026-02-17T21:16:48.375 INFO:teuthology.orchestra.run.trial135.stdout: ceph-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 24 M 2026-02-17T21:16:48.375 INFO:teuthology.orchestra.run.trial135.stdout:Installing weak dependencies: 2026-02-17T21:16:48.375 INFO:teuthology.orchestra.run.trial135.stdout: ceph-debugsource x86_64 2:19.2.3-679.gd855f53b.el9 ceph 11 M 2026-02-17T21:16:48.375 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:48.375 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:16:48.375 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:48.375 INFO:teuthology.orchestra.run.trial135.stdout:Install 3 Packages 2026-02-17T21:16:48.375 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:48.375 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 107 M 2026-02-17T21:16:48.375 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 654 M 2026-02-17T21:16:48.375 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:16:48.461 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:16:48.544 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:48.545 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:48.545 INFO:teuthology.orchestra.run.trial119.stdout: Package Architecture Version Repository Size 2026-02-17T21:16:48.545 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:48.545 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:16:48.545 INFO:teuthology.orchestra.run.trial119.stdout: rbd-nbd x86_64 2:19.2.3-679.gd855f53b.el9 ceph 170 k 2026-02-17T21:16:48.545 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:48.545 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:16:48.546 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:48.546 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:16:48.546 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:48.546 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 170 k 2026-02-17T21:16:48.546 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 490 k 2026-02-17T21:16:48.546 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:16:48.594 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:16:48.635 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:16:48.658 INFO:teuthology.orchestra.run.trial176.stdout:Package python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:48.676 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:48.676 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T21:16:48.676 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:16:48.697 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install python3-cephfs 2026-02-17T21:16:48.699 INFO:teuthology.orchestra.run.trial005.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T21:16:48.716 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:48.717 INFO:teuthology.orchestra.run.trial005.stdout:Nothing to do. 2026-02-17T21:16:48.717 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:16:48.739 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install ceph-mgr-rook 2026-02-17T21:16:49.000 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:16:49.047 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:16:49.063 INFO:teuthology.orchestra.run.trial176.stdout:Package python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:49.081 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:49.082 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T21:16:49.082 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:16:49.083 INFO:teuthology.orchestra.run.trial119.stdout:rbd-nbd-19.2.3-679.gd855f53b.el9.x86_64.rpm 316 kB/s | 170 kB 00:00 2026-02-17T21:16:49.083 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:49.083 INFO:teuthology.orchestra.run.trial119.stdout:Total 315 kB/s | 170 kB 00:00 2026-02-17T21:16:49.084 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:16:49.087 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:16:49.087 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:16:49.103 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install python3-rbd 2026-02-17T21:16:49.110 INFO:teuthology.orchestra.run.trial005.stdout:Package ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T21:16:49.120 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:16:49.120 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:16:49.127 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:49.128 INFO:teuthology.orchestra.run.trial005.stdout:Nothing to do. 2026-02-17T21:16:49.128 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:16:49.149 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T21:16:49.175 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:16:49.192 INFO:teuthology.orchestra.run.trial119.stdout: Installing : rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:49.201 INFO:teuthology.orchestra.run.trial135.stdout:(1/3): ceph-debugsource-19.2.3-679.gd855f53b.el 13 MB/s | 11 MB 00:00 2026-02-17T21:16:49.268 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:49.328 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:49.328 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:49.329 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:16:49.329 INFO:teuthology.orchestra.run.trial119.stdout: rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:49.329 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:49.329 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:16:49.357 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-base-debuginfo 2026-02-17T21:16:49.413 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:16:49.459 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:16:49.477 INFO:teuthology.orchestra.run.trial176.stdout:Package python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:49.495 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:49.495 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T21:16:49.496 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:16:49.517 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install rbd-fuse 2026-02-17T21:16:49.522 INFO:teuthology.orchestra.run.trial005.stdout:Package ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T21:16:49.539 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:49.540 INFO:teuthology.orchestra.run.trial005.stdout:Nothing to do. 2026-02-17T21:16:49.540 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:16:49.562 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install ceph-fuse 2026-02-17T21:16:49.611 INFO:teuthology.orchestra.run.trial135.stdout:(2/3): ceph-debuginfo-19.2.3-679.gd855f53b.el9. 20 MB/s | 24 MB 00:01 2026-02-17T21:16:49.673 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:16:49.756 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:16:49.756 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:49.756 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-17T21:16:49.756 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:49.756 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:16:49.756 INFO:teuthology.orchestra.run.trial119.stdout: ceph-base-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 72 M 2026-02-17T21:16:49.757 INFO:teuthology.orchestra.run.trial119.stdout:Installing dependencies: 2026-02-17T21:16:49.757 INFO:teuthology.orchestra.run.trial119.stdout: ceph-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 24 M 2026-02-17T21:16:49.757 INFO:teuthology.orchestra.run.trial119.stdout:Installing weak dependencies: 2026-02-17T21:16:49.757 INFO:teuthology.orchestra.run.trial119.stdout: ceph-debugsource x86_64 2:19.2.3-679.gd855f53b.el9 ceph 11 M 2026-02-17T21:16:49.757 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:49.757 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:16:49.757 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:16:49.757 INFO:teuthology.orchestra.run.trial119.stdout:Install 3 Packages 2026-02-17T21:16:49.757 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:16:49.757 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 107 M 2026-02-17T21:16:49.757 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 654 M 2026-02-17T21:16:49.758 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:16:49.822 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:16:49.876 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:16:49.903 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:49.904 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:49.904 INFO:teuthology.orchestra.run.trial176.stdout: Package Architecture Version Repository Size 2026-02-17T21:16:49.904 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:49.904 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:16:49.905 INFO:teuthology.orchestra.run.trial176.stdout: rbd-fuse x86_64 2:19.2.3-679.gd855f53b.el9 ceph 85 k 2026-02-17T21:16:49.905 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:49.905 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:16:49.905 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:49.905 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:16:49.905 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:49.905 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 85 k 2026-02-17T21:16:49.905 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 227 k 2026-02-17T21:16:49.905 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:16:49.958 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:49.959 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:49.959 INFO:teuthology.orchestra.run.trial005.stdout: Package Architecture Version Repository Size 2026-02-17T21:16:49.959 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:49.959 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:16:49.959 INFO:teuthology.orchestra.run.trial005.stdout: ceph-fuse x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.2 M 2026-02-17T21:16:49.959 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:49.959 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:16:49.959 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:49.959 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:16:49.959 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:49.959 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 1.2 M 2026-02-17T21:16:49.960 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 3.6 M 2026-02-17T21:16:49.960 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:16:50.102 INFO:teuthology.orchestra.run.trial176.stdout:rbd-fuse-19.2.3-679.gd855f53b.el9.x86_64.rpm 433 kB/s | 85 kB 00:00 2026-02-17T21:16:50.102 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:50.102 INFO:teuthology.orchestra.run.trial176.stdout:Total 431 kB/s | 85 kB 00:00 2026-02-17T21:16:50.102 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:16:50.106 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:16:50.106 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:16:50.137 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:16:50.137 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:16:50.188 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:16:50.205 INFO:teuthology.orchestra.run.trial176.stdout: Installing : rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:50.290 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:50.347 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:50.347 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:50.347 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:16:50.347 INFO:teuthology.orchestra.run.trial176.stdout: rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:50.347 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:50.347 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:16:50.366 INFO:teuthology.orchestra.run.trial005.stdout:ceph-fuse-19.2.3-679.gd855f53b.el9.x86_64.rpm 2.8 MB/s | 1.2 MB 00:00 2026-02-17T21:16:50.367 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:50.367 INFO:teuthology.orchestra.run.trial005.stdout:Total 2.8 MB/s | 1.2 MB 00:00 2026-02-17T21:16:50.367 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:16:50.371 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:16:50.378 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:16:50.379 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install rbd-mirror 2026-02-17T21:16:50.406 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:16:50.406 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:16:50.508 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:16:50.525 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:50.601 INFO:teuthology.orchestra.run.trial135.stdout:(3/3): ceph-base-debuginfo-19.2.3-679.gd855f53b 32 MB/s | 72 MB 00:02 2026-02-17T21:16:50.602 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:50.603 INFO:teuthology.orchestra.run.trial135.stdout:Total 48 MB/s | 107 MB 00:02 2026-02-17T21:16:50.603 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:16:50.608 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:16:50.608 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:16:50.688 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:16:50.746 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:50.770 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:50.771 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:50.771 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T21:16:50.771 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:50.771 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:16:50.771 INFO:teuthology.orchestra.run.trial176.stdout: rbd-mirror x86_64 2:19.2.3-679.gd855f53b.el9 ceph 3.1 M 2026-02-17T21:16:50.771 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:50.771 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:16:50.772 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:50.772 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:16:50.772 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:50.772 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 3.1 M 2026-02-17T21:16:50.772 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 13 M 2026-02-17T21:16:50.772 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:16:50.802 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:50.803 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:50.803 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:16:50.803 INFO:teuthology.orchestra.run.trial005.stdout: ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:50.803 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:50.803 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:16:50.831 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install ceph-volume 2026-02-17T21:16:50.970 INFO:teuthology.orchestra.run.trial119.stdout:(1/3): ceph-debugsource-19.2.3-679.gd855f53b.el 8.9 MB/s | 11 MB 00:01 2026-02-17T21:16:50.989 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:16:50.989 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:16:51.089 INFO:teuthology.orchestra.run.trial119.stdout:(2/3): ceph-debuginfo-19.2.3-679.gd855f53b.el9. 18 MB/s | 24 MB 00:01 2026-02-17T21:16:51.140 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:16:51.205 INFO:teuthology.orchestra.run.trial005.stdout:Package ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T21:16:51.223 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:51.223 INFO:teuthology.orchestra.run.trial005.stdout:Nothing to do. 2026-02-17T21:16:51.223 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:16:51.245 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install librados-devel 2026-02-17T21:16:51.356 INFO:teuthology.orchestra.run.trial176.stdout:rbd-mirror-19.2.3-679.gd855f53b.el9.x86_64.rpm 5.3 MB/s | 3.1 MB 00:00 2026-02-17T21:16:51.356 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:51.357 INFO:teuthology.orchestra.run.trial176.stdout:Total 5.3 MB/s | 3.1 MB 00:00 2026-02-17T21:16:51.357 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:16:51.360 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:16:51.360 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:16:51.400 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:16:51.400 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:16:51.553 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:16:51.592 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:16:51.594 INFO:teuthology.orchestra.run.trial176.stdout: Installing : rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:51.616 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:51.616 INFO:teuthology.orchestra.run.trial176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:51.617 INFO:teuthology.orchestra.run.trial176.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T21:16:51.617 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T21:16:51.617 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T21:16:51.617 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:51.635 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:51.635 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:51.635 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repo Size 2026-02-17T21:16:51.635 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:51.635 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:16:51.635 INFO:teuthology.orchestra.run.trial005.stdout: librados-devel x86_64 2:19.2.3-679.gd855f53b.el9 ceph 126 k 2026-02-17T21:16:51.635 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:51.635 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:16:51.636 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:51.636 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:16:51.636 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:51.636 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 126 k 2026-02-17T21:16:51.636 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 456 k 2026-02-17T21:16:51.636 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:16:51.910 INFO:teuthology.orchestra.run.trial005.stdout:librados-devel-19.2.3-679.gd855f53b.el9.x86_64. 461 kB/s | 126 kB 00:00 2026-02-17T21:16:51.910 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:51.911 INFO:teuthology.orchestra.run.trial005.stdout:Total 459 kB/s | 126 kB 00:00 2026-02-17T21:16:51.911 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:16:51.913 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:16:51.913 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:16:51.938 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:51.938 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:51.938 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:16:51.938 INFO:teuthology.orchestra.run.trial176.stdout: rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:51.938 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:51.938 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:16:51.944 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:16:51.945 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:16:51.965 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install rbd-nbd 2026-02-17T21:16:51.999 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:16:52.015 INFO:teuthology.orchestra.run.trial005.stdout: Installing : librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:52.095 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:52.151 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:52.152 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:52.152 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:16:52.152 INFO:teuthology.orchestra.run.trial005.stdout: librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:52.152 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:52.152 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:16:52.184 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install libcephfs2 2026-02-17T21:16:52.276 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:16:52.332 INFO:teuthology.orchestra.run.trial119.stdout:(3/3): ceph-base-debuginfo-19.2.3-679.gd855f53b 28 MB/s | 72 MB 00:02 2026-02-17T21:16:52.334 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:52.334 INFO:teuthology.orchestra.run.trial119.stdout:Total 42 MB/s | 107 MB 00:02 2026-02-17T21:16:52.334 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:16:52.339 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:16:52.339 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:16:52.358 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:52.358 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:52.359 INFO:teuthology.orchestra.run.trial176.stdout: Package Architecture Version Repository Size 2026-02-17T21:16:52.359 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:52.359 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:16:52.359 INFO:teuthology.orchestra.run.trial176.stdout: rbd-nbd x86_64 2:19.2.3-679.gd855f53b.el9 ceph 170 k 2026-02-17T21:16:52.359 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:52.359 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:16:52.359 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:52.359 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:16:52.359 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:52.359 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 170 k 2026-02-17T21:16:52.360 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 490 k 2026-02-17T21:16:52.360 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:16:52.443 INFO:teuthology.orchestra.run.trial176.stdout:rbd-nbd-19.2.3-679.gd855f53b.el9.x86_64.rpm 2.0 MB/s | 170 kB 00:00 2026-02-17T21:16:52.443 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:52.443 INFO:teuthology.orchestra.run.trial176.stdout:Total 2.0 MB/s | 170 kB 00:00 2026-02-17T21:16:52.443 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:16:52.446 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:16:52.447 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:16:52.479 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:16:52.479 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:16:52.494 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:16:52.535 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:16:52.552 INFO:teuthology.orchestra.run.trial176.stdout: Installing : rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:52.557 INFO:teuthology.orchestra.run.trial005.stdout:Package libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:52.575 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:52.575 INFO:teuthology.orchestra.run.trial005.stdout:Nothing to do. 2026-02-17T21:16:52.575 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:16:52.597 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install libcephfs-devel 2026-02-17T21:16:52.637 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:52.695 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:52.695 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:52.695 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:16:52.695 INFO:teuthology.orchestra.run.trial176.stdout: rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:52.695 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:52.695 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:16:52.718 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:16:52.718 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:16:52.723 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-base-debuginfo 2026-02-17T21:16:52.909 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:16:52.994 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:52.994 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:52.994 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repo Size 2026-02-17T21:16:52.994 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:52.994 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:16:52.994 INFO:teuthology.orchestra.run.trial005.stdout: libcephfs-devel x86_64 2:19.2.3-679.gd855f53b.el9 ceph 34 k 2026-02-17T21:16:52.995 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:52.995 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:16:52.995 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:52.995 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:16:52.995 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:52.995 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 34 k 2026-02-17T21:16:52.995 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 153 k 2026-02-17T21:16:52.995 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:16:53.036 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:16:53.057 INFO:teuthology.orchestra.run.trial005.stdout:libcephfs-devel-19.2.3-679.gd855f53b.el9.x86_64 540 kB/s | 34 kB 00:00 2026-02-17T21:16:53.057 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:53.057 INFO:teuthology.orchestra.run.trial005.stdout:Total 533 kB/s | 34 kB 00:00 2026-02-17T21:16:53.057 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:16:53.059 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:16:53.059 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:16:53.061 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:16:53.061 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:16:53.084 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:16:53.100 INFO:teuthology.orchestra.run.trial005.stdout: Installing : libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:53.119 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:16:53.119 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:53.119 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T21:16:53.119 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:53.119 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:16:53.119 INFO:teuthology.orchestra.run.trial176.stdout: ceph-base-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 72 M 2026-02-17T21:16:53.119 INFO:teuthology.orchestra.run.trial176.stdout:Installing dependencies: 2026-02-17T21:16:53.120 INFO:teuthology.orchestra.run.trial176.stdout: ceph-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 24 M 2026-02-17T21:16:53.120 INFO:teuthology.orchestra.run.trial176.stdout:Installing weak dependencies: 2026-02-17T21:16:53.120 INFO:teuthology.orchestra.run.trial176.stdout: ceph-debugsource x86_64 2:19.2.3-679.gd855f53b.el9 ceph 11 M 2026-02-17T21:16:53.120 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:53.120 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:16:53.120 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:16:53.120 INFO:teuthology.orchestra.run.trial176.stdout:Install 3 Packages 2026-02-17T21:16:53.120 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:16:53.120 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 107 M 2026-02-17T21:16:53.120 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 654 M 2026-02-17T21:16:53.120 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:16:53.155 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:53.212 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:53.212 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:53.212 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:16:53.212 INFO:teuthology.orchestra.run.trial005.stdout: libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:53.212 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:53.213 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:16:53.238 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install librados2 2026-02-17T21:16:53.444 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:16:53.543 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:16:53.607 INFO:teuthology.orchestra.run.trial005.stdout:Package librados2-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:53.625 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:53.625 INFO:teuthology.orchestra.run.trial005.stdout:Nothing to do. 2026-02-17T21:16:53.625 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:16:53.646 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install librbd1 2026-02-17T21:16:53.824 INFO:teuthology.orchestra.run.trial176.stdout:(1/3): ceph-debugsource-19.2.3-679.gd855f53b.el 15 MB/s | 11 MB 00:00 2026-02-17T21:16:53.956 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:16:54.020 INFO:teuthology.orchestra.run.trial005.stdout:Package librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:54.038 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:54.038 INFO:teuthology.orchestra.run.trial005.stdout:Nothing to do. 2026-02-17T21:16:54.039 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:16:54.059 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install python3-rados 2026-02-17T21:16:54.223 INFO:teuthology.orchestra.run.trial176.stdout:(2/3): ceph-debuginfo-19.2.3-679.gd855f53b.el9. 22 MB/s | 24 MB 00:01 2026-02-17T21:16:54.370 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:16:54.435 INFO:teuthology.orchestra.run.trial005.stdout:Package python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:54.452 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:54.453 INFO:teuthology.orchestra.run.trial005.stdout:Nothing to do. 2026-02-17T21:16:54.453 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:16:54.475 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install python3-rgw 2026-02-17T21:16:54.719 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-debugsource-2:19.2.3-679.gd855f53b.el9.x86_64 1/3 2026-02-17T21:16:54.783 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:16:54.847 INFO:teuthology.orchestra.run.trial005.stdout:Package python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:54.864 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:54.865 INFO:teuthology.orchestra.run.trial005.stdout:Nothing to do. 2026-02-17T21:16:54.865 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:16:54.886 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install python3-cephfs 2026-02-17T21:16:55.148 INFO:teuthology.orchestra.run.trial176.stdout:(3/3): ceph-base-debuginfo-19.2.3-679.gd855f53b 35 MB/s | 72 MB 00:02 2026-02-17T21:16:55.149 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:55.150 INFO:teuthology.orchestra.run.trial176.stdout:Total 53 MB/s | 107 MB 00:02 2026-02-17T21:16:55.150 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:16:55.155 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:16:55.155 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:16:55.175 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:16:55.195 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:16:55.259 INFO:teuthology.orchestra.run.trial005.stdout:Package python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:55.276 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:55.277 INFO:teuthology.orchestra.run.trial005.stdout:Nothing to do. 2026-02-17T21:16:55.277 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:16:55.298 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install python3-rbd 2026-02-17T21:16:55.538 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:16:55.538 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:16:55.606 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:16:55.670 INFO:teuthology.orchestra.run.trial005.stdout:Package python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:16:55.688 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:55.688 INFO:teuthology.orchestra.run.trial005.stdout:Nothing to do. 2026-02-17T21:16:55.688 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:16:55.710 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install rbd-fuse 2026-02-17T21:16:56.014 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:16:56.096 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:56.096 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:56.096 INFO:teuthology.orchestra.run.trial005.stdout: Package Architecture Version Repository Size 2026-02-17T21:16:56.096 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:56.096 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:16:56.096 INFO:teuthology.orchestra.run.trial005.stdout: rbd-fuse x86_64 2:19.2.3-679.gd855f53b.el9 ceph 85 k 2026-02-17T21:16:56.096 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:56.096 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:16:56.096 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:56.096 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:16:56.096 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:56.097 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 85 k 2026-02-17T21:16:56.097 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 227 k 2026-02-17T21:16:56.097 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:16:56.170 INFO:teuthology.orchestra.run.trial005.stdout:rbd-fuse-19.2.3-679.gd855f53b.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-17T21:16:56.171 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:56.171 INFO:teuthology.orchestra.run.trial005.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-17T21:16:56.171 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:16:56.174 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:16:56.174 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:16:56.205 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:16:56.205 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:16:56.256 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:16:56.272 INFO:teuthology.orchestra.run.trial005.stdout: Installing : rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:56.352 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:56.408 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:56.409 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:56.409 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:16:56.409 INFO:teuthology.orchestra.run.trial005.stdout: rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:56.409 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:56.409 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:16:56.436 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install rbd-mirror 2026-02-17T21:16:56.460 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-debugsource-2:19.2.3-679.gd855f53b.el9.x86_64 1/3 2026-02-17T21:16:56.764 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:16:56.846 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:56.846 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:56.846 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repo Size 2026-02-17T21:16:56.846 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:56.847 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:16:56.847 INFO:teuthology.orchestra.run.trial005.stdout: rbd-mirror x86_64 2:19.2.3-679.gd855f53b.el9 ceph 3.1 M 2026-02-17T21:16:56.847 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:56.847 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:16:56.847 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:56.847 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:16:56.847 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:56.847 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 3.1 M 2026-02-17T21:16:56.847 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 13 M 2026-02-17T21:16:56.847 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:16:56.996 INFO:teuthology.orchestra.run.trial005.stdout:rbd-mirror-19.2.3-679.gd855f53b.el9.x86_64.rpm 21 MB/s | 3.1 MB 00:00 2026-02-17T21:16:56.996 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:56.997 INFO:teuthology.orchestra.run.trial005.stdout:Total 21 MB/s | 3.1 MB 00:00 2026-02-17T21:16:56.997 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:16:57.000 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:16:57.000 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:16:57.040 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:16:57.040 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:16:57.233 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:16:57.234 INFO:teuthology.orchestra.run.trial005.stdout: Installing : rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:57.257 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:57.257 INFO:teuthology.orchestra.run.trial005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T21:16:57.257 INFO:teuthology.orchestra.run.trial005.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T21:16:57.257 INFO:teuthology.orchestra.run.trial005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T21:16:57.257 INFO:teuthology.orchestra.run.trial005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T21:16:57.257 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:57.559 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:57.559 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:57.559 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:16:57.559 INFO:teuthology.orchestra.run.trial005.stdout: rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:57.559 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:57.560 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:16:57.587 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install rbd-nbd 2026-02-17T21:16:57.902 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:16:57.986 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:57.986 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:57.987 INFO:teuthology.orchestra.run.trial005.stdout: Package Architecture Version Repository Size 2026-02-17T21:16:57.987 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:57.987 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:16:57.987 INFO:teuthology.orchestra.run.trial005.stdout: rbd-nbd x86_64 2:19.2.3-679.gd855f53b.el9 ceph 170 k 2026-02-17T21:16:57.987 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:57.987 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:16:57.987 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:57.987 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:16:57.987 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:57.987 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 170 k 2026-02-17T21:16:57.987 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 490 k 2026-02-17T21:16:57.988 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:16:57.989 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:16:58.071 INFO:teuthology.orchestra.run.trial005.stdout:rbd-nbd-19.2.3-679.gd855f53b.el9.x86_64.rpm 2.0 MB/s | 170 kB 00:00 2026-02-17T21:16:58.072 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:16:58.072 INFO:teuthology.orchestra.run.trial005.stdout:Total 2.0 MB/s | 170 kB 00:00 2026-02-17T21:16:58.072 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:16:58.075 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:16:58.075 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:16:58.107 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:16:58.107 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:16:58.165 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:16:58.184 INFO:teuthology.orchestra.run.trial005.stdout: Installing : rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:58.262 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:58.318 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:16:58.318 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:58.318 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:16:58.319 INFO:teuthology.orchestra.run.trial005.stdout: rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:58.319 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:58.319 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:16:58.346 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install ceph-base-debuginfo 2026-02-17T21:16:58.425 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2/3 2026-02-17T21:16:58.444 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 3/3 2026-02-17T21:16:58.671 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:16:58.753 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:16:58.754 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:58.754 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repo Size 2026-02-17T21:16:58.754 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:58.754 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:16:58.754 INFO:teuthology.orchestra.run.trial005.stdout: ceph-base-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 72 M 2026-02-17T21:16:58.754 INFO:teuthology.orchestra.run.trial005.stdout:Installing dependencies: 2026-02-17T21:16:58.754 INFO:teuthology.orchestra.run.trial005.stdout: ceph-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 24 M 2026-02-17T21:16:58.754 INFO:teuthology.orchestra.run.trial005.stdout:Installing weak dependencies: 2026-02-17T21:16:58.755 INFO:teuthology.orchestra.run.trial005.stdout: ceph-debugsource x86_64 2:19.2.3-679.gd855f53b.el9 ceph 11 M 2026-02-17T21:16:58.755 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:58.755 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:16:58.755 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:16:58.755 INFO:teuthology.orchestra.run.trial005.stdout:Install 3 Packages 2026-02-17T21:16:58.755 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:16:58.755 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 107 M 2026-02-17T21:16:58.755 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 654 M 2026-02-17T21:16:58.755 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:16:58.988 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 3/3 2026-02-17T21:16:58.988 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/3 2026-02-17T21:16:58.988 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2/3 2026-02-17T21:16:59.047 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-debugsource-2:19.2.3-679.gd855f53b.el9.x86_64 3/3 2026-02-17T21:16:59.047 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:59.047 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:16:59.048 INFO:teuthology.orchestra.run.trial135.stdout: ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:59.048 INFO:teuthology.orchestra.run.trial135.stdout: ceph-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:59.048 INFO:teuthology.orchestra.run.trial135.stdout: ceph-debugsource-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:16:59.048 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:59.048 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:16:59.092 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install ceph-common-debuginfo 2026-02-17T21:16:59.255 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-debugsource-2:19.2.3-679.gd855f53b.el9.x86_64 1/3 2026-02-17T21:16:59.413 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:00:53 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:16:59.497 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:16:59.497 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:59.497 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repo Size 2026-02-17T21:16:59.497 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:59.497 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:16:59.497 INFO:teuthology.orchestra.run.trial135.stdout: ceph-common-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 474 M 2026-02-17T21:16:59.497 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:59.497 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:16:59.497 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:16:59.497 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:16:59.497 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:16:59.497 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 474 M 2026-02-17T21:16:59.497 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 2.0 G 2026-02-17T21:16:59.497 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:16:59.517 INFO:teuthology.orchestra.run.trial005.stdout:(1/3): ceph-debugsource-19.2.3-679.gd855f53b.el 14 MB/s | 11 MB 00:00 2026-02-17T21:16:59.977 INFO:teuthology.orchestra.run.trial005.stdout:(2/3): ceph-debuginfo-19.2.3-679.gd855f53b.el9. 20 MB/s | 24 MB 00:01 2026-02-17T21:17:00.219 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2/3 2026-02-17T21:17:00.238 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 3/3 2026-02-17T21:17:00.798 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 3/3 2026-02-17T21:17:00.798 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/3 2026-02-17T21:17:00.798 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2/3 2026-02-17T21:17:00.856 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-debugsource-2:19.2.3-679.gd855f53b.el9.x86_64 3/3 2026-02-17T21:17:00.856 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:17:00.856 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:17:00.856 INFO:teuthology.orchestra.run.trial119.stdout: ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:17:00.856 INFO:teuthology.orchestra.run.trial119.stdout: ceph-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:17:00.856 INFO:teuthology.orchestra.run.trial119.stdout: ceph-debugsource-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:17:00.856 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:17:00.856 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:17:00.898 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-common-debuginfo 2026-02-17T21:17:01.211 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:00:56 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:17:01.294 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:17:01.294 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:17:01.294 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-17T21:17:01.294 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:17:01.294 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:17:01.294 INFO:teuthology.orchestra.run.trial119.stdout: ceph-common-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 474 M 2026-02-17T21:17:01.294 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:17:01.294 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:17:01.294 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:17:01.294 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:17:01.294 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:17:01.295 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 474 M 2026-02-17T21:17:01.295 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 2.0 G 2026-02-17T21:17:01.295 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:17:01.510 INFO:teuthology.orchestra.run.trial005.stdout:(3/3): ceph-base-debuginfo-19.2.3-679.gd855f53b 26 MB/s | 72 MB 00:02 2026-02-17T21:17:01.512 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:17:01.513 INFO:teuthology.orchestra.run.trial005.stdout:Total 39 MB/s | 107 MB 00:02 2026-02-17T21:17:01.513 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:17:01.518 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:17:01.518 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:17:01.895 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:17:01.895 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:17:02.938 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2/3 2026-02-17T21:17:02.957 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 3/3 2026-02-17T21:17:03.508 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 3/3 2026-02-17T21:17:03.508 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/3 2026-02-17T21:17:03.508 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2/3 2026-02-17T21:17:03.566 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-debugsource-2:19.2.3-679.gd855f53b.el9.x86_64 3/3 2026-02-17T21:17:03.566 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:17:03.566 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:17:03.566 INFO:teuthology.orchestra.run.trial176.stdout: ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:17:03.566 INFO:teuthology.orchestra.run.trial176.stdout: ceph-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:17:03.566 INFO:teuthology.orchestra.run.trial176.stdout: ceph-debugsource-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:17:03.567 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:17:03.567 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:17:03.609 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-common-debuginfo 2026-02-17T21:17:03.921 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:52 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:17:04.003 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:17:04.003 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:17:04.004 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T21:17:04.004 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:17:04.004 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:17:04.004 INFO:teuthology.orchestra.run.trial176.stdout: ceph-common-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 474 M 2026-02-17T21:17:04.004 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:17:04.004 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:17:04.004 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:17:04.004 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:17:04.004 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:17:04.004 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 474 M 2026-02-17T21:17:04.004 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 2.0 G 2026-02-17T21:17:04.005 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:17:04.339 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:17:05.628 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-debugsource-2:19.2.3-679.gd855f53b.el9.x86_64 1/3 2026-02-17T21:17:09.369 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2/3 2026-02-17T21:17:09.388 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 3/3 2026-02-17T21:17:09.953 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 3/3 2026-02-17T21:17:09.954 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/3 2026-02-17T21:17:09.954 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2/3 2026-02-17T21:17:10.011 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-debugsource-2:19.2.3-679.gd855f53b.el9.x86_64 3/3 2026-02-17T21:17:10.011 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:17:10.012 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:17:10.012 INFO:teuthology.orchestra.run.trial005.stdout: ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:17:10.012 INFO:teuthology.orchestra.run.trial005.stdout: ceph-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:17:10.012 INFO:teuthology.orchestra.run.trial005.stdout: ceph-debugsource-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:17:10.012 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:17:10.012 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:17:10.052 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install ceph-common-debuginfo 2026-02-17T21:17:10.368 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:00:53 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:17:10.452 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:17:10.452 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:17:10.452 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repo Size 2026-02-17T21:17:10.452 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:17:10.453 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:17:10.453 INFO:teuthology.orchestra.run.trial005.stdout: ceph-common-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 474 M 2026-02-17T21:17:10.453 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:17:10.453 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:17:10.453 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:17:10.453 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:17:10.453 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:17:10.453 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 474 M 2026-02-17T21:17:10.453 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 2.0 G 2026-02-17T21:17:10.453 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:17:13.370 INFO:teuthology.orchestra.run.trial135.stdout:ceph-common-debuginfo-19.2.3-679.gd855f53b.el9. 34 MB/s | 474 MB 00:13 2026-02-17T21:17:13.371 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:17:13.371 INFO:teuthology.orchestra.run.trial135.stdout:Total 34 MB/s | 474 MB 00:13 2026-02-17T21:17:13.371 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:17:13.373 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:17:13.373 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:17:14.781 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:17:14.781 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:17:29.042 INFO:teuthology.orchestra.run.trial119.stdout:ceph-common-debuginfo-19.2.3-679.gd855f53b.el9. 17 MB/s | 474 MB 00:27 2026-02-17T21:17:29.043 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:17:29.043 INFO:teuthology.orchestra.run.trial119.stdout:Total 17 MB/s | 474 MB 00:27 2026-02-17T21:17:29.043 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:17:29.045 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:17:29.045 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:17:30.456 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:17:30.456 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:17:33.552 INFO:teuthology.orchestra.run.trial005.stdout:ceph-common-debuginfo-19.2.3-679.gd855f53b.el9. 21 MB/s | 474 MB 00:23 2026-02-17T21:17:33.553 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:17:33.553 INFO:teuthology.orchestra.run.trial005.stdout:Total 21 MB/s | 474 MB 00:23 2026-02-17T21:17:33.553 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:17:33.555 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:17:33.555 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:17:33.897 INFO:teuthology.orchestra.run.trial176.stdout:ceph-common-debuginfo-19.2.3-679.gd855f53b.el9. 16 MB/s | 474 MB 00:29 2026-02-17T21:17:33.898 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:17:33.898 INFO:teuthology.orchestra.run.trial176.stdout:Total 16 MB/s | 474 MB 00:29 2026-02-17T21:17:33.898 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:17:33.900 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:17:33.900 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:17:34.970 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:17:34.970 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:17:35.313 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:17:35.313 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:17:38.276 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:17:38.294 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:17:39.794 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:17:39.851 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:17:39.851 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:17:39.852 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:17:39.852 INFO:teuthology.orchestra.run.trial135.stdout: ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:17:39.852 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:17:39.852 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:17:39.928 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-17T21:17:40.241 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:01:34 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:17:40.323 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:17:40.324 INFO:teuthology.orchestra.run.trial135.stdout:======================================================================================= 2026-02-17T21:17:40.325 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repo Size 2026-02-17T21:17:40.325 INFO:teuthology.orchestra.run.trial135.stdout:======================================================================================= 2026-02-17T21:17:40.325 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:17:40.325 INFO:teuthology.orchestra.run.trial135.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.5 M 2026-02-17T21:17:40.325 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:17:40.325 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:17:40.325 INFO:teuthology.orchestra.run.trial135.stdout:======================================================================================= 2026-02-17T21:17:40.325 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:17:40.325 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:17:40.325 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 1.5 M 2026-02-17T21:17:40.326 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 7.6 M 2026-02-17T21:17:40.326 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:17:40.445 INFO:teuthology.orchestra.run.trial135.stdout:ceph-immutable-object-cache-debuginfo-19.2.3-67 13 MB/s | 1.5 MB 00:00 2026-02-17T21:17:40.445 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:17:40.445 INFO:teuthology.orchestra.run.trial135.stdout:Total 13 MB/s | 1.5 MB 00:00 2026-02-17T21:17:40.445 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:17:40.446 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:17:40.447 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:17:40.468 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:17:40.469 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:17:40.587 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:17:40.604 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.2.3-679.g 1/1 2026-02-17T21:17:40.665 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.2.3-679.g 1/1 2026-02-17T21:17:40.724 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.2.3-679.g 1/1 2026-02-17T21:17:40.724 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:17:40.724 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:17:40.724 INFO:teuthology.orchestra.run.trial135.stdout: ceph-immutable-object-cache-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:17:40.724 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:17:40.725 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:17:40.754 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-17T21:17:41.070 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:01:35 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:17:41.155 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:17:41.155 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:17:41.155 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repo Size 2026-02-17T21:17:41.155 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:17:41.155 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:17:41.155 INFO:teuthology.orchestra.run.trial135.stdout: ceph-radosgw-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 200 M 2026-02-17T21:17:41.155 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:17:41.155 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:17:41.156 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:17:41.156 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:17:41.156 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:17:41.156 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 200 M 2026-02-17T21:17:41.156 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 893 M 2026-02-17T21:17:41.156 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:17:46.743 INFO:teuthology.orchestra.run.trial135.stdout:ceph-radosgw-debuginfo-19.2.3-679.gd855f53b.el9 36 MB/s | 200 MB 00:05 2026-02-17T21:17:46.743 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:17:46.744 INFO:teuthology.orchestra.run.trial135.stdout:Total 36 MB/s | 200 MB 00:05 2026-02-17T21:17:46.744 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:17:46.746 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:17:46.746 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:17:47.348 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:17:47.348 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:17:54.533 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:17:54.551 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:17:56.068 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:17:56.126 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:17:56.126 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:17:56.126 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:17:56.126 INFO:teuthology.orchestra.run.trial119.stdout: ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:17:56.126 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:17:56.126 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:17:56.198 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-17T21:17:56.510 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:01:51 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:17:56.591 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:17:56.592 INFO:teuthology.orchestra.run.trial119.stdout:======================================================================================= 2026-02-17T21:17:56.592 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-17T21:17:56.592 INFO:teuthology.orchestra.run.trial119.stdout:======================================================================================= 2026-02-17T21:17:56.592 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:17:56.592 INFO:teuthology.orchestra.run.trial119.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.5 M 2026-02-17T21:17:56.592 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:17:56.592 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:17:56.592 INFO:teuthology.orchestra.run.trial119.stdout:======================================================================================= 2026-02-17T21:17:56.592 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:17:56.592 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:17:56.592 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 1.5 M 2026-02-17T21:17:56.592 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 7.6 M 2026-02-17T21:17:56.592 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:17:57.408 INFO:teuthology.orchestra.run.trial119.stdout:ceph-immutable-object-cache-debuginfo-19.2.3-67 1.9 MB/s | 1.5 MB 00:00 2026-02-17T21:17:57.408 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:17:57.409 INFO:teuthology.orchestra.run.trial119.stdout:Total 1.9 MB/s | 1.5 MB 00:00 2026-02-17T21:17:57.409 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:17:57.411 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:17:57.412 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:17:57.433 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:17:57.434 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:17:57.546 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:17:57.564 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.2.3-679.g 1/1 2026-02-17T21:17:57.566 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:17:57.584 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x8 1/1 2026-02-17T21:17:57.627 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.2.3-679.g 1/1 2026-02-17T21:17:57.685 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.2.3-679.g 1/1 2026-02-17T21:17:57.686 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:17:57.686 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:17:57.686 INFO:teuthology.orchestra.run.trial119.stdout: ceph-immutable-object-cache-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:17:57.686 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:17:57.686 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:17:57.716 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-17T21:17:58.032 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:01:53 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:17:58.114 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:17:58.115 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:17:58.115 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-17T21:17:58.115 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:17:58.115 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:17:58.115 INFO:teuthology.orchestra.run.trial119.stdout: ceph-radosgw-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 200 M 2026-02-17T21:17:58.115 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:17:58.115 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:17:58.115 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:17:58.116 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:17:58.116 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:17:58.116 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 200 M 2026-02-17T21:17:58.116 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 893 M 2026-02-17T21:17:58.116 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:17:58.287 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x8 1/1 2026-02-17T21:17:58.345 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x8 1/1 2026-02-17T21:17:58.345 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:17:58.345 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:17:58.345 INFO:teuthology.orchestra.run.trial135.stdout: ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:17:58.345 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:17:58.345 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:17:58.390 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install ceph-test-debuginfo 2026-02-17T21:17:58.480 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:17:58.499 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:17:58.701 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:01:52 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:17:58.782 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:17:58.783 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:17:58.783 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repo Size 2026-02-17T21:17:58.783 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:17:58.783 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:17:58.784 INFO:teuthology.orchestra.run.trial135.stdout: ceph-test-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 729 M 2026-02-17T21:17:58.784 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:17:58.784 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:17:58.784 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:17:58.784 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:17:58.784 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:17:58.784 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 729 M 2026-02-17T21:17:58.784 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 3.6 G 2026-02-17T21:17:58.784 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:17:58.862 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:17:58.881 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:18:00.047 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:18:00.104 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:18:00.104 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:18:00.105 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:18:00.105 INFO:teuthology.orchestra.run.trial005.stdout: ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:18:00.105 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:18:00.105 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:18:00.172 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-17T21:18:00.422 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:18:00.479 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:18:00.479 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:18:00.479 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:18:00.480 INFO:teuthology.orchestra.run.trial176.stdout: ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:18:00.480 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:18:00.480 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:18:00.484 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:01:43 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:18:00.555 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-17T21:18:00.565 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:18:00.566 INFO:teuthology.orchestra.run.trial005.stdout:======================================================================================= 2026-02-17T21:18:00.566 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repo Size 2026-02-17T21:18:00.567 INFO:teuthology.orchestra.run.trial005.stdout:======================================================================================= 2026-02-17T21:18:00.567 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:18:00.567 INFO:teuthology.orchestra.run.trial005.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.5 M 2026-02-17T21:18:00.567 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:18:00.567 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:18:00.567 INFO:teuthology.orchestra.run.trial005.stdout:======================================================================================= 2026-02-17T21:18:00.567 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:18:00.567 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:18:00.567 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 1.5 M 2026-02-17T21:18:00.567 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 7.6 M 2026-02-17T21:18:00.568 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:18:00.867 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:01:49 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:18:00.948 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:18:00.949 INFO:teuthology.orchestra.run.trial176.stdout:======================================================================================= 2026-02-17T21:18:00.949 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T21:18:00.949 INFO:teuthology.orchestra.run.trial176.stdout:======================================================================================= 2026-02-17T21:18:00.949 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:18:00.949 INFO:teuthology.orchestra.run.trial176.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.5 M 2026-02-17T21:18:00.950 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:18:00.950 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:18:00.950 INFO:teuthology.orchestra.run.trial176.stdout:======================================================================================= 2026-02-17T21:18:00.950 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:18:00.950 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:18:00.950 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 1.5 M 2026-02-17T21:18:00.950 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 7.6 M 2026-02-17T21:18:00.950 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:18:01.888 INFO:teuthology.orchestra.run.trial005.stdout:ceph-immutable-object-cache-debuginfo-19.2.3-67 1.2 MB/s | 1.5 MB 00:01 2026-02-17T21:18:01.888 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:18:01.888 INFO:teuthology.orchestra.run.trial005.stdout:Total 1.2 MB/s | 1.5 MB 00:01 2026-02-17T21:18:01.888 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:18:01.890 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:18:01.890 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:18:01.912 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:18:01.912 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:18:02.025 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:18:02.042 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.2.3-679.g 1/1 2026-02-17T21:18:02.103 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.2.3-679.g 1/1 2026-02-17T21:18:02.147 INFO:teuthology.orchestra.run.trial176.stdout:ceph-immutable-object-cache-debuginfo-19.2.3-67 1.3 MB/s | 1.5 MB 00:01 2026-02-17T21:18:02.148 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:18:02.148 INFO:teuthology.orchestra.run.trial176.stdout:Total 1.3 MB/s | 1.5 MB 00:01 2026-02-17T21:18:02.148 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:18:02.150 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:18:02.150 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:18:02.160 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.2.3-679.g 1/1 2026-02-17T21:18:02.160 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:18:02.160 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:18:02.161 INFO:teuthology.orchestra.run.trial005.stdout: ceph-immutable-object-cache-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:18:02.161 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:18:02.161 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:18:02.172 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:18:02.172 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:18:02.188 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-17T21:18:02.285 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:18:02.302 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.2.3-679.g 1/1 2026-02-17T21:18:02.362 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.2.3-679.g 1/1 2026-02-17T21:18:02.419 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.2.3-679.g 1/1 2026-02-17T21:18:02.419 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:18:02.419 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:18:02.419 INFO:teuthology.orchestra.run.trial176.stdout: ceph-immutable-object-cache-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:18:02.420 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:18:02.420 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:18:02.446 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-17T21:18:02.498 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:01:45 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:18:02.580 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:18:02.581 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:18:02.581 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repo Size 2026-02-17T21:18:02.581 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:18:02.581 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:18:02.581 INFO:teuthology.orchestra.run.trial005.stdout: ceph-radosgw-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 200 M 2026-02-17T21:18:02.581 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:18:02.581 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:18:02.581 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:18:02.581 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:18:02.582 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:18:02.582 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 200 M 2026-02-17T21:18:02.582 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 893 M 2026-02-17T21:18:02.582 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:18:02.756 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:01:51 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:18:02.839 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:18:02.839 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:18:02.839 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T21:18:02.839 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:18:02.840 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:18:02.840 INFO:teuthology.orchestra.run.trial176.stdout: ceph-radosgw-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 200 M 2026-02-17T21:18:02.840 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:18:02.840 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:18:02.840 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:18:02.840 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:18:02.840 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:18:02.840 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 200 M 2026-02-17T21:18:02.840 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 893 M 2026-02-17T21:18:02.841 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:18:22.944 INFO:teuthology.orchestra.run.trial005.stdout:ceph-radosgw-debuginfo-19.2.3-679.gd855f53b.el9 9.8 MB/s | 200 MB 00:20 2026-02-17T21:18:22.945 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:18:22.945 INFO:teuthology.orchestra.run.trial005.stdout:Total 9.8 MB/s | 200 MB 00:20 2026-02-17T21:18:22.945 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:18:22.947 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:18:22.947 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:18:23.551 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:18:23.551 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:18:30.629 INFO:teuthology.orchestra.run.trial176.stdout:ceph-radosgw-debuginfo-19.2.3-679.gd855f53b.el9 7.2 MB/s | 200 MB 00:27 2026-02-17T21:18:30.630 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:18:30.630 INFO:teuthology.orchestra.run.trial176.stdout:Total 7.2 MB/s | 200 MB 00:27 2026-02-17T21:18:30.630 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:18:30.633 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:18:30.633 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:18:31.240 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:18:31.240 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:18:33.559 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:18:33.576 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x8 1/1 2026-02-17T21:18:34.265 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x8 1/1 2026-02-17T21:18:34.322 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x8 1/1 2026-02-17T21:18:34.322 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:18:34.322 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:18:34.322 INFO:teuthology.orchestra.run.trial005.stdout: ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:18:34.322 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:18:34.323 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:18:34.365 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install ceph-test-debuginfo 2026-02-17T21:18:34.677 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:02:17 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:18:34.759 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:18:34.759 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:18:34.760 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repo Size 2026-02-17T21:18:34.760 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:18:34.760 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:18:34.760 INFO:teuthology.orchestra.run.trial005.stdout: ceph-test-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 729 M 2026-02-17T21:18:34.760 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:18:34.760 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:18:34.760 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:18:34.760 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:18:34.761 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:18:34.761 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 729 M 2026-02-17T21:18:34.761 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 3.6 G 2026-02-17T21:18:34.761 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:18:39.293 INFO:teuthology.orchestra.run.trial119.stdout:ceph-radosgw-debuginfo-19.2.3-679.gd855f53b.el9 4.9 MB/s | 200 MB 00:41 2026-02-17T21:18:39.294 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:18:39.294 INFO:teuthology.orchestra.run.trial119.stdout:Total 4.9 MB/s | 200 MB 00:41 2026-02-17T21:18:39.294 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:18:39.296 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:18:39.297 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:18:39.902 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:18:39.903 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:18:41.297 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:18:41.315 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x8 1/1 2026-02-17T21:18:41.991 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x8 1/1 2026-02-17T21:18:42.049 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x8 1/1 2026-02-17T21:18:42.049 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:18:42.049 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:18:42.049 INFO:teuthology.orchestra.run.trial176.stdout: ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:18:42.050 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:18:42.050 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:18:42.095 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-test-debuginfo 2026-02-17T21:18:42.404 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:02:31 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:18:42.487 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:18:42.488 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:18:42.488 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T21:18:42.488 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:18:42.488 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:18:42.488 INFO:teuthology.orchestra.run.trial176.stdout: ceph-test-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 729 M 2026-02-17T21:18:42.488 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:18:42.488 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:18:42.488 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:18:42.489 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:18:42.489 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:18:42.489 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 729 M 2026-02-17T21:18:42.489 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 3.6 G 2026-02-17T21:18:42.489 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:18:50.129 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:18:50.146 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x8 1/1 2026-02-17T21:18:50.792 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x8 1/1 2026-02-17T21:18:50.850 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x8 1/1 2026-02-17T21:18:50.850 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:18:50.850 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:18:50.850 INFO:teuthology.orchestra.run.trial119.stdout: ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:18:50.851 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:18:50.851 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:18:50.895 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-test-debuginfo 2026-02-17T21:18:51.210 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:02:46 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:18:51.292 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:18:51.293 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:18:51.293 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-17T21:18:51.293 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:18:51.293 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:18:51.293 INFO:teuthology.orchestra.run.trial119.stdout: ceph-test-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 729 M 2026-02-17T21:18:51.293 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:18:51.293 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:18:51.293 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:18:51.294 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:18:51.294 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:18:51.294 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 729 M 2026-02-17T21:18:51.294 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 3.6 G 2026-02-17T21:18:51.294 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:19:39.543 INFO:teuthology.orchestra.run.trial119.stdout:ceph-test-debuginfo-19.2.3-679.gd855f53b.el9.x8 15 MB/s | 729 MB 00:48 2026-02-17T21:19:39.544 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:19:39.545 INFO:teuthology.orchestra.run.trial119.stdout:Total 15 MB/s | 729 MB 00:48 2026-02-17T21:19:39.545 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:19:39.547 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:19:39.547 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:19:40.143 INFO:teuthology.orchestra.run.trial176.stdout:ceph-test-debuginfo-19.2.3-679.gd855f53b.el9.x8 13 MB/s | 729 MB 00:57 2026-02-17T21:19:40.144 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:19:40.144 INFO:teuthology.orchestra.run.trial176.stdout:Total 13 MB/s | 729 MB 00:57 2026-02-17T21:19:40.144 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:19:40.146 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:19:40.146 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:19:41.714 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:19:41.714 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:19:42.312 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:19:42.312 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:19:52.030 INFO:teuthology.orchestra.run.trial005.stdout:ceph-test-debuginfo-19.2.3-679.gd855f53b.el9.x8 9.4 MB/s | 729 MB 01:17 2026-02-17T21:19:52.031 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:19:52.031 INFO:teuthology.orchestra.run.trial005.stdout:Total 9.4 MB/s | 729 MB 01:17 2026-02-17T21:19:52.031 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:19:52.034 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:19:52.034 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:19:53.056 INFO:teuthology.orchestra.run.trial135.stdout:ceph-test-debuginfo-19.2.3-679.gd855f53b.el9.x8 6.4 MB/s | 729 MB 01:54 2026-02-17T21:19:53.057 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:19:53.057 INFO:teuthology.orchestra.run.trial135.stdout:Total 6.4 MB/s | 729 MB 01:54 2026-02-17T21:19:53.057 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:19:53.060 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:19:53.060 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:19:54.190 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:19:54.190 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:19:55.225 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:19:55.225 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:20:19.532 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:20:19.605 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:20:19.986 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:20:20.044 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:20:20.044 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:20:20.044 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:20:20.045 INFO:teuthology.orchestra.run.trial119.stdout: ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:20:20.045 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:20:20.045 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:20:20.142 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-base-debuginfo 2026-02-17T21:20:20.235 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:20:20.255 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:20:20.459 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:04:15 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:20:20.524 INFO:teuthology.orchestra.run.trial119.stdout:Package ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:20:20.542 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:20:20.543 INFO:teuthology.orchestra.run.trial119.stdout:Nothing to do. 2026-02-17T21:20:20.543 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:20:20.565 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-mgr-debuginfo 2026-02-17T21:20:20.877 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:04:15 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:20:20.940 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:20:20.958 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:20:20.959 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:20:20.960 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-17T21:20:20.960 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:20:20.960 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:20:20.960 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 18 M 2026-02-17T21:20:20.960 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:20:20.960 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:20:20.960 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:20:20.960 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:20:20.960 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:20:20.960 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 18 M 2026-02-17T21:20:20.961 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 110 M 2026-02-17T21:20:20.961 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:20:20.997 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:20:20.997 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:20:20.997 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:20:20.997 INFO:teuthology.orchestra.run.trial176.stdout: ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:20:20.997 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:20:20.997 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:20:21.098 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-base-debuginfo 2026-02-17T21:20:21.410 INFO:teuthology.orchestra.run.trial119.stdout:ceph-mgr-debuginfo-19.2.3-679.gd855f53b.el9.x86 40 MB/s | 18 MB 00:00 2026-02-17T21:20:21.411 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:20:21.411 INFO:teuthology.orchestra.run.trial119.stdout:Total 40 MB/s | 18 MB 00:00 2026-02-17T21:20:21.411 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:20:21.412 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:04:10 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:20:21.412 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:20:21.413 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:20:21.476 INFO:teuthology.orchestra.run.trial176.stdout:Package ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:20:21.482 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:20:21.483 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:20:21.494 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:20:21.495 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T21:20:21.496 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:20:21.517 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-mgr-debuginfo 2026-02-17T21:20:21.830 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:04:10 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:20:21.912 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:20:21.913 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:20:21.913 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T21:20:21.913 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:20:21.913 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:20:21.913 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 18 M 2026-02-17T21:20:21.913 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:20:21.913 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:20:21.913 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:20:21.913 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:20:21.913 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:20:21.913 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 18 M 2026-02-17T21:20:21.913 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 110 M 2026-02-17T21:20:21.913 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:20:22.356 INFO:teuthology.orchestra.run.trial176.stdout:ceph-mgr-debuginfo-19.2.3-679.gd855f53b.el9.x86 41 MB/s | 18 MB 00:00 2026-02-17T21:20:22.356 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:20:22.356 INFO:teuthology.orchestra.run.trial176.stdout:Total 41 MB/s | 18 MB 00:00 2026-02-17T21:20:22.356 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:20:22.358 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:20:22.358 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:20:22.429 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:20:22.430 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:20:22.497 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:20:22.514 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:22.647 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:22.705 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:22.705 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:20:22.705 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:20:22.705 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:20:22.705 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:20:22.705 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:20:22.734 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-mds-debuginfo 2026-02-17T21:20:23.040 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:04:18 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:20:23.123 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:20:23.123 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:20:23.123 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-17T21:20:23.123 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:20:23.123 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:20:23.123 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mds-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 55 M 2026-02-17T21:20:23.123 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:20:23.123 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:20:23.124 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:20:23.124 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:20:23.124 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:20:23.124 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 55 M 2026-02-17T21:20:23.124 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 211 M 2026-02-17T21:20:23.124 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:20:23.446 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:20:23.463 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:23.600 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:23.658 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:23.658 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:20:23.658 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:20:23.658 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:20:23.658 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:20:23.658 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:20:23.687 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-mds-debuginfo 2026-02-17T21:20:23.998 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:04:12 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:20:24.080 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:20:24.081 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:20:24.081 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T21:20:24.081 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:20:24.081 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:20:24.081 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mds-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 55 M 2026-02-17T21:20:24.081 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:20:24.081 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:20:24.081 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:20:24.081 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:20:24.082 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:20:24.082 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 55 M 2026-02-17T21:20:24.082 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 211 M 2026-02-17T21:20:24.082 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:20:24.263 INFO:teuthology.orchestra.run.trial119.stdout:ceph-mds-debuginfo-19.2.3-679.gd855f53b.el9.x86 48 MB/s | 55 MB 00:01 2026-02-17T21:20:24.264 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:20:24.264 INFO:teuthology.orchestra.run.trial119.stdout:Total 48 MB/s | 55 MB 00:01 2026-02-17T21:20:24.264 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:20:24.266 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:20:24.266 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:20:24.445 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:20:24.446 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:20:25.302 INFO:teuthology.orchestra.run.trial176.stdout:ceph-mds-debuginfo-19.2.3-679.gd855f53b.el9.x86 45 MB/s | 55 MB 00:01 2026-02-17T21:20:25.303 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:20:25.303 INFO:teuthology.orchestra.run.trial176.stdout:Total 45 MB/s | 55 MB 00:01 2026-02-17T21:20:25.303 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:20:25.305 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:20:25.305 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:20:25.485 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:20:25.485 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:20:27.169 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:20:27.186 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:27.393 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:27.451 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:27.451 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:20:27.452 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:20:27.452 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:20:27.452 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:20:27.452 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:20:27.482 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-mon-debuginfo 2026-02-17T21:20:27.793 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:04:22 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:20:27.875 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:20:27.876 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:20:27.876 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-17T21:20:27.876 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:20:27.876 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:20:27.876 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mon-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 102 M 2026-02-17T21:20:27.876 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:20:27.876 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:20:27.876 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:20:27.876 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:20:27.876 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:20:27.876 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 102 M 2026-02-17T21:20:27.876 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 497 M 2026-02-17T21:20:27.876 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:20:28.166 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:20:28.184 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:28.395 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:28.453 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:28.454 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:20:28.454 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:20:28.454 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:20:28.454 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:20:28.454 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:20:28.484 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-mon-debuginfo 2026-02-17T21:20:28.789 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:04:17 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:20:28.871 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:20:28.872 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:20:28.872 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T21:20:28.872 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:20:28.872 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:20:28.872 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mon-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 102 M 2026-02-17T21:20:28.872 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:20:28.872 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:20:28.872 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:20:28.872 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:20:28.872 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:20:28.872 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 102 M 2026-02-17T21:20:28.873 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 497 M 2026-02-17T21:20:28.873 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:20:29.932 INFO:teuthology.orchestra.run.trial119.stdout:ceph-mon-debuginfo-19.2.3-679.gd855f53b.el9.x86 49 MB/s | 102 MB 00:02 2026-02-17T21:20:29.933 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:20:29.933 INFO:teuthology.orchestra.run.trial119.stdout:Total 49 MB/s | 102 MB 00:02 2026-02-17T21:20:29.933 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:20:29.935 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:20:29.935 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:20:30.252 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:20:30.253 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:20:31.772 INFO:teuthology.orchestra.run.trial176.stdout:ceph-mon-debuginfo-19.2.3-679.gd855f53b.el9.x86 35 MB/s | 102 MB 00:02 2026-02-17T21:20:31.773 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:20:31.773 INFO:teuthology.orchestra.run.trial176.stdout:Total 35 MB/s | 102 MB 00:02 2026-02-17T21:20:31.773 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:20:31.775 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:20:31.775 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:20:31.985 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:20:32.006 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:20:32.090 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:20:32.090 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:20:32.367 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:20:32.425 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:20:32.425 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:20:32.425 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:20:32.425 INFO:teuthology.orchestra.run.trial005.stdout: ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:20:32.425 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:20:32.425 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:20:32.520 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install ceph-base-debuginfo 2026-02-17T21:20:32.833 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:04:15 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:20:32.898 INFO:teuthology.orchestra.run.trial005.stdout:Package ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:20:32.916 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:20:32.917 INFO:teuthology.orchestra.run.trial005.stdout:Nothing to do. 2026-02-17T21:20:32.917 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:20:32.938 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install ceph-mgr-debuginfo 2026-02-17T21:20:33.253 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:04:16 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:20:33.336 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:20:33.336 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:20:33.336 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repo Size 2026-02-17T21:20:33.337 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:20:33.337 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:20:33.337 INFO:teuthology.orchestra.run.trial005.stdout: ceph-mgr-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 18 M 2026-02-17T21:20:33.337 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:20:33.337 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:20:33.337 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:20:33.337 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:20:33.337 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:20:33.337 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 18 M 2026-02-17T21:20:33.338 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 110 M 2026-02-17T21:20:33.338 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:20:33.777 INFO:teuthology.orchestra.run.trial005.stdout:ceph-mgr-debuginfo-19.2.3-679.gd855f53b.el9.x86 41 MB/s | 18 MB 00:00 2026-02-17T21:20:33.778 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:20:33.778 INFO:teuthology.orchestra.run.trial005.stdout:Total 41 MB/s | 18 MB 00:00 2026-02-17T21:20:33.778 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:20:33.780 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:20:33.780 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:20:33.850 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:20:33.851 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:20:34.865 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:20:34.882 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:35.019 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:35.077 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:35.077 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:20:35.077 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:20:35.077 INFO:teuthology.orchestra.run.trial005.stdout: ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:20:35.077 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:20:35.077 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:20:35.105 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install ceph-mds-debuginfo 2026-02-17T21:20:35.414 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:04:18 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:20:35.496 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:20:35.497 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:20:35.497 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repo Size 2026-02-17T21:20:35.497 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:20:35.497 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:20:35.497 INFO:teuthology.orchestra.run.trial005.stdout: ceph-mds-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 55 M 2026-02-17T21:20:35.497 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:20:35.497 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:20:35.497 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:20:35.497 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:20:35.498 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:20:35.498 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 55 M 2026-02-17T21:20:35.498 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 211 M 2026-02-17T21:20:35.498 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:20:35.572 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:20:35.590 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:36.016 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:36.074 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:36.074 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:20:36.075 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:20:36.075 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:20:36.075 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:20:36.075 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:20:36.112 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-osd-debuginfo 2026-02-17T21:20:36.422 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:04:31 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:20:36.504 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:20:36.504 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:20:36.505 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-17T21:20:36.505 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:20:36.505 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:20:36.505 INFO:teuthology.orchestra.run.trial119.stdout: ceph-osd-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 298 M 2026-02-17T21:20:36.505 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:20:36.505 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:20:36.505 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:20:36.505 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:20:36.505 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:20:36.505 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 298 M 2026-02-17T21:20:36.505 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 1.4 G 2026-02-17T21:20:36.506 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:20:36.631 INFO:teuthology.orchestra.run.trial005.stdout:ceph-mds-debuginfo-19.2.3-679.gd855f53b.el9.x86 49 MB/s | 55 MB 00:01 2026-02-17T21:20:36.632 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:20:36.632 INFO:teuthology.orchestra.run.trial005.stdout:Total 49 MB/s | 55 MB 00:01 2026-02-17T21:20:36.632 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:20:36.634 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:20:36.634 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:20:36.813 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:20:36.813 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:20:37.388 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:20:37.406 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:37.661 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:20:37.680 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:20:37.802 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:37.860 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:37.860 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:20:37.860 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:20:37.860 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:20:37.860 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:20:37.860 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:20:37.894 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-osd-debuginfo 2026-02-17T21:20:38.202 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:04:27 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:20:38.284 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:20:38.284 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:20:38.284 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T21:20:38.284 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:20:38.284 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:20:38.284 INFO:teuthology.orchestra.run.trial176.stdout: ceph-osd-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 298 M 2026-02-17T21:20:38.284 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:20:38.284 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:20:38.284 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:20:38.285 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:20:38.285 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:20:38.285 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 298 M 2026-02-17T21:20:38.285 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 1.4 G 2026-02-17T21:20:38.285 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:20:38.736 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:20:38.794 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:20:38.795 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:20:38.795 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:20:38.795 INFO:teuthology.orchestra.run.trial135.stdout: ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:20:38.795 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:20:38.795 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:20:38.895 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install ceph-base-debuginfo 2026-02-17T21:20:39.213 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:04:33 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:20:39.278 INFO:teuthology.orchestra.run.trial135.stdout:Package ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:20:39.296 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:20:39.297 INFO:teuthology.orchestra.run.trial135.stdout:Nothing to do. 2026-02-17T21:20:39.297 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:20:39.318 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install ceph-mgr-debuginfo 2026-02-17T21:20:39.539 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:20:39.556 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:39.629 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:04:33 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:20:39.711 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:20:39.712 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:20:39.712 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repo Size 2026-02-17T21:20:39.712 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:20:39.712 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:20:39.712 INFO:teuthology.orchestra.run.trial135.stdout: ceph-mgr-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 18 M 2026-02-17T21:20:39.712 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:20:39.712 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:20:39.712 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:20:39.712 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:20:39.712 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:20:39.712 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 18 M 2026-02-17T21:20:39.712 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 110 M 2026-02-17T21:20:39.712 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:20:39.763 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:39.820 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:39.820 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:20:39.820 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:20:39.820 INFO:teuthology.orchestra.run.trial005.stdout: ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:20:39.821 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:20:39.821 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:20:39.852 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install ceph-mon-debuginfo 2026-02-17T21:20:40.157 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:04:23 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:20:40.239 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:20:40.239 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:20:40.239 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repo Size 2026-02-17T21:20:40.239 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:20:40.239 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:20:40.239 INFO:teuthology.orchestra.run.trial005.stdout: ceph-mon-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 102 M 2026-02-17T21:20:40.239 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:20:40.239 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:20:40.239 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:20:40.239 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:20:40.239 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:20:40.239 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 102 M 2026-02-17T21:20:40.239 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 497 M 2026-02-17T21:20:40.239 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:20:43.105 INFO:teuthology.orchestra.run.trial135.stdout:ceph-mgr-debuginfo-19.2.3-679.gd855f53b.el9.x86 5.3 MB/s | 18 MB 00:03 2026-02-17T21:20:43.106 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:20:43.106 INFO:teuthology.orchestra.run.trial135.stdout:Total 5.3 MB/s | 18 MB 00:03 2026-02-17T21:20:43.107 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:20:43.108 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:20:43.108 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:20:43.178 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:20:43.178 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:20:43.758 INFO:teuthology.orchestra.run.trial119.stdout:ceph-osd-debuginfo-19.2.3-679.gd855f53b.el9.x86 41 MB/s | 298 MB 00:07 2026-02-17T21:20:43.759 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:20:43.759 INFO:teuthology.orchestra.run.trial119.stdout:Total 41 MB/s | 298 MB 00:07 2026-02-17T21:20:43.759 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:20:43.761 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:20:43.761 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:20:44.209 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:20:44.226 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:44.353 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:44.411 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:44.411 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:20:44.411 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:20:44.411 INFO:teuthology.orchestra.run.trial135.stdout: ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:20:44.411 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:20:44.411 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:20:44.441 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install ceph-mds-debuginfo 2026-02-17T21:20:44.653 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:20:44.653 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:20:44.751 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:04:38 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:20:44.834 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:20:44.834 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:20:44.835 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repo Size 2026-02-17T21:20:44.835 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:20:44.835 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:20:44.835 INFO:teuthology.orchestra.run.trial135.stdout: ceph-mds-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 55 M 2026-02-17T21:20:44.835 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:20:44.835 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:20:44.835 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:20:44.835 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:20:44.835 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:20:44.835 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 55 M 2026-02-17T21:20:44.835 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 211 M 2026-02-17T21:20:44.836 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:20:47.412 INFO:teuthology.orchestra.run.trial135.stdout:ceph-mds-debuginfo-19.2.3-679.gd855f53b.el9.x86 21 MB/s | 55 MB 00:02 2026-02-17T21:20:47.412 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:20:47.413 INFO:teuthology.orchestra.run.trial135.stdout:Total 21 MB/s | 55 MB 00:02 2026-02-17T21:20:47.413 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:20:47.415 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:20:47.415 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:20:47.594 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:20:47.595 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:20:49.205 INFO:teuthology.orchestra.run.trial176.stdout:ceph-osd-debuginfo-19.2.3-679.gd855f53b.el9.x86 27 MB/s | 298 MB 00:10 2026-02-17T21:20:49.206 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:20:49.206 INFO:teuthology.orchestra.run.trial176.stdout:Total 27 MB/s | 298 MB 00:10 2026-02-17T21:20:49.206 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:20:49.208 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:20:49.208 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:20:50.098 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:20:50.099 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:20:50.273 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:20:50.292 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:50.486 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:50.543 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:50.543 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:20:50.543 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:20:50.544 INFO:teuthology.orchestra.run.trial135.stdout: ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:20:50.544 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:20:50.544 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:20:50.576 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install ceph-mon-debuginfo 2026-02-17T21:20:50.885 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:04:44 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:20:50.966 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:20:50.967 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:20:50.967 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repo Size 2026-02-17T21:20:50.967 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:20:50.967 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:20:50.967 INFO:teuthology.orchestra.run.trial135.stdout: ceph-mon-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 102 M 2026-02-17T21:20:50.967 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:20:50.967 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:20:50.967 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:20:50.967 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:20:50.967 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:20:50.967 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 102 M 2026-02-17T21:20:50.967 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 497 M 2026-02-17T21:20:50.967 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:20:53.183 INFO:teuthology.orchestra.run.trial135.stdout:ceph-mon-debuginfo-19.2.3-679.gd855f53b.el9.x86 46 MB/s | 102 MB 00:02 2026-02-17T21:20:53.184 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:20:53.184 INFO:teuthology.orchestra.run.trial135.stdout:Total 46 MB/s | 102 MB 00:02 2026-02-17T21:20:53.184 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:20:53.186 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:20:53.186 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:20:53.502 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:20:53.502 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:20:53.736 INFO:teuthology.orchestra.run.trial005.stdout:ceph-mon-debuginfo-19.2.3-679.gd855f53b.el9.x86 7.5 MB/s | 102 MB 00:13 2026-02-17T21:20:53.737 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:20:53.737 INFO:teuthology.orchestra.run.trial005.stdout:Total 7.5 MB/s | 102 MB 00:13 2026-02-17T21:20:53.737 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:20:53.739 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:20:53.739 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:20:54.055 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:20:54.055 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:20:58.805 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:20:58.823 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:59.240 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:59.272 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:20:59.289 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:59.298 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:59.298 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:20:59.298 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:20:59.298 INFO:teuthology.orchestra.run.trial135.stdout: ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:20:59.298 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:20:59.298 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:20:59.336 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install ceph-osd-debuginfo 2026-02-17T21:20:59.647 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:04:53 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:20:59.656 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:20:59.674 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:59.675 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:59.730 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:20:59.731 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:20:59.731 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repo Size 2026-02-17T21:20:59.731 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:20:59.731 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:20:59.731 INFO:teuthology.orchestra.run.trial135.stdout: ceph-osd-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 298 M 2026-02-17T21:20:59.731 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:20:59.732 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:20:59.732 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:20:59.732 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:20:59.732 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:20:59.732 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 298 M 2026-02-17T21:20:59.732 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 1.4 G 2026-02-17T21:20:59.733 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:20:59.733 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:20:59.734 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:20:59.734 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:20:59.734 INFO:teuthology.orchestra.run.trial005.stdout: ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:20:59.734 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:20:59.734 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:20:59.769 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install ceph-osd-debuginfo 2026-02-17T21:21:00.083 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:04:43 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:21:00.165 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:21:00.166 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:00.166 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repo Size 2026-02-17T21:21:00.166 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:00.166 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:21:00.166 INFO:teuthology.orchestra.run.trial005.stdout: ceph-osd-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 298 M 2026-02-17T21:21:00.166 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:00.166 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:21:00.166 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:00.166 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:21:00.167 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:00.167 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 298 M 2026-02-17T21:21:00.167 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 1.4 G 2026-02-17T21:21:00.167 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:21:00.749 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:00.808 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:00.808 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:00.808 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:21:00.809 INFO:teuthology.orchestra.run.trial119.stdout: ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:00.809 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:00.809 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:21:00.864 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install ceph-fuse-debuginfo 2026-02-17T21:21:01.175 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:04:56 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:21:01.257 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:21:01.258 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:01.258 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-17T21:21:01.258 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:01.258 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:21:01.258 INFO:teuthology.orchestra.run.trial119.stdout: ceph-fuse-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 6.8 M 2026-02-17T21:21:01.258 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:01.258 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:21:01.258 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:01.258 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:21:01.258 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:01.258 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 6.8 M 2026-02-17T21:21:01.259 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 36 M 2026-02-17T21:21:01.259 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:21:03.696 INFO:teuthology.orchestra.run.trial119.stdout:ceph-fuse-debuginfo-19.2.3-679.gd855f53b.el9.x8 2.8 MB/s | 6.8 MB 00:02 2026-02-17T21:21:03.697 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:03.697 INFO:teuthology.orchestra.run.trial119.stdout:Total 2.8 MB/s | 6.8 MB 00:02 2026-02-17T21:21:03.697 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:21:03.699 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:21:03.699 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:21:03.737 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:21:03.737 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:21:04.130 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:21:04.147 INFO:teuthology.orchestra.run.trial119.stdout: Installing : ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:21:04.230 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:21:04.288 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:21:04.289 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:04.289 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:21:04.289 INFO:teuthology.orchestra.run.trial119.stdout: ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:04.289 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:04.289 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:21:04.316 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install librados-devel-debuginfo 2026-02-17T21:21:04.626 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:04:59 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:21:04.710 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:21:04.710 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:04.710 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-17T21:21:04.710 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:04.710 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:21:04.710 INFO:teuthology.orchestra.run.trial119.stdout: librados-devel-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 112 k 2026-02-17T21:21:04.710 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:04.710 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:21:04.710 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:04.711 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:21:04.711 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:04.711 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 112 k 2026-02-17T21:21:04.711 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 493 k 2026-02-17T21:21:04.711 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:21:05.076 INFO:teuthology.orchestra.run.trial119.stdout:librados-devel-debuginfo-19.2.3-679.gd855f53b.e 306 kB/s | 112 kB 00:00 2026-02-17T21:21:05.077 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:05.077 INFO:teuthology.orchestra.run.trial119.stdout:Total 306 kB/s | 112 kB 00:00 2026-02-17T21:21:05.077 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:21:05.079 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:21:05.079 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:21:05.097 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:21:05.097 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:21:05.135 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:21:05.153 INFO:teuthology.orchestra.run.trial119.stdout: Installing : librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:21:05.206 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:21:05.264 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:21:05.264 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:05.264 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:21:05.265 INFO:teuthology.orchestra.run.trial119.stdout: librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:05.265 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:05.265 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:21:05.292 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install libcephfs2-debuginfo 2026-02-17T21:21:05.409 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:21:05.427 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:05.603 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:05:00 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:21:05.686 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:21:05.686 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:05.686 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-17T21:21:05.686 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:05.686 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:21:05.686 INFO:teuthology.orchestra.run.trial119.stdout: libcephfs2-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 6.0 M 2026-02-17T21:21:05.686 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:05.687 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:21:05.687 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:05.687 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:21:05.687 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:05.687 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 6.0 M 2026-02-17T21:21:05.687 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 31 M 2026-02-17T21:21:05.687 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:21:06.518 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:06.576 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:06.576 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:06.576 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:21:06.576 INFO:teuthology.orchestra.run.trial176.stdout: ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:06.577 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:06.577 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:21:06.629 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-fuse-debuginfo 2026-02-17T21:21:06.661 INFO:teuthology.orchestra.run.trial119.stdout:libcephfs2-debuginfo-19.2.3-679.gd855f53b.el9.x 6.1 MB/s | 6.0 MB 00:00 2026-02-17T21:21:06.662 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:06.662 INFO:teuthology.orchestra.run.trial119.stdout:Total 6.1 MB/s | 6.0 MB 00:00 2026-02-17T21:21:06.662 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:21:06.663 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:21:06.664 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:21:06.698 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:21:06.699 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:21:06.938 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:04:55 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:21:07.020 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:21:07.020 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:07.020 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T21:21:07.020 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:07.020 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:21:07.020 INFO:teuthology.orchestra.run.trial176.stdout: ceph-fuse-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 6.8 M 2026-02-17T21:21:07.020 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:07.020 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:21:07.020 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:07.020 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:21:07.020 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:07.020 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 6.8 M 2026-02-17T21:21:07.020 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 36 M 2026-02-17T21:21:07.020 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:21:07.042 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:21:07.060 INFO:teuthology.orchestra.run.trial119.stdout: Installing : libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:21:07.140 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:21:07.197 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:21:07.198 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:07.198 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:21:07.198 INFO:teuthology.orchestra.run.trial119.stdout: libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:07.198 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:07.198 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:21:07.224 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install librados2-debuginfo 2026-02-17T21:21:07.338 INFO:teuthology.orchestra.run.trial135.stdout:ceph-osd-debuginfo-19.2.3-679.gd855f53b.el9.x86 39 MB/s | 298 MB 00:07 2026-02-17T21:21:07.340 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:07.340 INFO:teuthology.orchestra.run.trial135.stdout:Total 39 MB/s | 298 MB 00:07 2026-02-17T21:21:07.340 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:21:07.341 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:21:07.341 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:21:07.505 INFO:teuthology.orchestra.run.trial176.stdout:ceph-fuse-debuginfo-19.2.3-679.gd855f53b.el9.x8 14 MB/s | 6.8 MB 00:00 2026-02-17T21:21:07.506 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:07.506 INFO:teuthology.orchestra.run.trial176.stdout:Total 14 MB/s | 6.8 MB 00:00 2026-02-17T21:21:07.506 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:21:07.507 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:21:07.507 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:21:07.534 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:05:02 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:21:07.545 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:21:07.545 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:21:07.617 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:21:07.617 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:07.617 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-17T21:21:07.617 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:07.617 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:21:07.617 INFO:teuthology.orchestra.run.trial119.stdout: librados2-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 47 M 2026-02-17T21:21:07.617 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:07.617 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:21:07.617 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:07.618 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:21:07.618 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:07.618 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 47 M 2026-02-17T21:21:07.618 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 302 M 2026-02-17T21:21:07.618 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:21:07.935 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:21:07.953 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:21:08.033 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:21:08.090 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:21:08.091 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:08.091 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:21:08.091 INFO:teuthology.orchestra.run.trial176.stdout: ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:08.091 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:08.091 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:21:08.117 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install librados-devel-debuginfo 2026-02-17T21:21:08.234 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:21:08.234 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:21:08.425 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:04:57 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:21:08.509 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:21:08.509 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:08.509 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T21:21:08.509 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:08.510 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:21:08.510 INFO:teuthology.orchestra.run.trial176.stdout: librados-devel-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 112 k 2026-02-17T21:21:08.510 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:08.510 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:21:08.510 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:08.510 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:21:08.510 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:08.510 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 112 k 2026-02-17T21:21:08.510 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 493 k 2026-02-17T21:21:08.510 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:21:08.863 INFO:teuthology.orchestra.run.trial176.stdout:librados-devel-debuginfo-19.2.3-679.gd855f53b.e 317 kB/s | 112 kB 00:00 2026-02-17T21:21:08.863 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:08.863 INFO:teuthology.orchestra.run.trial176.stdout:Total 316 kB/s | 112 kB 00:00 2026-02-17T21:21:08.863 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:21:08.865 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:21:08.865 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:21:08.883 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:21:08.883 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:21:08.922 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:21:08.939 INFO:teuthology.orchestra.run.trial176.stdout: Installing : librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:21:08.992 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:21:09.049 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:21:09.049 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:09.050 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:21:09.050 INFO:teuthology.orchestra.run.trial176.stdout: librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:09.050 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:09.050 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:21:09.075 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install libcephfs2-debuginfo 2026-02-17T21:21:09.362 INFO:teuthology.orchestra.run.trial119.stdout:librados2-debuginfo-19.2.3-679.gd855f53b.el9.x8 27 MB/s | 47 MB 00:01 2026-02-17T21:21:09.363 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:09.363 INFO:teuthology.orchestra.run.trial119.stdout:Total 27 MB/s | 47 MB 00:01 2026-02-17T21:21:09.363 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:21:09.365 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:21:09.365 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:21:09.384 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:04:58 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:21:09.467 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:21:09.467 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:09.467 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T21:21:09.467 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:09.467 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:21:09.467 INFO:teuthology.orchestra.run.trial176.stdout: libcephfs2-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 6.0 M 2026-02-17T21:21:09.467 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:09.468 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:21:09.468 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:09.468 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:21:09.468 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:09.468 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 6.0 M 2026-02-17T21:21:09.468 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 31 M 2026-02-17T21:21:09.468 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:21:09.522 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:21:09.522 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:21:09.930 INFO:teuthology.orchestra.run.trial176.stdout:libcephfs2-debuginfo-19.2.3-679.gd855f53b.el9.x 13 MB/s | 6.0 MB 00:00 2026-02-17T21:21:09.931 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:09.931 INFO:teuthology.orchestra.run.trial176.stdout:Total 13 MB/s | 6.0 MB 00:00 2026-02-17T21:21:09.931 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:21:09.932 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:21:09.932 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:21:09.967 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:21:09.968 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:21:10.313 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:21:10.331 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:21:10.405 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:21:10.462 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:21:10.463 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:10.463 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:21:10.463 INFO:teuthology.orchestra.run.trial176.stdout: libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:10.463 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:10.463 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:21:10.490 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install librados2-debuginfo 2026-02-17T21:21:10.796 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:04:59 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:21:10.879 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:21:10.879 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:10.879 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T21:21:10.879 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:10.879 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:21:10.879 INFO:teuthology.orchestra.run.trial176.stdout: librados2-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 47 M 2026-02-17T21:21:10.879 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:10.880 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:21:10.880 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:10.880 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:21:10.880 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:10.880 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 47 M 2026-02-17T21:21:10.880 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 302 M 2026-02-17T21:21:10.880 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:21:12.166 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:21:12.183 INFO:teuthology.orchestra.run.trial119.stdout: Installing : librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:21:12.466 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:21:12.525 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:21:12.525 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:12.525 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:21:12.525 INFO:teuthology.orchestra.run.trial119.stdout: librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:12.525 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:12.526 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:21:12.559 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install librbd1-debuginfo 2026-02-17T21:21:12.588 INFO:teuthology.orchestra.run.trial176.stdout:librados2-debuginfo-19.2.3-679.gd855f53b.el9.x8 28 MB/s | 47 MB 00:01 2026-02-17T21:21:12.589 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:12.589 INFO:teuthology.orchestra.run.trial176.stdout:Total 28 MB/s | 47 MB 00:01 2026-02-17T21:21:12.589 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:21:12.591 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:21:12.591 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:21:12.644 INFO:teuthology.orchestra.run.trial005.stdout:ceph-osd-debuginfo-19.2.3-679.gd855f53b.el9.x86 24 MB/s | 298 MB 00:12 2026-02-17T21:21:12.644 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:12.645 INFO:teuthology.orchestra.run.trial005.stdout:Total 24 MB/s | 298 MB 00:12 2026-02-17T21:21:12.645 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:21:12.647 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:21:12.647 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:21:12.748 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:21:12.749 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:21:12.870 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:05:07 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:21:12.952 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:21:12.953 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:12.953 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-17T21:21:12.953 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:12.953 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:21:12.953 INFO:teuthology.orchestra.run.trial119.stdout: librbd1-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 55 M 2026-02-17T21:21:12.953 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:12.953 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:21:12.953 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:12.953 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:21:12.954 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:12.954 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 55 M 2026-02-17T21:21:12.954 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 374 M 2026-02-17T21:21:12.954 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:21:13.535 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:21:13.536 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:21:14.069 INFO:teuthology.orchestra.run.trial119.stdout:librbd1-debuginfo-19.2.3-679.gd855f53b.el9.x86_ 49 MB/s | 55 MB 00:01 2026-02-17T21:21:14.070 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:14.070 INFO:teuthology.orchestra.run.trial119.stdout:Total 49 MB/s | 55 MB 00:01 2026-02-17T21:21:14.071 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:21:14.072 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:21:14.072 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:21:14.251 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:21:14.251 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:21:15.396 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:21:15.414 INFO:teuthology.orchestra.run.trial176.stdout: Installing : librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:21:15.664 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:21:15.722 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:21:15.722 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:15.722 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:21:15.722 INFO:teuthology.orchestra.run.trial176.stdout: librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:15.723 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:15.723 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:21:15.753 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install librbd1-debuginfo 2026-02-17T21:21:16.055 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:05:05 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:21:16.138 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:21:16.138 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:16.138 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T21:21:16.138 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:16.139 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:21:16.139 INFO:teuthology.orchestra.run.trial176.stdout: librbd1-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 55 M 2026-02-17T21:21:16.139 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:16.139 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:21:16.139 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:16.139 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:21:16.139 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:16.139 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 55 M 2026-02-17T21:21:16.139 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 374 M 2026-02-17T21:21:16.140 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:21:17.292 INFO:teuthology.orchestra.run.trial176.stdout:librbd1-debuginfo-19.2.3-679.gd855f53b.el9.x86_ 47 MB/s | 55 MB 00:01 2026-02-17T21:21:17.293 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:17.293 INFO:teuthology.orchestra.run.trial176.stdout:Total 47 MB/s | 55 MB 00:01 2026-02-17T21:21:17.293 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:21:17.295 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:21:17.295 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:21:17.444 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:21:17.462 INFO:teuthology.orchestra.run.trial119.stdout: Installing : librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:17.474 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:21:17.474 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:21:17.785 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:17.844 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:17.844 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:17.844 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:21:17.844 INFO:teuthology.orchestra.run.trial119.stdout: librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:17.844 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:17.844 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:21:17.877 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install python3-cephfs-debuginfo 2026-02-17T21:21:18.187 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:05:13 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:21:18.270 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:21:18.271 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:18.271 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-17T21:21:18.271 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:18.271 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:21:18.271 INFO:teuthology.orchestra.run.trial119.stdout: python3-cephfs-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 629 k 2026-02-17T21:21:18.271 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:18.271 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:21:18.271 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:18.271 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:21:18.272 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:18.272 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 629 k 2026-02-17T21:21:18.272 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 2.1 M 2026-02-17T21:21:18.272 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:21:18.740 INFO:teuthology.orchestra.run.trial119.stdout:python3-cephfs-debuginfo-19.2.3-679.gd855f53b.e 1.3 MB/s | 629 kB 00:00 2026-02-17T21:21:18.740 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:18.740 INFO:teuthology.orchestra.run.trial119.stdout:Total 1.3 MB/s | 629 kB 00:00 2026-02-17T21:21:18.740 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:21:18.742 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:21:18.742 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:21:18.760 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:21:18.760 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:21:18.824 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:21:18.841 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:21:18.895 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:21:18.953 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:21:18.953 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:18.954 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:21:18.954 INFO:teuthology.orchestra.run.trial119.stdout: python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:18.954 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:18.954 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:21:18.980 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install python3-rados-debuginfo 2026-02-17T21:21:19.290 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:05:14 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:21:19.372 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:21:19.372 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:19.372 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-17T21:21:19.372 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:19.372 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:21:19.372 INFO:teuthology.orchestra.run.trial119.stdout: python3-rados-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 778 k 2026-02-17T21:21:19.372 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:19.373 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:21:19.373 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:19.373 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:21:19.373 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:19.373 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 778 k 2026-02-17T21:21:19.373 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 2.8 M 2026-02-17T21:21:19.373 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:21:19.583 INFO:teuthology.orchestra.run.trial119.stdout:python3-rados-debuginfo-19.2.3-679.gd855f53b.el 3.6 MB/s | 778 kB 00:00 2026-02-17T21:21:19.583 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:19.583 INFO:teuthology.orchestra.run.trial119.stdout:Total 3.6 MB/s | 778 kB 00:00 2026-02-17T21:21:19.583 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:21:19.586 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:21:19.586 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:21:19.605 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:21:19.605 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:21:19.676 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:21:19.693 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x 1/1 2026-02-17T21:21:19.749 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x 1/1 2026-02-17T21:21:19.806 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x 1/1 2026-02-17T21:21:19.806 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:19.806 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:21:19.806 INFO:teuthology.orchestra.run.trial119.stdout: python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:19.807 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:19.807 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:21:19.832 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install python3-rbd-debuginfo 2026-02-17T21:21:20.146 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:05:15 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:21:20.230 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:21:20.230 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:20.230 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-17T21:21:20.230 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:20.230 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:21:20.230 INFO:teuthology.orchestra.run.trial119.stdout: python3-rbd-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.1 M 2026-02-17T21:21:20.230 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:20.230 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:21:20.230 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:20.230 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:21:20.230 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:20.230 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 1.1 M 2026-02-17T21:21:20.230 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 4.3 M 2026-02-17T21:21:20.230 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:21:20.609 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:21:20.627 INFO:teuthology.orchestra.run.trial176.stdout: Installing : librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:20.832 INFO:teuthology.orchestra.run.trial119.stdout:python3-rbd-debuginfo-19.2.3-679.gd855f53b.el9. 1.9 MB/s | 1.1 MB 00:00 2026-02-17T21:21:20.833 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:20.834 INFO:teuthology.orchestra.run.trial119.stdout:Total 1.9 MB/s | 1.1 MB 00:00 2026-02-17T21:21:20.834 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:21:20.835 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:21:20.836 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:21:20.857 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:21:20.857 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:21:20.940 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:20.946 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:21:20.963 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:21:20.997 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:20.997 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:20.997 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:21:20.997 INFO:teuthology.orchestra.run.trial176.stdout: librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:20.997 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:20.997 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:21:21.023 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:21:21.026 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install python3-cephfs-debuginfo 2026-02-17T21:21:21.081 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:21:21.081 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:21.081 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:21:21.081 INFO:teuthology.orchestra.run.trial119.stdout: python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:21.081 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:21.081 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:21:21.110 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install python3-rgw-debuginfo 2026-02-17T21:21:21.332 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:05:10 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:21:21.415 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:21:21.416 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:21.416 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T21:21:21.416 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:21.417 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:21:21.417 INFO:teuthology.orchestra.run.trial176.stdout: python3-cephfs-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 629 k 2026-02-17T21:21:21.417 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:21.417 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:21:21.417 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:21.417 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:21:21.417 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:21.417 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 629 k 2026-02-17T21:21:21.417 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 2.1 M 2026-02-17T21:21:21.418 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:21:21.419 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:05:16 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:21:21.502 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:21:21.502 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:21.502 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-17T21:21:21.502 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:21.502 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:21:21.502 INFO:teuthology.orchestra.run.trial119.stdout: python3-rgw-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 339 k 2026-02-17T21:21:21.503 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:21.503 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:21:21.503 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:21.503 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:21:21.503 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:21.503 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 339 k 2026-02-17T21:21:21.503 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 1.0 M 2026-02-17T21:21:21.503 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:21:21.870 INFO:teuthology.orchestra.run.trial176.stdout:python3-cephfs-debuginfo-19.2.3-679.gd855f53b.e 1.4 MB/s | 629 kB 00:00 2026-02-17T21:21:21.871 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:21.871 INFO:teuthology.orchestra.run.trial176.stdout:Total 1.3 MB/s | 629 kB 00:00 2026-02-17T21:21:21.871 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:21:21.873 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:21:21.873 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:21:21.891 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:21:21.891 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:21:21.924 INFO:teuthology.orchestra.run.trial119.stdout:python3-rgw-debuginfo-19.2.3-679.gd855f53b.el9. 804 kB/s | 339 kB 00:00 2026-02-17T21:21:21.925 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:21.925 INFO:teuthology.orchestra.run.trial119.stdout:Total 802 kB/s | 339 kB 00:00 2026-02-17T21:21:21.925 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:21:21.927 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:21:21.927 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:21:21.945 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:21:21.945 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:21:21.955 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:21:21.972 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:21:21.994 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:21:22.011 INFO:teuthology.orchestra.run.trial119.stdout: Installing : python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:21:22.025 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:21:22.065 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:21:22.083 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:21:22.083 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:22.084 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:21:22.084 INFO:teuthology.orchestra.run.trial176.stdout: python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:22.084 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:22.084 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:21:22.111 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install python3-rados-debuginfo 2026-02-17T21:21:22.123 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:21:22.123 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:22.124 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:21:22.124 INFO:teuthology.orchestra.run.trial119.stdout: python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:22.124 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:22.124 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:21:22.152 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install rbd-fuse-debuginfo 2026-02-17T21:21:22.421 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:05:11 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:21:22.460 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:05:17 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:21:22.503 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:21:22.503 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:22.503 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T21:21:22.503 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:22.503 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:21:22.503 INFO:teuthology.orchestra.run.trial176.stdout: python3-rados-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 778 k 2026-02-17T21:21:22.503 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:22.503 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:21:22.503 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:22.503 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:21:22.504 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:22.504 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 778 k 2026-02-17T21:21:22.505 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 2.8 M 2026-02-17T21:21:22.505 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:21:22.543 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:21:22.543 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:22.544 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-17T21:21:22.544 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:22.544 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:21:22.544 INFO:teuthology.orchestra.run.trial119.stdout: rbd-fuse-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 546 k 2026-02-17T21:21:22.544 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:22.544 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:21:22.544 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:22.544 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:21:22.544 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:22.544 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 546 k 2026-02-17T21:21:22.545 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 3.0 M 2026-02-17T21:21:22.545 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:21:22.611 INFO:teuthology.orchestra.run.trial176.stdout:python3-rados-debuginfo-19.2.3-679.gd855f53b.el 7.0 MB/s | 778 kB 00:00 2026-02-17T21:21:22.612 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:22.612 INFO:teuthology.orchestra.run.trial176.stdout:Total 7.0 MB/s | 778 kB 00:00 2026-02-17T21:21:22.612 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:21:22.614 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:21:22.614 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:21:22.633 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:21:22.634 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:21:22.650 INFO:teuthology.orchestra.run.trial119.stdout:rbd-fuse-debuginfo-19.2.3-679.gd855f53b.el9.x86 5.0 MB/s | 546 kB 00:00 2026-02-17T21:21:22.650 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:22.650 INFO:teuthology.orchestra.run.trial119.stdout:Total 5.0 MB/s | 546 kB 00:00 2026-02-17T21:21:22.651 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:21:22.652 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:21:22.652 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:21:22.671 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:21:22.671 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:21:22.706 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:21:22.723 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x 1/1 2026-02-17T21:21:22.734 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:21:22.751 INFO:teuthology.orchestra.run.trial119.stdout: Installing : rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:22.781 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x 1/1 2026-02-17T21:21:22.807 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:22.839 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x 1/1 2026-02-17T21:21:22.839 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:22.839 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:21:22.839 INFO:teuthology.orchestra.run.trial176.stdout: python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:22.839 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:22.839 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:21:22.866 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install python3-rbd-debuginfo 2026-02-17T21:21:22.867 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:22.867 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:22.867 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:21:22.867 INFO:teuthology.orchestra.run.trial119.stdout: rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:22.867 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:22.868 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:21:22.891 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install rbd-mirror-debuginfo 2026-02-17T21:21:23.175 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:05:12 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:21:23.203 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:05:18 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:21:23.257 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:21:23.257 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:23.257 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T21:21:23.257 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:23.258 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:21:23.258 INFO:teuthology.orchestra.run.trial176.stdout: python3-rbd-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.1 M 2026-02-17T21:21:23.258 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:23.258 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:21:23.258 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:23.258 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:21:23.258 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:23.258 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 1.1 M 2026-02-17T21:21:23.258 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 4.3 M 2026-02-17T21:21:23.258 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:21:23.286 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:21:23.287 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:23.287 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-17T21:21:23.287 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:23.287 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:21:23.287 INFO:teuthology.orchestra.run.trial119.stdout: rbd-mirror-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 54 M 2026-02-17T21:21:23.287 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:23.287 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:21:23.287 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:23.287 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:21:23.287 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:23.288 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 54 M 2026-02-17T21:21:23.288 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 353 M 2026-02-17T21:21:23.288 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:21:23.376 INFO:teuthology.orchestra.run.trial176.stdout:python3-rbd-debuginfo-19.2.3-679.gd855f53b.el9. 9.6 MB/s | 1.1 MB 00:00 2026-02-17T21:21:23.377 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:23.378 INFO:teuthology.orchestra.run.trial176.stdout:Total 9.5 MB/s | 1.1 MB 00:00 2026-02-17T21:21:23.378 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:21:23.379 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:21:23.379 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:21:23.400 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:21:23.401 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:21:23.490 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:21:23.507 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:21:23.515 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:21:23.533 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:23.568 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:21:23.626 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:21:23.626 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:23.627 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:21:23.627 INFO:teuthology.orchestra.run.trial176.stdout: python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:23.627 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:23.627 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:21:23.653 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install python3-rgw-debuginfo 2026-02-17T21:21:23.960 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:05:12 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:21:24.043 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:21:24.044 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:24.044 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T21:21:24.044 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:24.044 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:21:24.044 INFO:teuthology.orchestra.run.trial176.stdout: python3-rgw-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 339 k 2026-02-17T21:21:24.044 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:24.044 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:21:24.045 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:24.045 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:21:24.045 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:24.045 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 339 k 2026-02-17T21:21:24.045 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 1.0 M 2026-02-17T21:21:24.045 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:21:24.429 INFO:teuthology.orchestra.run.trial176.stdout:python3-rgw-debuginfo-19.2.3-679.gd855f53b.el9. 881 kB/s | 339 kB 00:00 2026-02-17T21:21:24.429 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:24.429 INFO:teuthology.orchestra.run.trial176.stdout:Total 880 kB/s | 339 kB 00:00 2026-02-17T21:21:24.430 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:21:24.431 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:21:24.432 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:21:24.450 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:21:24.450 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:21:24.464 INFO:teuthology.orchestra.run.trial119.stdout:rbd-mirror-debuginfo-19.2.3-679.gd855f53b.el9.x 46 MB/s | 54 MB 00:01 2026-02-17T21:21:24.465 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:24.465 INFO:teuthology.orchestra.run.trial119.stdout:Total 45 MB/s | 54 MB 00:01 2026-02-17T21:21:24.465 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:21:24.467 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:21:24.467 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:21:24.500 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:21:24.517 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:21:24.562 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:24.571 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:21:24.620 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:24.620 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:24.620 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:21:24.620 INFO:teuthology.orchestra.run.trial135.stdout: ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:24.621 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:24.621 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:21:24.628 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:21:24.628 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:24.628 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:21:24.628 INFO:teuthology.orchestra.run.trial176.stdout: python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:24.628 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:24.628 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:21:24.642 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:21:24.642 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:21:24.655 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install rbd-fuse-debuginfo 2026-02-17T21:21:24.675 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install ceph-fuse-debuginfo 2026-02-17T21:21:24.966 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:05:13 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:21:24.986 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:05:18 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:21:25.049 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:21:25.049 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:25.049 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T21:21:25.050 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:25.050 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:21:25.050 INFO:teuthology.orchestra.run.trial176.stdout: rbd-fuse-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 546 k 2026-02-17T21:21:25.050 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:25.050 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:21:25.050 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:25.050 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:21:25.050 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:25.050 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 546 k 2026-02-17T21:21:25.050 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 3.0 M 2026-02-17T21:21:25.051 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:21:25.068 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:21:25.069 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:25.069 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repo Size 2026-02-17T21:21:25.069 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:25.069 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:21:25.069 INFO:teuthology.orchestra.run.trial135.stdout: ceph-fuse-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 6.8 M 2026-02-17T21:21:25.070 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:25.070 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:21:25.070 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:25.070 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:21:25.070 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:25.070 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 6.8 M 2026-02-17T21:21:25.070 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 36 M 2026-02-17T21:21:25.070 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:21:25.485 INFO:teuthology.orchestra.run.trial176.stdout:rbd-fuse-debuginfo-19.2.3-679.gd855f53b.el9.x86 1.2 MB/s | 546 kB 00:00 2026-02-17T21:21:25.486 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:25.486 INFO:teuthology.orchestra.run.trial176.stdout:Total 1.2 MB/s | 546 kB 00:00 2026-02-17T21:21:25.486 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:21:25.488 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:21:25.488 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:21:25.508 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:21:25.508 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:21:25.570 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:21:25.588 INFO:teuthology.orchestra.run.trial176.stdout: Installing : rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:25.647 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:25.705 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:25.705 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:25.705 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:21:25.705 INFO:teuthology.orchestra.run.trial176.stdout: rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:25.705 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:25.706 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:21:25.733 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install rbd-mirror-debuginfo 2026-02-17T21:21:26.042 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:05:15 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:21:26.126 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:21:26.126 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:26.127 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T21:21:26.127 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:26.127 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:21:26.127 INFO:teuthology.orchestra.run.trial176.stdout: rbd-mirror-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 54 M 2026-02-17T21:21:26.127 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:26.128 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:21:26.128 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:26.128 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:21:26.128 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:26.128 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 54 M 2026-02-17T21:21:26.128 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 353 M 2026-02-17T21:21:26.129 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:21:26.174 INFO:teuthology.orchestra.run.trial135.stdout:ceph-fuse-debuginfo-19.2.3-679.gd855f53b.el9.x8 6.2 MB/s | 6.8 MB 00:01 2026-02-17T21:21:26.175 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:26.175 INFO:teuthology.orchestra.run.trial135.stdout:Total 6.2 MB/s | 6.8 MB 00:01 2026-02-17T21:21:26.175 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:21:26.176 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:21:26.176 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:21:26.214 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:21:26.214 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:21:26.606 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:21:26.623 INFO:teuthology.orchestra.run.trial135.stdout: Installing : ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:21:26.705 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:21:26.762 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:21:26.763 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:26.763 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:21:26.763 INFO:teuthology.orchestra.run.trial135.stdout: ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:26.763 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:26.763 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:21:26.793 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install librados-devel-debuginfo 2026-02-17T21:21:27.110 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:05:21 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:21:27.194 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:21:27.194 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:27.194 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repo Size 2026-02-17T21:21:27.194 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:27.194 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:21:27.194 INFO:teuthology.orchestra.run.trial135.stdout: librados-devel-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 112 k 2026-02-17T21:21:27.194 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:27.194 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:21:27.194 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:27.194 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:21:27.194 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:27.195 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 112 k 2026-02-17T21:21:27.195 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 493 k 2026-02-17T21:21:27.195 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:21:27.278 INFO:teuthology.orchestra.run.trial135.stdout:librados-devel-debuginfo-19.2.3-679.gd855f53b.e 1.3 MB/s | 112 kB 00:00 2026-02-17T21:21:27.278 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:27.279 INFO:teuthology.orchestra.run.trial135.stdout:Total 1.3 MB/s | 112 kB 00:00 2026-02-17T21:21:27.279 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:21:27.280 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:21:27.280 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:21:27.298 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:21:27.298 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:21:27.337 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:21:27.355 INFO:teuthology.orchestra.run.trial135.stdout: Installing : librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:21:27.409 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:21:27.467 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:21:27.467 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:27.467 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:21:27.467 INFO:teuthology.orchestra.run.trial135.stdout: librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:27.467 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:27.467 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:21:27.493 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install libcephfs2-debuginfo 2026-02-17T21:21:27.727 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:21:27.745 INFO:teuthology.orchestra.run.trial119.stdout: Installing : rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:21:27.809 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:05:21 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:21:27.892 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:21:27.892 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:27.892 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repo Size 2026-02-17T21:21:27.892 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:27.892 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:21:27.892 INFO:teuthology.orchestra.run.trial135.stdout: libcephfs2-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 6.0 M 2026-02-17T21:21:27.892 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:27.892 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:21:27.892 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:27.892 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:21:27.893 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:27.893 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 6.0 M 2026-02-17T21:21:27.893 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 31 M 2026-02-17T21:21:27.893 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:21:28.060 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:21:28.117 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:21:28.117 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:28.118 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:21:28.118 INFO:teuthology.orchestra.run.trial119.stdout: rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:28.118 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:28.118 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:21:28.147 DEBUG:teuthology.orchestra.run.trial119:> sudo yum -y install rbd-nbd-debuginfo 2026-02-17T21:21:28.184 INFO:teuthology.orchestra.run.trial176.stdout:rbd-mirror-debuginfo-19.2.3-679.gd855f53b.el9.x 26 MB/s | 54 MB 00:02 2026-02-17T21:21:28.185 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:28.185 INFO:teuthology.orchestra.run.trial176.stdout:Total 26 MB/s | 54 MB 00:02 2026-02-17T21:21:28.185 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:21:28.187 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:21:28.187 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:21:28.362 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:21:28.362 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:21:28.455 INFO:teuthology.orchestra.run.trial119.stdout:Last metadata expiration check: 0:05:23 ago on Tue 17 Feb 2026 09:16:05 PM UTC. 2026-02-17T21:21:28.537 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-17T21:21:28.538 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:28.538 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-17T21:21:28.538 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:28.538 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-17T21:21:28.538 INFO:teuthology.orchestra.run.trial119.stdout: rbd-nbd-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.4 M 2026-02-17T21:21:28.538 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:28.538 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-17T21:21:28.538 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-17T21:21:28.538 INFO:teuthology.orchestra.run.trial119.stdout:Install 1 Package 2026-02-17T21:21:28.538 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:28.538 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 1.4 M 2026-02-17T21:21:28.538 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 6.6 M 2026-02-17T21:21:28.538 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-17T21:21:28.649 INFO:teuthology.orchestra.run.trial135.stdout:libcephfs2-debuginfo-19.2.3-679.gd855f53b.el9.x 7.9 MB/s | 6.0 MB 00:00 2026-02-17T21:21:28.650 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:28.650 INFO:teuthology.orchestra.run.trial135.stdout:Total 7.9 MB/s | 6.0 MB 00:00 2026-02-17T21:21:28.650 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:21:28.652 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:21:28.652 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:21:28.657 INFO:teuthology.orchestra.run.trial119.stdout:rbd-nbd-debuginfo-19.2.3-679.gd855f53b.el9.x86_ 11 MB/s | 1.4 MB 00:00 2026-02-17T21:21:28.658 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:28.658 INFO:teuthology.orchestra.run.trial119.stdout:Total 11 MB/s | 1.4 MB 00:00 2026-02-17T21:21:28.658 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-17T21:21:28.660 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-17T21:21:28.660 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-17T21:21:28.681 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-17T21:21:28.681 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-17T21:21:28.686 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:21:28.687 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:21:28.786 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-17T21:21:28.801 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:21:28.803 INFO:teuthology.orchestra.run.trial119.stdout: Installing : rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:28.819 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:28.861 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:28.918 INFO:teuthology.orchestra.run.trial119.stdout: Verifying : rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:28.918 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:28.918 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-17T21:21:28.918 INFO:teuthology.orchestra.run.trial119.stdout: rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:28.919 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:28.919 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-17T21:21:28.946 DEBUG:teuthology.parallel:result is None 2026-02-17T21:21:29.038 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:21:29.055 INFO:teuthology.orchestra.run.trial135.stdout: Installing : libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:21:29.134 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:21:29.192 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:21:29.192 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:29.192 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:21:29.192 INFO:teuthology.orchestra.run.trial135.stdout: libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:29.192 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:29.192 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:21:29.220 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install librados2-debuginfo 2026-02-17T21:21:29.535 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:05:23 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:21:29.616 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:21:29.617 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:29.617 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repo Size 2026-02-17T21:21:29.617 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:29.617 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:21:29.617 INFO:teuthology.orchestra.run.trial135.stdout: librados2-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 47 M 2026-02-17T21:21:29.617 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:29.617 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:21:29.617 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:29.617 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:21:29.617 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:29.617 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 47 M 2026-02-17T21:21:29.617 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 302 M 2026-02-17T21:21:29.617 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:21:29.919 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:29.976 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:29.976 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:29.976 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:21:29.976 INFO:teuthology.orchestra.run.trial005.stdout: ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:29.976 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:29.977 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:21:30.032 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install ceph-fuse-debuginfo 2026-02-17T21:21:30.339 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:05:13 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:21:30.421 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:21:30.422 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:30.422 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repo Size 2026-02-17T21:21:30.422 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:30.422 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:21:30.422 INFO:teuthology.orchestra.run.trial005.stdout: ceph-fuse-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 6.8 M 2026-02-17T21:21:30.422 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:30.422 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:21:30.423 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:30.423 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:21:30.423 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:30.423 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 6.8 M 2026-02-17T21:21:30.423 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 36 M 2026-02-17T21:21:30.423 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:21:30.604 INFO:teuthology.orchestra.run.trial135.stdout:librados2-debuginfo-19.2.3-679.gd855f53b.el9.x8 48 MB/s | 47 MB 00:00 2026-02-17T21:21:30.605 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:30.606 INFO:teuthology.orchestra.run.trial135.stdout:Total 48 MB/s | 47 MB 00:00 2026-02-17T21:21:30.606 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:21:30.607 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:21:30.607 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:21:30.724 INFO:teuthology.orchestra.run.trial005.stdout:ceph-fuse-debuginfo-19.2.3-679.gd855f53b.el9.x8 23 MB/s | 6.8 MB 00:00 2026-02-17T21:21:30.725 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:30.725 INFO:teuthology.orchestra.run.trial005.stdout:Total 23 MB/s | 6.8 MB 00:00 2026-02-17T21:21:30.726 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:21:30.727 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:21:30.727 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:21:30.764 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:21:30.765 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:21:30.765 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:21:30.765 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:21:31.158 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:21:31.176 INFO:teuthology.orchestra.run.trial005.stdout: Installing : ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:21:31.257 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:21:31.315 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:21:31.315 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:31.315 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:21:31.316 INFO:teuthology.orchestra.run.trial005.stdout: ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:31.316 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:31.316 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:21:31.343 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install librados-devel-debuginfo 2026-02-17T21:21:31.503 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:21:31.521 INFO:teuthology.orchestra.run.trial176.stdout: Installing : rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:21:31.655 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:05:14 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:21:31.737 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:21:31.737 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:31.737 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repo Size 2026-02-17T21:21:31.737 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:31.737 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:21:31.738 INFO:teuthology.orchestra.run.trial005.stdout: librados-devel-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 112 k 2026-02-17T21:21:31.738 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:31.738 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:21:31.738 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:31.738 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:21:31.738 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:31.738 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 112 k 2026-02-17T21:21:31.738 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 493 k 2026-02-17T21:21:31.738 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:21:31.821 INFO:teuthology.orchestra.run.trial005.stdout:librados-devel-debuginfo-19.2.3-679.gd855f53b.e 1.3 MB/s | 112 kB 00:00 2026-02-17T21:21:31.822 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:31.822 INFO:teuthology.orchestra.run.trial005.stdout:Total 1.3 MB/s | 112 kB 00:00 2026-02-17T21:21:31.822 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:21:31.824 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:21:31.824 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:21:31.840 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:21:31.841 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:21:31.841 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:21:31.881 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:21:31.898 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:21:31.898 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:31.898 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:21:31.898 INFO:teuthology.orchestra.run.trial176.stdout: rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:31.898 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:31.898 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:21:31.899 INFO:teuthology.orchestra.run.trial005.stdout: Installing : librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:21:31.932 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install rbd-nbd-debuginfo 2026-02-17T21:21:31.954 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:21:32.012 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:21:32.012 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:32.013 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:21:32.013 INFO:teuthology.orchestra.run.trial005.stdout: librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:32.013 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:32.013 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:21:32.039 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install libcephfs2-debuginfo 2026-02-17T21:21:32.240 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:05:21 ago on Tue 17 Feb 2026 09:16:11 PM UTC. 2026-02-17T21:21:32.323 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T21:21:32.323 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:32.323 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T21:21:32.323 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:32.323 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T21:21:32.323 INFO:teuthology.orchestra.run.trial176.stdout: rbd-nbd-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.4 M 2026-02-17T21:21:32.324 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:32.324 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T21:21:32.324 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T21:21:32.324 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T21:21:32.324 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:32.324 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 1.4 M 2026-02-17T21:21:32.324 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 6.6 M 2026-02-17T21:21:32.324 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T21:21:32.348 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:05:15 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:21:32.431 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:21:32.432 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:32.432 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repo Size 2026-02-17T21:21:32.432 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:32.432 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:21:32.432 INFO:teuthology.orchestra.run.trial005.stdout: libcephfs2-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 6.0 M 2026-02-17T21:21:32.432 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:32.432 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:21:32.432 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:32.432 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:21:32.433 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:32.433 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 6.0 M 2026-02-17T21:21:32.433 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 31 M 2026-02-17T21:21:32.433 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:21:32.441 INFO:teuthology.orchestra.run.trial176.stdout:rbd-nbd-debuginfo-19.2.3-679.gd855f53b.el9.x86_ 11 MB/s | 1.4 MB 00:00 2026-02-17T21:21:32.441 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:32.442 INFO:teuthology.orchestra.run.trial176.stdout:Total 11 MB/s | 1.4 MB 00:00 2026-02-17T21:21:32.442 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T21:21:32.443 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T21:21:32.443 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T21:21:32.464 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T21:21:32.464 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T21:21:32.568 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T21:21:32.585 INFO:teuthology.orchestra.run.trial176.stdout: Installing : rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:32.635 INFO:teuthology.orchestra.run.trial005.stdout:libcephfs2-debuginfo-19.2.3-679.gd855f53b.el9.x 29 MB/s | 6.0 MB 00:00 2026-02-17T21:21:32.636 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:32.636 INFO:teuthology.orchestra.run.trial005.stdout:Total 29 MB/s | 6.0 MB 00:00 2026-02-17T21:21:32.636 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:21:32.638 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:21:32.638 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:21:32.643 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:32.673 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:21:32.673 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:21:32.701 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:32.701 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:32.701 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T21:21:32.701 INFO:teuthology.orchestra.run.trial176.stdout: rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:32.701 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:32.701 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T21:21:32.732 DEBUG:teuthology.parallel:result is None 2026-02-17T21:21:33.023 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:21:33.041 INFO:teuthology.orchestra.run.trial005.stdout: Installing : libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:21:33.119 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:21:33.177 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:21:33.177 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:33.177 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:21:33.177 INFO:teuthology.orchestra.run.trial005.stdout: libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:33.178 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:33.178 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:21:33.205 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install librados2-debuginfo 2026-02-17T21:21:33.457 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:21:33.475 INFO:teuthology.orchestra.run.trial135.stdout: Installing : librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:21:33.518 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:05:16 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:21:33.602 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:21:33.602 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:33.602 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repo Size 2026-02-17T21:21:33.602 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:33.602 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:21:33.602 INFO:teuthology.orchestra.run.trial005.stdout: librados2-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 47 M 2026-02-17T21:21:33.602 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:33.602 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:21:33.603 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:33.603 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:21:33.603 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:33.603 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 47 M 2026-02-17T21:21:33.603 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 302 M 2026-02-17T21:21:33.603 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:21:33.763 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:21:33.823 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:21:33.823 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:33.824 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:21:33.824 INFO:teuthology.orchestra.run.trial135.stdout: librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:33.824 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:33.824 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:21:33.856 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install librbd1-debuginfo 2026-02-17T21:21:34.172 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:05:28 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:21:34.255 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:21:34.256 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:34.256 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repo Size 2026-02-17T21:21:34.256 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:34.256 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:21:34.256 INFO:teuthology.orchestra.run.trial135.stdout: librbd1-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 55 M 2026-02-17T21:21:34.256 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:34.256 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:21:34.256 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:34.256 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:21:34.257 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:34.257 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 55 M 2026-02-17T21:21:34.257 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 374 M 2026-02-17T21:21:34.257 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:21:34.581 INFO:teuthology.orchestra.run.trial005.stdout:librados2-debuginfo-19.2.3-679.gd855f53b.el9.x8 48 MB/s | 47 MB 00:00 2026-02-17T21:21:34.582 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:34.582 INFO:teuthology.orchestra.run.trial005.stdout:Total 48 MB/s | 47 MB 00:00 2026-02-17T21:21:34.582 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:21:34.584 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:21:34.584 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:21:34.741 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:21:34.741 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:21:35.581 INFO:teuthology.orchestra.run.trial135.stdout:librbd1-debuginfo-19.2.3-679.gd855f53b.el9.x86_ 41 MB/s | 55 MB 00:01 2026-02-17T21:21:35.582 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:35.582 INFO:teuthology.orchestra.run.trial135.stdout:Total 41 MB/s | 55 MB 00:01 2026-02-17T21:21:35.582 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:21:35.584 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:21:35.584 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:21:35.763 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:21:35.763 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:21:37.378 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:21:37.396 INFO:teuthology.orchestra.run.trial005.stdout: Installing : librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:21:37.646 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:21:37.704 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:21:37.704 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:37.704 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:21:37.704 INFO:teuthology.orchestra.run.trial005.stdout: librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:37.705 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:37.705 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:21:37.736 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install librbd1-debuginfo 2026-02-17T21:21:38.046 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:05:21 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:21:38.129 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:21:38.129 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:38.129 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repo Size 2026-02-17T21:21:38.130 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:38.130 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:21:38.130 INFO:teuthology.orchestra.run.trial005.stdout: librbd1-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 55 M 2026-02-17T21:21:38.130 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:38.130 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:21:38.130 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:38.130 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:21:38.130 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:38.130 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 55 M 2026-02-17T21:21:38.130 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 374 M 2026-02-17T21:21:38.131 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:21:38.952 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:21:38.970 INFO:teuthology.orchestra.run.trial135.stdout: Installing : librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:39.232 INFO:teuthology.orchestra.run.trial005.stdout:librbd1-debuginfo-19.2.3-679.gd855f53b.el9.x86_ 49 MB/s | 55 MB 00:01 2026-02-17T21:21:39.233 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:39.233 INFO:teuthology.orchestra.run.trial005.stdout:Total 49 MB/s | 55 MB 00:01 2026-02-17T21:21:39.233 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:21:39.235 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:21:39.235 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:21:39.283 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:39.342 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:39.343 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:39.343 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:21:39.343 INFO:teuthology.orchestra.run.trial135.stdout: librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:39.343 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:39.343 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:21:39.377 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install python3-cephfs-debuginfo 2026-02-17T21:21:39.414 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:21:39.414 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:21:39.689 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:05:33 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:21:39.773 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:21:39.773 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:39.773 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repo Size 2026-02-17T21:21:39.774 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:39.774 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:21:39.774 INFO:teuthology.orchestra.run.trial135.stdout: python3-cephfs-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 629 k 2026-02-17T21:21:39.774 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:39.774 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:21:39.774 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:39.774 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:21:39.775 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:39.775 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 629 k 2026-02-17T21:21:39.775 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 2.1 M 2026-02-17T21:21:39.775 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:21:39.880 INFO:teuthology.orchestra.run.trial135.stdout:python3-cephfs-debuginfo-19.2.3-679.gd855f53b.e 5.7 MB/s | 629 kB 00:00 2026-02-17T21:21:39.881 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:39.881 INFO:teuthology.orchestra.run.trial135.stdout:Total 5.7 MB/s | 629 kB 00:00 2026-02-17T21:21:39.881 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:21:39.882 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:21:39.882 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:21:39.901 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:21:39.901 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:21:39.965 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:21:39.982 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:21:40.039 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:21:40.096 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:21:40.097 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:40.097 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:21:40.097 INFO:teuthology.orchestra.run.trial135.stdout: python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:40.097 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:40.097 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:21:40.125 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install python3-rados-debuginfo 2026-02-17T21:21:40.437 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:05:34 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:21:40.521 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:21:40.522 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:40.522 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repo Size 2026-02-17T21:21:40.522 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:40.522 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:21:40.522 INFO:teuthology.orchestra.run.trial135.stdout: python3-rados-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 778 k 2026-02-17T21:21:40.522 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:40.522 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:21:40.523 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:40.523 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:21:40.523 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:40.523 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 778 k 2026-02-17T21:21:40.523 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 2.8 M 2026-02-17T21:21:40.523 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:21:40.629 INFO:teuthology.orchestra.run.trial135.stdout:python3-rados-debuginfo-19.2.3-679.gd855f53b.el 7.1 MB/s | 778 kB 00:00 2026-02-17T21:21:40.630 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:40.630 INFO:teuthology.orchestra.run.trial135.stdout:Total 7.0 MB/s | 778 kB 00:00 2026-02-17T21:21:40.630 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:21:40.631 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:21:40.631 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:21:40.650 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:21:40.651 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:21:40.724 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:21:40.741 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x 1/1 2026-02-17T21:21:40.796 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x 1/1 2026-02-17T21:21:40.853 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x 1/1 2026-02-17T21:21:40.854 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:40.854 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:21:40.854 INFO:teuthology.orchestra.run.trial135.stdout: python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:40.854 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:40.854 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:21:40.879 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install python3-rbd-debuginfo 2026-02-17T21:21:41.187 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:05:35 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:21:41.270 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:21:41.270 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:41.271 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repo Size 2026-02-17T21:21:41.271 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:41.271 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:21:41.271 INFO:teuthology.orchestra.run.trial135.stdout: python3-rbd-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.1 M 2026-02-17T21:21:41.271 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:41.271 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:21:41.271 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:41.271 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:21:41.271 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:41.271 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 1.1 M 2026-02-17T21:21:41.272 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 4.3 M 2026-02-17T21:21:41.272 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:21:41.389 INFO:teuthology.orchestra.run.trial135.stdout:python3-rbd-debuginfo-19.2.3-679.gd855f53b.el9. 9.7 MB/s | 1.1 MB 00:00 2026-02-17T21:21:41.389 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:41.389 INFO:teuthology.orchestra.run.trial135.stdout:Total 9.6 MB/s | 1.1 MB 00:00 2026-02-17T21:21:41.389 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:21:41.391 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:21:41.391 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:21:41.411 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:21:41.412 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:21:41.502 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:21:41.519 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:21:41.575 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:21:41.633 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:21:41.633 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:41.633 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:21:41.633 INFO:teuthology.orchestra.run.trial135.stdout: python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:41.633 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:41.633 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:21:41.659 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install python3-rgw-debuginfo 2026-02-17T21:21:41.970 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:05:35 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:21:42.053 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:21:42.053 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:42.053 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repo Size 2026-02-17T21:21:42.053 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:42.053 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:21:42.053 INFO:teuthology.orchestra.run.trial135.stdout: python3-rgw-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 339 k 2026-02-17T21:21:42.053 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:42.053 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:21:42.053 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:42.054 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:21:42.054 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:42.054 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 339 k 2026-02-17T21:21:42.054 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 1.0 M 2026-02-17T21:21:42.054 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:21:42.149 INFO:teuthology.orchestra.run.trial135.stdout:python3-rgw-debuginfo-19.2.3-679.gd855f53b.el9. 3.5 MB/s | 339 kB 00:00 2026-02-17T21:21:42.149 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:42.149 INFO:teuthology.orchestra.run.trial135.stdout:Total 3.4 MB/s | 339 kB 00:00 2026-02-17T21:21:42.150 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:21:42.151 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:21:42.151 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:21:42.169 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:21:42.169 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:21:42.219 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:21:42.237 INFO:teuthology.orchestra.run.trial135.stdout: Installing : python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:21:42.293 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:21:42.350 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:21:42.350 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:42.350 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:21:42.350 INFO:teuthology.orchestra.run.trial135.stdout: python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:42.350 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:42.350 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:21:42.376 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install rbd-fuse-debuginfo 2026-02-17T21:21:42.668 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:21:42.686 INFO:teuthology.orchestra.run.trial005.stdout: Installing : librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:42.686 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:05:36 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:21:42.769 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:21:42.770 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:42.770 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repo Size 2026-02-17T21:21:42.770 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:42.771 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:21:42.771 INFO:teuthology.orchestra.run.trial135.stdout: rbd-fuse-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 546 k 2026-02-17T21:21:42.771 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:42.771 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:21:42.771 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:42.771 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:21:42.771 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:42.771 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 546 k 2026-02-17T21:21:42.771 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 3.0 M 2026-02-17T21:21:42.771 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:21:42.876 INFO:teuthology.orchestra.run.trial135.stdout:rbd-fuse-debuginfo-19.2.3-679.gd855f53b.el9.x86 5.1 MB/s | 546 kB 00:00 2026-02-17T21:21:42.877 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:42.877 INFO:teuthology.orchestra.run.trial135.stdout:Total 5.0 MB/s | 546 kB 00:00 2026-02-17T21:21:42.877 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:21:42.878 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:21:42.878 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:21:42.897 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:21:42.898 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:21:42.960 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:21:42.976 INFO:teuthology.orchestra.run.trial135.stdout: Installing : rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:43.006 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:43.033 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:43.063 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:43.063 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:43.063 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:21:43.064 INFO:teuthology.orchestra.run.trial005.stdout: librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:43.064 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:43.064 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:21:43.091 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:43.091 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:43.091 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:21:43.091 INFO:teuthology.orchestra.run.trial135.stdout: rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:43.091 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:43.091 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:21:43.095 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install python3-cephfs-debuginfo 2026-02-17T21:21:43.117 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install rbd-mirror-debuginfo 2026-02-17T21:21:43.404 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:05:26 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:21:43.431 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:05:37 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:21:43.486 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:21:43.487 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:43.487 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repo Size 2026-02-17T21:21:43.487 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:43.487 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:21:43.487 INFO:teuthology.orchestra.run.trial005.stdout: python3-cephfs-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 629 k 2026-02-17T21:21:43.487 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:43.487 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:21:43.487 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:43.488 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:21:43.488 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:43.488 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 629 k 2026-02-17T21:21:43.488 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 2.1 M 2026-02-17T21:21:43.488 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:21:43.515 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:21:43.516 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:43.516 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repo Size 2026-02-17T21:21:43.516 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:43.516 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:21:43.516 INFO:teuthology.orchestra.run.trial135.stdout: rbd-mirror-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 54 M 2026-02-17T21:21:43.516 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:43.516 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:21:43.516 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:43.516 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:21:43.516 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:43.516 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 54 M 2026-02-17T21:21:43.517 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 353 M 2026-02-17T21:21:43.517 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:21:43.593 INFO:teuthology.orchestra.run.trial005.stdout:python3-cephfs-debuginfo-19.2.3-679.gd855f53b.e 5.8 MB/s | 629 kB 00:00 2026-02-17T21:21:43.594 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:43.594 INFO:teuthology.orchestra.run.trial005.stdout:Total 5.7 MB/s | 629 kB 00:00 2026-02-17T21:21:43.594 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:21:43.595 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:21:43.595 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:21:43.614 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:21:43.614 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:21:43.677 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:21:43.694 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:21:43.750 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:21:43.808 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:21:43.808 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:43.808 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:21:43.808 INFO:teuthology.orchestra.run.trial005.stdout: python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:43.808 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:43.808 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:21:43.835 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install python3-rados-debuginfo 2026-02-17T21:21:44.144 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:05:27 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:21:44.226 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:21:44.227 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:44.227 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repo Size 2026-02-17T21:21:44.227 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:44.227 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:21:44.227 INFO:teuthology.orchestra.run.trial005.stdout: python3-rados-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 778 k 2026-02-17T21:21:44.227 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:44.228 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:21:44.228 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:44.228 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:21:44.228 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:44.228 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 778 k 2026-02-17T21:21:44.228 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 2.8 M 2026-02-17T21:21:44.228 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:21:44.573 INFO:teuthology.orchestra.run.trial005.stdout:python3-rados-debuginfo-19.2.3-679.gd855f53b.el 2.2 MB/s | 778 kB 00:00 2026-02-17T21:21:44.574 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:44.574 INFO:teuthology.orchestra.run.trial005.stdout:Total 2.2 MB/s | 778 kB 00:00 2026-02-17T21:21:44.574 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:21:44.576 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:21:44.576 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:21:44.595 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:21:44.595 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:21:44.603 INFO:teuthology.orchestra.run.trial135.stdout:rbd-mirror-debuginfo-19.2.3-679.gd855f53b.el9.x 49 MB/s | 54 MB 00:01 2026-02-17T21:21:44.603 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:44.604 INFO:teuthology.orchestra.run.trial135.stdout:Total 49 MB/s | 54 MB 00:01 2026-02-17T21:21:44.604 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:21:44.606 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:21:44.606 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:21:44.666 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:21:44.684 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x 1/1 2026-02-17T21:21:44.739 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x 1/1 2026-02-17T21:21:44.780 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:21:44.780 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:21:44.796 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x 1/1 2026-02-17T21:21:44.796 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:44.796 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:21:44.797 INFO:teuthology.orchestra.run.trial005.stdout: python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:44.797 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:44.797 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:21:44.823 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install python3-rbd-debuginfo 2026-02-17T21:21:45.133 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:05:28 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:21:45.218 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:21:45.218 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:45.218 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repo Size 2026-02-17T21:21:45.218 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:45.218 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:21:45.218 INFO:teuthology.orchestra.run.trial005.stdout: python3-rbd-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.1 M 2026-02-17T21:21:45.218 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:45.218 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:21:45.218 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:45.219 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:21:45.219 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:45.219 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 1.1 M 2026-02-17T21:21:45.219 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 4.3 M 2026-02-17T21:21:45.219 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:21:45.336 INFO:teuthology.orchestra.run.trial005.stdout:python3-rbd-debuginfo-19.2.3-679.gd855f53b.el9. 9.7 MB/s | 1.1 MB 00:00 2026-02-17T21:21:45.336 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:45.336 INFO:teuthology.orchestra.run.trial005.stdout:Total 9.6 MB/s | 1.1 MB 00:00 2026-02-17T21:21:45.337 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:21:45.338 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:21:45.338 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:21:45.359 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:21:45.359 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:21:45.450 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:21:45.467 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:21:45.524 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:21:45.582 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:21:45.582 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:45.582 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:21:45.582 INFO:teuthology.orchestra.run.trial005.stdout: python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:45.582 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:45.582 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:21:45.608 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install python3-rgw-debuginfo 2026-02-17T21:21:45.919 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:05:28 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:21:46.001 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:21:46.001 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:46.001 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repo Size 2026-02-17T21:21:46.001 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:46.001 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:21:46.001 INFO:teuthology.orchestra.run.trial005.stdout: python3-rgw-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 339 k 2026-02-17T21:21:46.001 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:46.002 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:21:46.002 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:46.002 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:21:46.002 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:46.002 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 339 k 2026-02-17T21:21:46.002 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 1.0 M 2026-02-17T21:21:46.002 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:21:46.098 INFO:teuthology.orchestra.run.trial005.stdout:python3-rgw-debuginfo-19.2.3-679.gd855f53b.el9. 3.4 MB/s | 339 kB 00:00 2026-02-17T21:21:46.098 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:46.098 INFO:teuthology.orchestra.run.trial005.stdout:Total 3.4 MB/s | 339 kB 00:00 2026-02-17T21:21:46.099 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:21:46.100 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:21:46.100 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:21:46.118 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:21:46.119 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:21:46.168 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:21:46.185 INFO:teuthology.orchestra.run.trial005.stdout: Installing : python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:21:46.240 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:21:46.298 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:21:46.298 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:46.298 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:21:46.298 INFO:teuthology.orchestra.run.trial005.stdout: python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:46.299 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:46.299 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:21:46.325 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install rbd-fuse-debuginfo 2026-02-17T21:21:46.632 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:05:29 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:21:46.714 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:21:46.715 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:46.715 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repo Size 2026-02-17T21:21:46.715 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:46.715 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:21:46.715 INFO:teuthology.orchestra.run.trial005.stdout: rbd-fuse-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 546 k 2026-02-17T21:21:46.716 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:46.716 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:21:46.716 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:46.716 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:21:46.716 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:46.716 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 546 k 2026-02-17T21:21:46.716 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 3.0 M 2026-02-17T21:21:46.716 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:21:46.821 INFO:teuthology.orchestra.run.trial005.stdout:rbd-fuse-debuginfo-19.2.3-679.gd855f53b.el9.x86 5.0 MB/s | 546 kB 00:00 2026-02-17T21:21:46.822 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:46.822 INFO:teuthology.orchestra.run.trial005.stdout:Total 5.0 MB/s | 546 kB 00:00 2026-02-17T21:21:46.822 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:21:46.824 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:21:46.824 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:21:46.843 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:21:46.844 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:21:46.907 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:21:46.925 INFO:teuthology.orchestra.run.trial005.stdout: Installing : rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:46.979 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:47.037 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:47.037 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:47.037 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:21:47.038 INFO:teuthology.orchestra.run.trial005.stdout: rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:47.038 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:47.038 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:21:47.064 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install rbd-mirror-debuginfo 2026-02-17T21:21:47.373 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:05:30 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:21:47.456 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:21:47.457 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:47.457 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repo Size 2026-02-17T21:21:47.457 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:47.457 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:21:47.457 INFO:teuthology.orchestra.run.trial005.stdout: rbd-mirror-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 54 M 2026-02-17T21:21:47.457 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:47.457 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:21:47.457 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:47.458 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:21:47.458 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:47.458 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 54 M 2026-02-17T21:21:47.458 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 353 M 2026-02-17T21:21:47.458 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:21:47.820 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:21:47.838 INFO:teuthology.orchestra.run.trial135.stdout: Installing : rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:21:48.158 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:21:48.215 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:21:48.215 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:48.215 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:21:48.215 INFO:teuthology.orchestra.run.trial135.stdout: rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:48.215 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:48.215 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:21:48.247 DEBUG:teuthology.orchestra.run.trial135:> sudo yum -y install rbd-nbd-debuginfo 2026-02-17T21:21:48.548 INFO:teuthology.orchestra.run.trial005.stdout:rbd-mirror-debuginfo-19.2.3-679.gd855f53b.el9.x 49 MB/s | 54 MB 00:01 2026-02-17T21:21:48.549 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:48.549 INFO:teuthology.orchestra.run.trial005.stdout:Total 49 MB/s | 54 MB 00:01 2026-02-17T21:21:48.549 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:21:48.551 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:21:48.551 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:21:48.552 INFO:teuthology.orchestra.run.trial135.stdout:Last metadata expiration check: 0:05:42 ago on Tue 17 Feb 2026 09:16:06 PM UTC. 2026-02-17T21:21:48.634 INFO:teuthology.orchestra.run.trial135.stdout:Dependencies resolved. 2026-02-17T21:21:48.635 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:48.635 INFO:teuthology.orchestra.run.trial135.stdout: Package Arch Version Repo Size 2026-02-17T21:21:48.635 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:48.635 INFO:teuthology.orchestra.run.trial135.stdout:Installing: 2026-02-17T21:21:48.635 INFO:teuthology.orchestra.run.trial135.stdout: rbd-nbd-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.4 M 2026-02-17T21:21:48.635 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:48.635 INFO:teuthology.orchestra.run.trial135.stdout:Transaction Summary 2026-02-17T21:21:48.635 INFO:teuthology.orchestra.run.trial135.stdout:================================================================================ 2026-02-17T21:21:48.635 INFO:teuthology.orchestra.run.trial135.stdout:Install 1 Package 2026-02-17T21:21:48.635 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:48.635 INFO:teuthology.orchestra.run.trial135.stdout:Total download size: 1.4 M 2026-02-17T21:21:48.635 INFO:teuthology.orchestra.run.trial135.stdout:Installed size: 6.6 M 2026-02-17T21:21:48.635 INFO:teuthology.orchestra.run.trial135.stdout:Downloading Packages: 2026-02-17T21:21:48.725 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:21:48.726 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:21:48.759 INFO:teuthology.orchestra.run.trial135.stdout:rbd-nbd-debuginfo-19.2.3-679.gd855f53b.el9.x86_ 11 MB/s | 1.4 MB 00:00 2026-02-17T21:21:48.759 INFO:teuthology.orchestra.run.trial135.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:48.760 INFO:teuthology.orchestra.run.trial135.stdout:Total 11 MB/s | 1.4 MB 00:00 2026-02-17T21:21:48.760 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction check 2026-02-17T21:21:48.761 INFO:teuthology.orchestra.run.trial135.stdout:Transaction check succeeded. 2026-02-17T21:21:48.761 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction test 2026-02-17T21:21:48.782 INFO:teuthology.orchestra.run.trial135.stdout:Transaction test succeeded. 2026-02-17T21:21:48.783 INFO:teuthology.orchestra.run.trial135.stdout:Running transaction 2026-02-17T21:21:48.886 INFO:teuthology.orchestra.run.trial135.stdout: Preparing : 1/1 2026-02-17T21:21:48.903 INFO:teuthology.orchestra.run.trial135.stdout: Installing : rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:48.964 INFO:teuthology.orchestra.run.trial135.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:49.022 INFO:teuthology.orchestra.run.trial135.stdout: Verifying : rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:49.023 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:49.023 INFO:teuthology.orchestra.run.trial135.stdout:Installed: 2026-02-17T21:21:49.023 INFO:teuthology.orchestra.run.trial135.stdout: rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:49.023 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:49.023 INFO:teuthology.orchestra.run.trial135.stdout:Complete! 2026-02-17T21:21:49.054 DEBUG:teuthology.parallel:result is None 2026-02-17T21:21:51.761 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:21:51.778 INFO:teuthology.orchestra.run.trial005.stdout: Installing : rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:21:52.076 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:21:52.133 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:21:52.134 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:52.134 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:21:52.134 INFO:teuthology.orchestra.run.trial005.stdout: rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:52.134 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:52.134 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:21:52.163 DEBUG:teuthology.orchestra.run.trial005:> sudo yum -y install rbd-nbd-debuginfo 2026-02-17T21:21:52.475 INFO:teuthology.orchestra.run.trial005.stdout:Last metadata expiration check: 0:05:35 ago on Tue 17 Feb 2026 09:16:17 PM UTC. 2026-02-17T21:21:52.558 INFO:teuthology.orchestra.run.trial005.stdout:Dependencies resolved. 2026-02-17T21:21:52.558 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:52.558 INFO:teuthology.orchestra.run.trial005.stdout: Package Arch Version Repo Size 2026-02-17T21:21:52.558 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:52.559 INFO:teuthology.orchestra.run.trial005.stdout:Installing: 2026-02-17T21:21:52.559 INFO:teuthology.orchestra.run.trial005.stdout: rbd-nbd-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.4 M 2026-02-17T21:21:52.559 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:52.559 INFO:teuthology.orchestra.run.trial005.stdout:Transaction Summary 2026-02-17T21:21:52.559 INFO:teuthology.orchestra.run.trial005.stdout:================================================================================ 2026-02-17T21:21:52.559 INFO:teuthology.orchestra.run.trial005.stdout:Install 1 Package 2026-02-17T21:21:52.559 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:52.559 INFO:teuthology.orchestra.run.trial005.stdout:Total download size: 1.4 M 2026-02-17T21:21:52.559 INFO:teuthology.orchestra.run.trial005.stdout:Installed size: 6.6 M 2026-02-17T21:21:52.559 INFO:teuthology.orchestra.run.trial005.stdout:Downloading Packages: 2026-02-17T21:21:52.678 INFO:teuthology.orchestra.run.trial005.stdout:rbd-nbd-debuginfo-19.2.3-679.gd855f53b.el9.x86_ 11 MB/s | 1.4 MB 00:00 2026-02-17T21:21:52.679 INFO:teuthology.orchestra.run.trial005.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:21:52.679 INFO:teuthology.orchestra.run.trial005.stdout:Total 11 MB/s | 1.4 MB 00:00 2026-02-17T21:21:52.679 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction check 2026-02-17T21:21:52.680 INFO:teuthology.orchestra.run.trial005.stdout:Transaction check succeeded. 2026-02-17T21:21:52.680 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction test 2026-02-17T21:21:52.702 INFO:teuthology.orchestra.run.trial005.stdout:Transaction test succeeded. 2026-02-17T21:21:52.702 INFO:teuthology.orchestra.run.trial005.stdout:Running transaction 2026-02-17T21:21:52.807 INFO:teuthology.orchestra.run.trial005.stdout: Preparing : 1/1 2026-02-17T21:21:52.824 INFO:teuthology.orchestra.run.trial005.stdout: Installing : rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:52.886 INFO:teuthology.orchestra.run.trial005.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:52.944 INFO:teuthology.orchestra.run.trial005.stdout: Verifying : rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:21:52.944 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:52.944 INFO:teuthology.orchestra.run.trial005.stdout:Installed: 2026-02-17T21:21:52.944 INFO:teuthology.orchestra.run.trial005.stdout: rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:21:52.944 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:52.945 INFO:teuthology.orchestra.run.trial005.stdout:Complete! 2026-02-17T21:21:52.976 DEBUG:teuthology.parallel:result is None 2026-02-17T21:21:52.977 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d855f53b89fdcec760fd9232a5fb55ed4fb111a1 2026-02-17T21:21:53.142 DEBUG:teuthology.orchestra.run.trial005:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T21:21:53.164 INFO:teuthology.orchestra.run.trial005.stdout:19.2.3-679.gd855f53b.el9 2026-02-17T21:21:53.165 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-679.gd855f53b.el9 2026-02-17T21:21:53.165 INFO:teuthology.task.install:The correct ceph version 19.2.3-679.gd855f53b is installed. 2026-02-17T21:21:53.168 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d855f53b89fdcec760fd9232a5fb55ed4fb111a1 2026-02-17T21:21:53.324 DEBUG:teuthology.orchestra.run.trial119:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T21:21:53.346 INFO:teuthology.orchestra.run.trial119.stdout:19.2.3-679.gd855f53b.el9 2026-02-17T21:21:53.346 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-679.gd855f53b.el9 2026-02-17T21:21:53.346 INFO:teuthology.task.install:The correct ceph version 19.2.3-679.gd855f53b is installed. 2026-02-17T21:21:53.349 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d855f53b89fdcec760fd9232a5fb55ed4fb111a1 2026-02-17T21:21:53.499 DEBUG:teuthology.orchestra.run.trial135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T21:21:53.520 INFO:teuthology.orchestra.run.trial135.stdout:19.2.3-679.gd855f53b.el9 2026-02-17T21:21:53.521 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-679.gd855f53b.el9 2026-02-17T21:21:53.521 INFO:teuthology.task.install:The correct ceph version 19.2.3-679.gd855f53b is installed. 2026-02-17T21:21:53.523 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d855f53b89fdcec760fd9232a5fb55ed4fb111a1 2026-02-17T21:21:53.673 DEBUG:teuthology.orchestra.run.trial176:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T21:21:53.695 INFO:teuthology.orchestra.run.trial176.stdout:19.2.3-679.gd855f53b.el9 2026-02-17T21:21:53.695 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-679.gd855f53b.el9 2026-02-17T21:21:53.695 INFO:teuthology.task.install:The correct ceph version 19.2.3-679.gd855f53b is installed. 2026-02-17T21:21:53.698 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T21:21:53.698 DEBUG:teuthology.orchestra.run.trial005:> set -ex 2026-02-17T21:21:53.698 DEBUG:teuthology.orchestra.run.trial005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T21:21:53.724 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T21:21:53.724 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T21:21:53.750 DEBUG:teuthology.orchestra.run.trial135:> set -ex 2026-02-17T21:21:53.750 DEBUG:teuthology.orchestra.run.trial135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T21:21:53.777 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T21:21:53.777 DEBUG:teuthology.orchestra.run.trial176:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T21:21:53.803 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T21:21:53.803 DEBUG:teuthology.orchestra.run.trial005:> set -ex 2026-02-17T21:21:53.804 DEBUG:teuthology.orchestra.run.trial005:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T21:21:53.829 DEBUG:teuthology.orchestra.run.trial005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T21:21:53.893 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T21:21:53.894 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T21:21:53.919 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T21:21:53.985 DEBUG:teuthology.orchestra.run.trial135:> set -ex 2026-02-17T21:21:53.985 DEBUG:teuthology.orchestra.run.trial135:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T21:21:54.011 DEBUG:teuthology.orchestra.run.trial135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T21:21:54.076 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T21:21:54.076 DEBUG:teuthology.orchestra.run.trial176:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T21:21:54.101 DEBUG:teuthology.orchestra.run.trial176:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T21:21:54.165 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T21:21:54.165 DEBUG:teuthology.orchestra.run.trial005:> set -ex 2026-02-17T21:21:54.165 DEBUG:teuthology.orchestra.run.trial005:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T21:21:54.189 DEBUG:teuthology.orchestra.run.trial005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T21:21:54.253 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T21:21:54.253 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T21:21:54.279 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T21:21:54.343 DEBUG:teuthology.orchestra.run.trial135:> set -ex 2026-02-17T21:21:54.343 DEBUG:teuthology.orchestra.run.trial135:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T21:21:54.367 DEBUG:teuthology.orchestra.run.trial135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T21:21:54.432 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T21:21:54.432 DEBUG:teuthology.orchestra.run.trial176:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T21:21:54.458 DEBUG:teuthology.orchestra.run.trial176:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T21:21:54.522 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T21:21:54.523 DEBUG:teuthology.orchestra.run.trial005:> set -ex 2026-02-17T21:21:54.523 DEBUG:teuthology.orchestra.run.trial005:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T21:21:54.549 DEBUG:teuthology.orchestra.run.trial005:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T21:21:54.612 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T21:21:54.613 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T21:21:54.638 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T21:21:54.701 DEBUG:teuthology.orchestra.run.trial135:> set -ex 2026-02-17T21:21:54.702 DEBUG:teuthology.orchestra.run.trial135:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T21:21:54.727 DEBUG:teuthology.orchestra.run.trial135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T21:21:54.793 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T21:21:54.793 DEBUG:teuthology.orchestra.run.trial176:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T21:21:54.818 DEBUG:teuthology.orchestra.run.trial176:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T21:21:54.884 INFO:teuthology.run_tasks:Running task ceph... 2026-02-17T21:21:55.000 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-17T21:21:55.000 DEBUG:teuthology.orchestra.run.trial005:> sudo chmod 777 /var/log/ceph 2026-02-17T21:21:55.002 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod 777 /var/log/ceph 2026-02-17T21:21:55.004 DEBUG:teuthology.orchestra.run.trial135:> sudo chmod 777 /var/log/ceph 2026-02-17T21:21:55.005 DEBUG:teuthology.orchestra.run.trial176:> sudo chmod 777 /var/log/ceph 2026-02-17T21:21:55.029 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-17T21:21:55.029 DEBUG:teuthology.orchestra.run.trial005:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T21:21:55.066 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T21:21:55.068 DEBUG:teuthology.orchestra.run.trial135:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T21:21:55.070 DEBUG:teuthology.orchestra.run.trial176:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T21:21:55.093 INFO:tasks.ceph:Creating extra log directories... 2026-02-17T21:21:55.093 DEBUG:teuthology.orchestra.run.trial005:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T21:21:55.129 DEBUG:teuthology.orchestra.run.trial119:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T21:21:55.130 DEBUG:teuthology.orchestra.run.trial135:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T21:21:55.133 DEBUG:teuthology.orchestra.run.trial176:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T21:21:55.166 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-17T21:21:55.167 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', 'OSD bench result'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-17T21:21:55.167 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53902', 'branch': 'wip-yuri6-testing-2026-02-17-1732-squid', 'description': 'rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind}', 'email': None, 'first_in_suite': False, 'flavor': 'default', 'job_id': '53902', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri6-testing-2026-02-17-1732-squid'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', 'OSD bench result'], 'sha1': 'd855f53b89fdcec760fd9232a5fb55ed4fb111a1', 'stop-daemons-timeout': 1200, 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'd855f53b89fdcec760fd9232a5fb55ed4fb111a1'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri6-testing-2026-02-17-1732-squid', 'sha1': 'd855f53b89fdcec760fd9232a5fb55ed4fb111a1'}}, 'owner': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'], ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'], ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'], ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0']], 'seed': 2987, 'sha1': 'd855f53b89fdcec760fd9232a5fb55ed4fb111a1', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri6-testing-2026-02-17-1732-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'd855f53b89fdcec760fd9232a5fb55ed4fb111a1', 'targets': {'trial005.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIbBzjCl5jjcVxcum2l11FvJYPRMYGVICtOnxjjUeVXVZxSkimDH5nuyWI5nmxwKm499JWuozUWHy6FJWVDVp2I=', 'trial119.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNoEGeFq8aMsJVhcfasn4xIX1O4cFT4F+pOUthAjKWqpvco2UUfFZMVSEgLlLZPymfAJ/+Hi7iATbDPAdkCa0VM=', 'trial135.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBb94oSTPjlu7RURV7ty8IS6V01lskewUwsOpSay9jtRVVDzUGFR+RDcl22Am+9igPvcpn73okxnTa78AdyVkDc=', 'trial176.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIIgB2Egc9wWA8Dddrue98c3pwAjnOeSAyrNUeYnQS3u/FTb1aHthG45iTLgznnLHVK5oEqiqTiTH7u0Y5HsstE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'workunit': {'clients': {'client.0': ['rados/test.sh']}, 'env': {'ALLOW_TIMEOUTS': '1'}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["-- Don't run this test on tiny clusters\nif py_len(yaml.roles) < 4 then reject() end\n"]}, 'teuthology_branch': 'reimage-ssh-down', 'teuthology_sha1': '5f66ecfb34c0370410e78b3ee641753d19da653b', 'timestamp': '2026-02-17_20:43:43', 'tube': 'trial', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682'} 2026-02-17T21:21:55.167 DEBUG:teuthology.orchestra.run.trial005:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T21:21:55.194 DEBUG:teuthology.orchestra.run.trial119:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T21:21:55.196 DEBUG:teuthology.orchestra.run.trial135:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T21:21:55.198 DEBUG:teuthology.orchestra.run.trial176:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T21:21:55.214 DEBUG:teuthology.orchestra.run.trial005:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T21:21:55.251 DEBUG:teuthology.orchestra.run.trial119:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T21:21:55.253 DEBUG:teuthology.orchestra.run.trial135:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T21:21:55.254 DEBUG:teuthology.orchestra.run.trial176:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T21:21:55.278 DEBUG:teuthology.orchestra.run.trial005:> set -ex 2026-02-17T21:21:55.278 DEBUG:teuthology.orchestra.run.trial005:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T21:21:55.331 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T21:21:55.331 DEBUG:teuthology.orchestra.run.trial005:> stat /dev/vg_nvme/lv_1 2026-02-17T21:21:55.387 INFO:teuthology.orchestra.run.trial005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T21:21:55.387 INFO:teuthology.orchestra.run.trial005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:21:55.387 INFO:teuthology.orchestra.run.trial005.stdout:Device: 6h/6d Inode: 1304 Links: 1 2026-02-17T21:21:55.387 INFO:teuthology.orchestra.run.trial005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:21:55.387 INFO:teuthology.orchestra.run.trial005.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:21:55.387 INFO:teuthology.orchestra.run.trial005.stdout:Access: 2026-02-17 21:16:57.408732896 +0000 2026-02-17T21:21:55.387 INFO:teuthology.orchestra.run.trial005.stdout:Modify: 2026-02-17 21:16:23.473567064 +0000 2026-02-17T21:21:55.387 INFO:teuthology.orchestra.run.trial005.stdout:Change: 2026-02-17 21:16:23.473567064 +0000 2026-02-17T21:21:55.388 INFO:teuthology.orchestra.run.trial005.stdout: Birth: 2026-02-17 21:16:23.473567064 +0000 2026-02-17T21:21:55.388 DEBUG:teuthology.orchestra.run.trial005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T21:21:55.451 INFO:teuthology.orchestra.run.trial005.stderr:1+0 records in 2026-02-17T21:21:55.451 INFO:teuthology.orchestra.run.trial005.stderr:1+0 records out 2026-02-17T21:21:55.451 INFO:teuthology.orchestra.run.trial005.stderr:512 bytes copied, 0.000224757 s, 2.3 MB/s 2026-02-17T21:21:55.452 DEBUG:teuthology.orchestra.run.trial005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T21:21:55.509 DEBUG:teuthology.orchestra.run.trial005:> stat /dev/vg_nvme/lv_2 2026-02-17T21:21:55.566 INFO:teuthology.orchestra.run.trial005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T21:21:55.566 INFO:teuthology.orchestra.run.trial005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:21:55.566 INFO:teuthology.orchestra.run.trial005.stdout:Device: 6h/6d Inode: 1313 Links: 1 2026-02-17T21:21:55.566 INFO:teuthology.orchestra.run.trial005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:21:55.566 INFO:teuthology.orchestra.run.trial005.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:21:55.567 INFO:teuthology.orchestra.run.trial005.stdout:Access: 2026-02-17 21:16:57.409732872 +0000 2026-02-17T21:21:55.567 INFO:teuthology.orchestra.run.trial005.stdout:Modify: 2026-02-17 21:16:23.474567039 +0000 2026-02-17T21:21:55.567 INFO:teuthology.orchestra.run.trial005.stdout:Change: 2026-02-17 21:16:23.474567039 +0000 2026-02-17T21:21:55.567 INFO:teuthology.orchestra.run.trial005.stdout: Birth: 2026-02-17 21:16:23.474567039 +0000 2026-02-17T21:21:55.567 DEBUG:teuthology.orchestra.run.trial005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T21:21:55.629 INFO:teuthology.orchestra.run.trial005.stderr:1+0 records in 2026-02-17T21:21:55.629 INFO:teuthology.orchestra.run.trial005.stderr:1+0 records out 2026-02-17T21:21:55.630 INFO:teuthology.orchestra.run.trial005.stderr:512 bytes copied, 0.000239154 s, 2.1 MB/s 2026-02-17T21:21:55.631 DEBUG:teuthology.orchestra.run.trial005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T21:21:55.689 DEBUG:teuthology.orchestra.run.trial005:> stat /dev/vg_nvme/lv_3 2026-02-17T21:21:55.746 INFO:teuthology.orchestra.run.trial005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T21:21:55.746 INFO:teuthology.orchestra.run.trial005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:21:55.746 INFO:teuthology.orchestra.run.trial005.stdout:Device: 6h/6d Inode: 1305 Links: 1 2026-02-17T21:21:55.746 INFO:teuthology.orchestra.run.trial005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:21:55.746 INFO:teuthology.orchestra.run.trial005.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:21:55.746 INFO:teuthology.orchestra.run.trial005.stdout:Access: 2026-02-17 21:16:57.409732872 +0000 2026-02-17T21:21:55.746 INFO:teuthology.orchestra.run.trial005.stdout:Modify: 2026-02-17 21:16:23.473567064 +0000 2026-02-17T21:21:55.746 INFO:teuthology.orchestra.run.trial005.stdout:Change: 2026-02-17 21:16:23.473567064 +0000 2026-02-17T21:21:55.747 INFO:teuthology.orchestra.run.trial005.stdout: Birth: 2026-02-17 21:16:23.473567064 +0000 2026-02-17T21:21:55.747 DEBUG:teuthology.orchestra.run.trial005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T21:21:55.810 INFO:teuthology.orchestra.run.trial005.stderr:1+0 records in 2026-02-17T21:21:55.810 INFO:teuthology.orchestra.run.trial005.stderr:1+0 records out 2026-02-17T21:21:55.810 INFO:teuthology.orchestra.run.trial005.stderr:512 bytes copied, 0.000171268 s, 3.0 MB/s 2026-02-17T21:21:55.811 DEBUG:teuthology.orchestra.run.trial005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T21:21:55.869 DEBUG:teuthology.orchestra.run.trial005:> stat /dev/vg_nvme/lv_4 2026-02-17T21:21:55.925 INFO:teuthology.orchestra.run.trial005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T21:21:55.926 INFO:teuthology.orchestra.run.trial005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:21:55.926 INFO:teuthology.orchestra.run.trial005.stdout:Device: 6h/6d Inode: 1312 Links: 1 2026-02-17T21:21:55.926 INFO:teuthology.orchestra.run.trial005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:21:55.926 INFO:teuthology.orchestra.run.trial005.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:21:55.926 INFO:teuthology.orchestra.run.trial005.stdout:Access: 2026-02-17 21:16:57.409732872 +0000 2026-02-17T21:21:55.926 INFO:teuthology.orchestra.run.trial005.stdout:Modify: 2026-02-17 21:16:23.474567039 +0000 2026-02-17T21:21:55.926 INFO:teuthology.orchestra.run.trial005.stdout:Change: 2026-02-17 21:16:23.474567039 +0000 2026-02-17T21:21:55.926 INFO:teuthology.orchestra.run.trial005.stdout: Birth: 2026-02-17 21:16:23.474567039 +0000 2026-02-17T21:21:55.927 DEBUG:teuthology.orchestra.run.trial005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T21:21:55.988 INFO:teuthology.orchestra.run.trial005.stderr:1+0 records in 2026-02-17T21:21:55.988 INFO:teuthology.orchestra.run.trial005.stderr:1+0 records out 2026-02-17T21:21:55.988 INFO:teuthology.orchestra.run.trial005.stderr:512 bytes copied, 0.000153154 s, 3.3 MB/s 2026-02-17T21:21:55.989 DEBUG:teuthology.orchestra.run.trial005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T21:21:56.046 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-17T21:21:56.046 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T21:21:56.046 DEBUG:teuthology.orchestra.run.trial119:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T21:21:56.065 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T21:21:56.065 DEBUG:teuthology.orchestra.run.trial119:> stat /dev/vg_nvme/lv_1 2026-02-17T21:21:56.121 INFO:teuthology.orchestra.run.trial119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T21:21:56.122 INFO:teuthology.orchestra.run.trial119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:21:56.122 INFO:teuthology.orchestra.run.trial119.stdout:Device: 6h/6d Inode: 1310 Links: 1 2026-02-17T21:21:56.122 INFO:teuthology.orchestra.run.trial119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:21:56.122 INFO:teuthology.orchestra.run.trial119.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:21:56.122 INFO:teuthology.orchestra.run.trial119.stdout:Access: 2026-02-17 21:16:47.966219474 +0000 2026-02-17T21:21:56.122 INFO:teuthology.orchestra.run.trial119.stdout:Modify: 2026-02-17 21:16:10.626431528 +0000 2026-02-17T21:21:56.122 INFO:teuthology.orchestra.run.trial119.stdout:Change: 2026-02-17 21:16:10.626431528 +0000 2026-02-17T21:21:56.122 INFO:teuthology.orchestra.run.trial119.stdout: Birth: 2026-02-17 21:16:10.626431528 +0000 2026-02-17T21:21:56.123 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T21:21:56.183 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records in 2026-02-17T21:21:56.183 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records out 2026-02-17T21:21:56.184 INFO:teuthology.orchestra.run.trial119.stderr:512 bytes copied, 0.000157583 s, 3.2 MB/s 2026-02-17T21:21:56.185 DEBUG:teuthology.orchestra.run.trial119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T21:21:56.243 DEBUG:teuthology.orchestra.run.trial119:> stat /dev/vg_nvme/lv_2 2026-02-17T21:21:56.299 INFO:teuthology.orchestra.run.trial119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T21:21:56.300 INFO:teuthology.orchestra.run.trial119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:21:56.300 INFO:teuthology.orchestra.run.trial119.stdout:Device: 6h/6d Inode: 1302 Links: 1 2026-02-17T21:21:56.300 INFO:teuthology.orchestra.run.trial119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:21:56.300 INFO:teuthology.orchestra.run.trial119.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:21:56.300 INFO:teuthology.orchestra.run.trial119.stdout:Access: 2026-02-17 21:16:47.966219474 +0000 2026-02-17T21:21:56.300 INFO:teuthology.orchestra.run.trial119.stdout:Modify: 2026-02-17 21:16:10.625431561 +0000 2026-02-17T21:21:56.300 INFO:teuthology.orchestra.run.trial119.stdout:Change: 2026-02-17 21:16:10.625431561 +0000 2026-02-17T21:21:56.300 INFO:teuthology.orchestra.run.trial119.stdout: Birth: 2026-02-17 21:16:10.625431561 +0000 2026-02-17T21:21:56.301 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T21:21:56.363 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records in 2026-02-17T21:21:56.363 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records out 2026-02-17T21:21:56.363 INFO:teuthology.orchestra.run.trial119.stderr:512 bytes copied, 0.000152273 s, 3.4 MB/s 2026-02-17T21:21:56.364 DEBUG:teuthology.orchestra.run.trial119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T21:21:56.422 DEBUG:teuthology.orchestra.run.trial119:> stat /dev/vg_nvme/lv_3 2026-02-17T21:21:56.479 INFO:teuthology.orchestra.run.trial119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T21:21:56.479 INFO:teuthology.orchestra.run.trial119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:21:56.479 INFO:teuthology.orchestra.run.trial119.stdout:Device: 6h/6d Inode: 1312 Links: 1 2026-02-17T21:21:56.479 INFO:teuthology.orchestra.run.trial119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:21:56.479 INFO:teuthology.orchestra.run.trial119.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:21:56.479 INFO:teuthology.orchestra.run.trial119.stdout:Access: 2026-02-17 21:16:47.967219441 +0000 2026-02-17T21:21:56.479 INFO:teuthology.orchestra.run.trial119.stdout:Modify: 2026-02-17 21:16:10.626431528 +0000 2026-02-17T21:21:56.479 INFO:teuthology.orchestra.run.trial119.stdout:Change: 2026-02-17 21:16:10.626431528 +0000 2026-02-17T21:21:56.480 INFO:teuthology.orchestra.run.trial119.stdout: Birth: 2026-02-17 21:16:10.626431528 +0000 2026-02-17T21:21:56.480 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T21:21:56.541 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records in 2026-02-17T21:21:56.542 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records out 2026-02-17T21:21:56.542 INFO:teuthology.orchestra.run.trial119.stderr:512 bytes copied, 0.00015574 s, 3.3 MB/s 2026-02-17T21:21:56.543 DEBUG:teuthology.orchestra.run.trial119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T21:21:56.601 DEBUG:teuthology.orchestra.run.trial119:> stat /dev/vg_nvme/lv_4 2026-02-17T21:21:56.659 INFO:teuthology.orchestra.run.trial119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T21:21:56.671 INFO:teuthology.orchestra.run.trial119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:21:56.671 INFO:teuthology.orchestra.run.trial119.stdout:Device: 6h/6d Inode: 1294 Links: 1 2026-02-17T21:21:56.671 INFO:teuthology.orchestra.run.trial119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:21:56.671 INFO:teuthology.orchestra.run.trial119.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:21:56.671 INFO:teuthology.orchestra.run.trial119.stdout:Access: 2026-02-17 21:16:47.967219441 +0000 2026-02-17T21:21:56.671 INFO:teuthology.orchestra.run.trial119.stdout:Modify: 2026-02-17 21:16:10.625431561 +0000 2026-02-17T21:21:56.671 INFO:teuthology.orchestra.run.trial119.stdout:Change: 2026-02-17 21:16:10.625431561 +0000 2026-02-17T21:21:56.671 INFO:teuthology.orchestra.run.trial119.stdout: Birth: 2026-02-17 21:16:10.625431561 +0000 2026-02-17T21:21:56.672 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T21:21:56.726 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records in 2026-02-17T21:21:56.726 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records out 2026-02-17T21:21:56.726 INFO:teuthology.orchestra.run.trial119.stderr:512 bytes copied, 0.000145882 s, 3.5 MB/s 2026-02-17T21:21:56.727 DEBUG:teuthology.orchestra.run.trial119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T21:21:56.789 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-17T21:21:56.789 DEBUG:teuthology.orchestra.run.trial135:> set -ex 2026-02-17T21:21:56.789 DEBUG:teuthology.orchestra.run.trial135:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T21:21:56.809 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T21:21:56.809 DEBUG:teuthology.orchestra.run.trial135:> stat /dev/vg_nvme/lv_1 2026-02-17T21:21:56.865 INFO:teuthology.orchestra.run.trial135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T21:21:56.865 INFO:teuthology.orchestra.run.trial135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:21:56.865 INFO:teuthology.orchestra.run.trial135.stdout:Device: 6h/6d Inode: 1314 Links: 1 2026-02-17T21:21:56.865 INFO:teuthology.orchestra.run.trial135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:21:56.865 INFO:teuthology.orchestra.run.trial135.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:21:56.866 INFO:teuthology.orchestra.run.trial135.stdout:Access: 2026-02-17 21:16:47.016602070 +0000 2026-02-17T21:21:56.866 INFO:teuthology.orchestra.run.trial135.stdout:Modify: 2026-02-17 21:16:11.570471230 +0000 2026-02-17T21:21:56.866 INFO:teuthology.orchestra.run.trial135.stdout:Change: 2026-02-17 21:16:11.570471230 +0000 2026-02-17T21:21:56.866 INFO:teuthology.orchestra.run.trial135.stdout: Birth: 2026-02-17 21:16:11.570471230 +0000 2026-02-17T21:21:56.866 DEBUG:teuthology.orchestra.run.trial135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T21:21:56.929 INFO:teuthology.orchestra.run.trial135.stderr:1+0 records in 2026-02-17T21:21:56.929 INFO:teuthology.orchestra.run.trial135.stderr:1+0 records out 2026-02-17T21:21:56.929 INFO:teuthology.orchestra.run.trial135.stderr:512 bytes copied, 0.000168797 s, 3.0 MB/s 2026-02-17T21:21:56.931 DEBUG:teuthology.orchestra.run.trial135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T21:21:56.987 DEBUG:teuthology.orchestra.run.trial135:> stat /dev/vg_nvme/lv_2 2026-02-17T21:21:57.045 INFO:teuthology.orchestra.run.trial135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T21:21:57.045 INFO:teuthology.orchestra.run.trial135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:21:57.045 INFO:teuthology.orchestra.run.trial135.stdout:Device: 6h/6d Inode: 1294 Links: 1 2026-02-17T21:21:57.045 INFO:teuthology.orchestra.run.trial135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:21:57.045 INFO:teuthology.orchestra.run.trial135.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:21:57.045 INFO:teuthology.orchestra.run.trial135.stdout:Access: 2026-02-17 21:16:47.016602070 +0000 2026-02-17T21:21:57.045 INFO:teuthology.orchestra.run.trial135.stdout:Modify: 2026-02-17 21:16:11.570471230 +0000 2026-02-17T21:21:57.045 INFO:teuthology.orchestra.run.trial135.stdout:Change: 2026-02-17 21:16:11.570471230 +0000 2026-02-17T21:21:57.045 INFO:teuthology.orchestra.run.trial135.stdout: Birth: 2026-02-17 21:16:11.570471230 +0000 2026-02-17T21:21:57.045 DEBUG:teuthology.orchestra.run.trial135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T21:21:57.108 INFO:teuthology.orchestra.run.trial135.stderr:1+0 records in 2026-02-17T21:21:57.108 INFO:teuthology.orchestra.run.trial135.stderr:1+0 records out 2026-02-17T21:21:57.108 INFO:teuthology.orchestra.run.trial135.stderr:512 bytes copied, 0.000143449 s, 3.6 MB/s 2026-02-17T21:21:57.110 DEBUG:teuthology.orchestra.run.trial135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T21:21:57.166 DEBUG:teuthology.orchestra.run.trial135:> stat /dev/vg_nvme/lv_3 2026-02-17T21:21:57.225 INFO:teuthology.orchestra.run.trial135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T21:21:57.225 INFO:teuthology.orchestra.run.trial135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:21:57.225 INFO:teuthology.orchestra.run.trial135.stdout:Device: 6h/6d Inode: 1310 Links: 1 2026-02-17T21:21:57.226 INFO:teuthology.orchestra.run.trial135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:21:57.226 INFO:teuthology.orchestra.run.trial135.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:21:57.226 INFO:teuthology.orchestra.run.trial135.stdout:Access: 2026-02-17 21:16:47.017602047 +0000 2026-02-17T21:21:57.226 INFO:teuthology.orchestra.run.trial135.stdout:Modify: 2026-02-17 21:16:11.570471230 +0000 2026-02-17T21:21:57.226 INFO:teuthology.orchestra.run.trial135.stdout:Change: 2026-02-17 21:16:11.570471230 +0000 2026-02-17T21:21:57.226 INFO:teuthology.orchestra.run.trial135.stdout: Birth: 2026-02-17 21:16:11.570471230 +0000 2026-02-17T21:21:57.227 DEBUG:teuthology.orchestra.run.trial135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T21:21:57.288 INFO:teuthology.orchestra.run.trial135.stderr:1+0 records in 2026-02-17T21:21:57.289 INFO:teuthology.orchestra.run.trial135.stderr:1+0 records out 2026-02-17T21:21:57.289 INFO:teuthology.orchestra.run.trial135.stderr:512 bytes copied, 0.000146485 s, 3.5 MB/s 2026-02-17T21:21:57.290 DEBUG:teuthology.orchestra.run.trial135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T21:21:57.346 DEBUG:teuthology.orchestra.run.trial135:> stat /dev/vg_nvme/lv_4 2026-02-17T21:21:57.403 INFO:teuthology.orchestra.run.trial135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T21:21:57.403 INFO:teuthology.orchestra.run.trial135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:21:57.403 INFO:teuthology.orchestra.run.trial135.stdout:Device: 6h/6d Inode: 1295 Links: 1 2026-02-17T21:21:57.403 INFO:teuthology.orchestra.run.trial135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:21:57.403 INFO:teuthology.orchestra.run.trial135.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:21:57.403 INFO:teuthology.orchestra.run.trial135.stdout:Access: 2026-02-17 21:16:47.017602047 +0000 2026-02-17T21:21:57.403 INFO:teuthology.orchestra.run.trial135.stdout:Modify: 2026-02-17 21:16:11.570471230 +0000 2026-02-17T21:21:57.403 INFO:teuthology.orchestra.run.trial135.stdout:Change: 2026-02-17 21:16:11.570471230 +0000 2026-02-17T21:21:57.403 INFO:teuthology.orchestra.run.trial135.stdout: Birth: 2026-02-17 21:16:11.570471230 +0000 2026-02-17T21:21:57.403 DEBUG:teuthology.orchestra.run.trial135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T21:21:57.467 INFO:teuthology.orchestra.run.trial135.stderr:1+0 records in 2026-02-17T21:21:57.467 INFO:teuthology.orchestra.run.trial135.stderr:1+0 records out 2026-02-17T21:21:57.467 INFO:teuthology.orchestra.run.trial135.stderr:512 bytes copied, 0.000144602 s, 3.5 MB/s 2026-02-17T21:21:57.468 DEBUG:teuthology.orchestra.run.trial135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T21:21:57.526 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-17T21:21:57.526 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T21:21:57.526 DEBUG:teuthology.orchestra.run.trial176:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T21:21:57.544 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T21:21:57.544 DEBUG:teuthology.orchestra.run.trial176:> stat /dev/vg_nvme/lv_1 2026-02-17T21:21:57.600 INFO:teuthology.orchestra.run.trial176.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T21:21:57.600 INFO:teuthology.orchestra.run.trial176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:21:57.600 INFO:teuthology.orchestra.run.trial176.stdout:Device: 6h/6d Inode: 1304 Links: 1 2026-02-17T21:21:57.600 INFO:teuthology.orchestra.run.trial176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:21:57.600 INFO:teuthology.orchestra.run.trial176.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:21:57.600 INFO:teuthology.orchestra.run.trial176.stdout:Access: 2026-02-17 21:16:51.765673189 +0000 2026-02-17T21:21:57.600 INFO:teuthology.orchestra.run.trial176.stdout:Modify: 2026-02-17 21:16:17.271486152 +0000 2026-02-17T21:21:57.600 INFO:teuthology.orchestra.run.trial176.stdout:Change: 2026-02-17 21:16:17.271486152 +0000 2026-02-17T21:21:57.600 INFO:teuthology.orchestra.run.trial176.stdout: Birth: 2026-02-17 21:16:17.271486152 +0000 2026-02-17T21:21:57.601 DEBUG:teuthology.orchestra.run.trial176:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T21:21:57.664 INFO:teuthology.orchestra.run.trial176.stderr:1+0 records in 2026-02-17T21:21:57.665 INFO:teuthology.orchestra.run.trial176.stderr:1+0 records out 2026-02-17T21:21:57.665 INFO:teuthology.orchestra.run.trial176.stderr:512 bytes copied, 0.0002308 s, 2.2 MB/s 2026-02-17T21:21:57.666 DEBUG:teuthology.orchestra.run.trial176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T21:21:57.725 DEBUG:teuthology.orchestra.run.trial176:> stat /dev/vg_nvme/lv_2 2026-02-17T21:21:57.783 INFO:teuthology.orchestra.run.trial176.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T21:21:57.784 INFO:teuthology.orchestra.run.trial176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:21:57.784 INFO:teuthology.orchestra.run.trial176.stdout:Device: 6h/6d Inode: 1303 Links: 1 2026-02-17T21:21:57.784 INFO:teuthology.orchestra.run.trial176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:21:57.784 INFO:teuthology.orchestra.run.trial176.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:21:57.785 INFO:teuthology.orchestra.run.trial176.stdout:Access: 2026-02-17 21:16:51.765673189 +0000 2026-02-17T21:21:57.785 INFO:teuthology.orchestra.run.trial176.stdout:Modify: 2026-02-17 21:16:17.271486152 +0000 2026-02-17T21:21:57.785 INFO:teuthology.orchestra.run.trial176.stdout:Change: 2026-02-17 21:16:17.271486152 +0000 2026-02-17T21:21:57.785 INFO:teuthology.orchestra.run.trial176.stdout: Birth: 2026-02-17 21:16:17.271486152 +0000 2026-02-17T21:21:57.785 DEBUG:teuthology.orchestra.run.trial176:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T21:21:57.847 INFO:teuthology.orchestra.run.trial176.stderr:1+0 records in 2026-02-17T21:21:57.847 INFO:teuthology.orchestra.run.trial176.stderr:1+0 records out 2026-02-17T21:21:57.848 INFO:teuthology.orchestra.run.trial176.stderr:512 bytes copied, 0.000235018 s, 2.2 MB/s 2026-02-17T21:21:57.849 DEBUG:teuthology.orchestra.run.trial176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T21:21:57.906 DEBUG:teuthology.orchestra.run.trial176:> stat /dev/vg_nvme/lv_3 2026-02-17T21:21:57.964 INFO:teuthology.orchestra.run.trial176.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T21:21:57.964 INFO:teuthology.orchestra.run.trial176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:21:57.965 INFO:teuthology.orchestra.run.trial176.stdout:Device: 6h/6d Inode: 1298 Links: 1 2026-02-17T21:21:57.965 INFO:teuthology.orchestra.run.trial176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:21:57.965 INFO:teuthology.orchestra.run.trial176.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:21:57.965 INFO:teuthology.orchestra.run.trial176.stdout:Access: 2026-02-17 21:16:51.765673189 +0000 2026-02-17T21:21:57.965 INFO:teuthology.orchestra.run.trial176.stdout:Modify: 2026-02-17 21:16:17.271486152 +0000 2026-02-17T21:21:57.965 INFO:teuthology.orchestra.run.trial176.stdout:Change: 2026-02-17 21:16:17.271486152 +0000 2026-02-17T21:21:57.965 INFO:teuthology.orchestra.run.trial176.stdout: Birth: 2026-02-17 21:16:17.271486152 +0000 2026-02-17T21:21:57.966 DEBUG:teuthology.orchestra.run.trial176:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T21:21:58.027 INFO:teuthology.orchestra.run.trial176.stderr:1+0 records in 2026-02-17T21:21:58.027 INFO:teuthology.orchestra.run.trial176.stderr:1+0 records out 2026-02-17T21:21:58.027 INFO:teuthology.orchestra.run.trial176.stderr:512 bytes copied, 0.000148176 s, 3.5 MB/s 2026-02-17T21:21:58.028 DEBUG:teuthology.orchestra.run.trial176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T21:21:58.085 DEBUG:teuthology.orchestra.run.trial176:> stat /dev/vg_nvme/lv_4 2026-02-17T21:21:58.141 INFO:teuthology.orchestra.run.trial176.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T21:21:58.142 INFO:teuthology.orchestra.run.trial176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:21:58.142 INFO:teuthology.orchestra.run.trial176.stdout:Device: 6h/6d Inode: 1306 Links: 1 2026-02-17T21:21:58.142 INFO:teuthology.orchestra.run.trial176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:21:58.142 INFO:teuthology.orchestra.run.trial176.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:21:58.142 INFO:teuthology.orchestra.run.trial176.stdout:Access: 2026-02-17 21:16:51.766673164 +0000 2026-02-17T21:21:58.142 INFO:teuthology.orchestra.run.trial176.stdout:Modify: 2026-02-17 21:16:17.271486152 +0000 2026-02-17T21:21:58.142 INFO:teuthology.orchestra.run.trial176.stdout:Change: 2026-02-17 21:16:17.271486152 +0000 2026-02-17T21:21:58.142 INFO:teuthology.orchestra.run.trial176.stdout: Birth: 2026-02-17 21:16:17.271486152 +0000 2026-02-17T21:21:58.143 DEBUG:teuthology.orchestra.run.trial176:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T21:21:58.207 INFO:teuthology.orchestra.run.trial176.stderr:1+0 records in 2026-02-17T21:21:58.207 INFO:teuthology.orchestra.run.trial176.stderr:1+0 records out 2026-02-17T21:21:58.207 INFO:teuthology.orchestra.run.trial176.stderr:512 bytes copied, 0.000132577 s, 3.9 MB/s 2026-02-17T21:21:58.208 DEBUG:teuthology.orchestra.run.trial176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T21:21:58.265 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-17T21:21:58.266 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial119.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial135.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial176.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2026-02-17T21:21:58.266 INFO:tasks.ceph:Generating config... 2026-02-17T21:21:58.268 INFO:tasks.ceph:[client] debug monc = 20 2026-02-17T21:21:58.269 INFO:tasks.ceph:[client] debug ms = 1 2026-02-17T21:21:58.269 INFO:tasks.ceph:[client] debug objecter = 20 2026-02-17T21:21:58.269 INFO:tasks.ceph:[client] debug rados = 20 2026-02-17T21:21:58.269 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-17T21:21:58.269 INFO:tasks.ceph:[global] mon election default strategy = 1 2026-02-17T21:21:58.269 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2026-02-17T21:21:58.269 INFO:tasks.ceph:[global] ms type = async 2026-02-17T21:21:58.269 INFO:tasks.ceph:[global] osd heartbeat grace = 160 2026-02-17T21:21:58.269 INFO:tasks.ceph:[global] osd op thread timeout = 150 2026-02-17T21:21:58.269 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-17T21:21:58.269 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-17T21:21:58.270 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-17T21:21:58.270 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-17T21:21:58.270 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-17T21:21:58.270 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2026-02-17T21:21:58.270 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2026-02-17T21:21:58.270 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-17T21:21:58.270 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-17T21:21:58.270 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-17T21:21:58.270 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-17T21:21:58.270 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2026-02-17T21:21:58.270 INFO:tasks.ceph:[mon] paxos service trim min = 10 2026-02-17T21:21:58.270 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-17T21:21:58.271 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-17T21:21:58.271 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-17T21:21:58.271 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-17T21:21:58.271 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-17T21:21:58.271 INFO:tasks.ceph:[osd] debug bluefs = 1 2026-02-17T21:21:58.271 INFO:tasks.ceph:[osd] debug bluestore = 1 2026-02-17T21:21:58.271 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-17T21:21:58.271 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-17T21:21:58.271 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-17T21:21:58.271 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-17T21:21:58.271 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-17T21:21:58.271 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-17T21:21:58.272 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-17T21:21:58.272 INFO:tasks.ceph:[osd] osd class default list = * 2026-02-17T21:21:58.272 INFO:tasks.ceph:[osd] osd class load list = * 2026-02-17T21:21:58.272 INFO:tasks.ceph:[osd] osd client watch timeout = 240 2026-02-17T21:21:58.272 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-17T21:21:58.272 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-17T21:21:58.272 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-17T21:21:58.272 INFO:tasks.ceph:[osd] osd fast shutdown = False 2026-02-17T21:21:58.272 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-17T21:21:58.272 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-17T21:21:58.272 INFO:tasks.ceph:[osd] osd memory target = 1610612736 2026-02-17T21:21:58.272 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-17T21:21:58.272 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-17T21:21:58.273 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-17T21:21:58.273 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-17T21:21:58.273 INFO:tasks.ceph:Setting up mon.a... 2026-02-17T21:21:58.273 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-17T21:21:58.309 INFO:teuthology.orchestra.run.trial005.stdout:creating /etc/ceph/ceph.keyring 2026-02-17T21:21:58.312 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-17T21:21:58.390 DEBUG:teuthology.orchestra.run.trial005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T21:21:58.454 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.5'), ('mon.b', '10.20.193.119'), ('mon.c', '10.20.193.135')] 2026-02-17T21:21:58.455 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.5,10.20.193.119,10.20.193.135', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}} 2026-02-17T21:21:58.456 DEBUG:teuthology.orchestra.run.trial005:> set -ex 2026-02-17T21:21:58.456 DEBUG:teuthology.orchestra.run.trial005:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T21:21:58.511 DEBUG:teuthology.orchestra.run.trial005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.5 --add b 10.20.193.119 --add c 10.20.193.135 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:21:58.583 INFO:teuthology.orchestra.run.trial005.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:21:58.584 INFO:teuthology.orchestra.run.trial005.stdout:monmaptool: generated fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:21:58.584 INFO:teuthology.orchestra.run.trial005.stdout:setting min_mon_release = quincy 2026-02-17T21:21:58.584 INFO:teuthology.orchestra.run.trial005.stdout:epoch 0 2026-02-17T21:21:58.584 INFO:teuthology.orchestra.run.trial005.stdout:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:21:58.584 INFO:teuthology.orchestra.run.trial005.stdout:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:21:58.584 INFO:teuthology.orchestra.run.trial005.stdout:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:21:58.584 INFO:teuthology.orchestra.run.trial005.stdout:min_mon_release 17 (quincy) 2026-02-17T21:21:58.584 INFO:teuthology.orchestra.run.trial005.stdout:election_strategy: 1 2026-02-17T21:21:58.584 INFO:teuthology.orchestra.run.trial005.stdout:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:21:58.585 INFO:teuthology.orchestra.run.trial005.stdout:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:21:58.585 INFO:teuthology.orchestra.run.trial005.stdout:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:21:58.585 INFO:teuthology.orchestra.run.trial005.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-17T21:21:58.586 DEBUG:teuthology.orchestra.run.trial005:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T21:21:58.642 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b1be373b-56c5-4b5b-a965-9bcc20042691... 2026-02-17T21:21:58.643 DEBUG:teuthology.orchestra.run.trial005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T21:21:58.684 DEBUG:teuthology.orchestra.run.trial119:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T21:21:58.687 DEBUG:teuthology.orchestra.run.trial135:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T21:21:58.690 DEBUG:teuthology.orchestra.run.trial176:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T21:21:58.722 INFO:teuthology.orchestra.run.trial005.stdout:[global] 2026-02-17T21:21:58.722 INFO:teuthology.orchestra.run.trial005.stdout: chdir = "" 2026-02-17T21:21:58.723 INFO:teuthology.orchestra.run.trial005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T21:21:58.723 INFO:teuthology.orchestra.run.trial005.stdout: auth supported = cephx 2026-02-17T21:21:58.723 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.723 INFO:teuthology.orchestra.run.trial005.stdout: filestore xattr use omap = true 2026-02-17T21:21:58.723 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.723 INFO:teuthology.orchestra.run.trial005.stdout: mon clock drift allowed = 1.000 2026-02-17T21:21:58.723 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.723 INFO:teuthology.orchestra.run.trial005.stdout: osd crush chooseleaf type = 0 2026-02-17T21:21:58.723 INFO:teuthology.orchestra.run.trial005.stdout: auth debug = true 2026-02-17T21:21:58.723 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.723 INFO:teuthology.orchestra.run.trial005.stdout: ms die on old message = true 2026-02-17T21:21:58.724 INFO:teuthology.orchestra.run.trial005.stdout: ms die on bug = true 2026-02-17T21:21:58.724 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.724 INFO:teuthology.orchestra.run.trial005.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T21:21:58.724 INFO:teuthology.orchestra.run.trial005.stdout: mon pg warn max object skew = 0 2026-02-17T21:21:58.724 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.724 INFO:teuthology.orchestra.run.trial005.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T21:21:58.724 INFO:teuthology.orchestra.run.trial005.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T21:21:58.724 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.724 INFO:teuthology.orchestra.run.trial005.stdout: osd pool default size = 2 2026-02-17T21:21:58.724 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.724 INFO:teuthology.orchestra.run.trial005.stdout: mon osd allow primary affinity = true 2026-02-17T21:21:58.724 INFO:teuthology.orchestra.run.trial005.stdout: mon osd allow pg remap = true 2026-02-17T21:21:58.725 INFO:teuthology.orchestra.run.trial005.stdout: mon warn on legacy crush tunables = false 2026-02-17T21:21:58.725 INFO:teuthology.orchestra.run.trial005.stdout: mon warn on crush straw calc version zero = false 2026-02-17T21:21:58.725 INFO:teuthology.orchestra.run.trial005.stdout: mon warn on no sortbitwise = false 2026-02-17T21:21:58.725 INFO:teuthology.orchestra.run.trial005.stdout: mon warn on osd down out interval zero = false 2026-02-17T21:21:58.725 INFO:teuthology.orchestra.run.trial005.stdout: mon warn on too few osds = false 2026-02-17T21:21:58.725 INFO:teuthology.orchestra.run.trial005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T21:21:58.725 INFO:teuthology.orchestra.run.trial005.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T21:21:58.725 INFO:teuthology.orchestra.run.trial005.stdout: mon_allow_pool_size_one = true 2026-02-17T21:21:58.725 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.725 INFO:teuthology.orchestra.run.trial005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T21:21:58.725 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.725 INFO:teuthology.orchestra.run.trial005.stdout: osd default data pool replay window = 5 2026-02-17T21:21:58.726 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.726 INFO:teuthology.orchestra.run.trial005.stdout: mon allow pool delete = true 2026-02-17T21:21:58.726 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.726 INFO:teuthology.orchestra.run.trial005.stdout: mon cluster log file level = debug 2026-02-17T21:21:58.726 INFO:teuthology.orchestra.run.trial005.stdout: debug asserts on shutdown = true 2026-02-17T21:21:58.726 INFO:teuthology.orchestra.run.trial005.stdout: mon health detail to clog = false 2026-02-17T21:21:58.726 INFO:teuthology.orchestra.run.trial005.stdout: mon host = "10.20.193.5,10.20.193.119,10.20.193.135" 2026-02-17T21:21:58.726 INFO:teuthology.orchestra.run.trial005.stdout: mon client directed command retry = 5 2026-02-17T21:21:58.726 INFO:teuthology.orchestra.run.trial005.stdout: mon election default strategy = 1 2026-02-17T21:21:58.726 INFO:teuthology.orchestra.run.trial005.stdout: ms inject socket failures = 5000 2026-02-17T21:21:58.726 INFO:teuthology.orchestra.run.trial005.stdout: ms type = async 2026-02-17T21:21:58.726 INFO:teuthology.orchestra.run.trial005.stdout: osd heartbeat grace = 160 2026-02-17T21:21:58.726 INFO:teuthology.orchestra.run.trial005.stdout: osd op thread timeout = 150 2026-02-17T21:21:58.727 INFO:teuthology.orchestra.run.trial005.stdout: fsid = b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:21:58.727 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.727 INFO:teuthology.orchestra.run.trial005.stdout:[osd] 2026-02-17T21:21:58.727 INFO:teuthology.orchestra.run.trial005.stdout: osd journal size = 100 2026-02-17T21:21:58.727 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.727 INFO:teuthology.orchestra.run.trial005.stdout: osd scrub load threshold = 5.0 2026-02-17T21:21:58.727 INFO:teuthology.orchestra.run.trial005.stdout: osd scrub max interval = 600 2026-02-17T21:21:58.727 INFO:teuthology.orchestra.run.trial005.stdout: osd mclock profile = high_recovery_ops 2026-02-17T21:21:58.727 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.727 INFO:teuthology.orchestra.run.trial005.stdout: osd recover clone overlap = true 2026-02-17T21:21:58.727 INFO:teuthology.orchestra.run.trial005.stdout: osd recovery max chunk = 1048576 2026-02-17T21:21:58.727 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.728 INFO:teuthology.orchestra.run.trial005.stdout: osd debug shutdown = true 2026-02-17T21:21:58.728 INFO:teuthology.orchestra.run.trial005.stdout: osd debug op order = true 2026-02-17T21:21:58.728 INFO:teuthology.orchestra.run.trial005.stdout: osd debug verify stray on activate = true 2026-02-17T21:21:58.728 INFO:teuthology.orchestra.run.trial005.stdout: osd debug trim objects = true 2026-02-17T21:21:58.728 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.728 INFO:teuthology.orchestra.run.trial005.stdout: osd open classes on start = true 2026-02-17T21:21:58.728 INFO:teuthology.orchestra.run.trial005.stdout: osd debug pg log writeout = true 2026-02-17T21:21:58.728 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.728 INFO:teuthology.orchestra.run.trial005.stdout: osd deep scrub update digest min age = 30 2026-02-17T21:21:58.728 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.728 INFO:teuthology.orchestra.run.trial005.stdout: osd map max advance = 10 2026-02-17T21:21:58.728 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.729 INFO:teuthology.orchestra.run.trial005.stdout: journal zero on create = true 2026-02-17T21:21:58.729 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.729 INFO:teuthology.orchestra.run.trial005.stdout: filestore ondisk finisher threads = 3 2026-02-17T21:21:58.729 INFO:teuthology.orchestra.run.trial005.stdout: filestore apply finisher threads = 3 2026-02-17T21:21:58.729 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.729 INFO:teuthology.orchestra.run.trial005.stdout: bdev debug aio = true 2026-02-17T21:21:58.729 INFO:teuthology.orchestra.run.trial005.stdout: osd debug misdirected ops = true 2026-02-17T21:21:58.729 INFO:teuthology.orchestra.run.trial005.stdout: bdev async discard = True 2026-02-17T21:21:58.729 INFO:teuthology.orchestra.run.trial005.stdout: bdev enable discard = True 2026-02-17T21:21:58.729 INFO:teuthology.orchestra.run.trial005.stdout: bluestore block size = 96636764160 2026-02-17T21:21:58.729 INFO:teuthology.orchestra.run.trial005.stdout: bluestore fsck on mount = True 2026-02-17T21:21:58.729 INFO:teuthology.orchestra.run.trial005.stdout: bluestore zero block detection = True 2026-02-17T21:21:58.729 INFO:teuthology.orchestra.run.trial005.stdout: debug bluefs = 1 2026-02-17T21:21:58.730 INFO:teuthology.orchestra.run.trial005.stdout: debug bluestore = 1 2026-02-17T21:21:58.730 INFO:teuthology.orchestra.run.trial005.stdout: debug monc = 20 2026-02-17T21:21:58.730 INFO:teuthology.orchestra.run.trial005.stdout: debug ms = 1 2026-02-17T21:21:58.730 INFO:teuthology.orchestra.run.trial005.stdout: debug osd = 20 2026-02-17T21:21:58.730 INFO:teuthology.orchestra.run.trial005.stdout: debug rocksdb = 10 2026-02-17T21:21:58.730 INFO:teuthology.orchestra.run.trial005.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T21:21:58.730 INFO:teuthology.orchestra.run.trial005.stdout: mon osd full ratio = 0.9 2026-02-17T21:21:58.730 INFO:teuthology.orchestra.run.trial005.stdout: mon osd nearfull ratio = 0.8 2026-02-17T21:21:58.730 INFO:teuthology.orchestra.run.trial005.stdout: osd class default list = * 2026-02-17T21:21:58.730 INFO:teuthology.orchestra.run.trial005.stdout: osd class load list = * 2026-02-17T21:21:58.730 INFO:teuthology.orchestra.run.trial005.stdout: osd client watch timeout = 240 2026-02-17T21:21:58.730 INFO:teuthology.orchestra.run.trial005.stdout: osd debug verify cached snaps = True 2026-02-17T21:21:58.731 INFO:teuthology.orchestra.run.trial005.stdout: osd debug verify missing on start = True 2026-02-17T21:21:58.731 INFO:teuthology.orchestra.run.trial005.stdout: osd failsafe full ratio = 0.95 2026-02-17T21:21:58.731 INFO:teuthology.orchestra.run.trial005.stdout: osd fast shutdown = False 2026-02-17T21:21:58.731 INFO:teuthology.orchestra.run.trial005.stdout: osd mclock override recovery settings = True 2026-02-17T21:21:58.731 INFO:teuthology.orchestra.run.trial005.stdout: osd memory target = 1610612736 2026-02-17T21:21:58.731 INFO:teuthology.orchestra.run.trial005.stdout: osd objectstore = bluestore 2026-02-17T21:21:58.731 INFO:teuthology.orchestra.run.trial005.stdout: osd op queue = debug_random 2026-02-17T21:21:58.731 INFO:teuthology.orchestra.run.trial005.stdout: osd op queue cut off = debug_random 2026-02-17T21:21:58.731 INFO:teuthology.orchestra.run.trial005.stdout: osd shutdown pgref assert = True 2026-02-17T21:21:58.731 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.731 INFO:teuthology.orchestra.run.trial005.stdout:[mgr] 2026-02-17T21:21:58.731 INFO:teuthology.orchestra.run.trial005.stdout: debug ms = 1 2026-02-17T21:21:58.731 INFO:teuthology.orchestra.run.trial005.stdout: debug mgr = 20 2026-02-17T21:21:58.732 INFO:teuthology.orchestra.run.trial005.stdout: debug mon = 20 2026-02-17T21:21:58.732 INFO:teuthology.orchestra.run.trial005.stdout: debug auth = 20 2026-02-17T21:21:58.732 INFO:teuthology.orchestra.run.trial005.stdout: mon reweight min pgs per osd = 4 2026-02-17T21:21:58.732 INFO:teuthology.orchestra.run.trial005.stdout: mon reweight min bytes per osd = 10 2026-02-17T21:21:58.732 INFO:teuthology.orchestra.run.trial005.stdout: mgr/telemetry/nag = false 2026-02-17T21:21:58.732 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.732 INFO:teuthology.orchestra.run.trial005.stdout:[mon] 2026-02-17T21:21:58.732 INFO:teuthology.orchestra.run.trial005.stdout: debug ms = 1 2026-02-17T21:21:58.732 INFO:teuthology.orchestra.run.trial005.stdout: debug mon = 20 2026-02-17T21:21:58.732 INFO:teuthology.orchestra.run.trial005.stdout: debug paxos = 20 2026-02-17T21:21:58.732 INFO:teuthology.orchestra.run.trial005.stdout: debug auth = 20 2026-02-17T21:21:58.732 INFO:teuthology.orchestra.run.trial005.stdout: mon data avail warn = 5 2026-02-17T21:21:58.732 INFO:teuthology.orchestra.run.trial005.stdout: mon mgr mkfs grace = 240 2026-02-17T21:21:58.733 INFO:teuthology.orchestra.run.trial005.stdout: mon reweight min pgs per osd = 4 2026-02-17T21:21:58.733 INFO:teuthology.orchestra.run.trial005.stdout: mon osd reporter subtree level = osd 2026-02-17T21:21:58.733 INFO:teuthology.orchestra.run.trial005.stdout: mon osd prime pg temp = true 2026-02-17T21:21:58.733 INFO:teuthology.orchestra.run.trial005.stdout: mon reweight min bytes per osd = 10 2026-02-17T21:21:58.733 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.733 INFO:teuthology.orchestra.run.trial005.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T21:21:58.733 INFO:teuthology.orchestra.run.trial005.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T21:21:58.733 INFO:teuthology.orchestra.run.trial005.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T21:21:58.733 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.733 INFO:teuthology.orchestra.run.trial005.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T21:21:58.733 INFO:teuthology.orchestra.run.trial005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T21:21:58.733 INFO:teuthology.orchestra.run.trial005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T21:21:58.733 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.734 INFO:teuthology.orchestra.run.trial005.stdout: # 1m isn't quite enough 2026-02-17T21:21:58.734 INFO:teuthology.orchestra.run.trial005.stdout: mon_down_mkfs_grace = 2m 2026-02-17T21:21:58.734 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.734 INFO:teuthology.orchestra.run.trial005.stdout: mon_warn_on_filestore_osds = false 2026-02-17T21:21:58.734 INFO:teuthology.orchestra.run.trial005.stdout: mon min osdmap epochs = 50 2026-02-17T21:21:58.734 INFO:teuthology.orchestra.run.trial005.stdout: mon osd crush smoke test = False 2026-02-17T21:21:58.734 INFO:teuthology.orchestra.run.trial005.stdout: mon osdmap full prune interval = 2 2026-02-17T21:21:58.734 INFO:teuthology.orchestra.run.trial005.stdout: mon osdmap full prune min = 15 2026-02-17T21:21:58.734 INFO:teuthology.orchestra.run.trial005.stdout: mon osdmap full prune txsize = 2 2026-02-17T21:21:58.734 INFO:teuthology.orchestra.run.trial005.stdout: mon scrub interval = 300 2026-02-17T21:21:58.734 INFO:teuthology.orchestra.run.trial005.stdout: mon warn on pool no app = False 2026-02-17T21:21:58.734 INFO:teuthology.orchestra.run.trial005.stdout: paxos service trim min = 10 2026-02-17T21:21:58.735 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:21:58.735 INFO:teuthology.orchestra.run.trial005.stdout:[client] 2026-02-17T21:21:58.735 INFO:teuthology.orchestra.run.trial005.stdout: rgw cache enabled = true 2026-02-17T21:21:58.735 INFO:teuthology.orchestra.run.trial005.stdout: rgw enable ops log = true 2026-02-17T21:21:58.735 INFO:teuthology.orchestra.run.trial005.stdout: rgw enable usage log = true 2026-02-17T21:21:58.735 INFO:teuthology.orchestra.run.trial005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T21:21:58.735 INFO:teuthology.orchestra.run.trial005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T21:21:58.735 INFO:teuthology.orchestra.run.trial005.stdout: debug monc = 20 2026-02-17T21:21:58.735 INFO:teuthology.orchestra.run.trial005.stdout: debug ms = 1 2026-02-17T21:21:58.735 INFO:teuthology.orchestra.run.trial005.stdout: debug objecter = 20 2026-02-17T21:21:58.735 INFO:teuthology.orchestra.run.trial005.stdout: debug rados = 20 2026-02-17T21:21:58.735 INFO:teuthology.orchestra.run.trial005.stdout:[mon.a] 2026-02-17T21:21:58.735 INFO:teuthology.orchestra.run.trial005.stdout:[mon.b] 2026-02-17T21:21:58.736 INFO:teuthology.orchestra.run.trial005.stdout:[mon.c] 2026-02-17T21:21:58.737 INFO:teuthology.orchestra.run.trial176.stdout:[global] 2026-02-17T21:21:58.737 INFO:teuthology.orchestra.run.trial176.stdout: chdir = "" 2026-02-17T21:21:58.737 INFO:teuthology.orchestra.run.trial176.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T21:21:58.737 INFO:teuthology.orchestra.run.trial176.stdout: auth supported = cephx 2026-02-17T21:21:58.737 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.737 INFO:teuthology.orchestra.run.trial176.stdout: filestore xattr use omap = true 2026-02-17T21:21:58.737 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.737 INFO:teuthology.orchestra.run.trial176.stdout: mon clock drift allowed = 1.000 2026-02-17T21:21:58.738 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.738 INFO:teuthology.orchestra.run.trial176.stdout: osd crush chooseleaf type = 0 2026-02-17T21:21:58.738 INFO:teuthology.orchestra.run.trial176.stdout: auth debug = true 2026-02-17T21:21:58.738 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.738 INFO:teuthology.orchestra.run.trial176.stdout: ms die on old message = true 2026-02-17T21:21:58.738 INFO:teuthology.orchestra.run.trial176.stdout: ms die on bug = true 2026-02-17T21:21:58.738 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.738 INFO:teuthology.orchestra.run.trial176.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T21:21:58.738 INFO:teuthology.orchestra.run.trial176.stdout: mon pg warn max object skew = 0 2026-02-17T21:21:58.738 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.738 INFO:teuthology.orchestra.run.trial176.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T21:21:58.738 INFO:teuthology.orchestra.run.trial176.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T21:21:58.739 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.739 INFO:teuthology.orchestra.run.trial176.stdout: osd pool default size = 2 2026-02-17T21:21:58.739 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.739 INFO:teuthology.orchestra.run.trial176.stdout: mon osd allow primary affinity = true 2026-02-17T21:21:58.739 INFO:teuthology.orchestra.run.trial176.stdout: mon osd allow pg remap = true 2026-02-17T21:21:58.739 INFO:teuthology.orchestra.run.trial176.stdout: mon warn on legacy crush tunables = false 2026-02-17T21:21:58.739 INFO:teuthology.orchestra.run.trial176.stdout: mon warn on crush straw calc version zero = false 2026-02-17T21:21:58.739 INFO:teuthology.orchestra.run.trial176.stdout: mon warn on no sortbitwise = false 2026-02-17T21:21:58.739 INFO:teuthology.orchestra.run.trial176.stdout: mon warn on osd down out interval zero = false 2026-02-17T21:21:58.739 INFO:teuthology.orchestra.run.trial176.stdout: mon warn on too few osds = false 2026-02-17T21:21:58.739 INFO:teuthology.orchestra.run.trial176.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T21:21:58.739 INFO:teuthology.orchestra.run.trial176.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T21:21:58.740 INFO:teuthology.orchestra.run.trial176.stdout: mon_allow_pool_size_one = true 2026-02-17T21:21:58.740 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.740 INFO:teuthology.orchestra.run.trial176.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T21:21:58.740 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.740 INFO:teuthology.orchestra.run.trial176.stdout: osd default data pool replay window = 5 2026-02-17T21:21:58.740 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.740 INFO:teuthology.orchestra.run.trial176.stdout: mon allow pool delete = true 2026-02-17T21:21:58.740 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.740 INFO:teuthology.orchestra.run.trial176.stdout: mon cluster log file level = debug 2026-02-17T21:21:58.740 INFO:teuthology.orchestra.run.trial176.stdout: debug asserts on shutdown = true 2026-02-17T21:21:58.740 INFO:teuthology.orchestra.run.trial176.stdout: mon health detail to clog = false 2026-02-17T21:21:58.740 INFO:teuthology.orchestra.run.trial176.stdout: mon host = "10.20.193.5,10.20.193.119,10.20.193.135" 2026-02-17T21:21:58.741 INFO:teuthology.orchestra.run.trial176.stdout: mon client directed command retry = 5 2026-02-17T21:21:58.741 INFO:teuthology.orchestra.run.trial176.stdout: mon election default strategy = 1 2026-02-17T21:21:58.741 INFO:teuthology.orchestra.run.trial176.stdout: ms inject socket failures = 5000 2026-02-17T21:21:58.741 INFO:teuthology.orchestra.run.trial176.stdout: ms type = async 2026-02-17T21:21:58.741 INFO:teuthology.orchestra.run.trial176.stdout: osd heartbeat grace = 160 2026-02-17T21:21:58.741 INFO:teuthology.orchestra.run.trial176.stdout: osd op thread timeout = 150 2026-02-17T21:21:58.741 INFO:teuthology.orchestra.run.trial176.stdout: fsid = b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:21:58.741 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.741 INFO:teuthology.orchestra.run.trial176.stdout:[osd] 2026-02-17T21:21:58.741 INFO:teuthology.orchestra.run.trial176.stdout: osd journal size = 100 2026-02-17T21:21:58.741 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.741 INFO:teuthology.orchestra.run.trial176.stdout: osd scrub load threshold = 5.0 2026-02-17T21:21:58.742 INFO:teuthology.orchestra.run.trial176.stdout: osd scrub max interval = 600 2026-02-17T21:21:58.742 INFO:teuthology.orchestra.run.trial176.stdout: osd mclock profile = high_recovery_ops 2026-02-17T21:21:58.742 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.742 INFO:teuthology.orchestra.run.trial176.stdout: osd recover clone overlap = true 2026-02-17T21:21:58.742 INFO:teuthology.orchestra.run.trial176.stdout: osd recovery max chunk = 1048576 2026-02-17T21:21:58.742 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.742 INFO:teuthology.orchestra.run.trial176.stdout: osd debug shutdown = true 2026-02-17T21:21:58.742 INFO:teuthology.orchestra.run.trial176.stdout: osd debug op order = true 2026-02-17T21:21:58.742 INFO:teuthology.orchestra.run.trial176.stdout: osd debug verify stray on activate = true 2026-02-17T21:21:58.742 INFO:teuthology.orchestra.run.trial176.stdout: osd debug trim objects = true 2026-02-17T21:21:58.742 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.742 INFO:teuthology.orchestra.run.trial176.stdout: osd open classes on start = true 2026-02-17T21:21:58.743 INFO:teuthology.orchestra.run.trial176.stdout: osd debug pg log writeout = true 2026-02-17T21:21:58.743 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.743 INFO:teuthology.orchestra.run.trial176.stdout: osd deep scrub update digest min age = 30 2026-02-17T21:21:58.743 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.743 INFO:teuthology.orchestra.run.trial176.stdout: osd map max advance = 10 2026-02-17T21:21:58.743 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.743 INFO:teuthology.orchestra.run.trial176.stdout: journal zero on create = true 2026-02-17T21:21:58.743 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.743 INFO:teuthology.orchestra.run.trial176.stdout: filestore ondisk finisher threads = 3 2026-02-17T21:21:58.743 INFO:teuthology.orchestra.run.trial176.stdout: filestore apply finisher threads = 3 2026-02-17T21:21:58.743 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.743 INFO:teuthology.orchestra.run.trial176.stdout: bdev debug aio = true 2026-02-17T21:21:58.743 INFO:teuthology.orchestra.run.trial176.stdout: osd debug misdirected ops = true 2026-02-17T21:21:58.744 INFO:teuthology.orchestra.run.trial176.stdout: bdev async discard = True 2026-02-17T21:21:58.744 INFO:teuthology.orchestra.run.trial176.stdout: bdev enable discard = True 2026-02-17T21:21:58.744 INFO:teuthology.orchestra.run.trial176.stdout: bluestore block size = 96636764160 2026-02-17T21:21:58.744 INFO:teuthology.orchestra.run.trial176.stdout: bluestore fsck on mount = True 2026-02-17T21:21:58.744 INFO:teuthology.orchestra.run.trial176.stdout: bluestore zero block detection = True 2026-02-17T21:21:58.744 INFO:teuthology.orchestra.run.trial176.stdout: debug bluefs = 1 2026-02-17T21:21:58.744 INFO:teuthology.orchestra.run.trial176.stdout: debug bluestore = 1 2026-02-17T21:21:58.744 INFO:teuthology.orchestra.run.trial176.stdout: debug monc = 20 2026-02-17T21:21:58.744 INFO:teuthology.orchestra.run.trial176.stdout: debug ms = 1 2026-02-17T21:21:58.744 INFO:teuthology.orchestra.run.trial176.stdout: debug osd = 20 2026-02-17T21:21:58.744 INFO:teuthology.orchestra.run.trial176.stdout: debug rocksdb = 10 2026-02-17T21:21:58.744 INFO:teuthology.orchestra.run.trial176.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T21:21:58.744 INFO:teuthology.orchestra.run.trial176.stdout: mon osd full ratio = 0.9 2026-02-17T21:21:58.745 INFO:teuthology.orchestra.run.trial176.stdout: mon osd nearfull ratio = 0.8 2026-02-17T21:21:58.745 INFO:teuthology.orchestra.run.trial176.stdout: osd class default list = * 2026-02-17T21:21:58.745 INFO:teuthology.orchestra.run.trial176.stdout: osd class load list = * 2026-02-17T21:21:58.745 INFO:teuthology.orchestra.run.trial176.stdout: osd client watch timeout = 240 2026-02-17T21:21:58.745 INFO:teuthology.orchestra.run.trial176.stdout: osd debug verify cached snaps = True 2026-02-17T21:21:58.745 INFO:teuthology.orchestra.run.trial176.stdout: osd debug verify missing on start = True 2026-02-17T21:21:58.745 INFO:teuthology.orchestra.run.trial176.stdout: osd failsafe full ratio = 0.95 2026-02-17T21:21:58.745 INFO:teuthology.orchestra.run.trial176.stdout: osd fast shutdown = False 2026-02-17T21:21:58.745 INFO:teuthology.orchestra.run.trial176.stdout: osd mclock override recovery settings = True 2026-02-17T21:21:58.745 INFO:teuthology.orchestra.run.trial176.stdout: osd memory target = 1610612736 2026-02-17T21:21:58.745 INFO:teuthology.orchestra.run.trial176.stdout: osd objectstore = bluestore 2026-02-17T21:21:58.745 INFO:teuthology.orchestra.run.trial176.stdout: osd op queue = debug_random 2026-02-17T21:21:58.745 INFO:teuthology.orchestra.run.trial176.stdout: osd op queue cut off = debug_random 2026-02-17T21:21:58.746 INFO:teuthology.orchestra.run.trial176.stdout: osd shutdown pgref assert = True 2026-02-17T21:21:58.746 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.746 INFO:teuthology.orchestra.run.trial176.stdout:[mgr] 2026-02-17T21:21:58.746 INFO:teuthology.orchestra.run.trial176.stdout: debug ms = 1 2026-02-17T21:21:58.746 INFO:teuthology.orchestra.run.trial176.stdout: debug mgr = 20 2026-02-17T21:21:58.746 INFO:teuthology.orchestra.run.trial176.stdout: debug mon = 20 2026-02-17T21:21:58.746 INFO:teuthology.orchestra.run.trial176.stdout: debug auth = 20 2026-02-17T21:21:58.746 INFO:teuthology.orchestra.run.trial176.stdout: mon reweight min pgs per osd = 4 2026-02-17T21:21:58.746 INFO:teuthology.orchestra.run.trial176.stdout: mon reweight min bytes per osd = 10 2026-02-17T21:21:58.746 INFO:teuthology.orchestra.run.trial176.stdout: mgr/telemetry/nag = false 2026-02-17T21:21:58.746 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.746 INFO:teuthology.orchestra.run.trial176.stdout:[mon] 2026-02-17T21:21:58.747 INFO:teuthology.orchestra.run.trial176.stdout: debug ms = 1 2026-02-17T21:21:58.747 INFO:teuthology.orchestra.run.trial176.stdout: debug mon = 20 2026-02-17T21:21:58.747 INFO:teuthology.orchestra.run.trial176.stdout: debug paxos = 20 2026-02-17T21:21:58.747 INFO:teuthology.orchestra.run.trial176.stdout: debug auth = 20 2026-02-17T21:21:58.747 INFO:teuthology.orchestra.run.trial176.stdout: mon data avail warn = 5 2026-02-17T21:21:58.747 INFO:teuthology.orchestra.run.trial176.stdout: mon mgr mkfs grace = 240 2026-02-17T21:21:58.747 INFO:teuthology.orchestra.run.trial176.stdout: mon reweight min pgs per osd = 4 2026-02-17T21:21:58.747 INFO:teuthology.orchestra.run.trial176.stdout: mon osd reporter subtree level = osd 2026-02-17T21:21:58.747 INFO:teuthology.orchestra.run.trial176.stdout: mon osd prime pg temp = true 2026-02-17T21:21:58.747 INFO:teuthology.orchestra.run.trial176.stdout: mon reweight min bytes per osd = 10 2026-02-17T21:21:58.747 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.747 INFO:teuthology.orchestra.run.trial176.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T21:21:58.747 INFO:teuthology.orchestra.run.trial176.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T21:21:58.748 INFO:teuthology.orchestra.run.trial176.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T21:21:58.748 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.748 INFO:teuthology.orchestra.run.trial176.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T21:21:58.748 INFO:teuthology.orchestra.run.trial176.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T21:21:58.748 INFO:teuthology.orchestra.run.trial176.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T21:21:58.748 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.748 INFO:teuthology.orchestra.run.trial176.stdout: # 1m isn't quite enough 2026-02-17T21:21:58.748 INFO:teuthology.orchestra.run.trial176.stdout: mon_down_mkfs_grace = 2m 2026-02-17T21:21:58.748 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.748 INFO:teuthology.orchestra.run.trial176.stdout: mon_warn_on_filestore_osds = false 2026-02-17T21:21:58.748 INFO:teuthology.orchestra.run.trial176.stdout: mon min osdmap epochs = 50 2026-02-17T21:21:58.748 INFO:teuthology.orchestra.run.trial176.stdout: mon osd crush smoke test = False 2026-02-17T21:21:58.748 INFO:teuthology.orchestra.run.trial176.stdout: mon osdmap full prune interval = 2 2026-02-17T21:21:58.749 INFO:teuthology.orchestra.run.trial176.stdout: mon osdmap full prune min = 15 2026-02-17T21:21:58.749 INFO:teuthology.orchestra.run.trial176.stdout: mon osdmap full prune txsize = 2 2026-02-17T21:21:58.749 INFO:teuthology.orchestra.run.trial176.stdout: mon scrub interval = 300 2026-02-17T21:21:58.749 INFO:teuthology.orchestra.run.trial176.stdout: mon warn on pool no app = False 2026-02-17T21:21:58.749 INFO:teuthology.orchestra.run.trial176.stdout: paxos service trim min = 10 2026-02-17T21:21:58.749 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T21:21:58.749 INFO:teuthology.orchestra.run.trial176.stdout:[client] 2026-02-17T21:21:58.749 INFO:teuthology.orchestra.run.trial176.stdout: rgw cache enabled = true 2026-02-17T21:21:58.749 INFO:teuthology.orchestra.run.trial176.stdout: rgw enable ops log = true 2026-02-17T21:21:58.749 INFO:teuthology.orchestra.run.trial176.stdout: rgw enable usage log = true 2026-02-17T21:21:58.749 INFO:teuthology.orchestra.run.trial176.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T21:21:58.749 INFO:teuthology.orchestra.run.trial176.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T21:21:58.749 INFO:teuthology.orchestra.run.trial176.stdout: debug monc = 20 2026-02-17T21:21:58.750 INFO:teuthology.orchestra.run.trial176.stdout: debug ms = 1 2026-02-17T21:21:58.750 INFO:teuthology.orchestra.run.trial176.stdout: debug objecter = 20 2026-02-17T21:21:58.750 INFO:teuthology.orchestra.run.trial176.stdout: debug rados = 20 2026-02-17T21:21:58.750 INFO:teuthology.orchestra.run.trial176.stdout:[mon.a] 2026-02-17T21:21:58.750 INFO:teuthology.orchestra.run.trial176.stdout:[mon.b] 2026-02-17T21:21:58.750 INFO:teuthology.orchestra.run.trial176.stdout:[mon.c] 2026-02-17T21:21:58.750 INFO:teuthology.orchestra.run.trial135.stdout:[global] 2026-02-17T21:21:58.750 INFO:teuthology.orchestra.run.trial135.stdout: chdir = "" 2026-02-17T21:21:58.750 INFO:teuthology.orchestra.run.trial135.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T21:21:58.750 INFO:teuthology.orchestra.run.trial135.stdout: auth supported = cephx 2026-02-17T21:21:58.750 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.751 INFO:teuthology.orchestra.run.trial135.stdout: filestore xattr use omap = true 2026-02-17T21:21:58.751 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.751 INFO:teuthology.orchestra.run.trial135.stdout: mon clock drift allowed = 1.000 2026-02-17T21:21:58.751 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.751 INFO:teuthology.orchestra.run.trial135.stdout: osd crush chooseleaf type = 0 2026-02-17T21:21:58.751 INFO:teuthology.orchestra.run.trial135.stdout: auth debug = true 2026-02-17T21:21:58.751 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.751 INFO:teuthology.orchestra.run.trial135.stdout: ms die on old message = true 2026-02-17T21:21:58.751 INFO:teuthology.orchestra.run.trial135.stdout: ms die on bug = true 2026-02-17T21:21:58.751 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.751 INFO:teuthology.orchestra.run.trial135.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T21:21:58.751 INFO:teuthology.orchestra.run.trial135.stdout: mon pg warn max object skew = 0 2026-02-17T21:21:58.752 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.752 INFO:teuthology.orchestra.run.trial135.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T21:21:58.752 INFO:teuthology.orchestra.run.trial135.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T21:21:58.752 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.752 INFO:teuthology.orchestra.run.trial135.stdout: osd pool default size = 2 2026-02-17T21:21:58.752 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.752 INFO:teuthology.orchestra.run.trial135.stdout: mon osd allow primary affinity = true 2026-02-17T21:21:58.752 INFO:teuthology.orchestra.run.trial135.stdout: mon osd allow pg remap = true 2026-02-17T21:21:58.752 INFO:teuthology.orchestra.run.trial135.stdout: mon warn on legacy crush tunables = false 2026-02-17T21:21:58.752 INFO:teuthology.orchestra.run.trial135.stdout: mon warn on crush straw calc version zero = false 2026-02-17T21:21:58.752 INFO:teuthology.orchestra.run.trial135.stdout: mon warn on no sortbitwise = false 2026-02-17T21:21:58.752 INFO:teuthology.orchestra.run.trial135.stdout: mon warn on osd down out interval zero = false 2026-02-17T21:21:58.753 INFO:teuthology.orchestra.run.trial135.stdout: mon warn on too few osds = false 2026-02-17T21:21:58.753 INFO:teuthology.orchestra.run.trial135.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T21:21:58.753 INFO:teuthology.orchestra.run.trial135.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T21:21:58.753 INFO:teuthology.orchestra.run.trial135.stdout: mon_allow_pool_size_one = true 2026-02-17T21:21:58.753 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.753 INFO:teuthology.orchestra.run.trial135.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T21:21:58.753 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.753 INFO:teuthology.orchestra.run.trial135.stdout: osd default data pool replay window = 5 2026-02-17T21:21:58.753 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.753 INFO:teuthology.orchestra.run.trial135.stdout: mon allow pool delete = true 2026-02-17T21:21:58.753 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.753 INFO:teuthology.orchestra.run.trial135.stdout: mon cluster log file level = debug 2026-02-17T21:21:58.753 INFO:teuthology.orchestra.run.trial135.stdout: debug asserts on shutdown = true 2026-02-17T21:21:58.753 INFO:teuthology.orchestra.run.trial135.stdout: mon health detail to clog = false 2026-02-17T21:21:58.754 INFO:teuthology.orchestra.run.trial135.stdout: mon host = "10.20.193.5,10.20.193.119,10.20.193.135" 2026-02-17T21:21:58.754 INFO:teuthology.orchestra.run.trial135.stdout: mon client directed command retry = 5 2026-02-17T21:21:58.754 INFO:teuthology.orchestra.run.trial135.stdout: mon election default strategy = 1 2026-02-17T21:21:58.754 INFO:teuthology.orchestra.run.trial135.stdout: ms inject socket failures = 5000 2026-02-17T21:21:58.754 INFO:teuthology.orchestra.run.trial135.stdout: ms type = async 2026-02-17T21:21:58.754 INFO:teuthology.orchestra.run.trial135.stdout: osd heartbeat grace = 160 2026-02-17T21:21:58.754 INFO:teuthology.orchestra.run.trial135.stdout: osd op thread timeout = 150 2026-02-17T21:21:58.754 INFO:teuthology.orchestra.run.trial135.stdout: fsid = b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:21:58.754 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.754 INFO:teuthology.orchestra.run.trial135.stdout:[osd] 2026-02-17T21:21:58.754 INFO:teuthology.orchestra.run.trial135.stdout: osd journal size = 100 2026-02-17T21:21:58.754 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.754 INFO:teuthology.orchestra.run.trial135.stdout: osd scrub load threshold = 5.0 2026-02-17T21:21:58.754 INFO:teuthology.orchestra.run.trial135.stdout: osd scrub max interval = 600 2026-02-17T21:21:58.754 INFO:teuthology.orchestra.run.trial135.stdout: osd mclock profile = high_recovery_ops 2026-02-17T21:21:58.755 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.755 INFO:teuthology.orchestra.run.trial135.stdout: osd recover clone overlap = true 2026-02-17T21:21:58.755 INFO:teuthology.orchestra.run.trial135.stdout: osd recovery max chunk = 1048576 2026-02-17T21:21:58.755 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.755 INFO:teuthology.orchestra.run.trial135.stdout: osd debug shutdown = true 2026-02-17T21:21:58.755 INFO:teuthology.orchestra.run.trial135.stdout: osd debug op order = true 2026-02-17T21:21:58.755 INFO:teuthology.orchestra.run.trial135.stdout: osd debug verify stray on activate = true 2026-02-17T21:21:58.755 INFO:teuthology.orchestra.run.trial135.stdout: osd debug trim objects = true 2026-02-17T21:21:58.755 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.755 INFO:teuthology.orchestra.run.trial135.stdout: osd open classes on start = true 2026-02-17T21:21:58.755 INFO:teuthology.orchestra.run.trial135.stdout: osd debug pg log writeout = true 2026-02-17T21:21:58.755 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.755 INFO:teuthology.orchestra.run.trial135.stdout: osd deep scrub update digest min age = 30 2026-02-17T21:21:58.755 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.756 INFO:teuthology.orchestra.run.trial135.stdout: osd map max advance = 10 2026-02-17T21:21:58.756 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.756 INFO:teuthology.orchestra.run.trial135.stdout: journal zero on create = true 2026-02-17T21:21:58.756 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.756 INFO:teuthology.orchestra.run.trial135.stdout: filestore ondisk finisher threads = 3 2026-02-17T21:21:58.756 INFO:teuthology.orchestra.run.trial135.stdout: filestore apply finisher threads = 3 2026-02-17T21:21:58.756 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.756 INFO:teuthology.orchestra.run.trial135.stdout: bdev debug aio = true 2026-02-17T21:21:58.756 INFO:teuthology.orchestra.run.trial135.stdout: osd debug misdirected ops = true 2026-02-17T21:21:58.756 INFO:teuthology.orchestra.run.trial135.stdout: bdev async discard = True 2026-02-17T21:21:58.756 INFO:teuthology.orchestra.run.trial135.stdout: bdev enable discard = True 2026-02-17T21:21:58.756 INFO:teuthology.orchestra.run.trial135.stdout: bluestore block size = 96636764160 2026-02-17T21:21:58.756 INFO:teuthology.orchestra.run.trial135.stdout: bluestore fsck on mount = True 2026-02-17T21:21:58.756 INFO:teuthology.orchestra.run.trial135.stdout: bluestore zero block detection = True 2026-02-17T21:21:58.756 INFO:teuthology.orchestra.run.trial135.stdout: debug bluefs = 1 2026-02-17T21:21:58.757 INFO:teuthology.orchestra.run.trial135.stdout: debug bluestore = 1 2026-02-17T21:21:58.757 INFO:teuthology.orchestra.run.trial135.stdout: debug monc = 20 2026-02-17T21:21:58.757 INFO:teuthology.orchestra.run.trial135.stdout: debug ms = 1 2026-02-17T21:21:58.757 INFO:teuthology.orchestra.run.trial135.stdout: debug osd = 20 2026-02-17T21:21:58.757 INFO:teuthology.orchestra.run.trial135.stdout: debug rocksdb = 10 2026-02-17T21:21:58.757 INFO:teuthology.orchestra.run.trial135.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T21:21:58.757 INFO:teuthology.orchestra.run.trial135.stdout: mon osd full ratio = 0.9 2026-02-17T21:21:58.757 INFO:teuthology.orchestra.run.trial135.stdout: mon osd nearfull ratio = 0.8 2026-02-17T21:21:58.757 INFO:teuthology.orchestra.run.trial135.stdout: osd class default list = * 2026-02-17T21:21:58.757 INFO:teuthology.orchestra.run.trial135.stdout: osd class load list = * 2026-02-17T21:21:58.757 INFO:teuthology.orchestra.run.trial135.stdout: osd client watch timeout = 240 2026-02-17T21:21:58.757 INFO:teuthology.orchestra.run.trial135.stdout: osd debug verify cached snaps = True 2026-02-17T21:21:58.757 INFO:teuthology.orchestra.run.trial135.stdout: osd debug verify missing on start = True 2026-02-17T21:21:58.757 INFO:teuthology.orchestra.run.trial135.stdout: osd failsafe full ratio = 0.95 2026-02-17T21:21:58.757 INFO:teuthology.orchestra.run.trial135.stdout: osd fast shutdown = False 2026-02-17T21:21:58.758 INFO:teuthology.orchestra.run.trial135.stdout: osd mclock override recovery settings = True 2026-02-17T21:21:58.758 INFO:teuthology.orchestra.run.trial135.stdout: osd memory target = 1610612736 2026-02-17T21:21:58.758 INFO:teuthology.orchestra.run.trial135.stdout: osd objectstore = bluestore 2026-02-17T21:21:58.758 INFO:teuthology.orchestra.run.trial135.stdout: osd op queue = debug_random 2026-02-17T21:21:58.758 INFO:teuthology.orchestra.run.trial135.stdout: osd op queue cut off = debug_random 2026-02-17T21:21:58.758 INFO:teuthology.orchestra.run.trial135.stdout: osd shutdown pgref assert = True 2026-02-17T21:21:58.758 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.758 INFO:teuthology.orchestra.run.trial135.stdout:[mgr] 2026-02-17T21:21:58.758 INFO:teuthology.orchestra.run.trial135.stdout: debug ms = 1 2026-02-17T21:21:58.758 INFO:teuthology.orchestra.run.trial135.stdout: debug mgr = 20 2026-02-17T21:21:58.758 INFO:teuthology.orchestra.run.trial135.stdout: debug mon = 20 2026-02-17T21:21:58.758 INFO:teuthology.orchestra.run.trial135.stdout: debug auth = 20 2026-02-17T21:21:58.758 INFO:teuthology.orchestra.run.trial135.stdout: mon reweight min pgs per osd = 4 2026-02-17T21:21:58.758 INFO:teuthology.orchestra.run.trial135.stdout: mon reweight min bytes per osd = 10 2026-02-17T21:21:58.759 INFO:teuthology.orchestra.run.trial135.stdout: mgr/telemetry/nag = false 2026-02-17T21:21:58.759 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.759 INFO:teuthology.orchestra.run.trial135.stdout:[mon] 2026-02-17T21:21:58.759 INFO:teuthology.orchestra.run.trial135.stdout: debug ms = 1 2026-02-17T21:21:58.759 INFO:teuthology.orchestra.run.trial135.stdout: debug mon = 20 2026-02-17T21:21:58.759 INFO:teuthology.orchestra.run.trial135.stdout: debug paxos = 20 2026-02-17T21:21:58.759 INFO:teuthology.orchestra.run.trial135.stdout: debug auth = 20 2026-02-17T21:21:58.759 INFO:teuthology.orchestra.run.trial135.stdout: mon data avail warn = 5 2026-02-17T21:21:58.759 INFO:teuthology.orchestra.run.trial135.stdout: mon mgr mkfs grace = 240 2026-02-17T21:21:58.759 INFO:teuthology.orchestra.run.trial135.stdout: mon reweight min pgs per osd = 4 2026-02-17T21:21:58.759 INFO:teuthology.orchestra.run.trial135.stdout: mon osd reporter subtree level = osd 2026-02-17T21:21:58.759 INFO:teuthology.orchestra.run.trial135.stdout: mon osd prime pg temp = true 2026-02-17T21:21:58.759 INFO:teuthology.orchestra.run.trial135.stdout: mon reweight min bytes per osd = 10 2026-02-17T21:21:58.759 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.759 INFO:teuthology.orchestra.run.trial135.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T21:21:58.759 INFO:teuthology.orchestra.run.trial135.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T21:21:58.760 INFO:teuthology.orchestra.run.trial135.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T21:21:58.760 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.760 INFO:teuthology.orchestra.run.trial135.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T21:21:58.760 INFO:teuthology.orchestra.run.trial135.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T21:21:58.760 INFO:teuthology.orchestra.run.trial135.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T21:21:58.760 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.760 INFO:teuthology.orchestra.run.trial135.stdout: # 1m isn't quite enough 2026-02-17T21:21:58.760 INFO:teuthology.orchestra.run.trial135.stdout: mon_down_mkfs_grace = 2m 2026-02-17T21:21:58.760 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.760 INFO:teuthology.orchestra.run.trial135.stdout: mon_warn_on_filestore_osds = false 2026-02-17T21:21:58.760 INFO:teuthology.orchestra.run.trial135.stdout: mon min osdmap epochs = 50 2026-02-17T21:21:58.760 INFO:teuthology.orchestra.run.trial135.stdout: mon osd crush smoke test = False 2026-02-17T21:21:58.760 INFO:teuthology.orchestra.run.trial135.stdout: mon osdmap full prune interval = 2 2026-02-17T21:21:58.760 INFO:teuthology.orchestra.run.trial135.stdout: mon osdmap full prune min = 15 2026-02-17T21:21:58.760 INFO:teuthology.orchestra.run.trial135.stdout: mon osdmap full prune txsize = 2 2026-02-17T21:21:58.760 INFO:teuthology.orchestra.run.trial135.stdout: mon scrub interval = 300 2026-02-17T21:21:58.760 INFO:teuthology.orchestra.run.trial135.stdout: mon warn on pool no app = False 2026-02-17T21:21:58.761 INFO:teuthology.orchestra.run.trial135.stdout: paxos service trim min = 10 2026-02-17T21:21:58.761 INFO:teuthology.orchestra.run.trial135.stdout: 2026-02-17T21:21:58.761 INFO:teuthology.orchestra.run.trial135.stdout:[client] 2026-02-17T21:21:58.761 INFO:teuthology.orchestra.run.trial135.stdout: rgw cache enabled = true 2026-02-17T21:21:58.761 INFO:teuthology.orchestra.run.trial135.stdout: rgw enable ops log = true 2026-02-17T21:21:58.761 INFO:teuthology.orchestra.run.trial135.stdout: rgw enable usage log = true 2026-02-17T21:21:58.761 INFO:teuthology.orchestra.run.trial135.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T21:21:58.761 INFO:teuthology.orchestra.run.trial135.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T21:21:58.761 INFO:teuthology.orchestra.run.trial135.stdout: debug monc = 20 2026-02-17T21:21:58.761 INFO:teuthology.orchestra.run.trial135.stdout: debug ms = 1 2026-02-17T21:21:58.761 INFO:teuthology.orchestra.run.trial135.stdout: debug objecter = 20 2026-02-17T21:21:58.761 INFO:teuthology.orchestra.run.trial135.stdout: debug rados = 20 2026-02-17T21:21:58.761 INFO:teuthology.orchestra.run.trial135.stdout:[mon.a] 2026-02-17T21:21:58.761 INFO:teuthology.orchestra.run.trial135.stdout:[mon.b] 2026-02-17T21:21:58.761 INFO:teuthology.orchestra.run.trial135.stdout:[mon.c] 2026-02-17T21:21:58.762 INFO:teuthology.orchestra.run.trial119.stdout:[global] 2026-02-17T21:21:58.763 INFO:teuthology.orchestra.run.trial119.stdout: chdir = "" 2026-02-17T21:21:58.763 INFO:teuthology.orchestra.run.trial119.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T21:21:58.763 INFO:teuthology.orchestra.run.trial119.stdout: auth supported = cephx 2026-02-17T21:21:58.763 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.763 INFO:teuthology.orchestra.run.trial119.stdout: filestore xattr use omap = true 2026-02-17T21:21:58.763 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.763 INFO:teuthology.orchestra.run.trial119.stdout: mon clock drift allowed = 1.000 2026-02-17T21:21:58.763 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.763 INFO:teuthology.orchestra.run.trial119.stdout: osd crush chooseleaf type = 0 2026-02-17T21:21:58.763 INFO:teuthology.orchestra.run.trial119.stdout: auth debug = true 2026-02-17T21:21:58.763 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.763 INFO:teuthology.orchestra.run.trial119.stdout: ms die on old message = true 2026-02-17T21:21:58.763 INFO:teuthology.orchestra.run.trial119.stdout: ms die on bug = true 2026-02-17T21:21:58.763 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.763 INFO:teuthology.orchestra.run.trial119.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T21:21:58.763 INFO:teuthology.orchestra.run.trial119.stdout: mon pg warn max object skew = 0 2026-02-17T21:21:58.764 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.764 INFO:teuthology.orchestra.run.trial119.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T21:21:58.764 INFO:teuthology.orchestra.run.trial119.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T21:21:58.764 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.764 INFO:teuthology.orchestra.run.trial119.stdout: osd pool default size = 2 2026-02-17T21:21:58.764 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.764 INFO:teuthology.orchestra.run.trial119.stdout: mon osd allow primary affinity = true 2026-02-17T21:21:58.764 INFO:teuthology.orchestra.run.trial119.stdout: mon osd allow pg remap = true 2026-02-17T21:21:58.764 INFO:teuthology.orchestra.run.trial119.stdout: mon warn on legacy crush tunables = false 2026-02-17T21:21:58.764 INFO:teuthology.orchestra.run.trial119.stdout: mon warn on crush straw calc version zero = false 2026-02-17T21:21:58.764 INFO:teuthology.orchestra.run.trial119.stdout: mon warn on no sortbitwise = false 2026-02-17T21:21:58.764 INFO:teuthology.orchestra.run.trial119.stdout: mon warn on osd down out interval zero = false 2026-02-17T21:21:58.764 INFO:teuthology.orchestra.run.trial119.stdout: mon warn on too few osds = false 2026-02-17T21:21:58.764 INFO:teuthology.orchestra.run.trial119.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T21:21:58.764 INFO:teuthology.orchestra.run.trial119.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T21:21:58.764 INFO:teuthology.orchestra.run.trial119.stdout: mon_allow_pool_size_one = true 2026-02-17T21:21:58.764 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.765 INFO:teuthology.orchestra.run.trial119.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T21:21:58.765 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.765 INFO:teuthology.orchestra.run.trial119.stdout: osd default data pool replay window = 5 2026-02-17T21:21:58.765 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.765 INFO:teuthology.orchestra.run.trial119.stdout: mon allow pool delete = true 2026-02-17T21:21:58.765 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.765 INFO:teuthology.orchestra.run.trial119.stdout: mon cluster log file level = debug 2026-02-17T21:21:58.765 INFO:teuthology.orchestra.run.trial119.stdout: debug asserts on shutdown = true 2026-02-17T21:21:58.765 INFO:teuthology.orchestra.run.trial119.stdout: mon health detail to clog = false 2026-02-17T21:21:58.765 INFO:teuthology.orchestra.run.trial119.stdout: mon host = "10.20.193.5,10.20.193.119,10.20.193.135" 2026-02-17T21:21:58.765 INFO:teuthology.orchestra.run.trial119.stdout: mon client directed command retry = 5 2026-02-17T21:21:58.765 INFO:teuthology.orchestra.run.trial119.stdout: mon election default strategy = 1 2026-02-17T21:21:58.765 INFO:teuthology.orchestra.run.trial119.stdout: ms inject socket failures = 5000 2026-02-17T21:21:58.765 INFO:teuthology.orchestra.run.trial119.stdout: ms type = async 2026-02-17T21:21:58.765 INFO:teuthology.orchestra.run.trial119.stdout: osd heartbeat grace = 160 2026-02-17T21:21:58.765 INFO:teuthology.orchestra.run.trial119.stdout: osd op thread timeout = 150 2026-02-17T21:21:58.765 INFO:teuthology.orchestra.run.trial119.stdout: fsid = b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:21:58.765 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.766 INFO:teuthology.orchestra.run.trial119.stdout:[osd] 2026-02-17T21:21:58.766 INFO:teuthology.orchestra.run.trial119.stdout: osd journal size = 100 2026-02-17T21:21:58.766 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.766 INFO:teuthology.orchestra.run.trial119.stdout: osd scrub load threshold = 5.0 2026-02-17T21:21:58.766 INFO:teuthology.orchestra.run.trial119.stdout: osd scrub max interval = 600 2026-02-17T21:21:58.766 INFO:teuthology.orchestra.run.trial119.stdout: osd mclock profile = high_recovery_ops 2026-02-17T21:21:58.766 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.766 INFO:teuthology.orchestra.run.trial119.stdout: osd recover clone overlap = true 2026-02-17T21:21:58.766 INFO:teuthology.orchestra.run.trial119.stdout: osd recovery max chunk = 1048576 2026-02-17T21:21:58.766 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.766 INFO:teuthology.orchestra.run.trial119.stdout: osd debug shutdown = true 2026-02-17T21:21:58.766 INFO:teuthology.orchestra.run.trial119.stdout: osd debug op order = true 2026-02-17T21:21:58.766 INFO:teuthology.orchestra.run.trial119.stdout: osd debug verify stray on activate = true 2026-02-17T21:21:58.766 INFO:teuthology.orchestra.run.trial119.stdout: osd debug trim objects = true 2026-02-17T21:21:58.766 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.766 INFO:teuthology.orchestra.run.trial119.stdout: osd open classes on start = true 2026-02-17T21:21:58.766 INFO:teuthology.orchestra.run.trial119.stdout: osd debug pg log writeout = true 2026-02-17T21:21:58.766 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.766 INFO:teuthology.orchestra.run.trial119.stdout: osd deep scrub update digest min age = 30 2026-02-17T21:21:58.767 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.767 INFO:teuthology.orchestra.run.trial119.stdout: osd map max advance = 10 2026-02-17T21:21:58.767 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.767 INFO:teuthology.orchestra.run.trial119.stdout: journal zero on create = true 2026-02-17T21:21:58.767 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.767 INFO:teuthology.orchestra.run.trial119.stdout: filestore ondisk finisher threads = 3 2026-02-17T21:21:58.767 INFO:teuthology.orchestra.run.trial119.stdout: filestore apply finisher threads = 3 2026-02-17T21:21:58.767 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.767 INFO:teuthology.orchestra.run.trial119.stdout: bdev debug aio = true 2026-02-17T21:21:58.767 INFO:teuthology.orchestra.run.trial119.stdout: osd debug misdirected ops = true 2026-02-17T21:21:58.767 INFO:teuthology.orchestra.run.trial119.stdout: bdev async discard = True 2026-02-17T21:21:58.767 INFO:teuthology.orchestra.run.trial119.stdout: bdev enable discard = True 2026-02-17T21:21:58.767 INFO:teuthology.orchestra.run.trial119.stdout: bluestore block size = 96636764160 2026-02-17T21:21:58.767 INFO:teuthology.orchestra.run.trial119.stdout: bluestore fsck on mount = True 2026-02-17T21:21:58.767 INFO:teuthology.orchestra.run.trial119.stdout: bluestore zero block detection = True 2026-02-17T21:21:58.767 INFO:teuthology.orchestra.run.trial119.stdout: debug bluefs = 1 2026-02-17T21:21:58.767 INFO:teuthology.orchestra.run.trial119.stdout: debug bluestore = 1 2026-02-17T21:21:58.767 INFO:teuthology.orchestra.run.trial119.stdout: debug monc = 20 2026-02-17T21:21:58.767 INFO:teuthology.orchestra.run.trial119.stdout: debug ms = 1 2026-02-17T21:21:58.768 INFO:teuthology.orchestra.run.trial119.stdout: debug osd = 20 2026-02-17T21:21:58.768 INFO:teuthology.orchestra.run.trial119.stdout: debug rocksdb = 10 2026-02-17T21:21:58.768 INFO:teuthology.orchestra.run.trial119.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T21:21:58.768 INFO:teuthology.orchestra.run.trial119.stdout: mon osd full ratio = 0.9 2026-02-17T21:21:58.768 INFO:teuthology.orchestra.run.trial119.stdout: mon osd nearfull ratio = 0.8 2026-02-17T21:21:58.768 INFO:teuthology.orchestra.run.trial119.stdout: osd class default list = * 2026-02-17T21:21:58.768 INFO:teuthology.orchestra.run.trial119.stdout: osd class load list = * 2026-02-17T21:21:58.768 INFO:teuthology.orchestra.run.trial119.stdout: osd client watch timeout = 240 2026-02-17T21:21:58.768 INFO:teuthology.orchestra.run.trial119.stdout: osd debug verify cached snaps = True 2026-02-17T21:21:58.768 INFO:teuthology.orchestra.run.trial119.stdout: osd debug verify missing on start = True 2026-02-17T21:21:58.768 INFO:teuthology.orchestra.run.trial119.stdout: osd failsafe full ratio = 0.95 2026-02-17T21:21:58.768 INFO:teuthology.orchestra.run.trial119.stdout: osd fast shutdown = False 2026-02-17T21:21:58.768 INFO:teuthology.orchestra.run.trial119.stdout: osd mclock override recovery settings = True 2026-02-17T21:21:58.768 INFO:teuthology.orchestra.run.trial119.stdout: osd memory target = 1610612736 2026-02-17T21:21:58.768 INFO:teuthology.orchestra.run.trial119.stdout: osd objectstore = bluestore 2026-02-17T21:21:58.768 INFO:teuthology.orchestra.run.trial119.stdout: osd op queue = debug_random 2026-02-17T21:21:58.768 INFO:teuthology.orchestra.run.trial119.stdout: osd op queue cut off = debug_random 2026-02-17T21:21:58.768 INFO:teuthology.orchestra.run.trial119.stdout: osd shutdown pgref assert = True 2026-02-17T21:21:58.768 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.768 INFO:teuthology.orchestra.run.trial119.stdout:[mgr] 2026-02-17T21:21:58.768 INFO:teuthology.orchestra.run.trial119.stdout: debug ms = 1 2026-02-17T21:21:58.769 INFO:teuthology.orchestra.run.trial119.stdout: debug mgr = 20 2026-02-17T21:21:58.769 INFO:teuthology.orchestra.run.trial119.stdout: debug mon = 20 2026-02-17T21:21:58.769 INFO:teuthology.orchestra.run.trial119.stdout: debug auth = 20 2026-02-17T21:21:58.769 INFO:teuthology.orchestra.run.trial119.stdout: mon reweight min pgs per osd = 4 2026-02-17T21:21:58.769 INFO:teuthology.orchestra.run.trial119.stdout: mon reweight min bytes per osd = 10 2026-02-17T21:21:58.769 INFO:teuthology.orchestra.run.trial119.stdout: mgr/telemetry/nag = false 2026-02-17T21:21:58.769 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.769 INFO:teuthology.orchestra.run.trial119.stdout:[mon] 2026-02-17T21:21:58.769 INFO:teuthology.orchestra.run.trial119.stdout: debug ms = 1 2026-02-17T21:21:58.769 INFO:teuthology.orchestra.run.trial119.stdout: debug mon = 20 2026-02-17T21:21:58.769 INFO:teuthology.orchestra.run.trial119.stdout: debug paxos = 20 2026-02-17T21:21:58.769 INFO:teuthology.orchestra.run.trial119.stdout: debug auth = 20 2026-02-17T21:21:58.769 INFO:teuthology.orchestra.run.trial119.stdout: mon data avail warn = 5 2026-02-17T21:21:58.769 INFO:teuthology.orchestra.run.trial119.stdout: mon mgr mkfs grace = 240 2026-02-17T21:21:58.769 INFO:teuthology.orchestra.run.trial119.stdout: mon reweight min pgs per osd = 4 2026-02-17T21:21:58.769 INFO:teuthology.orchestra.run.trial119.stdout: mon osd reporter subtree level = osd 2026-02-17T21:21:58.769 INFO:teuthology.orchestra.run.trial119.stdout: mon osd prime pg temp = true 2026-02-17T21:21:58.769 INFO:teuthology.orchestra.run.trial119.stdout: mon reweight min bytes per osd = 10 2026-02-17T21:21:58.769 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.769 INFO:teuthology.orchestra.run.trial119.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T21:21:58.769 INFO:teuthology.orchestra.run.trial119.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T21:21:58.770 INFO:teuthology.orchestra.run.trial119.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T21:21:58.770 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.770 INFO:teuthology.orchestra.run.trial119.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T21:21:58.770 INFO:teuthology.orchestra.run.trial119.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T21:21:58.770 INFO:teuthology.orchestra.run.trial119.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T21:21:58.770 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.770 INFO:teuthology.orchestra.run.trial119.stdout: # 1m isn't quite enough 2026-02-17T21:21:58.770 INFO:teuthology.orchestra.run.trial119.stdout: mon_down_mkfs_grace = 2m 2026-02-17T21:21:58.770 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.770 INFO:teuthology.orchestra.run.trial119.stdout: mon_warn_on_filestore_osds = false 2026-02-17T21:21:58.770 INFO:teuthology.orchestra.run.trial119.stdout: mon min osdmap epochs = 50 2026-02-17T21:21:58.770 INFO:teuthology.orchestra.run.trial119.stdout: mon osd crush smoke test = False 2026-02-17T21:21:58.770 INFO:teuthology.orchestra.run.trial119.stdout: mon osdmap full prune interval = 2 2026-02-17T21:21:58.770 INFO:teuthology.orchestra.run.trial119.stdout: mon osdmap full prune min = 15 2026-02-17T21:21:58.770 INFO:teuthology.orchestra.run.trial119.stdout: mon osdmap full prune txsize = 2 2026-02-17T21:21:58.770 INFO:teuthology.orchestra.run.trial119.stdout: mon scrub interval = 300 2026-02-17T21:21:58.770 INFO:teuthology.orchestra.run.trial119.stdout: mon warn on pool no app = False 2026-02-17T21:21:58.770 INFO:teuthology.orchestra.run.trial119.stdout: paxos service trim min = 10 2026-02-17T21:21:58.770 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T21:21:58.770 INFO:teuthology.orchestra.run.trial119.stdout:[client] 2026-02-17T21:21:58.770 INFO:teuthology.orchestra.run.trial119.stdout: rgw cache enabled = true 2026-02-17T21:21:58.771 INFO:teuthology.orchestra.run.trial119.stdout: rgw enable ops log = true 2026-02-17T21:21:58.771 INFO:teuthology.orchestra.run.trial119.stdout: rgw enable usage log = true 2026-02-17T21:21:58.771 INFO:teuthology.orchestra.run.trial119.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T21:21:58.771 INFO:teuthology.orchestra.run.trial119.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T21:21:58.771 INFO:teuthology.orchestra.run.trial119.stdout: debug monc = 20 2026-02-17T21:21:58.771 INFO:teuthology.orchestra.run.trial119.stdout: debug ms = 1 2026-02-17T21:21:58.771 INFO:teuthology.orchestra.run.trial119.stdout: debug objecter = 20 2026-02-17T21:21:58.771 INFO:teuthology.orchestra.run.trial119.stdout: debug rados = 20 2026-02-17T21:21:58.771 INFO:teuthology.orchestra.run.trial119.stdout:[mon.a] 2026-02-17T21:21:58.771 INFO:teuthology.orchestra.run.trial119.stdout:[mon.b] 2026-02-17T21:21:58.771 INFO:teuthology.orchestra.run.trial119.stdout:[mon.c] 2026-02-17T21:21:58.772 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-17T21:21:58.772 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-17T21:21:58.845 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-17T21:21:58.845 DEBUG:teuthology.orchestra.run.trial005:> set -ex 2026-02-17T21:21:58.845 DEBUG:teuthology.orchestra.run.trial005:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-17T21:21:58.903 DEBUG:teuthology.orchestra.run.trial005:> set -ex 2026-02-17T21:21:58.903 DEBUG:teuthology.orchestra.run.trial005:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-17T21:21:58.960 INFO:tasks.ceph:Sending monmap to node ubuntu@trial005.front.sepia.ceph.com 2026-02-17T21:21:58.960 DEBUG:teuthology.orchestra.run.trial005:> set -ex 2026-02-17T21:21:58.960 DEBUG:teuthology.orchestra.run.trial005:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T21:21:58.960 DEBUG:teuthology.orchestra.run.trial005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T21:21:59.034 DEBUG:teuthology.orchestra.run.trial005:> set -ex 2026-02-17T21:21:59.034 DEBUG:teuthology.orchestra.run.trial005:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:21:59.092 INFO:tasks.ceph:Sending monmap to node ubuntu@trial119.front.sepia.ceph.com 2026-02-17T21:21:59.092 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T21:21:59.092 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T21:21:59.092 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T21:21:59.125 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T21:21:59.125 DEBUG:teuthology.orchestra.run.trial119:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:21:59.180 INFO:tasks.ceph:Sending monmap to node ubuntu@trial135.front.sepia.ceph.com 2026-02-17T21:21:59.180 DEBUG:teuthology.orchestra.run.trial135:> set -ex 2026-02-17T21:21:59.180 DEBUG:teuthology.orchestra.run.trial135:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T21:21:59.181 DEBUG:teuthology.orchestra.run.trial135:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T21:21:59.214 DEBUG:teuthology.orchestra.run.trial135:> set -ex 2026-02-17T21:21:59.214 DEBUG:teuthology.orchestra.run.trial135:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:21:59.272 INFO:tasks.ceph:Sending monmap to node ubuntu@trial176.front.sepia.ceph.com 2026-02-17T21:21:59.272 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T21:21:59.272 DEBUG:teuthology.orchestra.run.trial176:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T21:21:59.272 DEBUG:teuthology.orchestra.run.trial176:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T21:21:59.307 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T21:21:59.307 DEBUG:teuthology.orchestra.run.trial176:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:21:59.366 INFO:tasks.ceph:Setting up mon nodes... 2026-02-17T21:21:59.366 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-17T21:21:59.367 DEBUG:teuthology.orchestra.run.trial005:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2026-02-17T21:21:59.412 INFO:teuthology.orchestra.run.trial005.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2026-02-17T21:21:59.415 DEBUG:teuthology.orchestra.run.trial176:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T21:21:59.460 INFO:teuthology.orchestra.run.trial176.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T21:21:59.463 INFO:tasks.ceph:Setting up mds nodes... 2026-02-17T21:21:59.463 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-17T21:21:59.464 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-17T21:21:59.498 INFO:teuthology.orchestra.run.trial176.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-17T21:21:59.509 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-17T21:21:59.510 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial119.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial135.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial176.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2026-02-17T21:21:59.510 DEBUG:teuthology.orchestra.run.trial005:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-17T21:21:59.535 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-17T21:21:59.535 INFO:tasks.ceph:role: osd.0 2026-02-17T21:21:59.535 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial005.front.sepia.ceph.com 2026-02-17T21:21:59.535 DEBUG:teuthology.orchestra.run.trial005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T21:21:59.601 INFO:teuthology.orchestra.run.trial005.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:21:59.601 INFO:teuthology.orchestra.run.trial005.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:21:59.601 INFO:teuthology.orchestra.run.trial005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:21:59.601 INFO:teuthology.orchestra.run.trial005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:21:59.602 INFO:teuthology.orchestra.run.trial005.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:21:59.602 INFO:teuthology.orchestra.run.trial005.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:21:59.602 INFO:teuthology.orchestra.run.trial005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:21:59.602 INFO:teuthology.orchestra.run.trial005.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:21:59.602 INFO:teuthology.orchestra.run.trial005.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:21:59.602 INFO:teuthology.orchestra.run.trial005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:22:00.175 INFO:teuthology.orchestra.run.trial005.stdout:Discarding blocks...Done. 2026-02-17T21:22:00.178 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial005.front.sepia.ceph.com -o noatime 2026-02-17T21:22:00.178 DEBUG:teuthology.orchestra.run.trial005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-17T21:22:00.246 DEBUG:teuthology.orchestra.run.trial005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-17T21:22:00.314 DEBUG:teuthology.orchestra.run.trial005:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-17T21:22:00.380 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-17T21:22:00.380 INFO:tasks.ceph:role: osd.4 2026-02-17T21:22:00.380 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial005.front.sepia.ceph.com 2026-02-17T21:22:00.380 DEBUG:teuthology.orchestra.run.trial005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T21:22:00.444 INFO:teuthology.orchestra.run.trial005.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:22:00.445 INFO:teuthology.orchestra.run.trial005.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:22:00.445 INFO:teuthology.orchestra.run.trial005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:22:00.445 INFO:teuthology.orchestra.run.trial005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:22:00.445 INFO:teuthology.orchestra.run.trial005.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:22:00.445 INFO:teuthology.orchestra.run.trial005.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:22:00.445 INFO:teuthology.orchestra.run.trial005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:22:00.445 INFO:teuthology.orchestra.run.trial005.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:22:00.445 INFO:teuthology.orchestra.run.trial005.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:22:00.445 INFO:teuthology.orchestra.run.trial005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:22:01.003 INFO:teuthology.orchestra.run.trial005.stdout:Discarding blocks...Done. 2026-02-17T21:22:01.005 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial005.front.sepia.ceph.com -o noatime 2026-02-17T21:22:01.005 DEBUG:teuthology.orchestra.run.trial005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2026-02-17T21:22:01.078 DEBUG:teuthology.orchestra.run.trial005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-17T21:22:01.144 DEBUG:teuthology.orchestra.run.trial005:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2026-02-17T21:22:01.208 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-17T21:22:01.208 INFO:tasks.ceph:role: osd.8 2026-02-17T21:22:01.208 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial005.front.sepia.ceph.com 2026-02-17T21:22:01.209 DEBUG:teuthology.orchestra.run.trial005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T21:22:01.274 INFO:teuthology.orchestra.run.trial005.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:22:01.274 INFO:teuthology.orchestra.run.trial005.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:22:01.274 INFO:teuthology.orchestra.run.trial005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:22:01.274 INFO:teuthology.orchestra.run.trial005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:22:01.274 INFO:teuthology.orchestra.run.trial005.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:22:01.275 INFO:teuthology.orchestra.run.trial005.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:22:01.275 INFO:teuthology.orchestra.run.trial005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:22:01.275 INFO:teuthology.orchestra.run.trial005.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:22:01.275 INFO:teuthology.orchestra.run.trial005.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:22:01.275 INFO:teuthology.orchestra.run.trial005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:22:01.833 INFO:teuthology.orchestra.run.trial005.stdout:Discarding blocks...Done. 2026-02-17T21:22:01.835 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial005.front.sepia.ceph.com -o noatime 2026-02-17T21:22:01.835 DEBUG:teuthology.orchestra.run.trial005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2026-02-17T21:22:01.904 DEBUG:teuthology.orchestra.run.trial005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2026-02-17T21:22:01.971 DEBUG:teuthology.orchestra.run.trial005:> sudo mkdir -p /var/lib/ceph/osd/ceph-12 2026-02-17T21:22:02.034 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-17T21:22:02.035 INFO:tasks.ceph:role: osd.12 2026-02-17T21:22:02.035 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial005.front.sepia.ceph.com 2026-02-17T21:22:02.035 DEBUG:teuthology.orchestra.run.trial005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-17T21:22:02.100 INFO:teuthology.orchestra.run.trial005.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:22:02.100 INFO:teuthology.orchestra.run.trial005.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:22:02.101 INFO:teuthology.orchestra.run.trial005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:22:02.101 INFO:teuthology.orchestra.run.trial005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:22:02.101 INFO:teuthology.orchestra.run.trial005.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:22:02.101 INFO:teuthology.orchestra.run.trial005.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:22:02.101 INFO:teuthology.orchestra.run.trial005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:22:02.101 INFO:teuthology.orchestra.run.trial005.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:22:02.101 INFO:teuthology.orchestra.run.trial005.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:22:02.101 INFO:teuthology.orchestra.run.trial005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:22:02.656 INFO:teuthology.orchestra.run.trial005.stdout:Discarding blocks...Done. 2026-02-17T21:22:02.658 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial005.front.sepia.ceph.com -o noatime 2026-02-17T21:22:02.658 DEBUG:teuthology.orchestra.run.trial005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-12 2026-02-17T21:22:02.734 DEBUG:teuthology.orchestra.run.trial005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-12 2026-02-17T21:22:02.801 DEBUG:teuthology.orchestra.run.trial005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:22:02.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:22:02.877+0000 7f71551ad780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-17T21:22:02.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:22:02.877+0000 7f71551ad780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-17T21:22:02.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:22:02.877+0000 7f71551ad780 -1 bdev(0x559624b9d800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-17T21:22:02.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:22:02.878+0000 7f71551ad780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-17T21:22:06.762 DEBUG:teuthology.orchestra.run.trial005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-17T21:22:06.827 DEBUG:teuthology.orchestra.run.trial005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:22:06.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:22:06.904+0000 7f07c469d780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-17T21:22:06.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:22:06.905+0000 7f07c469d780 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-17T21:22:06.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:22:06.905+0000 7f07c469d780 -1 bdev(0x559f42133800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-17T21:22:06.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:22:06.905+0000 7f07c469d780 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-17T21:22:10.789 DEBUG:teuthology.orchestra.run.trial005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-17T21:22:10.853 DEBUG:teuthology.orchestra.run.trial005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:22:10.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:22:10.927+0000 7fcfdc7f9780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2026-02-17T21:22:10.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:22:10.927+0000 7fcfdc7f9780 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2026-02-17T21:22:10.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:22:10.927+0000 7fcfdc7f9780 -1 bdev(0x559ec6abf800 /var/lib/ceph/osd/ceph-8/block) open stat got: (1) Operation not permitted 2026-02-17T21:22:10.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:22:10.927+0000 7fcfdc7f9780 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2026-02-17T21:22:14.812 DEBUG:teuthology.orchestra.run.trial005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2026-02-17T21:22:14.878 DEBUG:teuthology.orchestra.run.trial005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 12 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:22:14.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:22:14.952+0000 7f88d3023780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-12/keyring: can't open /var/lib/ceph/osd/ceph-12/keyring: (2) No such file or directory 2026-02-17T21:22:14.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:22:14.952+0000 7f88d3023780 -1 created new key in keyring /var/lib/ceph/osd/ceph-12/keyring 2026-02-17T21:22:14.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:22:14.952+0000 7f88d3023780 -1 bdev(0x559a5199b800 /var/lib/ceph/osd/ceph-12/block) open stat got: (1) Operation not permitted 2026-02-17T21:22:14.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:22:14.953+0000 7f88d3023780 -1 bluestore(/var/lib/ceph/osd/ceph-12) _read_fsid unparsable uuid 2026-02-17T21:22:18.846 DEBUG:teuthology.orchestra.run.trial005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-12 2026-02-17T21:22:18.910 DEBUG:teuthology.orchestra.run.trial119:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-17T21:22:18.935 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-17T21:22:18.935 INFO:tasks.ceph:role: osd.1 2026-02-17T21:22:18.936 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial119.front.sepia.ceph.com 2026-02-17T21:22:18.936 DEBUG:teuthology.orchestra.run.trial119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T21:22:19.003 INFO:teuthology.orchestra.run.trial119.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:22:19.003 INFO:teuthology.orchestra.run.trial119.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:22:19.003 INFO:teuthology.orchestra.run.trial119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:22:19.003 INFO:teuthology.orchestra.run.trial119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:22:19.003 INFO:teuthology.orchestra.run.trial119.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:22:19.003 INFO:teuthology.orchestra.run.trial119.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:22:19.003 INFO:teuthology.orchestra.run.trial119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:22:19.003 INFO:teuthology.orchestra.run.trial119.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:22:19.004 INFO:teuthology.orchestra.run.trial119.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:22:19.004 INFO:teuthology.orchestra.run.trial119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:22:19.588 INFO:teuthology.orchestra.run.trial119.stdout:Discarding blocks...Done. 2026-02-17T21:22:19.590 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial119.front.sepia.ceph.com -o noatime 2026-02-17T21:22:19.590 DEBUG:teuthology.orchestra.run.trial119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2026-02-17T21:22:19.659 DEBUG:teuthology.orchestra.run.trial119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-17T21:22:19.725 DEBUG:teuthology.orchestra.run.trial119:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-17T21:22:19.788 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-17T21:22:19.789 INFO:tasks.ceph:role: osd.5 2026-02-17T21:22:19.789 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial119.front.sepia.ceph.com 2026-02-17T21:22:19.789 DEBUG:teuthology.orchestra.run.trial119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T21:22:19.852 INFO:teuthology.orchestra.run.trial119.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:22:19.853 INFO:teuthology.orchestra.run.trial119.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:22:19.853 INFO:teuthology.orchestra.run.trial119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:22:19.853 INFO:teuthology.orchestra.run.trial119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:22:19.853 INFO:teuthology.orchestra.run.trial119.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:22:19.853 INFO:teuthology.orchestra.run.trial119.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:22:19.853 INFO:teuthology.orchestra.run.trial119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:22:19.853 INFO:teuthology.orchestra.run.trial119.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:22:19.853 INFO:teuthology.orchestra.run.trial119.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:22:19.853 INFO:teuthology.orchestra.run.trial119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:22:20.410 INFO:teuthology.orchestra.run.trial119.stdout:Discarding blocks...Done. 2026-02-17T21:22:20.412 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial119.front.sepia.ceph.com -o noatime 2026-02-17T21:22:20.412 DEBUG:teuthology.orchestra.run.trial119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2026-02-17T21:22:20.479 DEBUG:teuthology.orchestra.run.trial119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-17T21:22:20.545 DEBUG:teuthology.orchestra.run.trial119:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2026-02-17T21:22:20.608 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-17T21:22:20.608 INFO:tasks.ceph:role: osd.9 2026-02-17T21:22:20.608 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial119.front.sepia.ceph.com 2026-02-17T21:22:20.608 DEBUG:teuthology.orchestra.run.trial119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T21:22:20.672 INFO:teuthology.orchestra.run.trial119.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:22:20.673 INFO:teuthology.orchestra.run.trial119.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:22:20.673 INFO:teuthology.orchestra.run.trial119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:22:20.673 INFO:teuthology.orchestra.run.trial119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:22:20.673 INFO:teuthology.orchestra.run.trial119.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:22:20.673 INFO:teuthology.orchestra.run.trial119.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:22:20.673 INFO:teuthology.orchestra.run.trial119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:22:20.673 INFO:teuthology.orchestra.run.trial119.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:22:20.673 INFO:teuthology.orchestra.run.trial119.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:22:20.673 INFO:teuthology.orchestra.run.trial119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:22:21.246 INFO:teuthology.orchestra.run.trial119.stdout:Discarding blocks...Done. 2026-02-17T21:22:21.248 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial119.front.sepia.ceph.com -o noatime 2026-02-17T21:22:21.248 DEBUG:teuthology.orchestra.run.trial119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-9 2026-02-17T21:22:21.316 DEBUG:teuthology.orchestra.run.trial119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2026-02-17T21:22:21.385 DEBUG:teuthology.orchestra.run.trial119:> sudo mkdir -p /var/lib/ceph/osd/ceph-13 2026-02-17T21:22:21.450 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-17T21:22:21.451 INFO:tasks.ceph:role: osd.13 2026-02-17T21:22:21.451 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial119.front.sepia.ceph.com 2026-02-17T21:22:21.451 DEBUG:teuthology.orchestra.run.trial119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-17T21:22:21.515 INFO:teuthology.orchestra.run.trial119.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:22:21.515 INFO:teuthology.orchestra.run.trial119.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:22:21.515 INFO:teuthology.orchestra.run.trial119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:22:21.515 INFO:teuthology.orchestra.run.trial119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:22:21.515 INFO:teuthology.orchestra.run.trial119.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:22:21.516 INFO:teuthology.orchestra.run.trial119.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:22:21.516 INFO:teuthology.orchestra.run.trial119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:22:21.516 INFO:teuthology.orchestra.run.trial119.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:22:21.516 INFO:teuthology.orchestra.run.trial119.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:22:21.516 INFO:teuthology.orchestra.run.trial119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:22:22.074 INFO:teuthology.orchestra.run.trial119.stdout:Discarding blocks...Done. 2026-02-17T21:22:22.076 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial119.front.sepia.ceph.com -o noatime 2026-02-17T21:22:22.076 DEBUG:teuthology.orchestra.run.trial119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-13 2026-02-17T21:22:22.152 DEBUG:teuthology.orchestra.run.trial119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-13 2026-02-17T21:22:22.220 DEBUG:teuthology.orchestra.run.trial119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:22:22.299 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T21:22:22.295+0000 7f5ed5811780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-17T21:22:22.299 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T21:22:22.295+0000 7f5ed5811780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-17T21:22:22.300 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T21:22:22.295+0000 7f5ed5811780 -1 bdev(0x5611fac35800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-17T21:22:22.300 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T21:22:22.295+0000 7f5ed5811780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-17T21:22:26.176 DEBUG:teuthology.orchestra.run.trial119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-17T21:22:26.241 DEBUG:teuthology.orchestra.run.trial119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:22:26.319 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T21:22:26.316+0000 7fdb99480780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-17T21:22:26.319 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T21:22:26.317+0000 7fdb99480780 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-17T21:22:26.320 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T21:22:26.317+0000 7fdb99480780 -1 bdev(0x560599625800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-17T21:22:26.320 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T21:22:26.317+0000 7fdb99480780 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-17T21:22:30.204 DEBUG:teuthology.orchestra.run.trial119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-17T21:22:30.268 DEBUG:teuthology.orchestra.run.trial119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:22:30.346 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T21:22:30.343+0000 7f9cf340f780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2026-02-17T21:22:30.346 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T21:22:30.343+0000 7f9cf340f780 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2026-02-17T21:22:30.346 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T21:22:30.343+0000 7f9cf340f780 -1 bdev(0x55c553f11800 /var/lib/ceph/osd/ceph-9/block) open stat got: (1) Operation not permitted 2026-02-17T21:22:30.346 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T21:22:30.344+0000 7f9cf340f780 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2026-02-17T21:22:34.225 DEBUG:teuthology.orchestra.run.trial119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2026-02-17T21:22:34.289 DEBUG:teuthology.orchestra.run.trial119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 13 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:22:34.367 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T21:22:34.364+0000 7fd4b302f780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-13/keyring: can't open /var/lib/ceph/osd/ceph-13/keyring: (2) No such file or directory 2026-02-17T21:22:34.367 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T21:22:34.365+0000 7fd4b302f780 -1 created new key in keyring /var/lib/ceph/osd/ceph-13/keyring 2026-02-17T21:22:34.367 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T21:22:34.365+0000 7fd4b302f780 -1 bdev(0x55c9717c5800 /var/lib/ceph/osd/ceph-13/block) open stat got: (1) Operation not permitted 2026-02-17T21:22:34.368 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T21:22:34.365+0000 7fd4b302f780 -1 bluestore(/var/lib/ceph/osd/ceph-13) _read_fsid unparsable uuid 2026-02-17T21:22:38.250 DEBUG:teuthology.orchestra.run.trial119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-13 2026-02-17T21:22:38.316 DEBUG:teuthology.orchestra.run.trial135:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-17T21:22:38.342 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-17T21:22:38.343 INFO:tasks.ceph:role: osd.2 2026-02-17T21:22:38.343 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial135.front.sepia.ceph.com 2026-02-17T21:22:38.343 DEBUG:teuthology.orchestra.run.trial135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T21:22:38.407 INFO:teuthology.orchestra.run.trial135.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:22:38.408 INFO:teuthology.orchestra.run.trial135.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:22:38.408 INFO:teuthology.orchestra.run.trial135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:22:38.408 INFO:teuthology.orchestra.run.trial135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:22:38.408 INFO:teuthology.orchestra.run.trial135.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:22:38.408 INFO:teuthology.orchestra.run.trial135.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:22:38.408 INFO:teuthology.orchestra.run.trial135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:22:38.408 INFO:teuthology.orchestra.run.trial135.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:22:38.408 INFO:teuthology.orchestra.run.trial135.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:22:38.408 INFO:teuthology.orchestra.run.trial135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:22:39.033 INFO:teuthology.orchestra.run.trial135.stdout:Discarding blocks...Done. 2026-02-17T21:22:39.035 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial135.front.sepia.ceph.com -o noatime 2026-02-17T21:22:39.035 DEBUG:teuthology.orchestra.run.trial135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2026-02-17T21:22:39.110 DEBUG:teuthology.orchestra.run.trial135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-17T21:22:39.178 DEBUG:teuthology.orchestra.run.trial135:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2026-02-17T21:22:39.243 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-17T21:22:39.243 INFO:tasks.ceph:role: osd.6 2026-02-17T21:22:39.243 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial135.front.sepia.ceph.com 2026-02-17T21:22:39.244 DEBUG:teuthology.orchestra.run.trial135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T21:22:39.308 INFO:teuthology.orchestra.run.trial135.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:22:39.308 INFO:teuthology.orchestra.run.trial135.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:22:39.308 INFO:teuthology.orchestra.run.trial135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:22:39.308 INFO:teuthology.orchestra.run.trial135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:22:39.309 INFO:teuthology.orchestra.run.trial135.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:22:39.309 INFO:teuthology.orchestra.run.trial135.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:22:39.309 INFO:teuthology.orchestra.run.trial135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:22:39.309 INFO:teuthology.orchestra.run.trial135.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:22:39.309 INFO:teuthology.orchestra.run.trial135.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:22:39.309 INFO:teuthology.orchestra.run.trial135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:22:39.866 INFO:teuthology.orchestra.run.trial135.stdout:Discarding blocks...Done. 2026-02-17T21:22:39.868 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial135.front.sepia.ceph.com -o noatime 2026-02-17T21:22:39.869 DEBUG:teuthology.orchestra.run.trial135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2026-02-17T21:22:39.936 DEBUG:teuthology.orchestra.run.trial135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2026-02-17T21:22:40.003 DEBUG:teuthology.orchestra.run.trial135:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2026-02-17T21:22:40.068 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-17T21:22:40.068 INFO:tasks.ceph:role: osd.10 2026-02-17T21:22:40.068 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial135.front.sepia.ceph.com 2026-02-17T21:22:40.069 DEBUG:teuthology.orchestra.run.trial135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T21:22:40.132 INFO:teuthology.orchestra.run.trial135.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:22:40.132 INFO:teuthology.orchestra.run.trial135.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:22:40.132 INFO:teuthology.orchestra.run.trial135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:22:40.133 INFO:teuthology.orchestra.run.trial135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:22:40.133 INFO:teuthology.orchestra.run.trial135.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:22:40.133 INFO:teuthology.orchestra.run.trial135.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:22:40.133 INFO:teuthology.orchestra.run.trial135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:22:40.133 INFO:teuthology.orchestra.run.trial135.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:22:40.133 INFO:teuthology.orchestra.run.trial135.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:22:40.133 INFO:teuthology.orchestra.run.trial135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:22:40.744 INFO:teuthology.orchestra.run.trial135.stdout:Discarding blocks...Done. 2026-02-17T21:22:40.745 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial135.front.sepia.ceph.com -o noatime 2026-02-17T21:22:40.746 DEBUG:teuthology.orchestra.run.trial135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-10 2026-02-17T21:22:40.815 DEBUG:teuthology.orchestra.run.trial135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2026-02-17T21:22:40.883 DEBUG:teuthology.orchestra.run.trial135:> sudo mkdir -p /var/lib/ceph/osd/ceph-14 2026-02-17T21:22:40.946 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-17T21:22:40.947 INFO:tasks.ceph:role: osd.14 2026-02-17T21:22:40.947 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial135.front.sepia.ceph.com 2026-02-17T21:22:40.947 DEBUG:teuthology.orchestra.run.trial135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-17T21:22:41.013 INFO:teuthology.orchestra.run.trial135.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:22:41.013 INFO:teuthology.orchestra.run.trial135.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:22:41.013 INFO:teuthology.orchestra.run.trial135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:22:41.013 INFO:teuthology.orchestra.run.trial135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:22:41.013 INFO:teuthology.orchestra.run.trial135.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:22:41.013 INFO:teuthology.orchestra.run.trial135.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:22:41.013 INFO:teuthology.orchestra.run.trial135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:22:41.014 INFO:teuthology.orchestra.run.trial135.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:22:41.014 INFO:teuthology.orchestra.run.trial135.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:22:41.014 INFO:teuthology.orchestra.run.trial135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:22:41.568 INFO:teuthology.orchestra.run.trial135.stdout:Discarding blocks...Done. 2026-02-17T21:22:41.570 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial135.front.sepia.ceph.com -o noatime 2026-02-17T21:22:41.571 DEBUG:teuthology.orchestra.run.trial135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-14 2026-02-17T21:22:41.649 DEBUG:teuthology.orchestra.run.trial135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-14 2026-02-17T21:22:41.716 DEBUG:teuthology.orchestra.run.trial135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:22:41.795 INFO:teuthology.orchestra.run.trial135.stderr:2026-02-17T21:22:41.792+0000 7fd2afa9d780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-17T21:22:41.795 INFO:teuthology.orchestra.run.trial135.stderr:2026-02-17T21:22:41.792+0000 7fd2afa9d780 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-17T21:22:41.795 INFO:teuthology.orchestra.run.trial135.stderr:2026-02-17T21:22:41.792+0000 7fd2afa9d780 -1 bdev(0x555db05d9800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-17T21:22:41.795 INFO:teuthology.orchestra.run.trial135.stderr:2026-02-17T21:22:41.793+0000 7fd2afa9d780 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-17T21:22:45.678 DEBUG:teuthology.orchestra.run.trial135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-17T21:22:45.743 DEBUG:teuthology.orchestra.run.trial135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:22:45.823 INFO:teuthology.orchestra.run.trial135.stderr:2026-02-17T21:22:45.820+0000 7ff84260d780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2026-02-17T21:22:45.823 INFO:teuthology.orchestra.run.trial135.stderr:2026-02-17T21:22:45.820+0000 7ff84260d780 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2026-02-17T21:22:45.823 INFO:teuthology.orchestra.run.trial135.stderr:2026-02-17T21:22:45.820+0000 7ff84260d780 -1 bdev(0x55a136e47800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2026-02-17T21:22:45.823 INFO:teuthology.orchestra.run.trial135.stderr:2026-02-17T21:22:45.820+0000 7ff84260d780 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2026-02-17T21:22:49.700 DEBUG:teuthology.orchestra.run.trial135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2026-02-17T21:22:49.764 DEBUG:teuthology.orchestra.run.trial135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:22:49.842 INFO:teuthology.orchestra.run.trial135.stderr:2026-02-17T21:22:49.840+0000 7f2bc821f780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2026-02-17T21:22:49.843 INFO:teuthology.orchestra.run.trial135.stderr:2026-02-17T21:22:49.841+0000 7f2bc821f780 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2026-02-17T21:22:49.843 INFO:teuthology.orchestra.run.trial135.stderr:2026-02-17T21:22:49.841+0000 7f2bc821f780 -1 bdev(0x559cc16ab800 /var/lib/ceph/osd/ceph-10/block) open stat got: (1) Operation not permitted 2026-02-17T21:22:49.843 INFO:teuthology.orchestra.run.trial135.stderr:2026-02-17T21:22:49.841+0000 7f2bc821f780 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2026-02-17T21:22:53.723 DEBUG:teuthology.orchestra.run.trial135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2026-02-17T21:22:53.788 DEBUG:teuthology.orchestra.run.trial135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 14 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:22:53.866 INFO:teuthology.orchestra.run.trial135.stderr:2026-02-17T21:22:53.864+0000 7f6e20510780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-14/keyring: can't open /var/lib/ceph/osd/ceph-14/keyring: (2) No such file or directory 2026-02-17T21:22:53.867 INFO:teuthology.orchestra.run.trial135.stderr:2026-02-17T21:22:53.865+0000 7f6e20510780 -1 created new key in keyring /var/lib/ceph/osd/ceph-14/keyring 2026-02-17T21:22:53.867 INFO:teuthology.orchestra.run.trial135.stderr:2026-02-17T21:22:53.865+0000 7f6e20510780 -1 bdev(0x564ca9a93800 /var/lib/ceph/osd/ceph-14/block) open stat got: (1) Operation not permitted 2026-02-17T21:22:53.867 INFO:teuthology.orchestra.run.trial135.stderr:2026-02-17T21:22:53.865+0000 7f6e20510780 -1 bluestore(/var/lib/ceph/osd/ceph-14) _read_fsid unparsable uuid 2026-02-17T21:22:57.750 DEBUG:teuthology.orchestra.run.trial135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-14 2026-02-17T21:22:57.815 DEBUG:teuthology.orchestra.run.trial176:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-17T21:22:57.842 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-17T21:22:57.842 INFO:tasks.ceph:role: osd.3 2026-02-17T21:22:57.842 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial176.front.sepia.ceph.com 2026-02-17T21:22:57.843 DEBUG:teuthology.orchestra.run.trial176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T21:22:57.906 INFO:teuthology.orchestra.run.trial176.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:22:57.906 INFO:teuthology.orchestra.run.trial176.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:22:57.907 INFO:teuthology.orchestra.run.trial176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:22:57.907 INFO:teuthology.orchestra.run.trial176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:22:57.907 INFO:teuthology.orchestra.run.trial176.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:22:57.907 INFO:teuthology.orchestra.run.trial176.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:22:57.907 INFO:teuthology.orchestra.run.trial176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:22:57.907 INFO:teuthology.orchestra.run.trial176.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:22:57.907 INFO:teuthology.orchestra.run.trial176.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:22:57.907 INFO:teuthology.orchestra.run.trial176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:22:58.480 INFO:teuthology.orchestra.run.trial176.stdout:Discarding blocks...Done. 2026-02-17T21:22:58.482 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial176.front.sepia.ceph.com -o noatime 2026-02-17T21:22:58.483 DEBUG:teuthology.orchestra.run.trial176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2026-02-17T21:22:58.551 DEBUG:teuthology.orchestra.run.trial176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-17T21:22:58.619 DEBUG:teuthology.orchestra.run.trial176:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2026-02-17T21:22:58.684 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-17T21:22:58.685 INFO:tasks.ceph:role: osd.7 2026-02-17T21:22:58.685 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial176.front.sepia.ceph.com 2026-02-17T21:22:58.685 DEBUG:teuthology.orchestra.run.trial176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T21:22:58.750 INFO:teuthology.orchestra.run.trial176.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:22:58.750 INFO:teuthology.orchestra.run.trial176.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:22:58.750 INFO:teuthology.orchestra.run.trial176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:22:58.750 INFO:teuthology.orchestra.run.trial176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:22:58.751 INFO:teuthology.orchestra.run.trial176.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:22:58.751 INFO:teuthology.orchestra.run.trial176.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:22:58.751 INFO:teuthology.orchestra.run.trial176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:22:58.751 INFO:teuthology.orchestra.run.trial176.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:22:58.751 INFO:teuthology.orchestra.run.trial176.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:22:58.751 INFO:teuthology.orchestra.run.trial176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:22:59.310 INFO:teuthology.orchestra.run.trial176.stdout:Discarding blocks...Done. 2026-02-17T21:22:59.312 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial176.front.sepia.ceph.com -o noatime 2026-02-17T21:22:59.312 DEBUG:teuthology.orchestra.run.trial176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-7 2026-02-17T21:22:59.379 DEBUG:teuthology.orchestra.run.trial176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2026-02-17T21:22:59.446 DEBUG:teuthology.orchestra.run.trial176:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2026-02-17T21:22:59.509 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-17T21:22:59.509 INFO:tasks.ceph:role: osd.11 2026-02-17T21:22:59.510 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial176.front.sepia.ceph.com 2026-02-17T21:22:59.510 DEBUG:teuthology.orchestra.run.trial176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T21:22:59.574 INFO:teuthology.orchestra.run.trial176.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:22:59.575 INFO:teuthology.orchestra.run.trial176.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:22:59.575 INFO:teuthology.orchestra.run.trial176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:22:59.575 INFO:teuthology.orchestra.run.trial176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:22:59.575 INFO:teuthology.orchestra.run.trial176.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:22:59.575 INFO:teuthology.orchestra.run.trial176.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:22:59.575 INFO:teuthology.orchestra.run.trial176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:22:59.575 INFO:teuthology.orchestra.run.trial176.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:22:59.575 INFO:teuthology.orchestra.run.trial176.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:22:59.575 INFO:teuthology.orchestra.run.trial176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:23:00.134 INFO:teuthology.orchestra.run.trial176.stdout:Discarding blocks...Done. 2026-02-17T21:23:00.136 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial176.front.sepia.ceph.com -o noatime 2026-02-17T21:23:00.136 DEBUG:teuthology.orchestra.run.trial176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-11 2026-02-17T21:23:00.204 DEBUG:teuthology.orchestra.run.trial176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2026-02-17T21:23:00.271 DEBUG:teuthology.orchestra.run.trial176:> sudo mkdir -p /var/lib/ceph/osd/ceph-15 2026-02-17T21:23:00.334 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-17T21:23:00.335 INFO:tasks.ceph:role: osd.15 2026-02-17T21:23:00.335 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial176.front.sepia.ceph.com 2026-02-17T21:23:00.335 DEBUG:teuthology.orchestra.run.trial176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-17T21:23:00.399 INFO:teuthology.orchestra.run.trial176.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:23:00.400 INFO:teuthology.orchestra.run.trial176.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:23:00.400 INFO:teuthology.orchestra.run.trial176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:23:00.400 INFO:teuthology.orchestra.run.trial176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:23:00.400 INFO:teuthology.orchestra.run.trial176.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:23:00.400 INFO:teuthology.orchestra.run.trial176.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:23:00.400 INFO:teuthology.orchestra.run.trial176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:23:00.400 INFO:teuthology.orchestra.run.trial176.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:23:00.400 INFO:teuthology.orchestra.run.trial176.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:23:00.400 INFO:teuthology.orchestra.run.trial176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:23:00.956 INFO:teuthology.orchestra.run.trial176.stdout:Discarding blocks...Done. 2026-02-17T21:23:00.958 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial176.front.sepia.ceph.com -o noatime 2026-02-17T21:23:00.959 DEBUG:teuthology.orchestra.run.trial176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-15 2026-02-17T21:23:01.035 DEBUG:teuthology.orchestra.run.trial176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-15 2026-02-17T21:23:01.102 DEBUG:teuthology.orchestra.run.trial176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:23:01.181 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:01.177+0000 7f4912220780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-17T21:23:01.181 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:01.177+0000 7f4912220780 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-17T21:23:01.182 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:01.177+0000 7f4912220780 -1 bdev(0x56156e511800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-17T21:23:01.182 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:01.177+0000 7f4912220780 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-17T21:23:05.063 DEBUG:teuthology.orchestra.run.trial176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-17T21:23:05.127 DEBUG:teuthology.orchestra.run.trial176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:23:05.207 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:05.204+0000 7febf3db4780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2026-02-17T21:23:05.207 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:05.204+0000 7febf3db4780 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2026-02-17T21:23:05.207 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:05.204+0000 7febf3db4780 -1 bdev(0x55ea459cf800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2026-02-17T21:23:05.207 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:05.204+0000 7febf3db4780 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2026-02-17T21:23:09.088 DEBUG:teuthology.orchestra.run.trial176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2026-02-17T21:23:09.153 DEBUG:teuthology.orchestra.run.trial176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:23:09.231 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:09.228+0000 7faa4e519780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2026-02-17T21:23:09.232 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:09.228+0000 7faa4e519780 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2026-02-17T21:23:09.232 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:09.228+0000 7faa4e519780 -1 bdev(0x55b551343800 /var/lib/ceph/osd/ceph-11/block) open stat got: (1) Operation not permitted 2026-02-17T21:23:09.232 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:09.228+0000 7faa4e519780 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2026-02-17T21:23:13.120 DEBUG:teuthology.orchestra.run.trial176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2026-02-17T21:23:13.187 DEBUG:teuthology.orchestra.run.trial176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 15 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:23:13.266 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:13.262+0000 7f6d64e0d780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-15/keyring: can't open /var/lib/ceph/osd/ceph-15/keyring: (2) No such file or directory 2026-02-17T21:23:13.266 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:13.262+0000 7f6d64e0d780 -1 created new key in keyring /var/lib/ceph/osd/ceph-15/keyring 2026-02-17T21:23:13.266 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:13.262+0000 7f6d64e0d780 -1 bdev(0x55a7f84e7800 /var/lib/ceph/osd/ceph-15/block) open stat got: (1) Operation not permitted 2026-02-17T21:23:13.266 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:13.262+0000 7f6d64e0d780 -1 bluestore(/var/lib/ceph/osd/ceph-15) _read_fsid unparsable uuid 2026-02-17T21:23:17.146 DEBUG:teuthology.orchestra.run.trial176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-15 2026-02-17T21:23:17.211 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-17T21:23:17.212 DEBUG:teuthology.orchestra.run.trial005:> set -ex 2026-02-17T21:23:17.212 DEBUG:teuthology.orchestra.run.trial005:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2026-02-17T21:23:17.237 DEBUG:teuthology.orchestra.run.trial005:> set -ex 2026-02-17T21:23:17.237 DEBUG:teuthology.orchestra.run.trial005:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-17T21:23:17.303 DEBUG:teuthology.orchestra.run.trial005:> set -ex 2026-02-17T21:23:17.303 DEBUG:teuthology.orchestra.run.trial005:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-17T21:23:17.367 DEBUG:teuthology.orchestra.run.trial005:> set -ex 2026-02-17T21:23:17.367 DEBUG:teuthology.orchestra.run.trial005:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2026-02-17T21:23:17.431 DEBUG:teuthology.orchestra.run.trial005:> set -ex 2026-02-17T21:23:17.431 DEBUG:teuthology.orchestra.run.trial005:> sudo dd if=/var/lib/ceph/osd/ceph-12/keyring of=/dev/stdout 2026-02-17T21:23:17.494 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T21:23:17.494 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-17T21:23:17.521 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T21:23:17.521 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-17T21:23:17.585 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T21:23:17.586 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2026-02-17T21:23:17.648 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T21:23:17.648 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/var/lib/ceph/osd/ceph-13/keyring of=/dev/stdout 2026-02-17T21:23:17.711 DEBUG:teuthology.orchestra.run.trial135:> set -ex 2026-02-17T21:23:17.711 DEBUG:teuthology.orchestra.run.trial135:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-17T21:23:17.737 DEBUG:teuthology.orchestra.run.trial135:> set -ex 2026-02-17T21:23:17.737 DEBUG:teuthology.orchestra.run.trial135:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2026-02-17T21:23:17.802 DEBUG:teuthology.orchestra.run.trial135:> set -ex 2026-02-17T21:23:17.802 DEBUG:teuthology.orchestra.run.trial135:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2026-02-17T21:23:17.866 DEBUG:teuthology.orchestra.run.trial135:> set -ex 2026-02-17T21:23:17.866 DEBUG:teuthology.orchestra.run.trial135:> sudo dd if=/var/lib/ceph/osd/ceph-14/keyring of=/dev/stdout 2026-02-17T21:23:17.932 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T21:23:17.932 DEBUG:teuthology.orchestra.run.trial176:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-17T21:23:17.959 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T21:23:17.959 DEBUG:teuthology.orchestra.run.trial176:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-17T21:23:18.023 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T21:23:18.023 DEBUG:teuthology.orchestra.run.trial176:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2026-02-17T21:23:18.086 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T21:23:18.087 DEBUG:teuthology.orchestra.run.trial176:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2026-02-17T21:23:18.151 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T21:23:18.151 DEBUG:teuthology.orchestra.run.trial176:> sudo dd if=/var/lib/ceph/osd/ceph-15/keyring of=/dev/stdout 2026-02-17T21:23:18.215 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T21:23:18.215 DEBUG:teuthology.orchestra.run.trial176:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-17T21:23:18.271 INFO:tasks.ceph:Adding keys to all mons... 2026-02-17T21:23:18.271 DEBUG:teuthology.orchestra.run.trial005:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T21:23:18.274 DEBUG:teuthology.orchestra.run.trial119:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T21:23:18.276 DEBUG:teuthology.orchestra.run.trial135:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T21:23:18.295 INFO:teuthology.orchestra.run.trial005.stdout:[mgr.y] 2026-02-17T21:23:18.295 INFO:teuthology.orchestra.run.trial005.stdout: key = AQD325Rp6pGOGBAADhWICMPUMeFlrhHDBjCewA== 2026-02-17T21:23:18.295 INFO:teuthology.orchestra.run.trial005.stdout:[osd.0] 2026-02-17T21:23:18.295 INFO:teuthology.orchestra.run.trial005.stdout: key = AQD625Rphd9YNBAAsw8/miEOxwJV6GYcvwu3mw== 2026-02-17T21:23:18.295 INFO:teuthology.orchestra.run.trial005.stdout:[osd.4] 2026-02-17T21:23:18.295 INFO:teuthology.orchestra.run.trial005.stdout: key = AQD+25RpDjz4NRAAA5LH0vak9nXuSWZ1KV9r5g== 2026-02-17T21:23:18.295 INFO:teuthology.orchestra.run.trial005.stdout:[osd.8] 2026-02-17T21:23:18.296 INFO:teuthology.orchestra.run.trial005.stdout: key = AQAC3JRpuR1iNxAAIVsfHTC32+hBY8wqxNVMUQ== 2026-02-17T21:23:18.296 INFO:teuthology.orchestra.run.trial005.stdout:[osd.12] 2026-02-17T21:23:18.296 INFO:teuthology.orchestra.run.trial005.stdout: key = AQAG3JRpuxjhOBAAqjNotDWJE04QwS08fkmjZg== 2026-02-17T21:23:18.296 INFO:teuthology.orchestra.run.trial005.stdout:[osd.1] 2026-02-17T21:23:18.296 INFO:teuthology.orchestra.run.trial005.stdout: key = AQAO3JRpSAS7ERAA/B5sl+c9FtuMeyuHVBAnPw== 2026-02-17T21:23:18.296 INFO:teuthology.orchestra.run.trial005.stdout:[osd.5] 2026-02-17T21:23:18.296 INFO:teuthology.orchestra.run.trial005.stdout: key = AQAS3JRpne3xEhAAPwBC3mzVYSANlpsKzKyKfA== 2026-02-17T21:23:18.296 INFO:teuthology.orchestra.run.trial005.stdout:[osd.9] 2026-02-17T21:23:18.296 INFO:teuthology.orchestra.run.trial005.stdout: key = AQAW3JRp7oCIFBAAIVhXpbJCEFVhZk0+/qh3UQ== 2026-02-17T21:23:18.296 INFO:teuthology.orchestra.run.trial005.stdout:[osd.13] 2026-02-17T21:23:18.296 INFO:teuthology.orchestra.run.trial005.stdout: key = AQAa3JRpbqbLFRAA5X/EdZ/MzhujPnEtX8xzXA== 2026-02-17T21:23:18.297 INFO:teuthology.orchestra.run.trial005.stdout:[osd.2] 2026-02-17T21:23:18.297 INFO:teuthology.orchestra.run.trial005.stdout: key = AQAh3JRpfXdSLxAAVpIDUgVPSxkj3AqLKaSfTA== 2026-02-17T21:23:18.297 INFO:teuthology.orchestra.run.trial005.stdout:[osd.6] 2026-02-17T21:23:18.297 INFO:teuthology.orchestra.run.trial005.stdout: key = AQAl3JRpUsr8MBAA/O2tLxHr+C4Im8to84bL+g== 2026-02-17T21:23:18.297 INFO:teuthology.orchestra.run.trial005.stdout:[osd.10] 2026-02-17T21:23:18.297 INFO:teuthology.orchestra.run.trial005.stdout: key = AQAp3JRpNLAxMhAA/yP1XhUDcadW7P6XMdoXFQ== 2026-02-17T21:23:18.297 INFO:teuthology.orchestra.run.trial005.stdout:[osd.14] 2026-02-17T21:23:18.297 INFO:teuthology.orchestra.run.trial005.stdout: key = AQAt3JRpVIehMxAA/MUGTsKy8Cz/T42RUflWUg== 2026-02-17T21:23:18.297 INFO:teuthology.orchestra.run.trial005.stdout:[mgr.x] 2026-02-17T21:23:18.297 INFO:teuthology.orchestra.run.trial005.stdout: key = AQD325RpR/tOGxAA48FSIYH2GQ8ulR0saaiFJQ== 2026-02-17T21:23:18.297 INFO:teuthology.orchestra.run.trial005.stdout:[osd.3] 2026-02-17T21:23:18.297 INFO:teuthology.orchestra.run.trial005.stdout: key = AQA13JRpdzGqChAAaTKvJf2q6nreTdPc3O/zMg== 2026-02-17T21:23:18.298 INFO:teuthology.orchestra.run.trial005.stdout:[osd.7] 2026-02-17T21:23:18.298 INFO:teuthology.orchestra.run.trial005.stdout: key = AQA53JRpAKQ3DBAACNLCvBslx+J3HvU2b+yqvQ== 2026-02-17T21:23:18.298 INFO:teuthology.orchestra.run.trial005.stdout:[osd.11] 2026-02-17T21:23:18.298 INFO:teuthology.orchestra.run.trial005.stdout: key = AQA93JRpU6ekDRAAmv3nweEAxGyyf0v1U/IIzQ== 2026-02-17T21:23:18.298 INFO:teuthology.orchestra.run.trial005.stdout:[osd.15] 2026-02-17T21:23:18.298 INFO:teuthology.orchestra.run.trial005.stdout: key = AQBB3JRpDIKvDxAAX/g34bqA/AXAKH+wkuYMqw== 2026-02-17T21:23:18.298 INFO:teuthology.orchestra.run.trial005.stdout:[client.0] 2026-02-17T21:23:18.298 INFO:teuthology.orchestra.run.trial005.stdout: key = AQD325Rpg7qWHRAAWB4rPWTuYphJIFS35ABIaQ== 2026-02-17T21:23:18.300 INFO:teuthology.orchestra.run.trial119.stdout:[mgr.y] 2026-02-17T21:23:18.300 INFO:teuthology.orchestra.run.trial119.stdout: key = AQD325Rp6pGOGBAADhWICMPUMeFlrhHDBjCewA== 2026-02-17T21:23:18.300 INFO:teuthology.orchestra.run.trial119.stdout:[osd.0] 2026-02-17T21:23:18.300 INFO:teuthology.orchestra.run.trial119.stdout: key = AQD625Rphd9YNBAAsw8/miEOxwJV6GYcvwu3mw== 2026-02-17T21:23:18.300 INFO:teuthology.orchestra.run.trial119.stdout:[osd.4] 2026-02-17T21:23:18.300 INFO:teuthology.orchestra.run.trial119.stdout: key = AQD+25RpDjz4NRAAA5LH0vak9nXuSWZ1KV9r5g== 2026-02-17T21:23:18.300 INFO:teuthology.orchestra.run.trial119.stdout:[osd.8] 2026-02-17T21:23:18.301 INFO:teuthology.orchestra.run.trial119.stdout: key = AQAC3JRpuR1iNxAAIVsfHTC32+hBY8wqxNVMUQ== 2026-02-17T21:23:18.301 INFO:teuthology.orchestra.run.trial119.stdout:[osd.12] 2026-02-17T21:23:18.301 INFO:teuthology.orchestra.run.trial119.stdout: key = AQAG3JRpuxjhOBAAqjNotDWJE04QwS08fkmjZg== 2026-02-17T21:23:18.301 INFO:teuthology.orchestra.run.trial119.stdout:[osd.1] 2026-02-17T21:23:18.301 INFO:teuthology.orchestra.run.trial119.stdout: key = AQAO3JRpSAS7ERAA/B5sl+c9FtuMeyuHVBAnPw== 2026-02-17T21:23:18.301 INFO:teuthology.orchestra.run.trial119.stdout:[osd.5] 2026-02-17T21:23:18.301 INFO:teuthology.orchestra.run.trial119.stdout: key = AQAS3JRpne3xEhAAPwBC3mzVYSANlpsKzKyKfA== 2026-02-17T21:23:18.301 INFO:teuthology.orchestra.run.trial119.stdout:[osd.9] 2026-02-17T21:23:18.301 INFO:teuthology.orchestra.run.trial119.stdout: key = AQAW3JRp7oCIFBAAIVhXpbJCEFVhZk0+/qh3UQ== 2026-02-17T21:23:18.301 INFO:teuthology.orchestra.run.trial119.stdout:[osd.13] 2026-02-17T21:23:18.301 INFO:teuthology.orchestra.run.trial119.stdout: key = AQAa3JRpbqbLFRAA5X/EdZ/MzhujPnEtX8xzXA== 2026-02-17T21:23:18.301 INFO:teuthology.orchestra.run.trial119.stdout:[osd.2] 2026-02-17T21:23:18.302 INFO:teuthology.orchestra.run.trial119.stdout: key = AQAh3JRpfXdSLxAAVpIDUgVPSxkj3AqLKaSfTA== 2026-02-17T21:23:18.302 INFO:teuthology.orchestra.run.trial119.stdout:[osd.6] 2026-02-17T21:23:18.302 INFO:teuthology.orchestra.run.trial119.stdout: key = AQAl3JRpUsr8MBAA/O2tLxHr+C4Im8to84bL+g== 2026-02-17T21:23:18.302 INFO:teuthology.orchestra.run.trial119.stdout:[osd.10] 2026-02-17T21:23:18.302 INFO:teuthology.orchestra.run.trial119.stdout: key = AQAp3JRpNLAxMhAA/yP1XhUDcadW7P6XMdoXFQ== 2026-02-17T21:23:18.302 INFO:teuthology.orchestra.run.trial119.stdout:[osd.14] 2026-02-17T21:23:18.302 INFO:teuthology.orchestra.run.trial119.stdout: key = AQAt3JRpVIehMxAA/MUGTsKy8Cz/T42RUflWUg== 2026-02-17T21:23:18.302 INFO:teuthology.orchestra.run.trial119.stdout:[mgr.x] 2026-02-17T21:23:18.302 INFO:teuthology.orchestra.run.trial119.stdout: key = AQD325RpR/tOGxAA48FSIYH2GQ8ulR0saaiFJQ== 2026-02-17T21:23:18.302 INFO:teuthology.orchestra.run.trial119.stdout:[osd.3] 2026-02-17T21:23:18.302 INFO:teuthology.orchestra.run.trial119.stdout: key = AQA13JRpdzGqChAAaTKvJf2q6nreTdPc3O/zMg== 2026-02-17T21:23:18.302 INFO:teuthology.orchestra.run.trial119.stdout:[osd.7] 2026-02-17T21:23:18.302 INFO:teuthology.orchestra.run.trial119.stdout: key = AQA53JRpAKQ3DBAACNLCvBslx+J3HvU2b+yqvQ== 2026-02-17T21:23:18.303 INFO:teuthology.orchestra.run.trial119.stdout:[osd.11] 2026-02-17T21:23:18.303 INFO:teuthology.orchestra.run.trial119.stdout: key = AQA93JRpU6ekDRAAmv3nweEAxGyyf0v1U/IIzQ== 2026-02-17T21:23:18.303 INFO:teuthology.orchestra.run.trial119.stdout:[osd.15] 2026-02-17T21:23:18.303 INFO:teuthology.orchestra.run.trial119.stdout: key = AQBB3JRpDIKvDxAAX/g34bqA/AXAKH+wkuYMqw== 2026-02-17T21:23:18.303 INFO:teuthology.orchestra.run.trial119.stdout:[client.0] 2026-02-17T21:23:18.303 INFO:teuthology.orchestra.run.trial119.stdout: key = AQD325Rpg7qWHRAAWB4rPWTuYphJIFS35ABIaQ== 2026-02-17T21:23:18.304 INFO:teuthology.orchestra.run.trial135.stdout:[mgr.y] 2026-02-17T21:23:18.304 INFO:teuthology.orchestra.run.trial135.stdout: key = AQD325Rp6pGOGBAADhWICMPUMeFlrhHDBjCewA== 2026-02-17T21:23:18.304 INFO:teuthology.orchestra.run.trial135.stdout:[osd.0] 2026-02-17T21:23:18.304 INFO:teuthology.orchestra.run.trial135.stdout: key = AQD625Rphd9YNBAAsw8/miEOxwJV6GYcvwu3mw== 2026-02-17T21:23:18.305 INFO:teuthology.orchestra.run.trial135.stdout:[osd.4] 2026-02-17T21:23:18.305 INFO:teuthology.orchestra.run.trial135.stdout: key = AQD+25RpDjz4NRAAA5LH0vak9nXuSWZ1KV9r5g== 2026-02-17T21:23:18.305 INFO:teuthology.orchestra.run.trial135.stdout:[osd.8] 2026-02-17T21:23:18.305 INFO:teuthology.orchestra.run.trial135.stdout: key = AQAC3JRpuR1iNxAAIVsfHTC32+hBY8wqxNVMUQ== 2026-02-17T21:23:18.305 INFO:teuthology.orchestra.run.trial135.stdout:[osd.12] 2026-02-17T21:23:18.305 INFO:teuthology.orchestra.run.trial135.stdout: key = AQAG3JRpuxjhOBAAqjNotDWJE04QwS08fkmjZg== 2026-02-17T21:23:18.305 INFO:teuthology.orchestra.run.trial135.stdout:[osd.1] 2026-02-17T21:23:18.305 INFO:teuthology.orchestra.run.trial135.stdout: key = AQAO3JRpSAS7ERAA/B5sl+c9FtuMeyuHVBAnPw== 2026-02-17T21:23:18.305 INFO:teuthology.orchestra.run.trial135.stdout:[osd.5] 2026-02-17T21:23:18.305 INFO:teuthology.orchestra.run.trial135.stdout: key = AQAS3JRpne3xEhAAPwBC3mzVYSANlpsKzKyKfA== 2026-02-17T21:23:18.305 INFO:teuthology.orchestra.run.trial135.stdout:[osd.9] 2026-02-17T21:23:18.305 INFO:teuthology.orchestra.run.trial135.stdout: key = AQAW3JRp7oCIFBAAIVhXpbJCEFVhZk0+/qh3UQ== 2026-02-17T21:23:18.306 INFO:teuthology.orchestra.run.trial135.stdout:[osd.13] 2026-02-17T21:23:18.306 INFO:teuthology.orchestra.run.trial135.stdout: key = AQAa3JRpbqbLFRAA5X/EdZ/MzhujPnEtX8xzXA== 2026-02-17T21:23:18.306 INFO:teuthology.orchestra.run.trial135.stdout:[osd.2] 2026-02-17T21:23:18.306 INFO:teuthology.orchestra.run.trial135.stdout: key = AQAh3JRpfXdSLxAAVpIDUgVPSxkj3AqLKaSfTA== 2026-02-17T21:23:18.306 INFO:teuthology.orchestra.run.trial135.stdout:[osd.6] 2026-02-17T21:23:18.306 INFO:teuthology.orchestra.run.trial135.stdout: key = AQAl3JRpUsr8MBAA/O2tLxHr+C4Im8to84bL+g== 2026-02-17T21:23:18.306 INFO:teuthology.orchestra.run.trial135.stdout:[osd.10] 2026-02-17T21:23:18.306 INFO:teuthology.orchestra.run.trial135.stdout: key = AQAp3JRpNLAxMhAA/yP1XhUDcadW7P6XMdoXFQ== 2026-02-17T21:23:18.306 INFO:teuthology.orchestra.run.trial135.stdout:[osd.14] 2026-02-17T21:23:18.306 INFO:teuthology.orchestra.run.trial135.stdout: key = AQAt3JRpVIehMxAA/MUGTsKy8Cz/T42RUflWUg== 2026-02-17T21:23:18.306 INFO:teuthology.orchestra.run.trial135.stdout:[mgr.x] 2026-02-17T21:23:18.306 INFO:teuthology.orchestra.run.trial135.stdout: key = AQD325RpR/tOGxAA48FSIYH2GQ8ulR0saaiFJQ== 2026-02-17T21:23:18.306 INFO:teuthology.orchestra.run.trial135.stdout:[osd.3] 2026-02-17T21:23:18.306 INFO:teuthology.orchestra.run.trial135.stdout: key = AQA13JRpdzGqChAAaTKvJf2q6nreTdPc3O/zMg== 2026-02-17T21:23:18.307 INFO:teuthology.orchestra.run.trial135.stdout:[osd.7] 2026-02-17T21:23:18.307 INFO:teuthology.orchestra.run.trial135.stdout: key = AQA53JRpAKQ3DBAACNLCvBslx+J3HvU2b+yqvQ== 2026-02-17T21:23:18.307 INFO:teuthology.orchestra.run.trial135.stdout:[osd.11] 2026-02-17T21:23:18.307 INFO:teuthology.orchestra.run.trial135.stdout: key = AQA93JRpU6ekDRAAmv3nweEAxGyyf0v1U/IIzQ== 2026-02-17T21:23:18.307 INFO:teuthology.orchestra.run.trial135.stdout:[osd.15] 2026-02-17T21:23:18.307 INFO:teuthology.orchestra.run.trial135.stdout: key = AQBB3JRpDIKvDxAAX/g34bqA/AXAKH+wkuYMqw== 2026-02-17T21:23:18.307 INFO:teuthology.orchestra.run.trial135.stdout:[client.0] 2026-02-17T21:23:18.307 INFO:teuthology.orchestra.run.trial135.stdout: key = AQD325Rpg7qWHRAAWB4rPWTuYphJIFS35ABIaQ== 2026-02-17T21:23:18.307 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T21:23:18.342 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T21:23:18.345 DEBUG:teuthology.orchestra.run.trial135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T21:23:18.392 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:18.424 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:18.426 DEBUG:teuthology.orchestra.run.trial135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:18.472 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:18.504 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:18.506 DEBUG:teuthology.orchestra.run.trial135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:18.553 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:18.584 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:18.586 DEBUG:teuthology.orchestra.run.trial135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:18.632 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:18.664 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:18.667 DEBUG:teuthology.orchestra.run.trial135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:18.711 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:18.741 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:18.744 DEBUG:teuthology.orchestra.run.trial135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:18.789 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:18.821 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:18.824 DEBUG:teuthology.orchestra.run.trial135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:18.870 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:18.899 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:18.902 DEBUG:teuthology.orchestra.run.trial135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:18.951 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:18.979 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:18.981 DEBUG:teuthology.orchestra.run.trial135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:19.029 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:19.058 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:19.061 DEBUG:teuthology.orchestra.run.trial135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:19.109 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:19.139 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:19.141 DEBUG:teuthology.orchestra.run.trial135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:19.188 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:19.218 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:19.221 DEBUG:teuthology.orchestra.run.trial135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:19.267 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:19.300 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:19.302 DEBUG:teuthology.orchestra.run.trial135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:19.346 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T21:23:19.380 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T21:23:19.383 DEBUG:teuthology.orchestra.run.trial135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T21:23:19.425 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:19.461 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:19.464 DEBUG:teuthology.orchestra.run.trial135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:19.504 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:19.541 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:19.544 DEBUG:teuthology.orchestra.run.trial135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:19.585 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:19.621 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:19.624 DEBUG:teuthology.orchestra.run.trial135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:19.665 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:19.700 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:19.703 DEBUG:teuthology.orchestra.run.trial135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:23:19.746 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T21:23:19.779 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T21:23:19.783 DEBUG:teuthology.orchestra.run.trial135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T21:23:19.829 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-17T21:23:19.830 DEBUG:teuthology.orchestra.run.trial005:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-17T21:23:19.880 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T21:23:19.966 DEBUG:teuthology.orchestra.run.trial005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-17T21:23:19.990 DEBUG:teuthology.orchestra.run.trial119:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-17T21:23:20.015 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T21:23:20.100 DEBUG:teuthology.orchestra.run.trial119:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-17T21:23:20.125 DEBUG:teuthology.orchestra.run.trial135:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-17T21:23:20.150 DEBUG:teuthology.orchestra.run.trial135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T21:23:20.239 DEBUG:teuthology.orchestra.run.trial135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-17T21:23:20.264 DEBUG:teuthology.orchestra.run.trial005:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:23:20.267 DEBUG:teuthology.orchestra.run.trial119:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:23:20.270 DEBUG:teuthology.orchestra.run.trial135:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:23:20.320 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-17T21:23:20.320 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-17T21:23:20.321 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T21:23:20.321 DEBUG:teuthology.orchestra.run.trial005:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2026-02-17T21:23:20.325 INFO:tasks.ceph.mon.a:Started 2026-02-17T21:23:20.325 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-17T21:23:20.326 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-17T21:23:20.326 DEBUG:teuthology.orchestra.run.trial119:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2026-02-17T21:23:20.328 INFO:tasks.ceph.mon.b:Started 2026-02-17T21:23:20.328 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-17T21:23:20.328 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T21:23:20.329 DEBUG:teuthology.orchestra.run.trial135:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2026-02-17T21:23:20.362 INFO:tasks.ceph.mon.c:Started 2026-02-17T21:23:20.363 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-17T21:23:20.363 INFO:tasks.ceph.mgr.y:Restarting daemon 2026-02-17T21:23:20.363 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2026-02-17T21:23:20.365 INFO:tasks.ceph.mgr.y:Started 2026-02-17T21:23:20.366 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-17T21:23:20.366 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2026-02-17T21:23:20.368 INFO:tasks.ceph.mgr.x:Started 2026-02-17T21:23:20.368 INFO:tasks.ceph:Setting crush tunables to default 2026-02-17T21:23:20.369 DEBUG:teuthology.orchestra.run.trial005:> sudo ceph --cluster ceph osd crush tunables default 2026-02-17T21:23:20.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.433+0000 7f0f502da640 10 monclient: get_monmap_and_config 2026-02-17T21:23:20.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.433+0000 7f0f502da640 10 monclient: build_initial_monmap 2026-02-17T21:23:20.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.433+0000 7f0f502da640 10 monclient: monmap: 2026-02-17T21:23:20.434 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:23:20.435 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:20.435 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:23:20.433906+0000 2026-02-17T21:23:20.435 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:23:20.433906+0000 2026-02-17T21:23:20.435 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:20.435 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:23:20.435 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:23:20.435 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:23:20.435 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:23:20.435 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:23:20.435 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:23:20.436 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:23:20.436 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:23:20.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.433+0000 7f0f502da640 1 Processor -- start 2026-02-17T21:23:20.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.433+0000 7f0f502da640 1 -- start start 2026-02-17T21:23:20.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.433+0000 7f0f502da640 10 monclient: init 2026-02-17T21:23:20.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.434+0000 7f0f502da640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:20.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.434+0000 7f0f502da640 10 monclient: _add_conns ranks=[5,4,3,1,2,0] 2026-02-17T21:23:20.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.434+0000 7f0f502da640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f0f480ce5d0 0x7f0f480d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:20.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.434+0000 7f0f502da640 10 monclient(hunting): picked mon.noname-c con 0x7f0f480ce5d0 addr v2:10.20.193.135:3300/0 2026-02-17T21:23:20.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.434+0000 7f0f502da640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0f4815bf30 0x7f0f480ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:20.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.434+0000 7f0f502da640 10 monclient(hunting): picked mon.noname-b con 0x7f0f4815bf30 addr v2:10.20.193.119:3300/0 2026-02-17T21:23:20.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.434+0000 7f0f502da640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f0f480ceef0 0x7f0f480c9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:20.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.434+0000 7f0f502da640 10 monclient(hunting): picked mon.noname-a con 0x7f0f480ceef0 addr v2:10.20.193.5:3300/0 2026-02-17T21:23:20.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.434+0000 7f0f502da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:20.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.434+0000 7f0f502da640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0f480d1e00 con 0x7f0f480ceef0 2026-02-17T21:23:20.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.434+0000 7f0f502da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:20.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.434+0000 7f0f502da640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f0f480d20d0 con 0x7f0f4815bf30 2026-02-17T21:23:20.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.434+0000 7f0f502da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:20.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.434+0000 7f0f502da640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0f480d23b0 con 0x7f0f480ce5d0 2026-02-17T21:23:20.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.434+0000 7f0f502da640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:20.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.434+0000 7f0f502da640 10 monclient(hunting): authenticate will time out at 905.999477s 2026-02-17T21:23:20.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.434+0000 7f0f4e850640 1 -- >> v2:10.20.193.5:3300/0 conn(0x7f0f480ceef0 msgr2=0x7f0f480c9780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.5:3300/0 2026-02-17T21:23:20.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.434+0000 7f0f4e04f640 1 -- >> v2:10.20.193.135:3300/0 conn(0x7f0f480ce5d0 msgr2=0x7f0f480d18c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.135:3300/0 2026-02-17T21:23:20.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.434+0000 7f0f4e850640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f0f480ceef0 0x7f0f480c9780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:23:20.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.434+0000 7f0f4e04f640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f0f480ce5d0 0x7f0f480d18c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:23:20.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.434+0000 7f0f4d84e640 1 -- >> v2:10.20.193.119:3300/0 conn(0x7f0f4815bf30 msgr2=0x7f0f480ce9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.119:3300/0 2026-02-17T21:23:20.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.434+0000 7f0f4d84e640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0f4815bf30 0x7f0f480ce9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:23:20.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.635+0000 7f0f4e850640 1 -- >> v2:10.20.193.5:3300/0 conn(0x7f0f480ceef0 msgr2=0x7f0f480c9780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.5:3300/0 2026-02-17T21:23:20.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.635+0000 7f0f4e850640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f0f480ceef0 0x7f0f480c9780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T21:23:20.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.635+0000 7f0f4d84e640 1 -- >> v2:10.20.193.119:3300/0 conn(0x7f0f4815bf30 msgr2=0x7f0f480ce9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.119:3300/0 2026-02-17T21:23:20.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.635+0000 7f0f4e04f640 1 -- >> v2:10.20.193.135:3300/0 conn(0x7f0f480ce5d0 msgr2=0x7f0f480d18c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.135:3300/0 2026-02-17T21:23:20.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.635+0000 7f0f4d84e640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0f4815bf30 0x7f0f480ce9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T21:23:20.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:20.635+0000 7f0f4e04f640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f0f480ce5d0 0x7f0f480d18c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T21:23:21.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:21.036+0000 7f0f4e850640 1 -- >> v2:10.20.193.5:3300/0 conn(0x7f0f480ceef0 msgr2=0x7f0f480c9780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.5:3300/0 2026-02-17T21:23:21.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:21.036+0000 7f0f4e850640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f0f480ceef0 0x7f0f480c9780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T21:23:21.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:21.036+0000 7f0f4e04f640 1 -- >> v2:10.20.193.135:3300/0 conn(0x7f0f480ce5d0 msgr2=0x7f0f480d18c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.135:3300/0 2026-02-17T21:23:21.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:21.036+0000 7f0f4d84e640 1 -- >> v2:10.20.193.119:3300/0 conn(0x7f0f4815bf30 msgr2=0x7f0f480ce9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.119:3300/0 2026-02-17T21:23:21.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:21.036+0000 7f0f4e04f640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f0f480ce5d0 0x7f0f480d18c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T21:23:21.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:21.036+0000 7f0f4d84e640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0f4815bf30 0x7f0f480ce9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T21:23:21.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:21.837+0000 7f0f4e850640 1 -- >> v2:10.20.193.5:3300/0 conn(0x7f0f480ceef0 msgr2=0x7f0f480c9780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.5:3300/0 2026-02-17T21:23:21.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:21.837+0000 7f0f4e850640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f0f480ceef0 0x7f0f480c9780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T21:23:21.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:21.837+0000 7f0f4e04f640 1 -- >> v2:10.20.193.135:3300/0 conn(0x7f0f480ce5d0 msgr2=0x7f0f480d18c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.135:3300/0 2026-02-17T21:23:21.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:21.837+0000 7f0f4e04f640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f0f480ce5d0 0x7f0f480d18c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T21:23:21.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:21.837+0000 7f0f4d84e640 1 -- >> v2:10.20.193.119:3300/0 conn(0x7f0f4815bf30 msgr2=0x7f0f480ce9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.119:3300/0 2026-02-17T21:23:21.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:21.837+0000 7f0f4d84e640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0f4815bf30 0x7f0f480ce9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T21:23:23.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:23.434+0000 7f0f2ffff640 10 monclient(hunting): tick 2026-02-17T21:23:23.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:23.434+0000 7f0f2ffff640 10 monclient(hunting): _check_auth_tickets 2026-02-17T21:23:23.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:23.434+0000 7f0f2ffff640 1 monclient(hunting): continuing hunt 2026-02-17T21:23:23.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:23.434+0000 7f0f2ffff640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T21:23:23.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:23.434+0000 7f0f2ffff640 1 -- >> v2:10.20.193.135:3300/0 conn(0x7f0f480ce5d0 msgr2=0x7f0f480d18c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:23:23.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:23.434+0000 7f0f2ffff640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f0f480ce5d0 0x7f0f480d18c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:23.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:23.434+0000 7f0f2ffff640 1 -- >> v2:10.20.193.119:3300/0 conn(0x7f0f4815bf30 msgr2=0x7f0f480ce9b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:23:23.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:23.434+0000 7f0f2ffff640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0f4815bf30 0x7f0f480ce9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:23.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:23.434+0000 7f0f2ffff640 1 -- >> v2:10.20.193.5:3300/0 conn(0x7f0f480ceef0 msgr2=0x7f0f480c9780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:23:23.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:23.434+0000 7f0f2ffff640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f0f480ceef0 0x7f0f480c9780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:23.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:23.434+0000 7f0f2ffff640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:23:23.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:23.434+0000 7f0f2ffff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0f280037b0 addr v1:10.20.193.5:6789/0 2026-02-17T21:23:23.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:23.434+0000 7f0f2ffff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0f28007430 addr v1:10.20.193.135:6789/0 2026-02-17T21:23:23.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:23.434+0000 7f0f2ffff640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f0f2800b1c0 addr v1:10.20.193.119:6789/0 2026-02-17T21:23:23.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:23.434+0000 7f0f2ffff640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f480d2690 con 0x7f0f280037b0 2026-02-17T21:23:23.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:23.434+0000 7f0f2ffff640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f2800ffd0 con 0x7f0f2800b1c0 2026-02-17T21:23:23.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:23.434+0000 7f0f4e04f640 1 -- >> v1:10.20.193.5:6789/0 conn(0x7f0f280037b0 legacy=0x7f0f28005c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.5:6789/0 2026-02-17T21:23:23.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:23.434+0000 7f0f2ffff640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f28011220 con 0x7f0f28007430 2026-02-17T21:23:23.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:23.434+0000 7f0f2ffff640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:23.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:23.434+0000 7f0f4d84e640 1 -- >> v1:10.20.193.135:6789/0 conn(0x7f0f28007430 legacy=0x7f0f280098f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.135:6789/0 2026-02-17T21:23:23.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:23.434+0000 7f0f4e850640 1 -- >> v1:10.20.193.119:6789/0 conn(0x7f0f2800b1c0 legacy=0x7f0f2800d680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-17T21:23:23.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:23.635+0000 7f0f4e04f640 1 -- >> v1:10.20.193.5:6789/0 conn(0x7f0f280037b0 legacy=0x7f0f28005c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.5:6789/0 2026-02-17T21:23:23.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:23.635+0000 7f0f4e850640 1 -- >> v1:10.20.193.119:6789/0 conn(0x7f0f2800b1c0 legacy=0x7f0f2800d680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-17T21:23:23.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:23.635+0000 7f0f4d84e640 1 -- >> v1:10.20.193.135:6789/0 conn(0x7f0f28007430 legacy=0x7f0f280098f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.135:6789/0 2026-02-17T21:23:24.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:24.036+0000 7f0f4e04f640 1 -- >> v1:10.20.193.5:6789/0 conn(0x7f0f280037b0 legacy=0x7f0f28005c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.5:6789/0 2026-02-17T21:23:24.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:24.036+0000 7f0f4e850640 1 -- >> v1:10.20.193.119:6789/0 conn(0x7f0f2800b1c0 legacy=0x7f0f2800d680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-17T21:23:24.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:24.036+0000 7f0f4d84e640 1 -- >> v1:10.20.193.135:6789/0 conn(0x7f0f28007430 legacy=0x7f0f280098f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.135:6789/0 2026-02-17T21:23:24.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:24.837+0000 7f0f4e04f640 1 -- >> v1:10.20.193.5:6789/0 conn(0x7f0f280037b0 legacy=0x7f0f28005c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.5:6789/0 2026-02-17T21:23:24.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:24.837+0000 7f0f4d84e640 1 -- >> v1:10.20.193.135:6789/0 conn(0x7f0f28007430 legacy=0x7f0f280098f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.135:6789/0 2026-02-17T21:23:24.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:24.837+0000 7f0f4e850640 1 -- >> v1:10.20.193.119:6789/0 conn(0x7f0f2800b1c0 legacy=0x7f0f2800d680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-17T21:23:26.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f2ffff640 10 monclient(hunting): tick 2026-02-17T21:23:26.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f2ffff640 10 monclient(hunting): _check_auth_tickets 2026-02-17T21:23:26.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f2ffff640 1 monclient(hunting): continuing hunt 2026-02-17T21:23:26.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f2ffff640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T21:23:26.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f2ffff640 1 -- >> v1:10.20.193.135:6789/0 conn(0x7f0f28007430 legacy=0x7f0f280098f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:23:26.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f2ffff640 1 -- >> v1:10.20.193.119:6789/0 conn(0x7f0f2800b1c0 legacy=0x7f0f2800d680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:23:26.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f2ffff640 1 -- >> v1:10.20.193.5:6789/0 conn(0x7f0f280037b0 legacy=0x7f0f28005c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:23:26.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f4e850640 1 -- reap_dead start 2026-02-17T21:23:26.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f4e850640 1 -- reap_dead start 2026-02-17T21:23:26.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f2ffff640 10 monclient: _add_conns ranks=[3,5,1,0,2,4] 2026-02-17T21:23:26.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f2ffff640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f0f28011420 0x7f0f280098f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:26.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f2ffff640 10 monclient(hunting): picked mon.noname-a con 0x7f0f28011420 addr v2:10.20.193.5:3300/0 2026-02-17T21:23:26.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f2ffff640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f0f28011800 0x7f0f28005ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:26.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f2ffff640 10 monclient(hunting): picked mon.noname-c con 0x7f0f28011800 addr v2:10.20.193.135:3300/0 2026-02-17T21:23:26.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f2ffff640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f0f28011c20 addr v1:10.20.193.119:6789/0 2026-02-17T21:23:26.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f2ffff640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f280124c0 con 0x7f0f28011c20 2026-02-17T21:23:26.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f2ffff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:26.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f2ffff640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0f480d1e00 con 0x7f0f28011420 2026-02-17T21:23:26.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f2ffff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:26.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f2ffff640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0f480d20d0 con 0x7f0f28011800 2026-02-17T21:23:26.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f2ffff640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:26.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f4e04f640 1 -- >> v2:10.20.193.5:3300/0 conn(0x7f0f28011420 msgr2=0x7f0f280098f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.5:3300/0 2026-02-17T21:23:26.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f4e04f640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f0f28011420 0x7f0f280098f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:23:26.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f4d84e640 1 -- >> v2:10.20.193.135:3300/0 conn(0x7f0f28011800 msgr2=0x7f0f28005ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.135:3300/0 2026-02-17T21:23:26.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f4d84e640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f0f28011800 0x7f0f28005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:23:26.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.434+0000 7f0f4e850640 1 -- >> v1:10.20.193.119:6789/0 conn(0x7f0f28011c20 legacy=0x7f0f2800d5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-17T21:23:26.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.635+0000 7f0f4e04f640 1 -- >> v2:10.20.193.5:3300/0 conn(0x7f0f28011420 msgr2=0x7f0f280098f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.5:3300/0 2026-02-17T21:23:26.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.635+0000 7f0f4e04f640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f0f28011420 0x7f0f280098f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T21:23:26.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.635+0000 7f0f4d84e640 1 -- >> v2:10.20.193.135:3300/0 conn(0x7f0f28011800 msgr2=0x7f0f28005ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.135:3300/0 2026-02-17T21:23:26.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.635+0000 7f0f4e850640 1 -- >> v1:10.20.193.119:6789/0 conn(0x7f0f28011c20 legacy=0x7f0f2800d5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-17T21:23:26.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:26.635+0000 7f0f4d84e640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f0f28011800 0x7f0f28005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T21:23:27.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:27.036+0000 7f0f4e04f640 1 -- >> v2:10.20.193.5:3300/0 conn(0x7f0f28011420 msgr2=0x7f0f280098f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.5:3300/0 2026-02-17T21:23:27.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:27.036+0000 7f0f4e04f640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f0f28011420 0x7f0f280098f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T21:23:27.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:27.036+0000 7f0f4d84e640 1 -- >> v2:10.20.193.135:3300/0 conn(0x7f0f28011800 msgr2=0x7f0f28005ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.135:3300/0 2026-02-17T21:23:27.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:27.036+0000 7f0f4d84e640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f0f28011800 0x7f0f28005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T21:23:27.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:27.036+0000 7f0f4e850640 1 -- >> v1:10.20.193.119:6789/0 conn(0x7f0f28011c20 legacy=0x7f0f2800d5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-17T21:23:27.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:27.837+0000 7f0f4e04f640 1 -- >> v2:10.20.193.5:3300/0 conn(0x7f0f28011420 msgr2=0x7f0f280098f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.5:3300/0 2026-02-17T21:23:27.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:27.837+0000 7f0f4e04f640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f0f28011420 0x7f0f280098f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T21:23:27.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:27.837+0000 7f0f4d84e640 1 -- >> v2:10.20.193.135:3300/0 conn(0x7f0f28011800 msgr2=0x7f0f28005ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.135:3300/0 2026-02-17T21:23:27.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:27.837+0000 7f0f4e850640 1 -- >> v1:10.20.193.119:6789/0 conn(0x7f0f28011c20 legacy=0x7f0f2800d5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-17T21:23:27.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:27.837+0000 7f0f4d84e640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f0f28011800 0x7f0f28005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T21:23:29.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.434+0000 7f0f2ffff640 10 monclient(hunting): tick 2026-02-17T21:23:29.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.434+0000 7f0f2ffff640 10 monclient(hunting): _check_auth_tickets 2026-02-17T21:23:29.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.434+0000 7f0f2ffff640 1 monclient(hunting): continuing hunt 2026-02-17T21:23:29.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.434+0000 7f0f2ffff640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T21:23:29.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.434+0000 7f0f2ffff640 1 -- >> v2:10.20.193.135:3300/0 conn(0x7f0f28011800 msgr2=0x7f0f28005ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:23:29.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.434+0000 7f0f2ffff640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f0f28011800 0x7f0f28005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:29.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.434+0000 7f0f2ffff640 1 -- >> v2:10.20.193.5:3300/0 conn(0x7f0f28011420 msgr2=0x7f0f280098f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:23:29.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.434+0000 7f0f2ffff640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f0f28011420 0x7f0f280098f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:29.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.434+0000 7f0f2ffff640 1 -- >> v1:10.20.193.119:6789/0 conn(0x7f0f28011c20 legacy=0x7f0f2800d5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:23:29.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.434+0000 7f0f2ffff640 10 monclient: _add_conns ranks=[2,0,4] 2026-02-17T21:23:29.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.434+0000 7f0f2ffff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0f2800efc0 addr v1:10.20.193.135:6789/0 2026-02-17T21:23:29.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.434+0000 7f0f2ffff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0f2800fab0 addr v1:10.20.193.5:6789/0 2026-02-17T21:23:29.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.434+0000 7f0f2ffff640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0f2800a7d0 0x7f0f28018820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:29.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.434+0000 7f0f2ffff640 10 monclient(hunting): picked mon.noname-b con 0x7f0f2800a7d0 addr v2:10.20.193.119:3300/0 2026-02-17T21:23:29.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.434+0000 7f0f2ffff640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f480d2690 con 0x7f0f2800fab0 2026-02-17T21:23:29.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.434+0000 7f0f2ffff640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f280124c0 con 0x7f0f2800efc0 2026-02-17T21:23:29.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.434+0000 7f0f2ffff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:29.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.434+0000 7f0f2ffff640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f0f480d1e00 con 0x7f0f2800a7d0 2026-02-17T21:23:29.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.434+0000 7f0f2ffff640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:29.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.434+0000 7f0f4d84e640 1 -- >> v1:10.20.193.5:6789/0 conn(0x7f0f2800fab0 legacy=0x7f0f2800a0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.5:6789/0 2026-02-17T21:23:29.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.434+0000 7f0f4e04f640 1 -- >> v1:10.20.193.135:6789/0 conn(0x7f0f2800efc0 legacy=0x7f0f2800f3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.135:6789/0 2026-02-17T21:23:29.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.434+0000 7f0f4e850640 1 -- >> v2:10.20.193.119:3300/0 conn(0x7f0f2800a7d0 msgr2=0x7f0f28018820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.119:3300/0 2026-02-17T21:23:29.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.434+0000 7f0f4e850640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0f2800a7d0 0x7f0f28018820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:23:29.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.635+0000 7f0f4d84e640 1 -- >> v1:10.20.193.5:6789/0 conn(0x7f0f2800fab0 legacy=0x7f0f2800a0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.5:6789/0 2026-02-17T21:23:29.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.635+0000 7f0f4e04f640 1 -- >> v1:10.20.193.135:6789/0 conn(0x7f0f2800efc0 legacy=0x7f0f2800f3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.135:6789/0 2026-02-17T21:23:29.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.635+0000 7f0f4e850640 1 -- >> v2:10.20.193.119:3300/0 conn(0x7f0f2800a7d0 msgr2=0x7f0f28018820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.119:3300/0 2026-02-17T21:23:29.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:29.635+0000 7f0f4e850640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0f2800a7d0 0x7f0f28018820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T21:23:30.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:30.036+0000 7f0f4d84e640 1 -- >> v1:10.20.193.5:6789/0 conn(0x7f0f2800fab0 legacy=0x7f0f2800a0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.5:6789/0 2026-02-17T21:23:30.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:30.036+0000 7f0f4e850640 1 -- >> v2:10.20.193.119:3300/0 conn(0x7f0f2800a7d0 msgr2=0x7f0f28018820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.119:3300/0 2026-02-17T21:23:30.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:30.036+0000 7f0f4e04f640 1 -- >> v1:10.20.193.135:6789/0 conn(0x7f0f2800efc0 legacy=0x7f0f2800f3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.135:6789/0 2026-02-17T21:23:30.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:30.036+0000 7f0f4e850640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0f2800a7d0 0x7f0f28018820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T21:23:30.763 INFO:tasks.ceph.mon.a.trial005.stderr:--00:00:00:10.389 26616-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/8e/304f65e79c5537b8c7950a0e2b40c29362732c.debug 2026-02-17T21:23:30.806 INFO:tasks.ceph.mon.b.trial119.stderr:--00:00:00:10.430 26273-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/8e/304f65e79c5537b8c7950a0e2b40c29362732c.debug 2026-02-17T21:23:30.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:30.837+0000 7f0f4d84e640 1 -- >> v1:10.20.193.5:6789/0 conn(0x7f0f2800fab0 legacy=0x7f0f2800a0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.5:6789/0 2026-02-17T21:23:30.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:30.837+0000 7f0f4e850640 1 -- >> v2:10.20.193.119:3300/0 conn(0x7f0f2800a7d0 msgr2=0x7f0f28018820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.119:3300/0 2026-02-17T21:23:30.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:30.837+0000 7f0f4e04f640 1 -- >> v1:10.20.193.135:6789/0 conn(0x7f0f2800efc0 legacy=0x7f0f2800f3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.135:6789/0 2026-02-17T21:23:30.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:30.837+0000 7f0f4e850640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0f2800a7d0 0x7f0f28018820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T21:23:30.959 INFO:tasks.ceph.mon.c.trial135.stderr:--00:00:00:10.545 26523-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/8e/304f65e79c5537b8c7950a0e2b40c29362732c.debug 2026-02-17T21:23:32.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:32.434+0000 7f0f2ffff640 10 monclient(hunting): tick 2026-02-17T21:23:32.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:32.434+0000 7f0f2ffff640 10 monclient(hunting): _check_auth_tickets 2026-02-17T21:23:32.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:32.434+0000 7f0f2ffff640 1 monclient(hunting): continuing hunt 2026-02-17T21:23:32.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:32.434+0000 7f0f2ffff640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T21:23:32.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:32.434+0000 7f0f2ffff640 1 -- >> v2:10.20.193.119:3300/0 conn(0x7f0f2800a7d0 msgr2=0x7f0f28018820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:23:32.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:32.434+0000 7f0f2ffff640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0f2800a7d0 0x7f0f28018820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:32.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:32.434+0000 7f0f2ffff640 1 -- >> v1:10.20.193.135:6789/0 conn(0x7f0f2800efc0 legacy=0x7f0f2800f3a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:23:32.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:32.434+0000 7f0f2ffff640 1 -- >> v1:10.20.193.5:6789/0 conn(0x7f0f2800fab0 legacy=0x7f0f2800a0c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:23:32.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:32.434+0000 7f0f4e850640 1 -- reap_dead start 2026-02-17T21:23:32.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:32.434+0000 7f0f2ffff640 10 monclient: _add_conns ranks=[1,2,0,4,5,3] 2026-02-17T21:23:32.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:32.434+0000 7f0f2ffff640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f0f28011420 addr v1:10.20.193.119:6789/0 2026-02-17T21:23:32.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:32.434+0000 7f0f2ffff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0f2800ad40 addr v1:10.20.193.135:6789/0 2026-02-17T21:23:32.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:32.434+0000 7f0f2ffff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0f2800a7d0 addr v1:10.20.193.5:6789/0 2026-02-17T21:23:32.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:32.434+0000 7f0f2ffff640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f2800ffd0 con 0x7f0f2800a7d0 2026-02-17T21:23:32.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:32.434+0000 7f0f2ffff640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f480d2690 con 0x7f0f28011420 2026-02-17T21:23:32.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:32.434+0000 7f0f2ffff640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f280124c0 con 0x7f0f2800ad40 2026-02-17T21:23:32.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:32.434+0000 7f0f2ffff640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:32.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:32.434+0000 7f0f4e850640 1 -- >> v1:10.20.193.5:6789/0 conn(0x7f0f2800a7d0 legacy=0x7f0f2800d5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.5:6789/0 2026-02-17T21:23:32.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:32.434+0000 7f0f4e04f640 1 -- >> v1:10.20.193.119:6789/0 conn(0x7f0f28011420 legacy=0x7f0f2800a0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-17T21:23:32.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:32.434+0000 7f0f4d84e640 1 -- >> v1:10.20.193.135:6789/0 conn(0x7f0f2800ad40 legacy=0x7f0f2800de50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.135:6789/0 2026-02-17T21:23:32.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:32.635+0000 7f0f4e850640 1 -- >> v1:10.20.193.5:6789/0 conn(0x7f0f2800a7d0 legacy=0x7f0f2800d5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.5:6789/0 2026-02-17T21:23:32.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:32.635+0000 7f0f4e04f640 1 -- >> v1:10.20.193.119:6789/0 conn(0x7f0f28011420 legacy=0x7f0f2800a0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-17T21:23:32.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:32.636+0000 7f0f4d84e640 1 -- >> v1:10.20.193.135:6789/0 conn(0x7f0f2800ad40 legacy=0x7f0f2800de50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.135:6789/0 2026-02-17T21:23:33.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:33.036+0000 7f0f4e850640 1 -- >> v1:10.20.193.5:6789/0 conn(0x7f0f2800a7d0 legacy=0x7f0f2800d5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.5:6789/0 2026-02-17T21:23:33.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:33.036+0000 7f0f4e04f640 1 -- >> v1:10.20.193.119:6789/0 conn(0x7f0f28011420 legacy=0x7f0f2800a0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-17T21:23:33.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:33.037+0000 7f0f4d84e640 1 -- >> v1:10.20.193.135:6789/0 conn(0x7f0f2800ad40 legacy=0x7f0f2800de50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.135:6789/0 2026-02-17T21:23:33.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:33.837+0000 7f0f4e850640 1 -- >> v1:10.20.193.5:6789/0 conn(0x7f0f2800a7d0 legacy=0x7f0f2800d5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.5:6789/0 2026-02-17T21:23:33.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:33.837+0000 7f0f4e04f640 1 -- >> v1:10.20.193.119:6789/0 conn(0x7f0f28011420 legacy=0x7f0f2800a0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-17T21:23:33.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:33.838+0000 7f0f4d84e640 1 -- >> v1:10.20.193.135:6789/0 conn(0x7f0f2800ad40 legacy=0x7f0f2800de50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.135:6789/0 2026-02-17T21:23:35.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.434+0000 7f0f2ffff640 10 monclient(hunting): tick 2026-02-17T21:23:35.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.434+0000 7f0f2ffff640 10 monclient(hunting): _check_auth_tickets 2026-02-17T21:23:35.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.434+0000 7f0f2ffff640 1 monclient(hunting): continuing hunt 2026-02-17T21:23:35.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.434+0000 7f0f2ffff640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T21:23:35.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.434+0000 7f0f2ffff640 1 -- >> v1:10.20.193.135:6789/0 conn(0x7f0f2800ad40 legacy=0x7f0f2800de50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:23:35.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.434+0000 7f0f2ffff640 1 -- >> v1:10.20.193.119:6789/0 conn(0x7f0f28011420 legacy=0x7f0f2800a0c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:23:35.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.434+0000 7f0f2ffff640 1 -- >> v1:10.20.193.5:6789/0 conn(0x7f0f2800a7d0 legacy=0x7f0f2800d5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:23:35.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.435+0000 7f0f2ffff640 10 monclient: _add_conns ranks=[4,3,5] 2026-02-17T21:23:35.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.435+0000 7f0f2ffff640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0f28005ba0 0x7f0f280098f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:35.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.435+0000 7f0f2ffff640 10 monclient(hunting): picked mon.noname-b con 0x7f0f28005ba0 addr v2:10.20.193.119:3300/0 2026-02-17T21:23:35.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.435+0000 7f0f2ffff640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f0f2800e560 0x7f0f280167d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:35.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.435+0000 7f0f2ffff640 10 monclient(hunting): picked mon.noname-a con 0x7f0f2800e560 addr v2:10.20.193.5:3300/0 2026-02-17T21:23:35.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.435+0000 7f0f2ffff640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f0f2800e970 0x7f0f28018d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:35.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.435+0000 7f0f2ffff640 10 monclient(hunting): picked mon.noname-c con 0x7f0f2800e970 addr v2:10.20.193.135:3300/0 2026-02-17T21:23:35.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.435+0000 7f0f2ffff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:35.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.435+0000 7f0f2ffff640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0f480d1e00 con 0x7f0f2800e560 2026-02-17T21:23:35.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.435+0000 7f0f2ffff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:35.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.435+0000 7f0f2ffff640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f0f480d20d0 con 0x7f0f28005ba0 2026-02-17T21:23:35.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.435+0000 7f0f2ffff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:35.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.435+0000 7f0f2ffff640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0f480d23b0 con 0x7f0f2800e970 2026-02-17T21:23:35.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.435+0000 7f0f2ffff640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:35.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.435+0000 7f0f4d84e640 1 -- >> v2:10.20.193.5:3300/0 conn(0x7f0f2800e560 msgr2=0x7f0f280167d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.5:3300/0 2026-02-17T21:23:35.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.435+0000 7f0f4d84e640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f0f2800e560 0x7f0f280167d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:23:35.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.435+0000 7f0f4e04f640 1 -- >> v2:10.20.193.119:3300/0 conn(0x7f0f28005ba0 msgr2=0x7f0f280098f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.119:3300/0 2026-02-17T21:23:35.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.435+0000 7f0f4e850640 1 -- >> v2:10.20.193.135:3300/0 conn(0x7f0f2800e970 msgr2=0x7f0f28018d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.135:3300/0 2026-02-17T21:23:35.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.435+0000 7f0f4e04f640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0f28005ba0 0x7f0f280098f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:23:35.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.435+0000 7f0f4e850640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f0f2800e970 0x7f0f28018d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:23:35.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.636+0000 7f0f4d84e640 1 -- >> v2:10.20.193.5:3300/0 conn(0x7f0f2800e560 msgr2=0x7f0f280167d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.5:3300/0 2026-02-17T21:23:35.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.636+0000 7f0f4d84e640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f0f2800e560 0x7f0f280167d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T21:23:35.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.636+0000 7f0f4e850640 1 -- >> v2:10.20.193.135:3300/0 conn(0x7f0f2800e970 msgr2=0x7f0f28018d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.135:3300/0 2026-02-17T21:23:35.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.636+0000 7f0f4e04f640 1 -- >> v2:10.20.193.119:3300/0 conn(0x7f0f28005ba0 msgr2=0x7f0f280098f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.119:3300/0 2026-02-17T21:23:35.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.636+0000 7f0f4e04f640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0f28005ba0 0x7f0f280098f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T21:23:35.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:35.636+0000 7f0f4e850640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f0f2800e970 0x7f0f28018d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T21:23:36.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:36.037+0000 7f0f4d84e640 1 -- >> v2:10.20.193.5:3300/0 conn(0x7f0f2800e560 msgr2=0x7f0f280167d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.5:3300/0 2026-02-17T21:23:36.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:36.037+0000 7f0f4d84e640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f0f2800e560 0x7f0f280167d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T21:23:36.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:36.037+0000 7f0f4e04f640 1 -- >> v2:10.20.193.119:3300/0 conn(0x7f0f28005ba0 msgr2=0x7f0f280098f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.119:3300/0 2026-02-17T21:23:36.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:36.037+0000 7f0f4e850640 1 -- >> v2:10.20.193.135:3300/0 conn(0x7f0f2800e970 msgr2=0x7f0f28018d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.135:3300/0 2026-02-17T21:23:36.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:36.037+0000 7f0f4e04f640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0f28005ba0 0x7f0f280098f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T21:23:36.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:36.037+0000 7f0f4e850640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f0f2800e970 0x7f0f28018d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T21:23:36.312 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:00:15.938 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:23:36.407 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:00:16.031 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:23:36.462 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:00:16.088 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:23:36.559 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:00:16.183 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:23:36.601 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:00:16.187 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:23:36.752 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:00:16.338 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:23:36.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:36.838+0000 7f0f4d84e640 1 -- >> v2:10.20.193.5:3300/0 conn(0x7f0f2800e560 msgr2=0x7f0f280167d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.5:3300/0 2026-02-17T21:23:36.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:36.838+0000 7f0f4d84e640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f0f2800e560 0x7f0f280167d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T21:23:36.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:36.838+0000 7f0f4e850640 1 -- >> v2:10.20.193.135:3300/0 conn(0x7f0f2800e970 msgr2=0x7f0f28018d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.135:3300/0 2026-02-17T21:23:36.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:36.838+0000 7f0f4e04f640 1 -- >> v2:10.20.193.119:3300/0 conn(0x7f0f28005ba0 msgr2=0x7f0f280098f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.119:3300/0 2026-02-17T21:23:36.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:36.838+0000 7f0f4e850640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f0f2800e970 0x7f0f28018d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T21:23:36.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:36.838+0000 7f0f4e04f640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0f28005ba0 0x7f0f280098f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T21:23:38.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.435+0000 7f0f2ffff640 10 monclient(hunting): tick 2026-02-17T21:23:38.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.435+0000 7f0f2ffff640 10 monclient(hunting): _check_auth_tickets 2026-02-17T21:23:38.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.435+0000 7f0f2ffff640 1 monclient(hunting): continuing hunt 2026-02-17T21:23:38.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.435+0000 7f0f2ffff640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T21:23:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.435+0000 7f0f2ffff640 1 -- >> v2:10.20.193.135:3300/0 conn(0x7f0f2800e970 msgr2=0x7f0f28018d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:23:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.435+0000 7f0f2ffff640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f0f2800e970 0x7f0f28018d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.435+0000 7f0f2ffff640 1 -- >> v2:10.20.193.119:3300/0 conn(0x7f0f28005ba0 msgr2=0x7f0f280098f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:23:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.435+0000 7f0f2ffff640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0f28005ba0 0x7f0f280098f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.435+0000 7f0f2ffff640 1 -- >> v2:10.20.193.5:3300/0 conn(0x7f0f2800e560 msgr2=0x7f0f280167d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:23:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.435+0000 7f0f2ffff640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f0f2800e560 0x7f0f280167d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.435+0000 7f0f4e850640 1 -- reap_dead start 2026-02-17T21:23:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.435+0000 7f0f2ffff640 10 monclient: _add_conns ranks=[4,1,3,5,2,0] 2026-02-17T21:23:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.435+0000 7f0f2ffff640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0f2800e970 0x7f0f2800de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.435+0000 7f0f2ffff640 10 monclient(hunting): picked mon.noname-b con 0x7f0f2800e970 addr v2:10.20.193.119:3300/0 2026-02-17T21:23:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.435+0000 7f0f2ffff640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f0f28011420 addr v1:10.20.193.119:6789/0 2026-02-17T21:23:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.435+0000 7f0f2ffff640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f0f2800e560 0x7f0f280098f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.435+0000 7f0f2ffff640 10 monclient(hunting): picked mon.noname-a con 0x7f0f2800e560 addr v2:10.20.193.5:3300/0 2026-02-17T21:23:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.435+0000 7f0f2ffff640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f28011220 con 0x7f0f28011420 2026-02-17T21:23:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.435+0000 7f0f2ffff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.435+0000 7f0f2ffff640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0f480d1e00 con 0x7f0f2800e560 2026-02-17T21:23:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.435+0000 7f0f2ffff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.435+0000 7f0f2ffff640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f0f480d20d0 con 0x7f0f2800e970 2026-02-17T21:23:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.435+0000 7f0f2ffff640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:38.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.441+0000 7f0f4e04f640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0f2800e970 0x7f0f2800de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:38.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.441+0000 7f0f4d84e640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f0f28011420 0x7f0f2800a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:46738/0 (socket says 10.20.193.5:46738) 2026-02-17T21:23:38.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.441+0000 7f0f4d84e640 1 -- 10.20.193.5:0/3962184886 learned_addr learned my addr 10.20.193.5:0/3962184886 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:23:38.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.442+0000 7f0f4e04f640 10 monclient(hunting): get_auth_request con 0x7f0f2800e970 auth_method 0 2026-02-17T21:23:38.444 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.442+0000 7f0f4e04f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:38.444 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.442+0000 7f0f4e04f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:38.444 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.442+0000 7f0f4e04f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:38.444 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.442+0000 7f0f4e04f640 1 -- 10.20.193.5:0/3962184886 >> v2:10.20.193.119:3300/0 conn(0x7f0f2800e970 msgr2=0x7f0f2800de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T21:23:38.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.442+0000 7f0f4e04f640 1 -- 10.20.193.5:0/3962184886 >> v2:10.20.193.119:3300/0 conn(0x7f0f2800e970 msgr2=0x7f0f2800de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T21:23:38.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.442+0000 7f0f4e04f640 1 --2- 10.20.193.5:0/3962184886 >> v2:10.20.193.119:3300/0 conn(0x7f0f2800e970 0x7f0f2800de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:23:38.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.442+0000 7f0f4e04f640 1 --2- 10.20.193.5:0/3962184886 >> v2:10.20.193.119:3300/0 conn(0x7f0f2800e970 0x7f0f2800de30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:23:38.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.469+0000 7f0f4e850640 1 --2- 10.20.193.5:0/3962184886 >> v2:10.20.193.5:3300/0 conn(0x7f0f2800e560 0x7f0f280098f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:38.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.469+0000 7f0f4e850640 10 monclient(hunting): get_auth_request con 0x7f0f2800e560 auth_method 0 2026-02-17T21:23:38.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.469+0000 7f0f4e850640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:38.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.469+0000 7f0f4e850640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:38.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.469+0000 7f0f4e850640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:38.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.482+0000 7f0f4e850640 1 -- 10.20.193.5:0/3962184886 >> v2:10.20.193.5:3300/0 conn(0x7f0f2800e560 msgr2=0x7f0f280098f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T21:23:38.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.482+0000 7f0f4e850640 1 -- 10.20.193.5:0/3962184886 >> v2:10.20.193.5:3300/0 conn(0x7f0f2800e560 msgr2=0x7f0f280098f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T21:23:38.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.482+0000 7f0f4e850640 1 --2- 10.20.193.5:0/3962184886 >> v2:10.20.193.5:3300/0 conn(0x7f0f2800e560 0x7f0f280098f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:23:38.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.482+0000 7f0f4e850640 1 --2- 10.20.193.5:0/3962184886 >> v2:10.20.193.5:3300/0 conn(0x7f0f2800e560 0x7f0f280098f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:23:38.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.643+0000 7f0f4e04f640 1 --2- 10.20.193.5:0/3962184886 >> v2:10.20.193.119:3300/0 conn(0x7f0f2800e970 0x7f0f2800de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:38.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.643+0000 7f0f4e04f640 10 monclient(hunting): get_auth_request con 0x7f0f2800e970 auth_method 0 2026-02-17T21:23:38.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.643+0000 7f0f4e04f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:38.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.643+0000 7f0f4e04f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:38.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.643+0000 7f0f4e04f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:23:38.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.644+0000 7f0f4e04f640 1 -- 10.20.193.5:0/3962184886 >> v2:10.20.193.119:3300/0 conn(0x7f0f2800e970 msgr2=0x7f0f2800de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T21:23:38.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.644+0000 7f0f4e04f640 1 -- 10.20.193.5:0/3962184886 >> v2:10.20.193.119:3300/0 conn(0x7f0f2800e970 msgr2=0x7f0f2800de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T21:23:38.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.644+0000 7f0f4e04f640 1 --2- 10.20.193.5:0/3962184886 >> v2:10.20.193.119:3300/0 conn(0x7f0f2800e970 0x7f0f2800de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:23:38.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.644+0000 7f0f4e04f640 1 --2- 10.20.193.5:0/3962184886 >> v2:10.20.193.119:3300/0 conn(0x7f0f2800e970 0x7f0f2800de30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T21:23:38.703 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.702+0000 7f0f4e850640 1 --2- 10.20.193.5:0/3962184886 >> v2:10.20.193.5:3300/0 conn(0x7f0f2800e560 0x7f0f280098f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:38.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.705+0000 7f0f4e850640 10 monclient(hunting): get_auth_request con 0x7f0f2800e560 auth_method 0 2026-02-17T21:23:38.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.705+0000 7f0f4e850640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:38.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.705+0000 7f0f4e850640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:38.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.705+0000 7f0f4e850640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:23:38.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.715+0000 7f0f4e850640 1 -- 10.20.193.5:0/3962184886 >> v2:10.20.193.5:3300/0 conn(0x7f0f2800e560 msgr2=0x7f0f280098f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T21:23:38.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.715+0000 7f0f4e850640 1 -- 10.20.193.5:0/3962184886 >> v2:10.20.193.5:3300/0 conn(0x7f0f2800e560 msgr2=0x7f0f280098f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T21:23:38.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.715+0000 7f0f4e850640 1 --2- 10.20.193.5:0/3962184886 >> v2:10.20.193.5:3300/0 conn(0x7f0f2800e560 0x7f0f280098f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:23:38.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:38.715+0000 7f0f4e850640 1 --2- 10.20.193.5:0/3962184886 >> v2:10.20.193.5:3300/0 conn(0x7f0f2800e560 0x7f0f280098f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T21:23:39.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.011+0000 7f0f4d04d640 1 -- 10.20.193.5:0/3962184886 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 589719896 0 0) 0x7f0f28011220 con 0x7f0f28011420 2026-02-17T21:23:39.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.011+0000 7f0f4d04d640 10 monclient(hunting): _negotiate 2026-02-17T21:23:39.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.011+0000 7f0f4d04d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:39.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.011+0000 7f0f4d04d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:39.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.011+0000 7f0f4d04d640 10 monclient(hunting): my global_id is 4102 2026-02-17T21:23:39.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.011+0000 7f0f4d04d640 1 -- 10.20.193.5:0/3962184886 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f30003620 con 0x7f0f28011420 2026-02-17T21:23:39.055 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.054+0000 7f0f4e04f640 1 --2- 10.20.193.5:0/3962184886 >> v2:10.20.193.119:3300/0 conn(0x7f0f2800e970 0x7f0f2800de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:39.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.061+0000 7f0f4e04f640 10 monclient(hunting): get_auth_request con 0x7f0f2800e970 auth_method 0 2026-02-17T21:23:39.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.061+0000 7f0f4e04f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:39.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.061+0000 7f0f4e04f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:39.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.061+0000 7f0f4e04f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:23:39.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.070+0000 7f0f4e04f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:39.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.070+0000 7f0f4e04f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:39.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.070+0000 7f0f4e04f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:39.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.075+0000 7f0f4e04f640 10 monclient(hunting): handle_auth_done global_id 4108 payload 274 2026-02-17T21:23:39.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.075+0000 7f0f4e04f640 1 -- 10.20.193.5:0/3962184886 >> v2:10.20.193.5:3300/0 conn(0x7f0f2800e560 msgr2=0x7f0f280098f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:23:39.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.075+0000 7f0f4e04f640 1 --2- 10.20.193.5:0/3962184886 >> v2:10.20.193.5:3300/0 conn(0x7f0f2800e560 0x7f0f280098f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:39.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.075+0000 7f0f4e04f640 1 -- 10.20.193.5:0/3962184886 >> v1:10.20.193.119:6789/0 conn(0x7f0f28011420 legacy=0x7f0f2800a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:39.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.075+0000 7f0f4e04f640 10 monclient: _finish_hunting 0 2026-02-17T21:23:39.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.075+0000 7f0f4e04f640 1 monclient: found mon.noname-b 2026-02-17T21:23:39.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.075+0000 7f0f4e04f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:39.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.075+0000 7f0f4e04f640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:23:39.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.075+0000 7f0f4e04f640 1 -- 10.20.193.5:0/3962184886 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f2800ffd0 con 0x7f0f2800e970 2026-02-17T21:23:39.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.090+0000 7f0f4e04f640 1 --2- 10.20.193.5:0/3962184886 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0f2800e970 0x7f0f2800de30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0f280060b0 tx=0x7f0f3802fee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7abacbf5105f19f4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:39.120 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f4d04d640 1 -- 10.20.193.5:0/3962184886 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f38036070 con 0x7f0f2800e970 2026-02-17T21:23:39.120 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f4d04d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:39.120 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f4d04d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:23:39.120 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f4d04d640 10 monclient: dump: 2026-02-17T21:23:39.120 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:23:39.121 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:39.121 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:39.121 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:39.121 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:39.121 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:23:39.121 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:39.121 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:39.121 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:39.121 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:23:39.121 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f4d04d640 10 monclient: _finish_auth 0 2026-02-17T21:23:39.121 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f4d04d640 10 monclient: _check_auth_tickets 2026-02-17T21:23:39.121 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f4d04d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:39.122 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f4d04d640 1 -- 10.20.193.5:0/3962184886 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f38030bb0 con 0x7f0f2800e970 2026-02-17T21:23:39.122 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f502da640 5 monclient: authenticate success, global_id 4108 2026-02-17T21:23:39.122 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f502da640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:23:39.122 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f4d04d640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:39.122 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f502da640 10 monclient: get_monmap_and_config success 2026-02-17T21:23:39.122 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f4d04d640 1 -- 10.20.193.5:0/3962184886 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3803a410 con 0x7f0f2800e970 2026-02-17T21:23:39.122 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f502da640 4 set_mon_vals no callback set 2026-02-17T21:23:39.122 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f4d04d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:39.122 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f4d04d640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:23:39.122 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f4d04d640 10 monclient: dump: 2026-02-17T21:23:39.122 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:23:39.123 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:39.123 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:39.123 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:39.123 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:39.123 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:23:39.123 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:39.123 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:39.123 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:39.123 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:23:39.123 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f502da640 10 monclient: shutdown 2026-02-17T21:23:39.123 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f502da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:39.123 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f502da640 1 -- 10.20.193.5:0/3962184886 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0f2800e970 msgr2=0x7f0f2800de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:39.124 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f502da640 1 --2- 10.20.193.5:0/3962184886 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0f2800e970 0x7f0f2800de30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0f280060b0 tx=0x7f0f3802fee0 comp rx=0 tx=0).stop 2026-02-17T21:23:39.124 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f502da640 1 -- 10.20.193.5:0/3962184886 shutdown_connections 2026-02-17T21:23:39.124 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f502da640 1 --2- 10.20.193.5:0/3962184886 >> v2:10.20.193.5:3300/0 conn(0x7f0f2800e560 0x7f0f280098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:39.124 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f502da640 1 --2- 10.20.193.5:0/3962184886 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0f2800e970 0x7f0f2800de30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:39.124 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f502da640 1 -- 10.20.193.5:0/3962184886 >> 10.20.193.5:0/3962184886 conn(0x7f0f48073030 msgr2=0x7f0f48073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:39.124 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f502da640 1 -- 10.20.193.5:0/3962184886 shutdown_connections 2026-02-17T21:23:39.124 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.116+0000 7f0f502da640 1 -- 10.20.193.5:0/3962184886 wait complete. 2026-02-17T21:23:39.124 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.117+0000 7f0f502da640 10 monclient: build_initial_monmap 2026-02-17T21:23:39.124 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.117+0000 7f0f502da640 10 monclient: monmap: 2026-02-17T21:23:39.124 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:23:39.124 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:23:39.125 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:23:39.125 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:23:39.125 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:39.125 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:23:39.125 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:23:39.125 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:23:39.125 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:23:39.125 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:23:39.125 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.117+0000 7f0f502da640 1 librados: starting msgr at 2026-02-17T21:23:39.125 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.117+0000 7f0f502da640 1 librados: starting objecter 2026-02-17T21:23:39.125 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.117+0000 7f0f502da640 1 Processor -- start 2026-02-17T21:23:39.125 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.117+0000 7f0f502da640 1 -- start start 2026-02-17T21:23:39.126 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.117+0000 7f0f502da640 1 librados: setting wanted keys 2026-02-17T21:23:39.126 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.117+0000 7f0f502da640 1 librados: calling monclient init 2026-02-17T21:23:39.126 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.117+0000 7f0f502da640 10 monclient: init 2026-02-17T21:23:39.126 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.118+0000 7f0f502da640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:39.126 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.118+0000 7f0f502da640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:23:39.126 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.118+0000 7f0f502da640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0f2800e560 0x7f0f480d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:39.126 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.118+0000 7f0f502da640 10 monclient(hunting): picked mon.noname-a con 0x7f0f2800e560 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:23:39.126 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.118+0000 7f0f502da640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0f2800e970 0x7f0f48150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:39.126 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.118+0000 7f0f502da640 10 monclient(hunting): picked mon.noname-b con 0x7f0f2800e970 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:23:39.126 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.118+0000 7f0f502da640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0f28011420 0x7f0f48150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:39.126 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.118+0000 7f0f502da640 10 monclient(hunting): picked mon.noname-c con 0x7f0f28011420 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:23:39.126 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.118+0000 7f0f502da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:39.127 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.118+0000 7f0f502da640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0f480cbc30 con 0x7f0f2800e560 2026-02-17T21:23:39.127 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.118+0000 7f0f502da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:39.127 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.118+0000 7f0f502da640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0f480c9260 con 0x7f0f2800e970 2026-02-17T21:23:39.127 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.118+0000 7f0f502da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:39.127 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.118+0000 7f0f502da640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0f481f6f80 con 0x7f0f28011420 2026-02-17T21:23:39.127 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.118+0000 7f0f502da640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:39.127 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.118+0000 7f0f502da640 10 monclient(hunting): authenticate will time out at 924.683412s 2026-02-17T21:23:39.131 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.123+0000 7f0f4e850640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0f28011420 0x7f0f48150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:39.131 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.123+0000 7f0f4e850640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0f28011420 0x7f0f48150790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:49428/0 (socket says 10.20.193.5:49428) 2026-02-17T21:23:39.131 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.123+0000 7f0f4e850640 1 -- 10.20.193.5:0/2299230115 learned_addr learned my addr 10.20.193.5:0/2299230115 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:23:39.131 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.123+0000 7f0f4e850640 10 monclient(hunting): get_auth_request con 0x7f0f28011420 auth_method 0 2026-02-17T21:23:39.131 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.123+0000 7f0f4e850640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:39.131 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.123+0000 7f0f4e850640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:39.131 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.123+0000 7f0f4e850640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:39.131 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.123+0000 7f0f4e850640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:39.131 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.123+0000 7f0f4e850640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:39.131 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.123+0000 7f0f4e850640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:39.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.125+0000 7f0f4e850640 10 monclient(hunting): handle_auth_done global_id 4109 payload 824 2026-02-17T21:23:39.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.125+0000 7f0f4e850640 1 -- 10.20.193.5:0/2299230115 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0f2800e970 msgr2=0x7f0f48150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:39.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.125+0000 7f0f4e850640 1 --2- 10.20.193.5:0/2299230115 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0f2800e970 0x7f0f48150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:39.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.125+0000 7f0f4e850640 1 -- 10.20.193.5:0/2299230115 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0f2800e560 msgr2=0x7f0f480d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:39.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.125+0000 7f0f4e850640 1 --2- 10.20.193.5:0/2299230115 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0f2800e560 0x7f0f480d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:39.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.125+0000 7f0f4e850640 10 monclient: _finish_hunting 0 2026-02-17T21:23:39.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.125+0000 7f0f4e850640 1 monclient: found mon.noname-c 2026-02-17T21:23:39.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.125+0000 7f0f4e850640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:39.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.125+0000 7f0f4e850640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:23:39.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.125+0000 7f0f4e850640 1 -- 10.20.193.5:0/2299230115 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4814f1b0 con 0x7f0f28011420 2026-02-17T21:23:39.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.126+0000 7f0f4e850640 1 --2- 10.20.193.5:0/2299230115 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0f28011420 0x7f0f48150790 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800ef00 tx=0x7f0f4400f7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:39.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.126+0000 7f0f2effd640 10 client.?.objecter ms_handle_connect 0x7f0f28011420 2026-02-17T21:23:39.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.126+0000 7f0f2effd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:23:39.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.127+0000 7f0f2effd640 1 -- 10.20.193.5:0/2299230115 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4400fea0 con 0x7f0f28011420 2026-02-17T21:23:39.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.127+0000 7f0f2effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:39.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.127+0000 7f0f2effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:23:39.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.127+0000 7f0f2effd640 10 monclient: dump: 2026-02-17T21:23:39.133 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:23:39.133 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:39.133 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:39.133 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:39.133 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:39.133 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:23:39.133 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:39.134 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:39.134 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:39.134 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:23:39.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.127+0000 7f0f2effd640 10 monclient: _finish_auth 0 2026-02-17T21:23:39.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.127+0000 7f0f2effd640 10 monclient: _check_auth_tickets 2026-02-17T21:23:39.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.127+0000 7f0f2effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:39.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.127+0000 7f0f502da640 5 monclient: authenticate success, global_id 4109 2026-02-17T21:23:39.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.127+0000 7f0f502da640 10 monclient: _renew_subs 2026-02-17T21:23:39.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.127+0000 7f0f502da640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:39.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.127+0000 7f0f502da640 1 -- 10.20.193.5:0/2299230115 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f4814f490 con 0x7f0f28011420 2026-02-17T21:23:39.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.127+0000 7f0f502da640 10 client.4109.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:23:39.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.127+0000 7f0f502da640 10 monclient: _renew_subs 2026-02-17T21:23:39.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.127+0000 7f0f502da640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:39.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.127+0000 7f0f502da640 1 -- 10.20.193.5:0/2299230115 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f4814fa50 con 0x7f0f28011420 2026-02-17T21:23:39.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.127+0000 7f0f502da640 1 librados: init done 2026-02-17T21:23:39.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.127+0000 7f0f502da640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:39.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.127+0000 7f0f502da640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:39.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.127+0000 7f0f502da640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:39.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.127+0000 7f0f502da640 1 -- 10.20.193.5:0/2299230115 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f480cac80 con 0x7f0f28011420 2026-02-17T21:23:39.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.128+0000 7f0f2effd640 1 -- 10.20.193.5:0/2299230115 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4400d890 con 0x7f0f28011420 2026-02-17T21:23:39.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.128+0000 7f0f2effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:39.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.128+0000 7f0f2effd640 1 -- 10.20.193.5:0/2299230115 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4401f060 con 0x7f0f28011420 2026-02-17T21:23:39.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.128+0000 7f0f2effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:39.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.128+0000 7f0f2effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:23:39.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.128+0000 7f0f4c84c640 4 set_mon_vals no callback set 2026-02-17T21:23:39.136 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.128+0000 7f0f2effd640 10 monclient: dump: 2026-02-17T21:23:39.136 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:23:39.136 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:39.136 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:39.136 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:39.136 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:39.136 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:23:39.136 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:39.136 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:39.136 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:39.136 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:23:39.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.208+0000 7f0f2effd640 1 -- 10.20.193.5:0/2299230115 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f0f4400dc80 con 0x7f0f28011420 2026-02-17T21:23:39.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.209+0000 7f0f2effd640 1 -- 10.20.193.5:0/2299230115 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0f4401a8b0 con 0x7f0f28011420 2026-02-17T21:23:39.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.209+0000 7f0f2effd640 10 client.4109.objecter ms_dispatch2 0x7f0f48000b90 osd_map(1..1 src has 1..1) 2026-02-17T21:23:39.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.209+0000 7f0f2effd640 3 client.4109.objecter handle_osd_map got epochs [1,1] > 0 2026-02-17T21:23:39.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.209+0000 7f0f2effd640 3 client.4109.objecter handle_osd_map decoding full epoch 1 2026-02-17T21:23:39.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.209+0000 7f0f2effd640 20 client.4109.objecter dump_active .. 0 homeless 2026-02-17T21:23:39.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.213+0000 7f0f2effd640 1 -- 10.20.193.5:0/2299230115 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f0f480cac80 con 0x7f0f28011420 2026-02-17T21:23:39.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.213+0000 7f0f2effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:39.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.213+0000 7f0f2effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:23:39.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.242+0000 7f0f502da640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-17T21:23:39.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.242+0000 7f0f502da640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-17T21:23:39.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.242+0000 7f0f502da640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:39.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.242+0000 7f0f502da640 1 -- 10.20.193.5:0/2299230115 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f0f480cb5f0 con 0x7f0f28011420 2026-02-17T21:23:39.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.421+0000 7f0f2effd640 1 -- 10.20.193.5:0/2299230115 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f0f480cb5f0 con 0x7f0f28011420 2026-02-17T21:23:39.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.421+0000 7f0f2effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-17T21:23:39.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.421+0000 7f0f2effd640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2026-02-17T21:23:39.423 INFO:teuthology.orchestra.run.trial005.stderr:adjusted tunables profile to default 2026-02-17T21:23:39.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.421+0000 7f0f502da640 10 librados: watch_flush enter 2026-02-17T21:23:39.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.421+0000 7f0f502da640 10 librados: watch_flush exit 2026-02-17T21:23:39.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.421+0000 7f0f502da640 20 client.4109.objecter shutdown clearing up homeless session... 2026-02-17T21:23:39.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.421+0000 7f0f502da640 10 client.4109.objecter successfully canceled tick 2026-02-17T21:23:39.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.421+0000 7f0f502da640 10 monclient: shutdown 2026-02-17T21:23:39.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.421+0000 7f0f502da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.421+0000 7f0f502da640 1 -- 10.20.193.5:0/2299230115 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0f28011420 msgr2=0x7f0f48150790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.421+0000 7f0f502da640 1 --2- 10.20.193.5:0/2299230115 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0f28011420 0x7f0f48150790 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800ef00 tx=0x7f0f4400f7b0 comp rx=0 tx=0).stop 2026-02-17T21:23:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.422+0000 7f0f502da640 1 -- 10.20.193.5:0/2299230115 shutdown_connections 2026-02-17T21:23:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.422+0000 7f0f502da640 1 --2- 10.20.193.5:0/2299230115 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0f28011420 0x7f0f48150790 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.422+0000 7f0f502da640 1 --2- 10.20.193.5:0/2299230115 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0f2800e970 0x7f0f48150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.422+0000 7f0f502da640 1 --2- 10.20.193.5:0/2299230115 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0f2800e560 0x7f0f480d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.422+0000 7f0f502da640 1 -- 10.20.193.5:0/2299230115 >> 10.20.193.5:0/2299230115 conn(0x7f0f48073030 msgr2=0x7f0f48152910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.422+0000 7f0f502da640 1 -- 10.20.193.5:0/2299230115 shutdown_connections 2026-02-17T21:23:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.422+0000 7f0f502da640 1 -- 10.20.193.5:0/2299230115 wait complete. 2026-02-17T21:23:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:39.422+0000 7f0f502da640 1 librados: shutdown 2026-02-17T21:23:39.432 INFO:tasks.ceph:check_enable_crimson: False 2026-02-17T21:23:39.432 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-17T21:23:39.432 DEBUG:teuthology.orchestra.run.trial005:> set -ex 2026-02-17T21:23:39.432 DEBUG:teuthology.orchestra.run.trial005:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-17T21:23:39.457 DEBUG:teuthology.orchestra.run.trial005:> set -ex 2026-02-17T21:23:39.457 DEBUG:teuthology.orchestra.run.trial005:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-17T21:23:39.477 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:39.473+0000 7fb01f20f140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T21:23:39.496 INFO:tasks.ceph.mgr.y.trial005.stderr:2026-02-17T21:23:39.495+0000 7fedb15dc140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T21:23:39.519 DEBUG:teuthology.orchestra.run.trial005:> set -ex 2026-02-17T21:23:39.519 DEBUG:teuthology.orchestra.run.trial005:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2026-02-17T21:23:39.583 DEBUG:teuthology.orchestra.run.trial005:> set -ex 2026-02-17T21:23:39.583 DEBUG:teuthology.orchestra.run.trial005:> sudo dd if=/var/lib/ceph/osd/ceph-12/fsid of=/dev/stdout 2026-02-17T21:23:39.598 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:39.594+0000 7fb01f20f140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T21:23:39.617 INFO:tasks.ceph.mgr.y.trial005.stderr:2026-02-17T21:23:39.616+0000 7fedb15dc140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T21:23:39.625 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:39.621+0000 7fb01f20f140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T21:23:39.640 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T21:23:39.640 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-17T21:23:39.644 INFO:tasks.ceph.mgr.y.trial005.stderr:2026-02-17T21:23:39.643+0000 7fedb15dc140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T21:23:39.658 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:39.654+0000 7fb01f20f140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T21:23:39.665 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T21:23:39.665 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-17T21:23:39.677 INFO:tasks.ceph.mgr.y.trial005.stderr:2026-02-17T21:23:39.676+0000 7fedb15dc140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T21:23:39.681 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:39.677+0000 7fb01f20f140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T21:23:39.700 INFO:tasks.ceph.mgr.y.trial005.stderr:2026-02-17T21:23:39.699+0000 7fedb15dc140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T21:23:39.708 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:39.703+0000 7fb01f20f140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T21:23:39.726 INFO:tasks.ceph.mgr.y.trial005.stderr:2026-02-17T21:23:39.725+0000 7fedb15dc140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T21:23:39.730 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T21:23:39.730 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2026-02-17T21:23:39.763 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:39.759+0000 7fb01f20f140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T21:23:39.782 INFO:tasks.ceph.mgr.y.trial005.stderr:2026-02-17T21:23:39.781+0000 7fedb15dc140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T21:23:39.794 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T21:23:39.794 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/var/lib/ceph/osd/ceph-13/fsid of=/dev/stdout 2026-02-17T21:23:39.823 INFO:tasks.ceph.mgr.x.trial176.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T21:23:39.824 INFO:tasks.ceph.mgr.x.trial176.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T21:23:39.824 INFO:tasks.ceph.mgr.x.trial176.stderr: from numpy import show_config as show_numpy_config 2026-02-17T21:23:39.827 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:39.823+0000 7fb01f20f140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T21:23:39.843 INFO:tasks.ceph.mgr.y.trial005.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T21:23:39.844 INFO:tasks.ceph.mgr.y.trial005.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T21:23:39.844 INFO:tasks.ceph.mgr.y.trial005.stderr: from numpy import show_config as show_numpy_config 2026-02-17T21:23:39.847 INFO:tasks.ceph.mgr.y.trial005.stderr:2026-02-17T21:23:39.846+0000 7fedb15dc140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T21:23:39.852 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:39.848+0000 7fb01f20f140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T21:23:39.857 DEBUG:teuthology.orchestra.run.trial135:> set -ex 2026-02-17T21:23:39.857 DEBUG:teuthology.orchestra.run.trial135:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-17T21:23:39.872 INFO:tasks.ceph.mgr.y.trial005.stderr:2026-02-17T21:23:39.871+0000 7fedb15dc140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T21:23:39.884 DEBUG:teuthology.orchestra.run.trial135:> set -ex 2026-02-17T21:23:39.885 DEBUG:teuthology.orchestra.run.trial135:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2026-02-17T21:23:39.908 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:39.904+0000 7fb01f20f140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T21:23:39.927 INFO:tasks.ceph.mgr.y.trial005.stderr:2026-02-17T21:23:39.926+0000 7fedb15dc140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T21:23:39.948 DEBUG:teuthology.orchestra.run.trial135:> set -ex 2026-02-17T21:23:39.948 DEBUG:teuthology.orchestra.run.trial135:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2026-02-17T21:23:39.951 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:39.947+0000 7fb01f20f140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T21:23:39.971 INFO:tasks.ceph.mgr.y.trial005.stderr:2026-02-17T21:23:39.970+0000 7fedb15dc140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T21:23:39.977 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:39.973+0000 7fb01f20f140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T21:23:39.997 INFO:tasks.ceph.mgr.y.trial005.stderr:2026-02-17T21:23:39.996+0000 7fedb15dc140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T21:23:40.002 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:39.998+0000 7fb01f20f140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T21:23:40.012 DEBUG:teuthology.orchestra.run.trial135:> set -ex 2026-02-17T21:23:40.013 DEBUG:teuthology.orchestra.run.trial135:> sudo dd if=/var/lib/ceph/osd/ceph-14/fsid of=/dev/stdout 2026-02-17T21:23:40.021 INFO:tasks.ceph.mgr.y.trial005.stderr:2026-02-17T21:23:40.020+0000 7fedb15dc140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T21:23:40.028 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:40.024+0000 7fb01f20f140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T21:23:40.047 INFO:tasks.ceph.mgr.y.trial005.stderr:2026-02-17T21:23:40.046+0000 7fedb15dc140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T21:23:40.050 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:40.046+0000 7fb01f20f140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T21:23:40.070 INFO:tasks.ceph.mgr.y.trial005.stderr:2026-02-17T21:23:40.069+0000 7fedb15dc140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T21:23:40.076 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T21:23:40.077 DEBUG:teuthology.orchestra.run.trial176:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-17T21:23:40.101 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T21:23:40.101 DEBUG:teuthology.orchestra.run.trial176:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2026-02-17T21:23:40.163 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T21:23:40.164 DEBUG:teuthology.orchestra.run.trial176:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2026-02-17T21:23:40.228 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T21:23:40.228 DEBUG:teuthology.orchestra.run.trial176:> sudo dd if=/var/lib/ceph/osd/ceph-15/fsid of=/dev/stdout 2026-02-17T21:23:40.248 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:40.244+0000 7fb01f20f140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T21:23:40.264 INFO:tasks.ceph.mgr.y.trial005.stderr:2026-02-17T21:23:40.263+0000 7fedb15dc140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T21:23:40.271 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph --cluster ceph osd new 8bffc5e9-1f92-4603-bf29-ce19225edc1a 0 2026-02-17T21:23:40.303 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:40.299+0000 7fb01f20f140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T21:23:40.318 INFO:tasks.ceph.mgr.y.trial005.stderr:2026-02-17T21:23:40.317+0000 7fedb15dc140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T21:23:40.326 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:40.322+0000 7fb01f20f140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T21:23:40.341 INFO:tasks.ceph.mgr.y.trial005.stderr:2026-02-17T21:23:40.340+0000 7fedb15dc140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T21:23:40.350 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:40.346+0000 7fb01f20f140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T21:23:40.364 INFO:tasks.ceph.mgr.y.trial005.stderr:2026-02-17T21:23:40.363+0000 7fedb15dc140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T21:23:40.368 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.364+0000 7fd6c81e7640 10 monclient: get_monmap_and_config 2026-02-17T21:23:40.368 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.364+0000 7fd6c81e7640 10 monclient: build_initial_monmap 2026-02-17T21:23:40.369 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.364+0000 7fd6c81e7640 10 monclient: monmap: 2026-02-17T21:23:40.369 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:40.369 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:40.369 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:23:40.366473+0000 2026-02-17T21:23:40.369 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:23:40.366473+0000 2026-02-17T21:23:40.369 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:40.369 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:40.369 INFO:teuthology.orchestra.run.trial176.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:23:40.369 INFO:teuthology.orchestra.run.trial176.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:23:40.369 INFO:teuthology.orchestra.run.trial176.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:23:40.369 INFO:teuthology.orchestra.run.trial176.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:23:40.370 INFO:teuthology.orchestra.run.trial176.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:23:40.370 INFO:teuthology.orchestra.run.trial176.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:23:40.370 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:40.373 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.365+0000 7fd6c81e7640 1 Processor -- start 2026-02-17T21:23:40.373 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.365+0000 7fd6c81e7640 1 -- start start 2026-02-17T21:23:40.373 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.365+0000 7fd6c81e7640 10 monclient: init 2026-02-17T21:23:40.373 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.365+0000 7fd6c81e7640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:40.374 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.365+0000 7fd6c81e7640 10 monclient: _add_conns ranks=[4,3,2,0,5,1] 2026-02-17T21:23:40.374 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.365+0000 7fd6c81e7640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fd6c0073830 0x7fd6c01181d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:40.374 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.365+0000 7fd6c81e7640 10 monclient(hunting): picked mon.noname-b con 0x7fd6c0073830 addr v2:10.20.193.119:3300/0 2026-02-17T21:23:40.374 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.365+0000 7fd6c81e7640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fd6c0073c10 0x7fd6c0123340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:40.374 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.365+0000 7fd6c81e7640 10 monclient(hunting): picked mon.noname-a con 0x7fd6c0073c10 addr v2:10.20.193.5:3300/0 2026-02-17T21:23:40.374 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.365+0000 7fd6c81e7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd6c0074080 addr v1:10.20.193.135:6789/0 2026-02-17T21:23:40.374 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.365+0000 7fd6c81e7640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6c0127070 con 0x7fd6c0074080 2026-02-17T21:23:40.374 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.365+0000 7fd6c81e7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:40.374 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.365+0000 7fd6c81e7640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd6c0128290 con 0x7fd6c0073c10 2026-02-17T21:23:40.374 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.365+0000 7fd6c81e7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:40.374 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.365+0000 7fd6c81e7640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fd6c0128410 con 0x7fd6c0073830 2026-02-17T21:23:40.374 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.365+0000 7fd6c81e7640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:40.375 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.365+0000 7fd6c81e7640 10 monclient(hunting): authenticate will time out at 959.008401s 2026-02-17T21:23:40.375 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.365+0000 7fd6c675d640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7fd6c0074080 0x7fd6c0125890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.176:40226/0 (socket says 10.20.193.176:40226) 2026-02-17T21:23:40.375 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.365+0000 7fd6c675d640 1 -- 10.20.193.176:0/2403144164 learned_addr learned my addr 10.20.193.176:0/2403144164 (peer_addr_for_me v1:10.20.193.176:0/0) 2026-02-17T21:23:40.375 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.365+0000 7fd6c5f5c640 1 --2- 10.20.193.176:0/2403144164 >> v2:10.20.193.119:3300/0 conn(0x7fd6c0073830 0x7fd6c01181d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:40.375 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.365+0000 7fd6c575b640 1 --2- 10.20.193.176:0/2403144164 >> v2:10.20.193.5:3300/0 conn(0x7fd6c0073c10 0x7fd6c0123340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:40.375 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.366+0000 7fd6c5f5c640 10 monclient(hunting): get_auth_request con 0x7fd6c0073830 auth_method 0 2026-02-17T21:23:40.375 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.366+0000 7fd6c5f5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:40.375 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.366+0000 7fd6c5f5c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:40.375 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.366+0000 7fd6c5f5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:40.375 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.366+0000 7fd6c575b640 10 monclient(hunting): get_auth_request con 0x7fd6c0073c10 auth_method 0 2026-02-17T21:23:40.375 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.366+0000 7fd6c575b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:40.375 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.366+0000 7fd6c575b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:40.376 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.366+0000 7fd6c575b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:40.376 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.366+0000 7fd6c575b640 1 -- 10.20.193.176:0/2403144164 >> v2:10.20.193.5:3300/0 conn(0x7fd6c0073c10 msgr2=0x7fd6c0123340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T21:23:40.376 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.366+0000 7fd6c575b640 1 -- 10.20.193.176:0/2403144164 >> v2:10.20.193.5:3300/0 conn(0x7fd6c0073c10 msgr2=0x7fd6c0123340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T21:23:40.376 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.366+0000 7fd6c575b640 1 --2- 10.20.193.176:0/2403144164 >> v2:10.20.193.5:3300/0 conn(0x7fd6c0073c10 0x7fd6c0123340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:23:40.376 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.366+0000 7fd6c575b640 1 --2- 10.20.193.176:0/2403144164 >> v2:10.20.193.5:3300/0 conn(0x7fd6c0073c10 0x7fd6c0123340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:23:40.376 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.366+0000 7fd6c5f5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:40.376 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.366+0000 7fd6c5f5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:40.376 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.366+0000 7fd6c5f5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:40.376 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.367+0000 7fd6c4f5a640 1 -- 10.20.193.176:0/2403144164 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 107187694 0 0) 0x7fd6c0127070 con 0x7fd6c0074080 2026-02-17T21:23:40.376 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.367+0000 7fd6c4f5a640 10 monclient(hunting): _negotiate 2026-02-17T21:23:40.376 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.367+0000 7fd6c4f5a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:40.376 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.367+0000 7fd6c4f5a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:40.377 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.367+0000 7fd6c4f5a640 10 monclient(hunting): my global_id is 4112 2026-02-17T21:23:40.377 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.367+0000 7fd6c4f5a640 1 -- 10.20.193.176:0/2403144164 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6a8003620 con 0x7fd6c0074080 2026-02-17T21:23:40.377 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.367+0000 7fd6c5f5c640 10 monclient(hunting): handle_auth_done global_id 4117 payload 274 2026-02-17T21:23:40.377 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.367+0000 7fd6c5f5c640 1 -- 10.20.193.176:0/2403144164 >> v2:10.20.193.5:3300/0 conn(0x7fd6c0073c10 msgr2=0x7fd6c0123340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:23:40.377 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.367+0000 7fd6c5f5c640 1 --2- 10.20.193.176:0/2403144164 >> v2:10.20.193.5:3300/0 conn(0x7fd6c0073c10 0x7fd6c0123340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.377 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.367+0000 7fd6c5f5c640 1 -- 10.20.193.176:0/2403144164 >> v1:10.20.193.135:6789/0 conn(0x7fd6c0074080 legacy=0x7fd6c0125890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:40.377 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.367+0000 7fd6c5f5c640 10 monclient: _finish_hunting 0 2026-02-17T21:23:40.377 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.367+0000 7fd6c5f5c640 1 monclient: found mon.noname-b 2026-02-17T21:23:40.377 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.367+0000 7fd6c5f5c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:40.377 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.367+0000 7fd6c5f5c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:23:40.377 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.367+0000 7fd6c5f5c640 1 -- 10.20.193.176:0/2403144164 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c01285c0 con 0x7fd6c0073830 2026-02-17T21:23:40.377 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.368+0000 7fd6c5f5c640 1 --2- 10.20.193.176:0/2403144164 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd6c0073830 0x7fd6c01181d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0076ab0 tx=0x7fd6b002ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3c402f0842d54ba server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:40.385 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.370+0000 7fd6c4f5a640 1 -- 10.20.193.176:0/2403144164 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b003c070 con 0x7fd6c0073830 2026-02-17T21:23:40.385 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.370+0000 7fd6c4f5a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:40.385 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.370+0000 7fd6c4f5a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:23:40.385 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.370+0000 7fd6c4f5a640 10 monclient: dump: 2026-02-17T21:23:40.385 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:40.385 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:40.385 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:40.386 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:40.386 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:40.386 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:40.386 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:40.386 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:40.386 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:40.386 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:40.386 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.370+0000 7fd6c4f5a640 10 monclient: _finish_auth 0 2026-02-17T21:23:40.386 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.370+0000 7fd6c4f5a640 10 monclient: _check_auth_tickets 2026-02-17T21:23:40.386 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.370+0000 7fd6c4f5a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:40.386 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.370+0000 7fd6c4f5a640 1 -- 10.20.193.176:0/2403144164 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6b002fa60 con 0x7fd6c0073830 2026-02-17T21:23:40.386 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.370+0000 7fd6c4f5a640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:40.387 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.370+0000 7fd6c4f5a640 1 -- 10.20.193.176:0/2403144164 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b002fe30 con 0x7fd6c0073830 2026-02-17T21:23:40.387 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.370+0000 7fd6c4f5a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:40.387 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.370+0000 7fd6c4f5a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:23:40.387 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.370+0000 7fd6c4f5a640 10 monclient: dump: 2026-02-17T21:23:40.387 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:40.387 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:40.387 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:40.387 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:40.387 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:40.387 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:40.387 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:40.387 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:40.388 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:40.388 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:40.388 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.370+0000 7fd6c81e7640 5 monclient: authenticate success, global_id 4117 2026-02-17T21:23:40.388 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.370+0000 7fd6c81e7640 10 monclient: get_monmap_and_config success 2026-02-17T21:23:40.388 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.370+0000 7fd6c81e7640 4 set_mon_vals no callback set 2026-02-17T21:23:40.388 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.371+0000 7fd6c81e7640 10 monclient: shutdown 2026-02-17T21:23:40.388 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.371+0000 7fd6c81e7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:40.388 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.371+0000 7fd6c81e7640 1 -- 10.20.193.176:0/2403144164 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd6c0073830 msgr2=0x7fd6c01181d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:40.388 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.371+0000 7fd6c81e7640 1 --2- 10.20.193.176:0/2403144164 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd6c0073830 0x7fd6c01181d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0076ab0 tx=0x7fd6b002ed50 comp rx=0 tx=0).stop 2026-02-17T21:23:40.388 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.371+0000 7fd6c81e7640 1 -- 10.20.193.176:0/2403144164 shutdown_connections 2026-02-17T21:23:40.388 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.371+0000 7fd6c81e7640 1 --2- 10.20.193.176:0/2403144164 >> v2:10.20.193.5:3300/0 conn(0x7fd6c0073c10 0x7fd6c0123340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.388 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.371+0000 7fd6c81e7640 1 --2- 10.20.193.176:0/2403144164 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd6c0073830 0x7fd6c01181d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.389 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.371+0000 7fd6c81e7640 1 -- 10.20.193.176:0/2403144164 >> 10.20.193.176:0/2403144164 conn(0x7fd6c006f660 msgr2=0x7fd6c0071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:40.389 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.371+0000 7fd6c81e7640 1 -- 10.20.193.176:0/2403144164 shutdown_connections 2026-02-17T21:23:40.389 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.371+0000 7fd6c81e7640 1 -- 10.20.193.176:0/2403144164 wait complete. 2026-02-17T21:23:40.389 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.371+0000 7fd6c81e7640 10 monclient: build_initial_monmap 2026-02-17T21:23:40.389 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.371+0000 7fd6c81e7640 10 monclient: monmap: 2026-02-17T21:23:40.389 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:40.389 INFO:teuthology.orchestra.run.trial176.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:23:40.389 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 0.000000 2026-02-17T21:23:40.389 INFO:teuthology.orchestra.run.trial176.stderr:created 0.000000 2026-02-17T21:23:40.389 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:40.389 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:40.389 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:23:40.390 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:23:40.390 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:23:40.390 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:40.390 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.371+0000 7fd6c81e7640 1 librados: starting msgr at 2026-02-17T21:23:40.390 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.371+0000 7fd6c81e7640 1 librados: starting objecter 2026-02-17T21:23:40.390 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.371+0000 7fd6c81e7640 1 Processor -- start 2026-02-17T21:23:40.390 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.371+0000 7fd6c81e7640 1 -- start start 2026-02-17T21:23:40.390 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.371+0000 7fd6c81e7640 1 librados: setting wanted keys 2026-02-17T21:23:40.390 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.371+0000 7fd6c81e7640 1 librados: calling monclient init 2026-02-17T21:23:40.390 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.371+0000 7fd6c81e7640 10 monclient: init 2026-02-17T21:23:40.390 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c81e7640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:40.390 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c81e7640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:23:40.391 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c81e7640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd6c0073830 0x7fd6c01afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:40.391 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c81e7640 10 monclient(hunting): picked mon.noname-c con 0x7fd6c0073830 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:23:40.391 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c81e7640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd6c0073c10 0x7fd6c01b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:40.391 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c81e7640 10 monclient(hunting): picked mon.noname-a con 0x7fd6c0073c10 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:23:40.391 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c81e7640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd6c0074080 0x7fd6c01b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:40.391 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c81e7640 10 monclient(hunting): picked mon.noname-b con 0x7fd6c0074080 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:23:40.391 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c81e7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:40.391 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c81e7640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c0127700 con 0x7fd6c0073c10 2026-02-17T21:23:40.391 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c81e7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:40.391 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c81e7640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c0127580 con 0x7fd6c0074080 2026-02-17T21:23:40.391 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c81e7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:40.391 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c81e7640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c0127880 con 0x7fd6c0073830 2026-02-17T21:23:40.391 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c81e7640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:40.392 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c81e7640 10 monclient(hunting): authenticate will time out at 959.015141s 2026-02-17T21:23:40.392 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c5f5c640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd6c0073830 0x7fd6c01afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:40.392 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c575b640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd6c0073c10 0x7fd6c01b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:40.392 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c5f5c640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd6c0073830 0x7fd6c01afc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.176:59554/0 (socket says 10.20.193.176:59554) 2026-02-17T21:23:40.392 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c5f5c640 1 -- 10.20.193.176:0/2117964208 learned_addr learned my addr 10.20.193.176:0/2117964208 (peer_addr_for_me v2:10.20.193.176:0/0) 2026-02-17T21:23:40.392 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c5f5c640 10 monclient(hunting): get_auth_request con 0x7fd6c0073830 auth_method 0 2026-02-17T21:23:40.392 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c5f5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:40.392 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c5f5c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:40.392 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c5f5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:40.392 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c675d640 1 --2- 10.20.193.176:0/2117964208 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd6c0074080 0x7fd6c01b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:40.392 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c575b640 10 monclient(hunting): get_auth_request con 0x7fd6c0073c10 auth_method 0 2026-02-17T21:23:40.393 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c575b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:40.393 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c575b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:40.393 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c575b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:40.393 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c5f5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:40.393 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c5f5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:40.393 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c5f5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:40.393 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c675d640 10 monclient(hunting): get_auth_request con 0x7fd6c0074080 auth_method 0 2026-02-17T21:23:40.393 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c675d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:40.393 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c675d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:40.393 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.372+0000 7fd6c675d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:40.393 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.373+0000 7fd6c575b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:40.393 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.373+0000 7fd6c575b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:40.393 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.373+0000 7fd6c575b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:40.394 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.373+0000 7fd6c675d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:40.394 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.373+0000 7fd6c675d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:40.394 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.373+0000 7fd6c675d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:40.394 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.374+0000 7fd6c5f5c640 10 monclient(hunting): handle_auth_done global_id 4115 payload 824 2026-02-17T21:23:40.394 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.374+0000 7fd6c5f5c640 1 -- 10.20.193.176:0/2117964208 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd6c0074080 msgr2=0x7fd6c01b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:40.394 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.374+0000 7fd6c5f5c640 1 --2- 10.20.193.176:0/2117964208 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd6c0074080 0x7fd6c01b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.394 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.374+0000 7fd6c5f5c640 1 -- 10.20.193.176:0/2117964208 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd6c0073c10 msgr2=0x7fd6c01b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:40.394 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.374+0000 7fd6c5f5c640 1 --2- 10.20.193.176:0/2117964208 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd6c0073c10 0x7fd6c01b0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.394 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.374+0000 7fd6c5f5c640 10 monclient: _finish_hunting 0 2026-02-17T21:23:40.394 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.374+0000 7fd6c5f5c640 1 monclient: found mon.noname-c 2026-02-17T21:23:40.394 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.374+0000 7fd6c5f5c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:40.394 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.374+0000 7fd6c5f5c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:23:40.394 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.374+0000 7fd6c5f5c640 1 -- 10.20.193.176:0/2117964208 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c01b4b70 con 0x7fd6c0073830 2026-02-17T21:23:40.395 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.375+0000 7fd6c5f5c640 1 --2- 10.20.193.176:0/2117964208 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd6c0073830 0x7fd6c01afc00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0009130 tx=0x7fd6b00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:40.395 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.375+0000 7fd6ae7fc640 10 client.?.objecter ms_handle_connect 0x7fd6c0073830 2026-02-17T21:23:40.395 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.375+0000 7fd6ae7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:23:40.395 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.376+0000 7fd6ae7fc640 1 -- 10.20.193.176:0/2117964208 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b003c040 con 0x7fd6c0073830 2026-02-17T21:23:40.395 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.376+0000 7fd6ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:40.395 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.376+0000 7fd6ae7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:23:40.395 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.376+0000 7fd6ae7fc640 10 monclient: dump: 2026-02-17T21:23:40.395 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:40.395 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:40.395 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:40.395 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:40.395 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:40.395 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:40.396 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:40.396 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:40.396 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:40.396 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:40.396 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.376+0000 7fd6ae7fc640 10 monclient: _finish_auth 0 2026-02-17T21:23:40.396 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.376+0000 7fd6ae7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:23:40.396 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.376+0000 7fd6ae7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:40.396 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.376+0000 7fd6ae7fc640 1 -- 10.20.193.176:0/2117964208 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6b0042450 con 0x7fd6c0073830 2026-02-17T21:23:40.396 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.376+0000 7fd6ae7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:40.396 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.376+0000 7fd6ae7fc640 1 -- 10.20.193.176:0/2117964208 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0042820 con 0x7fd6c0073830 2026-02-17T21:23:40.396 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.376+0000 7fd6ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:40.396 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.376+0000 7fd6ae7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:23:40.397 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.376+0000 7fd6ae7fc640 10 monclient: dump: 2026-02-17T21:23:40.397 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:40.397 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:40.397 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:40.397 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:40.397 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:40.397 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:40.397 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:40.397 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:40.397 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:40.397 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:40.397 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.376+0000 7fd6affff640 4 set_mon_vals no callback set 2026-02-17T21:23:40.397 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.376+0000 7fd6c81e7640 5 monclient: authenticate success, global_id 4115 2026-02-17T21:23:40.398 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.376+0000 7fd6c81e7640 10 monclient: _renew_subs 2026-02-17T21:23:40.398 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.376+0000 7fd6c81e7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:40.398 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.376+0000 7fd6c81e7640 1 -- 10.20.193.176:0/2117964208 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6c01b4e00 con 0x7fd6c0073830 2026-02-17T21:23:40.398 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.376+0000 7fd6c81e7640 10 client.4115.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:23:40.398 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.376+0000 7fd6c81e7640 10 monclient: _renew_subs 2026-02-17T21:23:40.398 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.376+0000 7fd6c81e7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:40.398 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.376+0000 7fd6c81e7640 1 -- 10.20.193.176:0/2117964208 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6c01bc480 con 0x7fd6c0073830 2026-02-17T21:23:40.398 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.376+0000 7fd6c81e7640 1 librados: init done 2026-02-17T21:23:40.398 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.377+0000 7fd6c81e7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:40.398 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.377+0000 7fd6c81e7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:40.398 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.377+0000 7fd6c81e7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:40.398 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.377+0000 7fd6c81e7640 1 -- 10.20.193.176:0/2117964208 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6c0127c90 con 0x7fd6c0073830 2026-02-17T21:23:40.399 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.378+0000 7fd6ae7fc640 1 -- 10.20.193.176:0/2117964208 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fd6b0053070 con 0x7fd6c0073830 2026-02-17T21:23:40.399 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.378+0000 7fd6ae7fc640 1 -- 10.20.193.176:0/2117964208 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fd6b004baa0 con 0x7fd6c0073830 2026-02-17T21:23:40.399 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.378+0000 7fd6ae7fc640 10 client.4115.objecter ms_dispatch2 0x7fd6c0000b90 osd_map(2..2 src has 1..2) 2026-02-17T21:23:40.399 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.378+0000 7fd6ae7fc640 3 client.4115.objecter handle_osd_map got epochs [2,2] > 0 2026-02-17T21:23:40.399 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.378+0000 7fd6ae7fc640 3 client.4115.objecter handle_osd_map decoding full epoch 2 2026-02-17T21:23:40.399 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.378+0000 7fd6ae7fc640 20 client.4115.objecter dump_active .. 0 homeless 2026-02-17T21:23:40.404 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:40.401+0000 7fb01f20f140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T21:23:40.417 INFO:tasks.ceph.mgr.y.trial005.stderr:2026-02-17T21:23:40.416+0000 7fedb15dc140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T21:23:40.422 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.418+0000 7fd6ae7fc640 1 -- 10.20.193.176:0/2117964208 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fd6b0050020 con 0x7fd6c0073830 2026-02-17T21:23:40.422 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.418+0000 7fd6ae7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:40.422 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.418+0000 7fd6ae7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:23:40.426 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:40.422+0000 7fb01f20f140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T21:23:40.438 INFO:tasks.ceph.mgr.y.trial005.stderr:2026-02-17T21:23:40.437+0000 7fedb15dc140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T21:23:40.455 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.451+0000 7fd6c81e7640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "8bffc5e9-1f92-4603-bf29-ce19225edc1a", "id": 0}] 2026-02-17T21:23:40.455 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.451+0000 7fd6c81e7640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "8bffc5e9-1f92-4603-bf29-ce19225edc1a", "id": 0}] 2026-02-17T21:23:40.455 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.451+0000 7fd6c81e7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:40.456 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.451+0000 7fd6c81e7640 1 -- 10.20.193.176:0/2117964208 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8bffc5e9-1f92-4603-bf29-ce19225edc1a", "id": 0} v 0) -- 0x7fd6c0112330 con 0x7fd6c0073830 2026-02-17T21:23:40.478 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:40.475+0000 7fb01f20f140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T21:23:40.491 INFO:tasks.ceph.mgr.y.trial005.stderr:2026-02-17T21:23:40.490+0000 7fedb15dc140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T21:23:40.528 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.524+0000 7fd6ae7fc640 1 -- 10.20.193.176:0/2117964208 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8bffc5e9-1f92-4603-bf29-ce19225edc1a", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fd6b004bca0 con 0x7fd6c0073830 2026-02-17T21:23:40.528 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.524+0000 7fd6ae7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "8bffc5e9-1f92-4603-bf29-ce19225edc1a", "id": 0}] 2026-02-17T21:23:40.528 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.524+0000 7fd6ae7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:23:40.528 INFO:teuthology.orchestra.run.trial176.stdout:0 2026-02-17T21:23:40.530 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.525+0000 7fd6c81e7640 10 librados: watch_flush enter 2026-02-17T21:23:40.530 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.525+0000 7fd6c81e7640 10 librados: watch_flush exit 2026-02-17T21:23:40.530 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.525+0000 7fd6c81e7640 20 client.4115.objecter shutdown clearing up homeless session... 2026-02-17T21:23:40.530 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.525+0000 7fd6c81e7640 10 client.4115.objecter successfully canceled tick 2026-02-17T21:23:40.530 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.525+0000 7fd6c81e7640 10 monclient: shutdown 2026-02-17T21:23:40.530 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.525+0000 7fd6c81e7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:40.531 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.525+0000 7fd6c81e7640 1 -- 10.20.193.176:0/2117964208 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd6c0073830 msgr2=0x7fd6c01afc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:40.531 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.525+0000 7fd6c81e7640 1 --2- 10.20.193.176:0/2117964208 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd6c0073830 0x7fd6c01afc00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0009130 tx=0x7fd6b00047c0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.531 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.525+0000 7fd6c81e7640 1 -- 10.20.193.176:0/2117964208 shutdown_connections 2026-02-17T21:23:40.531 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.525+0000 7fd6c81e7640 1 --2- 10.20.193.176:0/2117964208 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd6c0074080 0x7fd6c01b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.531 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.525+0000 7fd6c81e7640 1 --2- 10.20.193.176:0/2117964208 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd6c0073c10 0x7fd6c01b0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.531 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.525+0000 7fd6c81e7640 1 --2- 10.20.193.176:0/2117964208 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd6c0073830 0x7fd6c01afc00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.531 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.525+0000 7fd6c81e7640 1 -- 10.20.193.176:0/2117964208 >> 10.20.193.176:0/2117964208 conn(0x7fd6c006f660 msgr2=0x7fd6c01245b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:40.531 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.525+0000 7fd6c81e7640 1 -- 10.20.193.176:0/2117964208 shutdown_connections 2026-02-17T21:23:40.531 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.525+0000 7fd6c81e7640 1 -- 10.20.193.176:0/2117964208 wait complete. 2026-02-17T21:23:40.531 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.525+0000 7fd6c81e7640 1 librados: shutdown 2026-02-17T21:23:40.537 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph --cluster ceph osd new 8ffdf919-2ec4-4c1f-a69f-aee5cea211e0 1 2026-02-17T21:23:40.645 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.639+0000 7f588bf49640 10 monclient: get_monmap_and_config 2026-02-17T21:23:40.645 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.639+0000 7f588bf49640 10 monclient: build_initial_monmap 2026-02-17T21:23:40.645 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.639+0000 7f588bf49640 10 monclient: monmap: 2026-02-17T21:23:40.645 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:40.645 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:40.645 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:23:40.641032+0000 2026-02-17T21:23:40.645 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:23:40.641032+0000 2026-02-17T21:23:40.646 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:40.646 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:40.646 INFO:teuthology.orchestra.run.trial176.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:23:40.646 INFO:teuthology.orchestra.run.trial176.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:23:40.646 INFO:teuthology.orchestra.run.trial176.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:23:40.646 INFO:teuthology.orchestra.run.trial176.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:23:40.646 INFO:teuthology.orchestra.run.trial176.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:23:40.646 INFO:teuthology.orchestra.run.trial176.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:23:40.646 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:40.646 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.639+0000 7f588bf49640 1 Processor -- start 2026-02-17T21:23:40.646 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.639+0000 7f588bf49640 1 -- start start 2026-02-17T21:23:40.646 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.639+0000 7f588bf49640 10 monclient: init 2026-02-17T21:23:40.647 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.639+0000 7f588bf49640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:40.647 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.639+0000 7f588bf49640 10 monclient: _add_conns ranks=[5,1,3,2,0,4] 2026-02-17T21:23:40.647 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.639+0000 7f588bf49640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f58841123f0 0x7f58841127d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:40.647 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.639+0000 7f588bf49640 10 monclient(hunting): picked mon.noname-c con 0x7f58841123f0 addr v2:10.20.193.135:3300/0 2026-02-17T21:23:40.647 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.639+0000 7f588bf49640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f58841192c0 addr v1:10.20.193.119:6789/0 2026-02-17T21:23:40.647 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.639+0000 7f588bf49640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f588411cdd0 0x7f588411f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:40.647 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.639+0000 7f588bf49640 10 monclient(hunting): picked mon.noname-a con 0x7f588411cdd0 addr v2:10.20.193.5:3300/0 2026-02-17T21:23:40.647 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.639+0000 7f588bf49640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f588411f790 con 0x7f58841192c0 2026-02-17T21:23:40.647 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.639+0000 7f588bf49640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:40.647 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.639+0000 7f588bf49640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5884120990 con 0x7f588411cdd0 2026-02-17T21:23:40.647 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.639+0000 7f588bf49640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:40.647 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.639+0000 7f588bf49640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f5884120b10 con 0x7f58841123f0 2026-02-17T21:23:40.648 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.639+0000 7f588bf49640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:40.648 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.639+0000 7f588bf49640 10 monclient(hunting): authenticate will time out at 959.282962s 2026-02-17T21:23:40.648 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.640+0000 7f5889cbe640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f58841123f0 0x7f58841127d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:40.648 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.640+0000 7f58894bd640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f58841192c0 0x7f588411b6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.176:41190/0 (socket says 10.20.193.176:41190) 2026-02-17T21:23:40.648 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.640+0000 7f58894bd640 1 -- 10.20.193.176:0/2960472421 learned_addr learned my addr 10.20.193.176:0/2960472421 (peer_addr_for_me v1:10.20.193.176:0/0) 2026-02-17T21:23:40.648 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.640+0000 7f588a4bf640 1 --2- 10.20.193.176:0/2960472421 >> v2:10.20.193.5:3300/0 conn(0x7f588411cdd0 0x7f588411f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:40.648 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.640+0000 7f588a4bf640 10 monclient(hunting): get_auth_request con 0x7f588411cdd0 auth_method 0 2026-02-17T21:23:40.648 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.640+0000 7f588a4bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:40.648 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.640+0000 7f588a4bf640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:40.648 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.640+0000 7f588a4bf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:40.648 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.640+0000 7f5889cbe640 1 -- 10.20.193.176:0/2960472421 >> v2:10.20.193.135:3300/0 conn(0x7f58841123f0 msgr2=0x7f58841127d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T21:23:40.648 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.641+0000 7f5889cbe640 1 -- 10.20.193.176:0/2960472421 >> v2:10.20.193.135:3300/0 conn(0x7f58841123f0 msgr2=0x7f58841127d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T21:23:40.649 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.641+0000 7f5889cbe640 1 --2- 10.20.193.176:0/2960472421 >> v2:10.20.193.135:3300/0 conn(0x7f58841123f0 0x7f58841127d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:23:40.649 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.641+0000 7f5889cbe640 1 --2- 10.20.193.176:0/2960472421 >> v2:10.20.193.135:3300/0 conn(0x7f58841123f0 0x7f58841127d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:23:40.649 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.641+0000 7f588a4bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:40.649 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.641+0000 7f588a4bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:40.649 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.641+0000 7f588a4bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:40.657 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.641+0000 7f5888cbc640 1 -- 10.20.193.176:0/2960472421 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4200252425 0 0) 0x7f588411f790 con 0x7f58841192c0 2026-02-17T21:23:40.657 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.641+0000 7f5888cbc640 10 monclient(hunting): _negotiate 2026-02-17T21:23:40.657 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.641+0000 7f5888cbc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:40.657 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.641+0000 7f5888cbc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:40.657 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.641+0000 7f5888cbc640 10 monclient(hunting): my global_id is 4123 2026-02-17T21:23:40.657 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.641+0000 7f5888cbc640 1 -- 10.20.193.176:0/2960472421 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f586c003620 con 0x7f58841192c0 2026-02-17T21:23:40.657 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.642+0000 7f588a4bf640 10 monclient(hunting): handle_auth_done global_id 4113 payload 274 2026-02-17T21:23:40.657 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.642+0000 7f588a4bf640 1 -- 10.20.193.176:0/2960472421 >> v2:10.20.193.135:3300/0 conn(0x7f58841123f0 msgr2=0x7f58841127d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:23:40.657 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.642+0000 7f588a4bf640 1 --2- 10.20.193.176:0/2960472421 >> v2:10.20.193.135:3300/0 conn(0x7f58841123f0 0x7f58841127d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.657 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.642+0000 7f588a4bf640 1 -- 10.20.193.176:0/2960472421 >> v1:10.20.193.119:6789/0 conn(0x7f58841192c0 legacy=0x7f588411b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:40.658 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.642+0000 7f588a4bf640 10 monclient: _finish_hunting 0 2026-02-17T21:23:40.658 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.642+0000 7f588a4bf640 1 monclient: found mon.noname-a 2026-02-17T21:23:40.658 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.642+0000 7f588a4bf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:40.658 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.642+0000 7f588a4bf640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:23:40.658 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.642+0000 7f588a4bf640 1 -- 10.20.193.176:0/2960472421 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5884120cc0 con 0x7f588411cdd0 2026-02-17T21:23:40.658 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.643+0000 7f588a4bf640 1 --2- 10.20.193.176:0/2960472421 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f588411cdd0 0x7f588411f1c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f58840751c0 tx=0x7f588002f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df253c7b0eba2395 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:40.658 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.645+0000 7f5888cbc640 1 -- 10.20.193.176:0/2960472421 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588003c070 con 0x7f588411cdd0 2026-02-17T21:23:40.658 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.645+0000 7f5888cbc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:40.658 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.645+0000 7f5888cbc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:23:40.658 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.645+0000 7f5888cbc640 10 monclient: dump: 2026-02-17T21:23:40.658 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:40.658 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:40.659 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:40.659 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:40.659 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:40.659 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:40.659 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:40.659 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:40.659 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:40.659 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:40.659 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.645+0000 7f5888cbc640 10 monclient: _finish_auth 0 2026-02-17T21:23:40.659 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.645+0000 7f5888cbc640 10 monclient: _check_auth_tickets 2026-02-17T21:23:40.659 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.645+0000 7f5888cbc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:40.659 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.645+0000 7f5888cbc640 1 -- 10.20.193.176:0/2960472421 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f588002fe40 con 0x7f588411cdd0 2026-02-17T21:23:40.660 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.645+0000 7f588bf49640 5 monclient: authenticate success, global_id 4113 2026-02-17T21:23:40.660 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.645+0000 7f588bf49640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:23:40.660 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.645+0000 7f5888cbc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:40.660 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.645+0000 7f5888cbc640 1 -- 10.20.193.176:0/2960472421 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5880037660 con 0x7f588411cdd0 2026-02-17T21:23:40.660 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.645+0000 7f588bf49640 10 monclient: get_monmap_and_config success 2026-02-17T21:23:40.660 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.645+0000 7f588bf49640 4 set_mon_vals no callback set 2026-02-17T21:23:40.660 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.645+0000 7f5888cbc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:40.660 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.645+0000 7f5888cbc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:23:40.660 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.645+0000 7f5888cbc640 10 monclient: dump: 2026-02-17T21:23:40.660 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:40.660 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:40.660 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:40.660 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:40.661 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:40.661 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:40.661 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:40.661 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:40.661 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:40.661 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:40.661 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 10 monclient: shutdown 2026-02-17T21:23:40.661 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:40.661 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 1 -- 10.20.193.176:0/2960472421 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f588411cdd0 msgr2=0x7f588411f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:40.661 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 1 --2- 10.20.193.176:0/2960472421 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f588411cdd0 0x7f588411f1c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f58840751c0 tx=0x7f588002f130 comp rx=0 tx=0).stop 2026-02-17T21:23:40.661 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 1 -- 10.20.193.176:0/2960472421 shutdown_connections 2026-02-17T21:23:40.661 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 1 --2- 10.20.193.176:0/2960472421 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f588411cdd0 0x7f588411f1c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.662 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 1 --2- 10.20.193.176:0/2960472421 >> v2:10.20.193.135:3300/0 conn(0x7f58841123f0 0x7f58841127d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.662 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 1 -- 10.20.193.176:0/2960472421 >> 10.20.193.176:0/2960472421 conn(0x7f588406f660 msgr2=0x7f5884071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:40.662 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 1 -- 10.20.193.176:0/2960472421 shutdown_connections 2026-02-17T21:23:40.662 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 1 -- 10.20.193.176:0/2960472421 wait complete. 2026-02-17T21:23:40.662 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 10 monclient: build_initial_monmap 2026-02-17T21:23:40.662 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 10 monclient: monmap: 2026-02-17T21:23:40.662 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:40.662 INFO:teuthology.orchestra.run.trial176.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:23:40.662 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 0.000000 2026-02-17T21:23:40.662 INFO:teuthology.orchestra.run.trial176.stderr:created 0.000000 2026-02-17T21:23:40.662 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:40.662 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:40.662 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:23:40.663 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:23:40.663 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:23:40.663 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:40.663 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 1 librados: starting msgr at 2026-02-17T21:23:40.663 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 1 librados: starting objecter 2026-02-17T21:23:40.663 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 1 Processor -- start 2026-02-17T21:23:40.663 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 1 -- start start 2026-02-17T21:23:40.663 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 1 librados: setting wanted keys 2026-02-17T21:23:40.663 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 1 librados: calling monclient init 2026-02-17T21:23:40.663 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 10 monclient: init 2026-02-17T21:23:40.663 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:40.663 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:23:40.664 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f58841123f0 0x7f58841b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:40.664 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 10 monclient(hunting): picked mon.noname-b con 0x7f58841123f0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:23:40.664 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f58841192c0 0x7f58841b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:40.664 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 10 monclient(hunting): picked mon.noname-c con 0x7f58841192c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:23:40.664 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f588411cdd0 0x7f58841ab3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:40.664 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 10 monclient(hunting): picked mon.noname-a con 0x7f588411cdd0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:23:40.664 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:40.664 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f588411fe20 con 0x7f588411cdd0 2026-02-17T21:23:40.664 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:40.664 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f588411fca0 con 0x7f58841123f0 2026-02-17T21:23:40.664 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:40.664 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f588411ffa0 con 0x7f58841192c0 2026-02-17T21:23:40.665 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:40.665 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.646+0000 7f588bf49640 10 monclient(hunting): authenticate will time out at 959.289817s 2026-02-17T21:23:40.665 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f58894bd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f58841192c0 0x7f58841b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:40.665 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f588a4bf640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f588411cdd0 0x7f58841ab3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:40.665 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f5889cbe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f58841123f0 0x7f58841b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:40.665 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f58894bd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f58841192c0 0x7f58841b19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.176:59568/0 (socket says 10.20.193.176:59568) 2026-02-17T21:23:40.665 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f58894bd640 1 -- 10.20.193.176:0/970557784 learned_addr learned my addr 10.20.193.176:0/970557784 (peer_addr_for_me v2:10.20.193.176:0/0) 2026-02-17T21:23:40.665 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f58894bd640 10 monclient(hunting): get_auth_request con 0x7f58841192c0 auth_method 0 2026-02-17T21:23:40.665 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f58894bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:40.665 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f58894bd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:40.665 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f58894bd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:40.665 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f588a4bf640 10 monclient(hunting): get_auth_request con 0x7f588411cdd0 auth_method 0 2026-02-17T21:23:40.666 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f588a4bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:40.666 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f588a4bf640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:40.666 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f588a4bf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:40.666 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f5889cbe640 10 monclient(hunting): get_auth_request con 0x7f58841123f0 auth_method 0 2026-02-17T21:23:40.666 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f5889cbe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:40.666 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f5889cbe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:40.666 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f5889cbe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:40.666 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f588a4bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:40.666 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f588a4bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:40.666 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f588a4bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:40.666 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f58894bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:40.666 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f58894bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:40.666 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f58894bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:40.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f5889cbe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:40.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f5889cbe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:40.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.647+0000 7f5889cbe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:40.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.648+0000 7f588a4bf640 10 monclient(hunting): handle_auth_done global_id 4116 payload 824 2026-02-17T21:23:40.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.648+0000 7f588a4bf640 1 -- 10.20.193.176:0/970557784 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f58841192c0 msgr2=0x7f58841b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:40.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.648+0000 7f588a4bf640 1 --2- 10.20.193.176:0/970557784 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f58841192c0 0x7f58841b19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.648+0000 7f588a4bf640 1 -- 10.20.193.176:0/970557784 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f58841123f0 msgr2=0x7f58841b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:40.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.648+0000 7f588a4bf640 1 --2- 10.20.193.176:0/970557784 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f58841123f0 0x7f58841b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.648+0000 7f588a4bf640 10 monclient: _finish_hunting 0 2026-02-17T21:23:40.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.648+0000 7f588a4bf640 1 monclient: found mon.noname-a 2026-02-17T21:23:40.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.648+0000 7f588a4bf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:40.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.648+0000 7f588a4bf640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:23:40.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.648+0000 7f588a4bf640 1 -- 10.20.193.176:0/970557784 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58841abcb0 con 0x7f588411cdd0 2026-02-17T21:23:40.668 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.649+0000 7f588a4bf640 1 --2- 10.20.193.176:0/970557784 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f588411cdd0 0x7f58841ab3f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5880036000 tx=0x7f5880004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:40.668 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.649+0000 7f58727fc640 10 client.?.objecter ms_handle_connect 0x7f588411cdd0 2026-02-17T21:23:40.668 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.649+0000 7f58727fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:23:40.668 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.651+0000 7f58727fc640 1 -- 10.20.193.176:0/970557784 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5880047030 con 0x7f588411cdd0 2026-02-17T21:23:40.668 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.651+0000 7f58727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:40.668 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.651+0000 7f58727fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:23:40.668 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.651+0000 7f58727fc640 10 monclient: dump: 2026-02-17T21:23:40.668 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:40.668 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:40.668 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:40.668 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:40.668 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:40.668 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:40.669 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:40.669 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:40.669 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:40.669 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:40.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.651+0000 7f58727fc640 10 monclient: _finish_auth 0 2026-02-17T21:23:40.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.651+0000 7f58727fc640 10 monclient: _check_auth_tickets 2026-02-17T21:23:40.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.651+0000 7f58727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:40.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.651+0000 7f58727fc640 1 -- 10.20.193.176:0/970557784 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f588002fc40 con 0x7f588411cdd0 2026-02-17T21:23:40.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.651+0000 7f58727fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:40.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.651+0000 7f58727fc640 1 -- 10.20.193.176:0/970557784 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588003c040 con 0x7f588411cdd0 2026-02-17T21:23:40.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.651+0000 7f58727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:40.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.651+0000 7f58727fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:23:40.670 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.651+0000 7f58727fc640 10 monclient: dump: 2026-02-17T21:23:40.670 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:40.670 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:40.670 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:40.670 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:40.670 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:40.670 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:40.670 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:40.670 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:40.670 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:40.670 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:40.670 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.651+0000 7f588bf49640 5 monclient: authenticate success, global_id 4116 2026-02-17T21:23:40.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.651+0000 7f5873fff640 4 set_mon_vals no callback set 2026-02-17T21:23:40.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.651+0000 7f588bf49640 10 monclient: _renew_subs 2026-02-17T21:23:40.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.651+0000 7f588bf49640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:23:40.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.651+0000 7f588bf49640 1 -- 10.20.193.176:0/970557784 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58841abee0 con 0x7f588411cdd0 2026-02-17T21:23:40.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.651+0000 7f588bf49640 10 client.4116.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:23:40.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.651+0000 7f588bf49640 10 monclient: _renew_subs 2026-02-17T21:23:40.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.651+0000 7f588bf49640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:23:40.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.651+0000 7f588bf49640 1 -- 10.20.193.176:0/970557784 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58841b80f0 con 0x7f588411cdd0 2026-02-17T21:23:40.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.651+0000 7f588bf49640 1 librados: init done 2026-02-17T21:23:40.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.652+0000 7f588bf49640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:40.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.652+0000 7f588bf49640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:40.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.652+0000 7f588bf49640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:23:40.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.652+0000 7f588bf49640 1 -- 10.20.193.176:0/970557784 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58841127d0 con 0x7f588411cdd0 2026-02-17T21:23:40.673 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.654+0000 7f58727fc640 1 -- 10.20.193.176:0/970557784 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f58800426b0 con 0x7f588411cdd0 2026-02-17T21:23:40.673 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.654+0000 7f58727fc640 1 -- 10.20.193.176:0/970557784 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f58800439c0 con 0x7f588411cdd0 2026-02-17T21:23:40.673 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.654+0000 7f58727fc640 10 client.4116.objecter ms_dispatch2 0x7f5884000b90 osd_map(3..3 src has 1..3) 2026-02-17T21:23:40.673 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.654+0000 7f58727fc640 3 client.4116.objecter handle_osd_map got epochs [3,3] > 0 2026-02-17T21:23:40.673 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.654+0000 7f58727fc640 3 client.4116.objecter handle_osd_map decoding full epoch 3 2026-02-17T21:23:40.673 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.654+0000 7f58727fc640 20 client.4116.objecter dump_active .. 0 homeless 2026-02-17T21:23:40.706 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.702+0000 7f58727fc640 1 -- 10.20.193.176:0/970557784 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f5880051070 con 0x7f588411cdd0 2026-02-17T21:23:40.706 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.702+0000 7f58727fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:40.707 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.702+0000 7f58727fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:23:40.739 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.735+0000 7f588bf49640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "8ffdf919-2ec4-4c1f-a69f-aee5cea211e0", "id": 1}] 2026-02-17T21:23:40.739 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.735+0000 7f588bf49640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "8ffdf919-2ec4-4c1f-a69f-aee5cea211e0", "id": 1}] 2026-02-17T21:23:40.739 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.735+0000 7f588bf49640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:23:40.739 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.735+0000 7f588bf49640 1 -- 10.20.193.176:0/970557784 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8ffdf919-2ec4-4c1f-a69f-aee5cea211e0", "id": 1} v 0) -- 0x7f588406fbf0 con 0x7f588411cdd0 2026-02-17T21:23:40.760 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.756+0000 7f58727fc640 1 -- 10.20.193.176:0/970557784 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8ffdf919-2ec4-4c1f-a69f-aee5cea211e0", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f5880043420 con 0x7f588411cdd0 2026-02-17T21:23:40.760 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.756+0000 7f58727fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "8ffdf919-2ec4-4c1f-a69f-aee5cea211e0", "id": 1}] 2026-02-17T21:23:40.760 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.756+0000 7f58727fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:23:40.761 INFO:teuthology.orchestra.run.trial176.stdout:1 2026-02-17T21:23:40.762 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.757+0000 7f588bf49640 10 librados: watch_flush enter 2026-02-17T21:23:40.762 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.757+0000 7f588bf49640 10 librados: watch_flush exit 2026-02-17T21:23:40.762 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.757+0000 7f588bf49640 20 client.4116.objecter shutdown clearing up homeless session... 2026-02-17T21:23:40.762 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.757+0000 7f588bf49640 10 client.4116.objecter successfully canceled tick 2026-02-17T21:23:40.762 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.757+0000 7f588bf49640 10 monclient: shutdown 2026-02-17T21:23:40.762 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.757+0000 7f588bf49640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:40.763 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.757+0000 7f588bf49640 1 -- 10.20.193.176:0/970557784 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f588411cdd0 msgr2=0x7f58841ab3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:40.763 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.757+0000 7f588bf49640 1 --2- 10.20.193.176:0/970557784 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f588411cdd0 0x7f58841ab3f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5880036000 tx=0x7f5880004b40 comp rx=0 tx=0).stop 2026-02-17T21:23:40.763 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.757+0000 7f588bf49640 1 -- 10.20.193.176:0/970557784 shutdown_connections 2026-02-17T21:23:40.763 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.757+0000 7f588bf49640 1 --2- 10.20.193.176:0/970557784 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f588411cdd0 0x7f58841ab3f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.763 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.757+0000 7f588bf49640 1 --2- 10.20.193.176:0/970557784 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f58841192c0 0x7f58841b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.763 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.757+0000 7f588bf49640 1 --2- 10.20.193.176:0/970557784 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f58841123f0 0x7f58841b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.763 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.757+0000 7f588bf49640 1 -- 10.20.193.176:0/970557784 >> 10.20.193.176:0/970557784 conn(0x7f588406f660 msgr2=0x7f5884073ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:40.763 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.757+0000 7f588bf49640 1 -- 10.20.193.176:0/970557784 shutdown_connections 2026-02-17T21:23:40.763 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.757+0000 7f588bf49640 1 -- 10.20.193.176:0/970557784 wait complete. 2026-02-17T21:23:40.763 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.757+0000 7f588bf49640 1 librados: shutdown 2026-02-17T21:23:40.769 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph --cluster ceph osd new d186244a-4bf7-416d-b6a0-0e0f5af50eb2 2 2026-02-17T21:23:40.839 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.831+0000 7f2dd23bc640 10 monclient: get_monmap_and_config 2026-02-17T21:23:40.839 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.831+0000 7f2dd23bc640 10 monclient: build_initial_monmap 2026-02-17T21:23:40.839 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.832+0000 7f2dd23bc640 10 monclient: monmap: 2026-02-17T21:23:40.840 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:40.840 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:40.840 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:23:40.833641+0000 2026-02-17T21:23:40.840 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:23:40.833641+0000 2026-02-17T21:23:40.840 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:40.840 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:40.840 INFO:teuthology.orchestra.run.trial176.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:23:40.840 INFO:teuthology.orchestra.run.trial176.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:23:40.840 INFO:teuthology.orchestra.run.trial176.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:23:40.840 INFO:teuthology.orchestra.run.trial176.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:23:40.840 INFO:teuthology.orchestra.run.trial176.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:23:40.840 INFO:teuthology.orchestra.run.trial176.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:23:40.841 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:40.841 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.832+0000 7f2dd23bc640 1 Processor -- start 2026-02-17T21:23:40.841 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.832+0000 7f2dd23bc640 1 -- start start 2026-02-17T21:23:40.841 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.832+0000 7f2dd23bc640 10 monclient: init 2026-02-17T21:23:40.841 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.832+0000 7f2dd23bc640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:40.841 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.832+0000 7f2dd23bc640 10 monclient: _add_conns ranks=[4,3,2,5,0,1] 2026-02-17T21:23:40.841 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.832+0000 7f2dd23bc640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f2dcc073830 0x7f2dcc073c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:40.841 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.832+0000 7f2dd23bc640 10 monclient(hunting): picked mon.noname-b con 0x7f2dcc073830 addr v2:10.20.193.119:3300/0 2026-02-17T21:23:40.841 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.832+0000 7f2dd23bc640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f2dcc074150 0x7f2dcc11c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:40.841 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.832+0000 7f2dd23bc640 10 monclient(hunting): picked mon.noname-a con 0x7f2dcc074150 addr v2:10.20.193.5:3300/0 2026-02-17T21:23:40.841 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.832+0000 7f2dd23bc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2dcc11cb30 addr v1:10.20.193.135:6789/0 2026-02-17T21:23:40.842 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.832+0000 7f2dd23bc640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dcc1208f0 con 0x7f2dcc11cb30 2026-02-17T21:23:40.842 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.832+0000 7f2dd23bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:40.842 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.832+0000 7f2dd23bc640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2dcc121b10 con 0x7f2dcc074150 2026-02-17T21:23:40.842 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.832+0000 7f2dd23bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:40.842 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.832+0000 7f2dd23bc640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f2dcc121c90 con 0x7f2dcc073830 2026-02-17T21:23:40.842 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.832+0000 7f2dd23bc640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:40.842 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.832+0000 7f2dd23bc640 10 monclient(hunting): authenticate will time out at 959.475525s 2026-02-17T21:23:40.842 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.832+0000 7f2dd0932640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f2dcc11cb30 0x7f2dcc11eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.176:40228/0 (socket says 10.20.193.176:40228) 2026-02-17T21:23:40.842 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.832+0000 7f2dd0932640 1 -- 10.20.193.176:0/3949199684 learned_addr learned my addr 10.20.193.176:0/3949199684 (peer_addr_for_me v1:10.20.193.176:0/0) 2026-02-17T21:23:40.842 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.832+0000 7f2dcbfff640 1 --2- 10.20.193.176:0/3949199684 >> v2:10.20.193.119:3300/0 conn(0x7f2dcc073830 0x7f2dcc073c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:40.842 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.833+0000 7f2dcb7fe640 1 --2- 10.20.193.176:0/3949199684 >> v2:10.20.193.5:3300/0 conn(0x7f2dcc074150 0x7f2dcc11c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:40.842 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.833+0000 7f2dcbfff640 10 monclient(hunting): get_auth_request con 0x7f2dcc073830 auth_method 0 2026-02-17T21:23:40.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.833+0000 7f2dcbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:40.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.833+0000 7f2dcbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:40.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.833+0000 7f2dcbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:40.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.833+0000 7f2dcb7fe640 10 monclient(hunting): get_auth_request con 0x7f2dcc074150 auth_method 0 2026-02-17T21:23:40.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.833+0000 7f2dcb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:40.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.833+0000 7f2dcb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:40.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.833+0000 7f2dcb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:40.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.833+0000 7f2dcbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:40.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.833+0000 7f2dcbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:40.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.833+0000 7f2dcbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:40.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.833+0000 7f2dcb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:40.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.833+0000 7f2dcb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:40.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.833+0000 7f2dcb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:40.844 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.834+0000 7f2dcaffd640 1 -- 10.20.193.176:0/3949199684 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2439239026 0 0) 0x7f2dcc1208f0 con 0x7f2dcc11cb30 2026-02-17T21:23:40.844 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.834+0000 7f2dcaffd640 10 monclient(hunting): _negotiate 2026-02-17T21:23:40.844 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.834+0000 7f2dcaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:40.844 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.834+0000 7f2dcaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:40.844 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.834+0000 7f2dcaffd640 10 monclient(hunting): my global_id is 4121 2026-02-17T21:23:40.844 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.834+0000 7f2dcaffd640 1 -- 10.20.193.176:0/3949199684 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2db0003620 con 0x7f2dcc11cb30 2026-02-17T21:23:40.844 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.834+0000 7f2dcbfff640 10 monclient(hunting): handle_auth_done global_id 4129 payload 274 2026-02-17T21:23:40.844 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.834+0000 7f2dcbfff640 1 -- 10.20.193.176:0/3949199684 >> v2:10.20.193.5:3300/0 conn(0x7f2dcc074150 msgr2=0x7f2dcc11c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:23:40.844 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.834+0000 7f2dcbfff640 1 --2- 10.20.193.176:0/3949199684 >> v2:10.20.193.5:3300/0 conn(0x7f2dcc074150 0x7f2dcc11c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.844 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.834+0000 7f2dcbfff640 1 -- 10.20.193.176:0/3949199684 >> v1:10.20.193.135:6789/0 conn(0x7f2dcc11cb30 legacy=0x7f2dcc11eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:40.844 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.834+0000 7f2dcbfff640 10 monclient: _finish_hunting 0 2026-02-17T21:23:40.844 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.834+0000 7f2dcbfff640 1 monclient: found mon.noname-b 2026-02-17T21:23:40.845 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.834+0000 7f2dcbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:40.845 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.834+0000 7f2dcbfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:23:40.845 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.834+0000 7f2dcbfff640 1 -- 10.20.193.176:0/3949199684 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dcc121e40 con 0x7f2dcc073830 2026-02-17T21:23:40.845 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.835+0000 7f2dcbfff640 1 --2- 10.20.193.176:0/3949199684 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2dcc073830 0x7f2dcc073c10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc076ab0 tx=0x7f2db802ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be0a7bf24c77bbb9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:40.851 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.836+0000 7f2dcaffd640 1 -- 10.20.193.176:0/3949199684 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db803c070 con 0x7f2dcc073830 2026-02-17T21:23:40.852 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.836+0000 7f2dcaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:40.852 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.836+0000 7f2dcaffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:23:40.852 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.836+0000 7f2dcaffd640 10 monclient: dump: 2026-02-17T21:23:40.852 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:40.852 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:40.852 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:40.852 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:40.852 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:40.852 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:40.852 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:40.853 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:40.853 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:40.853 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:40.853 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.836+0000 7f2dcaffd640 10 monclient: _finish_auth 0 2026-02-17T21:23:40.853 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.836+0000 7f2dcaffd640 10 monclient: _check_auth_tickets 2026-02-17T21:23:40.853 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.836+0000 7f2dcaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:40.853 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.836+0000 7f2dd23bc640 5 monclient: authenticate success, global_id 4129 2026-02-17T21:23:40.853 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.836+0000 7f2dd23bc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:23:40.853 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.836+0000 7f2dcaffd640 1 -- 10.20.193.176:0/3949199684 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db802fa60 con 0x7f2dcc073830 2026-02-17T21:23:40.853 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.836+0000 7f2dcaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:40.853 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.836+0000 7f2dcaffd640 1 -- 10.20.193.176:0/3949199684 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db802fe10 con 0x7f2dcc073830 2026-02-17T21:23:40.853 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.836+0000 7f2dd23bc640 10 monclient: get_monmap_and_config success 2026-02-17T21:23:40.854 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.836+0000 7f2dd23bc640 4 set_mon_vals no callback set 2026-02-17T21:23:40.854 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.836+0000 7f2dcaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:40.854 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.836+0000 7f2dcaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:23:40.854 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.836+0000 7f2dcaffd640 10 monclient: dump: 2026-02-17T21:23:40.854 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:40.854 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:40.854 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:40.854 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:40.854 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:40.854 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:40.854 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:40.854 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:40.855 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:40.855 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:40.855 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 10 monclient: shutdown 2026-02-17T21:23:40.855 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:40.855 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 1 -- 10.20.193.176:0/3949199684 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2dcc073830 msgr2=0x7f2dcc073c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:40.855 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 1 --2- 10.20.193.176:0/3949199684 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2dcc073830 0x7f2dcc073c10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc076ab0 tx=0x7f2db802ed50 comp rx=0 tx=0).stop 2026-02-17T21:23:40.855 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 1 -- 10.20.193.176:0/3949199684 shutdown_connections 2026-02-17T21:23:40.855 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 1 --2- 10.20.193.176:0/3949199684 >> v2:10.20.193.5:3300/0 conn(0x7f2dcc074150 0x7f2dcc11c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.855 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 1 --2- 10.20.193.176:0/3949199684 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2dcc073830 0x7f2dcc073c10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.855 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 1 -- 10.20.193.176:0/3949199684 >> 10.20.193.176:0/3949199684 conn(0x7f2dcc06f660 msgr2=0x7f2dcc071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:40.855 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 1 -- 10.20.193.176:0/3949199684 shutdown_connections 2026-02-17T21:23:40.855 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 1 -- 10.20.193.176:0/3949199684 wait complete. 2026-02-17T21:23:40.856 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 10 monclient: build_initial_monmap 2026-02-17T21:23:40.856 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 10 monclient: monmap: 2026-02-17T21:23:40.856 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:40.856 INFO:teuthology.orchestra.run.trial176.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:23:40.856 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 0.000000 2026-02-17T21:23:40.856 INFO:teuthology.orchestra.run.trial176.stderr:created 0.000000 2026-02-17T21:23:40.856 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:40.856 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:40.856 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:23:40.856 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:23:40.856 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:23:40.856 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:40.857 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 1 librados: starting msgr at 2026-02-17T21:23:40.857 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 1 librados: starting objecter 2026-02-17T21:23:40.857 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 1 Processor -- start 2026-02-17T21:23:40.857 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 1 -- start start 2026-02-17T21:23:40.857 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 1 librados: setting wanted keys 2026-02-17T21:23:40.857 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 1 librados: calling monclient init 2026-02-17T21:23:40.857 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 10 monclient: init 2026-02-17T21:23:40.857 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:40.857 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:23:40.857 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2dcc073830 0x7f2dcc1b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:40.857 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 10 monclient(hunting): picked mon.noname-c con 0x7f2dcc073830 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:23:40.857 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2dcc074150 0x7f2dcc1b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:40.857 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 10 monclient(hunting): picked mon.noname-b con 0x7f2dcc074150 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:23:40.858 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2dcc11cb30 0x7f2dcc1ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:40.858 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 10 monclient(hunting): picked mon.noname-a con 0x7f2dcc11cb30 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:23:40.858 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:40.858 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2dcc120f80 con 0x7f2dcc11cb30 2026-02-17T21:23:40.858 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:40.858 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2dcc120e00 con 0x7f2dcc074150 2026-02-17T21:23:40.858 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:40.858 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2dcc121100 con 0x7f2dcc073830 2026-02-17T21:23:40.858 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:40.858 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.837+0000 7f2dd23bc640 10 monclient(hunting): authenticate will time out at 959.480977s 2026-02-17T21:23:40.858 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.838+0000 7f2dcbfff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2dcc073830 0x7f2dcc1b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:40.858 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.838+0000 7f2dd0932640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2dcc11cb30 0x7f2dcc1ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:40.859 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.838+0000 7f2dcbfff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2dcc073830 0x7f2dcc1b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.176:59578/0 (socket says 10.20.193.176:59578) 2026-02-17T21:23:40.859 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.838+0000 7f2dcbfff640 1 -- 10.20.193.176:0/804291556 learned_addr learned my addr 10.20.193.176:0/804291556 (peer_addr_for_me v2:10.20.193.176:0/0) 2026-02-17T21:23:40.859 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.838+0000 7f2dcbfff640 10 monclient(hunting): get_auth_request con 0x7f2dcc073830 auth_method 0 2026-02-17T21:23:40.859 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.838+0000 7f2dcbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:40.859 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.838+0000 7f2dcbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:40.859 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.838+0000 7f2dcbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:40.859 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.838+0000 7f2dd0932640 10 monclient(hunting): get_auth_request con 0x7f2dcc11cb30 auth_method 0 2026-02-17T21:23:40.859 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.838+0000 7f2dd0932640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:40.859 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.838+0000 7f2dd0932640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:40.859 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.838+0000 7f2dd0932640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:40.859 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.838+0000 7f2dcbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:40.859 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.838+0000 7f2dcbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:40.859 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.838+0000 7f2dcbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:40.860 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.838+0000 7f2dcb7fe640 1 --2- 10.20.193.176:0/804291556 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2dcc074150 0x7f2dcc1b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:40.860 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.838+0000 7f2dd0932640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:40.860 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.838+0000 7f2dd0932640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:40.860 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.838+0000 7f2dd0932640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:40.860 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.839+0000 7f2dcb7fe640 10 monclient(hunting): get_auth_request con 0x7f2dcc074150 auth_method 0 2026-02-17T21:23:40.860 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.839+0000 7f2dcb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:40.860 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.839+0000 7f2dcb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:40.860 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.839+0000 7f2dcb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:40.860 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.839+0000 7f2dcb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:40.860 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.839+0000 7f2dcb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:40.860 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.839+0000 7f2dcb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:40.860 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.840+0000 7f2dcbfff640 10 monclient(hunting): handle_auth_done global_id 4124 payload 824 2026-02-17T21:23:40.860 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.840+0000 7f2dcbfff640 1 -- 10.20.193.176:0/804291556 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2dcc074150 msgr2=0x7f2dcc1b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:40.861 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.840+0000 7f2dcbfff640 1 --2- 10.20.193.176:0/804291556 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2dcc074150 0x7f2dcc1b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.861 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.840+0000 7f2dcbfff640 1 -- 10.20.193.176:0/804291556 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2dcc11cb30 msgr2=0x7f2dcc1ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:40.861 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.840+0000 7f2dcbfff640 1 --2- 10.20.193.176:0/804291556 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2dcc11cb30 0x7f2dcc1ab2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.861 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.840+0000 7f2dcbfff640 10 monclient: _finish_hunting 0 2026-02-17T21:23:40.861 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.840+0000 7f2dcbfff640 1 monclient: found mon.noname-c 2026-02-17T21:23:40.861 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.840+0000 7f2dcbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:40.861 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.840+0000 7f2dcbfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:23:40.861 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.840+0000 7f2dcbfff640 1 -- 10.20.193.176:0/804291556 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dcc1abb70 con 0x7f2dcc073830 2026-02-17T21:23:40.861 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.841+0000 7f2dcbfff640 1 --2- 10.20.193.176:0/804291556 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2dcc073830 0x7f2dcc1b1200 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2db803a040 tx=0x7f2db80047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:40.861 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.841+0000 7f2dc8ff9640 10 client.?.objecter ms_handle_connect 0x7f2dcc073830 2026-02-17T21:23:40.861 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.841+0000 7f2dc8ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:23:40.861 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dc8ff9640 1 -- 10.20.193.176:0/804291556 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db803c040 con 0x7f2dcc073830 2026-02-17T21:23:40.862 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dc8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:40.862 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dc8ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:23:40.862 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dc8ff9640 10 monclient: dump: 2026-02-17T21:23:40.862 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:40.862 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:40.862 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:40.862 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:40.862 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:40.862 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:40.862 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:40.862 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:40.862 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:40.862 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:40.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dc8ff9640 10 monclient: _finish_auth 0 2026-02-17T21:23:40.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dc8ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:23:40.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dc8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:40.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dd23bc640 5 monclient: authenticate success, global_id 4124 2026-02-17T21:23:40.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dd23bc640 10 monclient: _renew_subs 2026-02-17T21:23:40.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dd23bc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:40.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dd23bc640 1 -- 10.20.193.176:0/804291556 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dcc1abda0 con 0x7f2dcc073830 2026-02-17T21:23:40.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dd23bc640 10 client.4124.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:23:40.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dd23bc640 10 monclient: _renew_subs 2026-02-17T21:23:40.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dd23bc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:40.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dd23bc640 1 -- 10.20.193.176:0/804291556 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dcc1b8190 con 0x7f2dcc073830 2026-02-17T21:23:40.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dd23bc640 1 librados: init done 2026-02-17T21:23:40.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dc8ff9640 1 -- 10.20.193.176:0/804291556 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db8003910 con 0x7f2dcc073830 2026-02-17T21:23:40.864 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dc8ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:40.864 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dc8ff9640 1 -- 10.20.193.176:0/804291556 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db8003cc0 con 0x7f2dcc073830 2026-02-17T21:23:40.864 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dc8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:40.864 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dc8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:23:40.864 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dca7fc640 4 set_mon_vals no callback set 2026-02-17T21:23:40.864 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dc8ff9640 10 monclient: dump: 2026-02-17T21:23:40.864 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:40.864 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:40.864 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:40.864 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:40.864 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:40.864 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:40.864 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:40.865 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:40.865 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:40.865 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:40.865 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dd23bc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:40.865 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dd23bc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:40.865 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dd23bc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:40.865 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.842+0000 7f2dd23bc640 1 -- 10.20.193.176:0/804291556 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dcc073c10 con 0x7f2dcc073830 2026-02-17T21:23:40.865 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.844+0000 7f2dc8ff9640 1 -- 10.20.193.176:0/804291556 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f2db802f9f0 con 0x7f2dcc073830 2026-02-17T21:23:40.865 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.844+0000 7f2dc8ff9640 1 -- 10.20.193.176:0/804291556 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f2db8042430 con 0x7f2dcc073830 2026-02-17T21:23:40.865 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.844+0000 7f2dc8ff9640 10 client.4124.objecter ms_dispatch2 0x7f2dcc000b90 osd_map(4..4 src has 1..4) 2026-02-17T21:23:40.865 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.844+0000 7f2dc8ff9640 3 client.4124.objecter handle_osd_map got epochs [4,4] > 0 2026-02-17T21:23:40.866 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.844+0000 7f2dc8ff9640 3 client.4124.objecter handle_osd_map decoding full epoch 4 2026-02-17T21:23:40.866 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.844+0000 7f2dc8ff9640 20 client.4124.objecter dump_active .. 0 homeless 2026-02-17T21:23:40.874 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:40.870+0000 7fb01f20f140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T21:23:40.887 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.883+0000 7f2dc8ff9640 1 -- 10.20.193.176:0/804291556 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f2db80374e0 con 0x7f2dcc073830 2026-02-17T21:23:40.887 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.883+0000 7f2dc8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:40.887 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.883+0000 7f2dc8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:23:40.889 INFO:tasks.ceph.mgr.y.trial005.stderr:2026-02-17T21:23:40.888+0000 7fedb15dc140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T21:23:40.896 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:40.893+0000 7fb01f20f140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T21:23:40.911 INFO:tasks.ceph.mgr.y.trial005.stderr:2026-02-17T21:23:40.910+0000 7fedb15dc140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T21:23:40.919 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.915+0000 7f2dd23bc640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "d186244a-4bf7-416d-b6a0-0e0f5af50eb2", "id": 2}] 2026-02-17T21:23:40.920 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.915+0000 7f2dd23bc640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "d186244a-4bf7-416d-b6a0-0e0f5af50eb2", "id": 2}] 2026-02-17T21:23:40.920 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.915+0000 7f2dd23bc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:40.920 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.915+0000 7f2dd23bc640 1 -- 10.20.193.176:0/804291556 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d186244a-4bf7-416d-b6a0-0e0f5af50eb2", "id": 2} v 0) -- 0x7f2dcc1b8360 con 0x7f2dcc073830 2026-02-17T21:23:40.958 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.954+0000 7f2dc8ff9640 1 -- 10.20.193.176:0/804291556 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d186244a-4bf7-416d-b6a0-0e0f5af50eb2", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f2db8037b20 con 0x7f2dcc073830 2026-02-17T21:23:40.958 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.954+0000 7f2dc8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "d186244a-4bf7-416d-b6a0-0e0f5af50eb2", "id": 2}] 2026-02-17T21:23:40.958 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.954+0000 7f2dc8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:23:40.958 INFO:teuthology.orchestra.run.trial176.stdout:2 2026-02-17T21:23:40.960 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.954+0000 7f2dd23bc640 10 librados: watch_flush enter 2026-02-17T21:23:40.960 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.954+0000 7f2dd23bc640 10 librados: watch_flush exit 2026-02-17T21:23:40.960 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.954+0000 7f2dd23bc640 20 client.4124.objecter shutdown clearing up homeless session... 2026-02-17T21:23:40.960 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.954+0000 7f2dd23bc640 10 client.4124.objecter successfully canceled tick 2026-02-17T21:23:40.960 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.954+0000 7f2dd23bc640 10 monclient: shutdown 2026-02-17T21:23:40.960 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.954+0000 7f2dd23bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:40.960 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.954+0000 7f2dd23bc640 1 -- 10.20.193.176:0/804291556 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2dcc073830 msgr2=0x7f2dcc1b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:40.960 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.954+0000 7f2dd23bc640 1 --2- 10.20.193.176:0/804291556 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2dcc073830 0x7f2dcc1b1200 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2db803a040 tx=0x7f2db80047c0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.960 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.954+0000 7f2dd23bc640 1 -- 10.20.193.176:0/804291556 shutdown_connections 2026-02-17T21:23:40.960 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.954+0000 7f2dd23bc640 1 --2- 10.20.193.176:0/804291556 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2dcc11cb30 0x7f2dcc1ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.960 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.954+0000 7f2dd23bc640 1 --2- 10.20.193.176:0/804291556 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2dcc074150 0x7f2dcc1b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.961 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.954+0000 7f2dd23bc640 1 --2- 10.20.193.176:0/804291556 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2dcc073830 0x7f2dcc1b1200 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:40.961 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.954+0000 7f2dd23bc640 1 -- 10.20.193.176:0/804291556 >> 10.20.193.176:0/804291556 conn(0x7f2dcc06f660 msgr2=0x7f2dcc072300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:40.961 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.954+0000 7f2dd23bc640 1 -- 10.20.193.176:0/804291556 shutdown_connections 2026-02-17T21:23:40.961 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.954+0000 7f2dd23bc640 1 -- 10.20.193.176:0/804291556 wait complete. 2026-02-17T21:23:40.961 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:40.954+0000 7f2dd23bc640 1 librados: shutdown 2026-02-17T21:23:40.966 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph --cluster ceph osd new 093b417e-53bf-4b60-a937-7c5ffee43e1e 3 2026-02-17T21:23:41.031 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.027+0000 7f483ac2f640 10 monclient: get_monmap_and_config 2026-02-17T21:23:41.032 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.027+0000 7f483ac2f640 10 monclient: build_initial_monmap 2026-02-17T21:23:41.032 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.027+0000 7f483ac2f640 10 monclient: monmap: 2026-02-17T21:23:41.032 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:41.032 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:41.032 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:23:41.029599+0000 2026-02-17T21:23:41.032 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:23:41.029599+0000 2026-02-17T21:23:41.032 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:41.032 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:41.032 INFO:teuthology.orchestra.run.trial176.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:23:41.033 INFO:teuthology.orchestra.run.trial176.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:23:41.033 INFO:teuthology.orchestra.run.trial176.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:23:41.033 INFO:teuthology.orchestra.run.trial176.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:23:41.033 INFO:teuthology.orchestra.run.trial176.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:23:41.033 INFO:teuthology.orchestra.run.trial176.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:23:41.033 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:41.036 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.028+0000 7f483ac2f640 1 Processor -- start 2026-02-17T21:23:41.036 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.028+0000 7f483ac2f640 1 -- start start 2026-02-17T21:23:41.036 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.028+0000 7f483ac2f640 10 monclient: init 2026-02-17T21:23:41.036 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.028+0000 7f483ac2f640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:41.037 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.028+0000 7f483ac2f640 10 monclient: _add_conns ranks=[1,4,0,5,2,3] 2026-02-17T21:23:41.037 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.028+0000 7f483ac2f640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f48341123f0 addr v1:10.20.193.119:6789/0 2026-02-17T21:23:41.037 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.028+0000 7f483ac2f640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f483411a340 0x7f483411c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:41.037 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.028+0000 7f483ac2f640 10 monclient(hunting): picked mon.noname-b con 0x7f483411a340 addr v2:10.20.193.119:3300/0 2026-02-17T21:23:41.037 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.028+0000 7f483ac2f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f483411cc70 addr v1:10.20.193.5:6789/0 2026-02-17T21:23:41.037 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.028+0000 7f483ac2f640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4834120940 con 0x7f483411cc70 2026-02-17T21:23:41.037 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.028+0000 7f483ac2f640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4834121b60 con 0x7f48341123f0 2026-02-17T21:23:41.037 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.028+0000 7f483ac2f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:41.037 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.028+0000 7f483ac2f640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f4834122d60 con 0x7f483411a340 2026-02-17T21:23:41.037 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.028+0000 7f483ac2f640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:41.038 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.028+0000 7f483ac2f640 10 monclient(hunting): authenticate will time out at 959.671697s 2026-02-17T21:23:41.038 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.029+0000 7f482bfff640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f483411a340 0x7f483411c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:41.038 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.029+0000 7f48391a5640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f483411cc70 0x7f483411f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.176:43592/0 (socket says 10.20.193.176:43592) 2026-02-17T21:23:41.038 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.029+0000 7f48391a5640 1 -- 10.20.193.176:0/1461637092 learned_addr learned my addr 10.20.193.176:0/1461637092 (peer_addr_for_me v1:10.20.193.176:0/0) 2026-02-17T21:23:41.038 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.029+0000 7f482bfff640 10 monclient(hunting): get_auth_request con 0x7f483411a340 auth_method 0 2026-02-17T21:23:41.038 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.029+0000 7f482bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:41.038 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.029+0000 7f482bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:41.038 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.029+0000 7f482bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:41.038 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.029+0000 7f482bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:41.038 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.029+0000 7f482bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:41.038 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.029+0000 7f482bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:41.038 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.030+0000 7f482b7fe640 1 -- 10.20.193.176:0/1461637092 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2728214361 0 0) 0x7f4834120940 con 0x7f483411cc70 2026-02-17T21:23:41.039 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.030+0000 7f482b7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:23:41.039 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.030+0000 7f482b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:41.039 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.030+0000 7f482b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:41.039 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.030+0000 7f482b7fe640 10 monclient(hunting): my global_id is 4125 2026-02-17T21:23:41.039 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.030+0000 7f482b7fe640 1 -- 10.20.193.176:0/1461637092 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4820003620 con 0x7f483411cc70 2026-02-17T21:23:41.039 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.031+0000 7f482bfff640 10 monclient(hunting): handle_auth_done global_id 4135 payload 274 2026-02-17T21:23:41.039 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.031+0000 7f482bfff640 1 -- 10.20.193.176:0/1461637092 >> v1:10.20.193.119:6789/0 conn(0x7f48341123f0 legacy=0x7f48341127d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:41.039 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.031+0000 7f482bfff640 1 -- 10.20.193.176:0/1461637092 >> v1:10.20.193.5:6789/0 conn(0x7f483411cc70 legacy=0x7f483411f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:41.039 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.031+0000 7f482bfff640 10 monclient: _finish_hunting 0 2026-02-17T21:23:41.039 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.031+0000 7f482bfff640 1 monclient: found mon.noname-b 2026-02-17T21:23:41.039 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.031+0000 7f482bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:41.039 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.031+0000 7f482bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:23:41.039 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.031+0000 7f482bfff640 1 -- 10.20.193.176:0/1461637092 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4834122ee0 con 0x7f483411a340 2026-02-17T21:23:41.040 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.032+0000 7f482bfff640 1 --2- 10.20.193.176:0/1461637092 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f483411a340 0x7f483411c730 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f481c0098a0 tx=0x7f481c02edd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a63a600e6c09e764 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:41.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.034+0000 7f482b7fe640 1 -- 10.20.193.176:0/1461637092 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f481c03c070 con 0x7f483411a340 2026-02-17T21:23:41.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.034+0000 7f482b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:41.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.034+0000 7f482b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:23:41.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.034+0000 7f482b7fe640 10 monclient: dump: 2026-02-17T21:23:41.046 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:41.047 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:41.047 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.047 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.047 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:41.047 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:41.047 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:41.047 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:41.047 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:41.047 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:41.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.034+0000 7f482b7fe640 10 monclient: _finish_auth 0 2026-02-17T21:23:41.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.034+0000 7f482b7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:23:41.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.034+0000 7f482b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:41.048 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.034+0000 7f483ac2f640 5 monclient: authenticate success, global_id 4135 2026-02-17T21:23:41.048 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.034+0000 7f483ac2f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:23:41.048 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.034+0000 7f482b7fe640 1 -- 10.20.193.176:0/1461637092 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f481c02fae0 con 0x7f483411a340 2026-02-17T21:23:41.048 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.034+0000 7f482b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:41.048 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.034+0000 7f482b7fe640 1 -- 10.20.193.176:0/1461637092 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f481c037440 con 0x7f483411a340 2026-02-17T21:23:41.048 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.034+0000 7f482b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:41.048 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.034+0000 7f482b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:23:41.048 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.034+0000 7f482b7fe640 10 monclient: dump: 2026-02-17T21:23:41.048 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:41.048 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:41.048 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.049 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.049 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:41.049 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:41.049 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:41.049 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:41.049 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:41.049 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:41.049 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.034+0000 7f483ac2f640 10 monclient: get_monmap_and_config success 2026-02-17T21:23:41.049 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.034+0000 7f483ac2f640 4 set_mon_vals no callback set 2026-02-17T21:23:41.049 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.035+0000 7f483ac2f640 10 monclient: shutdown 2026-02-17T21:23:41.049 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.035+0000 7f483ac2f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:41.049 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.035+0000 7f483ac2f640 1 -- 10.20.193.176:0/1461637092 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f483411a340 msgr2=0x7f483411c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:41.049 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.035+0000 7f483ac2f640 1 --2- 10.20.193.176:0/1461637092 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f483411a340 0x7f483411c730 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f481c0098a0 tx=0x7f481c02edd0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.035+0000 7f483ac2f640 1 -- 10.20.193.176:0/1461637092 shutdown_connections 2026-02-17T21:23:41.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.035+0000 7f483ac2f640 1 --2- 10.20.193.176:0/1461637092 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f483411a340 0x7f483411c730 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.035+0000 7f483ac2f640 1 -- 10.20.193.176:0/1461637092 >> 10.20.193.176:0/1461637092 conn(0x7f483406f660 msgr2=0x7f4834071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:41.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.035+0000 7f483ac2f640 1 -- 10.20.193.176:0/1461637092 shutdown_connections 2026-02-17T21:23:41.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.035+0000 7f483ac2f640 1 -- 10.20.193.176:0/1461637092 wait complete. 2026-02-17T21:23:41.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.035+0000 7f483ac2f640 10 monclient: build_initial_monmap 2026-02-17T21:23:41.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.035+0000 7f483ac2f640 10 monclient: monmap: 2026-02-17T21:23:41.050 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:41.050 INFO:teuthology.orchestra.run.trial176.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:23:41.050 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 0.000000 2026-02-17T21:23:41.050 INFO:teuthology.orchestra.run.trial176.stderr:created 0.000000 2026-02-17T21:23:41.050 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:41.051 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:41.051 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:23:41.051 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:23:41.051 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:23:41.051 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:41.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.035+0000 7f483ac2f640 1 librados: starting msgr at 2026-02-17T21:23:41.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.035+0000 7f483ac2f640 1 librados: starting objecter 2026-02-17T21:23:41.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.035+0000 7f483ac2f640 1 Processor -- start 2026-02-17T21:23:41.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f483ac2f640 1 -- start start 2026-02-17T21:23:41.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f483ac2f640 1 librados: setting wanted keys 2026-02-17T21:23:41.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f483ac2f640 1 librados: calling monclient init 2026-02-17T21:23:41.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f483ac2f640 10 monclient: init 2026-02-17T21:23:41.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f483ac2f640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:41.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f483ac2f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:23:41.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f483ac2f640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f48341123f0 0x7f48341b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:41.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f483ac2f640 10 monclient(hunting): picked mon.noname-b con 0x7f48341123f0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:23:41.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f483ac2f640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f483411a340 0x7f48341b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:41.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f483ac2f640 10 monclient(hunting): picked mon.noname-a con 0x7f483411a340 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:23:41.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f483ac2f640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f483411cc70 0x7f48341ab430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:41.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f483ac2f640 10 monclient(hunting): picked mon.noname-c con 0x7f483411cc70 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:23:41.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f483ac2f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:41.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f483ac2f640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f48341221f0 con 0x7f483411a340 2026-02-17T21:23:41.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f483ac2f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:41.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f483ac2f640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4834122070 con 0x7f48341123f0 2026-02-17T21:23:41.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f483ac2f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:41.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f483ac2f640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4834122370 con 0x7f483411cc70 2026-02-17T21:23:41.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f483ac2f640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:41.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f483ac2f640 10 monclient(hunting): authenticate will time out at 959.679232s 2026-02-17T21:23:41.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f48389a4640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f48341123f0 0x7f48341b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:41.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f482bfff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f483411a340 0x7f48341b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:41.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f48391a5640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f483411cc70 0x7f48341ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:41.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f48389a4640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f48341123f0 0x7f48341b1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.176:51140/0 (socket says 10.20.193.176:51140) 2026-02-17T21:23:41.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f48389a4640 1 -- 10.20.193.176:0/1622917510 learned_addr learned my addr 10.20.193.176:0/1622917510 (peer_addr_for_me v2:10.20.193.176:0/0) 2026-02-17T21:23:41.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f48389a4640 10 monclient(hunting): get_auth_request con 0x7f48341123f0 auth_method 0 2026-02-17T21:23:41.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f48389a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:41.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f48389a4640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:41.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f48389a4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:41.054 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f48391a5640 10 monclient(hunting): get_auth_request con 0x7f483411cc70 auth_method 0 2026-02-17T21:23:41.054 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f48391a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:41.054 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f48391a5640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:41.054 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f48391a5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:41.054 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f482bfff640 10 monclient(hunting): get_auth_request con 0x7f483411a340 auth_method 0 2026-02-17T21:23:41.054 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f482bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:41.054 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f482bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:41.054 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f482bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:41.054 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f48389a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:41.054 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f48389a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:41.054 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.036+0000 7f48389a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:41.054 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.037+0000 7f482bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:41.054 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.037+0000 7f482bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:41.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.037+0000 7f482bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:41.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.037+0000 7f48391a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:41.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.037+0000 7f48391a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:41.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.037+0000 7f48391a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:41.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.038+0000 7f48389a4640 10 monclient(hunting): handle_auth_done global_id 4141 payload 824 2026-02-17T21:23:41.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.038+0000 7f48389a4640 1 -- 10.20.193.176:0/1622917510 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f483411cc70 msgr2=0x7f48341ab430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:41.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.038+0000 7f48389a4640 1 --2- 10.20.193.176:0/1622917510 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f483411cc70 0x7f48341ab430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.038+0000 7f48389a4640 1 -- 10.20.193.176:0/1622917510 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f483411a340 msgr2=0x7f48341b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:41.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.038+0000 7f48389a4640 1 --2- 10.20.193.176:0/1622917510 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f483411a340 0x7f48341b19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.038+0000 7f48389a4640 10 monclient: _finish_hunting 0 2026-02-17T21:23:41.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.038+0000 7f48389a4640 1 monclient: found mon.noname-b 2026-02-17T21:23:41.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.038+0000 7f48389a4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:41.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.038+0000 7f48389a4640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:23:41.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.038+0000 7f48389a4640 1 -- 10.20.193.176:0/1622917510 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48341abcf0 con 0x7f48341123f0 2026-02-17T21:23:41.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.039+0000 7f48389a4640 1 --2- 10.20.193.176:0/1622917510 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f48341123f0 0x7f48341b1380 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f482400c700 tx=0x7f482400cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:41.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.039+0000 7f48297fa640 10 client.?.objecter ms_handle_connect 0x7f48341123f0 2026-02-17T21:23:41.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.039+0000 7f48297fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:23:41.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f48297fa640 1 -- 10.20.193.176:0/1622917510 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48240052d0 con 0x7f48341123f0 2026-02-17T21:23:41.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f48297fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:41.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f48297fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:23:41.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f48297fa640 10 monclient: dump: 2026-02-17T21:23:41.056 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:41.056 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:41.056 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.057 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.057 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:41.057 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:41.057 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:41.057 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:41.057 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:41.057 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:41.057 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f48297fa640 10 monclient: _finish_auth 0 2026-02-17T21:23:41.057 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f48297fa640 10 monclient: _check_auth_tickets 2026-02-17T21:23:41.057 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f48297fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:41.057 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f48297fa640 1 -- 10.20.193.176:0/1622917510 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4824005470 con 0x7f48341123f0 2026-02-17T21:23:41.057 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f48297fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:41.057 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f483ac2f640 5 monclient: authenticate success, global_id 4141 2026-02-17T21:23:41.058 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f48297fa640 1 -- 10.20.193.176:0/1622917510 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48240038d0 con 0x7f48341123f0 2026-02-17T21:23:41.058 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f483ac2f640 10 monclient: _renew_subs 2026-02-17T21:23:41.058 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f482affd640 4 set_mon_vals no callback set 2026-02-17T21:23:41.058 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f483ac2f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:41.058 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f483ac2f640 1 -- 10.20.193.176:0/1622917510 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48341abf80 con 0x7f48341123f0 2026-02-17T21:23:41.058 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f48297fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:41.058 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f48297fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:23:41.058 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f48297fa640 10 monclient: dump: 2026-02-17T21:23:41.058 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:41.058 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:41.058 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.058 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.059 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:41.059 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:41.059 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:41.059 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:41.059 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:41.059 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:41.059 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f483ac2f640 10 client.4141.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:23:41.059 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f483ac2f640 10 monclient: _renew_subs 2026-02-17T21:23:41.059 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f483ac2f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:41.059 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f483ac2f640 1 -- 10.20.193.176:0/1622917510 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48341b8310 con 0x7f48341123f0 2026-02-17T21:23:41.059 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f483ac2f640 1 librados: init done 2026-02-17T21:23:41.059 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f483ac2f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:41.059 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f483ac2f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:41.060 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f483ac2f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:41.060 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.041+0000 7f483ac2f640 1 -- 10.20.193.176:0/1622917510 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4834122850 con 0x7f48341123f0 2026-02-17T21:23:41.117 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.113+0000 7f48297fa640 1 -- 10.20.193.176:0/1622917510 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f4824003a70 con 0x7f48341123f0 2026-02-17T21:23:41.122 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.117+0000 7f48297fa640 1 -- 10.20.193.176:0/1622917510 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f48240258c0 con 0x7f48341123f0 2026-02-17T21:23:41.122 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.117+0000 7f48297fa640 10 client.4141.objecter ms_dispatch2 0x7f4834000b90 osd_map(5..5 src has 1..5) 2026-02-17T21:23:41.122 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.117+0000 7f48297fa640 3 client.4141.objecter handle_osd_map got epochs [5,5] > 0 2026-02-17T21:23:41.122 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.117+0000 7f48297fa640 3 client.4141.objecter handle_osd_map decoding full epoch 5 2026-02-17T21:23:41.122 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.118+0000 7f48297fa640 20 client.4141.objecter dump_active .. 0 homeless 2026-02-17T21:23:41.122 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.118+0000 7f48297fa640 1 -- 10.20.193.176:0/1622917510 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f4824025430 con 0x7f48341123f0 2026-02-17T21:23:41.122 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.118+0000 7f48297fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:41.123 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.118+0000 7f48297fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:23:41.154 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.150+0000 7f483ac2f640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "093b417e-53bf-4b60-a937-7c5ffee43e1e", "id": 3}] 2026-02-17T21:23:41.155 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.150+0000 7f483ac2f640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "093b417e-53bf-4b60-a937-7c5ffee43e1e", "id": 3}] 2026-02-17T21:23:41.155 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.150+0000 7f483ac2f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:41.155 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.150+0000 7f483ac2f640 1 -- 10.20.193.176:0/1622917510 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "093b417e-53bf-4b60-a937-7c5ffee43e1e", "id": 3} v 0) -- 0x7f48341187e0 con 0x7f48341123f0 2026-02-17T21:23:41.205 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.201+0000 7f48297fa640 1 -- 10.20.193.176:0/1622917510 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "093b417e-53bf-4b60-a937-7c5ffee43e1e", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f4824025610 con 0x7f48341123f0 2026-02-17T21:23:41.205 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.201+0000 7f48297fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "093b417e-53bf-4b60-a937-7c5ffee43e1e", "id": 3}] 2026-02-17T21:23:41.205 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.201+0000 7f48297fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:23:41.206 INFO:teuthology.orchestra.run.trial176.stdout:3 2026-02-17T21:23:41.207 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.202+0000 7f483ac2f640 10 librados: watch_flush enter 2026-02-17T21:23:41.207 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.202+0000 7f483ac2f640 10 librados: watch_flush exit 2026-02-17T21:23:41.207 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.202+0000 7f483ac2f640 20 client.4141.objecter shutdown clearing up homeless session... 2026-02-17T21:23:41.207 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.202+0000 7f483ac2f640 10 client.4141.objecter successfully canceled tick 2026-02-17T21:23:41.208 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.202+0000 7f483ac2f640 10 monclient: shutdown 2026-02-17T21:23:41.208 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.202+0000 7f483ac2f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:41.208 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.202+0000 7f483ac2f640 1 -- 10.20.193.176:0/1622917510 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f48341123f0 msgr2=0x7f48341b1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:41.208 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.202+0000 7f483ac2f640 1 --2- 10.20.193.176:0/1622917510 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f48341123f0 0x7f48341b1380 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f482400c700 tx=0x7f482400cbd0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.208 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.202+0000 7f483ac2f640 1 -- 10.20.193.176:0/1622917510 shutdown_connections 2026-02-17T21:23:41.208 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.202+0000 7f483ac2f640 1 --2- 10.20.193.176:0/1622917510 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f483411cc70 0x7f48341ab430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.208 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.202+0000 7f483ac2f640 1 --2- 10.20.193.176:0/1622917510 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f483411a340 0x7f48341b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.208 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.202+0000 7f483ac2f640 1 --2- 10.20.193.176:0/1622917510 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f48341123f0 0x7f48341b1380 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.208 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.202+0000 7f483ac2f640 1 -- 10.20.193.176:0/1622917510 >> 10.20.193.176:0/1622917510 conn(0x7f483406f660 msgr2=0x7f483411f060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:41.208 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.202+0000 7f483ac2f640 1 -- 10.20.193.176:0/1622917510 shutdown_connections 2026-02-17T21:23:41.208 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.202+0000 7f483ac2f640 1 -- 10.20.193.176:0/1622917510 wait complete. 2026-02-17T21:23:41.208 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.202+0000 7f483ac2f640 1 librados: shutdown 2026-02-17T21:23:41.214 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph --cluster ceph osd new 0a48e684-05b0-41b1-a553-022424011225 4 2026-02-17T21:23:41.241 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:41.237+0000 7fb01f20f140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T21:23:41.257 INFO:tasks.ceph.mgr.y.trial005.stderr:2026-02-17T21:23:41.256+0000 7fedb15dc140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T21:23:41.278 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.274+0000 7fdf9044c640 10 monclient: get_monmap_and_config 2026-02-17T21:23:41.279 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.274+0000 7fdf9044c640 10 monclient: build_initial_monmap 2026-02-17T21:23:41.279 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.274+0000 7fdf9044c640 10 monclient: monmap: 2026-02-17T21:23:41.279 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:41.279 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:41.279 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:23:41.276546+0000 2026-02-17T21:23:41.279 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:23:41.276546+0000 2026-02-17T21:23:41.279 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:41.279 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:41.279 INFO:teuthology.orchestra.run.trial176.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:23:41.280 INFO:teuthology.orchestra.run.trial176.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:23:41.280 INFO:teuthology.orchestra.run.trial176.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:23:41.280 INFO:teuthology.orchestra.run.trial176.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:23:41.280 INFO:teuthology.orchestra.run.trial176.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:23:41.280 INFO:teuthology.orchestra.run.trial176.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:23:41.280 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:41.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.275+0000 7fdf9044c640 1 Processor -- start 2026-02-17T21:23:41.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.275+0000 7fdf9044c640 1 -- start start 2026-02-17T21:23:41.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.275+0000 7fdf9044c640 10 monclient: init 2026-02-17T21:23:41.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.275+0000 7fdf9044c640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:41.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.275+0000 7fdf9044c640 10 monclient: _add_conns ranks=[1,4,5,2,0,3] 2026-02-17T21:23:41.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.275+0000 7fdf9044c640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fdf881123f0 addr v1:10.20.193.119:6789/0 2026-02-17T21:23:41.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.275+0000 7fdf9044c640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fdf8811a340 0x7fdf8811c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:41.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.275+0000 7fdf9044c640 10 monclient(hunting): picked mon.noname-b con 0x7fdf8811a340 addr v2:10.20.193.119:3300/0 2026-02-17T21:23:41.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.275+0000 7fdf9044c640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fdf8811cc70 0x7fdf8811f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:41.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.275+0000 7fdf9044c640 10 monclient(hunting): picked mon.noname-c con 0x7fdf8811cc70 addr v2:10.20.193.135:3300/0 2026-02-17T21:23:41.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.275+0000 7fdf9044c640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf8811f760 con 0x7fdf881123f0 2026-02-17T21:23:41.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.275+0000 7fdf9044c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:41.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.275+0000 7fdf9044c640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fdf88120980 con 0x7fdf8811a340 2026-02-17T21:23:41.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.275+0000 7fdf9044c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:41.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.275+0000 7fdf9044c640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fdf88120b00 con 0x7fdf8811cc70 2026-02-17T21:23:41.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.275+0000 7fdf9044c640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:41.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.275+0000 7fdf9044c640 10 monclient(hunting): authenticate will time out at 959.918660s 2026-02-17T21:23:41.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.276+0000 7fdf8e9c2640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fdf8811cc70 0x7fdf8811f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:41.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.276+0000 7fdf8e9c2640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fdf8811cc70 0x7fdf8811f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.176:59600/0 (socket says 10.20.193.176:59600) 2026-02-17T21:23:41.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.276+0000 7fdf8e9c2640 1 -- 10.20.193.176:0/1001544254 learned_addr learned my addr 10.20.193.176:0/1001544254 (peer_addr_for_me v2:10.20.193.176:0/0) 2026-02-17T21:23:41.285 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.276+0000 7fdf8e9c2640 10 monclient(hunting): get_auth_request con 0x7fdf8811cc70 auth_method 0 2026-02-17T21:23:41.285 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.276+0000 7fdf8e9c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:41.285 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.276+0000 7fdf8e9c2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:41.285 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.276+0000 7fdf8e9c2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:41.285 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.276+0000 7fdf8e9c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:41.285 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.276+0000 7fdf8e9c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:41.285 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.276+0000 7fdf8e9c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:41.285 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.277+0000 7fdf8e9c2640 10 monclient(hunting): handle_auth_done global_id 4130 payload 274 2026-02-17T21:23:41.285 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.277+0000 7fdf8e9c2640 1 -- 10.20.193.176:0/1001544254 >> v2:10.20.193.119:3300/0 conn(0x7fdf8811a340 msgr2=0x7fdf8811c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:23:41.285 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.277+0000 7fdf8e9c2640 1 --2- 10.20.193.176:0/1001544254 >> v2:10.20.193.119:3300/0 conn(0x7fdf8811a340 0x7fdf8811c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.285 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.277+0000 7fdf8e9c2640 1 -- 10.20.193.176:0/1001544254 >> v1:10.20.193.119:6789/0 conn(0x7fdf881123f0 legacy=0x7fdf881127d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:23:41.285 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.277+0000 7fdf8e9c2640 10 monclient: _finish_hunting 0 2026-02-17T21:23:41.286 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.277+0000 7fdf8e9c2640 1 monclient: found mon.noname-c 2026-02-17T21:23:41.286 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.277+0000 7fdf8e9c2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:41.286 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.277+0000 7fdf8e9c2640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:23:41.286 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.277+0000 7fdf8e9c2640 1 -- 10.20.193.176:0/1001544254 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf88120cb0 con 0x7fdf8811cc70 2026-02-17T21:23:41.286 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.278+0000 7fdf8e9c2640 1 --2- 10.20.193.176:0/1001544254 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fdf8811cc70 0x7fdf8811f060 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdf88113070 tx=0x7fdf8402f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cc859d8f7e5bb8e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:41.290 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf8d1bf640 1 -- 10.20.193.176:0/1001544254 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8402fc50 con 0x7fdf8811cc70 2026-02-17T21:23:41.290 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf8d1bf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:41.290 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf8d1bf640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:23:41.290 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf8d1bf640 10 monclient: dump: 2026-02-17T21:23:41.290 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:41.291 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:41.291 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.291 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.291 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:41.291 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:41.291 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:41.291 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:41.291 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:41.291 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:41.291 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf8d1bf640 10 monclient: _finish_auth 0 2026-02-17T21:23:41.291 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf8d1bf640 10 monclient: _check_auth_tickets 2026-02-17T21:23:41.292 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf8d1bf640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:41.292 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf8d1bf640 1 -- 10.20.193.176:0/1001544254 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf8402fdf0 con 0x7fdf8811cc70 2026-02-17T21:23:41.292 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf8d1bf640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:41.292 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf8d1bf640 1 -- 10.20.193.176:0/1001544254 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf84037610 con 0x7fdf8811cc70 2026-02-17T21:23:41.292 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf8d1bf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:41.292 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf8d1bf640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:23:41.292 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf8d1bf640 10 monclient: dump: 2026-02-17T21:23:41.292 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:41.292 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:41.292 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.292 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.292 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:41.293 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:41.293 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:41.293 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:41.293 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:41.293 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:41.293 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf9044c640 5 monclient: authenticate success, global_id 4130 2026-02-17T21:23:41.293 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf9044c640 10 monclient: get_monmap_and_config success 2026-02-17T21:23:41.293 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf9044c640 4 set_mon_vals no callback set 2026-02-17T21:23:41.293 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf9044c640 10 monclient: shutdown 2026-02-17T21:23:41.293 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf9044c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:41.293 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf9044c640 1 -- 10.20.193.176:0/1001544254 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fdf8811cc70 msgr2=0x7fdf8811f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:41.293 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf9044c640 1 --2- 10.20.193.176:0/1001544254 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fdf8811cc70 0x7fdf8811f060 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdf88113070 tx=0x7fdf8402f230 comp rx=0 tx=0).stop 2026-02-17T21:23:41.294 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf9044c640 1 -- 10.20.193.176:0/1001544254 shutdown_connections 2026-02-17T21:23:41.294 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf9044c640 1 --2- 10.20.193.176:0/1001544254 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fdf8811cc70 0x7fdf8811f060 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.294 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf9044c640 1 --2- 10.20.193.176:0/1001544254 >> v2:10.20.193.119:3300/0 conn(0x7fdf8811a340 0x7fdf8811c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.294 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf9044c640 1 -- 10.20.193.176:0/1001544254 >> 10.20.193.176:0/1001544254 conn(0x7fdf8806f660 msgr2=0x7fdf88071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:41.294 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf9044c640 1 -- 10.20.193.176:0/1001544254 shutdown_connections 2026-02-17T21:23:41.294 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.282+0000 7fdf9044c640 1 -- 10.20.193.176:0/1001544254 wait complete. 2026-02-17T21:23:41.294 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.283+0000 7fdf9044c640 10 monclient: build_initial_monmap 2026-02-17T21:23:41.294 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.283+0000 7fdf9044c640 10 monclient: monmap: 2026-02-17T21:23:41.294 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:41.294 INFO:teuthology.orchestra.run.trial176.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:23:41.294 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 0.000000 2026-02-17T21:23:41.294 INFO:teuthology.orchestra.run.trial176.stderr:created 0.000000 2026-02-17T21:23:41.295 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:41.295 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:41.295 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:23:41.295 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:23:41.295 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:23:41.295 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:41.295 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.283+0000 7fdf9044c640 1 librados: starting msgr at 2026-02-17T21:23:41.295 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.283+0000 7fdf9044c640 1 librados: starting objecter 2026-02-17T21:23:41.295 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.283+0000 7fdf9044c640 1 Processor -- start 2026-02-17T21:23:41.295 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.283+0000 7fdf9044c640 1 -- start start 2026-02-17T21:23:41.295 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.283+0000 7fdf9044c640 1 librados: setting wanted keys 2026-02-17T21:23:41.295 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.283+0000 7fdf9044c640 1 librados: calling monclient init 2026-02-17T21:23:41.296 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.283+0000 7fdf9044c640 10 monclient: init 2026-02-17T21:23:41.296 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.283+0000 7fdf9044c640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:41.296 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.283+0000 7fdf9044c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:23:41.296 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.283+0000 7fdf9044c640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fdf881123f0 0x7fdf881b1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:41.296 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.283+0000 7fdf9044c640 10 monclient(hunting): picked mon.noname-c con 0x7fdf881123f0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:23:41.296 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.283+0000 7fdf9044c640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fdf8811a340 0x7fdf881b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:41.296 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.283+0000 7fdf9044c640 10 monclient(hunting): picked mon.noname-a con 0x7fdf8811a340 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:23:41.296 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.283+0000 7fdf9044c640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdf8811cc70 0x7fdf881ab510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:41.296 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.283+0000 7fdf9044c640 10 monclient(hunting): picked mon.noname-b con 0x7fdf8811cc70 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:23:41.296 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.283+0000 7fdf9044c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:41.296 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.283+0000 7fdf9044c640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8811fd90 con 0x7fdf8811a340 2026-02-17T21:23:41.296 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.283+0000 7fdf9044c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:41.297 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.283+0000 7fdf9044c640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8811fc10 con 0x7fdf8811cc70 2026-02-17T21:23:41.297 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.283+0000 7fdf9044c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:41.297 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.283+0000 7fdf9044c640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8811ff10 con 0x7fdf881123f0 2026-02-17T21:23:41.297 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.283+0000 7fdf9044c640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:41.297 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.283+0000 7fdf9044c640 10 monclient(hunting): authenticate will time out at 959.926634s 2026-02-17T21:23:41.297 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.285+0000 7fdf8e9c2640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdf8811cc70 0x7fdf881ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:41.297 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.285+0000 7fdf8e1c1640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fdf881123f0 0x7fdf881b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:41.297 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.286+0000 7fdf8e9c2640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdf8811cc70 0x7fdf881ab510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.176:51156/0 (socket says 10.20.193.176:51156) 2026-02-17T21:23:41.297 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.286+0000 7fdf8e9c2640 1 -- 10.20.193.176:0/435128010 learned_addr learned my addr 10.20.193.176:0/435128010 (peer_addr_for_me v2:10.20.193.176:0/0) 2026-02-17T21:23:41.297 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.286+0000 7fdf8e9c2640 10 monclient(hunting): get_auth_request con 0x7fdf8811cc70 auth_method 0 2026-02-17T21:23:41.297 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.286+0000 7fdf8e9c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:41.297 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.286+0000 7fdf8e9c2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:41.298 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.286+0000 7fdf8e9c2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:41.298 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.286+0000 7fdf8e9c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:41.298 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.286+0000 7fdf8e9c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:41.298 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.286+0000 7fdf8e9c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:41.298 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.286+0000 7fdf8e1c1640 10 monclient(hunting): get_auth_request con 0x7fdf881123f0 auth_method 0 2026-02-17T21:23:41.298 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.286+0000 7fdf8e1c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:41.298 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.286+0000 7fdf8e1c1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:41.298 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.286+0000 7fdf8e1c1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:41.298 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.286+0000 7fdf8e1c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:41.298 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.286+0000 7fdf8e1c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:41.298 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.286+0000 7fdf8e1c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:41.301 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.287+0000 7fdf8e9c2640 10 monclient(hunting): handle_auth_done global_id 4144 payload 824 2026-02-17T21:23:41.301 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.287+0000 7fdf8e9c2640 1 -- 10.20.193.176:0/435128010 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fdf881123f0 msgr2=0x7fdf881b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:41.301 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.287+0000 7fdf8e9c2640 1 --2- 10.20.193.176:0/435128010 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fdf881123f0 0x7fdf881b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.301 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.287+0000 7fdf8e9c2640 1 -- 10.20.193.176:0/435128010 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fdf8811a340 msgr2=0x7fdf881b1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:41.301 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.287+0000 7fdf8e9c2640 1 --2- 10.20.193.176:0/435128010 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fdf8811a340 0x7fdf881b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.301 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.287+0000 7fdf8e9c2640 10 monclient: _finish_hunting 0 2026-02-17T21:23:41.301 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.287+0000 7fdf8e9c2640 1 monclient: found mon.noname-b 2026-02-17T21:23:41.302 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.287+0000 7fdf8e9c2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:41.302 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.287+0000 7fdf8e9c2640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:23:41.302 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.287+0000 7fdf8e9c2640 1 -- 10.20.193.176:0/435128010 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf881abdd0 con 0x7fdf8811cc70 2026-02-17T21:23:41.302 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.288+0000 7fdf8e9c2640 1 --2- 10.20.193.176:0/435128010 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdf8811cc70 0x7fdf881ab510 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdf84030fd0 tx=0x7fdf84004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:41.302 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.288+0000 7fdf6effd640 10 client.?.objecter ms_handle_connect 0x7fdf8811cc70 2026-02-17T21:23:41.302 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.288+0000 7fdf6effd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:23:41.302 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf6effd640 1 -- 10.20.193.176:0/435128010 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf84046070 con 0x7fdf8811cc70 2026-02-17T21:23:41.302 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf6effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:41.302 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf6effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:23:41.302 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf6effd640 10 monclient: dump: 2026-02-17T21:23:41.302 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:41.302 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:41.303 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.303 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.303 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:41.303 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:41.303 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:41.303 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:41.303 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:41.303 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:41.303 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf6effd640 10 monclient: _finish_auth 0 2026-02-17T21:23:41.303 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf6effd640 10 monclient: _check_auth_tickets 2026-02-17T21:23:41.303 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf6effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:41.303 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf6effd640 1 -- 10.20.193.176:0/435128010 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf84042640 con 0x7fdf8811cc70 2026-02-17T21:23:41.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf9044c640 5 monclient: authenticate success, global_id 4144 2026-02-17T21:23:41.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf9044c640 10 monclient: _renew_subs 2026-02-17T21:23:41.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf9044c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:41.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf9044c640 1 -- 10.20.193.176:0/435128010 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf881ac000 con 0x7fdf8811cc70 2026-02-17T21:23:41.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf6effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:41.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf6effd640 1 -- 10.20.193.176:0/435128010 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf84042a10 con 0x7fdf8811cc70 2026-02-17T21:23:41.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf6effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:41.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf8c9be640 4 set_mon_vals no callback set 2026-02-17T21:23:41.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf6effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:23:41.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf6effd640 10 monclient: dump: 2026-02-17T21:23:41.304 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:41.304 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:41.305 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.305 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.305 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:41.305 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:41.305 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:41.305 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:41.305 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:41.305 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:41.305 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf9044c640 10 client.4144.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:23:41.305 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf9044c640 10 monclient: _renew_subs 2026-02-17T21:23:41.305 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf9044c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:41.305 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf9044c640 1 -- 10.20.193.176:0/435128010 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf881b83f0 con 0x7fdf8811cc70 2026-02-17T21:23:41.306 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf9044c640 1 librados: init done 2026-02-17T21:23:41.306 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf9044c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:41.306 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf9044c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:41.306 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf9044c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:41.306 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.291+0000 7fdf9044c640 1 -- 10.20.193.176:0/435128010 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf881203b0 con 0x7fdf8811cc70 2026-02-17T21:23:41.334 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.331+0000 7fdf6effd640 1 -- 10.20.193.176:0/435128010 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fdf84042bb0 con 0x7fdf8811cc70 2026-02-17T21:23:41.337 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.334+0000 7fdf6effd640 1 -- 10.20.193.176:0/435128010 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fdf8404b960 con 0x7fdf8811cc70 2026-02-17T21:23:41.338 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.334+0000 7fdf6effd640 10 client.4144.objecter ms_dispatch2 0x7fdf88000b90 osd_map(6..6 src has 1..6) 2026-02-17T21:23:41.338 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.334+0000 7fdf6effd640 3 client.4144.objecter handle_osd_map got epochs [6,6] > 0 2026-02-17T21:23:41.338 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.334+0000 7fdf6effd640 3 client.4144.objecter handle_osd_map decoding full epoch 6 2026-02-17T21:23:41.338 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.334+0000 7fdf6effd640 20 client.4144.objecter dump_active .. 0 homeless 2026-02-17T21:23:41.338 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.334+0000 7fdf6effd640 1 -- 10.20.193.176:0/435128010 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fdf8404b450 con 0x7fdf8811cc70 2026-02-17T21:23:41.338 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.334+0000 7fdf6effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:41.338 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.334+0000 7fdf6effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:23:41.370 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.366+0000 7fdf9044c640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "0a48e684-05b0-41b1-a553-022424011225", "id": 4}] 2026-02-17T21:23:41.370 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.366+0000 7fdf9044c640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "0a48e684-05b0-41b1-a553-022424011225", "id": 4}] 2026-02-17T21:23:41.370 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.366+0000 7fdf9044c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:41.370 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.366+0000 7fdf9044c640 1 -- 10.20.193.176:0/435128010 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0a48e684-05b0-41b1-a553-022424011225", "id": 4} v 0) -- 0x7fdf88070bc0 con 0x7fdf8811cc70 2026-02-17T21:23:41.407 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:41.404+0000 7fb019b6b640 -1 mgr handle_mgr_map I was active but no longer am 2026-02-17T21:23:41.479 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.475+0000 7fdf6effd640 1 -- 10.20.193.176:0/435128010 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mgrmap(e 2) ==== 50143+0+0 (secure 0 0 0) 0x7fdf8404b630 con 0x7fdf8811cc70 2026-02-17T21:23:41.531 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.527+0000 7fdf6effd640 1 -- 10.20.193.176:0/435128010 <== mon.1 v2:10.20.193.119:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0a48e684-05b0-41b1-a553-022424011225", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fdf88070bc0 con 0x7fdf8811cc70 2026-02-17T21:23:41.531 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.527+0000 7fdf6effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "0a48e684-05b0-41b1-a553-022424011225", "id": 4}] 2026-02-17T21:23:41.531 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.527+0000 7fdf6effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:23:41.532 INFO:teuthology.orchestra.run.trial176.stdout:4 2026-02-17T21:23:41.533 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.528+0000 7fdf9044c640 10 librados: watch_flush enter 2026-02-17T21:23:41.533 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.528+0000 7fdf9044c640 10 librados: watch_flush exit 2026-02-17T21:23:41.533 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.528+0000 7fdf9044c640 20 client.4144.objecter shutdown clearing up homeless session... 2026-02-17T21:23:41.534 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.528+0000 7fdf9044c640 10 client.4144.objecter successfully canceled tick 2026-02-17T21:23:41.534 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.528+0000 7fdf9044c640 10 monclient: shutdown 2026-02-17T21:23:41.534 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.528+0000 7fdf9044c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:41.534 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.528+0000 7fdf9044c640 1 -- 10.20.193.176:0/435128010 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdf8811cc70 msgr2=0x7fdf881ab510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:41.534 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.528+0000 7fdf9044c640 1 --2- 10.20.193.176:0/435128010 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdf8811cc70 0x7fdf881ab510 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdf84030fd0 tx=0x7fdf84004b40 comp rx=0 tx=0).stop 2026-02-17T21:23:41.534 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.528+0000 7fdf9044c640 1 -- 10.20.193.176:0/435128010 shutdown_connections 2026-02-17T21:23:41.534 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.528+0000 7fdf9044c640 1 --2- 10.20.193.176:0/435128010 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdf8811cc70 0x7fdf881ab510 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.534 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.528+0000 7fdf9044c640 1 --2- 10.20.193.176:0/435128010 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fdf8811a340 0x7fdf881b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.534 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.528+0000 7fdf9044c640 1 --2- 10.20.193.176:0/435128010 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fdf881123f0 0x7fdf881b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.534 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.528+0000 7fdf9044c640 1 -- 10.20.193.176:0/435128010 >> 10.20.193.176:0/435128010 conn(0x7fdf8806f660 msgr2=0x7fdf881196b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:41.534 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.528+0000 7fdf9044c640 1 -- 10.20.193.176:0/435128010 shutdown_connections 2026-02-17T21:23:41.535 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.528+0000 7fdf9044c640 1 -- 10.20.193.176:0/435128010 wait complete. 2026-02-17T21:23:41.535 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.528+0000 7fdf9044c640 1 librados: shutdown 2026-02-17T21:23:41.540 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph --cluster ceph osd new d73b7c38-cef9-4993-b353-908c1d87603c 5 2026-02-17T21:23:41.646 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.640+0000 7f3955c1b640 10 monclient: get_monmap_and_config 2026-02-17T21:23:41.646 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.640+0000 7f3955c1b640 10 monclient: build_initial_monmap 2026-02-17T21:23:41.646 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.640+0000 7f3955c1b640 10 monclient: monmap: 2026-02-17T21:23:41.646 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:41.646 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:41.647 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:23:41.642106+0000 2026-02-17T21:23:41.647 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:23:41.642106+0000 2026-02-17T21:23:41.647 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:41.647 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:41.647 INFO:teuthology.orchestra.run.trial176.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:23:41.647 INFO:teuthology.orchestra.run.trial176.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:23:41.647 INFO:teuthology.orchestra.run.trial176.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:23:41.647 INFO:teuthology.orchestra.run.trial176.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:23:41.647 INFO:teuthology.orchestra.run.trial176.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:23:41.647 INFO:teuthology.orchestra.run.trial176.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:23:41.648 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:41.648 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.640+0000 7f3955c1b640 1 Processor -- start 2026-02-17T21:23:41.648 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.640+0000 7f3955c1b640 1 -- start start 2026-02-17T21:23:41.648 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.640+0000 7f3955c1b640 10 monclient: init 2026-02-17T21:23:41.648 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.640+0000 7f3955c1b640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:41.648 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.640+0000 7f3955c1b640 10 monclient: _add_conns ranks=[2,0,3,4,5,1] 2026-02-17T21:23:41.648 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.641+0000 7f3955c1b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3950112750 addr v1:10.20.193.135:6789/0 2026-02-17T21:23:41.648 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.641+0000 7f3955c1b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f395011b340 addr v1:10.20.193.5:6789/0 2026-02-17T21:23:41.649 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.641+0000 7f3955c1b640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f395011eee0 0x7f3950121380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:41.649 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.641+0000 7f3955c1b640 10 monclient(hunting): picked mon.noname-a con 0x7f395011eee0 addr v2:10.20.193.5:3300/0 2026-02-17T21:23:41.649 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.641+0000 7f3955c1b640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3950121aa0 con 0x7f395011b340 2026-02-17T21:23:41.649 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.641+0000 7f3955c1b640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3950122cc0 con 0x7f3950112750 2026-02-17T21:23:41.649 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.641+0000 7f3955c1b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:41.649 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.641+0000 7f3955c1b640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f3950123ec0 con 0x7f395011eee0 2026-02-17T21:23:41.649 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.641+0000 7f3955c1b640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:41.649 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.641+0000 7f3955c1b640 10 monclient(hunting): authenticate will time out at 960.284046s 2026-02-17T21:23:41.650 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.641+0000 7f394f7fe640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f3950112750 0x7f3950112b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.176:40250/0 (socket says 10.20.193.176:40250) 2026-02-17T21:23:41.650 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.641+0000 7f394f7fe640 1 -- 10.20.193.176:0/2637794088 learned_addr learned my addr 10.20.193.176:0/2637794088 (peer_addr_for_me v1:10.20.193.176:0/0) 2026-02-17T21:23:41.650 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.641+0000 7f394ffff640 1 --2- 10.20.193.176:0/2637794088 >> v2:10.20.193.5:3300/0 conn(0x7f395011eee0 0x7f3950121380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:41.650 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.641+0000 7f394ffff640 10 monclient(hunting): get_auth_request con 0x7f395011eee0 auth_method 0 2026-02-17T21:23:41.650 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.641+0000 7f394ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:41.650 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.641+0000 7f394ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:41.650 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.641+0000 7f394ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:41.651 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.642+0000 7f394ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:41.651 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.642+0000 7f394ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:41.651 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.642+0000 7f394ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:41.661 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.642+0000 7f394e7fc640 1 -- 10.20.193.176:0/2637794088 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 312006837 0 0) 0x7f3950122cc0 con 0x7f3950112750 2026-02-17T21:23:41.662 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.642+0000 7f394e7fc640 10 monclient(hunting): _negotiate 2026-02-17T21:23:41.662 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.642+0000 7f394e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:41.662 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.642+0000 7f394e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:41.662 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.642+0000 7f394e7fc640 10 monclient(hunting): my global_id is 4142 2026-02-17T21:23:41.662 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.642+0000 7f394e7fc640 1 -- 10.20.193.176:0/2637794088 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3934003620 con 0x7f3950112750 2026-02-17T21:23:41.662 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.643+0000 7f394ffff640 10 monclient(hunting): handle_auth_done global_id 4134 payload 274 2026-02-17T21:23:41.662 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.643+0000 7f394ffff640 1 -- 10.20.193.176:0/2637794088 >> v1:10.20.193.135:6789/0 conn(0x7f3950112750 legacy=0x7f3950112b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:41.662 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.643+0000 7f394ffff640 1 -- 10.20.193.176:0/2637794088 >> v1:10.20.193.5:6789/0 conn(0x7f395011b340 legacy=0x7f395011d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:41.662 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.643+0000 7f394ffff640 10 monclient: _finish_hunting 0 2026-02-17T21:23:41.662 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.643+0000 7f394ffff640 1 monclient: found mon.noname-a 2026-02-17T21:23:41.663 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.643+0000 7f394ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:41.663 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.643+0000 7f394ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:23:41.663 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.643+0000 7f394ffff640 1 -- 10.20.193.176:0/2637794088 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3950124040 con 0x7f395011eee0 2026-02-17T21:23:41.663 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.644+0000 7f394ffff640 1 --2- 10.20.193.176:0/2637794088 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f395011eee0 0x7f3950121380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3944009d90 tx=0x7f394402f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c14071edd6f4a6a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:41.663 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.646+0000 7f394e7fc640 1 -- 10.20.193.176:0/2637794088 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394403c070 con 0x7f395011eee0 2026-02-17T21:23:41.663 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.646+0000 7f394e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:41.663 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.646+0000 7f394e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:23:41.663 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.646+0000 7f394e7fc640 10 monclient: dump: 2026-02-17T21:23:41.663 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:41.663 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:41.663 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.664 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.664 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:41.664 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:41.664 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:41.664 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:41.664 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:41.664 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:41.664 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.646+0000 7f394e7fc640 10 monclient: _finish_auth 0 2026-02-17T21:23:41.664 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.646+0000 7f394e7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:23:41.664 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.646+0000 7f394e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:41.664 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.646+0000 7f394e7fc640 1 -- 10.20.193.176:0/2637794088 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3944037440 con 0x7f395011eee0 2026-02-17T21:23:41.664 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.646+0000 7f394e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:41.665 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.646+0000 7f3955c1b640 5 monclient: authenticate success, global_id 4134 2026-02-17T21:23:41.665 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.646+0000 7f394e7fc640 1 -- 10.20.193.176:0/2637794088 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3944037810 con 0x7f395011eee0 2026-02-17T21:23:41.665 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.646+0000 7f394e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:41.665 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.646+0000 7f394e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:23:41.665 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.646+0000 7f394e7fc640 10 monclient: dump: 2026-02-17T21:23:41.665 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:41.665 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:41.665 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.665 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.665 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:41.665 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:41.665 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:41.666 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:41.666 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:41.666 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:41.666 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.646+0000 7f3955c1b640 10 monclient: get_monmap_and_config success 2026-02-17T21:23:41.666 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.646+0000 7f3955c1b640 4 set_mon_vals no callback set 2026-02-17T21:23:41.666 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.646+0000 7f3955c1b640 10 monclient: shutdown 2026-02-17T21:23:41.666 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.646+0000 7f3955c1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:41.666 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.646+0000 7f3955c1b640 1 -- 10.20.193.176:0/2637794088 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f395011eee0 msgr2=0x7f3950121380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:41.666 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.646+0000 7f3955c1b640 1 --2- 10.20.193.176:0/2637794088 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f395011eee0 0x7f3950121380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3944009d90 tx=0x7f394402f1e0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.666 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.646+0000 7f3955c1b640 1 -- 10.20.193.176:0/2637794088 shutdown_connections 2026-02-17T21:23:41.666 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.646+0000 7f3955c1b640 1 --2- 10.20.193.176:0/2637794088 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f395011eee0 0x7f3950121380 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.666 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.646+0000 7f3955c1b640 1 -- 10.20.193.176:0/2637794088 >> 10.20.193.176:0/2637794088 conn(0x7f395006dba0 msgr2=0x7f395006ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:41.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.646+0000 7f3955c1b640 1 -- 10.20.193.176:0/2637794088 shutdown_connections 2026-02-17T21:23:41.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.646+0000 7f3955c1b640 1 -- 10.20.193.176:0/2637794088 wait complete. 2026-02-17T21:23:41.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f3955c1b640 10 monclient: build_initial_monmap 2026-02-17T21:23:41.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f3955c1b640 10 monclient: monmap: 2026-02-17T21:23:41.667 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:41.667 INFO:teuthology.orchestra.run.trial176.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:23:41.667 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 0.000000 2026-02-17T21:23:41.667 INFO:teuthology.orchestra.run.trial176.stderr:created 0.000000 2026-02-17T21:23:41.667 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:41.667 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:41.667 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:23:41.667 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:23:41.668 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:23:41.668 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:41.668 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f3955c1b640 1 librados: starting msgr at 2026-02-17T21:23:41.668 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f3955c1b640 1 librados: starting objecter 2026-02-17T21:23:41.668 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f3955c1b640 1 Processor -- start 2026-02-17T21:23:41.668 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f3955c1b640 1 -- start start 2026-02-17T21:23:41.668 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f3955c1b640 1 librados: setting wanted keys 2026-02-17T21:23:41.668 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f3955c1b640 1 librados: calling monclient init 2026-02-17T21:23:41.668 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f3955c1b640 10 monclient: init 2026-02-17T21:23:41.668 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f3955c1b640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:41.668 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f3955c1b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:23:41.668 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f3955c1b640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3950112750 0x7f395006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:41.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f3955c1b640 10 monclient(hunting): picked mon.noname-b con 0x7f3950112750 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:23:41.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f3955c1b640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f395011b340 0x7f39500700d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:41.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f3955c1b640 10 monclient(hunting): picked mon.noname-c con 0x7f395011b340 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:23:41.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f3955c1b640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f395011eee0 0x7f39501b7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:41.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f3955c1b640 10 monclient(hunting): picked mon.noname-a con 0x7f395011eee0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:23:41.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f3955c1b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:41.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f3955c1b640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f39501220f0 con 0x7f395011eee0 2026-02-17T21:23:41.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f3955c1b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:41.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f3955c1b640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3950121f70 con 0x7f3950112750 2026-02-17T21:23:41.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f3955c1b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:41.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f3955c1b640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3950122270 con 0x7f395011b340 2026-02-17T21:23:41.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f3955c1b640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:41.670 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f3955c1b640 10 monclient(hunting): authenticate will time out at 960.290546s 2026-02-17T21:23:41.670 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f394f7fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3950112750 0x7f395006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:41.670 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f394effd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f395011b340 0x7f39500700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:41.670 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.647+0000 7f394ffff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f395011eee0 0x7f39501b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:41.670 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.648+0000 7f394effd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f395011b340 0x7f39500700d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.176:59664/0 (socket says 10.20.193.176:59664) 2026-02-17T21:23:41.670 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.648+0000 7f394effd640 1 -- 10.20.193.176:0/1714207381 learned_addr learned my addr 10.20.193.176:0/1714207381 (peer_addr_for_me v2:10.20.193.176:0/0) 2026-02-17T21:23:41.670 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.648+0000 7f394effd640 10 monclient(hunting): get_auth_request con 0x7f395011b340 auth_method 0 2026-02-17T21:23:41.670 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.648+0000 7f394effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:41.670 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.648+0000 7f394effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:41.670 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.648+0000 7f394effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:41.670 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.648+0000 7f394ffff640 10 monclient(hunting): get_auth_request con 0x7f395011eee0 auth_method 0 2026-02-17T21:23:41.670 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.648+0000 7f394ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:41.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.648+0000 7f394ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:41.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.648+0000 7f394ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:41.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.648+0000 7f394f7fe640 10 monclient(hunting): get_auth_request con 0x7f3950112750 auth_method 0 2026-02-17T21:23:41.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.648+0000 7f394f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:41.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.648+0000 7f394f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:41.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.648+0000 7f394f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:41.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.648+0000 7f394effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:41.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.648+0000 7f394effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:41.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.648+0000 7f394effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:41.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.648+0000 7f394ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:41.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.648+0000 7f394ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:41.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.648+0000 7f394ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:41.671 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.648+0000 7f394f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:41.672 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.648+0000 7f394f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:41.672 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.648+0000 7f394f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:41.672 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.649+0000 7f394effd640 10 monclient(hunting): handle_auth_done global_id 4145 payload 824 2026-02-17T21:23:41.672 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.649+0000 7f394effd640 1 -- 10.20.193.176:0/1714207381 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3950112750 msgr2=0x7f395006fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:41.672 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.649+0000 7f394effd640 1 --2- 10.20.193.176:0/1714207381 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3950112750 0x7f395006fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.672 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.649+0000 7f394effd640 1 -- 10.20.193.176:0/1714207381 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f395011eee0 msgr2=0x7f39501b7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:41.672 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.649+0000 7f394effd640 1 --2- 10.20.193.176:0/1714207381 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f395011eee0 0x7f39501b7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.672 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.649+0000 7f394effd640 10 monclient: _finish_hunting 0 2026-02-17T21:23:41.672 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.649+0000 7f394effd640 1 monclient: found mon.noname-c 2026-02-17T21:23:41.672 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.649+0000 7f394effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:41.672 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.649+0000 7f394effd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:23:41.672 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.649+0000 7f394effd640 1 -- 10.20.193.176:0/1714207381 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39501b7a70 con 0x7f395011b340 2026-02-17T21:23:41.672 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.650+0000 7f394effd640 1 --2- 10.20.193.176:0/1714207381 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f395011b340 0x7f39500700d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f394000c6e0 tx=0x7f394000cbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:41.673 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.650+0000 7f392bfff640 10 client.?.objecter ms_handle_connect 0x7f395011b340 2026-02-17T21:23:41.673 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.650+0000 7f392bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:23:41.673 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f392bfff640 1 -- 10.20.193.176:0/1714207381 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39400052d0 con 0x7f395011b340 2026-02-17T21:23:41.673 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f392bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:41.673 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f392bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:23:41.673 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f392bfff640 10 monclient: dump: 2026-02-17T21:23:41.673 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:41.673 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:41.673 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.673 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.673 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:41.673 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:41.674 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:41.674 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:41.674 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:41.674 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:41.674 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f392bfff640 10 monclient: _finish_auth 0 2026-02-17T21:23:41.674 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f392bfff640 10 monclient: _check_auth_tickets 2026-02-17T21:23:41.674 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f392bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:41.674 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f3955c1b640 5 monclient: authenticate success, global_id 4145 2026-02-17T21:23:41.674 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f392bfff640 1 -- 10.20.193.176:0/1714207381 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3940005470 con 0x7f395011b340 2026-02-17T21:23:41.674 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f392bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:41.674 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f3955c1b640 10 monclient: _renew_subs 2026-02-17T21:23:41.674 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f392bfff640 1 -- 10.20.193.176:0/1714207381 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39400038f0 con 0x7f395011b340 2026-02-17T21:23:41.675 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f3955c1b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:41.675 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f3955c1b640 1 -- 10.20.193.176:0/1714207381 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39501b7d00 con 0x7f395011b340 2026-02-17T21:23:41.675 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f394dffb640 4 set_mon_vals no callback set 2026-02-17T21:23:41.675 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f392bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:41.675 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f392bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:23:41.675 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f392bfff640 10 monclient: dump: 2026-02-17T21:23:41.675 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:41.675 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:41.675 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.675 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.675 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:41.675 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:41.676 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:41.676 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:41.676 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:41.676 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:41.676 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f3955c1b640 10 client.4145.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:23:41.676 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f3955c1b640 10 monclient: _renew_subs 2026-02-17T21:23:41.676 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f3955c1b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:41.676 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f3955c1b640 1 -- 10.20.193.176:0/1714207381 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39501b82c0 con 0x7f395011b340 2026-02-17T21:23:41.676 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f3955c1b640 1 librados: init done 2026-02-17T21:23:41.676 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f3955c1b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:41.676 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f3955c1b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:41.677 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f3955c1b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:41.677 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.652+0000 7f3955c1b640 1 -- 10.20.193.176:0/1714207381 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3950122750 con 0x7f395011b340 2026-02-17T21:23:41.678 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.660+0000 7f392bfff640 1 -- 10.20.193.176:0/1714207381 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 2) ==== 50143+0+0 (secure 0 0 0) 0x7f3940003a90 con 0x7f395011b340 2026-02-17T21:23:41.678 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.661+0000 7f392bfff640 1 -- 10.20.193.176:0/1714207381 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f3940003db0 con 0x7f395011b340 2026-02-17T21:23:41.678 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.661+0000 7f392bfff640 10 client.4145.objecter ms_dispatch2 0x7f3950000b90 osd_map(7..7 src has 1..7) 2026-02-17T21:23:41.678 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.661+0000 7f392bfff640 3 client.4145.objecter handle_osd_map got epochs [7,7] > 0 2026-02-17T21:23:41.678 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.661+0000 7f392bfff640 3 client.4145.objecter handle_osd_map decoding full epoch 7 2026-02-17T21:23:41.678 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.661+0000 7f392bfff640 20 client.4145.objecter dump_active .. 0 homeless 2026-02-17T21:23:41.705 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.701+0000 7f392bfff640 1 -- 10.20.193.176:0/1714207381 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f394000a640 con 0x7f395011b340 2026-02-17T21:23:41.705 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.701+0000 7f392bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:41.706 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.701+0000 7f392bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:23:41.721 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:41.717+0000 7f4fa5bdb140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T21:23:41.738 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.734+0000 7f3955c1b640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "d73b7c38-cef9-4993-b353-908c1d87603c", "id": 5}] 2026-02-17T21:23:41.738 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.734+0000 7f3955c1b640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "d73b7c38-cef9-4993-b353-908c1d87603c", "id": 5}] 2026-02-17T21:23:41.738 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.734+0000 7f3955c1b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:41.739 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.734+0000 7f3955c1b640 1 -- 10.20.193.176:0/1714207381 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d73b7c38-cef9-4993-b353-908c1d87603c", "id": 5} v 0) -- 0x7f39501b8590 con 0x7f395011b340 2026-02-17T21:23:41.782 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.778+0000 7f392bfff640 1 -- 10.20.193.176:0/1714207381 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d73b7c38-cef9-4993-b353-908c1d87603c", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f394000ada0 con 0x7f395011b340 2026-02-17T21:23:41.782 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.778+0000 7f392bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "d73b7c38-cef9-4993-b353-908c1d87603c", "id": 5}] 2026-02-17T21:23:41.782 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.778+0000 7f392bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:23:41.782 INFO:teuthology.orchestra.run.trial176.stdout:5 2026-02-17T21:23:41.783 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.778+0000 7f3955c1b640 10 librados: watch_flush enter 2026-02-17T21:23:41.783 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.778+0000 7f3955c1b640 10 librados: watch_flush exit 2026-02-17T21:23:41.783 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.778+0000 7f3955c1b640 20 client.4145.objecter shutdown clearing up homeless session... 2026-02-17T21:23:41.783 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.778+0000 7f3955c1b640 10 client.4145.objecter successfully canceled tick 2026-02-17T21:23:41.783 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.779+0000 7f3955c1b640 10 monclient: shutdown 2026-02-17T21:23:41.783 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.779+0000 7f3955c1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:41.783 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.779+0000 7f3955c1b640 1 -- 10.20.193.176:0/1714207381 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f395011b340 msgr2=0x7f39500700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:41.783 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.779+0000 7f3955c1b640 1 --2- 10.20.193.176:0/1714207381 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f395011b340 0x7f39500700d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f394000c6e0 tx=0x7f394000cbb0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.783 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.779+0000 7f3955c1b640 1 -- 10.20.193.176:0/1714207381 shutdown_connections 2026-02-17T21:23:41.784 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.779+0000 7f3955c1b640 1 --2- 10.20.193.176:0/1714207381 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f395011eee0 0x7f39501b7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.784 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.779+0000 7f3955c1b640 1 --2- 10.20.193.176:0/1714207381 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f395011b340 0x7f39500700d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.784 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.779+0000 7f3955c1b640 1 --2- 10.20.193.176:0/1714207381 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3950112750 0x7f395006fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.784 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.779+0000 7f3955c1b640 1 -- 10.20.193.176:0/1714207381 >> 10.20.193.176:0/1714207381 conn(0x7f395006dba0 msgr2=0x7f39501192f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:41.784 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.779+0000 7f3955c1b640 1 -- 10.20.193.176:0/1714207381 shutdown_connections 2026-02-17T21:23:41.784 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.779+0000 7f3955c1b640 1 -- 10.20.193.176:0/1714207381 wait complete. 2026-02-17T21:23:41.784 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.779+0000 7f3955c1b640 1 librados: shutdown 2026-02-17T21:23:41.791 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph --cluster ceph osd new f7774c25-72e8-41b2-8634-517af7a213b3 6 2026-02-17T21:23:41.839 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:41.835+0000 7f4fa5bdb140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T21:23:41.856 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.852+0000 7fcd994b0640 10 monclient: get_monmap_and_config 2026-02-17T21:23:41.856 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.852+0000 7fcd994b0640 10 monclient: build_initial_monmap 2026-02-17T21:23:41.857 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.852+0000 7fcd994b0640 10 monclient: monmap: 2026-02-17T21:23:41.857 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:41.857 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:41.857 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:23:41.854443+0000 2026-02-17T21:23:41.857 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:23:41.854443+0000 2026-02-17T21:23:41.857 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:41.857 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:41.857 INFO:teuthology.orchestra.run.trial176.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:23:41.857 INFO:teuthology.orchestra.run.trial176.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:23:41.857 INFO:teuthology.orchestra.run.trial176.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:23:41.857 INFO:teuthology.orchestra.run.trial176.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:23:41.857 INFO:teuthology.orchestra.run.trial176.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:23:41.858 INFO:teuthology.orchestra.run.trial176.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:23:41.858 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:41.861 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.853+0000 7fcd994b0640 1 Processor -- start 2026-02-17T21:23:41.861 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.853+0000 7fcd994b0640 1 -- start start 2026-02-17T21:23:41.861 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.853+0000 7fcd994b0640 10 monclient: init 2026-02-17T21:23:41.861 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.853+0000 7fcd994b0640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:41.861 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.853+0000 7fcd994b0640 10 monclient: _add_conns ranks=[0,5,3,2,1,4] 2026-02-17T21:23:41.861 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.853+0000 7fcd994b0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fcd941149f0 addr v1:10.20.193.5:6789/0 2026-02-17T21:23:41.861 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.853+0000 7fcd994b0640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fcd9411d5c0 0x7fcd9411f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:41.861 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.853+0000 7fcd994b0640 10 monclient(hunting): picked mon.noname-c con 0x7fcd9411d5c0 addr v2:10.20.193.135:3300/0 2026-02-17T21:23:41.861 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.853+0000 7fcd994b0640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fcd9411ff80 0x7fcd94122440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:41.861 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.853+0000 7fcd994b0640 10 monclient(hunting): picked mon.noname-a con 0x7fcd9411ff80 addr v2:10.20.193.5:3300/0 2026-02-17T21:23:41.862 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.853+0000 7fcd994b0640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd94122b60 con 0x7fcd941149f0 2026-02-17T21:23:41.862 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.853+0000 7fcd994b0640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:41.862 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.853+0000 7fcd994b0640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fcd94123d80 con 0x7fcd9411ff80 2026-02-17T21:23:41.862 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.853+0000 7fcd994b0640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:41.862 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.853+0000 7fcd994b0640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fcd94123f00 con 0x7fcd9411d5c0 2026-02-17T21:23:41.862 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.853+0000 7fcd994b0640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:41.862 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.853+0000 7fcd994b0640 10 monclient(hunting): authenticate will time out at 960.496452s 2026-02-17T21:23:41.862 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.853+0000 7fcd927fc640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fcd9411d5c0 0x7fcd9411f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:41.862 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.853+0000 7fcd937fe640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fcd9411ff80 0x7fcd94122440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:41.862 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.854+0000 7fcd927fc640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fcd9411d5c0 0x7fcd9411f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.176:59678/0 (socket says 10.20.193.176:59678) 2026-02-17T21:23:41.862 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.854+0000 7fcd927fc640 1 -- 10.20.193.176:0/1548304632 learned_addr learned my addr 10.20.193.176:0/1548304632 (peer_addr_for_me v2:10.20.193.176:0/0) 2026-02-17T21:23:41.862 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.854+0000 7fcd927fc640 10 monclient(hunting): get_auth_request con 0x7fcd9411d5c0 auth_method 0 2026-02-17T21:23:41.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.854+0000 7fcd927fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:41.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.854+0000 7fcd927fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:41.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.854+0000 7fcd927fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:41.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.854+0000 7fcd937fe640 10 monclient(hunting): get_auth_request con 0x7fcd9411ff80 auth_method 0 2026-02-17T21:23:41.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.854+0000 7fcd937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:41.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.854+0000 7fcd937fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:41.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.854+0000 7fcd937fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:41.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.854+0000 7fcd927fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:41.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.854+0000 7fcd927fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:41.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.854+0000 7fcd927fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:41.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.854+0000 7fcd937fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:41.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.854+0000 7fcd937fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:41.863 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.854+0000 7fcd937fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:41.864 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.855+0000 7fcd927fc640 10 monclient(hunting): handle_auth_done global_id 4148 payload 274 2026-02-17T21:23:41.864 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.855+0000 7fcd927fc640 1 -- 10.20.193.176:0/1548304632 >> v2:10.20.193.5:3300/0 conn(0x7fcd9411ff80 msgr2=0x7fcd94122440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:23:41.864 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.855+0000 7fcd927fc640 1 --2- 10.20.193.176:0/1548304632 >> v2:10.20.193.5:3300/0 conn(0x7fcd9411ff80 0x7fcd94122440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.864 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.855+0000 7fcd927fc640 1 -- 10.20.193.176:0/1548304632 >> v1:10.20.193.5:6789/0 conn(0x7fcd941149f0 legacy=0x7fcd94114dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:41.864 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.855+0000 7fcd927fc640 10 monclient: _finish_hunting 0 2026-02-17T21:23:41.864 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.855+0000 7fcd927fc640 1 monclient: found mon.noname-c 2026-02-17T21:23:41.864 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.855+0000 7fcd927fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:41.864 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.855+0000 7fcd927fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:23:41.864 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.855+0000 7fcd927fc640 1 -- 10.20.193.176:0/1548304632 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd941240b0 con 0x7fcd9411d5c0 2026-02-17T21:23:41.864 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.856+0000 7fcd927fc640 1 --2- 10.20.193.176:0/1548304632 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fcd9411d5c0 0x7fcd9411f9b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcd941146b0 tx=0x7fcd7c02eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6444d5f0359b8cb server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:41.865 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd91ffb640 1 -- 10.20.193.176:0/1548304632 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c03c070 con 0x7fcd9411d5c0 2026-02-17T21:23:41.866 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd91ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:41.866 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd91ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:23:41.866 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd91ffb640 10 monclient: dump: 2026-02-17T21:23:41.866 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:41.866 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:41.866 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.866 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.866 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:41.866 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:41.866 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:41.866 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:41.866 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:41.867 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:41.867 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd91ffb640 10 monclient: _finish_auth 0 2026-02-17T21:23:41.867 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd91ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:23:41.867 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd91ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:41.867 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd91ffb640 1 -- 10.20.193.176:0/1548304632 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd7c02fbe0 con 0x7fcd9411d5c0 2026-02-17T21:23:41.867 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd91ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:41.867 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd91ffb640 1 -- 10.20.193.176:0/1548304632 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c037440 con 0x7fcd9411d5c0 2026-02-17T21:23:41.867 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd994b0640 5 monclient: authenticate success, global_id 4148 2026-02-17T21:23:41.867 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd994b0640 10 monclient: get_monmap_and_config success 2026-02-17T21:23:41.867 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd994b0640 4 set_mon_vals no callback set 2026-02-17T21:23:41.867 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd91ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:41.867 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd91ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:23:41.867 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd91ffb640 10 monclient: dump: 2026-02-17T21:23:41.867 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:41.868 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:41.868 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.868 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.868 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:41.868 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:41.868 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:41.868 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:41.868 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:41.868 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:41.868 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:41.858+0000 7f4fa5bdb140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T21:23:41.873 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd994b0640 10 monclient: shutdown 2026-02-17T21:23:41.873 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd994b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:41.873 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd994b0640 1 -- 10.20.193.176:0/1548304632 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fcd9411d5c0 msgr2=0x7fcd9411f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:41.873 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd994b0640 1 --2- 10.20.193.176:0/1548304632 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fcd9411d5c0 0x7fcd9411f9b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcd941146b0 tx=0x7fcd7c02eed0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.874 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd994b0640 1 -- 10.20.193.176:0/1548304632 shutdown_connections 2026-02-17T21:23:41.874 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd994b0640 1 --2- 10.20.193.176:0/1548304632 >> v2:10.20.193.5:3300/0 conn(0x7fcd9411ff80 0x7fcd94122440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.874 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd994b0640 1 --2- 10.20.193.176:0/1548304632 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fcd9411d5c0 0x7fcd9411f9b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.874 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd994b0640 1 -- 10.20.193.176:0/1548304632 >> 10.20.193.176:0/1548304632 conn(0x7fcd94073660 msgr2=0x7fcd94073a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:41.874 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd994b0640 1 -- 10.20.193.176:0/1548304632 shutdown_connections 2026-02-17T21:23:41.874 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd994b0640 1 -- 10.20.193.176:0/1548304632 wait complete. 2026-02-17T21:23:41.874 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd994b0640 10 monclient: build_initial_monmap 2026-02-17T21:23:41.874 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd994b0640 10 monclient: monmap: 2026-02-17T21:23:41.874 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:41.874 INFO:teuthology.orchestra.run.trial176.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:23:41.874 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 0.000000 2026-02-17T21:23:41.874 INFO:teuthology.orchestra.run.trial176.stderr:created 0.000000 2026-02-17T21:23:41.874 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:41.874 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:41.875 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:23:41.875 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:23:41.875 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:23:41.875 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:41.875 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd994b0640 1 librados: starting msgr at 2026-02-17T21:23:41.875 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd994b0640 1 librados: starting objecter 2026-02-17T21:23:41.875 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd994b0640 1 Processor -- start 2026-02-17T21:23:41.875 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd994b0640 1 -- start start 2026-02-17T21:23:41.875 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd994b0640 1 librados: setting wanted keys 2026-02-17T21:23:41.875 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd994b0640 1 librados: calling monclient init 2026-02-17T21:23:41.875 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd994b0640 10 monclient: init 2026-02-17T21:23:41.875 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.858+0000 7fcd994b0640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:41.875 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd994b0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:23:41.875 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd994b0640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fcd941149f0 0x7fcd941ab930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:41.876 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd994b0640 10 monclient(hunting): picked mon.noname-b con 0x7fcd941149f0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:23:41.876 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd994b0640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fcd9411d5c0 0x7fcd941abfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:41.876 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd994b0640 10 monclient(hunting): picked mon.noname-c con 0x7fcd9411d5c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:23:41.876 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd994b0640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fcd9411ff80 0x7fcd941b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:41.876 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd994b0640 10 monclient(hunting): picked mon.noname-a con 0x7fcd9411ff80 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:23:41.876 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd994b0640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:41.876 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd994b0640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcd941231b0 con 0x7fcd9411ff80 2026-02-17T21:23:41.876 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd994b0640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:41.876 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd994b0640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcd94123030 con 0x7fcd941149f0 2026-02-17T21:23:41.876 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd994b0640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:41.876 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd994b0640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcd94123330 con 0x7fcd9411d5c0 2026-02-17T21:23:41.876 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd994b0640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:41.876 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd994b0640 10 monclient(hunting): authenticate will time out at 960.502049s 2026-02-17T21:23:41.876 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd937fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fcd9411ff80 0x7fcd941b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:41.877 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd927fc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fcd9411d5c0 0x7fcd941abfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:41.877 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd927fc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fcd9411d5c0 0x7fcd941abfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.176:59682/0 (socket says 10.20.193.176:59682) 2026-02-17T21:23:41.877 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd927fc640 1 -- 10.20.193.176:0/3832808252 learned_addr learned my addr 10.20.193.176:0/3832808252 (peer_addr_for_me v2:10.20.193.176:0/0) 2026-02-17T21:23:41.877 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd927fc640 10 monclient(hunting): get_auth_request con 0x7fcd9411d5c0 auth_method 0 2026-02-17T21:23:41.877 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd927fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:41.877 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd927fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:41.877 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd927fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:41.877 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd92ffd640 1 --2- 10.20.193.176:0/3832808252 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fcd941149f0 0x7fcd941ab930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:41.877 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd937fe640 10 monclient(hunting): get_auth_request con 0x7fcd9411ff80 auth_method 0 2026-02-17T21:23:41.877 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:41.877 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd937fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:41.877 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd937fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:41.877 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd92ffd640 10 monclient(hunting): get_auth_request con 0x7fcd941149f0 auth_method 0 2026-02-17T21:23:41.878 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd92ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:41.878 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd92ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:41.878 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd92ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:41.878 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd927fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:41.878 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd927fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:41.878 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd927fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:41.878 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd92ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:41.878 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd92ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:41.878 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.859+0000 7fcd92ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:41.878 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.860+0000 7fcd937fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:41.878 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.860+0000 7fcd937fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:41.878 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.860+0000 7fcd937fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:41.878 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.860+0000 7fcd927fc640 10 monclient(hunting): handle_auth_done global_id 4151 payload 824 2026-02-17T21:23:41.878 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.860+0000 7fcd927fc640 1 -- 10.20.193.176:0/3832808252 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fcd941149f0 msgr2=0x7fcd941ab930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:41.878 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.860+0000 7fcd927fc640 1 --2- 10.20.193.176:0/3832808252 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fcd941149f0 0x7fcd941ab930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.879 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.860+0000 7fcd927fc640 1 -- 10.20.193.176:0/3832808252 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fcd9411ff80 msgr2=0x7fcd941b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:41.879 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.860+0000 7fcd927fc640 1 --2- 10.20.193.176:0/3832808252 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fcd9411ff80 0x7fcd941b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.879 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.860+0000 7fcd927fc640 10 monclient: _finish_hunting 0 2026-02-17T21:23:41.879 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.860+0000 7fcd927fc640 1 monclient: found mon.noname-c 2026-02-17T21:23:41.879 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.860+0000 7fcd927fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:41.879 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.860+0000 7fcd927fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:23:41.879 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.860+0000 7fcd927fc640 1 -- 10.20.193.176:0/3832808252 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd941b08e0 con 0x7fcd9411d5c0 2026-02-17T21:23:41.879 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.861+0000 7fcd927fc640 1 --2- 10.20.193.176:0/3832808252 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fcd9411d5c0 0x7fcd941abfa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c009a70 tx=0x7fcd7c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:41.879 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.861+0000 7fcd737fe640 10 client.?.objecter ms_handle_connect 0x7fcd9411d5c0 2026-02-17T21:23:41.879 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.861+0000 7fcd737fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:23:41.879 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd737fe640 1 -- 10.20.193.176:0/3832808252 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c03c040 con 0x7fcd9411d5c0 2026-02-17T21:23:41.879 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd737fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:41.879 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd737fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:23:41.879 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd737fe640 10 monclient: dump: 2026-02-17T21:23:41.880 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:41.880 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:41.880 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.880 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.880 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:41.880 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:41.880 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:41.880 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:41.880 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:41.880 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:41.880 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd737fe640 10 monclient: _finish_auth 0 2026-02-17T21:23:41.880 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd737fe640 10 monclient: _check_auth_tickets 2026-02-17T21:23:41.880 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd737fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:41.880 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd737fe640 1 -- 10.20.193.176:0/3832808252 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd7c042630 con 0x7fcd9411d5c0 2026-02-17T21:23:41.881 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd737fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:41.881 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd737fe640 1 -- 10.20.193.176:0/3832808252 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c042a20 con 0x7fcd9411d5c0 2026-02-17T21:23:41.881 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd737fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:41.881 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd737fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:23:41.881 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd917fa640 4 set_mon_vals no callback set 2026-02-17T21:23:41.881 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd737fe640 10 monclient: dump: 2026-02-17T21:23:41.881 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:41.881 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:41.881 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.881 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:41.881 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:41.881 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:41.882 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:41.882 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:41.882 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:41.882 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:41.882 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd994b0640 5 monclient: authenticate success, global_id 4151 2026-02-17T21:23:41.882 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd994b0640 10 monclient: _renew_subs 2026-02-17T21:23:41.882 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd994b0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:41.882 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd994b0640 1 -- 10.20.193.176:0/3832808252 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd941b0b70 con 0x7fcd9411d5c0 2026-02-17T21:23:41.882 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd994b0640 10 client.4151.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:23:41.882 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd994b0640 10 monclient: _renew_subs 2026-02-17T21:23:41.882 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd994b0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:41.882 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd994b0640 1 -- 10.20.193.176:0/3832808252 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd941b8350 con 0x7fcd9411d5c0 2026-02-17T21:23:41.883 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd994b0640 1 librados: init done 2026-02-17T21:23:41.883 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd994b0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:41.883 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd994b0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:41.883 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd994b0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:41.883 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.863+0000 7fcd994b0640 1 -- 10.20.193.176:0/3832808252 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd94123740 con 0x7fcd9411d5c0 2026-02-17T21:23:41.883 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.869+0000 7fcd737fe640 1 -- 10.20.193.176:0/3832808252 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 2) ==== 50143+0+0 (secure 0 0 0) 0x7fcd7c042bc0 con 0x7fcd9411d5c0 2026-02-17T21:23:41.884 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.870+0000 7fcd737fe640 1 -- 10.20.193.176:0/3832808252 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fcd7c04adc0 con 0x7fcd9411d5c0 2026-02-17T21:23:41.884 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.870+0000 7fcd737fe640 10 client.4151.objecter ms_dispatch2 0x7fcd94000b90 osd_map(8..8 src has 1..8) 2026-02-17T21:23:41.884 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.870+0000 7fcd737fe640 3 client.4151.objecter handle_osd_map got epochs [8,8] > 0 2026-02-17T21:23:41.884 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.870+0000 7fcd737fe640 3 client.4151.objecter handle_osd_map decoding full epoch 8 2026-02-17T21:23:41.884 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.870+0000 7fcd737fe640 20 client.4151.objecter dump_active .. 0 homeless 2026-02-17T21:23:41.887 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:41.884+0000 7f4fa5bdb140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T21:23:41.909 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:41.905+0000 7f4fa5bdb140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T21:23:41.914 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.910+0000 7fcd737fe640 1 -- 10.20.193.176:0/3832808252 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fcd7c02faa0 con 0x7fcd9411d5c0 2026-02-17T21:23:41.914 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.910+0000 7fcd737fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:41.914 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.910+0000 7fcd737fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:23:41.934 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:41.930+0000 7f4fa5bdb140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T21:23:41.946 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.942+0000 7fcd994b0640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "f7774c25-72e8-41b2-8634-517af7a213b3", "id": 6}] 2026-02-17T21:23:41.946 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.942+0000 7fcd994b0640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "f7774c25-72e8-41b2-8634-517af7a213b3", "id": 6}] 2026-02-17T21:23:41.946 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.942+0000 7fcd994b0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:41.947 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.942+0000 7fcd994b0640 1 -- 10.20.193.176:0/3832808252 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f7774c25-72e8-41b2-8634-517af7a213b3", "id": 6} v 0) -- 0x7fcd941b8520 con 0x7fcd9411d5c0 2026-02-17T21:23:41.986 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:41.982+0000 7f4fa5bdb140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T21:23:41.989 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.985+0000 7fcd737fe640 1 -- 10.20.193.176:0/3832808252 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f7774c25-72e8-41b2-8634-517af7a213b3", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fcd7c055620 con 0x7fcd9411d5c0 2026-02-17T21:23:41.989 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.985+0000 7fcd737fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "f7774c25-72e8-41b2-8634-517af7a213b3", "id": 6}] 2026-02-17T21:23:41.989 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.985+0000 7fcd737fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:23:41.990 INFO:teuthology.orchestra.run.trial176.stdout:6 2026-02-17T21:23:41.991 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.986+0000 7fcd994b0640 10 librados: watch_flush enter 2026-02-17T21:23:41.991 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.986+0000 7fcd994b0640 10 librados: watch_flush exit 2026-02-17T21:23:41.991 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.986+0000 7fcd994b0640 20 client.4151.objecter shutdown clearing up homeless session... 2026-02-17T21:23:41.991 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.986+0000 7fcd994b0640 10 client.4151.objecter successfully canceled tick 2026-02-17T21:23:41.991 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.986+0000 7fcd994b0640 10 monclient: shutdown 2026-02-17T21:23:41.991 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.986+0000 7fcd994b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:41.992 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.986+0000 7fcd994b0640 1 -- 10.20.193.176:0/3832808252 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fcd9411d5c0 msgr2=0x7fcd941abfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:41.992 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.986+0000 7fcd994b0640 1 --2- 10.20.193.176:0/3832808252 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fcd9411d5c0 0x7fcd941abfa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c009a70 tx=0x7fcd7c0047c0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.992 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.986+0000 7fcd994b0640 1 -- 10.20.193.176:0/3832808252 shutdown_connections 2026-02-17T21:23:41.992 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.986+0000 7fcd994b0640 1 --2- 10.20.193.176:0/3832808252 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fcd9411ff80 0x7fcd941b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.992 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.986+0000 7fcd994b0640 1 --2- 10.20.193.176:0/3832808252 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fcd9411d5c0 0x7fcd941abfa0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.992 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.986+0000 7fcd994b0640 1 --2- 10.20.193.176:0/3832808252 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fcd941149f0 0x7fcd941ab930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:41.992 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.986+0000 7fcd994b0640 1 -- 10.20.193.176:0/3832808252 >> 10.20.193.176:0/3832808252 conn(0x7fcd94073660 msgr2=0x7fcd94112b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:41.992 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.986+0000 7fcd994b0640 1 -- 10.20.193.176:0/3832808252 shutdown_connections 2026-02-17T21:23:41.992 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.986+0000 7fcd994b0640 1 -- 10.20.193.176:0/3832808252 wait complete. 2026-02-17T21:23:41.992 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:41.986+0000 7fcd994b0640 1 librados: shutdown 2026-02-17T21:23:41.998 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph --cluster ceph osd new 30a68802-afce-499b-90ce-bd568bc69406 7 2026-02-17T21:23:42.047 INFO:tasks.ceph.mgr.x.trial176.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T21:23:42.047 INFO:tasks.ceph.mgr.x.trial176.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T21:23:42.048 INFO:tasks.ceph.mgr.x.trial176.stderr: from numpy import show_config as show_numpy_config 2026-02-17T21:23:42.050 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:42.046+0000 7f4fa5bdb140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T21:23:42.061 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.057+0000 7f6c88674640 10 monclient: get_monmap_and_config 2026-02-17T21:23:42.061 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.057+0000 7f6c88674640 10 monclient: build_initial_monmap 2026-02-17T21:23:42.061 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.057+0000 7f6c88674640 10 monclient: monmap: 2026-02-17T21:23:42.062 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:42.062 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:42.062 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:23:42.058766+0000 2026-02-17T21:23:42.062 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:23:42.058766+0000 2026-02-17T21:23:42.062 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:42.062 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:42.062 INFO:teuthology.orchestra.run.trial176.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:23:42.062 INFO:teuthology.orchestra.run.trial176.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:23:42.062 INFO:teuthology.orchestra.run.trial176.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:23:42.062 INFO:teuthology.orchestra.run.trial176.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:23:42.062 INFO:teuthology.orchestra.run.trial176.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:23:42.063 INFO:teuthology.orchestra.run.trial176.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:23:42.063 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:42.063 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.057+0000 7f6c88674640 1 Processor -- start 2026-02-17T21:23:42.063 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.057+0000 7f6c88674640 1 -- start start 2026-02-17T21:23:42.063 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.057+0000 7f6c88674640 10 monclient: init 2026-02-17T21:23:42.063 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.057+0000 7f6c88674640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:42.063 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.057+0000 7f6c88674640 10 monclient: _add_conns ranks=[3,2,1,0,4,5] 2026-02-17T21:23:42.063 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.057+0000 7f6c88674640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f6c80073830 0x7f6c801181d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:42.063 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.057+0000 7f6c88674640 10 monclient(hunting): picked mon.noname-a con 0x7f6c80073830 addr v2:10.20.193.5:3300/0 2026-02-17T21:23:42.063 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.057+0000 7f6c88674640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6c80073c10 addr v1:10.20.193.135:6789/0 2026-02-17T21:23:42.063 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.057+0000 7f6c88674640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f6c80074080 addr v1:10.20.193.119:6789/0 2026-02-17T21:23:42.063 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.057+0000 7f6c88674640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c80128250 con 0x7f6c80074080 2026-02-17T21:23:42.064 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.057+0000 7f6c88674640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c80129470 con 0x7f6c80073c10 2026-02-17T21:23:42.064 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.057+0000 7f6c88674640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:42.064 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.057+0000 7f6c88674640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6c8012a670 con 0x7f6c80073830 2026-02-17T21:23:42.064 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.057+0000 7f6c88674640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:42.064 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.057+0000 7f6c88674640 10 monclient(hunting): authenticate will time out at 960.700657s 2026-02-17T21:23:42.066 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.058+0000 7f6c86bea640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f6c80074080 0x7f6c80126a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.176:41228/0 (socket says 10.20.193.176:41228) 2026-02-17T21:23:42.066 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.058+0000 7f6c86bea640 1 -- 10.20.193.176:0/139707522 learned_addr learned my addr 10.20.193.176:0/139707522 (peer_addr_for_me v1:10.20.193.176:0/0) 2026-02-17T21:23:42.066 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.059+0000 7f6c853e7640 1 -- 10.20.193.176:0/139707522 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4032180008 0 0) 0x7f6c80129470 con 0x7f6c80073c10 2026-02-17T21:23:42.066 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.059+0000 7f6c853e7640 10 monclient(hunting): _negotiate 2026-02-17T21:23:42.066 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.059+0000 7f6c853e7640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:42.067 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.059+0000 7f6c853e7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:42.067 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.059+0000 7f6c853e7640 10 monclient(hunting): my global_id is 4154 2026-02-17T21:23:42.067 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.059+0000 7f6c853e7640 1 -- 10.20.193.176:0/139707522 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c68003620 con 0x7f6c80073c10 2026-02-17T21:23:42.067 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.059+0000 7f6c853e7640 1 -- 10.20.193.176:0/139707522 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2792121964 0 0) 0x7f6c80128250 con 0x7f6c80074080 2026-02-17T21:23:42.067 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.059+0000 7f6c853e7640 10 monclient(hunting): _negotiate 2026-02-17T21:23:42.067 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.059+0000 7f6c853e7640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:42.067 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.059+0000 7f6c853e7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:42.067 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.059+0000 7f6c853e7640 10 monclient(hunting): my global_id is 4153 2026-02-17T21:23:42.067 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.059+0000 7f6c853e7640 1 -- 10.20.193.176:0/139707522 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c80129470 con 0x7f6c80074080 2026-02-17T21:23:42.067 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 1 -- 10.20.193.176:0/139707522 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2951306657 0 0) 0x7f6c80129470 con 0x7f6c80074080 2026-02-17T21:23:42.068 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 1 -- 10.20.193.176:0/139707522 >> v2:10.20.193.5:3300/0 conn(0x7f6c80073830 msgr2=0x7f6c801181d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:23:42.068 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 1 --2- 10.20.193.176:0/139707522 >> v2:10.20.193.5:3300/0 conn(0x7f6c80073830 0x7f6c801181d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.068 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 1 -- 10.20.193.176:0/139707522 >> v1:10.20.193.135:6789/0 conn(0x7f6c80073c10 legacy=0x7f6c80123340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:42.068 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 10 monclient: _finish_hunting 0 2026-02-17T21:23:42.068 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 1 monclient: found mon.noname-b-legacy 2026-02-17T21:23:42.068 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:42.068 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.119:6789/0 2026-02-17T21:23:42.068 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 1 -- 10.20.193.176:0/139707522 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8012a7f0 con 0x7f6c80074080 2026-02-17T21:23:42.068 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 10 monclient: _finish_auth 0 2026-02-17T21:23:42.068 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 10 monclient: _check_auth_tickets 2026-02-17T21:23:42.068 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:42.068 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 1 -- 10.20.193.176:0/139707522 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3880376286 0 0) 0x7f6c7c003260 con 0x7f6c80074080 2026-02-17T21:23:42.069 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:42.069 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T21:23:42.069 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 10 monclient: dump: 2026-02-17T21:23:42.069 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:42.069 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:42.069 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.069 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.069 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:42.069 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:42.069 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:42.069 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:42.069 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:42.070 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:42.070 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] but i'm connected to v1:10.20.193.119:6789/0, reconnecting 2026-02-17T21:23:42.070 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:42.070 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 1 -- 10.20.193.176:0/139707522 >> v1:10.20.193.119:6789/0 conn(0x7f6c80074080 legacy=0x7f6c80126a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:42.070 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:23:42.070 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 1 --2- 10.20.193.176:0/139707522 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6c68003dd0 0x7f6c680041d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:42.070 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 10 monclient(hunting): picked mon.c con 0x7f6c68003dd0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:23:42.070 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 1 --2- 10.20.193.176:0/139707522 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6c68004950 0x7f6c68004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:42.070 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 10 monclient(hunting): picked mon.b con 0x7f6c68004950 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:23:42.070 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 1 --2- 10.20.193.176:0/139707522 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6c68009ab0 0x7f6c6800bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:42.070 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 10 monclient(hunting): picked mon.a con 0x7f6c68009ab0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:23:42.070 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:42.070 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 1 -- 10.20.193.176:0/139707522 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8012a670 con 0x7f6c68009ab0 2026-02-17T21:23:42.071 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:42.071 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 1 -- 10.20.193.176:0/139707522 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6800c5a0 con 0x7f6c68004950 2026-02-17T21:23:42.071 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:42.071 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 1 -- 10.20.193.176:0/139707522 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6800c7a0 con 0x7f6c68003dd0 2026-02-17T21:23:42.071 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:42.071 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.061+0000 7f6c853e7640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:23:42.071 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.062+0000 7f6c85be8640 1 --2- 10.20.193.176:0/139707522 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6c68004950 0x7f6c68004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:42.071 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.062+0000 7f6c85be8640 10 monclient(hunting): get_auth_request con 0x7f6c68004950 auth_method 0 2026-02-17T21:23:42.071 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.062+0000 7f6c85be8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:42.071 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.062+0000 7f6c85be8640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:42.071 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.062+0000 7f6c85be8640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:23:42.077 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.063+0000 7f6c85be8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:42.077 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.063+0000 7f6c85be8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:42.077 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.063+0000 7f6c85be8640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:23:42.077 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.063+0000 7f6c863e9640 1 --2- 10.20.193.176:0/139707522 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6c68003dd0 0x7f6c680041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:42.077 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.063+0000 7f6c863e9640 10 monclient(hunting): get_auth_request con 0x7f6c68003dd0 auth_method 0 2026-02-17T21:23:42.077 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.063+0000 7f6c863e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:42.077 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.063+0000 7f6c863e9640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:42.077 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.063+0000 7f6c863e9640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:23:42.077 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.063+0000 7f6c85be8640 10 monclient(hunting): handle_auth_done global_id 4153 payload 293 2026-02-17T21:23:42.077 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.063+0000 7f6c85be8640 1 -- 10.20.193.176:0/139707522 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6c68003dd0 msgr2=0x7f6c680041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:23:42.078 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.063+0000 7f6c85be8640 1 --2- 10.20.193.176:0/139707522 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6c68003dd0 0x7f6c680041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.078 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.063+0000 7f6c85be8640 1 -- 10.20.193.176:0/139707522 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6c68009ab0 msgr2=0x7f6c6800bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:23:42.078 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.063+0000 7f6c85be8640 1 --2- 10.20.193.176:0/139707522 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6c68009ab0 0x7f6c6800bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.078 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.063+0000 7f6c85be8640 10 monclient: _finish_hunting 0 2026-02-17T21:23:42.078 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.063+0000 7f6c85be8640 1 monclient: found mon.b 2026-02-17T21:23:42.078 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.063+0000 7f6c85be8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:42.078 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.063+0000 7f6c85be8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:42.078 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.063+0000 7f6c85be8640 1 -- 10.20.193.176:0/139707522 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c80129470 con 0x7f6c68004950 2026-02-17T21:23:42.078 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.063+0000 7f6c86bea640 1 -- 10.20.193.176:0/139707522 reap_dead start 2026-02-17T21:23:42.078 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.063+0000 7f6c85be8640 10 monclient: _finish_auth 0 2026-02-17T21:23:42.078 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.063+0000 7f6c85be8640 10 monclient: _check_auth_tickets 2026-02-17T21:23:42.078 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.063+0000 7f6c85be8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:42.078 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.063+0000 7f6c88674640 5 monclient: authenticate success, global_id 4153 2026-02-17T21:23:42.079 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.063+0000 7f6c88674640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:23:42.079 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.064+0000 7f6c85be8640 1 --2- 10.20.193.176:0/139707522 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6c68004950 0x7f6c68004db0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6c74003290 tx=0x7f6c7402efb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56e7827516aef48f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:42.079 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.066+0000 7f6c853e7640 1 -- 10.20.193.176:0/139707522 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c74002eb0 con 0x7f6c68004950 2026-02-17T21:23:42.079 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.066+0000 7f6c853e7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:42.079 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.066+0000 7f6c853e7640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:23:42.079 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.066+0000 7f6c853e7640 10 monclient: dump: 2026-02-17T21:23:42.079 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:42.079 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:42.079 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.079 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.079 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:42.080 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:42.080 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:42.080 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:42.080 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:42.080 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:42.080 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.066+0000 7f6c88674640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:23:42.080 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.066+0000 7f6c853e7640 1 -- 10.20.193.176:0/139707522 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c740052d0 con 0x7f6c68004950 2026-02-17T21:23:42.080 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.066+0000 7f6c853e7640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:42.080 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.066+0000 7f6c88674640 10 monclient: get_monmap_and_config success 2026-02-17T21:23:42.080 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.066+0000 7f6c88674640 4 set_mon_vals no callback set 2026-02-17T21:23:42.080 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.066+0000 7f6c853e7640 1 -- 10.20.193.176:0/139707522 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7402f810 con 0x7f6c68004950 2026-02-17T21:23:42.080 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.066+0000 7f6c853e7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:42.081 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.066+0000 7f6c853e7640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:23:42.081 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.066+0000 7f6c853e7640 10 monclient: dump: 2026-02-17T21:23:42.081 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:42.081 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:42.081 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.081 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.081 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:42.081 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:42.081 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:42.081 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:42.081 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:42.081 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:42.081 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.066+0000 7f6c88674640 10 monclient: shutdown 2026-02-17T21:23:42.082 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.066+0000 7f6c88674640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:42.082 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.066+0000 7f6c88674640 1 -- 10.20.193.176:0/139707522 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6c68004950 msgr2=0x7f6c68004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:42.082 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.066+0000 7f6c88674640 1 --2- 10.20.193.176:0/139707522 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6c68004950 0x7f6c68004db0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6c74003290 tx=0x7f6c7402efb0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.082 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.066+0000 7f6c88674640 1 -- 10.20.193.176:0/139707522 shutdown_connections 2026-02-17T21:23:42.082 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.066+0000 7f6c88674640 1 --2- 10.20.193.176:0/139707522 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6c68004950 0x7f6c68004db0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.082 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.066+0000 7f6c88674640 1 -- 10.20.193.176:0/139707522 >> 10.20.193.176:0/139707522 conn(0x7f6c8006f660 msgr2=0x7f6c80071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:42.082 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.066+0000 7f6c88674640 1 -- 10.20.193.176:0/139707522 shutdown_connections 2026-02-17T21:23:42.082 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.066+0000 7f6c88674640 1 -- 10.20.193.176:0/139707522 wait complete. 2026-02-17T21:23:42.082 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c88674640 10 monclient: build_initial_monmap 2026-02-17T21:23:42.082 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c88674640 10 monclient: monmap: 2026-02-17T21:23:42.083 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:42.083 INFO:teuthology.orchestra.run.trial176.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:23:42.083 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 0.000000 2026-02-17T21:23:42.083 INFO:teuthology.orchestra.run.trial176.stderr:created 0.000000 2026-02-17T21:23:42.083 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:42.083 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:42.083 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:23:42.083 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:23:42.083 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:23:42.083 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:42.083 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c88674640 1 librados: starting msgr at 2026-02-17T21:23:42.083 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c88674640 1 librados: starting objecter 2026-02-17T21:23:42.084 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c88674640 1 Processor -- start 2026-02-17T21:23:42.084 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c88674640 1 -- start start 2026-02-17T21:23:42.084 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c88674640 1 librados: setting wanted keys 2026-02-17T21:23:42.084 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c88674640 1 librados: calling monclient init 2026-02-17T21:23:42.084 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c88674640 10 monclient: init 2026-02-17T21:23:42.084 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c88674640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:42.084 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c88674640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:23:42.084 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c88674640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6c68004950 0x7f6c801b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:42.084 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c88674640 10 monclient(hunting): picked mon.noname-c con 0x7f6c68004950 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:23:42.084 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c88674640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6c801b6030 0x7f6c801265b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:42.084 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c88674640 10 monclient(hunting): picked mon.noname-b con 0x7f6c801b6030 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:23:42.084 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c88674640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6c80126af0 0x7f6c80126fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:42.085 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c88674640 10 monclient(hunting): picked mon.noname-a con 0x7f6c80126af0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:23:42.085 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c88674640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:42.085 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c88674640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6c80128870 con 0x7f6c80126af0 2026-02-17T21:23:42.085 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c88674640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:42.085 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c88674640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6c801286f0 con 0x7f6c801b6030 2026-02-17T21:23:42.085 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c88674640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:42.085 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c88674640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6c801289f0 con 0x7f6c68004950 2026-02-17T21:23:42.085 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c88674640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:42.085 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c88674640 10 monclient(hunting): authenticate will time out at 960.710558s 2026-02-17T21:23:42.085 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.067+0000 7f6c85be8640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6c801b6030 0x7f6c801265b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:42.085 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.068+0000 7f6c863e9640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6c68004950 0x7f6c801b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:42.085 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.068+0000 7f6c863e9640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6c68004950 0x7f6c801b5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.176:59714/0 (socket says 10.20.193.176:59714) 2026-02-17T21:23:42.085 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.068+0000 7f6c863e9640 1 -- 10.20.193.176:0/850088021 learned_addr learned my addr 10.20.193.176:0/850088021 (peer_addr_for_me v2:10.20.193.176:0/0) 2026-02-17T21:23:42.086 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.068+0000 7f6c863e9640 10 monclient(hunting): get_auth_request con 0x7f6c68004950 auth_method 0 2026-02-17T21:23:42.086 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.068+0000 7f6c863e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:42.086 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.068+0000 7f6c863e9640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:42.086 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.068+0000 7f6c863e9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:42.086 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.068+0000 7f6c863e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:42.086 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.068+0000 7f6c863e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:42.086 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.068+0000 7f6c863e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:42.086 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.068+0000 7f6c85be8640 10 monclient(hunting): get_auth_request con 0x7f6c801b6030 auth_method 0 2026-02-17T21:23:42.086 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.068+0000 7f6c85be8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:42.086 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.068+0000 7f6c85be8640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:42.086 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.068+0000 7f6c85be8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:42.086 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.069+0000 7f6c85be8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:42.086 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.069+0000 7f6c85be8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:42.087 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.069+0000 7f6c85be8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:42.087 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.069+0000 7f6c863e9640 10 monclient(hunting): handle_auth_done global_id 4157 payload 824 2026-02-17T21:23:42.087 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.069+0000 7f6c863e9640 1 -- 10.20.193.176:0/850088021 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6c801b6030 msgr2=0x7f6c801265b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:42.087 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.069+0000 7f6c863e9640 1 --2- 10.20.193.176:0/850088021 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6c801b6030 0x7f6c801265b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.087 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.069+0000 7f6c863e9640 1 -- 10.20.193.176:0/850088021 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6c80126af0 msgr2=0x7f6c80126fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:42.087 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.069+0000 7f6c863e9640 1 --2- 10.20.193.176:0/850088021 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6c80126af0 0x7f6c80126fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.087 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.069+0000 7f6c863e9640 10 monclient: _finish_hunting 0 2026-02-17T21:23:42.087 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.069+0000 7f6c863e9640 1 monclient: found mon.noname-c 2026-02-17T21:23:42.087 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.069+0000 7f6c863e9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:42.087 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.069+0000 7f6c863e9640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:23:42.087 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.069+0000 7f6c863e9640 1 -- 10.20.193.176:0/850088021 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c801bc8f0 con 0x7f6c68004950 2026-02-17T21:23:42.088 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:42.071+0000 7f4fa5bdb140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T21:23:42.090 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.071+0000 7f6c863e9640 1 --2- 10.20.193.176:0/850088021 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6c68004950 0x7f6c801b5a60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000d800 tx=0x7f6c7000dcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:42.090 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.071+0000 7f6c66ffd640 10 client.?.objecter ms_handle_connect 0x7f6c68004950 2026-02-17T21:23:42.090 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.071+0000 7f6c66ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:23:42.090 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c66ffd640 1 -- 10.20.193.176:0/850088021 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c700040d0 con 0x7f6c68004950 2026-02-17T21:23:42.090 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c66ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:42.090 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c66ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:23:42.091 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c66ffd640 10 monclient: dump: 2026-02-17T21:23:42.091 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:42.091 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:42.091 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.091 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.091 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:42.091 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:42.091 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:42.091 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:42.091 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:42.091 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:42.091 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c66ffd640 10 monclient: _finish_auth 0 2026-02-17T21:23:42.092 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c66ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:23:42.092 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c66ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:42.092 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c66ffd640 1 -- 10.20.193.176:0/850088021 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c70017070 con 0x7f6c68004950 2026-02-17T21:23:42.092 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c88674640 5 monclient: authenticate success, global_id 4157 2026-02-17T21:23:42.092 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c88674640 10 monclient: _renew_subs 2026-02-17T21:23:42.092 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c88674640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:42.092 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c88674640 1 -- 10.20.193.176:0/850088021 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c801bcb20 con 0x7f6c68004950 2026-02-17T21:23:42.092 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c66ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:42.092 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c66ffd640 1 -- 10.20.193.176:0/850088021 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c700044d0 con 0x7f6c68004950 2026-02-17T21:23:42.092 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c66ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:42.092 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c84be6640 4 set_mon_vals no callback set 2026-02-17T21:23:42.093 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c66ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:23:42.093 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c66ffd640 10 monclient: dump: 2026-02-17T21:23:42.093 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:42.093 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:42.093 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.093 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.093 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:42.093 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:42.093 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:42.093 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:42.093 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:42.093 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:42.093 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c88674640 10 client.4157.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:23:42.093 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c88674640 10 monclient: _renew_subs 2026-02-17T21:23:42.094 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c88674640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:42.094 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c88674640 1 -- 10.20.193.176:0/850088021 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c801bd070 con 0x7f6c68004950 2026-02-17T21:23:42.094 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c88674640 1 librados: init done 2026-02-17T21:23:42.094 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c88674640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:42.094 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c88674640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:42.094 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c88674640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:42.094 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.073+0000 7f6c88674640 1 -- 10.20.193.176:0/850088021 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c80128e50 con 0x7f6c68004950 2026-02-17T21:23:42.094 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.079+0000 7f6c66ffd640 1 -- 10.20.193.176:0/850088021 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 2) ==== 50143+0+0 (secure 0 0 0) 0x7f6c700026e0 con 0x7f6c68004950 2026-02-17T21:23:42.094 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.080+0000 7f6c66ffd640 1 -- 10.20.193.176:0/850088021 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f6c70024dc0 con 0x7f6c68004950 2026-02-17T21:23:42.094 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.080+0000 7f6c66ffd640 10 client.4157.objecter ms_dispatch2 0x7f6c80000b90 osd_map(9..9 src has 1..9) 2026-02-17T21:23:42.094 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.080+0000 7f6c66ffd640 3 client.4157.objecter handle_osd_map got epochs [9,9] > 0 2026-02-17T21:23:42.094 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.080+0000 7f6c66ffd640 3 client.4157.objecter handle_osd_map decoding full epoch 9 2026-02-17T21:23:42.094 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.080+0000 7f6c66ffd640 20 client.4157.objecter dump_active .. 0 homeless 2026-02-17T21:23:42.123 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.119+0000 7f6c66ffd640 1 -- 10.20.193.176:0/850088021 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f6c700253d0 con 0x7f6c68004950 2026-02-17T21:23:42.123 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.119+0000 7f6c66ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:42.124 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.119+0000 7f6c66ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:23:42.129 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:42.126+0000 7f4fa5bdb140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T21:23:42.156 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.151+0000 7f6c88674640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "30a68802-afce-499b-90ce-bd568bc69406", "id": 7}] 2026-02-17T21:23:42.156 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.151+0000 7f6c88674640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "30a68802-afce-499b-90ce-bd568bc69406", "id": 7}] 2026-02-17T21:23:42.156 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.151+0000 7f6c88674640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:42.156 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.151+0000 7f6c88674640 1 -- 10.20.193.176:0/850088021 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "30a68802-afce-499b-90ce-bd568bc69406", "id": 7} v 0) -- 0x7f6c801152f0 con 0x7f6c68004950 2026-02-17T21:23:42.171 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:42.167+0000 7f4fa5bdb140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T21:23:42.196 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:42.192+0000 7f4fa5bdb140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T21:23:42.202 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.198+0000 7f6c66ffd640 1 -- 10.20.193.176:0/850088021 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "30a68802-afce-499b-90ce-bd568bc69406", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f6c7001bb10 con 0x7f6c68004950 2026-02-17T21:23:42.202 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.198+0000 7f6c66ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "30a68802-afce-499b-90ce-bd568bc69406", "id": 7}] 2026-02-17T21:23:42.202 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.198+0000 7f6c66ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:23:42.202 INFO:teuthology.orchestra.run.trial176.stdout:7 2026-02-17T21:23:42.204 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.198+0000 7f6c88674640 10 librados: watch_flush enter 2026-02-17T21:23:42.204 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.198+0000 7f6c88674640 10 librados: watch_flush exit 2026-02-17T21:23:42.204 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.198+0000 7f6c88674640 20 client.4157.objecter shutdown clearing up homeless session... 2026-02-17T21:23:42.204 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.198+0000 7f6c88674640 10 client.4157.objecter successfully canceled tick 2026-02-17T21:23:42.204 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.198+0000 7f6c88674640 10 monclient: shutdown 2026-02-17T21:23:42.204 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.198+0000 7f6c88674640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:42.204 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.198+0000 7f6c88674640 1 -- 10.20.193.176:0/850088021 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6c68004950 msgr2=0x7f6c801b5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:42.205 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.198+0000 7f6c88674640 1 --2- 10.20.193.176:0/850088021 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6c68004950 0x7f6c801b5a60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000d800 tx=0x7f6c7000dcd0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.205 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.198+0000 7f6c88674640 1 -- 10.20.193.176:0/850088021 shutdown_connections 2026-02-17T21:23:42.205 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.198+0000 7f6c88674640 1 --2- 10.20.193.176:0/850088021 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6c80126af0 0x7f6c80126fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.205 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.198+0000 7f6c88674640 1 --2- 10.20.193.176:0/850088021 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6c801b6030 0x7f6c801265b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.205 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.198+0000 7f6c88674640 1 --2- 10.20.193.176:0/850088021 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6c68004950 0x7f6c801b5a60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.205 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.198+0000 7f6c88674640 1 -- 10.20.193.176:0/850088021 >> 10.20.193.176:0/850088021 conn(0x7f6c8006f660 msgr2=0x7f6c80117350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:42.206 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.198+0000 7f6c88674640 1 -- 10.20.193.176:0/850088021 shutdown_connections 2026-02-17T21:23:42.206 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.198+0000 7f6c88674640 1 -- 10.20.193.176:0/850088021 wait complete. 2026-02-17T21:23:42.206 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.198+0000 7f6c88674640 1 librados: shutdown 2026-02-17T21:23:42.211 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph --cluster ceph osd new 8b4a2001-3ac8-4756-9dcf-af38c6d12d44 8 2026-02-17T21:23:42.220 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:42.216+0000 7f4fa5bdb140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T21:23:42.245 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:42.241+0000 7f4fa5bdb140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T21:23:42.266 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:42.262+0000 7f4fa5bdb140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T21:23:42.276 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.272+0000 7f1e66656640 10 monclient: get_monmap_and_config 2026-02-17T21:23:42.277 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.272+0000 7f1e66656640 10 monclient: build_initial_monmap 2026-02-17T21:23:42.277 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.272+0000 7f1e66656640 10 monclient: monmap: 2026-02-17T21:23:42.277 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:42.277 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:42.277 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:23:42.274522+0000 2026-02-17T21:23:42.277 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:23:42.274522+0000 2026-02-17T21:23:42.277 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:42.277 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:42.277 INFO:teuthology.orchestra.run.trial176.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:23:42.277 INFO:teuthology.orchestra.run.trial176.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:23:42.278 INFO:teuthology.orchestra.run.trial176.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:23:42.278 INFO:teuthology.orchestra.run.trial176.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:23:42.278 INFO:teuthology.orchestra.run.trial176.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:23:42.278 INFO:teuthology.orchestra.run.trial176.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:23:42.278 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:42.281 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.273+0000 7f1e66656640 1 Processor -- start 2026-02-17T21:23:42.281 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.273+0000 7f1e66656640 1 -- start start 2026-02-17T21:23:42.281 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.273+0000 7f1e66656640 10 monclient: init 2026-02-17T21:23:42.281 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.273+0000 7f1e66656640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:42.281 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.273+0000 7f1e66656640 10 monclient: _add_conns ranks=[1,2,4,3,5,0] 2026-02-17T21:23:42.281 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.273+0000 7f1e66656640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f1e601149f0 addr v1:10.20.193.119:6789/0 2026-02-17T21:23:42.281 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.273+0000 7f1e66656640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1e6011d5c0 addr v1:10.20.193.135:6789/0 2026-02-17T21:23:42.281 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.273+0000 7f1e66656640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f1e60121160 0x7f1e60123620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:42.281 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.273+0000 7f1e66656640 10 monclient(hunting): picked mon.noname-b con 0x7f1e60121160 addr v2:10.20.193.119:3300/0 2026-02-17T21:23:42.281 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.273+0000 7f1e66656640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e60123d40 con 0x7f1e601149f0 2026-02-17T21:23:42.281 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.273+0000 7f1e66656640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e60124f60 con 0x7f1e6011d5c0 2026-02-17T21:23:42.282 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.273+0000 7f1e66656640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:42.282 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.273+0000 7f1e66656640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f1e60126160 con 0x7f1e60121160 2026-02-17T21:23:42.282 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.273+0000 7f1e66656640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:42.282 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.273+0000 7f1e66656640 10 monclient(hunting): authenticate will time out at 960.916530s 2026-02-17T21:23:42.282 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.273+0000 7f1e64bcc640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f1e60121160 0x7f1e60123620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:42.282 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.273+0000 7f1e5f7fe640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f1e6011d5c0 0x7f1e6011f9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.176:40256/0 (socket says 10.20.193.176:40256) 2026-02-17T21:23:42.282 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.273+0000 7f1e5f7fe640 1 -- 10.20.193.176:0/2214586826 learned_addr learned my addr 10.20.193.176:0/2214586826 (peer_addr_for_me v1:10.20.193.176:0/0) 2026-02-17T21:23:42.282 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.274+0000 7f1e64bcc640 10 monclient(hunting): get_auth_request con 0x7f1e60121160 auth_method 0 2026-02-17T21:23:42.282 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.274+0000 7f1e64bcc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:42.282 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.274+0000 7f1e64bcc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:42.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.274+0000 7f1e64bcc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:42.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.274+0000 7f1e64bcc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:42.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.274+0000 7f1e64bcc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:42.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.274+0000 7f1e64bcc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:42.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.275+0000 7f1e64bcc640 10 monclient(hunting): handle_auth_done global_id 4159 payload 274 2026-02-17T21:23:42.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.275+0000 7f1e64bcc640 1 -- 10.20.193.176:0/2214586826 >> v1:10.20.193.135:6789/0 conn(0x7f1e6011d5c0 legacy=0x7f1e6011f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:42.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.275+0000 7f1e64bcc640 1 -- 10.20.193.176:0/2214586826 >> v1:10.20.193.119:6789/0 conn(0x7f1e601149f0 legacy=0x7f1e60114dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:23:42.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.275+0000 7f1e64bcc640 10 monclient: _finish_hunting 0 2026-02-17T21:23:42.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.275+0000 7f1e64bcc640 1 monclient: found mon.noname-b 2026-02-17T21:23:42.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.275+0000 7f1e64bcc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:42.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.275+0000 7f1e64bcc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:23:42.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.275+0000 7f1e64bcc640 1 -- 10.20.193.176:0/2214586826 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e601262e0 con 0x7f1e60121160 2026-02-17T21:23:42.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.277+0000 7f1e64bcc640 1 --2- 10.20.193.176:0/2214586826 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1e60121160 0x7f1e60123620 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1e54009d90 tx=0x7f1e5402f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59c11c27433bbc95 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:42.290 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.278+0000 7f1e5effd640 1 -- 10.20.193.176:0/2214586826 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5403c070 con 0x7f1e60121160 2026-02-17T21:23:42.290 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.278+0000 7f1e5effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:42.291 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.278+0000 7f1e5effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:23:42.291 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.278+0000 7f1e5effd640 10 monclient: dump: 2026-02-17T21:23:42.291 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:42.291 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:42.291 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.291 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.291 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:42.291 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:42.291 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:42.291 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:42.291 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:42.292 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:42.292 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.278+0000 7f1e5effd640 10 monclient: _finish_auth 0 2026-02-17T21:23:42.292 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.278+0000 7f1e5effd640 10 monclient: _check_auth_tickets 2026-02-17T21:23:42.292 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.278+0000 7f1e5effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:42.292 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.278+0000 7f1e5effd640 1 -- 10.20.193.176:0/2214586826 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e54037440 con 0x7f1e60121160 2026-02-17T21:23:42.292 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.278+0000 7f1e5effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:42.292 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.278+0000 7f1e66656640 5 monclient: authenticate success, global_id 4159 2026-02-17T21:23:42.292 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.278+0000 7f1e5effd640 1 -- 10.20.193.176:0/2214586826 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e54037810 con 0x7f1e60121160 2026-02-17T21:23:42.292 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.278+0000 7f1e66656640 10 monclient: get_monmap_and_config success 2026-02-17T21:23:42.292 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.278+0000 7f1e66656640 4 set_mon_vals no callback set 2026-02-17T21:23:42.292 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.278+0000 7f1e5effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:42.292 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.278+0000 7f1e5effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:23:42.293 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.278+0000 7f1e5effd640 10 monclient: dump: 2026-02-17T21:23:42.293 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:42.293 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:42.293 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.293 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.293 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:42.293 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:42.293 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:42.293 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:42.293 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:42.293 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:42.293 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 10 monclient: shutdown 2026-02-17T21:23:42.294 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:42.294 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 1 -- 10.20.193.176:0/2214586826 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1e60121160 msgr2=0x7f1e60123620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:42.294 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 1 --2- 10.20.193.176:0/2214586826 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1e60121160 0x7f1e60123620 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1e54009d90 tx=0x7f1e5402f1e0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.294 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 1 -- 10.20.193.176:0/2214586826 shutdown_connections 2026-02-17T21:23:42.294 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 1 --2- 10.20.193.176:0/2214586826 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1e60121160 0x7f1e60123620 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.294 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 1 -- 10.20.193.176:0/2214586826 >> 10.20.193.176:0/2214586826 conn(0x7f1e60073660 msgr2=0x7f1e60073a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:42.294 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 1 -- 10.20.193.176:0/2214586826 shutdown_connections 2026-02-17T21:23:42.294 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 1 -- 10.20.193.176:0/2214586826 wait complete. 2026-02-17T21:23:42.294 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 10 monclient: build_initial_monmap 2026-02-17T21:23:42.294 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 10 monclient: monmap: 2026-02-17T21:23:42.294 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:42.295 INFO:teuthology.orchestra.run.trial176.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:23:42.295 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 0.000000 2026-02-17T21:23:42.295 INFO:teuthology.orchestra.run.trial176.stderr:created 0.000000 2026-02-17T21:23:42.295 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:42.295 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:42.295 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:23:42.295 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:23:42.295 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:23:42.295 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:42.295 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 1 librados: starting msgr at 2026-02-17T21:23:42.295 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 1 librados: starting objecter 2026-02-17T21:23:42.295 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 1 Processor -- start 2026-02-17T21:23:42.295 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 1 -- start start 2026-02-17T21:23:42.296 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 1 librados: setting wanted keys 2026-02-17T21:23:42.296 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 1 librados: calling monclient init 2026-02-17T21:23:42.296 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 10 monclient: init 2026-02-17T21:23:42.296 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:42.296 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:23:42.296 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1e601149f0 0x7f1e601b1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:42.296 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 10 monclient(hunting): picked mon.noname-a con 0x7f1e601149f0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:23:42.296 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1e6011d5c0 0x7f1e601b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:42.296 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 10 monclient(hunting): picked mon.noname-b con 0x7f1e6011d5c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:23:42.296 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1e60121160 0x7f1e6011f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:42.296 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 10 monclient(hunting): picked mon.noname-c con 0x7f1e60121160 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:23:42.296 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:42.297 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1e60124390 con 0x7f1e601149f0 2026-02-17T21:23:42.297 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:42.297 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1e60124210 con 0x7f1e6011d5c0 2026-02-17T21:23:42.297 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:42.297 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1e60124510 con 0x7f1e60121160 2026-02-17T21:23:42.297 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:42.297 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.279+0000 7f1e66656640 10 monclient(hunting): authenticate will time out at 960.922732s 2026-02-17T21:23:42.297 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e5f7fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1e6011d5c0 0x7f1e601b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:42.297 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e64bcc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1e60121160 0x7f1e6011f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:42.297 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e5ffff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1e601149f0 0x7f1e601b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:42.297 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e5f7fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1e6011d5c0 0x7f1e601b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.176:51244/0 (socket says 10.20.193.176:51244) 2026-02-17T21:23:42.297 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e5f7fe640 1 -- 10.20.193.176:0/3505880373 learned_addr learned my addr 10.20.193.176:0/3505880373 (peer_addr_for_me v2:10.20.193.176:0/0) 2026-02-17T21:23:42.298 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e5f7fe640 10 monclient(hunting): get_auth_request con 0x7f1e6011d5c0 auth_method 0 2026-02-17T21:23:42.298 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e5f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:42.298 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e5f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:42.298 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e5f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:42.298 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e64bcc640 10 monclient(hunting): get_auth_request con 0x7f1e60121160 auth_method 0 2026-02-17T21:23:42.298 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e64bcc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:42.298 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e64bcc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:42.298 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e64bcc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:42.298 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e5f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:42.298 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e5f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:42.298 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e5f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:42.298 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e5ffff640 10 monclient(hunting): get_auth_request con 0x7f1e601149f0 auth_method 0 2026-02-17T21:23:42.298 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e5ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:42.299 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:42.299 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:42.299 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e64bcc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:42.299 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e64bcc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:42.299 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e64bcc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:42.299 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e5ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:42.299 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e5ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:42.299 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.280+0000 7f1e5ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:42.299 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.281+0000 7f1e5f7fe640 10 monclient(hunting): handle_auth_done global_id 4162 payload 824 2026-02-17T21:23:42.299 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.281+0000 7f1e5f7fe640 1 -- 10.20.193.176:0/3505880373 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1e60121160 msgr2=0x7f1e6011f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:42.299 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.281+0000 7f1e5f7fe640 1 --2- 10.20.193.176:0/3505880373 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1e60121160 0x7f1e6011f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.299 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.281+0000 7f1e5f7fe640 1 -- 10.20.193.176:0/3505880373 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1e601149f0 msgr2=0x7f1e601b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:42.300 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.281+0000 7f1e5f7fe640 1 --2- 10.20.193.176:0/3505880373 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1e601149f0 0x7f1e601b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.300 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.281+0000 7f1e5f7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:23:42.300 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.281+0000 7f1e5f7fe640 1 monclient: found mon.noname-b 2026-02-17T21:23:42.300 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.281+0000 7f1e5f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:42.300 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.281+0000 7f1e5f7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:23:42.300 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.281+0000 7f1e5f7fe640 1 -- 10.20.193.176:0/3505880373 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e6011fe40 con 0x7f1e6011d5c0 2026-02-17T21:23:42.300 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.282+0000 7f1e5f7fe640 1 --2- 10.20.193.176:0/3505880373 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1e6011d5c0 0x7f1e601b1bc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000c700 tx=0x7f1e5000cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:42.300 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.282+0000 7f1e5cff9640 10 client.?.objecter ms_handle_connect 0x7f1e6011d5c0 2026-02-17T21:23:42.300 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.282+0000 7f1e5cff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:23:42.300 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e5cff9640 1 -- 10.20.193.176:0/3505880373 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e50017070 con 0x7f1e6011d5c0 2026-02-17T21:23:42.300 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e5cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:42.300 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e5cff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:23:42.300 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e5cff9640 10 monclient: dump: 2026-02-17T21:23:42.301 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:42.301 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:42.301 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.301 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.301 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:42.301 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:42.301 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:42.301 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:42.301 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:42.301 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:42.301 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e5cff9640 10 monclient: _finish_auth 0 2026-02-17T21:23:42.301 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e5cff9640 10 monclient: _check_auth_tickets 2026-02-17T21:23:42.301 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e5cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:42.302 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e5cff9640 1 -- 10.20.193.176:0/3505880373 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e50005b70 con 0x7f1e6011d5c0 2026-02-17T21:23:42.302 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e5cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:42.302 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e5cff9640 1 -- 10.20.193.176:0/3505880373 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e50007070 con 0x7f1e6011d5c0 2026-02-17T21:23:42.302 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e5cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:42.302 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e5cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:23:42.302 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e5cff9640 10 monclient: dump: 2026-02-17T21:23:42.302 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:42.302 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:42.302 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.302 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.302 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:42.302 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:42.303 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:42.303 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:42.303 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:42.303 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:42.303 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e5e7fc640 4 set_mon_vals no callback set 2026-02-17T21:23:42.303 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e66656640 5 monclient: authenticate success, global_id 4162 2026-02-17T21:23:42.303 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e66656640 10 monclient: _renew_subs 2026-02-17T21:23:42.303 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e66656640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:42.303 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e66656640 1 -- 10.20.193.176:0/3505880373 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e60120130 con 0x7f1e6011d5c0 2026-02-17T21:23:42.303 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e66656640 10 client.4162.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:23:42.303 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e66656640 10 monclient: _renew_subs 2026-02-17T21:23:42.303 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e66656640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:42.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e66656640 1 -- 10.20.193.176:0/3505880373 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e601b8560 con 0x7f1e6011d5c0 2026-02-17T21:23:42.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e66656640 1 librados: init done 2026-02-17T21:23:42.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e66656640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:42.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e66656640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:42.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e66656640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:42.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.284+0000 7f1e66656640 1 -- 10.20.193.176:0/3505880373 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e601249f0 con 0x7f1e6011d5c0 2026-02-17T21:23:42.305 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.291+0000 7f1e5cff9640 1 -- 10.20.193.176:0/3505880373 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 2) ==== 50143+0+0 (secure 0 0 0) 0x7f1e50007210 con 0x7f1e6011d5c0 2026-02-17T21:23:42.336 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.331+0000 7f1e5cff9640 1 -- 10.20.193.176:0/3505880373 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f1e50019d40 con 0x7f1e6011d5c0 2026-02-17T21:23:42.336 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.331+0000 7f1e5cff9640 10 client.4162.objecter ms_dispatch2 0x7f1e60000b90 osd_map(10..10 src has 1..10) 2026-02-17T21:23:42.336 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.331+0000 7f1e5cff9640 3 client.4162.objecter handle_osd_map got epochs [10,10] > 0 2026-02-17T21:23:42.336 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.331+0000 7f1e5cff9640 3 client.4162.objecter handle_osd_map decoding full epoch 10 2026-02-17T21:23:42.336 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.331+0000 7f1e5cff9640 20 client.4162.objecter dump_active .. 0 homeless 2026-02-17T21:23:42.336 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.331+0000 7f1e5cff9640 1 -- 10.20.193.176:0/3505880373 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f1e50021020 con 0x7f1e6011d5c0 2026-02-17T21:23:42.336 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.332+0000 7f1e5cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:42.337 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.332+0000 7f1e5cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:23:42.368 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.364+0000 7f1e66656640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "8b4a2001-3ac8-4756-9dcf-af38c6d12d44", "id": 8}] 2026-02-17T21:23:42.368 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.364+0000 7f1e66656640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "8b4a2001-3ac8-4756-9dcf-af38c6d12d44", "id": 8}] 2026-02-17T21:23:42.368 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.364+0000 7f1e66656640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:42.368 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.364+0000 7f1e66656640 1 -- 10.20.193.176:0/3505880373 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8b4a2001-3ac8-4756-9dcf-af38c6d12d44", "id": 8} v 0) -- 0x7f1e601b8730 con 0x7f1e6011d5c0 2026-02-17T21:23:42.423 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:42.419+0000 7f4fa5bdb140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T21:23:42.454 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.450+0000 7f1e5cff9640 1 -- 10.20.193.176:0/3505880373 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mgrmap(e 3) ==== 99956+0+0 (secure 0 0 0) 0x7f1e5000a640 con 0x7f1e6011d5c0 2026-02-17T21:23:42.479 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:42.475+0000 7f4fa5bdb140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T21:23:42.488 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.484+0000 7f1e5cff9640 1 -- 10.20.193.176:0/3505880373 <== mon.1 v2:10.20.193.119:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8b4a2001-3ac8-4756-9dcf-af38c6d12d44", "id": 8}]=0 v11) ==== 112+0+2 (secure 0 0 0) 0x7f1e50063be0 con 0x7f1e6011d5c0 2026-02-17T21:23:42.488 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.484+0000 7f1e5cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "8b4a2001-3ac8-4756-9dcf-af38c6d12d44", "id": 8}] 2026-02-17T21:23:42.488 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.484+0000 7f1e5cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:23:42.488 INFO:teuthology.orchestra.run.trial176.stdout:8 2026-02-17T21:23:42.490 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.484+0000 7f1e66656640 10 librados: watch_flush enter 2026-02-17T21:23:42.490 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.484+0000 7f1e66656640 10 librados: watch_flush exit 2026-02-17T21:23:42.490 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.484+0000 7f1e66656640 20 client.4162.objecter shutdown clearing up homeless session... 2026-02-17T21:23:42.490 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.484+0000 7f1e66656640 10 client.4162.objecter successfully canceled tick 2026-02-17T21:23:42.490 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.484+0000 7f1e66656640 10 monclient: shutdown 2026-02-17T21:23:42.490 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.485+0000 7f1e66656640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:42.490 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.485+0000 7f1e66656640 1 -- 10.20.193.176:0/3505880373 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1e6011d5c0 msgr2=0x7f1e601b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:42.490 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.485+0000 7f1e66656640 1 --2- 10.20.193.176:0/3505880373 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1e6011d5c0 0x7f1e601b1bc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000c700 tx=0x7f1e5000cbd0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.490 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.485+0000 7f1e66656640 1 -- 10.20.193.176:0/3505880373 shutdown_connections 2026-02-17T21:23:42.490 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.485+0000 7f1e66656640 1 --2- 10.20.193.176:0/3505880373 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1e60121160 0x7f1e6011f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.491 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.485+0000 7f1e66656640 1 --2- 10.20.193.176:0/3505880373 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1e6011d5c0 0x7f1e601b1bc0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.491 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.485+0000 7f1e66656640 1 --2- 10.20.193.176:0/3505880373 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1e601149f0 0x7f1e601b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.491 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.485+0000 7f1e66656640 1 -- 10.20.193.176:0/3505880373 >> 10.20.193.176:0/3505880373 conn(0x7f1e60073660 msgr2=0x7f1e6011b570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:42.491 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.485+0000 7f1e66656640 1 -- 10.20.193.176:0/3505880373 shutdown_connections 2026-02-17T21:23:42.491 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.485+0000 7f1e66656640 1 -- 10.20.193.176:0/3505880373 wait complete. 2026-02-17T21:23:42.491 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.485+0000 7f1e66656640 1 librados: shutdown 2026-02-17T21:23:42.497 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph --cluster ceph osd new dfdfee67-eff6-4413-bd7a-adc0a019bfbd 9 2026-02-17T21:23:42.500 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:42.496+0000 7f4fa5bdb140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T21:23:42.522 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:42.519+0000 7f4fa5bdb140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T21:23:42.566 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.561+0000 7fec1c86d640 10 monclient: get_monmap_and_config 2026-02-17T21:23:42.567 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.561+0000 7fec1c86d640 10 monclient: build_initial_monmap 2026-02-17T21:23:42.567 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.561+0000 7fec1c86d640 10 monclient: monmap: 2026-02-17T21:23:42.567 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:42.567 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:42.567 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:23:42.562653+0000 2026-02-17T21:23:42.567 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:23:42.562653+0000 2026-02-17T21:23:42.567 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:42.567 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:42.567 INFO:teuthology.orchestra.run.trial176.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:23:42.568 INFO:teuthology.orchestra.run.trial176.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:23:42.568 INFO:teuthology.orchestra.run.trial176.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:23:42.568 INFO:teuthology.orchestra.run.trial176.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:23:42.568 INFO:teuthology.orchestra.run.trial176.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:23:42.568 INFO:teuthology.orchestra.run.trial176.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:23:42.568 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:42.568 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.561+0000 7fec1c86d640 1 Processor -- start 2026-02-17T21:23:42.568 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.561+0000 7fec1c86d640 1 -- start start 2026-02-17T21:23:42.568 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.561+0000 7fec1c86d640 10 monclient: init 2026-02-17T21:23:42.568 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.561+0000 7fec1c86d640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:42.568 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.561+0000 7fec1c86d640 10 monclient: _add_conns ranks=[4,2,1,3,5,0] 2026-02-17T21:23:42.568 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.561+0000 7fec1c86d640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fec141149f0 0x7fec14114dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:42.569 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.561+0000 7fec1c86d640 10 monclient(hunting): picked mon.noname-b con 0x7fec141149f0 addr v2:10.20.193.119:3300/0 2026-02-17T21:23:42.569 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.561+0000 7fec1c86d640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fec141192f0 addr v1:10.20.193.135:6789/0 2026-02-17T21:23:42.569 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.561+0000 7fec1c86d640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fec14119e70 addr v1:10.20.193.119:6789/0 2026-02-17T21:23:42.569 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.561+0000 7fec1c86d640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec14123da0 con 0x7fec14119e70 2026-02-17T21:23:42.569 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.561+0000 7fec1c86d640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec14124f80 con 0x7fec141192f0 2026-02-17T21:23:42.569 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.561+0000 7fec1c86d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:42.569 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.561+0000 7fec1c86d640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fec14126160 con 0x7fec141149f0 2026-02-17T21:23:42.569 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.561+0000 7fec1c86d640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:42.569 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.561+0000 7fec1c86d640 10 monclient(hunting): authenticate will time out at 961.204572s 2026-02-17T21:23:42.569 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.561+0000 7fec1a5e2640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fec141149f0 0x7fec14114dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:42.569 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.562+0000 7fec19de1640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7fec141192f0 0x7fec14119760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.176:40264/0 (socket says 10.20.193.176:40264) 2026-02-17T21:23:42.569 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.562+0000 7fec19de1640 1 -- 10.20.193.176:0/3905161201 learned_addr learned my addr 10.20.193.176:0/3905161201 (peer_addr_for_me v1:10.20.193.176:0/0) 2026-02-17T21:23:42.570 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.562+0000 7fec1a5e2640 10 monclient(hunting): get_auth_request con 0x7fec141149f0 auth_method 0 2026-02-17T21:23:42.570 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.562+0000 7fec1a5e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:42.570 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.562+0000 7fec1a5e2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:42.570 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.562+0000 7fec1a5e2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:42.570 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.562+0000 7fec1a5e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:42.570 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.562+0000 7fec1a5e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:42.570 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.562+0000 7fec1a5e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:42.577 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.563+0000 7fec195e0640 1 -- 10.20.193.176:0/3905161201 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3343678112 0 0) 0x7fec14124f80 con 0x7fec141192f0 2026-02-17T21:23:42.577 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.563+0000 7fec195e0640 10 monclient(hunting): _negotiate 2026-02-17T21:23:42.577 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.563+0000 7fec195e0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:42.577 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.563+0000 7fec195e0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:42.577 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.563+0000 7fec195e0640 10 monclient(hunting): my global_id is 4166 2026-02-17T21:23:42.578 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.563+0000 7fec195e0640 1 -- 10.20.193.176:0/3905161201 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec04003620 con 0x7fec141192f0 2026-02-17T21:23:42.578 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.563+0000 7fec1a5e2640 10 monclient(hunting): handle_auth_done global_id 4165 payload 274 2026-02-17T21:23:42.578 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.563+0000 7fec1a5e2640 1 -- 10.20.193.176:0/3905161201 >> v1:10.20.193.135:6789/0 conn(0x7fec141192f0 legacy=0x7fec14119760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:42.578 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.563+0000 7fec1a5e2640 1 -- 10.20.193.176:0/3905161201 >> v1:10.20.193.119:6789/0 conn(0x7fec14119e70 legacy=0x7fec141225f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:42.578 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.563+0000 7fec1a5e2640 10 monclient: _finish_hunting 0 2026-02-17T21:23:42.578 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.563+0000 7fec1a5e2640 1 monclient: found mon.noname-b 2026-02-17T21:23:42.578 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.563+0000 7fec1a5e2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:42.578 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.563+0000 7fec1a5e2640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:23:42.578 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.563+0000 7fec1a5e2640 1 -- 10.20.193.176:0/3905161201 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec141262e0 con 0x7fec141149f0 2026-02-17T21:23:42.578 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.565+0000 7fec1a5e2640 1 --2- 10.20.193.176:0/3905161201 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fec141149f0 0x7fec14114dd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0098a0 tx=0x7fec0c02edd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dac5e42800f7dc75 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:42.578 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.567+0000 7fec195e0640 1 -- 10.20.193.176:0/3905161201 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c03c070 con 0x7fec141149f0 2026-02-17T21:23:42.579 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.567+0000 7fec195e0640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:42.579 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.567+0000 7fec195e0640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:23:42.579 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.567+0000 7fec195e0640 10 monclient: dump: 2026-02-17T21:23:42.579 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:42.579 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:42.579 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.579 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.579 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:42.579 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:42.579 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:42.579 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:42.579 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:42.579 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:42.580 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.567+0000 7fec195e0640 10 monclient: _finish_auth 0 2026-02-17T21:23:42.580 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.567+0000 7fec195e0640 10 monclient: _check_auth_tickets 2026-02-17T21:23:42.580 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.567+0000 7fec195e0640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:42.580 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.567+0000 7fec195e0640 1 -- 10.20.193.176:0/3905161201 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec0c02fae0 con 0x7fec141149f0 2026-02-17T21:23:42.580 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.567+0000 7fec1c86d640 5 monclient: authenticate success, global_id 4165 2026-02-17T21:23:42.580 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.567+0000 7fec1c86d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:23:42.580 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.567+0000 7fec195e0640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:42.580 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.567+0000 7fec1c86d640 10 monclient: get_monmap_and_config success 2026-02-17T21:23:42.580 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.567+0000 7fec195e0640 1 -- 10.20.193.176:0/3905161201 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c037440 con 0x7fec141149f0 2026-02-17T21:23:42.580 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.567+0000 7fec195e0640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:42.580 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.567+0000 7fec1c86d640 4 set_mon_vals no callback set 2026-02-17T21:23:42.580 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.567+0000 7fec195e0640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:23:42.581 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.567+0000 7fec195e0640 10 monclient: dump: 2026-02-17T21:23:42.581 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:42.581 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:42.581 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.581 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.581 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:42.581 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:42.581 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:42.581 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:42.581 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:42.581 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:42.581 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 10 monclient: shutdown 2026-02-17T21:23:42.582 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:42.582 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 1 -- 10.20.193.176:0/3905161201 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fec141149f0 msgr2=0x7fec14114dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:42.582 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 1 --2- 10.20.193.176:0/3905161201 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fec141149f0 0x7fec14114dd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0098a0 tx=0x7fec0c02edd0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.582 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 1 -- 10.20.193.176:0/3905161201 shutdown_connections 2026-02-17T21:23:42.582 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 1 --2- 10.20.193.176:0/3905161201 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fec141149f0 0x7fec14114dd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.582 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 1 -- 10.20.193.176:0/3905161201 >> 10.20.193.176:0/3905161201 conn(0x7fec14073660 msgr2=0x7fec14073a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:42.582 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 1 -- 10.20.193.176:0/3905161201 shutdown_connections 2026-02-17T21:23:42.582 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 1 -- 10.20.193.176:0/3905161201 wait complete. 2026-02-17T21:23:42.582 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 10 monclient: build_initial_monmap 2026-02-17T21:23:42.582 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 10 monclient: monmap: 2026-02-17T21:23:42.582 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:42.582 INFO:teuthology.orchestra.run.trial176.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:23:42.583 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 0.000000 2026-02-17T21:23:42.583 INFO:teuthology.orchestra.run.trial176.stderr:created 0.000000 2026-02-17T21:23:42.583 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:42.583 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:42.583 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:23:42.583 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:23:42.583 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:23:42.583 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:42.583 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 1 librados: starting msgr at 2026-02-17T21:23:42.583 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 1 librados: starting objecter 2026-02-17T21:23:42.583 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 1 Processor -- start 2026-02-17T21:23:42.583 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 1 -- start start 2026-02-17T21:23:42.583 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 1 librados: setting wanted keys 2026-02-17T21:23:42.584 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 1 librados: calling monclient init 2026-02-17T21:23:42.584 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 10 monclient: init 2026-02-17T21:23:42.584 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:42.584 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:23:42.584 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fec141149f0 0x7fec141222a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:42.584 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 10 monclient(hunting): picked mon.noname-a con 0x7fec141149f0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:23:42.584 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fec141192f0 0x7fec141228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:42.584 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 10 monclient(hunting): picked mon.noname-c con 0x7fec141192f0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:23:42.584 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fec14119e70 0x7fec141b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:42.584 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 10 monclient(hunting): picked mon.noname-b con 0x7fec14119e70 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:23:42.584 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:42.584 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fec141243f0 con 0x7fec141149f0 2026-02-17T21:23:42.585 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:42.585 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fec14124270 con 0x7fec14119e70 2026-02-17T21:23:42.585 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:42.585 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fec14124570 con 0x7fec141192f0 2026-02-17T21:23:42.585 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:42.585 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.568+0000 7fec1c86d640 10 monclient(hunting): authenticate will time out at 961.211672s 2026-02-17T21:23:42.585 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec1ade3640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fec14119e70 0x7fec141b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:42.585 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec19de1640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fec141192f0 0x7fec141228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:42.585 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec1a5e2640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fec141149f0 0x7fec141222a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:42.585 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec1ade3640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fec14119e70 0x7fec141b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.176:51260/0 (socket says 10.20.193.176:51260) 2026-02-17T21:23:42.585 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec1ade3640 1 -- 10.20.193.176:0/463664618 learned_addr learned my addr 10.20.193.176:0/463664618 (peer_addr_for_me v2:10.20.193.176:0/0) 2026-02-17T21:23:42.585 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec1ade3640 10 monclient(hunting): get_auth_request con 0x7fec14119e70 auth_method 0 2026-02-17T21:23:42.586 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec1ade3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:42.586 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec1ade3640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:42.586 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec1ade3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:42.586 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec19de1640 10 monclient(hunting): get_auth_request con 0x7fec141192f0 auth_method 0 2026-02-17T21:23:42.586 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec19de1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:42.586 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec19de1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:42.586 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec19de1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:42.586 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec1a5e2640 10 monclient(hunting): get_auth_request con 0x7fec141149f0 auth_method 0 2026-02-17T21:23:42.586 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec1a5e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:42.586 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec1a5e2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:42.586 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec1a5e2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:42.586 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec1ade3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:42.586 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec1ade3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:42.587 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec1ade3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:42.587 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec19de1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:42.587 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec19de1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:42.587 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec19de1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:42.587 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec1a5e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:42.587 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec1a5e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:42.587 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.569+0000 7fec1a5e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:42.587 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.570+0000 7fec1ade3640 10 monclient(hunting): handle_auth_done global_id 4171 payload 824 2026-02-17T21:23:42.587 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.570+0000 7fec1ade3640 1 -- 10.20.193.176:0/463664618 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fec141192f0 msgr2=0x7fec141228f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:42.587 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.570+0000 7fec1ade3640 1 --2- 10.20.193.176:0/463664618 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fec141192f0 0x7fec141228f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.587 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.570+0000 7fec1ade3640 1 -- 10.20.193.176:0/463664618 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fec141149f0 msgr2=0x7fec141222a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:42.587 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.570+0000 7fec1ade3640 1 --2- 10.20.193.176:0/463664618 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fec141149f0 0x7fec141222a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.588 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.570+0000 7fec1ade3640 10 monclient: _finish_hunting 0 2026-02-17T21:23:42.588 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.570+0000 7fec1ade3640 1 monclient: found mon.noname-b 2026-02-17T21:23:42.588 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.570+0000 7fec1ade3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:42.588 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.570+0000 7fec1ade3640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:23:42.588 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.570+0000 7fec1ade3640 1 -- 10.20.193.176:0/463664618 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec141b1ac0 con 0x7fec14119e70 2026-02-17T21:23:42.588 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.571+0000 7fec1ade3640 1 --2- 10.20.193.176:0/463664618 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fec14119e70 0x7fec141b1200 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fec0800cc50 tx=0x7fec0800a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:42.588 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.571+0000 7febfeffd640 10 client.?.objecter ms_handle_connect 0x7fec14119e70 2026-02-17T21:23:42.588 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.571+0000 7febfeffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:23:42.588 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.572+0000 7febfeffd640 1 -- 10.20.193.176:0/463664618 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec08003a70 con 0x7fec14119e70 2026-02-17T21:23:42.588 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.572+0000 7febfeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:42.588 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.572+0000 7febfeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:23:42.588 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.572+0000 7febfeffd640 10 monclient: dump: 2026-02-17T21:23:42.588 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:42.589 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:42.589 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.589 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.589 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:42.589 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:42.589 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:42.589 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:42.589 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:42.589 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:42.589 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.572+0000 7febfeffd640 10 monclient: _finish_auth 0 2026-02-17T21:23:42.589 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.572+0000 7febfeffd640 10 monclient: _check_auth_tickets 2026-02-17T21:23:42.589 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.572+0000 7febfeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:42.589 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.572+0000 7fec1c86d640 5 monclient: authenticate success, global_id 4171 2026-02-17T21:23:42.590 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.572+0000 7fec1c86d640 10 monclient: _renew_subs 2026-02-17T21:23:42.590 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.572+0000 7fec1c86d640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:42.590 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.572+0000 7fec1c86d640 1 -- 10.20.193.176:0/463664618 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec141b1cf0 con 0x7fec14119e70 2026-02-17T21:23:42.590 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.572+0000 7fec1c86d640 10 client.4171.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:23:42.590 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.572+0000 7fec1c86d640 10 monclient: _renew_subs 2026-02-17T21:23:42.590 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.572+0000 7fec1c86d640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:42.590 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.572+0000 7fec1c86d640 1 -- 10.20.193.176:0/463664618 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec141b8490 con 0x7fec14119e70 2026-02-17T21:23:42.590 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.572+0000 7fec1c86d640 1 librados: init done 2026-02-17T21:23:42.591 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:42.572+0000 7f4fa5bdb140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T21:23:42.591 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.573+0000 7fec1c86d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:42.591 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.573+0000 7fec1c86d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:42.592 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.573+0000 7fec1c86d640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:42.592 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.573+0000 7fec1c86d640 1 -- 10.20.193.176:0/463664618 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec14114e50 con 0x7fec14119e70 2026-02-17T21:23:42.592 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.573+0000 7febfeffd640 1 -- 10.20.193.176:0/463664618 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec08003c10 con 0x7fec14119e70 2026-02-17T21:23:42.592 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.573+0000 7febfeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:42.592 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.573+0000 7febfeffd640 1 -- 10.20.193.176:0/463664618 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec080050d0 con 0x7fec14119e70 2026-02-17T21:23:42.592 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.573+0000 7febfeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:42.592 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.573+0000 7febfeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:23:42.592 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.573+0000 7febfeffd640 10 monclient: dump: 2026-02-17T21:23:42.592 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:42.592 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:42.592 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.592 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.593 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:42.593 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:42.593 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:42.593 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:42.593 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:42.593 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:42.593 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.573+0000 7fec18ddf640 4 set_mon_vals no callback set 2026-02-17T21:23:42.597 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:42.593+0000 7f4fa5bdb140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T21:23:42.624 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.620+0000 7febfeffd640 1 -- 10.20.193.176:0/463664618 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 3) ==== 99956+0+0 (secure 0 0 0) 0x7fec08005270 con 0x7fec14119e70 2026-02-17T21:23:42.628 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.624+0000 7febfeffd640 1 -- 10.20.193.176:0/463664618 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1760+0+0 (secure 0 0 0) 0x7fec0805e100 con 0x7fec14119e70 2026-02-17T21:23:42.628 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.624+0000 7febfeffd640 10 client.4171.objecter ms_dispatch2 0x7fec14000b90 osd_map(11..11 src has 1..11) 2026-02-17T21:23:42.628 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.624+0000 7febfeffd640 3 client.4171.objecter handle_osd_map got epochs [11,11] > 0 2026-02-17T21:23:42.628 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.624+0000 7febfeffd640 3 client.4171.objecter handle_osd_map decoding full epoch 11 2026-02-17T21:23:42.628 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.624+0000 7febfeffd640 20 client.4171.objecter dump_active .. 0 homeless 2026-02-17T21:23:42.628 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.624+0000 7febfeffd640 1 -- 10.20.193.176:0/463664618 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fec080629e0 con 0x7fec14119e70 2026-02-17T21:23:42.628 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.624+0000 7febfeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:42.629 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.624+0000 7febfeffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:23:42.650 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:42.646+0000 7f4fa5bdb140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T21:23:42.661 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.657+0000 7fec1c86d640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "dfdfee67-eff6-4413-bd7a-adc0a019bfbd", "id": 9}] 2026-02-17T21:23:42.661 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.657+0000 7fec1c86d640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "dfdfee67-eff6-4413-bd7a-adc0a019bfbd", "id": 9}] 2026-02-17T21:23:42.661 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.657+0000 7fec1c86d640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:42.661 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.657+0000 7fec1c86d640 1 -- 10.20.193.176:0/463664618 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dfdfee67-eff6-4413-bd7a-adc0a019bfbd", "id": 9} v 0) -- 0x7fec141b8660 con 0x7fec14119e70 2026-02-17T21:23:42.705 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.701+0000 7febfeffd640 1 -- 10.20.193.176:0/463664618 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dfdfee67-eff6-4413-bd7a-adc0a019bfbd", "id": 9}]=0 v12) ==== 112+0+2 (secure 0 0 0) 0x7fec08066ce0 con 0x7fec14119e70 2026-02-17T21:23:42.705 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.701+0000 7febfeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "dfdfee67-eff6-4413-bd7a-adc0a019bfbd", "id": 9}] 2026-02-17T21:23:42.705 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.701+0000 7febfeffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:23:42.706 INFO:teuthology.orchestra.run.trial176.stdout:9 2026-02-17T21:23:42.707 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.702+0000 7fec1c86d640 10 librados: watch_flush enter 2026-02-17T21:23:42.707 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.702+0000 7fec1c86d640 10 librados: watch_flush exit 2026-02-17T21:23:42.707 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.702+0000 7fec1c86d640 20 client.4171.objecter shutdown clearing up homeless session... 2026-02-17T21:23:42.707 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.702+0000 7fec1c86d640 10 client.4171.objecter successfully canceled tick 2026-02-17T21:23:42.707 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.702+0000 7fec1c86d640 10 monclient: shutdown 2026-02-17T21:23:42.707 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.702+0000 7fec1c86d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:42.708 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.702+0000 7fec1c86d640 1 -- 10.20.193.176:0/463664618 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fec14119e70 msgr2=0x7fec141b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:42.708 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.702+0000 7fec1c86d640 1 --2- 10.20.193.176:0/463664618 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fec14119e70 0x7fec141b1200 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fec0800cc50 tx=0x7fec0800a430 comp rx=0 tx=0).stop 2026-02-17T21:23:42.708 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.702+0000 7fec1c86d640 1 -- 10.20.193.176:0/463664618 shutdown_connections 2026-02-17T21:23:42.708 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.702+0000 7fec1c86d640 1 --2- 10.20.193.176:0/463664618 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fec14119e70 0x7fec141b1200 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.708 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.702+0000 7fec1c86d640 1 --2- 10.20.193.176:0/463664618 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fec141192f0 0x7fec141228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.708 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.702+0000 7fec1c86d640 1 --2- 10.20.193.176:0/463664618 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fec141149f0 0x7fec141222a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.708 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.702+0000 7fec1c86d640 1 -- 10.20.193.176:0/463664618 >> 10.20.193.176:0/463664618 conn(0x7fec14073660 msgr2=0x7fec14074560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:42.708 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.702+0000 7fec1c86d640 1 -- 10.20.193.176:0/463664618 shutdown_connections 2026-02-17T21:23:42.708 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.702+0000 7fec1c86d640 1 -- 10.20.193.176:0/463664618 wait complete. 2026-02-17T21:23:42.708 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.702+0000 7fec1c86d640 1 librados: shutdown 2026-02-17T21:23:42.714 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph --cluster ceph osd new fc24ee77-5a0d-41d4-88f5-8d03a77c7608 10 2026-02-17T21:23:42.820 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.815+0000 7efdfd7f8640 10 monclient: get_monmap_and_config 2026-02-17T21:23:42.820 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.815+0000 7efdfd7f8640 10 monclient: build_initial_monmap 2026-02-17T21:23:42.820 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.816+0000 7efdfd7f8640 10 monclient: monmap: 2026-02-17T21:23:42.820 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:42.820 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:42.820 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:23:42.817639+0000 2026-02-17T21:23:42.820 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:23:42.817639+0000 2026-02-17T21:23:42.820 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:42.821 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:42.821 INFO:teuthology.orchestra.run.trial176.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:23:42.821 INFO:teuthology.orchestra.run.trial176.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:23:42.821 INFO:teuthology.orchestra.run.trial176.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:23:42.821 INFO:teuthology.orchestra.run.trial176.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:23:42.821 INFO:teuthology.orchestra.run.trial176.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:23:42.821 INFO:teuthology.orchestra.run.trial176.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:23:42.821 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:42.824 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.816+0000 7efdfd7f8640 1 Processor -- start 2026-02-17T21:23:42.824 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.816+0000 7efdfd7f8640 1 -- start start 2026-02-17T21:23:42.824 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.816+0000 7efdfd7f8640 10 monclient: init 2026-02-17T21:23:42.824 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.816+0000 7efdfd7f8640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:42.824 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.816+0000 7efdfd7f8640 10 monclient: _add_conns ranks=[5,1,0,2,4,3] 2026-02-17T21:23:42.824 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.816+0000 7efdfd7f8640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7efdf81149f0 0x7efdf8114dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:42.825 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.816+0000 7efdfd7f8640 10 monclient(hunting): picked mon.noname-c con 0x7efdf81149f0 addr v2:10.20.193.135:3300/0 2026-02-17T21:23:42.825 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.816+0000 7efdfd7f8640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7efdf81192f0 addr v1:10.20.193.119:6789/0 2026-02-17T21:23:42.825 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.816+0000 7efdfd7f8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7efdf8119e70 addr v1:10.20.193.5:6789/0 2026-02-17T21:23:42.825 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.816+0000 7efdfd7f8640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdf8123da0 con 0x7efdf8119e70 2026-02-17T21:23:42.825 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.816+0000 7efdfd7f8640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdf8124f80 con 0x7efdf81192f0 2026-02-17T21:23:42.825 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.816+0000 7efdfd7f8640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:42.825 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.816+0000 7efdfd7f8640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7efdf8126160 con 0x7efdf81149f0 2026-02-17T21:23:42.825 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.816+0000 7efdfd7f8640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:42.825 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.816+0000 7efdfd7f8640 10 monclient(hunting): authenticate will time out at 961.459705s 2026-02-17T21:23:42.825 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.817+0000 7efdf6ffd640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7efdf81149f0 0x7efdf8114dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:42.826 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.817+0000 7efdf67fc640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7efdf81192f0 0x7efdf8119760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.176:41254/0 (socket says 10.20.193.176:41254) 2026-02-17T21:23:42.826 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.817+0000 7efdf67fc640 1 -- 10.20.193.176:0/1882529168 learned_addr learned my addr 10.20.193.176:0/1882529168 (peer_addr_for_me v1:10.20.193.176:0/0) 2026-02-17T21:23:42.826 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.817+0000 7efdf6ffd640 10 monclient(hunting): get_auth_request con 0x7efdf81149f0 auth_method 0 2026-02-17T21:23:42.826 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.817+0000 7efdf6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:42.826 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.817+0000 7efdf6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:42.826 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.817+0000 7efdf6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:42.826 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.817+0000 7efdf6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:42.826 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.817+0000 7efdf6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:42.826 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.817+0000 7efdf6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:42.826 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.818+0000 7efdf6ffd640 10 monclient(hunting): handle_auth_done global_id 4172 payload 274 2026-02-17T21:23:42.826 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.818+0000 7efdf6ffd640 1 -- 10.20.193.176:0/1882529168 >> v1:10.20.193.119:6789/0 conn(0x7efdf81192f0 legacy=0x7efdf8119760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:42.826 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.818+0000 7efdf6ffd640 1 -- 10.20.193.176:0/1882529168 >> v1:10.20.193.5:6789/0 conn(0x7efdf8119e70 legacy=0x7efdf81225f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:42.827 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.818+0000 7efdf6ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:23:42.827 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.818+0000 7efdf6ffd640 1 monclient: found mon.noname-c 2026-02-17T21:23:42.827 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.818+0000 7efdf6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:42.827 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.818+0000 7efdf6ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:23:42.827 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.818+0000 7efdf6ffd640 1 -- 10.20.193.176:0/1882529168 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf81262e0 con 0x7efdf81149f0 2026-02-17T21:23:42.827 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.819+0000 7efdf6ffd640 1 --2- 10.20.193.176:0/1882529168 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7efdf81149f0 0x7efdf8114dd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efdec0098a0 tx=0x7efdec02edd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdbf13a9404e8d62 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:42.834 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdf5ffb640 1 -- 10.20.193.176:0/1882529168 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec03c070 con 0x7efdf81149f0 2026-02-17T21:23:42.834 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdf5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:42.834 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdf5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:23:42.834 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdf5ffb640 10 monclient: dump: 2026-02-17T21:23:42.835 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:42.835 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:42.835 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.835 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.835 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:42.835 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:42.835 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:42.835 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:42.835 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:42.835 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:42.835 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdf5ffb640 10 monclient: _finish_auth 0 2026-02-17T21:23:42.835 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdf5ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:23:42.836 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdf5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:42.836 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdf5ffb640 1 -- 10.20.193.176:0/1882529168 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdec02fae0 con 0x7efdf81149f0 2026-02-17T21:23:42.836 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdfd7f8640 5 monclient: authenticate success, global_id 4172 2026-02-17T21:23:42.836 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdfd7f8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:23:42.836 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdf5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:42.836 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdf5ffb640 1 -- 10.20.193.176:0/1882529168 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec037440 con 0x7efdf81149f0 2026-02-17T21:23:42.836 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdfd7f8640 10 monclient: get_monmap_and_config success 2026-02-17T21:23:42.836 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdfd7f8640 4 set_mon_vals no callback set 2026-02-17T21:23:42.836 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdf5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:42.836 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdf5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:23:42.836 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdf5ffb640 10 monclient: dump: 2026-02-17T21:23:42.836 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:42.836 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:42.837 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.837 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.837 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:42.837 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:42.837 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:42.837 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:42.837 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:42.837 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:42.837 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdfd7f8640 10 monclient: shutdown 2026-02-17T21:23:42.837 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdfd7f8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:42.837 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdfd7f8640 1 -- 10.20.193.176:0/1882529168 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7efdf81149f0 msgr2=0x7efdf8114dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:42.837 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdfd7f8640 1 --2- 10.20.193.176:0/1882529168 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7efdf81149f0 0x7efdf8114dd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efdec0098a0 tx=0x7efdec02edd0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.838 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdfd7f8640 1 -- 10.20.193.176:0/1882529168 shutdown_connections 2026-02-17T21:23:42.838 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdfd7f8640 1 --2- 10.20.193.176:0/1882529168 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7efdf81149f0 0x7efdf8114dd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.838 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdfd7f8640 1 -- 10.20.193.176:0/1882529168 >> 10.20.193.176:0/1882529168 conn(0x7efdf8073660 msgr2=0x7efdf8073a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:42.838 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdfd7f8640 1 -- 10.20.193.176:0/1882529168 shutdown_connections 2026-02-17T21:23:42.838 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdfd7f8640 1 -- 10.20.193.176:0/1882529168 wait complete. 2026-02-17T21:23:42.838 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdfd7f8640 10 monclient: build_initial_monmap 2026-02-17T21:23:42.838 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdfd7f8640 10 monclient: monmap: 2026-02-17T21:23:42.838 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:42.838 INFO:teuthology.orchestra.run.trial176.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:23:42.838 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 0.000000 2026-02-17T21:23:42.838 INFO:teuthology.orchestra.run.trial176.stderr:created 0.000000 2026-02-17T21:23:42.838 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:42.839 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:42.839 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:23:42.839 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:23:42.839 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:23:42.839 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:42.839 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdfd7f8640 1 librados: starting msgr at 2026-02-17T21:23:42.839 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdfd7f8640 1 librados: starting objecter 2026-02-17T21:23:42.839 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.821+0000 7efdfd7f8640 1 Processor -- start 2026-02-17T21:23:42.839 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdfd7f8640 1 -- start start 2026-02-17T21:23:42.839 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdfd7f8640 1 librados: setting wanted keys 2026-02-17T21:23:42.839 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdfd7f8640 1 librados: calling monclient init 2026-02-17T21:23:42.839 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdfd7f8640 10 monclient: init 2026-02-17T21:23:42.839 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdfd7f8640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:42.840 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdfd7f8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:23:42.840 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdfd7f8640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efdf81149f0 0x7efdf8122410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:42.840 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdfd7f8640 10 monclient(hunting): picked mon.noname-b con 0x7efdf81149f0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:23:42.840 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdfd7f8640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7efdf81192f0 0x7efdf8122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:42.840 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdfd7f8640 10 monclient(hunting): picked mon.noname-c con 0x7efdf81192f0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:23:42.840 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdfd7f8640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7efdf8119e70 0x7efdf81b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:42.840 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdfd7f8640 10 monclient(hunting): picked mon.noname-a con 0x7efdf8119e70 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:23:42.840 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdfd7f8640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:42.840 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdfd7f8640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7efdf81255d0 con 0x7efdf8119e70 2026-02-17T21:23:42.840 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdfd7f8640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:42.840 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdfd7f8640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7efdf8125450 con 0x7efdf81149f0 2026-02-17T21:23:42.840 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdfd7f8640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:42.840 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdfd7f8640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7efdf8125750 con 0x7efdf81192f0 2026-02-17T21:23:42.841 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdfd7f8640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:42.841 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdfd7f8640 10 monclient(hunting): authenticate will time out at 961.465148s 2026-02-17T21:23:42.841 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdf67fc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7efdf81192f0 0x7efdf8122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:42.841 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdf6ffd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efdf81149f0 0x7efdf8122410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:42.841 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdf67fc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7efdf81192f0 0x7efdf8122a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.176:59752/0 (socket says 10.20.193.176:59752) 2026-02-17T21:23:42.841 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdf67fc640 1 -- 10.20.193.176:0/4235126843 learned_addr learned my addr 10.20.193.176:0/4235126843 (peer_addr_for_me v2:10.20.193.176:0/0) 2026-02-17T21:23:42.841 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdf67fc640 10 monclient(hunting): get_auth_request con 0x7efdf81192f0 auth_method 0 2026-02-17T21:23:42.841 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdf67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:42.841 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdf67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:42.841 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdf67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:42.841 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdf77fe640 1 --2- 10.20.193.176:0/4235126843 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7efdf8119e70 0x7efdf81b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:42.842 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdf6ffd640 10 monclient(hunting): get_auth_request con 0x7efdf81149f0 auth_method 0 2026-02-17T21:23:42.842 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdf6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:42.842 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdf6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:42.842 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdf6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:42.842 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdf77fe640 10 monclient(hunting): get_auth_request con 0x7efdf8119e70 auth_method 0 2026-02-17T21:23:42.842 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdf77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:42.842 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdf77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:42.842 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdf77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:42.842 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdf67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:42.842 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdf67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:42.842 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.822+0000 7efdf67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:42.842 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.823+0000 7efdf6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:42.842 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.823+0000 7efdf6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:42.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.823+0000 7efdf6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:42.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.823+0000 7efdf77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:42.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.823+0000 7efdf77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:42.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.823+0000 7efdf77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:42.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.824+0000 7efdf67fc640 10 monclient(hunting): handle_auth_done global_id 4175 payload 824 2026-02-17T21:23:42.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.824+0000 7efdf67fc640 1 -- 10.20.193.176:0/4235126843 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efdf81149f0 msgr2=0x7efdf8122410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:42.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.824+0000 7efdf67fc640 1 --2- 10.20.193.176:0/4235126843 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efdf81149f0 0x7efdf8122410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.824+0000 7efdf67fc640 1 -- 10.20.193.176:0/4235126843 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7efdf8119e70 msgr2=0x7efdf81b12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:42.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.824+0000 7efdf67fc640 1 --2- 10.20.193.176:0/4235126843 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7efdf8119e70 0x7efdf81b12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.824+0000 7efdf67fc640 10 monclient: _finish_hunting 0 2026-02-17T21:23:42.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.824+0000 7efdf67fc640 1 monclient: found mon.noname-c 2026-02-17T21:23:42.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.824+0000 7efdf67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:42.843 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.824+0000 7efdf67fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:23:42.844 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.824+0000 7efdf67fc640 1 -- 10.20.193.176:0/4235126843 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf81b1b70 con 0x7efdf81192f0 2026-02-17T21:23:42.844 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.825+0000 7efdf67fc640 1 --2- 10.20.193.176:0/4235126843 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7efdf81192f0 0x7efdf8122a80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efde000c730 tx=0x7efde000cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:42.844 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.825+0000 7efdd77fe640 10 client.?.objecter ms_handle_connect 0x7efdf81192f0 2026-02-17T21:23:42.844 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.825+0000 7efdd77fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:23:42.844 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdd77fe640 1 -- 10.20.193.176:0/4235126843 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde0017070 con 0x7efdf81192f0 2026-02-17T21:23:42.844 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdd77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:42.844 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdd77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:23:42.844 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdd77fe640 10 monclient: dump: 2026-02-17T21:23:42.844 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:42.844 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:42.844 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.844 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.845 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:42.845 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:42.845 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:42.845 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:42.845 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:42.845 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:42.845 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdd77fe640 10 monclient: _finish_auth 0 2026-02-17T21:23:42.845 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdd77fe640 10 monclient: _check_auth_tickets 2026-02-17T21:23:42.845 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdd77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:42.845 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdfd7f8640 5 monclient: authenticate success, global_id 4175 2026-02-17T21:23:42.845 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdfd7f8640 10 monclient: _renew_subs 2026-02-17T21:23:42.845 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdfd7f8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:42.845 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdfd7f8640 1 -- 10.20.193.176:0/4235126843 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdf81b1e00 con 0x7efdf81192f0 2026-02-17T21:23:42.846 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdfd7f8640 10 client.4175.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:23:42.846 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdfd7f8640 10 monclient: _renew_subs 2026-02-17T21:23:42.846 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdfd7f8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:42.846 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdfd7f8640 1 -- 10.20.193.176:0/4235126843 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdf81b85a0 con 0x7efdf81192f0 2026-02-17T21:23:42.846 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdfd7f8640 1 librados: init done 2026-02-17T21:23:42.846 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdfd7f8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:42.846 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdfd7f8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:42.846 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdfd7f8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:42.846 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdfd7f8640 1 -- 10.20.193.176:0/4235126843 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdf8114e50 con 0x7efdf81192f0 2026-02-17T21:23:42.846 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdd77fe640 1 -- 10.20.193.176:0/4235126843 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efde0005b70 con 0x7efdf81192f0 2026-02-17T21:23:42.846 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdd77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:42.846 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdd77fe640 1 -- 10.20.193.176:0/4235126843 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde0007070 con 0x7efdf81192f0 2026-02-17T21:23:42.846 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdd77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:42.847 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdd77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:23:42.847 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdd77fe640 10 monclient: dump: 2026-02-17T21:23:42.847 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:42.847 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:42.847 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.847 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:42.847 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:42.847 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:42.847 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:42.847 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:42.847 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:42.847 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:42.848 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.826+0000 7efdf57fa640 4 set_mon_vals no callback set 2026-02-17T21:23:42.879 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.875+0000 7efdd77fe640 1 -- 10.20.193.176:0/4235126843 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 3) ==== 99956+0+0 (secure 0 0 0) 0x7efde0007210 con 0x7efdf81192f0 2026-02-17T21:23:42.881 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.876+0000 7efdd77fe640 1 -- 10.20.193.176:0/4235126843 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 1875+0+0 (secure 0 0 0) 0x7efde005cdc0 con 0x7efdf81192f0 2026-02-17T21:23:42.881 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.876+0000 7efdd77fe640 10 client.4175.objecter ms_dispatch2 0x7efdf8000b90 osd_map(12..12 src has 1..12) 2026-02-17T21:23:42.881 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.876+0000 7efdd77fe640 3 client.4175.objecter handle_osd_map got epochs [12,12] > 0 2026-02-17T21:23:42.881 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.876+0000 7efdd77fe640 3 client.4175.objecter handle_osd_map decoding full epoch 12 2026-02-17T21:23:42.881 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.876+0000 7efdd77fe640 20 client.4175.objecter dump_active .. 0 homeless 2026-02-17T21:23:42.883 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.879+0000 7efdd77fe640 1 -- 10.20.193.176:0/4235126843 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7efde0022020 con 0x7efdf81192f0 2026-02-17T21:23:42.883 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.879+0000 7efdd77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:42.883 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.879+0000 7efdd77fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:23:42.916 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.912+0000 7efdfd7f8640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "fc24ee77-5a0d-41d4-88f5-8d03a77c7608", "id": 10}] 2026-02-17T21:23:42.916 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.912+0000 7efdfd7f8640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "fc24ee77-5a0d-41d4-88f5-8d03a77c7608", "id": 10}] 2026-02-17T21:23:42.916 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.912+0000 7efdfd7f8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:42.916 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.912+0000 7efdfd7f8640 1 -- 10.20.193.176:0/4235126843 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fc24ee77-5a0d-41d4-88f5-8d03a77c7608", "id": 10} v 0) -- 0x7efdf81b87d0 con 0x7efdf81192f0 2026-02-17T21:23:42.965 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.961+0000 7efdd77fe640 1 -- 10.20.193.176:0/4235126843 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fc24ee77-5a0d-41d4-88f5-8d03a77c7608", "id": 10}]=0 v13) ==== 113+0+3 (secure 0 0 0) 0x7efde00616a0 con 0x7efdf81192f0 2026-02-17T21:23:42.965 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.961+0000 7efdd77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "fc24ee77-5a0d-41d4-88f5-8d03a77c7608", "id": 10}] 2026-02-17T21:23:42.965 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.961+0000 7efdd77fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:23:42.965 INFO:teuthology.orchestra.run.trial176.stdout:10 2026-02-17T21:23:42.967 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.961+0000 7efdfd7f8640 10 librados: watch_flush enter 2026-02-17T21:23:42.967 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.961+0000 7efdfd7f8640 10 librados: watch_flush exit 2026-02-17T21:23:42.967 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.961+0000 7efdfd7f8640 20 client.4175.objecter shutdown clearing up homeless session... 2026-02-17T21:23:42.967 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.961+0000 7efdfd7f8640 10 client.4175.objecter successfully canceled tick 2026-02-17T21:23:42.967 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.961+0000 7efdfd7f8640 10 monclient: shutdown 2026-02-17T21:23:42.967 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.961+0000 7efdfd7f8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:42.968 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.961+0000 7efdfd7f8640 1 -- 10.20.193.176:0/4235126843 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7efdf81192f0 msgr2=0x7efdf8122a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:42.968 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.961+0000 7efdfd7f8640 1 --2- 10.20.193.176:0/4235126843 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7efdf81192f0 0x7efdf8122a80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efde000c730 tx=0x7efde000cc00 comp rx=0 tx=0).stop 2026-02-17T21:23:42.968 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.962+0000 7efdfd7f8640 1 -- 10.20.193.176:0/4235126843 shutdown_connections 2026-02-17T21:23:42.968 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.962+0000 7efdfd7f8640 1 --2- 10.20.193.176:0/4235126843 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7efdf8119e70 0x7efdf81b12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.968 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.962+0000 7efdfd7f8640 1 --2- 10.20.193.176:0/4235126843 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7efdf81192f0 0x7efdf8122a80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.968 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.962+0000 7efdfd7f8640 1 --2- 10.20.193.176:0/4235126843 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efdf81149f0 0x7efdf8122410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:42.968 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.962+0000 7efdfd7f8640 1 -- 10.20.193.176:0/4235126843 >> 10.20.193.176:0/4235126843 conn(0x7efdf8073660 msgr2=0x7efdf8112570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:42.968 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.962+0000 7efdfd7f8640 1 -- 10.20.193.176:0/4235126843 shutdown_connections 2026-02-17T21:23:42.968 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.962+0000 7efdfd7f8640 1 -- 10.20.193.176:0/4235126843 wait complete. 2026-02-17T21:23:42.968 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:42.962+0000 7efdfd7f8640 1 librados: shutdown 2026-02-17T21:23:42.974 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph --cluster ceph osd new 1d737681-1923-453a-82f8-516eeb875559 11 2026-02-17T21:23:42.977 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:42.973+0000 7f4fa5bdb140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T21:23:42.998 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:42.995+0000 7f4fa5bdb140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T21:23:43.039 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.034+0000 7ffa442d3640 10 monclient: get_monmap_and_config 2026-02-17T21:23:43.039 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.034+0000 7ffa442d3640 10 monclient: build_initial_monmap 2026-02-17T21:23:43.040 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.034+0000 7ffa442d3640 10 monclient: monmap: 2026-02-17T21:23:43.040 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:43.040 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:43.040 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:23:43.035932+0000 2026-02-17T21:23:43.040 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:23:43.035932+0000 2026-02-17T21:23:43.040 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:43.040 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:43.040 INFO:teuthology.orchestra.run.trial176.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:23:43.040 INFO:teuthology.orchestra.run.trial176.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:23:43.040 INFO:teuthology.orchestra.run.trial176.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:23:43.041 INFO:teuthology.orchestra.run.trial176.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:23:43.041 INFO:teuthology.orchestra.run.trial176.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:23:43.041 INFO:teuthology.orchestra.run.trial176.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:23:43.041 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:43.041 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.034+0000 7ffa442d3640 1 Processor -- start 2026-02-17T21:23:43.041 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.034+0000 7ffa442d3640 1 -- start start 2026-02-17T21:23:43.041 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.034+0000 7ffa442d3640 10 monclient: init 2026-02-17T21:23:43.041 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.034+0000 7ffa442d3640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:43.041 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.034+0000 7ffa442d3640 10 monclient: _add_conns ranks=[0,2,3,4,5,1] 2026-02-17T21:23:43.041 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.034+0000 7ffa442d3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ffa3c073830 addr v1:10.20.193.5:6789/0 2026-02-17T21:23:43.041 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.034+0000 7ffa442d3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ffa3c073c10 addr v1:10.20.193.135:6789/0 2026-02-17T21:23:43.042 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.034+0000 7ffa442d3640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7ffa3c125a70 0x7ffa3c127e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:43.042 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.034+0000 7ffa442d3640 10 monclient(hunting): picked mon.noname-a con 0x7ffa3c125a70 addr v2:10.20.193.5:3300/0 2026-02-17T21:23:43.042 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.034+0000 7ffa442d3640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa3c1283a0 con 0x7ffa3c073830 2026-02-17T21:23:43.042 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.034+0000 7ffa442d3640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa3c129580 con 0x7ffa3c073c10 2026-02-17T21:23:43.042 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.034+0000 7ffa442d3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:43.042 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.034+0000 7ffa442d3640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7ffa3c12a760 con 0x7ffa3c125a70 2026-02-17T21:23:43.042 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.034+0000 7ffa442d3640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:43.042 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.034+0000 7ffa442d3640 10 monclient(hunting): authenticate will time out at 961.677833s 2026-02-17T21:23:43.042 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.035+0000 7ffa41847640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7ffa3c073c10 0x7ffa3c124350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.176:40266/0 (socket says 10.20.193.176:40266) 2026-02-17T21:23:43.042 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.035+0000 7ffa41847640 1 -- 10.20.193.176:0/697972916 learned_addr learned my addr 10.20.193.176:0/697972916 (peer_addr_for_me v1:10.20.193.176:0/0) 2026-02-17T21:23:43.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.036+0000 7ffa41046640 1 -- 10.20.193.176:0/697972916 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3934846505 0 0) 0x7ffa3c129580 con 0x7ffa3c073c10 2026-02-17T21:23:43.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.036+0000 7ffa41046640 10 monclient(hunting): _negotiate 2026-02-17T21:23:43.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.036+0000 7ffa41046640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:43.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.036+0000 7ffa41046640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:43.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.036+0000 7ffa41046640 10 monclient(hunting): my global_id is 4178 2026-02-17T21:23:43.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.036+0000 7ffa41046640 1 -- 10.20.193.176:0/697972916 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa24003620 con 0x7ffa3c073c10 2026-02-17T21:23:43.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 1 -- 10.20.193.176:0/697972916 <== mon.2 v1:10.20.193.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2612408915 0 0) 0x7ffa24003620 con 0x7ffa3c073c10 2026-02-17T21:23:43.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 1 -- 10.20.193.176:0/697972916 >> v2:10.20.193.5:3300/0 conn(0x7ffa3c125a70 msgr2=0x7ffa3c127e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:23:43.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 1 --2- 10.20.193.176:0/697972916 >> v2:10.20.193.5:3300/0 conn(0x7ffa3c125a70 0x7ffa3c127e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 1 -- 10.20.193.176:0/697972916 >> v1:10.20.193.5:6789/0 conn(0x7ffa3c073830 legacy=0x7ffa3c1181d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:23:43.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 10 monclient: _finish_hunting 0 2026-02-17T21:23:43.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 1 monclient: found mon.noname-c-legacy 2026-02-17T21:23:43.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:43.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.135:6789/0 2026-02-17T21:23:43.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 1 -- 10.20.193.176:0/697972916 --> v1:10.20.193.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa3c12a8e0 con 0x7ffa3c073c10 2026-02-17T21:23:43.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 10 monclient: _finish_auth 0 2026-02-17T21:23:43.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 10 monclient: _check_auth_tickets 2026-02-17T21:23:43.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:43.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 1 -- 10.20.193.176:0/697972916 <== mon.2 v1:10.20.193.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3880376286 0 0) 0x7ffa30002f00 con 0x7ffa3c073c10 2026-02-17T21:23:43.054 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa442d3640 5 monclient: authenticate success, global_id 4178 2026-02-17T21:23:43.054 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa442d3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:23:43.054 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:43.054 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T21:23:43.054 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 10 monclient: dump: 2026-02-17T21:23:43.054 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:43.054 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:43.054 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.054 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.054 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:43.054 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:43.054 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:43.055 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:43.055 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:43.055 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:43.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 1 monclient: mon.c has (v2) addrs [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] but i'm connected to v1:10.20.193.135:6789/0, reconnecting 2026-02-17T21:23:43.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:43.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 1 -- 10.20.193.176:0/697972916 >> v1:10.20.193.135:6789/0 conn(0x7ffa3c073c10 legacy=0x7ffa3c124350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:43.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:23:43.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 1 --2- 10.20.193.176:0/697972916 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffa24003ba0 0x7ffa24003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:43.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 10 monclient(hunting): picked mon.b con 0x7ffa24003ba0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:23:43.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 1 --2- 10.20.193.176:0/697972916 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ffa24004900 0x7ffa24004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:43.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 10 monclient(hunting): picked mon.a con 0x7ffa24004900 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:23:43.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 1 --2- 10.20.193.176:0/697972916 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ffa24009ab0 0x7ffa2400bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:43.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 10 monclient(hunting): picked mon.c con 0x7ffa24009ab0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:23:43.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:43.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 1 -- 10.20.193.176:0/697972916 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c12a760 con 0x7ffa24004900 2026-02-17T21:23:43.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:43.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 1 -- 10.20.193.176:0/697972916 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2400c4f0 con 0x7ffa24003ba0 2026-02-17T21:23:43.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:43.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 1 -- 10.20.193.176:0/697972916 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2400c6f0 con 0x7ffa24009ab0 2026-02-17T21:23:43.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:43.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa41046640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:23:43.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa442d3640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T21:23:43.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa42048640 1 --2- 10.20.193.176:0/697972916 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffa24003ba0 0x7ffa24003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:43.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa42048640 10 monclient(hunting): get_auth_request con 0x7ffa24003ba0 auth_method 0 2026-02-17T21:23:43.057 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa42048640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:43.057 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa42048640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:43.057 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.038+0000 7ffa42048640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:23:43.057 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa42048640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:43.057 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa42048640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:43.057 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa42048640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:23:43.057 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa42849640 1 --2- 10.20.193.176:0/697972916 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ffa24009ab0 0x7ffa2400bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:43.057 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa42849640 10 monclient(hunting): get_auth_request con 0x7ffa24009ab0 auth_method 0 2026-02-17T21:23:43.057 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa42849640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:43.057 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa42849640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:43.057 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa42849640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:23:43.057 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa42849640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:43.057 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa42849640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:43.058 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa42849640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:23:43.058 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa41847640 1 --2- 10.20.193.176:0/697972916 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ffa24004900 0x7ffa24004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:43.058 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa42048640 10 monclient(hunting): handle_auth_done global_id 4178 payload 293 2026-02-17T21:23:43.058 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa42048640 1 -- 10.20.193.176:0/697972916 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ffa24009ab0 msgr2=0x7ffa2400bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:23:43.058 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa42048640 1 --2- 10.20.193.176:0/697972916 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ffa24009ab0 0x7ffa2400bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.058 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa42048640 1 -- 10.20.193.176:0/697972916 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ffa24004900 msgr2=0x7ffa24004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:23:43.058 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa42048640 1 --2- 10.20.193.176:0/697972916 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ffa24004900 0x7ffa24004d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.058 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa42048640 10 monclient: _finish_hunting 0 2026-02-17T21:23:43.058 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa42048640 1 monclient: found mon.b 2026-02-17T21:23:43.058 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa42849640 1 -- 10.20.193.176:0/697972916 reap_dead start 2026-02-17T21:23:43.058 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa42048640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:43.059 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa42048640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:43.059 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa42048640 1 -- 10.20.193.176:0/697972916 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa24003620 con 0x7ffa24003ba0 2026-02-17T21:23:43.059 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa42048640 10 monclient: _finish_auth 0 2026-02-17T21:23:43.059 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa42048640 10 monclient: _check_auth_tickets 2026-02-17T21:23:43.059 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.039+0000 7ffa42048640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:43.059 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.040+0000 7ffa42048640 1 --2- 10.20.193.176:0/697972916 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffa24003ba0 0x7ffa24003fa0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c002f60 tx=0x7ffa2c02eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50c0025798b4cd38 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:43.059 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.042+0000 7ffa41046640 1 -- 10.20.193.176:0/697972916 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c002b30 con 0x7ffa24003ba0 2026-02-17T21:23:43.059 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.042+0000 7ffa41046640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:43.059 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.042+0000 7ffa41046640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:23:43.059 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.042+0000 7ffa41046640 10 monclient: dump: 2026-02-17T21:23:43.059 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:43.059 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:43.060 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.060 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.060 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:43.060 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:43.060 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:43.060 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:43.060 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:43.060 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:43.060 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.042+0000 7ffa41046640 1 -- 10.20.193.176:0/697972916 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa2c005290 con 0x7ffa24003ba0 2026-02-17T21:23:43.060 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.042+0000 7ffa442d3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:23:43.060 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.042+0000 7ffa41046640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:43.060 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.042+0000 7ffa41046640 1 -- 10.20.193.176:0/697972916 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c003710 con 0x7ffa24003ba0 2026-02-17T21:23:43.060 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.042+0000 7ffa442d3640 10 monclient: get_monmap_and_config success 2026-02-17T21:23:43.061 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.042+0000 7ffa442d3640 4 set_mon_vals no callback set 2026-02-17T21:23:43.061 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.042+0000 7ffa41046640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:43.061 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.042+0000 7ffa41046640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:23:43.061 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.042+0000 7ffa41046640 10 monclient: dump: 2026-02-17T21:23:43.061 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:43.061 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:43.061 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.061 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.061 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:43.061 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:43.061 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:43.061 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:43.062 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:43.062 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:43.062 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.042+0000 7ffa442d3640 10 monclient: shutdown 2026-02-17T21:23:43.062 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.042+0000 7ffa442d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:43.062 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.042+0000 7ffa442d3640 1 -- 10.20.193.176:0/697972916 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffa24003ba0 msgr2=0x7ffa24003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:43.062 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.042+0000 7ffa442d3640 1 --2- 10.20.193.176:0/697972916 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffa24003ba0 0x7ffa24003fa0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c002f60 tx=0x7ffa2c02eca0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.062 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.042+0000 7ffa442d3640 1 -- 10.20.193.176:0/697972916 shutdown_connections 2026-02-17T21:23:43.062 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.042+0000 7ffa442d3640 1 --2- 10.20.193.176:0/697972916 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffa24003ba0 0x7ffa24003fa0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.062 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.042+0000 7ffa442d3640 1 -- 10.20.193.176:0/697972916 >> 10.20.193.176:0/697972916 conn(0x7ffa3c06f660 msgr2=0x7ffa3c071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:43.062 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.042+0000 7ffa442d3640 1 -- 10.20.193.176:0/697972916 shutdown_connections 2026-02-17T21:23:43.062 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.042+0000 7ffa442d3640 1 -- 10.20.193.176:0/697972916 wait complete. 2026-02-17T21:23:43.062 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa442d3640 10 monclient: build_initial_monmap 2026-02-17T21:23:43.062 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa442d3640 10 monclient: monmap: 2026-02-17T21:23:43.063 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:43.063 INFO:teuthology.orchestra.run.trial176.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:23:43.063 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 0.000000 2026-02-17T21:23:43.063 INFO:teuthology.orchestra.run.trial176.stderr:created 0.000000 2026-02-17T21:23:43.063 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:43.063 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:43.063 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:23:43.063 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:23:43.063 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:23:43.063 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:43.063 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa442d3640 1 librados: starting msgr at 2026-02-17T21:23:43.064 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa442d3640 1 librados: starting objecter 2026-02-17T21:23:43.064 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa442d3640 1 Processor -- start 2026-02-17T21:23:43.064 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa442d3640 1 -- start start 2026-02-17T21:23:43.064 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa442d3640 1 librados: setting wanted keys 2026-02-17T21:23:43.064 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa442d3640 1 librados: calling monclient init 2026-02-17T21:23:43.064 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa442d3640 10 monclient: init 2026-02-17T21:23:43.064 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa442d3640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:43.064 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa442d3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:23:43.064 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa442d3640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffa24003ba0 0x7ffa3c116d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:43.064 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa442d3640 10 monclient(hunting): picked mon.noname-b con 0x7ffa24003ba0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:23:43.064 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa442d3640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ffa3c117240 0x7ffa3c1b9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:43.064 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa442d3640 10 monclient(hunting): picked mon.noname-a con 0x7ffa3c117240 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:23:43.065 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa442d3640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ffa3c1176c0 0x7ffa3c1bbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:43.065 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa442d3640 10 monclient(hunting): picked mon.noname-c con 0x7ffa3c1176c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:23:43.065 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa442d3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:43.065 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa442d3640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c128960 con 0x7ffa3c117240 2026-02-17T21:23:43.065 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa442d3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:43.065 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa442d3640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c1287e0 con 0x7ffa24003ba0 2026-02-17T21:23:43.065 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa442d3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:43.065 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa442d3640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c128ae0 con 0x7ffa3c1176c0 2026-02-17T21:23:43.065 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa442d3640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:43.065 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa442d3640 10 monclient(hunting): authenticate will time out at 961.686449s 2026-02-17T21:23:43.065 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa42849640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ffa3c1176c0 0x7ffa3c1bbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:43.065 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa41847640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ffa3c117240 0x7ffa3c1b9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:43.066 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa42048640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffa24003ba0 0x7ffa3c116d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:43.066 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa41847640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ffa3c117240 0x7ffa3c1b9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.176:47014/0 (socket says 10.20.193.176:47014) 2026-02-17T21:23:43.066 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa41847640 1 -- 10.20.193.176:0/2790784390 learned_addr learned my addr 10.20.193.176:0/2790784390 (peer_addr_for_me v2:10.20.193.176:0/0) 2026-02-17T21:23:43.066 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa41847640 10 monclient(hunting): get_auth_request con 0x7ffa3c117240 auth_method 0 2026-02-17T21:23:43.066 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa41847640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:43.066 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa41847640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:43.066 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa41847640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:43.066 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa42048640 10 monclient(hunting): get_auth_request con 0x7ffa24003ba0 auth_method 0 2026-02-17T21:23:43.066 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa42048640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:43.066 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa42048640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:43.066 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.043+0000 7ffa42048640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:43.066 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.044+0000 7ffa42048640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:43.066 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.044+0000 7ffa42048640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:43.067 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.044+0000 7ffa42048640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:43.067 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.044+0000 7ffa41847640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:43.067 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.044+0000 7ffa41847640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:43.067 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.044+0000 7ffa41847640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:43.067 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.044+0000 7ffa42849640 10 monclient(hunting): get_auth_request con 0x7ffa3c1176c0 auth_method 0 2026-02-17T21:23:43.067 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.044+0000 7ffa42849640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:43.067 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.044+0000 7ffa42849640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:43.067 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.044+0000 7ffa42849640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:43.067 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.044+0000 7ffa42849640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:43.067 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.044+0000 7ffa42849640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:43.067 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.044+0000 7ffa42849640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:43.067 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.045+0000 7ffa42048640 10 monclient(hunting): handle_auth_done global_id 4180 payload 824 2026-02-17T21:23:43.067 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.045+0000 7ffa42048640 1 -- 10.20.193.176:0/2790784390 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ffa3c1176c0 msgr2=0x7ffa3c1bbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:43.068 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.045+0000 7ffa42048640 1 --2- 10.20.193.176:0/2790784390 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ffa3c1176c0 0x7ffa3c1bbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.068 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.045+0000 7ffa42048640 1 -- 10.20.193.176:0/2790784390 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ffa3c117240 msgr2=0x7ffa3c1b9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:43.068 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.045+0000 7ffa42048640 1 --2- 10.20.193.176:0/2790784390 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ffa3c117240 0x7ffa3c1b9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.068 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.045+0000 7ffa42048640 10 monclient: _finish_hunting 0 2026-02-17T21:23:43.068 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.045+0000 7ffa42048640 1 monclient: found mon.noname-b 2026-02-17T21:23:43.068 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.045+0000 7ffa42048640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:43.068 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.045+0000 7ffa42048640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:23:43.068 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.045+0000 7ffa42048640 1 -- 10.20.193.176:0/2790784390 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa3c1bc5b0 con 0x7ffa24003ba0 2026-02-17T21:23:43.068 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.046+0000 7ffa42048640 1 --2- 10.20.193.176:0/2790784390 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffa24003ba0 0x7ffa3c116d00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c034000 tx=0x7ffa2c0027c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:43.068 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.046+0000 7ffa22ffd640 10 client.?.objecter ms_handle_connect 0x7ffa24003ba0 2026-02-17T21:23:43.068 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.046+0000 7ffa22ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:23:43.071 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.048+0000 7ffa22ffd640 1 -- 10.20.193.176:0/2790784390 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c006ab0 con 0x7ffa24003ba0 2026-02-17T21:23:43.071 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.048+0000 7ffa22ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:43.071 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.048+0000 7ffa22ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:23:43.071 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.048+0000 7ffa22ffd640 10 monclient: dump: 2026-02-17T21:23:43.071 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:43.071 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:43.071 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.071 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.071 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:43.071 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:43.071 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:43.072 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:43.072 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:43.072 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:43.072 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.048+0000 7ffa22ffd640 10 monclient: _finish_auth 0 2026-02-17T21:23:43.072 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.048+0000 7ffa22ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:23:43.072 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.048+0000 7ffa22ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:43.072 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.048+0000 7ffa442d3640 5 monclient: authenticate success, global_id 4180 2026-02-17T21:23:43.072 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.048+0000 7ffa22ffd640 1 -- 10.20.193.176:0/2790784390 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa2c006c50 con 0x7ffa24003ba0 2026-02-17T21:23:43.072 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.048+0000 7ffa22ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:43.072 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.048+0000 7ffa22ffd640 1 -- 10.20.193.176:0/2790784390 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c007070 con 0x7ffa24003ba0 2026-02-17T21:23:43.072 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.048+0000 7ffa22ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:43.072 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.048+0000 7ffa22ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:23:43.073 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.048+0000 7ffa40845640 4 set_mon_vals no callback set 2026-02-17T21:23:43.073 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.048+0000 7ffa22ffd640 10 monclient: dump: 2026-02-17T21:23:43.073 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:43.073 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:43.073 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.073 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.073 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:43.073 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:43.073 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:43.073 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:43.073 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:43.073 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:43.073 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.048+0000 7ffa442d3640 10 monclient: _renew_subs 2026-02-17T21:23:43.074 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.048+0000 7ffa442d3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:43.074 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.048+0000 7ffa442d3640 1 -- 10.20.193.176:0/2790784390 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa3c1bc7e0 con 0x7ffa24003ba0 2026-02-17T21:23:43.074 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.048+0000 7ffa442d3640 10 client.4180.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:23:43.074 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.048+0000 7ffa442d3640 10 monclient: _renew_subs 2026-02-17T21:23:43.074 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.048+0000 7ffa442d3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:43.074 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.048+0000 7ffa442d3640 1 -- 10.20.193.176:0/2790784390 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa3c1bcd30 con 0x7ffa24003ba0 2026-02-17T21:23:43.074 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.048+0000 7ffa442d3640 1 librados: init done 2026-02-17T21:23:43.074 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.049+0000 7ffa442d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:43.074 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.049+0000 7ffa442d3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:43.074 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.049+0000 7ffa442d3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:43.074 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.049+0000 7ffa442d3640 1 -- 10.20.193.176:0/2790784390 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa3c128ef0 con 0x7ffa24003ba0 2026-02-17T21:23:43.074 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.059+0000 7ffa22ffd640 1 -- 10.20.193.176:0/2790784390 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 3) ==== 99956+0+0 (secure 0 0 0) 0x7ffa2c007230 con 0x7ffa24003ba0 2026-02-17T21:23:43.074 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.060+0000 7ffa22ffd640 1 -- 10.20.193.176:0/2790784390 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 1990+0+0 (secure 0 0 0) 0x7ffa2c082630 con 0x7ffa24003ba0 2026-02-17T21:23:43.074 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.060+0000 7ffa22ffd640 10 client.4180.objecter ms_dispatch2 0x7ffa3c000b90 osd_map(13..13 src has 1..13) 2026-02-17T21:23:43.075 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.060+0000 7ffa22ffd640 3 client.4180.objecter handle_osd_map got epochs [13,13] > 0 2026-02-17T21:23:43.075 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.060+0000 7ffa22ffd640 3 client.4180.objecter handle_osd_map decoding full epoch 13 2026-02-17T21:23:43.075 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.060+0000 7ffa22ffd640 20 client.4180.objecter dump_active .. 0 homeless 2026-02-17T21:23:43.103 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.099+0000 7ffa22ffd640 1 -- 10.20.193.176:0/2790784390 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7ffa2c034030 con 0x7ffa24003ba0 2026-02-17T21:23:43.103 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.099+0000 7ffa22ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:43.103 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.099+0000 7ffa22ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:23:43.135 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.131+0000 7ffa442d3640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "1d737681-1923-453a-82f8-516eeb875559", "id": 11}] 2026-02-17T21:23:43.135 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.131+0000 7ffa442d3640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "1d737681-1923-453a-82f8-516eeb875559", "id": 11}] 2026-02-17T21:23:43.135 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.131+0000 7ffa442d3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:43.136 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.131+0000 7ffa442d3640 1 -- 10.20.193.176:0/2790784390 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1d737681-1923-453a-82f8-516eeb875559", "id": 11} v 0) -- 0x7ffa3c123960 con 0x7ffa24003ba0 2026-02-17T21:23:43.178 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.174+0000 7ffa22ffd640 1 -- 10.20.193.176:0/2790784390 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1d737681-1923-453a-82f8-516eeb875559", "id": 11}]=0 v14) ==== 113+0+3 (secure 0 0 0) 0x7ffa2c086f10 con 0x7ffa24003ba0 2026-02-17T21:23:43.178 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.174+0000 7ffa22ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "1d737681-1923-453a-82f8-516eeb875559", "id": 11}] 2026-02-17T21:23:43.178 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.174+0000 7ffa22ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:23:43.179 INFO:teuthology.orchestra.run.trial176.stdout:11 2026-02-17T21:23:43.180 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.175+0000 7ffa442d3640 10 librados: watch_flush enter 2026-02-17T21:23:43.180 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.175+0000 7ffa442d3640 10 librados: watch_flush exit 2026-02-17T21:23:43.180 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.175+0000 7ffa442d3640 20 client.4180.objecter shutdown clearing up homeless session... 2026-02-17T21:23:43.180 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.175+0000 7ffa442d3640 10 client.4180.objecter successfully canceled tick 2026-02-17T21:23:43.180 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.175+0000 7ffa442d3640 10 monclient: shutdown 2026-02-17T21:23:43.180 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.175+0000 7ffa442d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:43.181 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.175+0000 7ffa442d3640 1 -- 10.20.193.176:0/2790784390 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffa24003ba0 msgr2=0x7ffa3c116d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:43.181 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.175+0000 7ffa442d3640 1 --2- 10.20.193.176:0/2790784390 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffa24003ba0 0x7ffa3c116d00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c034000 tx=0x7ffa2c0027c0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.181 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.175+0000 7ffa442d3640 1 -- 10.20.193.176:0/2790784390 shutdown_connections 2026-02-17T21:23:43.181 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.175+0000 7ffa442d3640 1 --2- 10.20.193.176:0/2790784390 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ffa3c1176c0 0x7ffa3c1bbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.181 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.175+0000 7ffa442d3640 1 --2- 10.20.193.176:0/2790784390 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ffa3c117240 0x7ffa3c1b9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.181 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.175+0000 7ffa442d3640 1 --2- 10.20.193.176:0/2790784390 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffa24003ba0 0x7ffa3c116d00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.181 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.175+0000 7ffa442d3640 1 -- 10.20.193.176:0/2790784390 >> 10.20.193.176:0/2790784390 conn(0x7ffa3c06f660 msgr2=0x7ffa3c072310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:43.181 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.175+0000 7ffa442d3640 1 -- 10.20.193.176:0/2790784390 shutdown_connections 2026-02-17T21:23:43.181 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.175+0000 7ffa442d3640 1 -- 10.20.193.176:0/2790784390 wait complete. 2026-02-17T21:23:43.181 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.175+0000 7ffa442d3640 1 librados: shutdown 2026-02-17T21:23:43.187 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph --cluster ceph osd new c4f0322e-a862-4c5e-967e-4551087ede8c 12 2026-02-17T21:23:43.292 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.288+0000 7efd45ac6640 10 monclient: get_monmap_and_config 2026-02-17T21:23:43.292 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.288+0000 7efd45ac6640 10 monclient: build_initial_monmap 2026-02-17T21:23:43.292 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.288+0000 7efd45ac6640 10 monclient: monmap: 2026-02-17T21:23:43.292 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:43.292 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:43.293 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:23:43.290008+0000 2026-02-17T21:23:43.293 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:23:43.290008+0000 2026-02-17T21:23:43.293 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:43.293 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:43.293 INFO:teuthology.orchestra.run.trial176.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:23:43.293 INFO:teuthology.orchestra.run.trial176.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:23:43.293 INFO:teuthology.orchestra.run.trial176.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:23:43.293 INFO:teuthology.orchestra.run.trial176.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:23:43.293 INFO:teuthology.orchestra.run.trial176.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:23:43.293 INFO:teuthology.orchestra.run.trial176.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:23:43.293 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:43.303 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.288+0000 7efd45ac6640 1 Processor -- start 2026-02-17T21:23:43.303 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.288+0000 7efd45ac6640 1 -- start start 2026-02-17T21:23:43.303 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.288+0000 7efd45ac6640 10 monclient: init 2026-02-17T21:23:43.303 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd45ac6640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:43.303 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd45ac6640 10 monclient: _add_conns ranks=[4,3,1,2,0,5] 2026-02-17T21:23:43.303 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd45ac6640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7efd401149f0 0x7efd40114dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:43.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd45ac6640 10 monclient(hunting): picked mon.noname-b con 0x7efd401149f0 addr v2:10.20.193.119:3300/0 2026-02-17T21:23:43.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd45ac6640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7efd401192f0 0x7efd40119760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:43.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd45ac6640 10 monclient(hunting): picked mon.noname-a con 0x7efd401192f0 addr v2:10.20.193.5:3300/0 2026-02-17T21:23:43.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd45ac6640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7efd40119ca0 addr v1:10.20.193.119:6789/0 2026-02-17T21:23:43.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd45ac6640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd40122d00 con 0x7efd40119ca0 2026-02-17T21:23:43.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd45ac6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:43.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd45ac6640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7efd40123ee0 con 0x7efd401192f0 2026-02-17T21:23:43.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd45ac6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:43.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd45ac6640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7efd40124060 con 0x7efd401149f0 2026-02-17T21:23:43.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd45ac6640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:43.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd45ac6640 10 monclient(hunting): authenticate will time out at 961.932086s 2026-02-17T21:23:43.304 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd3f7fe640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7efd401149f0 0x7efd40114dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:43.305 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd3effd640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7efd401192f0 0x7efd40119760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:43.305 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd3effd640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7efd401192f0 0x7efd40119760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.176:47022/0 (socket says 10.20.193.176:47022) 2026-02-17T21:23:43.305 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd3effd640 1 -- 10.20.193.176:0/243019014 learned_addr learned my addr 10.20.193.176:0/243019014 (peer_addr_for_me v2:10.20.193.176:0/0) 2026-02-17T21:23:43.305 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd3effd640 10 monclient(hunting): get_auth_request con 0x7efd401192f0 auth_method 0 2026-02-17T21:23:43.305 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd3effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:43.305 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd3effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:43.305 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd3effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:43.305 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd3f7fe640 10 monclient(hunting): get_auth_request con 0x7efd401149f0 auth_method 0 2026-02-17T21:23:43.305 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd3f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:43.305 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd3f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:43.305 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.289+0000 7efd3f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:43.305 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.290+0000 7efd3effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:43.306 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.290+0000 7efd3effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:43.306 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.290+0000 7efd3effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:43.306 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.290+0000 7efd3f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:43.306 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.290+0000 7efd3f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:43.306 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.290+0000 7efd3f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:43.306 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.290+0000 7efd3effd640 10 monclient(hunting): handle_auth_done global_id 4164 payload 274 2026-02-17T21:23:43.306 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.290+0000 7efd3effd640 1 -- 10.20.193.176:0/243019014 >> v2:10.20.193.119:3300/0 conn(0x7efd401149f0 msgr2=0x7efd40114dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:23:43.306 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.290+0000 7efd3effd640 1 --2- 10.20.193.176:0/243019014 >> v2:10.20.193.119:3300/0 conn(0x7efd401149f0 0x7efd40114dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.306 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.290+0000 7efd3effd640 1 -- 10.20.193.176:0/243019014 >> v1:10.20.193.119:6789/0 conn(0x7efd40119ca0 legacy=0x7efd401215e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:43.306 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.290+0000 7efd3effd640 10 monclient: _finish_hunting 0 2026-02-17T21:23:43.306 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.290+0000 7efd3effd640 1 monclient: found mon.noname-a 2026-02-17T21:23:43.307 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.290+0000 7efd3effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:43.307 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.290+0000 7efd3effd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:23:43.307 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.290+0000 7efd3effd640 1 -- 10.20.193.176:0/243019014 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd401241e0 con 0x7efd401192f0 2026-02-17T21:23:43.307 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.291+0000 7efd3effd640 1 --2- 10.20.193.176:0/243019014 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7efd401192f0 0x7efd40119760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efd401156c0 tx=0x7efd3002ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd82a9c9e4cc3c7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:43.307 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd3e7fc640 1 -- 10.20.193.176:0/243019014 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3003c070 con 0x7efd401192f0 2026-02-17T21:23:43.307 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd3e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:43.307 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd3e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:23:43.307 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd3e7fc640 10 monclient: dump: 2026-02-17T21:23:43.307 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:43.307 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:43.307 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.307 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.307 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:43.308 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:43.308 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:43.308 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:43.308 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:43.308 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:43.308 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd3e7fc640 10 monclient: _finish_auth 0 2026-02-17T21:23:43.308 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd3e7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:23:43.308 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd3e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:43.308 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd3e7fc640 1 -- 10.20.193.176:0/243019014 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd3002fb60 con 0x7efd401192f0 2026-02-17T21:23:43.308 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd3e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:43.308 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd45ac6640 5 monclient: authenticate success, global_id 4164 2026-02-17T21:23:43.308 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd3e7fc640 1 -- 10.20.193.176:0/243019014 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd30037440 con 0x7efd401192f0 2026-02-17T21:23:43.309 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd45ac6640 10 monclient: get_monmap_and_config success 2026-02-17T21:23:43.309 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd3e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:43.309 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd45ac6640 4 set_mon_vals no callback set 2026-02-17T21:23:43.309 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd3e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:23:43.309 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd3e7fc640 10 monclient: dump: 2026-02-17T21:23:43.309 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:43.309 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:43.309 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.309 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.309 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:43.309 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:43.309 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:43.310 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:43.310 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:43.310 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:43.310 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd45ac6640 10 monclient: shutdown 2026-02-17T21:23:43.310 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd45ac6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:43.310 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd45ac6640 1 -- 10.20.193.176:0/243019014 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7efd401192f0 msgr2=0x7efd40119760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:43.310 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd45ac6640 1 --2- 10.20.193.176:0/243019014 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7efd401192f0 0x7efd40119760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efd401156c0 tx=0x7efd3002ee90 comp rx=0 tx=0).stop 2026-02-17T21:23:43.310 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd45ac6640 1 -- 10.20.193.176:0/243019014 shutdown_connections 2026-02-17T21:23:43.310 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd45ac6640 1 --2- 10.20.193.176:0/243019014 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7efd401192f0 0x7efd40119760 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.310 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd45ac6640 1 --2- 10.20.193.176:0/243019014 >> v2:10.20.193.119:3300/0 conn(0x7efd401149f0 0x7efd40114dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.310 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd45ac6640 1 -- 10.20.193.176:0/243019014 >> 10.20.193.176:0/243019014 conn(0x7efd40073660 msgr2=0x7efd40073a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:43.310 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd45ac6640 1 -- 10.20.193.176:0/243019014 shutdown_connections 2026-02-17T21:23:43.311 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.293+0000 7efd45ac6640 1 -- 10.20.193.176:0/243019014 wait complete. 2026-02-17T21:23:43.311 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd45ac6640 10 monclient: build_initial_monmap 2026-02-17T21:23:43.311 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd45ac6640 10 monclient: monmap: 2026-02-17T21:23:43.311 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:43.311 INFO:teuthology.orchestra.run.trial176.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:23:43.311 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 0.000000 2026-02-17T21:23:43.311 INFO:teuthology.orchestra.run.trial176.stderr:created 0.000000 2026-02-17T21:23:43.311 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:43.311 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:43.311 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:23:43.311 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:23:43.311 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:23:43.312 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:43.312 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd45ac6640 1 librados: starting msgr at 2026-02-17T21:23:43.312 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd45ac6640 1 librados: starting objecter 2026-02-17T21:23:43.312 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd45ac6640 1 Processor -- start 2026-02-17T21:23:43.312 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd45ac6640 1 -- start start 2026-02-17T21:23:43.312 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd45ac6640 1 librados: setting wanted keys 2026-02-17T21:23:43.312 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd45ac6640 1 librados: calling monclient init 2026-02-17T21:23:43.312 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd45ac6640 10 monclient: init 2026-02-17T21:23:43.312 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd45ac6640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:43.312 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd45ac6640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:23:43.312 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd45ac6640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7efd401149f0 0x7efd401ab940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:43.312 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd45ac6640 10 monclient(hunting): picked mon.noname-c con 0x7efd401149f0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:23:43.312 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd45ac6640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efd401192f0 0x7efd401abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:43.313 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd45ac6640 10 monclient(hunting): picked mon.noname-b con 0x7efd401192f0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:23:43.313 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd45ac6640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7efd40119ca0 0x7efd401b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:43.313 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd45ac6640 10 monclient(hunting): picked mon.noname-a con 0x7efd40119ca0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:23:43.313 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd45ac6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:43.313 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd45ac6640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7efd401232f0 con 0x7efd40119ca0 2026-02-17T21:23:43.313 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd45ac6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:43.313 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd45ac6640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7efd40123170 con 0x7efd401192f0 2026-02-17T21:23:43.313 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd45ac6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:43.313 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd45ac6640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7efd40123470 con 0x7efd401149f0 2026-02-17T21:23:43.313 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd45ac6640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:43.314 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd45ac6640 10 monclient(hunting): authenticate will time out at 961.937709s 2026-02-17T21:23:43.314 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.294+0000 7efd3effd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efd401192f0 0x7efd401abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:43.314 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.295+0000 7efd3effd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efd401192f0 0x7efd401abfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.176:51322/0 (socket says 10.20.193.176:51322) 2026-02-17T21:23:43.314 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.295+0000 7efd3effd640 1 -- 10.20.193.176:0/3949989853 learned_addr learned my addr 10.20.193.176:0/3949989853 (peer_addr_for_me v2:10.20.193.176:0/0) 2026-02-17T21:23:43.314 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.295+0000 7efd3effd640 10 monclient(hunting): get_auth_request con 0x7efd401192f0 auth_method 0 2026-02-17T21:23:43.314 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.295+0000 7efd3effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:43.314 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.295+0000 7efd3effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:43.314 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.295+0000 7efd3effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:43.314 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.295+0000 7efd3ffff640 1 --2- 10.20.193.176:0/3949989853 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7efd40119ca0 0x7efd401b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:43.314 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.295+0000 7efd3f7fe640 1 --2- 10.20.193.176:0/3949989853 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7efd401149f0 0x7efd401ab940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:43.314 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.295+0000 7efd3ffff640 10 monclient(hunting): get_auth_request con 0x7efd40119ca0 auth_method 0 2026-02-17T21:23:43.314 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.295+0000 7efd3ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:43.315 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.295+0000 7efd3ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:43.315 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.295+0000 7efd3ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:43.315 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.295+0000 7efd3effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:43.315 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.295+0000 7efd3effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:43.315 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.295+0000 7efd3effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:43.315 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.295+0000 7efd3f7fe640 10 monclient(hunting): get_auth_request con 0x7efd401149f0 auth_method 0 2026-02-17T21:23:43.315 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.295+0000 7efd3f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:43.315 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.295+0000 7efd3f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:43.315 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.295+0000 7efd3f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:43.315 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.295+0000 7efd3ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:43.315 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.295+0000 7efd3ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:43.315 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.295+0000 7efd3ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:43.316 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.295+0000 7efd3f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:43.316 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.295+0000 7efd3f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:43.316 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.295+0000 7efd3f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:43.316 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.296+0000 7efd3effd640 10 monclient(hunting): handle_auth_done global_id 4189 payload 824 2026-02-17T21:23:43.316 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.296+0000 7efd3effd640 1 -- 10.20.193.176:0/3949989853 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7efd401149f0 msgr2=0x7efd401ab940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:43.316 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.296+0000 7efd3effd640 1 --2- 10.20.193.176:0/3949989853 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7efd401149f0 0x7efd401ab940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.316 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.296+0000 7efd3effd640 1 -- 10.20.193.176:0/3949989853 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7efd40119ca0 msgr2=0x7efd401b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:43.316 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.296+0000 7efd3effd640 1 --2- 10.20.193.176:0/3949989853 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7efd40119ca0 0x7efd401b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.316 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.296+0000 7efd3effd640 10 monclient: _finish_hunting 0 2026-02-17T21:23:43.316 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.296+0000 7efd3effd640 1 monclient: found mon.noname-b 2026-02-17T21:23:43.316 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.296+0000 7efd3effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:43.316 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.296+0000 7efd3effd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:23:43.317 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.296+0000 7efd3effd640 1 -- 10.20.193.176:0/3949989853 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd401b08f0 con 0x7efd401192f0 2026-02-17T21:23:43.317 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.297+0000 7efd3effd640 1 --2- 10.20.193.176:0/3949989853 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efd401192f0 0x7efd401abfb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efd30009aa0 tx=0x7efd300047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:43.317 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.297+0000 7efd1bfff640 10 client.?.objecter ms_handle_connect 0x7efd401192f0 2026-02-17T21:23:43.317 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.297+0000 7efd1bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:23:43.317 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.298+0000 7efd1bfff640 1 -- 10.20.193.176:0/3949989853 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd30047070 con 0x7efd401192f0 2026-02-17T21:23:43.317 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.298+0000 7efd1bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:43.317 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.298+0000 7efd1bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:23:43.317 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.298+0000 7efd1bfff640 10 monclient: dump: 2026-02-17T21:23:43.317 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:43.317 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:43.317 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.317 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.318 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:43.318 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:43.318 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:43.318 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:43.318 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:43.318 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:43.318 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.298+0000 7efd1bfff640 10 monclient: _finish_auth 0 2026-02-17T21:23:43.318 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.298+0000 7efd1bfff640 10 monclient: _check_auth_tickets 2026-02-17T21:23:43.318 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.298+0000 7efd1bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:43.318 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.298+0000 7efd45ac6640 5 monclient: authenticate success, global_id 4189 2026-02-17T21:23:43.318 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.298+0000 7efd45ac6640 10 monclient: _renew_subs 2026-02-17T21:23:43.318 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.298+0000 7efd45ac6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:43.318 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.298+0000 7efd45ac6640 1 -- 10.20.193.176:0/3949989853 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd401b0b80 con 0x7efd401192f0 2026-02-17T21:23:43.319 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.298+0000 7efd45ac6640 10 client.4189.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:23:43.319 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.298+0000 7efd45ac6640 10 monclient: _renew_subs 2026-02-17T21:23:43.319 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.298+0000 7efd45ac6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:43.319 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.298+0000 7efd45ac6640 1 -- 10.20.193.176:0/3949989853 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd401b8360 con 0x7efd401192f0 2026-02-17T21:23:43.319 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.298+0000 7efd45ac6640 1 librados: init done 2026-02-17T21:23:43.319 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.299+0000 7efd45ac6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:43.319 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.299+0000 7efd45ac6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:43.319 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.299+0000 7efd45ac6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:43.319 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.299+0000 7efd45ac6640 1 -- 10.20.193.176:0/3949989853 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd40114dd0 con 0x7efd401192f0 2026-02-17T21:23:43.319 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.299+0000 7efd1bfff640 1 -- 10.20.193.176:0/3949989853 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd3002faa0 con 0x7efd401192f0 2026-02-17T21:23:43.319 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.299+0000 7efd1bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:43.319 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.299+0000 7efd1bfff640 1 -- 10.20.193.176:0/3949989853 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3003c040 con 0x7efd401192f0 2026-02-17T21:23:43.320 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.299+0000 7efd1bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:43.320 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.299+0000 7efd1bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:23:43.320 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.299+0000 7efd1bfff640 10 monclient: dump: 2026-02-17T21:23:43.320 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:43.320 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:43.320 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.320 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.320 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:43.320 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:43.320 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:43.320 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:43.320 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:43.320 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:43.321 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.299+0000 7efd3dffb640 4 set_mon_vals no callback set 2026-02-17T21:23:43.336 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:43.332+0000 7f4fa5bdb140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T21:23:43.351 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.347+0000 7efd1bfff640 1 -- 10.20.193.176:0/3949989853 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 3) ==== 99956+0+0 (secure 0 0 0) 0x7efd30004430 con 0x7efd401192f0 2026-02-17T21:23:43.352 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.349+0000 7efd1bfff640 1 -- 10.20.193.176:0/3949989853 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2105+0+0 (secure 0 0 0) 0x7efd300820b0 con 0x7efd401192f0 2026-02-17T21:23:43.352 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.349+0000 7efd1bfff640 10 client.4189.objecter ms_dispatch2 0x7efd40000b90 osd_map(14..14 src has 1..14) 2026-02-17T21:23:43.352 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.349+0000 7efd1bfff640 3 client.4189.objecter handle_osd_map got epochs [14,14] > 0 2026-02-17T21:23:43.352 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.349+0000 7efd1bfff640 3 client.4189.objecter handle_osd_map decoding full epoch 14 2026-02-17T21:23:43.352 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.349+0000 7efd1bfff640 20 client.4189.objecter dump_active .. 0 homeless 2026-02-17T21:23:43.354 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.351+0000 7efd1bfff640 1 -- 10.20.193.176:0/3949989853 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7efd300648b0 con 0x7efd401192f0 2026-02-17T21:23:43.354 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.351+0000 7efd1bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:43.354 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.351+0000 7efd1bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:23:43.388 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.384+0000 7efd45ac6640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "c4f0322e-a862-4c5e-967e-4551087ede8c", "id": 12}] 2026-02-17T21:23:43.388 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.384+0000 7efd45ac6640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "c4f0322e-a862-4c5e-967e-4551087ede8c", "id": 12}] 2026-02-17T21:23:43.388 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.384+0000 7efd45ac6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:43.388 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.384+0000 7efd45ac6640 1 -- 10.20.193.176:0/3949989853 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c4f0322e-a862-4c5e-967e-4551087ede8c", "id": 12} v 0) -- 0x7efd401b8530 con 0x7efd401192f0 2026-02-17T21:23:43.451 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.447+0000 7efd1bfff640 1 -- 10.20.193.176:0/3949989853 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mgrmap(e 4) ==== 99956+0+0 (secure 0 0 0) 0x7efd300829d0 con 0x7efd401192f0 2026-02-17T21:23:43.531 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.528+0000 7efd1bfff640 1 -- 10.20.193.176:0/3949989853 <== mon.1 v2:10.20.193.119:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c4f0322e-a862-4c5e-967e-4551087ede8c", "id": 12}]=0 v16) ==== 113+0+3 (secure 0 0 0) 0x7efd3008be20 con 0x7efd401192f0 2026-02-17T21:23:43.532 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.528+0000 7efd1bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "c4f0322e-a862-4c5e-967e-4551087ede8c", "id": 12}] 2026-02-17T21:23:43.532 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.528+0000 7efd1bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:23:43.532 INFO:teuthology.orchestra.run.trial176.stdout:12 2026-02-17T21:23:43.534 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.528+0000 7efd45ac6640 10 librados: watch_flush enter 2026-02-17T21:23:43.534 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.528+0000 7efd45ac6640 10 librados: watch_flush exit 2026-02-17T21:23:43.534 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.528+0000 7efd45ac6640 20 client.4189.objecter shutdown clearing up homeless session... 2026-02-17T21:23:43.534 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.528+0000 7efd45ac6640 10 client.4189.objecter successfully canceled tick 2026-02-17T21:23:43.534 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.528+0000 7efd45ac6640 10 monclient: shutdown 2026-02-17T21:23:43.534 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.528+0000 7efd45ac6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:43.534 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.528+0000 7efd45ac6640 1 -- 10.20.193.176:0/3949989853 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efd401192f0 msgr2=0x7efd401abfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:43.535 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.528+0000 7efd45ac6640 1 --2- 10.20.193.176:0/3949989853 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efd401192f0 0x7efd401abfb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efd30009aa0 tx=0x7efd300047c0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.535 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.528+0000 7efd45ac6640 1 -- 10.20.193.176:0/3949989853 shutdown_connections 2026-02-17T21:23:43.535 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.528+0000 7efd45ac6640 1 --2- 10.20.193.176:0/3949989853 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7efd40119ca0 0x7efd401b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.535 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.528+0000 7efd45ac6640 1 --2- 10.20.193.176:0/3949989853 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efd401192f0 0x7efd401abfb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.535 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.528+0000 7efd45ac6640 1 --2- 10.20.193.176:0/3949989853 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7efd401149f0 0x7efd401ab940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.535 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.528+0000 7efd45ac6640 1 -- 10.20.193.176:0/3949989853 >> 10.20.193.176:0/3949989853 conn(0x7efd40073660 msgr2=0x7efd401181e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:43.535 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.528+0000 7efd45ac6640 1 -- 10.20.193.176:0/3949989853 shutdown_connections 2026-02-17T21:23:43.535 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.528+0000 7efd45ac6640 1 -- 10.20.193.176:0/3949989853 wait complete. 2026-02-17T21:23:43.535 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.528+0000 7efd45ac6640 1 librados: shutdown 2026-02-17T21:23:43.540 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph --cluster ceph osd new 0b5e9861-a194-4f11-a849-d8bb94ce95a5 13 2026-02-17T21:23:43.605 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.600+0000 7f04945fe640 10 monclient: get_monmap_and_config 2026-02-17T21:23:43.606 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.600+0000 7f04945fe640 10 monclient: build_initial_monmap 2026-02-17T21:23:43.606 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.600+0000 7f04945fe640 10 monclient: monmap: 2026-02-17T21:23:43.606 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:43.606 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:43.606 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:23:43.601666+0000 2026-02-17T21:23:43.606 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:23:43.601666+0000 2026-02-17T21:23:43.606 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:43.606 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:43.606 INFO:teuthology.orchestra.run.trial176.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:23:43.607 INFO:teuthology.orchestra.run.trial176.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:23:43.607 INFO:teuthology.orchestra.run.trial176.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:23:43.607 INFO:teuthology.orchestra.run.trial176.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:23:43.607 INFO:teuthology.orchestra.run.trial176.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:23:43.607 INFO:teuthology.orchestra.run.trial176.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:23:43.607 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:43.607 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.600+0000 7f04945fe640 1 Processor -- start 2026-02-17T21:23:43.607 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.600+0000 7f04945fe640 1 -- start start 2026-02-17T21:23:43.607 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.600+0000 7f04945fe640 10 monclient: init 2026-02-17T21:23:43.607 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.600+0000 7f04945fe640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:43.607 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.600+0000 7f04945fe640 10 monclient: _add_conns ranks=[0,3,2,1,5,4] 2026-02-17T21:23:43.608 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.600+0000 7f04945fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f048c073590 addr v1:10.20.193.5:6789/0 2026-02-17T21:23:43.608 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.600+0000 7f04945fe640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f048c074080 0x7f048c11f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:43.608 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.600+0000 7f04945fe640 10 monclient(hunting): picked mon.noname-a con 0x7f048c074080 addr v2:10.20.193.5:3300/0 2026-02-17T21:23:43.608 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.600+0000 7f04945fe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f048c11ffa0 addr v1:10.20.193.135:6789/0 2026-02-17T21:23:43.608 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.600+0000 7f04945fe640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f048c123d40 con 0x7f048c073590 2026-02-17T21:23:43.608 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.600+0000 7f04945fe640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f048c124f60 con 0x7f048c11ffa0 2026-02-17T21:23:43.608 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.600+0000 7f04945fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:43.608 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.600+0000 7f04945fe640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f048c126160 con 0x7f048c074080 2026-02-17T21:23:43.608 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.600+0000 7f04945fe640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:43.608 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.600+0000 7f04945fe640 10 monclient(hunting): authenticate will time out at 962.243619s 2026-02-17T21:23:43.609 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.601+0000 7f0491b72640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f048c074080 0x7f048c11f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:43.609 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.601+0000 7f0491b72640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f048c074080 0x7f048c11f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.176:47050/0 (socket says 10.20.193.176:47050) 2026-02-17T21:23:43.609 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.601+0000 7f0491b72640 1 -- 10.20.193.176:0/2327612938 learned_addr learned my addr 10.20.193.176:0/2327612938 (peer_addr_for_me v2:10.20.193.176:0/0) 2026-02-17T21:23:43.609 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.601+0000 7f0491b72640 10 monclient(hunting): get_auth_request con 0x7f048c074080 auth_method 0 2026-02-17T21:23:43.609 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.601+0000 7f0491b72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:43.609 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.601+0000 7f0491b72640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:43.609 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.601+0000 7f0491b72640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:43.610 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.602+0000 7f0491b72640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:43.610 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.602+0000 7f0491b72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:43.610 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.602+0000 7f0491b72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:43.619 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.614+0000 7f0491b72640 10 monclient(hunting): handle_auth_done global_id 4170 payload 274 2026-02-17T21:23:43.619 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.614+0000 7f0491b72640 1 -- 10.20.193.176:0/2327612938 >> v1:10.20.193.135:6789/0 conn(0x7f048c11ffa0 legacy=0x7f048c122440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:23:43.619 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.614+0000 7f0491b72640 1 -- 10.20.193.176:0/2327612938 >> v1:10.20.193.5:6789/0 conn(0x7f048c073590 legacy=0x7f048c073970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:43.619 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.614+0000 7f0491b72640 10 monclient: _finish_hunting 0 2026-02-17T21:23:43.619 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.614+0000 7f0491b72640 1 monclient: found mon.noname-a 2026-02-17T21:23:43.619 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.614+0000 7f0491b72640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:43.619 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.614+0000 7f0491b72640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:23:43.619 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.614+0000 7f0491b72640 1 -- 10.20.193.176:0/2327612938 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048c1262e0 con 0x7f048c074080 2026-02-17T21:23:43.623 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.619+0000 7f0491b72640 1 --2- 10.20.193.176:0/2327612938 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f048c074080 0x7f048c11f970 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0480009970 tx=0x7f048002ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7fd4a1c0c272e22 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:43.643 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f0491371640 1 -- 10.20.193.176:0/2327612938 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048003c070 con 0x7f048c074080 2026-02-17T21:23:43.643 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f0491371640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:43.643 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f0491371640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:23:43.643 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f0491371640 10 monclient: dump: 2026-02-17T21:23:43.643 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:43.643 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:43.644 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.644 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.644 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:43.644 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:43.644 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:43.644 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:43.644 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:43.644 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:43.644 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f0491371640 10 monclient: _finish_auth 0 2026-02-17T21:23:43.644 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f0491371640 10 monclient: _check_auth_tickets 2026-02-17T21:23:43.645 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f0491371640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:43.645 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f0491371640 1 -- 10.20.193.176:0/2327612938 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f048002fb10 con 0x7f048c074080 2026-02-17T21:23:43.645 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f04945fe640 5 monclient: authenticate success, global_id 4170 2026-02-17T21:23:43.645 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f04945fe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:23:43.645 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f0491371640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:43.645 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f0491371640 1 -- 10.20.193.176:0/2327612938 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0480037440 con 0x7f048c074080 2026-02-17T21:23:43.645 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f04945fe640 10 monclient: get_monmap_and_config success 2026-02-17T21:23:43.645 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f04945fe640 4 set_mon_vals no callback set 2026-02-17T21:23:43.645 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f0491371640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:43.645 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f0491371640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:23:43.645 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f0491371640 10 monclient: dump: 2026-02-17T21:23:43.646 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:43.646 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:43.646 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.646 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.646 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:43.646 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:43.646 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:43.646 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:43.646 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:43.646 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:43.646 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f04945fe640 10 monclient: shutdown 2026-02-17T21:23:43.647 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f04945fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:43.647 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f04945fe640 1 -- 10.20.193.176:0/2327612938 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f048c074080 msgr2=0x7f048c11f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:43.647 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f04945fe640 1 --2- 10.20.193.176:0/2327612938 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f048c074080 0x7f048c11f970 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0480009970 tx=0x7f048002ee90 comp rx=0 tx=0).stop 2026-02-17T21:23:43.647 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f04945fe640 1 -- 10.20.193.176:0/2327612938 shutdown_connections 2026-02-17T21:23:43.647 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f04945fe640 1 --2- 10.20.193.176:0/2327612938 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f048c074080 0x7f048c11f970 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.647 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f04945fe640 1 -- 10.20.193.176:0/2327612938 >> 10.20.193.176:0/2327612938 conn(0x7f048c06f660 msgr2=0x7f048c071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:43.647 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f04945fe640 1 -- 10.20.193.176:0/2327612938 shutdown_connections 2026-02-17T21:23:43.647 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.635+0000 7f04945fe640 1 -- 10.20.193.176:0/2327612938 wait complete. 2026-02-17T21:23:43.647 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.636+0000 7f04945fe640 10 monclient: build_initial_monmap 2026-02-17T21:23:43.647 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.636+0000 7f04945fe640 10 monclient: monmap: 2026-02-17T21:23:43.648 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:43.648 INFO:teuthology.orchestra.run.trial176.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:23:43.648 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 0.000000 2026-02-17T21:23:43.648 INFO:teuthology.orchestra.run.trial176.stderr:created 0.000000 2026-02-17T21:23:43.648 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:43.648 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:43.648 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:23:43.648 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:23:43.648 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:23:43.648 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:43.648 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.636+0000 7f04945fe640 1 librados: starting msgr at 2026-02-17T21:23:43.649 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.636+0000 7f04945fe640 1 librados: starting objecter 2026-02-17T21:23:43.649 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.636+0000 7f04945fe640 1 Processor -- start 2026-02-17T21:23:43.649 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.636+0000 7f04945fe640 1 -- start start 2026-02-17T21:23:43.649 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.636+0000 7f04945fe640 1 librados: setting wanted keys 2026-02-17T21:23:43.649 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.636+0000 7f04945fe640 1 librados: calling monclient init 2026-02-17T21:23:43.649 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.636+0000 7f04945fe640 10 monclient: init 2026-02-17T21:23:43.649 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.636+0000 7f04945fe640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:43.649 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.636+0000 7f04945fe640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:23:43.649 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.636+0000 7f04945fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f048c073590 0x7f048c1b1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:43.649 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.636+0000 7f04945fe640 10 monclient(hunting): picked mon.noname-b con 0x7f048c073590 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:23:43.649 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.636+0000 7f04945fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f048c074080 0x7f048c1b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:43.650 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.636+0000 7f04945fe640 10 monclient(hunting): picked mon.noname-c con 0x7f048c074080 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:23:43.650 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.636+0000 7f04945fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f048c11ffa0 0x7f048c11e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:43.650 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.636+0000 7f04945fe640 10 monclient(hunting): picked mon.noname-a con 0x7f048c11ffa0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:23:43.650 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.636+0000 7f04945fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:43.650 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.636+0000 7f04945fe640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f048c1255f0 con 0x7f048c11ffa0 2026-02-17T21:23:43.650 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.636+0000 7f04945fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:43.650 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.636+0000 7f04945fe640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f048c125470 con 0x7f048c073590 2026-02-17T21:23:43.650 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.636+0000 7f04945fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:43.650 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.636+0000 7f04945fe640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f048c125770 con 0x7f048c074080 2026-02-17T21:23:43.650 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.636+0000 7f04945fe640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:43.650 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.636+0000 7f04945fe640 10 monclient(hunting): authenticate will time out at 962.279635s 2026-02-17T21:23:43.651 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.637+0000 7f0492373640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f048c073590 0x7f048c1b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:43.651 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.638+0000 7f0492373640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f048c073590 0x7f048c1b1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.176:51382/0 (socket says 10.20.193.176:51382) 2026-02-17T21:23:43.651 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.638+0000 7f0492373640 1 -- 10.20.193.176:0/3642136430 learned_addr learned my addr 10.20.193.176:0/3642136430 (peer_addr_for_me v2:10.20.193.176:0/0) 2026-02-17T21:23:43.651 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.638+0000 7f0492373640 10 monclient(hunting): get_auth_request con 0x7f048c073590 auth_method 0 2026-02-17T21:23:43.651 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.638+0000 7f0492373640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:43.651 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.638+0000 7f0492373640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:43.651 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.638+0000 7f0492373640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:43.651 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.638+0000 7f0492373640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:43.651 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.638+0000 7f0492373640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:43.651 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.638+0000 7f0492373640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:43.653 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.639+0000 7f0492b74640 1 --2- 10.20.193.176:0/3642136430 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f048c11ffa0 0x7f048c11e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:43.653 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.639+0000 7f0492b74640 10 monclient(hunting): get_auth_request con 0x7f048c11ffa0 auth_method 0 2026-02-17T21:23:43.653 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.639+0000 7f0492b74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:43.653 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.639+0000 7f0492b74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:43.653 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.639+0000 7f0492b74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:43.654 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.640+0000 7f0492373640 10 monclient(hunting): handle_auth_done global_id 4204 payload 824 2026-02-17T21:23:43.654 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.640+0000 7f0492373640 1 -- 10.20.193.176:0/3642136430 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f048c074080 msgr2=0x7f048c1b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:43.654 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.640+0000 7f0492373640 1 --2- 10.20.193.176:0/3642136430 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f048c074080 0x7f048c1b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.654 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.640+0000 7f0492373640 1 -- 10.20.193.176:0/3642136430 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f048c11ffa0 msgr2=0x7f048c11e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:43.654 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.640+0000 7f0492373640 1 --2- 10.20.193.176:0/3642136430 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f048c11ffa0 0x7f048c11e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.654 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.640+0000 7f0492373640 10 monclient: _finish_hunting 0 2026-02-17T21:23:43.654 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.640+0000 7f0492373640 1 monclient: found mon.noname-b 2026-02-17T21:23:43.654 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.640+0000 7f0492373640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:43.654 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.640+0000 7f0492373640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:23:43.654 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.640+0000 7f0492373640 1 -- 10.20.193.176:0/3642136430 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048c11ec90 con 0x7f048c073590 2026-02-17T21:23:43.654 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.640+0000 7f0492b74640 1 --2- 10.20.193.176:0/3642136430 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f048c11ffa0 0x7f048c11e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T21:23:43.655 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.642+0000 7f0492373640 1 --2- 10.20.193.176:0/3642136430 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f048c073590 0x7f048c1b1680 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f047c00c700 tx=0x7f047c00cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:43.655 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.642+0000 7f0472ffd640 10 client.?.objecter ms_handle_connect 0x7f048c073590 2026-02-17T21:23:43.655 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.642+0000 7f0472ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:23:43.665 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f0472ffd640 1 -- 10.20.193.176:0/3642136430 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c0052d0 con 0x7f048c073590 2026-02-17T21:23:43.665 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f0472ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:43.665 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f0472ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:23:43.665 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f0472ffd640 10 monclient: dump: 2026-02-17T21:23:43.665 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:43.666 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:43.666 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.666 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.666 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:43.666 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:43.666 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:43.666 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:43.666 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:43.666 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:43.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f0472ffd640 10 monclient: _finish_auth 0 2026-02-17T21:23:43.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f0472ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:23:43.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f0472ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:43.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f0472ffd640 1 -- 10.20.193.176:0/3642136430 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f047c005470 con 0x7f048c073590 2026-02-17T21:23:43.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f0472ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:43.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f0472ffd640 1 -- 10.20.193.176:0/3642136430 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c0038d0 con 0x7f048c073590 2026-02-17T21:23:43.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f04945fe640 5 monclient: authenticate success, global_id 4204 2026-02-17T21:23:43.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f04945fe640 10 monclient: _renew_subs 2026-02-17T21:23:43.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f0490b70640 4 set_mon_vals no callback set 2026-02-17T21:23:43.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f04945fe640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:43.667 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f04945fe640 1 -- 10.20.193.176:0/3642136430 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f048c11ef80 con 0x7f048c073590 2026-02-17T21:23:43.668 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f0472ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:43.668 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f0472ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:23:43.668 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f0472ffd640 10 monclient: dump: 2026-02-17T21:23:43.668 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:43.668 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:43.668 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.668 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.668 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:43.668 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:43.668 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:43.668 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:43.669 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:43.669 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:43.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f04945fe640 10 client.4204.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:23:43.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f04945fe640 10 monclient: _renew_subs 2026-02-17T21:23:43.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f04945fe640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:43.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f04945fe640 1 -- 10.20.193.176:0/3642136430 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f048c1b8520 con 0x7f048c073590 2026-02-17T21:23:43.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f04945fe640 1 librados: init done 2026-02-17T21:23:43.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f04945fe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:43.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f04945fe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:43.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f04945fe640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:43.669 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.660+0000 7f04945fe640 1 -- 10.20.193.176:0/3642136430 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f048c125c50 con 0x7f048c073590 2026-02-17T21:23:43.711 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.707+0000 7f0472ffd640 1 -- 10.20.193.176:0/3642136430 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 4) ==== 99956+0+0 (secure 0 0 0) 0x7f047c003a70 con 0x7f048c073590 2026-02-17T21:23:43.715 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.711+0000 7f0472ffd640 1 -- 10.20.193.176:0/3642136430 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2220+0+0 (secure 0 0 0) 0x7f047c05daa0 con 0x7f048c073590 2026-02-17T21:23:43.715 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.711+0000 7f0472ffd640 10 client.4204.objecter ms_dispatch2 0x7f048c000b90 osd_map(16..16 src has 1..16) 2026-02-17T21:23:43.716 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.711+0000 7f0472ffd640 3 client.4204.objecter handle_osd_map got epochs [16,16] > 0 2026-02-17T21:23:43.716 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.711+0000 7f0472ffd640 3 client.4204.objecter handle_osd_map decoding full epoch 16 2026-02-17T21:23:43.716 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.711+0000 7f0472ffd640 20 client.4204.objecter dump_active .. 0 homeless 2026-02-17T21:23:43.716 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.711+0000 7f0472ffd640 1 -- 10.20.193.176:0/3642136430 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f047c062a80 con 0x7f048c073590 2026-02-17T21:23:43.716 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.711+0000 7f0472ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:43.716 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.711+0000 7f0472ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:23:43.747 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.743+0000 7f04945fe640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "0b5e9861-a194-4f11-a849-d8bb94ce95a5", "id": 13}] 2026-02-17T21:23:43.747 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.743+0000 7f04945fe640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "0b5e9861-a194-4f11-a849-d8bb94ce95a5", "id": 13}] 2026-02-17T21:23:43.747 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.743+0000 7f04945fe640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:23:43.747 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.743+0000 7f04945fe640 1 -- 10.20.193.176:0/3642136430 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0b5e9861-a194-4f11-a849-d8bb94ce95a5", "id": 13} v 0) -- 0x7f048c0722e0 con 0x7f048c073590 2026-02-17T21:23:43.832 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.828+0000 7f0472ffd640 1 -- 10.20.193.176:0/3642136430 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0b5e9861-a194-4f11-a849-d8bb94ce95a5", "id": 13}]=0 v17) ==== 113+0+3 (secure 0 0 0) 0x7f048c0722e0 con 0x7f048c073590 2026-02-17T21:23:43.832 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.828+0000 7f0472ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "0b5e9861-a194-4f11-a849-d8bb94ce95a5", "id": 13}] 2026-02-17T21:23:43.832 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.828+0000 7f0472ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:23:43.833 INFO:teuthology.orchestra.run.trial176.stdout:13 2026-02-17T21:23:43.834 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.828+0000 7f04945fe640 10 librados: watch_flush enter 2026-02-17T21:23:43.834 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.828+0000 7f04945fe640 10 librados: watch_flush exit 2026-02-17T21:23:43.834 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.828+0000 7f04945fe640 20 client.4204.objecter shutdown clearing up homeless session... 2026-02-17T21:23:43.835 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.828+0000 7f04945fe640 10 client.4204.objecter successfully canceled tick 2026-02-17T21:23:43.835 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.828+0000 7f04945fe640 10 monclient: shutdown 2026-02-17T21:23:43.835 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.828+0000 7f04945fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:43.835 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.828+0000 7f04945fe640 1 -- 10.20.193.176:0/3642136430 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f048c073590 msgr2=0x7f048c1b1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:43.835 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.828+0000 7f04945fe640 1 --2- 10.20.193.176:0/3642136430 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f048c073590 0x7f048c1b1680 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f047c00c700 tx=0x7f047c00cbd0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.835 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.828+0000 7f04945fe640 1 -- 10.20.193.176:0/3642136430 shutdown_connections 2026-02-17T21:23:43.835 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.828+0000 7f04945fe640 1 --2- 10.20.193.176:0/3642136430 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f048c11ffa0 0x7f048c11e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.835 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.828+0000 7f04945fe640 1 --2- 10.20.193.176:0/3642136430 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f048c074080 0x7f048c1b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.835 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.828+0000 7f04945fe640 1 --2- 10.20.193.176:0/3642136430 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f048c073590 0x7f048c1b1680 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.835 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.828+0000 7f04945fe640 1 -- 10.20.193.176:0/3642136430 >> 10.20.193.176:0/3642136430 conn(0x7f048c06f660 msgr2=0x7f048c06fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:43.835 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.828+0000 7f04945fe640 1 -- 10.20.193.176:0/3642136430 shutdown_connections 2026-02-17T21:23:43.836 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.828+0000 7f04945fe640 1 -- 10.20.193.176:0/3642136430 wait complete. 2026-02-17T21:23:43.836 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.828+0000 7f04945fe640 1 librados: shutdown 2026-02-17T21:23:43.842 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph --cluster ceph osd new 6f182077-0c0d-481c-97b4-43ef48aa5aea 14 2026-02-17T21:23:43.906 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.902+0000 7f946dbe7640 10 monclient: get_monmap_and_config 2026-02-17T21:23:43.906 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.902+0000 7f946dbe7640 10 monclient: build_initial_monmap 2026-02-17T21:23:43.906 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.902+0000 7f946dbe7640 10 monclient: monmap: 2026-02-17T21:23:43.906 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:43.906 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:43.906 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:23:43.903846+0000 2026-02-17T21:23:43.906 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:23:43.903846+0000 2026-02-17T21:23:43.907 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:43.907 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:43.907 INFO:teuthology.orchestra.run.trial176.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:23:43.907 INFO:teuthology.orchestra.run.trial176.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:23:43.907 INFO:teuthology.orchestra.run.trial176.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:23:43.907 INFO:teuthology.orchestra.run.trial176.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:23:43.907 INFO:teuthology.orchestra.run.trial176.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:23:43.907 INFO:teuthology.orchestra.run.trial176.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:23:43.907 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:43.910 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.902+0000 7f946dbe7640 1 Processor -- start 2026-02-17T21:23:43.910 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.902+0000 7f946dbe7640 1 -- start start 2026-02-17T21:23:43.910 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.902+0000 7f946dbe7640 10 monclient: init 2026-02-17T21:23:43.910 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.902+0000 7f946dbe7640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:43.910 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.902+0000 7f946dbe7640 10 monclient: _add_conns ranks=[5,2,1,3,0,4] 2026-02-17T21:23:43.910 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.902+0000 7f946dbe7640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f94681149f0 0x7f9468114dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:43.910 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.902+0000 7f946dbe7640 10 monclient(hunting): picked mon.noname-c con 0x7f94681149f0 addr v2:10.20.193.135:3300/0 2026-02-17T21:23:43.910 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.902+0000 7f946dbe7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f94681192f0 addr v1:10.20.193.135:6789/0 2026-02-17T21:23:43.910 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.902+0000 7f946dbe7640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f9468119e70 addr v1:10.20.193.119:6789/0 2026-02-17T21:23:43.910 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.902+0000 7f946dbe7640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9468123da0 con 0x7f9468119e70 2026-02-17T21:23:43.911 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.902+0000 7f946dbe7640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9468124f80 con 0x7f94681192f0 2026-02-17T21:23:43.911 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.902+0000 7f946dbe7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:43.911 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.902+0000 7f946dbe7640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f9468126160 con 0x7f94681149f0 2026-02-17T21:23:43.911 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.902+0000 7f946dbe7640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:43.911 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.902+0000 7f946dbe7640 10 monclient(hunting): authenticate will time out at 962.545867s 2026-02-17T21:23:43.911 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.903+0000 7f9467fff640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f9468119e70 0x7f94681225f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.176:41264/0 (socket says 10.20.193.176:41264) 2026-02-17T21:23:43.911 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.903+0000 7f9467fff640 1 -- 10.20.193.176:0/1340399943 learned_addr learned my addr 10.20.193.176:0/1340399943 (peer_addr_for_me v1:10.20.193.176:0/0) 2026-02-17T21:23:43.911 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.903+0000 7f94677fe640 1 --2- 10.20.193.176:0/1340399943 >> v2:10.20.193.135:3300/0 conn(0x7f94681149f0 0x7f9468114dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:43.911 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.903+0000 7f94677fe640 10 monclient(hunting): get_auth_request con 0x7f94681149f0 auth_method 0 2026-02-17T21:23:43.911 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.903+0000 7f94677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:43.911 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.903+0000 7f94677fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:43.911 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.903+0000 7f94677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:43.912 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.904+0000 7f94677fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:43.912 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.904+0000 7f94677fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:43.912 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.904+0000 7f94677fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:43.912 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.905+0000 7f94677fe640 10 monclient(hunting): handle_auth_done global_id 4187 payload 274 2026-02-17T21:23:43.912 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.905+0000 7f94677fe640 1 -- 10.20.193.176:0/1340399943 >> v1:10.20.193.135:6789/0 conn(0x7f94681192f0 legacy=0x7f9468119760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:43.912 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.905+0000 7f94677fe640 1 -- 10.20.193.176:0/1340399943 >> v1:10.20.193.119:6789/0 conn(0x7f9468119e70 legacy=0x7f94681225f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:43.912 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.905+0000 7f94677fe640 10 monclient: _finish_hunting 0 2026-02-17T21:23:43.912 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.905+0000 7f94677fe640 1 monclient: found mon.noname-c 2026-02-17T21:23:43.912 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.905+0000 7f94677fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:43.912 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.905+0000 7f94677fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:23:43.912 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.905+0000 7f94677fe640 1 -- 10.20.193.176:0/1340399943 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94681262e0 con 0x7f94681149f0 2026-02-17T21:23:43.916 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.907+0000 7f94677fe640 1 --2- 10.20.193.176:0/1340399943 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f94681149f0 0x7f9468114dd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f94540098a0 tx=0x7f945402edd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e07c98d9a63f33c6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:43.917 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.908+0000 7f94667fc640 1 -- 10.20.193.176:0/1340399943 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945403c070 con 0x7f94681149f0 2026-02-17T21:23:43.917 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.908+0000 7f94667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:43.917 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f94667fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:23:43.917 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f94667fc640 10 monclient: dump: 2026-02-17T21:23:43.917 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:43.917 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:43.917 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.917 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.917 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:43.917 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:43.918 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:43.918 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:43.918 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:43.918 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:43.918 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f94667fc640 10 monclient: _finish_auth 0 2026-02-17T21:23:43.918 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f94667fc640 10 monclient: _check_auth_tickets 2026-02-17T21:23:43.918 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f94667fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:43.918 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f946dbe7640 5 monclient: authenticate success, global_id 4187 2026-02-17T21:23:43.918 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f946dbe7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:23:43.918 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f94667fc640 1 -- 10.20.193.176:0/1340399943 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f945402fae0 con 0x7f94681149f0 2026-02-17T21:23:43.918 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f94667fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:43.918 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f94667fc640 1 -- 10.20.193.176:0/1340399943 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9454037440 con 0x7f94681149f0 2026-02-17T21:23:43.919 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f94667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:43.919 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f94667fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:23:43.919 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f94667fc640 10 monclient: dump: 2026-02-17T21:23:43.919 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:43.919 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:43.919 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.919 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.919 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:43.919 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:43.919 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:43.919 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:43.919 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:43.920 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:43.920 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f946dbe7640 10 monclient: get_monmap_and_config success 2026-02-17T21:23:43.920 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f946dbe7640 4 set_mon_vals no callback set 2026-02-17T21:23:43.920 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f946dbe7640 10 monclient: shutdown 2026-02-17T21:23:43.920 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f946dbe7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:43.920 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f946dbe7640 1 -- 10.20.193.176:0/1340399943 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f94681149f0 msgr2=0x7f9468114dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:43.920 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f946dbe7640 1 --2- 10.20.193.176:0/1340399943 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f94681149f0 0x7f9468114dd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f94540098a0 tx=0x7f945402edd0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.920 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f946dbe7640 1 -- 10.20.193.176:0/1340399943 shutdown_connections 2026-02-17T21:23:43.920 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f946dbe7640 1 --2- 10.20.193.176:0/1340399943 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f94681149f0 0x7f9468114dd0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.920 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f946dbe7640 1 -- 10.20.193.176:0/1340399943 >> 10.20.193.176:0/1340399943 conn(0x7f9468073660 msgr2=0x7f9468073a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:43.920 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f946dbe7640 1 -- 10.20.193.176:0/1340399943 shutdown_connections 2026-02-17T21:23:43.920 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f946dbe7640 1 -- 10.20.193.176:0/1340399943 wait complete. 2026-02-17T21:23:43.921 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f946dbe7640 10 monclient: build_initial_monmap 2026-02-17T21:23:43.921 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f946dbe7640 10 monclient: monmap: 2026-02-17T21:23:43.921 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:43.921 INFO:teuthology.orchestra.run.trial176.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:23:43.921 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 0.000000 2026-02-17T21:23:43.921 INFO:teuthology.orchestra.run.trial176.stderr:created 0.000000 2026-02-17T21:23:43.921 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:43.921 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:43.921 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:23:43.921 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:23:43.921 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:23:43.921 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:43.921 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f946dbe7640 1 librados: starting msgr at 2026-02-17T21:23:43.922 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f946dbe7640 1 librados: starting objecter 2026-02-17T21:23:43.922 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f946dbe7640 1 Processor -- start 2026-02-17T21:23:43.922 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f946dbe7640 1 -- start start 2026-02-17T21:23:43.922 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f946dbe7640 1 librados: setting wanted keys 2026-02-17T21:23:43.922 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f946dbe7640 1 librados: calling monclient init 2026-02-17T21:23:43.922 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.909+0000 7f946dbe7640 10 monclient: init 2026-02-17T21:23:43.922 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f946dbe7640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:43.922 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f946dbe7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:23:43.922 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f946dbe7640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f94681149f0 0x7f9468122410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:43.922 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f946dbe7640 10 monclient(hunting): picked mon.noname-b con 0x7f94681149f0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:23:43.922 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f946dbe7640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f94681192f0 0x7f9468122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:43.922 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f946dbe7640 10 monclient(hunting): picked mon.noname-c con 0x7f94681192f0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:23:43.923 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f946dbe7640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9468119e70 0x7f94681b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:43.923 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f946dbe7640 10 monclient(hunting): picked mon.noname-a con 0x7f9468119e70 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:23:43.923 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f946dbe7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:43.923 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f946dbe7640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f94681255d0 con 0x7f9468119e70 2026-02-17T21:23:43.923 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f946dbe7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:43.923 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f946dbe7640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9468125450 con 0x7f94681149f0 2026-02-17T21:23:43.923 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f946dbe7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:43.923 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f946dbe7640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9468125750 con 0x7f94681192f0 2026-02-17T21:23:43.923 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f946dbe7640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:43.923 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f946dbe7640 10 monclient(hunting): authenticate will time out at 962.553116s 2026-02-17T21:23:43.923 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f94677fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f94681149f0 0x7f9468122410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:43.923 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f9466ffd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f94681192f0 0x7f9468122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:43.924 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f94677fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f94681149f0 0x7f9468122410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.176:51404/0 (socket says 10.20.193.176:51404) 2026-02-17T21:23:43.924 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f94677fe640 1 -- 10.20.193.176:0/2672899781 learned_addr learned my addr 10.20.193.176:0/2672899781 (peer_addr_for_me v2:10.20.193.176:0/0) 2026-02-17T21:23:43.924 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f94677fe640 10 monclient(hunting): get_auth_request con 0x7f94681149f0 auth_method 0 2026-02-17T21:23:43.924 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f94677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:43.924 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f94677fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:43.924 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f94677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:43.924 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f9466ffd640 10 monclient(hunting): get_auth_request con 0x7f94681192f0 auth_method 0 2026-02-17T21:23:43.924 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f9466ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:43.924 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f9466ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:43.924 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f9466ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:43.924 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f9466ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:43.924 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f9466ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:43.924 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f9466ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:43.925 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f94677fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:43.925 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f94677fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:43.925 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.910+0000 7f94677fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:43.925 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.912+0000 7f9466ffd640 10 monclient(hunting): handle_auth_done global_id 4190 payload 824 2026-02-17T21:23:43.925 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.912+0000 7f9466ffd640 1 -- 10.20.193.176:0/2672899781 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f94681149f0 msgr2=0x7f9468122410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:43.925 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.912+0000 7f9466ffd640 1 --2- 10.20.193.176:0/2672899781 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f94681149f0 0x7f9468122410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.925 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.912+0000 7f9466ffd640 1 -- 10.20.193.176:0/2672899781 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9468119e70 msgr2=0x7f94681b12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:43.925 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.912+0000 7f9466ffd640 1 --2- 10.20.193.176:0/2672899781 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9468119e70 0x7f94681b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:43.925 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.912+0000 7f9466ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:23:43.925 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.912+0000 7f9466ffd640 1 monclient: found mon.noname-c 2026-02-17T21:23:43.925 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.912+0000 7f9466ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:43.925 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.912+0000 7f9466ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:23:43.925 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.912+0000 7f9466ffd640 1 -- 10.20.193.176:0/2672899781 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94681b1b70 con 0x7f94681192f0 2026-02-17T21:23:43.926 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.913+0000 7f9466ffd640 1 --2- 10.20.193.176:0/2672899781 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f94681192f0 0x7f9468122a80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f945800c480 tx=0x7f945800c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:43.926 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.913+0000 7f9443fff640 10 client.?.objecter ms_handle_connect 0x7f94681192f0 2026-02-17T21:23:43.926 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.913+0000 7f9443fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:23:43.928 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.914+0000 7f9443fff640 1 -- 10.20.193.176:0/2672899781 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9458017070 con 0x7f94681192f0 2026-02-17T21:23:43.928 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.914+0000 7f9443fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:43.928 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.914+0000 7f9443fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:23:43.928 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.914+0000 7f9443fff640 10 monclient: dump: 2026-02-17T21:23:43.928 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:43.928 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:43.928 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.928 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.928 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:43.929 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:43.929 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:43.929 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:43.929 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:43.929 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:43.929 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.914+0000 7f9443fff640 10 monclient: _finish_auth 0 2026-02-17T21:23:43.929 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.914+0000 7f9443fff640 10 monclient: _check_auth_tickets 2026-02-17T21:23:43.929 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.914+0000 7f9443fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:43.929 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.914+0000 7f9443fff640 1 -- 10.20.193.176:0/2672899781 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94580052d0 con 0x7f94681192f0 2026-02-17T21:23:43.929 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.914+0000 7f946dbe7640 5 monclient: authenticate success, global_id 4190 2026-02-17T21:23:43.929 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.914+0000 7f9443fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:43.929 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.914+0000 7f9443fff640 1 -- 10.20.193.176:0/2672899781 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94580036f0 con 0x7f94681192f0 2026-02-17T21:23:43.930 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.914+0000 7f9443fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:43.930 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.914+0000 7f9443fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:23:43.930 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.914+0000 7f9465ffb640 4 set_mon_vals no callback set 2026-02-17T21:23:43.930 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.914+0000 7f9443fff640 10 monclient: dump: 2026-02-17T21:23:43.930 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:43.930 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:43.930 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.930 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:43.930 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:43.930 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:43.930 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:43.930 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:43.931 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:43.931 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:43.931 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.914+0000 7f946dbe7640 10 monclient: _renew_subs 2026-02-17T21:23:43.931 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.914+0000 7f946dbe7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:43.931 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.914+0000 7f946dbe7640 1 -- 10.20.193.176:0/2672899781 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94681b1e00 con 0x7f94681192f0 2026-02-17T21:23:43.931 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.914+0000 7f946dbe7640 10 client.4190.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:23:43.931 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.914+0000 7f946dbe7640 10 monclient: _renew_subs 2026-02-17T21:23:43.931 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.914+0000 7f946dbe7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:43.931 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.914+0000 7f946dbe7640 1 -- 10.20.193.176:0/2672899781 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94681b85a0 con 0x7f94681192f0 2026-02-17T21:23:43.931 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.914+0000 7f946dbe7640 1 librados: init done 2026-02-17T21:23:43.931 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.915+0000 7f946dbe7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:43.931 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.915+0000 7f946dbe7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:43.931 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.915+0000 7f946dbe7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:43.932 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.915+0000 7f946dbe7640 1 -- 10.20.193.176:0/2672899781 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9468114e50 con 0x7f94681192f0 2026-02-17T21:23:43.934 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.930+0000 7f9443fff640 1 -- 10.20.193.176:0/2672899781 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 4) ==== 99956+0+0 (secure 0 0 0) 0x7f9458003890 con 0x7f94681192f0 2026-02-17T21:23:44.000 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.995+0000 7f9443fff640 1 -- 10.20.193.176:0/2672899781 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2335+0+0 (secure 0 0 0) 0x7f945805cab0 con 0x7f94681192f0 2026-02-17T21:23:44.000 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.995+0000 7f9443fff640 10 client.4190.objecter ms_dispatch2 0x7f9468000b90 osd_map(17..17 src has 1..17) 2026-02-17T21:23:44.000 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.995+0000 7f9443fff640 3 client.4190.objecter handle_osd_map got epochs [17,17] > 0 2026-02-17T21:23:44.000 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.995+0000 7f9443fff640 3 client.4190.objecter handle_osd_map decoding full epoch 17 2026-02-17T21:23:44.000 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.996+0000 7f9443fff640 20 client.4190.objecter dump_active .. 0 homeless 2026-02-17T21:23:44.000 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.996+0000 7f9443fff640 1 -- 10.20.193.176:0/2672899781 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f9458021080 con 0x7f94681192f0 2026-02-17T21:23:44.000 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.996+0000 7f9443fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:44.000 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:43.996+0000 7f9443fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:23:44.034 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.030+0000 7f946dbe7640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "6f182077-0c0d-481c-97b4-43ef48aa5aea", "id": 14}] 2026-02-17T21:23:44.034 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.030+0000 7f946dbe7640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "6f182077-0c0d-481c-97b4-43ef48aa5aea", "id": 14}] 2026-02-17T21:23:44.035 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.030+0000 7f946dbe7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:44.035 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.030+0000 7f946dbe7640 1 -- 10.20.193.176:0/2672899781 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6f182077-0c0d-481c-97b4-43ef48aa5aea", "id": 14} v 0) -- 0x7f94681b8770 con 0x7f94681192f0 2026-02-17T21:23:44.188 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.185+0000 7f9443fff640 1 -- 10.20.193.176:0/2672899781 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6f182077-0c0d-481c-97b4-43ef48aa5aea", "id": 14}]=0 v18) ==== 113+0+3 (secure 0 0 0) 0x7f9458061390 con 0x7f94681192f0 2026-02-17T21:23:44.189 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.185+0000 7f9443fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "6f182077-0c0d-481c-97b4-43ef48aa5aea", "id": 14}] 2026-02-17T21:23:44.189 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.185+0000 7f9443fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:23:44.189 INFO:teuthology.orchestra.run.trial176.stdout:14 2026-02-17T21:23:44.190 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.185+0000 7f946dbe7640 10 librados: watch_flush enter 2026-02-17T21:23:44.191 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.185+0000 7f946dbe7640 10 librados: watch_flush exit 2026-02-17T21:23:44.191 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.185+0000 7f946dbe7640 20 client.4190.objecter shutdown clearing up homeless session... 2026-02-17T21:23:44.191 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.185+0000 7f946dbe7640 10 client.4190.objecter successfully canceled tick 2026-02-17T21:23:44.191 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.185+0000 7f946dbe7640 10 monclient: shutdown 2026-02-17T21:23:44.191 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.185+0000 7f946dbe7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:44.191 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.185+0000 7f946dbe7640 1 -- 10.20.193.176:0/2672899781 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f94681192f0 msgr2=0x7f9468122a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:44.191 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.185+0000 7f946dbe7640 1 --2- 10.20.193.176:0/2672899781 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f94681192f0 0x7f9468122a80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f945800c480 tx=0x7f945800c950 comp rx=0 tx=0).stop 2026-02-17T21:23:44.191 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.185+0000 7f946dbe7640 1 -- 10.20.193.176:0/2672899781 shutdown_connections 2026-02-17T21:23:44.191 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.185+0000 7f946dbe7640 1 --2- 10.20.193.176:0/2672899781 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9468119e70 0x7f94681b12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:44.191 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.185+0000 7f946dbe7640 1 --2- 10.20.193.176:0/2672899781 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f94681192f0 0x7f9468122a80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:44.191 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.185+0000 7f946dbe7640 1 --2- 10.20.193.176:0/2672899781 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f94681149f0 0x7f9468122410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:44.192 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.185+0000 7f946dbe7640 1 -- 10.20.193.176:0/2672899781 >> 10.20.193.176:0/2672899781 conn(0x7f9468073660 msgr2=0x7f9468112570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:44.192 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.185+0000 7f946dbe7640 1 -- 10.20.193.176:0/2672899781 shutdown_connections 2026-02-17T21:23:44.192 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.185+0000 7f946dbe7640 1 -- 10.20.193.176:0/2672899781 wait complete. 2026-02-17T21:23:44.192 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.186+0000 7f946dbe7640 1 librados: shutdown 2026-02-17T21:23:44.198 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph --cluster ceph osd new 537605ff-bedd-4f2b-922f-e2eaa8c17f48 15 2026-02-17T21:23:44.261 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.257+0000 7fce36361640 10 monclient: get_monmap_and_config 2026-02-17T21:23:44.261 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.257+0000 7fce36361640 10 monclient: build_initial_monmap 2026-02-17T21:23:44.262 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.257+0000 7fce36361640 10 monclient: monmap: 2026-02-17T21:23:44.262 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:44.262 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:44.262 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:23:44.259314+0000 2026-02-17T21:23:44.262 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:23:44.259314+0000 2026-02-17T21:23:44.262 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:44.262 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:44.262 INFO:teuthology.orchestra.run.trial176.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:23:44.262 INFO:teuthology.orchestra.run.trial176.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:23:44.262 INFO:teuthology.orchestra.run.trial176.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:23:44.262 INFO:teuthology.orchestra.run.trial176.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:23:44.262 INFO:teuthology.orchestra.run.trial176.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:23:44.263 INFO:teuthology.orchestra.run.trial176.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:23:44.263 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:44.266 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.258+0000 7fce36361640 1 Processor -- start 2026-02-17T21:23:44.266 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.258+0000 7fce36361640 1 -- start start 2026-02-17T21:23:44.266 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.258+0000 7fce36361640 10 monclient: init 2026-02-17T21:23:44.266 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.258+0000 7fce36361640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:44.266 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.258+0000 7fce36361640 10 monclient: _add_conns ranks=[5,2,1,4,3,0] 2026-02-17T21:23:44.266 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.258+0000 7fce36361640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fce30117560 0x7fce30117940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:44.266 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.258+0000 7fce36361640 10 monclient(hunting): picked mon.noname-c con 0x7fce30117560 addr v2:10.20.193.135:3300/0 2026-02-17T21:23:44.266 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.258+0000 7fce36361640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fce30116090 addr v1:10.20.193.135:6789/0 2026-02-17T21:23:44.266 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.258+0000 7fce36361640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fce30116c00 addr v1:10.20.193.119:6789/0 2026-02-17T21:23:44.266 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.258+0000 7fce36361640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce30121ac0 con 0x7fce30116c00 2026-02-17T21:23:44.266 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.258+0000 7fce36361640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce30122ca0 con 0x7fce30116090 2026-02-17T21:23:44.267 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.258+0000 7fce36361640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:44.267 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.258+0000 7fce36361640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fce30123e80 con 0x7fce30117560 2026-02-17T21:23:44.267 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.258+0000 7fce36361640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:44.267 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.258+0000 7fce36361640 10 monclient(hunting): authenticate will time out at 962.901360s 2026-02-17T21:23:44.267 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.258+0000 7fce2ffff640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fce30117560 0x7fce30117940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:44.267 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.258+0000 7fce348d7640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7fce30116c00 0x7fce30120310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.176:56970/0 (socket says 10.20.193.176:56970) 2026-02-17T21:23:44.267 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.258+0000 7fce348d7640 1 -- 10.20.193.176:0/580276212 learned_addr learned my addr 10.20.193.176:0/580276212 (peer_addr_for_me v1:10.20.193.176:0/0) 2026-02-17T21:23:44.267 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.259+0000 7fce2ffff640 10 monclient(hunting): get_auth_request con 0x7fce30117560 auth_method 0 2026-02-17T21:23:44.267 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.259+0000 7fce2ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:44.267 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.259+0000 7fce2ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:44.267 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.259+0000 7fce2ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:44.268 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.259+0000 7fce2ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:44.268 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.259+0000 7fce2ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:44.268 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.259+0000 7fce2ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:44.268 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.260+0000 7fce2effd640 1 -- 10.20.193.176:0/580276212 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4113171297 0 0) 0x7fce30121ac0 con 0x7fce30116c00 2026-02-17T21:23:44.268 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.260+0000 7fce2effd640 10 monclient(hunting): _negotiate 2026-02-17T21:23:44.268 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.260+0000 7fce2effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:44.268 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.260+0000 7fce2effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:44.268 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.260+0000 7fce2effd640 10 monclient(hunting): my global_id is 4210 2026-02-17T21:23:44.268 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.260+0000 7fce2effd640 1 -- 10.20.193.176:0/580276212 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce14003620 con 0x7fce30116c00 2026-02-17T21:23:44.268 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.260+0000 7fce2ffff640 10 monclient(hunting): handle_auth_done global_id 4193 payload 274 2026-02-17T21:23:44.268 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.260+0000 7fce2ffff640 1 -- 10.20.193.176:0/580276212 >> v1:10.20.193.135:6789/0 conn(0x7fce30116090 legacy=0x7fce301164f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:44.268 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.260+0000 7fce2ffff640 1 -- 10.20.193.176:0/580276212 >> v1:10.20.193.119:6789/0 conn(0x7fce30116c00 legacy=0x7fce30120310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:44.269 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.260+0000 7fce2ffff640 10 monclient: _finish_hunting 0 2026-02-17T21:23:44.269 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.260+0000 7fce2ffff640 1 monclient: found mon.noname-c 2026-02-17T21:23:44.269 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.260+0000 7fce2ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:44.269 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.260+0000 7fce2ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:23:44.269 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.260+0000 7fce2ffff640 1 -- 10.20.193.176:0/580276212 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce30124000 con 0x7fce30117560 2026-02-17T21:23:44.276 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.262+0000 7fce2ffff640 1 --2- 10.20.193.176:0/580276212 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fce30117560 0x7fce30117940 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fce1c0098a0 tx=0x7fce1c02edd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7b2c613d50ceb86 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:44.276 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce2effd640 1 -- 10.20.193.176:0/580276212 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c03c070 con 0x7fce30117560 2026-02-17T21:23:44.276 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce2effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:44.276 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce2effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:23:44.276 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce2effd640 10 monclient: dump: 2026-02-17T21:23:44.276 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:44.276 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:44.276 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:44.276 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:44.276 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:44.277 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:44.277 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:44.277 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:44.277 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:44.277 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:44.277 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce2effd640 10 monclient: _finish_auth 0 2026-02-17T21:23:44.277 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce2effd640 10 monclient: _check_auth_tickets 2026-02-17T21:23:44.277 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce2effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:44.277 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce2effd640 1 -- 10.20.193.176:0/580276212 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce1c02fae0 con 0x7fce30117560 2026-02-17T21:23:44.277 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce36361640 5 monclient: authenticate success, global_id 4193 2026-02-17T21:23:44.277 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce36361640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:23:44.277 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce2effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:44.278 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce2effd640 1 -- 10.20.193.176:0/580276212 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c037440 con 0x7fce30117560 2026-02-17T21:23:44.278 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce36361640 10 monclient: get_monmap_and_config success 2026-02-17T21:23:44.278 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce36361640 4 set_mon_vals no callback set 2026-02-17T21:23:44.278 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce2effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:44.278 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce2effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:23:44.278 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce2effd640 10 monclient: dump: 2026-02-17T21:23:44.278 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:44.278 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:44.278 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:44.278 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:44.278 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:44.278 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:44.279 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:44.279 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:44.279 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:44.279 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:44.279 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce36361640 10 monclient: shutdown 2026-02-17T21:23:44.279 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce36361640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:44.279 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce36361640 1 -- 10.20.193.176:0/580276212 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fce30117560 msgr2=0x7fce30117940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:44.279 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce36361640 1 --2- 10.20.193.176:0/580276212 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fce30117560 0x7fce30117940 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fce1c0098a0 tx=0x7fce1c02edd0 comp rx=0 tx=0).stop 2026-02-17T21:23:44.279 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce36361640 1 -- 10.20.193.176:0/580276212 shutdown_connections 2026-02-17T21:23:44.279 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce36361640 1 --2- 10.20.193.176:0/580276212 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fce30117560 0x7fce30117940 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:44.279 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce36361640 1 -- 10.20.193.176:0/580276212 >> 10.20.193.176:0/580276212 conn(0x7fce30071500 msgr2=0x7fce30073920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:44.279 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce36361640 1 -- 10.20.193.176:0/580276212 shutdown_connections 2026-02-17T21:23:44.280 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.264+0000 7fce36361640 1 -- 10.20.193.176:0/580276212 wait complete. 2026-02-17T21:23:44.280 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce36361640 10 monclient: build_initial_monmap 2026-02-17T21:23:44.280 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce36361640 10 monclient: monmap: 2026-02-17T21:23:44.280 INFO:teuthology.orchestra.run.trial176.stderr:epoch 0 2026-02-17T21:23:44.280 INFO:teuthology.orchestra.run.trial176.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:23:44.280 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 0.000000 2026-02-17T21:23:44.280 INFO:teuthology.orchestra.run.trial176.stderr:created 0.000000 2026-02-17T21:23:44.280 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:44.280 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:44.280 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:23:44.280 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:23:44.280 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:23:44.280 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:44.281 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce36361640 1 librados: starting msgr at 2026-02-17T21:23:44.281 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce36361640 1 librados: starting objecter 2026-02-17T21:23:44.281 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce36361640 1 Processor -- start 2026-02-17T21:23:44.281 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce36361640 1 -- start start 2026-02-17T21:23:44.281 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce36361640 1 librados: setting wanted keys 2026-02-17T21:23:44.281 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce36361640 1 librados: calling monclient init 2026-02-17T21:23:44.281 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce36361640 10 monclient: init 2026-02-17T21:23:44.281 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce36361640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:44.281 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce36361640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:23:44.281 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce36361640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fce30116090 0x7fce301b1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:44.281 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce36361640 10 monclient(hunting): picked mon.noname-b con 0x7fce30116090 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:23:44.281 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce36361640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fce30116c00 0x7fce301b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:44.282 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce36361640 10 monclient(hunting): picked mon.noname-a con 0x7fce30116c00 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:23:44.282 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce36361640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fce30117560 0x7fce301ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:44.282 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce36361640 10 monclient(hunting): picked mon.noname-c con 0x7fce30117560 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:23:44.282 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce36361640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:44.282 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce36361640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fce30123330 con 0x7fce30116c00 2026-02-17T21:23:44.282 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce36361640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:44.282 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce36361640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fce301231b0 con 0x7fce30116090 2026-02-17T21:23:44.282 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce36361640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:44.282 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce36361640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fce301234b0 con 0x7fce30117560 2026-02-17T21:23:44.282 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce36361640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:44.282 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce36361640 10 monclient(hunting): authenticate will time out at 962.908544s 2026-02-17T21:23:44.282 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce348d7640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fce30117560 0x7fce301ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:44.282 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.265+0000 7fce2f7fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fce30116c00 0x7fce301b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:44.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.266+0000 7fce2ffff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fce30116090 0x7fce301b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:44.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.266+0000 7fce348d7640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fce30117560 0x7fce301ab4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.176:59744/0 (socket says 10.20.193.176:59744) 2026-02-17T21:23:44.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.266+0000 7fce348d7640 1 -- 10.20.193.176:0/660360281 learned_addr learned my addr 10.20.193.176:0/660360281 (peer_addr_for_me v2:10.20.193.176:0/0) 2026-02-17T21:23:44.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.266+0000 7fce348d7640 10 monclient(hunting): get_auth_request con 0x7fce30117560 auth_method 0 2026-02-17T21:23:44.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.266+0000 7fce348d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:44.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.266+0000 7fce348d7640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:44.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.266+0000 7fce348d7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:44.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.266+0000 7fce2ffff640 10 monclient(hunting): get_auth_request con 0x7fce30116090 auth_method 0 2026-02-17T21:23:44.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.266+0000 7fce2ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:44.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.266+0000 7fce2ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:44.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.266+0000 7fce2ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:44.283 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.266+0000 7fce2f7fe640 10 monclient(hunting): get_auth_request con 0x7fce30116c00 auth_method 0 2026-02-17T21:23:44.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.266+0000 7fce2f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:44.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.266+0000 7fce2f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:44.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.266+0000 7fce2f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:44.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.266+0000 7fce348d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:44.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.266+0000 7fce348d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:44.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.266+0000 7fce348d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:44.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.266+0000 7fce2ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:44.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.266+0000 7fce2ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:44.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.266+0000 7fce2ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:44.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.266+0000 7fce2f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:44.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.266+0000 7fce2f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:44.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.266+0000 7fce2f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:44.284 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.267+0000 7fce348d7640 10 monclient(hunting): handle_auth_done global_id 4199 payload 824 2026-02-17T21:23:44.285 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.267+0000 7fce348d7640 1 -- 10.20.193.176:0/660360281 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fce30116090 msgr2=0x7fce301b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:44.285 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.267+0000 7fce348d7640 1 --2- 10.20.193.176:0/660360281 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fce30116090 0x7fce301b1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:44.285 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.267+0000 7fce348d7640 1 -- 10.20.193.176:0/660360281 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fce30116c00 msgr2=0x7fce301b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:44.285 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.267+0000 7fce348d7640 1 --2- 10.20.193.176:0/660360281 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fce30116c00 0x7fce301b1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:44.285 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.267+0000 7fce348d7640 10 monclient: _finish_hunting 0 2026-02-17T21:23:44.285 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.267+0000 7fce348d7640 1 monclient: found mon.noname-c 2026-02-17T21:23:44.285 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.267+0000 7fce348d7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:44.285 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.267+0000 7fce348d7640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:23:44.285 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.267+0000 7fce348d7640 1 -- 10.20.193.176:0/660360281 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce301abd90 con 0x7fce30117560 2026-02-17T21:23:44.285 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.268+0000 7fce348d7640 1 --2- 10.20.193.176:0/660360281 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fce30117560 0x7fce301ab4d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fce2400cbb0 tx=0x7fce2400a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:44.285 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.268+0000 7fce2cff9640 10 client.?.objecter ms_handle_connect 0x7fce30117560 2026-02-17T21:23:44.285 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.268+0000 7fce2cff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:23:44.285 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce2cff9640 1 -- 10.20.193.176:0/660360281 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2400ad50 con 0x7fce30117560 2026-02-17T21:23:44.286 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce2cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:44.286 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce2cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:23:44.286 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce2cff9640 10 monclient: dump: 2026-02-17T21:23:44.286 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:44.286 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:44.286 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:44.286 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:44.286 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:44.286 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:44.286 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:44.286 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:44.286 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:44.286 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:44.287 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce2cff9640 10 monclient: _finish_auth 0 2026-02-17T21:23:44.287 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce2cff9640 10 monclient: _check_auth_tickets 2026-02-17T21:23:44.287 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce2cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:44.287 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce2cff9640 1 -- 10.20.193.176:0/660360281 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce24012400 con 0x7fce30117560 2026-02-17T21:23:44.287 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce2cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:44.287 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce2cff9640 1 -- 10.20.193.176:0/660360281 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce24012870 con 0x7fce30117560 2026-02-17T21:23:44.287 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce2cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:44.287 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce2cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:23:44.287 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce2e7fc640 4 set_mon_vals no callback set 2026-02-17T21:23:44.287 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce2cff9640 10 monclient: dump: 2026-02-17T21:23:44.287 INFO:teuthology.orchestra.run.trial176.stderr:epoch 1 2026-02-17T21:23:44.287 INFO:teuthology.orchestra.run.trial176.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:44.287 INFO:teuthology.orchestra.run.trial176.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:44.288 INFO:teuthology.orchestra.run.trial176.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:44.288 INFO:teuthology.orchestra.run.trial176.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:44.288 INFO:teuthology.orchestra.run.trial176.stderr:election_strategy: 1 2026-02-17T21:23:44.288 INFO:teuthology.orchestra.run.trial176.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:44.288 INFO:teuthology.orchestra.run.trial176.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:44.288 INFO:teuthology.orchestra.run.trial176.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:44.288 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:23:44.288 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce36361640 5 monclient: authenticate success, global_id 4199 2026-02-17T21:23:44.288 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce36361640 10 monclient: _renew_subs 2026-02-17T21:23:44.288 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce36361640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:44.288 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce36361640 1 -- 10.20.193.176:0/660360281 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce301ac020 con 0x7fce30117560 2026-02-17T21:23:44.288 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce36361640 10 client.4199.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:23:44.288 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce36361640 10 monclient: _renew_subs 2026-02-17T21:23:44.289 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce36361640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:44.289 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce36361640 1 -- 10.20.193.176:0/660360281 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce301b83b0 con 0x7fce30117560 2026-02-17T21:23:44.289 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce36361640 1 librados: init done 2026-02-17T21:23:44.289 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce36361640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:44.289 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce36361640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:44.289 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce36361640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:44.289 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.270+0000 7fce36361640 1 -- 10.20.193.176:0/660360281 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce301179c0 con 0x7fce30117560 2026-02-17T21:23:44.290 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.281+0000 7fce2cff9640 1 -- 10.20.193.176:0/660360281 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 4) ==== 99956+0+0 (secure 0 0 0) 0x7fce24012a10 con 0x7fce30117560 2026-02-17T21:23:44.327 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.324+0000 7fce2cff9640 1 -- 10.20.193.176:0/660360281 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2450+0+0 (secure 0 0 0) 0x7fce24012d30 con 0x7fce30117560 2026-02-17T21:23:44.328 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.324+0000 7fce2cff9640 10 client.4199.objecter ms_dispatch2 0x7fce30000b90 osd_map(18..18 src has 1..18) 2026-02-17T21:23:44.328 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.324+0000 7fce2cff9640 3 client.4199.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T21:23:44.328 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.324+0000 7fce2cff9640 3 client.4199.objecter handle_osd_map decoding full epoch 18 2026-02-17T21:23:44.328 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.324+0000 7fce2cff9640 20 client.4199.objecter dump_active .. 0 homeless 2026-02-17T21:23:44.328 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.324+0000 7fce2cff9640 1 -- 10.20.193.176:0/660360281 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fce24062ae0 con 0x7fce30117560 2026-02-17T21:23:44.328 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.324+0000 7fce2cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:44.328 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.324+0000 7fce2cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:23:44.359 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.355+0000 7fce36361640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "537605ff-bedd-4f2b-922f-e2eaa8c17f48", "id": 15}] 2026-02-17T21:23:44.359 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.355+0000 7fce36361640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "537605ff-bedd-4f2b-922f-e2eaa8c17f48", "id": 15}] 2026-02-17T21:23:44.359 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.355+0000 7fce36361640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:44.360 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.355+0000 7fce36361640 1 -- 10.20.193.176:0/660360281 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "537605ff-bedd-4f2b-922f-e2eaa8c17f48", "id": 15} v 0) -- 0x7fce301b8580 con 0x7fce30117560 2026-02-17T21:23:44.402 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.399+0000 7fce2cff9640 1 -- 10.20.193.176:0/660360281 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "537605ff-bedd-4f2b-922f-e2eaa8c17f48", "id": 15}]=0 v19) ==== 113+0+3 (secure 0 0 0) 0x7fce24066de0 con 0x7fce30117560 2026-02-17T21:23:44.403 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.399+0000 7fce2cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "537605ff-bedd-4f2b-922f-e2eaa8c17f48", "id": 15}] 2026-02-17T21:23:44.403 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.399+0000 7fce2cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:23:44.403 INFO:teuthology.orchestra.run.trial176.stdout:15 2026-02-17T21:23:44.404 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.399+0000 7fce36361640 10 librados: watch_flush enter 2026-02-17T21:23:44.404 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.399+0000 7fce36361640 10 librados: watch_flush exit 2026-02-17T21:23:44.404 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.399+0000 7fce36361640 20 client.4199.objecter shutdown clearing up homeless session... 2026-02-17T21:23:44.405 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.399+0000 7fce36361640 10 client.4199.objecter successfully canceled tick 2026-02-17T21:23:44.405 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.399+0000 7fce36361640 10 monclient: shutdown 2026-02-17T21:23:44.405 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.399+0000 7fce36361640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:44.405 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.399+0000 7fce36361640 1 -- 10.20.193.176:0/660360281 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fce30117560 msgr2=0x7fce301ab4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:44.405 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.399+0000 7fce36361640 1 --2- 10.20.193.176:0/660360281 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fce30117560 0x7fce301ab4d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fce2400cbb0 tx=0x7fce2400a430 comp rx=0 tx=0).stop 2026-02-17T21:23:44.405 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.399+0000 7fce36361640 1 -- 10.20.193.176:0/660360281 shutdown_connections 2026-02-17T21:23:44.405 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.399+0000 7fce36361640 1 --2- 10.20.193.176:0/660360281 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fce30117560 0x7fce301ab4d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:44.405 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.399+0000 7fce36361640 1 --2- 10.20.193.176:0/660360281 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fce30116c00 0x7fce301b1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:44.405 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.399+0000 7fce36361640 1 --2- 10.20.193.176:0/660360281 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fce30116090 0x7fce301b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:44.405 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.399+0000 7fce36361640 1 -- 10.20.193.176:0/660360281 >> 10.20.193.176:0/660360281 conn(0x7fce30071500 msgr2=0x7fce30114dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:44.405 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.399+0000 7fce36361640 1 -- 10.20.193.176:0/660360281 shutdown_connections 2026-02-17T21:23:44.406 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.399+0000 7fce36361640 1 -- 10.20.193.176:0/660360281 wait complete. 2026-02-17T21:23:44.406 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T21:23:44.399+0000 7fce36361640 1 librados: shutdown 2026-02-17T21:23:44.409 DEBUG:tasks.ceph_manager:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:23:44.410 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-17T21:23:44.410 DEBUG:teuthology.orchestra.run.trial005:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 2026-02-17T21:23:44.412 INFO:tasks.ceph.osd.0:Started 2026-02-17T21:23:44.412 DEBUG:tasks.ceph_manager:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:23:44.412 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-17T21:23:44.413 DEBUG:teuthology.orchestra.run.trial005:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 2026-02-17T21:23:44.495 INFO:tasks.ceph.osd.4:Started 2026-02-17T21:23:44.495 DEBUG:tasks.ceph_manager:running osd.8 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.8.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:23:44.495 INFO:tasks.ceph.osd.8:Restarting daemon 2026-02-17T21:23:44.495 DEBUG:teuthology.orchestra.run.trial005:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.8.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 8 2026-02-17T21:23:44.496 INFO:tasks.ceph.osd.8:Started 2026-02-17T21:23:44.496 DEBUG:tasks.ceph_manager:running osd.12 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.12.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:23:44.496 INFO:tasks.ceph.osd.12:Restarting daemon 2026-02-17T21:23:44.496 DEBUG:teuthology.orchestra.run.trial005:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.12.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 12 2026-02-17T21:23:44.498 INFO:tasks.ceph.osd.12:Started 2026-02-17T21:23:44.498 DEBUG:tasks.ceph_manager:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:23:44.498 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-17T21:23:44.498 DEBUG:teuthology.orchestra.run.trial119:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 2026-02-17T21:23:44.499 INFO:tasks.ceph.osd.1:Started 2026-02-17T21:23:44.499 DEBUG:tasks.ceph_manager:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:23:44.500 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-17T21:23:44.500 DEBUG:teuthology.orchestra.run.trial119:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 2026-02-17T21:23:44.501 INFO:tasks.ceph.osd.5:Started 2026-02-17T21:23:44.501 DEBUG:tasks.ceph_manager:running osd.9 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.9.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:23:44.501 INFO:tasks.ceph.osd.9:Restarting daemon 2026-02-17T21:23:44.501 DEBUG:teuthology.orchestra.run.trial119:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.9.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 9 2026-02-17T21:23:44.503 INFO:tasks.ceph.osd.9:Started 2026-02-17T21:23:44.503 DEBUG:tasks.ceph_manager:running osd.13 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.13.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:23:44.503 INFO:tasks.ceph.osd.13:Restarting daemon 2026-02-17T21:23:44.504 DEBUG:teuthology.orchestra.run.trial119:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.13.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 13 2026-02-17T21:23:44.505 INFO:tasks.ceph.osd.13:Started 2026-02-17T21:23:44.505 DEBUG:tasks.ceph_manager:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:23:44.505 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-17T21:23:44.505 DEBUG:teuthology.orchestra.run.trial135:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 2026-02-17T21:23:44.507 INFO:tasks.ceph.osd.2:Started 2026-02-17T21:23:44.507 DEBUG:tasks.ceph_manager:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:23:44.507 INFO:tasks.ceph.osd.6:Restarting daemon 2026-02-17T21:23:44.507 DEBUG:teuthology.orchestra.run.trial135:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 2026-02-17T21:23:44.509 INFO:tasks.ceph.osd.6:Started 2026-02-17T21:23:44.509 DEBUG:tasks.ceph_manager:running osd.10 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.10.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:23:44.509 INFO:tasks.ceph.osd.10:Restarting daemon 2026-02-17T21:23:44.509 DEBUG:teuthology.orchestra.run.trial135:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.10.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 10 2026-02-17T21:23:44.511 INFO:tasks.ceph.osd.10:Started 2026-02-17T21:23:44.511 DEBUG:tasks.ceph_manager:running osd.14 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.14.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:23:44.511 INFO:tasks.ceph.osd.14:Restarting daemon 2026-02-17T21:23:44.511 DEBUG:teuthology.orchestra.run.trial135:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.14.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 14 2026-02-17T21:23:44.513 INFO:tasks.ceph.osd.14:Started 2026-02-17T21:23:44.513 DEBUG:tasks.ceph_manager:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:23:44.513 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-17T21:23:44.513 DEBUG:teuthology.orchestra.run.trial176:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 2026-02-17T21:23:44.515 INFO:tasks.ceph.osd.3:Started 2026-02-17T21:23:44.515 DEBUG:tasks.ceph_manager:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:23:44.515 INFO:tasks.ceph.osd.7:Restarting daemon 2026-02-17T21:23:44.515 DEBUG:teuthology.orchestra.run.trial176:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 2026-02-17T21:23:44.517 INFO:tasks.ceph.osd.7:Started 2026-02-17T21:23:44.517 DEBUG:tasks.ceph_manager:running osd.11 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.11.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:23:44.517 INFO:tasks.ceph.osd.11:Restarting daemon 2026-02-17T21:23:44.517 DEBUG:teuthology.orchestra.run.trial176:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.11.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 11 2026-02-17T21:23:44.519 INFO:tasks.ceph.osd.11:Started 2026-02-17T21:23:44.519 DEBUG:tasks.ceph_manager:running osd.15 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.15.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:23:44.519 INFO:tasks.ceph.osd.15:Restarting daemon 2026-02-17T21:23:44.519 DEBUG:teuthology.orchestra.run.trial176:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.15.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 15 2026-02-17T21:23:44.520 INFO:tasks.ceph.osd.15:Started 2026-02-17T21:23:44.520 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T21:23:44.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.588+0000 7ffb79a5d640 10 monclient: get_monmap_and_config 2026-02-17T21:23:44.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.588+0000 7ffb79a5d640 10 monclient: build_initial_monmap 2026-02-17T21:23:44.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.588+0000 7ffb79a5d640 10 monclient: monmap: 2026-02-17T21:23:44.590 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:23:44.590 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:44.590 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:23:44.589144+0000 2026-02-17T21:23:44.590 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:23:44.589144+0000 2026-02-17T21:23:44.590 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:44.590 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:23:44.590 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:23:44.590 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:23:44.590 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:23:44.590 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:23:44.590 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:23:44.590 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:23:44.590 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:23:44.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.589+0000 7ffb79a5d640 1 Processor -- start 2026-02-17T21:23:44.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.589+0000 7ffb79a5d640 1 -- start start 2026-02-17T21:23:44.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.589+0000 7ffb79a5d640 10 monclient: init 2026-02-17T21:23:44.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.589+0000 7ffb79a5d640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:44.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.589+0000 7ffb79a5d640 10 monclient: _add_conns ranks=[5,3,4,1,2,0] 2026-02-17T21:23:44.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.589+0000 7ffb79a5d640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7ffb740d1b60 0x7ffb740d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:44.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.589+0000 7ffb79a5d640 10 monclient(hunting): picked mon.noname-c con 0x7ffb740d1b60 addr v2:10.20.193.135:3300/0 2026-02-17T21:23:44.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.589+0000 7ffb79a5d640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7ffb7415c840 0x7ffb740c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:44.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.589+0000 7ffb79a5d640 10 monclient(hunting): picked mon.noname-a con 0x7ffb7415c840 addr v2:10.20.193.5:3300/0 2026-02-17T21:23:44.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.589+0000 7ffb79a5d640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7ffb740c92a0 0x7ffb7415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:44.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.589+0000 7ffb79a5d640 10 monclient(hunting): picked mon.noname-b con 0x7ffb740c92a0 addr v2:10.20.193.119:3300/0 2026-02-17T21:23:44.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.589+0000 7ffb79a5d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:44.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.589+0000 7ffb79a5d640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7ffb740ca460 con 0x7ffb7415c840 2026-02-17T21:23:44.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.589+0000 7ffb79a5d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:44.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.589+0000 7ffb79a5d640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7ffb7415d4c0 con 0x7ffb740c92a0 2026-02-17T21:23:44.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.589+0000 7ffb79a5d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:44.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.589+0000 7ffb79a5d640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7ffb740c98e0 con 0x7ffb740d1b60 2026-02-17T21:23:44.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.589+0000 7ffb79a5d640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:44.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.589+0000 7ffb79a5d640 10 monclient(hunting): authenticate will time out at 930.154787s 2026-02-17T21:23:44.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.590+0000 7ffb72ffd640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7ffb740d1b60 0x7ffb740d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:44.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.591+0000 7ffb72ffd640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7ffb740d1b60 0x7ffb740d1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:49444/0 (socket says 10.20.193.5:49444) 2026-02-17T21:23:44.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.591+0000 7ffb72ffd640 1 -- 10.20.193.5:0/3386622649 learned_addr learned my addr 10.20.193.5:0/3386622649 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:23:44.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.591+0000 7ffb72ffd640 10 monclient(hunting): get_auth_request con 0x7ffb740d1b60 auth_method 0 2026-02-17T21:23:44.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.591+0000 7ffb72ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:44.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.591+0000 7ffb72ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:44.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.591+0000 7ffb72ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:44.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.591+0000 7ffb72ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:44.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.591+0000 7ffb72ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:44.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.591+0000 7ffb72ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:44.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.592+0000 7ffb72ffd640 10 monclient(hunting): handle_auth_done global_id 4202 payload 274 2026-02-17T21:23:44.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.592+0000 7ffb72ffd640 1 -- 10.20.193.5:0/3386622649 >> v2:10.20.193.119:3300/0 conn(0x7ffb740c92a0 msgr2=0x7ffb7415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:23:44.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.592+0000 7ffb72ffd640 1 --2- 10.20.193.5:0/3386622649 >> v2:10.20.193.119:3300/0 conn(0x7ffb740c92a0 0x7ffb7415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:44.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.592+0000 7ffb72ffd640 1 -- 10.20.193.5:0/3386622649 >> v2:10.20.193.5:3300/0 conn(0x7ffb7415c840 msgr2=0x7ffb740c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:23:44.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.592+0000 7ffb72ffd640 1 --2- 10.20.193.5:0/3386622649 >> v2:10.20.193.5:3300/0 conn(0x7ffb7415c840 0x7ffb740c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:44.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.592+0000 7ffb72ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:23:44.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.592+0000 7ffb72ffd640 1 monclient: found mon.noname-c 2026-02-17T21:23:44.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.592+0000 7ffb72ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:44.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.592+0000 7ffb72ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:23:44.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.592+0000 7ffb72ffd640 1 -- 10.20.193.5:0/3386622649 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb740c9bc0 con 0x7ffb740d1b60 2026-02-17T21:23:44.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.593+0000 7ffb72ffd640 1 --2- 10.20.193.5:0/3386622649 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ffb740d1b60 0x7ffb740d1f40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ffb740751e0 tx=0x7ffb6802ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7332523e0cd95a3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:44.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.594+0000 7ffb71ffb640 1 -- 10.20.193.5:0/3386622649 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6803c070 con 0x7ffb740d1b60 2026-02-17T21:23:44.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.594+0000 7ffb71ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:44.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.594+0000 7ffb71ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:23:44.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.594+0000 7ffb71ffb640 10 monclient: dump: 2026-02-17T21:23:44.596 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:23:44.596 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:44.596 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:44.596 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:44.596 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:44.596 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:23:44.596 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:44.596 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:44.596 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:44.596 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:23:44.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.594+0000 7ffb71ffb640 10 monclient: _finish_auth 0 2026-02-17T21:23:44.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.594+0000 7ffb71ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:23:44.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.594+0000 7ffb71ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:44.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.594+0000 7ffb79a5d640 5 monclient: authenticate success, global_id 4202 2026-02-17T21:23:44.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.594+0000 7ffb79a5d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:23:44.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.595+0000 7ffb71ffb640 1 -- 10.20.193.5:0/3386622649 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb6802fb50 con 0x7ffb740d1b60 2026-02-17T21:23:44.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.595+0000 7ffb71ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:44.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.595+0000 7ffb71ffb640 1 -- 10.20.193.5:0/3386622649 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb68037440 con 0x7ffb740d1b60 2026-02-17T21:23:44.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.595+0000 7ffb71ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:44.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.595+0000 7ffb71ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:23:44.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.595+0000 7ffb71ffb640 10 monclient: dump: 2026-02-17T21:23:44.599 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:23:44.599 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:44.599 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:44.599 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:44.599 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:44.599 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:23:44.599 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:44.599 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:44.599 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:44.599 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:23:44.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.595+0000 7ffb79a5d640 10 monclient: get_monmap_and_config success 2026-02-17T21:23:44.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.595+0000 7ffb79a5d640 4 set_mon_vals no callback set 2026-02-17T21:23:44.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.595+0000 7ffb79a5d640 10 monclient: shutdown 2026-02-17T21:23:44.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.595+0000 7ffb79a5d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:44.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.595+0000 7ffb79a5d640 1 -- 10.20.193.5:0/3386622649 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ffb740d1b60 msgr2=0x7ffb740d1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:44.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.595+0000 7ffb79a5d640 1 --2- 10.20.193.5:0/3386622649 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ffb740d1b60 0x7ffb740d1f40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ffb740751e0 tx=0x7ffb6802ee90 comp rx=0 tx=0).stop 2026-02-17T21:23:44.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.595+0000 7ffb79a5d640 1 -- 10.20.193.5:0/3386622649 shutdown_connections 2026-02-17T21:23:44.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.595+0000 7ffb79a5d640 1 --2- 10.20.193.5:0/3386622649 >> v2:10.20.193.119:3300/0 conn(0x7ffb740c92a0 0x7ffb7415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:44.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.595+0000 7ffb79a5d640 1 --2- 10.20.193.5:0/3386622649 >> v2:10.20.193.5:3300/0 conn(0x7ffb7415c840 0x7ffb740c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:44.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.595+0000 7ffb79a5d640 1 --2- 10.20.193.5:0/3386622649 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ffb740d1b60 0x7ffb740d1f40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:44.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.595+0000 7ffb79a5d640 1 -- 10.20.193.5:0/3386622649 >> 10.20.193.5:0/3386622649 conn(0x7ffb7406d9b0 msgr2=0x7ffb7406ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:44.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.595+0000 7ffb79a5d640 1 -- 10.20.193.5:0/3386622649 shutdown_connections 2026-02-17T21:23:44.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.595+0000 7ffb79a5d640 1 -- 10.20.193.5:0/3386622649 wait complete. 2026-02-17T21:23:44.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.596+0000 7ffb79a5d640 10 monclient: build_initial_monmap 2026-02-17T21:23:44.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.596+0000 7ffb79a5d640 10 monclient: monmap: 2026-02-17T21:23:44.600 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:23:44.600 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:23:44.600 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:23:44.600 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:23:44.601 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:44.601 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:23:44.601 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:23:44.601 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:23:44.601 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:23:44.601 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:23:44.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.596+0000 7ffb79a5d640 1 librados: starting msgr at 2026-02-17T21:23:44.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.596+0000 7ffb79a5d640 1 librados: starting objecter 2026-02-17T21:23:44.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.596+0000 7ffb79a5d640 1 Processor -- start 2026-02-17T21:23:44.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.596+0000 7ffb79a5d640 1 -- start start 2026-02-17T21:23:44.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.596+0000 7ffb79a5d640 1 librados: setting wanted keys 2026-02-17T21:23:44.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.596+0000 7ffb79a5d640 1 librados: calling monclient init 2026-02-17T21:23:44.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.596+0000 7ffb79a5d640 10 monclient: init 2026-02-17T21:23:44.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.596+0000 7ffb79a5d640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:44.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.596+0000 7ffb79a5d640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:23:44.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.596+0000 7ffb79a5d640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ffb740c92a0 0x7ffb74158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:44.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.596+0000 7ffb79a5d640 10 monclient(hunting): picked mon.noname-a con 0x7ffb740c92a0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:23:44.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.596+0000 7ffb79a5d640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ffb740d1b60 0x7ffb7414ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:44.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.596+0000 7ffb79a5d640 10 monclient(hunting): picked mon.noname-c con 0x7ffb740d1b60 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:23:44.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.596+0000 7ffb79a5d640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffb7415c840 0x7ffb7415d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:44.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.596+0000 7ffb79a5d640 10 monclient(hunting): picked mon.noname-b con 0x7ffb7415c840 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:23:44.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.596+0000 7ffb79a5d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:44.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.596+0000 7ffb79a5d640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7415cc90 con 0x7ffb740c92a0 2026-02-17T21:23:44.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.596+0000 7ffb79a5d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:44.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.596+0000 7ffb79a5d640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7ffb740ca180 con 0x7ffb7415c840 2026-02-17T21:23:44.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.596+0000 7ffb79a5d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:44.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.596+0000 7ffb79a5d640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7406e7b0 con 0x7ffb740d1b60 2026-02-17T21:23:44.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.596+0000 7ffb79a5d640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:44.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.596+0000 7ffb79a5d640 10 monclient(hunting): authenticate will time out at 930.161954s 2026-02-17T21:23:44.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.597+0000 7ffb727fc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ffb740d1b60 0x7ffb7414ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:44.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.597+0000 7ffb727fc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ffb740d1b60 0x7ffb7414ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:49446/0 (socket says 10.20.193.5:49446) 2026-02-17T21:23:44.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.597+0000 7ffb727fc640 1 -- 10.20.193.5:0/3829775227 learned_addr learned my addr 10.20.193.5:0/3829775227 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:23:44.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.597+0000 7ffb727fc640 10 monclient(hunting): get_auth_request con 0x7ffb740d1b60 auth_method 0 2026-02-17T21:23:44.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.597+0000 7ffb727fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:44.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.597+0000 7ffb727fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:44.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.597+0000 7ffb727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:44.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.597+0000 7ffb727fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:44.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.597+0000 7ffb727fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:44.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.597+0000 7ffb727fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:44.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.598+0000 7ffb727fc640 10 monclient(hunting): handle_auth_done global_id 4205 payload 824 2026-02-17T21:23:44.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.598+0000 7ffb727fc640 1 -- 10.20.193.5:0/3829775227 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffb7415c840 msgr2=0x7ffb7415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:44.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.598+0000 7ffb727fc640 1 --2- 10.20.193.5:0/3829775227 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffb7415c840 0x7ffb7415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:44.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.598+0000 7ffb727fc640 1 -- 10.20.193.5:0/3829775227 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ffb740c92a0 msgr2=0x7ffb74158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:44.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.598+0000 7ffb727fc640 1 --2- 10.20.193.5:0/3829775227 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ffb740c92a0 0x7ffb74158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:44.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.598+0000 7ffb727fc640 10 monclient: _finish_hunting 0 2026-02-17T21:23:44.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.598+0000 7ffb727fc640 1 monclient: found mon.noname-c 2026-02-17T21:23:44.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.599+0000 7ffb727fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:44.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.599+0000 7ffb727fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:23:44.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.599+0000 7ffb727fc640 1 -- 10.20.193.5:0/3829775227 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb74157ba0 con 0x7ffb740d1b60 2026-02-17T21:23:44.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.600+0000 7ffb727fc640 1 --2- 10.20.193.5:0/3829775227 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ffb740d1b60 0x7ffb7414ad40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00b530 tx=0x7ffb5c00ba00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:44.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.600+0000 7ffb4bfff640 10 client.?.objecter ms_handle_connect 0x7ffb740d1b60 2026-02-17T21:23:44.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.600+0000 7ffb4bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:23:44.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.601+0000 7ffb4bfff640 1 -- 10.20.193.5:0/3829775227 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c013020 con 0x7ffb740d1b60 2026-02-17T21:23:44.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.601+0000 7ffb4bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:44.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.601+0000 7ffb4bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:23:44.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.601+0000 7ffb4bfff640 10 monclient: dump: 2026-02-17T21:23:44.605 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:23:44.605 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:44.605 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:44.605 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:44.605 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:44.605 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:23:44.605 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:44.605 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:44.605 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:44.605 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:23:44.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.601+0000 7ffb4bfff640 10 monclient: _finish_auth 0 2026-02-17T21:23:44.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.601+0000 7ffb4bfff640 10 monclient: _check_auth_tickets 2026-02-17T21:23:44.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.601+0000 7ffb4bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:44.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.601+0000 7ffb79a5d640 5 monclient: authenticate success, global_id 4205 2026-02-17T21:23:44.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.601+0000 7ffb4bfff640 1 -- 10.20.193.5:0/3829775227 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb5c004480 con 0x7ffb740d1b60 2026-02-17T21:23:44.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.601+0000 7ffb79a5d640 10 monclient: _renew_subs 2026-02-17T21:23:44.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.601+0000 7ffb79a5d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:44.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.601+0000 7ffb79a5d640 1 -- 10.20.193.5:0/3829775227 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb74157e80 con 0x7ffb740d1b60 2026-02-17T21:23:44.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.601+0000 7ffb4bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:44.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.601+0000 7ffb4bfff640 1 -- 10.20.193.5:0/3829775227 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c002920 con 0x7ffb740d1b60 2026-02-17T21:23:44.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.601+0000 7ffb4bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:44.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.601+0000 7ffb4bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:23:44.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.601+0000 7ffb717fa640 4 set_mon_vals no callback set 2026-02-17T21:23:44.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.601+0000 7ffb4bfff640 10 monclient: dump: 2026-02-17T21:23:44.606 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:23:44.606 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:44.606 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:44.606 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:44.606 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:44.607 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:23:44.607 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:44.607 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:44.607 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:44.607 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:23:44.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.601+0000 7ffb79a5d640 10 client.4205.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:23:44.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.601+0000 7ffb79a5d640 10 monclient: _renew_subs 2026-02-17T21:23:44.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.601+0000 7ffb79a5d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:44.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.601+0000 7ffb79a5d640 1 -- 10.20.193.5:0/3829775227 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb74158440 con 0x7ffb740d1b60 2026-02-17T21:23:44.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.601+0000 7ffb79a5d640 1 librados: init done 2026-02-17T21:23:44.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.602+0000 7ffb79a5d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:44.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.602+0000 7ffb79a5d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:44.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.602+0000 7ffb79a5d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:44.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.602+0000 7ffb79a5d640 1 -- 10.20.193.5:0/3829775227 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb740d1f40 con 0x7ffb740d1b60 2026-02-17T21:23:44.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.615+0000 7ffb4bfff640 1 -- 10.20.193.5:0/3829775227 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 4) ==== 99956+0+0 (secure 0 0 0) 0x7ffb5c002ac0 con 0x7ffb740d1b60 2026-02-17T21:23:44.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.617+0000 7ffb4bfff640 1 -- 10.20.193.5:0/3829775227 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 2565+0+0 (secure 0 0 0) 0x7ffb5c05d950 con 0x7ffb740d1b60 2026-02-17T21:23:44.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.617+0000 7ffb4bfff640 10 client.4205.objecter ms_dispatch2 0x7ffb74000b90 osd_map(19..19 src has 1..19) 2026-02-17T21:23:44.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.617+0000 7ffb4bfff640 3 client.4205.objecter handle_osd_map got epochs [19,19] > 0 2026-02-17T21:23:44.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.617+0000 7ffb4bfff640 3 client.4205.objecter handle_osd_map decoding full epoch 19 2026-02-17T21:23:44.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.617+0000 7ffb4bfff640 20 client.4205.objecter dump_active .. 0 homeless 2026-02-17T21:23:44.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.658+0000 7ffb4bfff640 1 -- 10.20.193.5:0/3829775227 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7ffb5c01d020 con 0x7ffb740d1b60 2026-02-17T21:23:44.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.658+0000 7ffb4bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:44.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.658+0000 7ffb4bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:23:44.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.687+0000 7ffb79a5d640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:23:44.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.687+0000 7ffb79a5d640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:23:44.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.687+0000 7ffb79a5d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:44.689 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.687+0000 7ffb79a5d640 1 -- 10.20.193.5:0/3829775227 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb740d0140 con 0x7ffb740d1b60 2026-02-17T21:23:44.719 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:44.715+0000 7f4ec286b640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-17T21:23:44.742 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.740+0000 7ffb4bfff640 1 -- 10.20.193.5:0/3829775227 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mgrmap(e 5) ==== 100083+0+0 (secure 0 0 0) 0x7ffb5c05e270 con 0x7ffb740d1b60 2026-02-17T21:23:44.742 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.741+0000 7ffb4bfff640 1 --2- 10.20.193.5:0/3829775227 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ffb4403df30 0x7ffb4407ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:44.742 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.741+0000 7ffb72ffd640 1 --2- 10.20.193.5:0/3829775227 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ffb4403df30 0x7ffb4407ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:44.742 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.741+0000 7ffb72ffd640 10 monclient: get_auth_request con 0x7ffb4403df30 auth_method 0 2026-02-17T21:23:44.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.741+0000 7ffb72ffd640 1 --2- 10.20.193.5:0/3829775227 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ffb4403df30 0x7ffb4407ce50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffb7408fc80 tx=0x7ffb68031000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:44.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.741+0000 7ffb4bfff640 10 client.4205.objecter ms_handle_connect 0x7ffb4403df30 2026-02-17T21:23:44.792 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.790+0000 7ffb4bfff640 1 -- 10.20.193.5:0/3829775227 <== mon.2 v2:10.20.193.135:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12879 (secure 0 0 0) 0x7ffb5c074eb0 con 0x7ffb740d1b60 2026-02-17T21:23:44.792 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.790+0000 7ffb4bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:23:44.792 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.790+0000 7ffb4bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:23:44.793 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:23:44.793 INFO:teuthology.orchestra.run.trial005.stdout:{"epoch":19,"fsid":"b1be373b-56c5-4b5b-a965-9bcc20042691","created":"2026-02-17T21:23:38.622021+0000","modified":"2026-02-17T21:23:44.366223+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:23:44.366223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8bffc5e9-1f92-4603-bf29-ce19225edc1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8ffdf919-2ec4-4c1f-a69f-aee5cea211e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d186244a-4bf7-416d-b6a0-0e0f5af50eb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"093b417e-53bf-4b60-a937-7c5ffee43e1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0a48e684-05b0-41b1-a553-022424011225","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d73b7c38-cef9-4993-b353-908c1d87603c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f7774c25-72e8-41b2-8634-517af7a213b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"30a68802-afce-499b-90ce-bd568bc69406","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"8b4a2001-3ac8-4756-9dcf-af38c6d12d44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"dfdfee67-eff6-4413-bd7a-adc0a019bfbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"fc24ee77-5a0d-41d4-88f5-8d03a77c7608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"1d737681-1923-453a-82f8-516eeb875559","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"c4f0322e-a862-4c5e-967e-4551087ede8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"0b5e9861-a194-4f11-a849-d8bb94ce95a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"6f182077-0c0d-481c-97b4-43ef48aa5aea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"537605ff-bedd-4f2b-922f-e2eaa8c17f48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:23:44.794 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.791+0000 7ffb79a5d640 10 librados: watch_flush enter 2026-02-17T21:23:44.795 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.791+0000 7ffb79a5d640 10 librados: watch_flush exit 2026-02-17T21:23:44.795 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.791+0000 7ffb79a5d640 20 client.4205.objecter shutdown clearing up homeless session... 2026-02-17T21:23:44.795 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.791+0000 7ffb79a5d640 10 client.4205.objecter successfully canceled tick 2026-02-17T21:23:44.795 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.792+0000 7ffb79a5d640 1 -- 10.20.193.5:0/3829775227 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ffb4403df30 msgr2=0x7ffb4407ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:44.795 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.792+0000 7ffb79a5d640 1 --2- 10.20.193.5:0/3829775227 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ffb4403df30 0x7ffb4407ce50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffb7408fc80 tx=0x7ffb68031000 comp rx=0 tx=0).stop 2026-02-17T21:23:44.795 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.792+0000 7ffb79a5d640 10 monclient: shutdown 2026-02-17T21:23:44.795 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.792+0000 7ffb79a5d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:44.795 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.792+0000 7ffb79a5d640 1 -- 10.20.193.5:0/3829775227 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ffb740d1b60 msgr2=0x7ffb7414ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:44.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.792+0000 7ffb79a5d640 1 --2- 10.20.193.5:0/3829775227 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ffb740d1b60 0x7ffb7414ad40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00b530 tx=0x7ffb5c00ba00 comp rx=0 tx=0).stop 2026-02-17T21:23:44.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.792+0000 7ffb79a5d640 1 -- 10.20.193.5:0/3829775227 shutdown_connections 2026-02-17T21:23:44.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.792+0000 7ffb79a5d640 1 --2- 10.20.193.5:0/3829775227 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ffb4403df30 0x7ffb4407ce50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:44.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.792+0000 7ffb79a5d640 1 --2- 10.20.193.5:0/3829775227 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffb7415c840 0x7ffb7415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:44.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.792+0000 7ffb79a5d640 1 --2- 10.20.193.5:0/3829775227 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ffb740d1b60 0x7ffb7414ad40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:44.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.792+0000 7ffb79a5d640 1 --2- 10.20.193.5:0/3829775227 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ffb740c92a0 0x7ffb74158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:44.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.792+0000 7ffb79a5d640 1 -- 10.20.193.5:0/3829775227 >> 10.20.193.5:0/3829775227 conn(0x7ffb7406d9b0 msgr2=0x7ffb74150c80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:44.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.792+0000 7ffb79a5d640 1 -- 10.20.193.5:0/3829775227 shutdown_connections 2026-02-17T21:23:44.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.792+0000 7ffb79a5d640 1 -- 10.20.193.5:0/3829775227 wait complete. 2026-02-17T21:23:44.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:23:44.792+0000 7ffb79a5d640 1 librados: shutdown 2026-02-17T21:23:44.804 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-17T21:23:44.804 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-17T21:23:44.821 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:23:44.817+0000 7f4ec286b640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-17T21:23:46.418 DEBUG:teuthology.orchestra.run.trial005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:23:46.480 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.477+0000 7f27bac05640 10 monclient: get_monmap_and_config 2026-02-17T21:23:46.480 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.477+0000 7f27bac05640 10 monclient: build_initial_monmap 2026-02-17T21:23:46.480 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.477+0000 7f27bac05640 10 monclient: monmap: 2026-02-17T21:23:46.480 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:23:46.480 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:46.480 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:23:46.479513+0000 2026-02-17T21:23:46.480 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:23:46.479513+0000 2026-02-17T21:23:46.480 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:46.481 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:23:46.481 INFO:teuthology.misc.health.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:23:46.481 INFO:teuthology.misc.health.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:23:46.481 INFO:teuthology.misc.health.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:23:46.481 INFO:teuthology.misc.health.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:23:46.481 INFO:teuthology.misc.health.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:23:46.481 INFO:teuthology.misc.health.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:23:46.481 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:23:46.484 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.478+0000 7f27bac05640 1 Processor -- start 2026-02-17T21:23:46.484 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.478+0000 7f27bac05640 1 -- start start 2026-02-17T21:23:46.484 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.478+0000 7f27bac05640 10 monclient: init 2026-02-17T21:23:46.484 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.478+0000 7f27bac05640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:46.484 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.478+0000 7f27bac05640 10 monclient: _add_conns ranks=[5,1,4,2,3,0] 2026-02-17T21:23:46.485 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.478+0000 7f27bac05640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f27b415c2c0 0x7f27b415c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:46.485 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.478+0000 7f27bac05640 10 monclient(hunting): picked mon.noname-c con 0x7f27b415c2c0 addr v2:10.20.193.135:3300/0 2026-02-17T21:23:46.485 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.478+0000 7f27bac05640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f27b40c6aa0 addr v1:10.20.193.119:6789/0 2026-02-17T21:23:46.485 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.478+0000 7f27bac05640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f27b40c7e30 0x7f27b406dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:46.485 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.478+0000 7f27bac05640 10 monclient(hunting): picked mon.noname-b con 0x7f27b40c7e30 addr v2:10.20.193.119:3300/0 2026-02-17T21:23:46.485 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.478+0000 7f27bac05640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27b406d5c0 con 0x7f27b40c6aa0 2026-02-17T21:23:46.485 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.478+0000 7f27bac05640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:46.485 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.478+0000 7f27bac05640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f27b40c6fb0 con 0x7f27b40c7e30 2026-02-17T21:23:46.485 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.478+0000 7f27bac05640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:46.485 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.478+0000 7f27bac05640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f27b40c7290 con 0x7f27b415c2c0 2026-02-17T21:23:46.485 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.478+0000 7f27bac05640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:46.485 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.478+0000 7f27bac05640 10 monclient(hunting): authenticate will time out at 932.044899s 2026-02-17T21:23:46.486 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.479+0000 7f27b917b640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f27b40c7e30 0x7f27b406dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:46.486 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.479+0000 7f27b897a640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f27b415c2c0 0x7f27b415c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:46.486 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.479+0000 7f27abfff640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f27b40c6aa0 0x7f27b4070af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:46740/0 (socket says 10.20.193.5:46740) 2026-02-17T21:23:46.486 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.479+0000 7f27abfff640 1 -- 10.20.193.5:0/2990159630 learned_addr learned my addr 10.20.193.5:0/2990159630 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:23:46.486 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.479+0000 7f27b897a640 10 monclient(hunting): get_auth_request con 0x7f27b415c2c0 auth_method 0 2026-02-17T21:23:46.486 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.479+0000 7f27b897a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:46.486 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.479+0000 7f27b897a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:46.486 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.479+0000 7f27b897a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:46.486 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.479+0000 7f27b917b640 10 monclient(hunting): get_auth_request con 0x7f27b40c7e30 auth_method 0 2026-02-17T21:23:46.486 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.479+0000 7f27b917b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:46.486 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.479+0000 7f27b917b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:46.487 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.479+0000 7f27b917b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:46.487 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.480+0000 7f27b897a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:46.487 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.480+0000 7f27b897a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:46.487 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.480+0000 7f27b897a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:46.487 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.480+0000 7f27b917b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:46.487 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.480+0000 7f27b917b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:46.487 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.480+0000 7f27b917b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:46.487 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.481+0000 7f27b897a640 10 monclient(hunting): handle_auth_done global_id 4208 payload 274 2026-02-17T21:23:46.487 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.481+0000 7f27b897a640 1 -- 10.20.193.5:0/2990159630 >> v2:10.20.193.119:3300/0 conn(0x7f27b40c7e30 msgr2=0x7f27b406dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:23:46.487 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.481+0000 7f27b897a640 1 --2- 10.20.193.5:0/2990159630 >> v2:10.20.193.119:3300/0 conn(0x7f27b40c7e30 0x7f27b406dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:46.487 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.481+0000 7f27b897a640 1 -- 10.20.193.5:0/2990159630 >> v1:10.20.193.119:6789/0 conn(0x7f27b40c6aa0 legacy=0x7f27b4070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:46.487 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.481+0000 7f27b897a640 10 monclient: _finish_hunting 0 2026-02-17T21:23:46.487 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.481+0000 7f27b897a640 1 monclient: found mon.noname-c 2026-02-17T21:23:46.488 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.481+0000 7f27b897a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:46.488 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.481+0000 7f27b897a640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:23:46.488 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.481+0000 7f27b897a640 1 -- 10.20.193.5:0/2990159630 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b40c7570 con 0x7f27b415c2c0 2026-02-17T21:23:46.494 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.482+0000 7f27b897a640 1 --2- 10.20.193.5:0/2990159630 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f27b415c2c0 0x7f27b415c6a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f27b4069960 tx=0x7f27a402eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a53b437996ab644c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:46.494 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27ab7fe640 1 -- 10.20.193.5:0/2990159630 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a403c070 con 0x7f27b415c2c0 2026-02-17T21:23:46.494 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:46.494 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27ab7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:23:46.494 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27ab7fe640 10 monclient: dump: 2026-02-17T21:23:46.494 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:23:46.494 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:46.494 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:46.495 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:46.495 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:46.495 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:23:46.495 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:46.495 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:46.495 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:46.495 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:23:46.495 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27ab7fe640 10 monclient: _finish_auth 0 2026-02-17T21:23:46.495 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27ab7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:23:46.495 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27ab7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:46.495 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27bac05640 5 monclient: authenticate success, global_id 4208 2026-02-17T21:23:46.495 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27bac05640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:23:46.496 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27ab7fe640 1 -- 10.20.193.5:0/2990159630 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a402fb80 con 0x7f27b415c2c0 2026-02-17T21:23:46.496 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27ab7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:46.496 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27ab7fe640 1 -- 10.20.193.5:0/2990159630 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a4037440 con 0x7f27b415c2c0 2026-02-17T21:23:46.496 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:46.496 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27ab7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:23:46.496 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27ab7fe640 10 monclient: dump: 2026-02-17T21:23:46.496 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:23:46.496 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:46.496 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:46.496 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:46.496 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:46.496 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:23:46.496 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:46.497 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:46.497 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:46.497 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:23:46.497 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27bac05640 10 monclient: get_monmap_and_config success 2026-02-17T21:23:46.497 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27bac05640 4 set_mon_vals no callback set 2026-02-17T21:23:46.497 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27bac05640 10 monclient: shutdown 2026-02-17T21:23:46.497 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27bac05640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:46.497 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27bac05640 1 -- 10.20.193.5:0/2990159630 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f27b415c2c0 msgr2=0x7f27b415c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:46.497 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27bac05640 1 --2- 10.20.193.5:0/2990159630 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f27b415c2c0 0x7f27b415c6a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f27b4069960 tx=0x7f27a402eeb0 comp rx=0 tx=0).stop 2026-02-17T21:23:46.497 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27bac05640 1 -- 10.20.193.5:0/2990159630 shutdown_connections 2026-02-17T21:23:46.497 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27bac05640 1 --2- 10.20.193.5:0/2990159630 >> v2:10.20.193.119:3300/0 conn(0x7f27b40c7e30 0x7f27b406dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:46.497 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27bac05640 1 --2- 10.20.193.5:0/2990159630 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f27b415c2c0 0x7f27b415c6a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:46.498 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27bac05640 1 -- 10.20.193.5:0/2990159630 >> 10.20.193.5:0/2990159630 conn(0x7f27b40c9f30 msgr2=0x7f27b40ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:46.498 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27bac05640 1 -- 10.20.193.5:0/2990159630 shutdown_connections 2026-02-17T21:23:46.498 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.484+0000 7f27bac05640 1 -- 10.20.193.5:0/2990159630 wait complete. 2026-02-17T21:23:46.498 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.485+0000 7f27bac05640 10 monclient: build_initial_monmap 2026-02-17T21:23:46.498 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.485+0000 7f27bac05640 10 monclient: monmap: 2026-02-17T21:23:46.498 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:23:46.498 INFO:teuthology.misc.health.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:23:46.498 INFO:teuthology.misc.health.trial005.stderr:last_changed 0.000000 2026-02-17T21:23:46.498 INFO:teuthology.misc.health.trial005.stderr:created 0.000000 2026-02-17T21:23:46.498 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:46.498 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:23:46.498 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:23:46.499 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:23:46.499 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:23:46.499 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:23:46.499 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.485+0000 7f27bac05640 1 librados: starting msgr at 2026-02-17T21:23:46.499 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.485+0000 7f27bac05640 1 librados: starting objecter 2026-02-17T21:23:46.499 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.485+0000 7f27bac05640 1 Processor -- start 2026-02-17T21:23:46.499 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.485+0000 7f27bac05640 1 -- start start 2026-02-17T21:23:46.499 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.485+0000 7f27bac05640 1 librados: setting wanted keys 2026-02-17T21:23:46.499 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.485+0000 7f27bac05640 1 librados: calling monclient init 2026-02-17T21:23:46.499 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.485+0000 7f27bac05640 10 monclient: init 2026-02-17T21:23:46.499 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.485+0000 7f27bac05640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:46.499 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.485+0000 7f27bac05640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:23:46.499 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.485+0000 7f27bac05640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f27b40c6aa0 0x7f27b406fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:46.500 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.485+0000 7f27bac05640 10 monclient(hunting): picked mon.noname-a con 0x7f27b40c6aa0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:23:46.500 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.485+0000 7f27bac05640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f27b40c7e30 0x7f27b41410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:46.500 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.485+0000 7f27bac05640 10 monclient(hunting): picked mon.noname-c con 0x7f27b40c7e30 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:23:46.500 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.485+0000 7f27bac05640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f27b415c2c0 0x7f27b40cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:46.500 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.485+0000 7f27bac05640 10 monclient(hunting): picked mon.noname-b con 0x7f27b415c2c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:23:46.500 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.485+0000 7f27bac05640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:46.500 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.485+0000 7f27bac05640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f27b40c82a0 con 0x7f27b40c6aa0 2026-02-17T21:23:46.500 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.485+0000 7f27bac05640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:46.500 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.485+0000 7f27bac05640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f27b40c7850 con 0x7f27b415c2c0 2026-02-17T21:23:46.500 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27bac05640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:46.500 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27bac05640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f27b40c8420 con 0x7f27b40c7e30 2026-02-17T21:23:46.500 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27bac05640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:46.501 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27bac05640 10 monclient(hunting): authenticate will time out at 932.052005s 2026-02-17T21:23:46.501 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27abfff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f27b40c7e30 0x7f27b41410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:46.501 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27b917b640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f27b415c2c0 0x7f27b40cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:46.501 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27b897a640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f27b40c6aa0 0x7f27b406fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:46.501 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27abfff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f27b40c7e30 0x7f27b41410b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:49462/0 (socket says 10.20.193.5:49462) 2026-02-17T21:23:46.501 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27abfff640 1 -- 10.20.193.5:0/1327810739 learned_addr learned my addr 10.20.193.5:0/1327810739 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:23:46.501 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27abfff640 10 monclient(hunting): get_auth_request con 0x7f27b40c7e30 auth_method 0 2026-02-17T21:23:46.501 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27abfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:46.501 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27abfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:46.501 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:46.501 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27b917b640 10 monclient(hunting): get_auth_request con 0x7f27b415c2c0 auth_method 0 2026-02-17T21:23:46.501 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27b917b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:46.502 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27b917b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:46.502 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27b917b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:46.502 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27b897a640 10 monclient(hunting): get_auth_request con 0x7f27b40c6aa0 auth_method 0 2026-02-17T21:23:46.502 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27b897a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:46.502 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27b897a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:46.502 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27b897a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:46.502 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27abfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:46.502 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27abfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:46.502 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27abfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:46.502 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27b917b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:46.502 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27b917b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:46.502 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.486+0000 7f27b917b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:46.502 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.487+0000 7f27b897a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:46.503 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.487+0000 7f27b897a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:46.503 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.487+0000 7f27b897a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:46.503 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.488+0000 7f27abfff640 10 monclient(hunting): handle_auth_done global_id 4211 payload 824 2026-02-17T21:23:46.503 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.488+0000 7f27abfff640 1 -- 10.20.193.5:0/1327810739 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f27b415c2c0 msgr2=0x7f27b40cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:46.503 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.488+0000 7f27abfff640 1 --2- 10.20.193.5:0/1327810739 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f27b415c2c0 0x7f27b40cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:46.503 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.488+0000 7f27abfff640 1 -- 10.20.193.5:0/1327810739 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f27b40c6aa0 msgr2=0x7f27b406fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:46.503 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.488+0000 7f27abfff640 1 --2- 10.20.193.5:0/1327810739 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f27b40c6aa0 0x7f27b406fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:46.503 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.488+0000 7f27abfff640 10 monclient: _finish_hunting 0 2026-02-17T21:23:46.503 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.488+0000 7f27abfff640 1 monclient: found mon.noname-c 2026-02-17T21:23:46.503 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.488+0000 7f27abfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:46.503 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.488+0000 7f27abfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:23:46.503 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.488+0000 7f27abfff640 1 -- 10.20.193.5:0/1327810739 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b4143010 con 0x7f27b40c7e30 2026-02-17T21:23:46.503 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.489+0000 7f27abfff640 1 --2- 10.20.193.5:0/1327810739 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f27b40c7e30 0x7f27b41410b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f279c00c730 tx=0x7f279c00cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:46.504 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.489+0000 7f27a97fa640 10 client.?.objecter ms_handle_connect 0x7f27b40c7e30 2026-02-17T21:23:46.504 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.489+0000 7f27a97fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:23:46.504 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.490+0000 7f27a97fa640 1 -- 10.20.193.5:0/1327810739 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c017070 con 0x7f27b40c7e30 2026-02-17T21:23:46.504 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.490+0000 7f27a97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:46.504 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.490+0000 7f27a97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:23:46.504 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.490+0000 7f27a97fa640 10 monclient: dump: 2026-02-17T21:23:46.504 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:23:46.504 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:46.504 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:46.504 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:46.504 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:46.504 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:23:46.505 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:46.505 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:46.505 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:46.505 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:23:46.505 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.490+0000 7f27a97fa640 10 monclient: _finish_auth 0 2026-02-17T21:23:46.505 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.490+0000 7f27a97fa640 10 monclient: _check_auth_tickets 2026-02-17T21:23:46.505 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.490+0000 7f27a97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:46.505 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.490+0000 7f27bac05640 5 monclient: authenticate success, global_id 4211 2026-02-17T21:23:46.505 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.490+0000 7f27bac05640 10 monclient: _renew_subs 2026-02-17T21:23:46.505 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.490+0000 7f27bac05640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:46.505 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.490+0000 7f27bac05640 1 -- 10.20.193.5:0/1327810739 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27b41432f0 con 0x7f27b40c7e30 2026-02-17T21:23:46.505 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.490+0000 7f27bac05640 10 client.4211.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:23:46.505 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.490+0000 7f27bac05640 10 monclient: _renew_subs 2026-02-17T21:23:46.506 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.490+0000 7f27bac05640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:46.506 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.490+0000 7f27bac05640 1 -- 10.20.193.5:0/1327810739 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27b41438b0 con 0x7f27b40c7e30 2026-02-17T21:23:46.506 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.490+0000 7f27bac05640 1 librados: init done 2026-02-17T21:23:46.506 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.491+0000 7f27a97fa640 1 -- 10.20.193.5:0/1327810739 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f279c005b70 con 0x7f27b40c7e30 2026-02-17T21:23:46.506 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.491+0000 7f27a97fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:46.506 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.491+0000 7f27a97fa640 1 -- 10.20.193.5:0/1327810739 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c021060 con 0x7f27b40c7e30 2026-02-17T21:23:46.506 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.491+0000 7f27a97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:46.506 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.491+0000 7f27aaffd640 4 set_mon_vals no callback set 2026-02-17T21:23:46.506 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.491+0000 7f27a97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:23:46.506 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.491+0000 7f27a97fa640 10 monclient: dump: 2026-02-17T21:23:46.506 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:23:46.506 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:46.507 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:46.507 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:46.507 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:46.507 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:23:46.507 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:46.507 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:46.507 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:46.507 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:23:46.507 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.491+0000 7f27bac05640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:46.507 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.491+0000 7f27bac05640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:46.507 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.491+0000 7f27bac05640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:46.507 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.491+0000 7f27bac05640 1 -- 10.20.193.5:0/1327810739 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27b415c6a0 con 0x7f27b40c7e30 2026-02-17T21:23:46.581 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.579+0000 7f27a97fa640 1 -- 10.20.193.5:0/1327810739 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 6) ==== 100189+0+0 (secure 0 0 0) 0x7f279c024080 con 0x7f27b40c7e30 2026-02-17T21:23:46.582 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.579+0000 7f27a97fa640 1 --2- 10.20.193.5:0/1327810739 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f27840791f0 0x7f278407b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:46.582 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.580+0000 7f27b897a640 1 --2- 10.20.193.5:0/1327810739 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f27840791f0 0x7f278407b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:46.582 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.580+0000 7f27b897a640 10 monclient: get_auth_request con 0x7f27840791f0 auth_method 0 2026-02-17T21:23:46.582 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.580+0000 7f27a97fa640 10 client.4211.objecter ms_handle_connect 0x7f27840791f0 2026-02-17T21:23:46.583 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.580+0000 7f27b897a640 1 --2- 10.20.193.5:0/1327810739 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f27840791f0 0x7f278407b6b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f27a4039000 tx=0x7f27a4033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:46.602 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.599+0000 7f27a97fa640 1 -- 10.20.193.5:0/1327810739 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 2565+0+0 (secure 0 0 0) 0x7f279c05d840 con 0x7f27b40c7e30 2026-02-17T21:23:46.602 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.599+0000 7f27a97fa640 10 client.4211.objecter ms_dispatch2 0x7f27b4000b90 osd_map(19..19 src has 1..19) 2026-02-17T21:23:46.602 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.599+0000 7f27a97fa640 3 client.4211.objecter handle_osd_map got epochs [19,19] > 0 2026-02-17T21:23:46.602 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.599+0000 7f27a97fa640 3 client.4211.objecter handle_osd_map decoding full epoch 19 2026-02-17T21:23:46.602 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.599+0000 7f27a97fa640 20 client.4211.objecter dump_active .. 0 homeless 2026-02-17T21:23:46.609 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.607+0000 7f27a97fa640 1 -- 10.20.193.5:0/1327810739 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f279c061800 con 0x7f27b40c7e30 2026-02-17T21:23:46.609 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.607+0000 7f27a97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:46.609 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.607+0000 7f27a97fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:23:46.700 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.697+0000 7f27bac05640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:23:46.700 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.697+0000 7f27bac05640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:23:46.700 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.697+0000 7f27bac05640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:23:46.700 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.697+0000 7f27bac05640 1 -- 10.20.193.5:0/1327810739 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f27b415b6b0 con 0x7f27b40c7e30 2026-02-17T21:23:46.711 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.709+0000 7f27a97fa640 1 -- 10.20.193.5:0/1327810739 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12879 (secure 0 0 0) 0x7f279c065b00 con 0x7f27b40c7e30 2026-02-17T21:23:46.711 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.709+0000 7f27a97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:23:46.711 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.709+0000 7f27a97fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:23:46.712 INFO:teuthology.misc.health.trial005.stdout: 2026-02-17T21:23:46.712 INFO:teuthology.misc.health.trial005.stdout:{"epoch":19,"fsid":"b1be373b-56c5-4b5b-a965-9bcc20042691","created":"2026-02-17T21:23:38.622021+0000","modified":"2026-02-17T21:23:44.366223+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:23:44.366223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8bffc5e9-1f92-4603-bf29-ce19225edc1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8ffdf919-2ec4-4c1f-a69f-aee5cea211e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d186244a-4bf7-416d-b6a0-0e0f5af50eb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"093b417e-53bf-4b60-a937-7c5ffee43e1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0a48e684-05b0-41b1-a553-022424011225","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d73b7c38-cef9-4993-b353-908c1d87603c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f7774c25-72e8-41b2-8634-517af7a213b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"30a68802-afce-499b-90ce-bd568bc69406","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"8b4a2001-3ac8-4756-9dcf-af38c6d12d44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"dfdfee67-eff6-4413-bd7a-adc0a019bfbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"fc24ee77-5a0d-41d4-88f5-8d03a77c7608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"1d737681-1923-453a-82f8-516eeb875559","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"c4f0322e-a862-4c5e-967e-4551087ede8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"0b5e9861-a194-4f11-a849-d8bb94ce95a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"6f182077-0c0d-481c-97b4-43ef48aa5aea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"537605ff-bedd-4f2b-922f-e2eaa8c17f48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:23:46.715 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.712+0000 7f27bac05640 10 librados: watch_flush enter 2026-02-17T21:23:46.715 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.712+0000 7f27bac05640 10 librados: watch_flush exit 2026-02-17T21:23:46.715 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.712+0000 7f27bac05640 20 client.4211.objecter shutdown clearing up homeless session... 2026-02-17T21:23:46.715 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.712+0000 7f27bac05640 10 client.4211.objecter successfully canceled tick 2026-02-17T21:23:46.715 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.712+0000 7f27bac05640 1 -- 10.20.193.5:0/1327810739 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f27840791f0 msgr2=0x7f278407b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:46.715 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.712+0000 7f27bac05640 1 --2- 10.20.193.5:0/1327810739 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f27840791f0 0x7f278407b6b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f27a4039000 tx=0x7f27a4033000 comp rx=0 tx=0).stop 2026-02-17T21:23:46.715 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.712+0000 7f27bac05640 10 monclient: shutdown 2026-02-17T21:23:46.716 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.712+0000 7f27bac05640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:46.716 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.712+0000 7f27bac05640 1 -- 10.20.193.5:0/1327810739 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f27b40c7e30 msgr2=0x7f27b41410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:46.716 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.712+0000 7f27bac05640 1 --2- 10.20.193.5:0/1327810739 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f27b40c7e30 0x7f27b41410b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f279c00c730 tx=0x7f279c00cc00 comp rx=0 tx=0).stop 2026-02-17T21:23:46.716 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.712+0000 7f27bac05640 1 -- 10.20.193.5:0/1327810739 shutdown_connections 2026-02-17T21:23:46.716 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.712+0000 7f27bac05640 1 --2- 10.20.193.5:0/1327810739 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f27840791f0 0x7f278407b6b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:46.716 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.712+0000 7f27bac05640 1 --2- 10.20.193.5:0/1327810739 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f27b415c2c0 0x7f27b40cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:46.716 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.712+0000 7f27bac05640 1 --2- 10.20.193.5:0/1327810739 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f27b40c7e30 0x7f27b41410b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:46.716 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.712+0000 7f27bac05640 1 --2- 10.20.193.5:0/1327810739 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f27b40c6aa0 0x7f27b406fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:46.716 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.712+0000 7f27bac05640 1 -- 10.20.193.5:0/1327810739 >> 10.20.193.5:0/1327810739 conn(0x7f27b40c9f30 msgr2=0x7f27b40c5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:46.716 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.712+0000 7f27bac05640 1 -- 10.20.193.5:0/1327810739 shutdown_connections 2026-02-17T21:23:46.717 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.712+0000 7f27bac05640 1 -- 10.20.193.5:0/1327810739 wait complete. 2026-02-17T21:23:46.717 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:46.712+0000 7f27bac05640 1 librados: shutdown 2026-02-17T21:23:46.722 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T21:23:54.336 DEBUG:teuthology.orchestra.run.trial005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:23:54.398 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.395+0000 7f942d3b3640 10 monclient: get_monmap_and_config 2026-02-17T21:23:54.398 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.395+0000 7f942d3b3640 10 monclient: build_initial_monmap 2026-02-17T21:23:54.398 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.395+0000 7f942d3b3640 10 monclient: monmap: 2026-02-17T21:23:54.398 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:23:54.398 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:54.398 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:23:54.397498+0000 2026-02-17T21:23:54.398 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:23:54.397498+0000 2026-02-17T21:23:54.399 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:54.399 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:23:54.399 INFO:teuthology.misc.health.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:23:54.399 INFO:teuthology.misc.health.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:23:54.399 INFO:teuthology.misc.health.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:23:54.399 INFO:teuthology.misc.health.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:23:54.399 INFO:teuthology.misc.health.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:23:54.399 INFO:teuthology.misc.health.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:23:54.399 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:23:54.402 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.396+0000 7f942d3b3640 1 Processor -- start 2026-02-17T21:23:54.402 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.396+0000 7f942d3b3640 1 -- start start 2026-02-17T21:23:54.402 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.396+0000 7f942d3b3640 10 monclient: init 2026-02-17T21:23:54.403 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.396+0000 7f942d3b3640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:54.403 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.396+0000 7f942d3b3640 10 monclient: _add_conns ranks=[4,3,1,0,5,2] 2026-02-17T21:23:54.403 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.396+0000 7f942d3b3640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f94281504c0 0x7f94280c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:54.403 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.396+0000 7f942d3b3640 10 monclient(hunting): picked mon.noname-b con 0x7f94281504c0 addr v2:10.20.193.119:3300/0 2026-02-17T21:23:54.403 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.396+0000 7f942d3b3640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f94280c7120 0x7f94280c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:54.403 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.396+0000 7f942d3b3640 10 monclient(hunting): picked mon.noname-a con 0x7f94280c7120 addr v2:10.20.193.5:3300/0 2026-02-17T21:23:54.403 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.396+0000 7f942d3b3640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f94280c9050 addr v1:10.20.193.119:6789/0 2026-02-17T21:23:54.403 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.396+0000 7f942d3b3640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f942815def0 con 0x7f94280c9050 2026-02-17T21:23:54.403 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.396+0000 7f942d3b3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:54.403 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.396+0000 7f942d3b3640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f94280c5c70 con 0x7f94280c7120 2026-02-17T21:23:54.403 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.396+0000 7f942d3b3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:54.404 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.396+0000 7f942d3b3640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f94280c7fb0 con 0x7f94281504c0 2026-02-17T21:23:54.404 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.396+0000 7f942d3b3640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:54.404 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.396+0000 7f942d3b3640 10 monclient(hunting): authenticate will time out at 939.962865s 2026-02-17T21:23:54.404 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.397+0000 7f9426ffd640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f94281504c0 0x7f94280c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:54.404 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.397+0000 7f94267fc640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f94280c7120 0x7f94280c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:54.404 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.397+0000 7f94267fc640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f94280c7120 0x7f94280c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:46676/0 (socket says 10.20.193.5:46676) 2026-02-17T21:23:54.404 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.397+0000 7f94267fc640 1 -- 10.20.193.5:0/172677409 learned_addr learned my addr 10.20.193.5:0/172677409 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:23:54.404 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.397+0000 7f94267fc640 10 monclient(hunting): get_auth_request con 0x7f94280c7120 auth_method 0 2026-02-17T21:23:54.404 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.397+0000 7f94267fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:54.404 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.397+0000 7f94267fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:54.405 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.397+0000 7f94267fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:54.405 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.397+0000 7f9426ffd640 10 monclient(hunting): get_auth_request con 0x7f94281504c0 auth_method 0 2026-02-17T21:23:54.405 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.397+0000 7f9426ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:54.405 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.397+0000 7f9426ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:54.405 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.397+0000 7f9426ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:54.405 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.397+0000 7f94267fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:54.405 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.397+0000 7f94267fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:54.405 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.397+0000 7f94267fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:54.405 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.398+0000 7f9426ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:54.405 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.398+0000 7f9426ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:54.405 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.398+0000 7f9426ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:54.405 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.399+0000 7f94267fc640 10 monclient(hunting): handle_auth_done global_id 4191 payload 274 2026-02-17T21:23:54.406 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.399+0000 7f94267fc640 1 -- 10.20.193.5:0/172677409 >> v2:10.20.193.119:3300/0 conn(0x7f94281504c0 msgr2=0x7f94280c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:23:54.406 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.399+0000 7f94267fc640 1 --2- 10.20.193.5:0/172677409 >> v2:10.20.193.119:3300/0 conn(0x7f94281504c0 0x7f94280c52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:54.406 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.399+0000 7f94267fc640 1 -- 10.20.193.5:0/172677409 >> v1:10.20.193.119:6789/0 conn(0x7f94280c9050 legacy=0x7f942815d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:54.406 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.399+0000 7f94267fc640 10 monclient: _finish_hunting 0 2026-02-17T21:23:54.406 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.399+0000 7f94267fc640 1 monclient: found mon.noname-a 2026-02-17T21:23:54.406 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.399+0000 7f94267fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:54.406 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.399+0000 7f94267fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:23:54.406 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.399+0000 7f94267fc640 1 -- 10.20.193.5:0/172677409 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94280c8290 con 0x7f94280c7120 2026-02-17T21:23:54.406 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.400+0000 7f94267fc640 1 --2- 10.20.193.5:0/172677409 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f94280c7120 0x7f94280c7550 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9428072320 tx=0x7f941002efe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce718a8d46bbd9a7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:54.412 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.401+0000 7f9425ffb640 1 -- 10.20.193.5:0/172677409 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941003c070 con 0x7f94280c7120 2026-02-17T21:23:54.413 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.401+0000 7f9425ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:54.413 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.401+0000 7f9425ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:23:54.413 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.401+0000 7f9425ffb640 10 monclient: dump: 2026-02-17T21:23:54.413 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:23:54.413 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:54.413 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:54.413 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:54.413 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:54.413 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:23:54.413 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:54.414 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:54.414 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:54.414 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:23:54.414 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.401+0000 7f9425ffb640 10 monclient: _finish_auth 0 2026-02-17T21:23:54.414 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.401+0000 7f9425ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:23:54.414 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.401+0000 7f9425ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:54.414 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.401+0000 7f942d3b3640 5 monclient: authenticate success, global_id 4191 2026-02-17T21:23:54.414 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.401+0000 7f942d3b3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:23:54.414 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.402+0000 7f9425ffb640 1 -- 10.20.193.5:0/172677409 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f941002fcf0 con 0x7f94280c7120 2026-02-17T21:23:54.414 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.402+0000 7f9425ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:54.414 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.402+0000 7f9425ffb640 1 -- 10.20.193.5:0/172677409 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9410037660 con 0x7f94280c7120 2026-02-17T21:23:54.415 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.402+0000 7f9425ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:54.415 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.402+0000 7f9425ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:23:54.415 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.402+0000 7f9425ffb640 10 monclient: dump: 2026-02-17T21:23:54.415 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:23:54.415 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:54.415 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:54.415 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:54.415 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:54.415 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:23:54.415 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:54.415 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:54.415 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:54.416 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:23:54.416 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.402+0000 7f942d3b3640 10 monclient: get_monmap_and_config success 2026-02-17T21:23:54.416 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.402+0000 7f942d3b3640 4 set_mon_vals no callback set 2026-02-17T21:23:54.416 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.402+0000 7f942d3b3640 10 monclient: shutdown 2026-02-17T21:23:54.416 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.402+0000 7f942d3b3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:54.416 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.402+0000 7f942d3b3640 1 -- 10.20.193.5:0/172677409 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f94280c7120 msgr2=0x7f94280c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:54.416 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.402+0000 7f942d3b3640 1 --2- 10.20.193.5:0/172677409 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f94280c7120 0x7f94280c7550 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9428072320 tx=0x7f941002efe0 comp rx=0 tx=0).stop 2026-02-17T21:23:54.416 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.402+0000 7f942d3b3640 1 -- 10.20.193.5:0/172677409 shutdown_connections 2026-02-17T21:23:54.416 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.402+0000 7f942d3b3640 1 --2- 10.20.193.5:0/172677409 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f94280c7120 0x7f94280c7550 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:54.416 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.402+0000 7f942d3b3640 1 --2- 10.20.193.5:0/172677409 >> v2:10.20.193.119:3300/0 conn(0x7f94281504c0 0x7f94280c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:54.416 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.402+0000 7f942d3b3640 1 -- 10.20.193.5:0/172677409 >> 10.20.193.5:0/172677409 conn(0x7f94280c9f30 msgr2=0x7f94280ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:54.416 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.402+0000 7f942d3b3640 1 -- 10.20.193.5:0/172677409 shutdown_connections 2026-02-17T21:23:54.417 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.402+0000 7f942d3b3640 1 -- 10.20.193.5:0/172677409 wait complete. 2026-02-17T21:23:54.417 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.402+0000 7f942d3b3640 10 monclient: build_initial_monmap 2026-02-17T21:23:54.417 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.402+0000 7f942d3b3640 10 monclient: monmap: 2026-02-17T21:23:54.417 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:23:54.417 INFO:teuthology.misc.health.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:23:54.417 INFO:teuthology.misc.health.trial005.stderr:last_changed 0.000000 2026-02-17T21:23:54.417 INFO:teuthology.misc.health.trial005.stderr:created 0.000000 2026-02-17T21:23:54.417 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:23:54.417 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:23:54.417 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:23:54.417 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:23:54.417 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:23:54.417 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:23:54.418 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.403+0000 7f942d3b3640 1 librados: starting msgr at 2026-02-17T21:23:54.418 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.403+0000 7f942d3b3640 1 librados: starting objecter 2026-02-17T21:23:54.418 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.403+0000 7f942d3b3640 1 Processor -- start 2026-02-17T21:23:54.418 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.403+0000 7f942d3b3640 1 -- start start 2026-02-17T21:23:54.418 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.403+0000 7f942d3b3640 1 librados: setting wanted keys 2026-02-17T21:23:54.418 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.403+0000 7f942d3b3640 1 librados: calling monclient init 2026-02-17T21:23:54.418 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.403+0000 7f942d3b3640 10 monclient: init 2026-02-17T21:23:54.418 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.403+0000 7f942d3b3640 10 monclient: _reopen_session rank -1 2026-02-17T21:23:54.418 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.403+0000 7f942d3b3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:23:54.418 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.403+0000 7f942d3b3640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f94280c7120 0x7f942814a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:54.418 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.403+0000 7f942d3b3640 10 monclient(hunting): picked mon.noname-b con 0x7f94280c7120 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:23:54.418 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.403+0000 7f942d3b3640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f94280c9050 0x7f942813ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:54.419 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.403+0000 7f942d3b3640 10 monclient(hunting): picked mon.noname-c con 0x7f94280c9050 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:23:54.419 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.403+0000 7f942d3b3640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f94281504c0 0x7f94281f7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:54.419 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.403+0000 7f942d3b3640 10 monclient(hunting): picked mon.noname-a con 0x7f94281504c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:23:54.419 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.403+0000 7f942d3b3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:54.419 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.403+0000 7f942d3b3640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f94280c8b30 con 0x7f94281504c0 2026-02-17T21:23:54.419 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.403+0000 7f942d3b3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:54.419 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.403+0000 7f942d3b3640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f94280c8850 con 0x7f94280c7120 2026-02-17T21:23:54.419 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.403+0000 7f942d3b3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:23:54.419 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.403+0000 7f942d3b3640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f94281508a0 con 0x7f94280c9050 2026-02-17T21:23:54.419 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.403+0000 7f942d3b3640 10 monclient(hunting): _renew_subs 2026-02-17T21:23:54.419 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.403+0000 7f942d3b3640 10 monclient(hunting): authenticate will time out at 939.969816s 2026-02-17T21:23:54.419 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.404+0000 7f94277fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f94281504c0 0x7f94281f7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:54.420 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.404+0000 7f9426ffd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f94280c7120 0x7f942814a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:54.420 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.404+0000 7f94277fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f94281504c0 0x7f94281f7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:46680/0 (socket says 10.20.193.5:46680) 2026-02-17T21:23:54.420 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.404+0000 7f94277fe640 1 -- 10.20.193.5:0/1057818365 learned_addr learned my addr 10.20.193.5:0/1057818365 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:23:54.420 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.404+0000 7f94277fe640 10 monclient(hunting): get_auth_request con 0x7f94281504c0 auth_method 0 2026-02-17T21:23:54.420 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.404+0000 7f94277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:54.420 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.404+0000 7f94277fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:54.420 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.404+0000 7f94277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:54.420 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.404+0000 7f9426ffd640 10 monclient(hunting): get_auth_request con 0x7f94280c7120 auth_method 0 2026-02-17T21:23:54.420 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.404+0000 7f9426ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:54.420 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.404+0000 7f9426ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:54.420 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.404+0000 7f9426ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:54.421 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.404+0000 7f94267fc640 1 --2- 10.20.193.5:0/1057818365 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f94280c9050 0x7f942813ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:54.421 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.404+0000 7f94277fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:54.421 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.404+0000 7f94277fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:54.421 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.404+0000 7f94277fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:54.421 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.404+0000 7f9426ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:54.421 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.404+0000 7f9426ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:54.421 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.404+0000 7f9426ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:54.421 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.404+0000 7f94267fc640 10 monclient(hunting): get_auth_request con 0x7f94280c9050 auth_method 0 2026-02-17T21:23:54.421 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.404+0000 7f94267fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:23:54.421 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.404+0000 7f94267fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:23:54.421 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.404+0000 7f94267fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:23:54.421 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.405+0000 7f94267fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:23:54.421 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.405+0000 7f94267fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:23:54.422 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.405+0000 7f94267fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:23:54.422 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.406+0000 7f94277fe640 10 monclient(hunting): handle_auth_done global_id 4194 payload 824 2026-02-17T21:23:54.422 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.406+0000 7f94277fe640 1 -- 10.20.193.5:0/1057818365 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f94280c9050 msgr2=0x7f942813ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:54.422 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.406+0000 7f94277fe640 1 --2- 10.20.193.5:0/1057818365 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f94280c9050 0x7f942813ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:54.422 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.406+0000 7f94277fe640 1 -- 10.20.193.5:0/1057818365 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f94280c7120 msgr2=0x7f942814a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:54.422 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.406+0000 7f94277fe640 1 --2- 10.20.193.5:0/1057818365 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f94280c7120 0x7f942814a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:54.422 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.406+0000 7f94277fe640 10 monclient: _finish_hunting 0 2026-02-17T21:23:54.422 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.406+0000 7f94277fe640 1 monclient: found mon.noname-a 2026-02-17T21:23:54.422 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.406+0000 7f94277fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:23:54.422 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.406+0000 7f94277fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:23:54.422 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.406+0000 7f94277fe640 1 -- 10.20.193.5:0/1057818365 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9428149630 con 0x7f94281504c0 2026-02-17T21:23:54.422 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.407+0000 7f94277fe640 1 --2- 10.20.193.5:0/1057818365 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f94281504c0 0x7f94281f7230 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f941800cb70 tx=0x7f941800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:54.423 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.407+0000 7f94077fe640 10 client.?.objecter ms_handle_connect 0x7f94281504c0 2026-02-17T21:23:54.423 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.407+0000 7f94077fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:23:54.423 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.408+0000 7f94077fe640 1 -- 10.20.193.5:0/1057818365 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941800ad50 con 0x7f94281504c0 2026-02-17T21:23:54.423 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.408+0000 7f94077fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:54.423 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.408+0000 7f94077fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:23:54.423 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.408+0000 7f94077fe640 10 monclient: dump: 2026-02-17T21:23:54.423 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:23:54.423 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:54.423 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:54.423 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:54.423 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:54.424 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:23:54.424 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:54.424 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:54.424 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:54.424 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:23:54.424 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.408+0000 7f94077fe640 10 monclient: _finish_auth 0 2026-02-17T21:23:54.424 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.408+0000 7f94077fe640 10 monclient: _check_auth_tickets 2026-02-17T21:23:54.424 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.408+0000 7f94077fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:23:54.424 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.408+0000 7f94077fe640 1 -- 10.20.193.5:0/1057818365 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9418003a70 con 0x7f94281504c0 2026-02-17T21:23:54.424 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.408+0000 7f94077fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:23:54.424 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.408+0000 7f94077fe640 1 -- 10.20.193.5:0/1057818365 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9418003e60 con 0x7f94281504c0 2026-02-17T21:23:54.424 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.408+0000 7f94077fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:23:54.425 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.408+0000 7f94077fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:23:54.425 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.408+0000 7f94077fe640 10 monclient: dump: 2026-02-17T21:23:54.425 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:23:54.425 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:23:54.425 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:54.425 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:23:54.425 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:23:54.425 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:23:54.425 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:23:54.425 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:23:54.425 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:23:54.425 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:23:54.425 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.408+0000 7f94257fa640 4 set_mon_vals no callback set 2026-02-17T21:23:54.426 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.408+0000 7f942d3b3640 5 monclient: authenticate success, global_id 4194 2026-02-17T21:23:54.426 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.408+0000 7f942d3b3640 10 monclient: _renew_subs 2026-02-17T21:23:54.426 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.408+0000 7f942d3b3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:23:54.426 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.408+0000 7f942d3b3640 1 -- 10.20.193.5:0/1057818365 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9428149910 con 0x7f94281504c0 2026-02-17T21:23:54.426 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.408+0000 7f942d3b3640 10 client.4194.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:23:54.426 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.408+0000 7f942d3b3640 10 monclient: _renew_subs 2026-02-17T21:23:54.426 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.408+0000 7f942d3b3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:23:54.426 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.408+0000 7f942d3b3640 1 -- 10.20.193.5:0/1057818365 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9428149ed0 con 0x7f94281504c0 2026-02-17T21:23:54.426 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.408+0000 7f942d3b3640 1 librados: init done 2026-02-17T21:23:54.426 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.409+0000 7f942d3b3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:54.426 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.409+0000 7f942d3b3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:54.426 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.409+0000 7f942d3b3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:23:54.427 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.409+0000 7f942d3b3640 1 -- 10.20.193.5:0/1057818365 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94280c7550 con 0x7f94281504c0 2026-02-17T21:23:54.428 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.421+0000 7f94077fe640 1 -- 10.20.193.5:0/1057818365 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 6) ==== 100189+0+0 (secure 0 0 0) 0x7f94180050d0 con 0x7f94281504c0 2026-02-17T21:23:54.428 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.421+0000 7f94077fe640 1 --2- 10.20.193.5:0/1057818365 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f93f40791f0 0x7f93f407b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:54.428 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.421+0000 7f9426ffd640 1 --2- 10.20.193.5:0/1057818365 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f93f40791f0 0x7f93f407b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:54.428 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.421+0000 7f9426ffd640 10 monclient: get_auth_request con 0x7f93f40791f0 auth_method 0 2026-02-17T21:23:54.428 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.421+0000 7f94077fe640 1 -- 10.20.193.5:0/1057818365 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 2565+0+0 (secure 0 0 0) 0x7f941805e9f0 con 0x7f94281504c0 2026-02-17T21:23:54.428 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.421+0000 7f94077fe640 10 client.4194.objecter ms_dispatch2 0x7f9428000b90 osd_map(19..19 src has 1..19) 2026-02-17T21:23:54.428 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.421+0000 7f94077fe640 3 client.4194.objecter handle_osd_map got epochs [19,19] > 0 2026-02-17T21:23:54.429 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.421+0000 7f94077fe640 3 client.4194.objecter handle_osd_map decoding full epoch 19 2026-02-17T21:23:54.429 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.422+0000 7f94077fe640 20 client.4194.objecter dump_active .. 0 homeless 2026-02-17T21:23:54.429 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.422+0000 7f94077fe640 10 client.4194.objecter ms_handle_connect 0x7f93f40791f0 2026-02-17T21:23:54.429 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.422+0000 7f9426ffd640 1 --2- 10.20.193.5:0/1057818365 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f93f40791f0 0x7f93f407b6b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f941c009c40 tx=0x7f941c009290 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:54.462 INFO:tasks.ceph.osd.4.trial005.stderr:--00:00:00:09.999 26913-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:23:54.519 INFO:tasks.ceph.osd.1.trial119.stderr:--00:00:00:09.970 26517-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:23:54.519 INFO:tasks.ceph.osd.9.trial119.stderr:--00:00:00:09.970 26518-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:23:54.520 INFO:tasks.ceph.osd.13.trial119.stderr:--00:00:00:09.969 26519-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:23:54.522 INFO:tasks.ceph.osd.5.trial119.stderr:--00:00:00:09.973 26516-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:23:54.528 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.526+0000 7f94077fe640 1 -- 10.20.193.5:0/1057818365 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f94180629b0 con 0x7f94281504c0 2026-02-17T21:23:54.528 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.526+0000 7f94077fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:23:54.528 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.526+0000 7f94077fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:23:54.535 INFO:tasks.ceph.osd.6.trial135.stderr:--00:00:00:09.976 26767-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:23:54.536 INFO:tasks.ceph.osd.0.trial005.stderr:--00:00:00:10.074 26912-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:23:54.536 INFO:tasks.ceph.osd.14.trial135.stderr:--00:00:00:09.977 26769-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:23:54.537 INFO:tasks.ceph.osd.10.trial135.stderr:--00:00:00:09.978 26768-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:23:54.553 INFO:tasks.ceph.osd.8.trial005.stderr:--00:00:00:10.011 26990-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:23:54.554 INFO:tasks.ceph.osd.12.trial005.stderr:--00:00:00:10.012 26989-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:23:54.569 INFO:tasks.ceph.osd.15.trial176.stderr:--00:00:00:09.997 26826-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:23:54.569 INFO:tasks.ceph.osd.11.trial176.stderr:--00:00:00:09.998 26825-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:23:54.571 INFO:tasks.ceph.osd.3.trial176.stderr:--00:00:00:10.000 26823-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:23:54.572 INFO:tasks.ceph.osd.7.trial176.stderr:--00:00:00:10.000 26824-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:23:54.630 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.628+0000 7f942d3b3640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:23:54.630 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.628+0000 7f942d3b3640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:23:54.631 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.628+0000 7f942d3b3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:23:54.631 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.628+0000 7f942d3b3640 1 -- 10.20.193.5:0/1057818365 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94280c6260 con 0x7f94281504c0 2026-02-17T21:23:54.656 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.654+0000 7f94077fe640 1 -- 10.20.193.5:0/1057818365 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12879 (secure 0 0 0) 0x7f9418066cb0 con 0x7f94281504c0 2026-02-17T21:23:54.656 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.654+0000 7f94077fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:23:54.656 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.654+0000 7f94077fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:23:54.656 INFO:teuthology.misc.health.trial005.stdout: 2026-02-17T21:23:54.657 INFO:teuthology.misc.health.trial005.stdout:{"epoch":19,"fsid":"b1be373b-56c5-4b5b-a965-9bcc20042691","created":"2026-02-17T21:23:38.622021+0000","modified":"2026-02-17T21:23:44.366223+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:23:44.366223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8bffc5e9-1f92-4603-bf29-ce19225edc1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8ffdf919-2ec4-4c1f-a69f-aee5cea211e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d186244a-4bf7-416d-b6a0-0e0f5af50eb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"093b417e-53bf-4b60-a937-7c5ffee43e1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0a48e684-05b0-41b1-a553-022424011225","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d73b7c38-cef9-4993-b353-908c1d87603c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f7774c25-72e8-41b2-8634-517af7a213b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"30a68802-afce-499b-90ce-bd568bc69406","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"8b4a2001-3ac8-4756-9dcf-af38c6d12d44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"dfdfee67-eff6-4413-bd7a-adc0a019bfbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"fc24ee77-5a0d-41d4-88f5-8d03a77c7608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"1d737681-1923-453a-82f8-516eeb875559","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"c4f0322e-a862-4c5e-967e-4551087ede8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"0b5e9861-a194-4f11-a849-d8bb94ce95a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"6f182077-0c0d-481c-97b4-43ef48aa5aea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"537605ff-bedd-4f2b-922f-e2eaa8c17f48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:23:54.659 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.656+0000 7f942d3b3640 10 librados: watch_flush enter 2026-02-17T21:23:54.659 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.656+0000 7f942d3b3640 10 librados: watch_flush exit 2026-02-17T21:23:54.659 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.656+0000 7f942d3b3640 20 client.4194.objecter shutdown clearing up homeless session... 2026-02-17T21:23:54.659 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.656+0000 7f942d3b3640 10 client.4194.objecter successfully canceled tick 2026-02-17T21:23:54.659 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.656+0000 7f942d3b3640 1 -- 10.20.193.5:0/1057818365 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f93f40791f0 msgr2=0x7f93f407b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:54.659 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.656+0000 7f942d3b3640 1 --2- 10.20.193.5:0/1057818365 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f93f40791f0 0x7f93f407b6b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f941c009c40 tx=0x7f941c009290 comp rx=0 tx=0).stop 2026-02-17T21:23:54.659 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.656+0000 7f942d3b3640 10 monclient: shutdown 2026-02-17T21:23:54.660 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.656+0000 7f942d3b3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:23:54.660 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.656+0000 7f942d3b3640 1 -- 10.20.193.5:0/1057818365 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f94281504c0 msgr2=0x7f94281f7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:54.660 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.656+0000 7f942d3b3640 1 --2- 10.20.193.5:0/1057818365 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f94281504c0 0x7f94281f7230 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f941800cb70 tx=0x7f941800a430 comp rx=0 tx=0).stop 2026-02-17T21:23:54.660 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.656+0000 7f942d3b3640 1 -- 10.20.193.5:0/1057818365 shutdown_connections 2026-02-17T21:23:54.660 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.656+0000 7f942d3b3640 1 --2- 10.20.193.5:0/1057818365 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f93f40791f0 0x7f93f407b6b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:54.660 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.656+0000 7f942d3b3640 1 --2- 10.20.193.5:0/1057818365 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f94281504c0 0x7f94281f7230 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:54.660 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.656+0000 7f942d3b3640 1 --2- 10.20.193.5:0/1057818365 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f94280c9050 0x7f942813ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:54.660 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.656+0000 7f942d3b3640 1 --2- 10.20.193.5:0/1057818365 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f94280c7120 0x7f942814a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:54.660 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.656+0000 7f942d3b3640 1 -- 10.20.193.5:0/1057818365 >> 10.20.193.5:0/1057818365 conn(0x7f94280c9f30 msgr2=0x7f94280ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:54.660 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.656+0000 7f942d3b3640 1 -- 10.20.193.5:0/1057818365 shutdown_connections 2026-02-17T21:23:54.660 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.656+0000 7f942d3b3640 1 -- 10.20.193.5:0/1057818365 wait complete. 2026-02-17T21:23:54.661 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:23:54.656+0000 7f942d3b3640 1 librados: shutdown 2026-02-17T21:23:54.667 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T21:23:54.724 INFO:tasks.ceph.osd.2.trial135.stderr:--00:00:00:10.170 26766-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:23:58.994 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:14.531 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.029 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:14.480 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.030 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:14.481 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.062 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:14.514 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.063 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:14.512 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.080 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:14.618 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.103 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:14.562 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.104 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:14.561 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.109 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:14.538 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.121 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:14.562 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.137 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:14.578 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.160 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:14.589 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.180 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:14.621 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.185 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:14.614 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.212 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:14.641 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.281 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:14.818 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.294 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:14.741 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.305 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:14.843 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.316 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:14.767 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.320 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:14.772 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.341 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:14.792 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.345 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:14.797 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.352 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:14.804 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.361 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:14.811 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.364 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:14.903 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.374 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:14.826 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.382 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:14.832 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.391 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:14.930 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.395 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:14.824 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.398 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:14.856 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.399 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:14.850 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.399 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:14.858 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.405 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:14.846 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.406 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:14.856 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.418 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:14.847 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.420 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:14.879 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.428 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:14.870 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.432 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:14.873 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.446 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:14.875 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.459 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:14.900 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.464 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:14.905 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.470 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:14.899 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.473 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:14.902 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.479 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:14.920 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.488 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:14.930 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.500 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:14.929 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.500 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:14.929 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.503 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:14.932 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.508 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:14.949 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.526 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:14.955 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.530 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:14.959 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.532 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:14.973 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.550 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:14.979 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.574 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:15.111 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.578 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:15.025 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.593 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:15.040 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.607 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:15.059 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.613 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:15.065 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.656 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:15.194 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.661 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:15.113 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.671 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:15.129 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.677 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:15.127 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.682 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:15.111 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.689 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:15.148 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.692 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:15.150 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.728 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:15.169 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.756 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:15.198 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.768 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:15.197 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.795 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:15.224 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.796 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:15.237 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.821 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:15.250 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.839 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:15.376 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.857 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:15.304 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.872 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:15.322 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.878 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:15.329 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.920 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:15.458 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.927 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:15.379 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.943 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:15.394 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.946 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:15.375 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.954 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:15.403 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.957 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:15.415 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.961 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:15.419 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.968 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:15.418 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:23:59.995 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:15.436 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.010 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:15.451 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.031 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:15.473 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.033 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:15.462 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.046 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:15.487 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.049 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:15.478 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.065 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:15.494 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.075 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:15.516 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.080 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:15.509 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.090 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:15.530 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.104 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:15.642 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.107 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:15.536 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.120 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:15.657 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.122 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:15.551 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.133 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:15.580 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.142 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:15.593 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.146 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:15.598 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.157 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:15.608 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.161 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:15.613 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.185 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:15.723 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.200 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:15.739 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.212 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:15.641 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.227 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:15.656 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.232 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:15.690 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.233 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:15.691 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.248 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:15.705 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.248 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:15.707 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.408 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:15.854 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.423 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:15.870 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:00.478 INFO:tasks.ceph.osd.1.trial119.stderr:2026-02-17T21:24:00.473+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:24:00.518 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:24:00.513+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:24:00.536 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:24:00.531+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:24:00.576 INFO:tasks.ceph.osd.11.trial176.stderr:2026-02-17T21:24:00.570+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:24:00.581 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:24:00.576+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:24:00.613 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:24:00.607+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:24:00.634 INFO:tasks.ceph.osd.14.trial135.stderr:2026-02-17T21:24:00.629+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:24:00.647 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:24:00.642+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:24:00.672 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:24:00.666+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:24:00.689 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:24:00.684+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:24:00.696 INFO:tasks.ceph.osd.5.trial119.stderr:2026-02-17T21:24:00.691+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:24:00.727 INFO:tasks.ceph.osd.0.trial005.stderr:2026-02-17T21:24:00.722+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:24:00.769 INFO:tasks.ceph.osd.7.trial176.stderr:2026-02-17T21:24:00.763+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:24:00.781 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:24:00.776+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:24:00.785 INFO:tasks.ceph.osd.12.trial005.stderr:2026-02-17T21:24:00.780+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:24:00.962 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:24:00.957+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:24:02.280 DEBUG:teuthology.orchestra.run.trial005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:24:02.342 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.340+0000 7ff4965ca640 10 monclient: get_monmap_and_config 2026-02-17T21:24:02.342 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.341+0000 7ff4965ca640 10 monclient: build_initial_monmap 2026-02-17T21:24:02.342 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.341+0000 7ff4965ca640 10 monclient: monmap: 2026-02-17T21:24:02.342 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:24:02.342 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:02.342 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:24:02.341685+0000 2026-02-17T21:24:02.342 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:24:02.341685+0000 2026-02-17T21:24:02.342 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:24:02.342 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:02.342 INFO:teuthology.misc.health.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:24:02.342 INFO:teuthology.misc.health.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:24:02.342 INFO:teuthology.misc.health.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:24:02.342 INFO:teuthology.misc.health.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:24:02.342 INFO:teuthology.misc.health.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:24:02.342 INFO:teuthology.misc.health.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:24:02.342 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:02.342 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.341+0000 7ff4965ca640 1 Processor -- start 2026-02-17T21:24:02.342 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.341+0000 7ff4965ca640 1 -- start start 2026-02-17T21:24:02.342 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.341+0000 7ff4965ca640 10 monclient: init 2026-02-17T21:24:02.343 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.342+0000 7ff4965ca640 10 monclient: _reopen_session rank -1 2026-02-17T21:24:02.343 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.342+0000 7ff4965ca640 10 monclient: _add_conns ranks=[4,2,5,3,1,0] 2026-02-17T21:24:02.343 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.342+0000 7ff4965ca640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7ff4901504c0 0x7ff4900c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:02.343 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.342+0000 7ff4965ca640 10 monclient(hunting): picked mon.noname-b con 0x7ff4901504c0 addr v2:10.20.193.119:3300/0 2026-02-17T21:24:02.343 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.342+0000 7ff4965ca640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff4900c7120 addr v1:10.20.193.135:6789/0 2026-02-17T21:24:02.343 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.342+0000 7ff4965ca640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7ff4900c7550 0x7ff49015d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:02.343 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.342+0000 7ff4965ca640 10 monclient(hunting): picked mon.noname-c con 0x7ff4900c7550 addr v2:10.20.193.135:3300/0 2026-02-17T21:24:02.343 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.342+0000 7ff4965ca640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4900c7930 con 0x7ff4900c7120 2026-02-17T21:24:02.343 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.342+0000 7ff4965ca640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:02.343 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.342+0000 7ff4965ca640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7ff4900c5c70 con 0x7ff4901504c0 2026-02-17T21:24:02.343 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.342+0000 7ff4965ca640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:02.343 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.342+0000 7ff4965ca640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff49015def0 con 0x7ff4900c7550 2026-02-17T21:24:02.343 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.342+0000 7ff4965ca640 10 monclient(hunting): _renew_subs 2026-02-17T21:24:02.343 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.342+0000 7ff4965ca640 10 monclient(hunting): authenticate will time out at 947.907091s 2026-02-17T21:24:02.344 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.342+0000 7ff48ffff640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7ff4901504c0 0x7ff4900c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:02.344 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.342+0000 7ff48f7fe640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7ff4900c7120 0x7ff4900c9050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:36554/0 (socket says 10.20.193.5:36554) 2026-02-17T21:24:02.344 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.342+0000 7ff48f7fe640 1 -- 10.20.193.5:0/491455774 learned_addr learned my addr 10.20.193.5:0/491455774 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:24:02.344 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.342+0000 7ff48ffff640 10 monclient(hunting): get_auth_request con 0x7ff4901504c0 auth_method 0 2026-02-17T21:24:02.344 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.342+0000 7ff48ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:02.344 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.342+0000 7ff48ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:02.344 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.342+0000 7ff48ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:02.344 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.343+0000 7ff494b40640 1 --2- 10.20.193.5:0/491455774 >> v2:10.20.193.135:3300/0 conn(0x7ff4900c7550 0x7ff49015d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:02.344 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.343+0000 7ff48ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:02.344 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.343+0000 7ff48ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:02.344 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.343+0000 7ff48ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:02.344 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.343+0000 7ff494b40640 10 monclient(hunting): get_auth_request con 0x7ff4900c7550 auth_method 0 2026-02-17T21:24:02.344 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.343+0000 7ff494b40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:02.344 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.343+0000 7ff494b40640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:02.344 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.343+0000 7ff494b40640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:02.345 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.344+0000 7ff48ffff640 10 monclient(hunting): handle_auth_done global_id 4279 payload 274 2026-02-17T21:24:02.345 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.344+0000 7ff48ffff640 1 -- 10.20.193.5:0/491455774 >> v2:10.20.193.135:3300/0 conn(0x7ff4900c7550 msgr2=0x7ff49015d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:24:02.345 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.344+0000 7ff48ffff640 1 --2- 10.20.193.5:0/491455774 >> v2:10.20.193.135:3300/0 conn(0x7ff4900c7550 0x7ff49015d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:02.345 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.344+0000 7ff48ffff640 1 -- 10.20.193.5:0/491455774 >> v1:10.20.193.135:6789/0 conn(0x7ff4900c7120 legacy=0x7ff4900c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:02.345 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.344+0000 7ff48ffff640 10 monclient: _finish_hunting 0 2026-02-17T21:24:02.345 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.344+0000 7ff48ffff640 1 monclient: found mon.noname-b 2026-02-17T21:24:02.345 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.344+0000 7ff48ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:24:02.345 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.344+0000 7ff48ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:24:02.345 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.344+0000 7ff48ffff640 1 -- 10.20.193.5:0/491455774 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4900c7fb0 con 0x7ff4901504c0 2026-02-17T21:24:02.346 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.345+0000 7ff48ffff640 1 --2- 10.20.193.5:0/491455774 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff4901504c0 0x7ff4900c52c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff4900c9df0 tx=0x7ff47c02ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff89be87da548391 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:24:02.348 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.347+0000 7ff48effd640 1 -- 10.20.193.5:0/491455774 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47c03c070 con 0x7ff4901504c0 2026-02-17T21:24:02.348 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.347+0000 7ff48effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:02.348 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.347+0000 7ff48effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:24:02.348 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.347+0000 7ff48effd640 10 monclient: dump: 2026-02-17T21:24:02.348 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:02.348 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:02.348 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:02.348 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:02.348 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:02.348 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:02.348 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:02.348 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:02.348 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:02.348 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:02.348 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.347+0000 7ff48effd640 10 monclient: _finish_auth 0 2026-02-17T21:24:02.348 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.347+0000 7ff48effd640 10 monclient: _check_auth_tickets 2026-02-17T21:24:02.348 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.347+0000 7ff48effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:24:02.348 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.347+0000 7ff4965ca640 5 monclient: authenticate success, global_id 4279 2026-02-17T21:24:02.348 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.347+0000 7ff4965ca640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:24:02.349 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.347+0000 7ff48effd640 1 -- 10.20.193.5:0/491455774 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff47c02fc20 con 0x7ff4901504c0 2026-02-17T21:24:02.349 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.347+0000 7ff48effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:24:02.349 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.347+0000 7ff48effd640 1 -- 10.20.193.5:0/491455774 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47c037440 con 0x7ff4901504c0 2026-02-17T21:24:02.349 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.347+0000 7ff48effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:02.349 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.347+0000 7ff48effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:24:02.349 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.347+0000 7ff48effd640 10 monclient: dump: 2026-02-17T21:24:02.349 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:02.349 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:02.349 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:02.349 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:02.349 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:02.349 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:02.349 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:02.349 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:02.349 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:02.349 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:02.349 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.347+0000 7ff4965ca640 10 monclient: get_monmap_and_config success 2026-02-17T21:24:02.349 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.347+0000 7ff4965ca640 4 set_mon_vals no callback set 2026-02-17T21:24:02.349 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.348+0000 7ff4965ca640 10 monclient: shutdown 2026-02-17T21:24:02.349 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.348+0000 7ff4965ca640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:24:02.349 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.348+0000 7ff4965ca640 1 -- 10.20.193.5:0/491455774 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff4901504c0 msgr2=0x7ff4900c52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:02.349 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.348+0000 7ff4965ca640 1 --2- 10.20.193.5:0/491455774 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff4901504c0 0x7ff4900c52c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff4900c9df0 tx=0x7ff47c02ef10 comp rx=0 tx=0).stop 2026-02-17T21:24:02.349 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.348+0000 7ff4965ca640 1 -- 10.20.193.5:0/491455774 shutdown_connections 2026-02-17T21:24:02.350 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.348+0000 7ff4965ca640 1 --2- 10.20.193.5:0/491455774 >> v2:10.20.193.135:3300/0 conn(0x7ff4900c7550 0x7ff49015d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:02.350 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.348+0000 7ff4965ca640 1 --2- 10.20.193.5:0/491455774 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff4901504c0 0x7ff4900c52c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:02.350 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.348+0000 7ff4965ca640 1 -- 10.20.193.5:0/491455774 >> 10.20.193.5:0/491455774 conn(0x7ff4900c9f30 msgr2=0x7ff4900ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:24:02.350 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.348+0000 7ff4965ca640 1 -- 10.20.193.5:0/491455774 shutdown_connections 2026-02-17T21:24:02.350 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.348+0000 7ff4965ca640 1 -- 10.20.193.5:0/491455774 wait complete. 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.348+0000 7ff4965ca640 10 monclient: build_initial_monmap 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.348+0000 7ff4965ca640 10 monclient: monmap: 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:last_changed 0.000000 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:created 0.000000 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.348+0000 7ff4965ca640 1 librados: starting msgr at 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.348+0000 7ff4965ca640 1 librados: starting objecter 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.348+0000 7ff4965ca640 1 Processor -- start 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.348+0000 7ff4965ca640 1 -- start start 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.348+0000 7ff4965ca640 1 librados: setting wanted keys 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.348+0000 7ff4965ca640 1 librados: calling monclient init 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.348+0000 7ff4965ca640 10 monclient: init 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff4965ca640 10 monclient: _reopen_session rank -1 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff4965ca640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff4965ca640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff4900c7120 0x7ff4901f2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff4965ca640 10 monclient(hunting): picked mon.noname-a con 0x7ff4900c7120 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff4965ca640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff4900c7550 0x7ff4901ef820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff4965ca640 10 monclient(hunting): picked mon.noname-c con 0x7ff4900c7550 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff4965ca640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff4901504c0 0x7ff4901efd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:02.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff4965ca640 10 monclient(hunting): picked mon.noname-b con 0x7ff4901504c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff4965ca640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff4965ca640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff4900c8850 con 0x7ff4900c7120 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff4965ca640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff4965ca640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff4900c8570 con 0x7ff4901504c0 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff4965ca640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff4965ca640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff4900c8b30 con 0x7ff4900c7550 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff4965ca640 10 monclient(hunting): _renew_subs 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff4965ca640 10 monclient(hunting): authenticate will time out at 947.914185s 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff494b40640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff4901504c0 0x7ff4901efd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff48f7fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff4900c7550 0x7ff4901ef820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff48ffff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff4900c7120 0x7ff4901f2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff494b40640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff4901504c0 0x7ff4901efd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:33484/0 (socket says 10.20.193.5:33484) 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff494b40640 1 -- 10.20.193.5:0/4132290043 learned_addr learned my addr 10.20.193.5:0/4132290043 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff494b40640 10 monclient(hunting): get_auth_request con 0x7ff4901504c0 auth_method 0 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff494b40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff494b40640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff494b40640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff48f7fe640 10 monclient(hunting): get_auth_request con 0x7ff4900c7550 auth_method 0 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff48f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff48f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff48f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff48ffff640 10 monclient(hunting): get_auth_request con 0x7ff4900c7120 auth_method 0 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff48ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff48ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.349+0000 7ff48ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.350+0000 7ff494b40640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.350+0000 7ff494b40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.350+0000 7ff494b40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.350+0000 7ff48f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.350+0000 7ff48f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.350+0000 7ff48f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.350+0000 7ff48ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.350+0000 7ff48ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:02.352 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.350+0000 7ff48ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:02.353 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.351+0000 7ff494b40640 10 monclient(hunting): handle_auth_done global_id 4282 payload 824 2026-02-17T21:24:02.353 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.351+0000 7ff494b40640 1 -- 10.20.193.5:0/4132290043 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff4900c7550 msgr2=0x7ff4901ef820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:02.353 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.351+0000 7ff494b40640 1 --2- 10.20.193.5:0/4132290043 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff4900c7550 0x7ff4901ef820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:02.353 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.351+0000 7ff494b40640 1 -- 10.20.193.5:0/4132290043 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff4900c7120 msgr2=0x7ff4901f2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:02.353 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.351+0000 7ff494b40640 1 --2- 10.20.193.5:0/4132290043 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff4900c7120 0x7ff4901f2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:02.353 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.351+0000 7ff494b40640 10 monclient: _finish_hunting 0 2026-02-17T21:24:02.353 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.351+0000 7ff494b40640 1 monclient: found mon.noname-b 2026-02-17T21:24:02.353 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.351+0000 7ff494b40640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:24:02.353 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.351+0000 7ff494b40640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:24:02.353 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.351+0000 7ff494b40640 1 -- 10.20.193.5:0/4132290043 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4901f2760 con 0x7ff4901504c0 2026-02-17T21:24:02.354 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.353+0000 7ff494b40640 1 --2- 10.20.193.5:0/4132290043 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff4901504c0 0x7ff4901efd60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff484007e40 tx=0x7ff48400e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:24:02.354 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.353+0000 7ff48cff9640 10 client.?.objecter ms_handle_connect 0x7ff4901504c0 2026-02-17T21:24:02.354 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.353+0000 7ff48cff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:24:02.355 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.354+0000 7ff48cff9640 1 -- 10.20.193.5:0/4132290043 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484014620 con 0x7ff4901504c0 2026-02-17T21:24:02.356 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.354+0000 7ff48cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:02.356 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.354+0000 7ff48cff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:24:02.356 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.354+0000 7ff48cff9640 10 monclient: dump: 2026-02-17T21:24:02.356 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:02.356 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:02.356 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:02.356 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:02.356 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:02.356 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:02.356 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:02.356 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:02.356 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:02.356 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:02.356 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.354+0000 7ff48cff9640 10 monclient: _finish_auth 0 2026-02-17T21:24:02.356 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.354+0000 7ff48cff9640 10 monclient: _check_auth_tickets 2026-02-17T21:24:02.356 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.354+0000 7ff48cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:24:02.356 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.354+0000 7ff4965ca640 5 monclient: authenticate success, global_id 4282 2026-02-17T21:24:02.356 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.354+0000 7ff4965ca640 10 monclient: _renew_subs 2026-02-17T21:24:02.356 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.354+0000 7ff4965ca640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:24:02.356 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.354+0000 7ff4965ca640 1 -- 10.20.193.5:0/4132290043 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4901f3a70 con 0x7ff4901504c0 2026-02-17T21:24:02.356 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.354+0000 7ff4965ca640 10 client.4282.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:24:02.356 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.354+0000 7ff4965ca640 10 monclient: _renew_subs 2026-02-17T21:24:02.356 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.354+0000 7ff4965ca640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:24:02.356 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.354+0000 7ff4965ca640 1 -- 10.20.193.5:0/4132290043 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4901f4030 con 0x7ff4901504c0 2026-02-17T21:24:02.356 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.354+0000 7ff4965ca640 1 librados: init done 2026-02-17T21:24:02.357 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.355+0000 7ff48cff9640 1 -- 10.20.193.5:0/4132290043 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff484019070 con 0x7ff4901504c0 2026-02-17T21:24:02.357 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.355+0000 7ff48cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:24:02.357 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.355+0000 7ff48cff9640 1 -- 10.20.193.5:0/4132290043 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4840149c0 con 0x7ff4901504c0 2026-02-17T21:24:02.357 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.355+0000 7ff48cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:02.357 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.355+0000 7ff48cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:24:02.357 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.355+0000 7ff48cff9640 10 monclient: dump: 2026-02-17T21:24:02.357 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:02.357 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:02.357 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:02.357 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:02.357 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:02.357 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:02.357 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:02.357 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:02.357 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:02.357 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:02.357 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.355+0000 7ff48e7fc640 4 set_mon_vals no callback set 2026-02-17T21:24:02.357 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.355+0000 7ff4965ca640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:24:02.357 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.355+0000 7ff4965ca640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:24:02.357 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.355+0000 7ff4965ca640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:24:02.357 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.355+0000 7ff4965ca640 1 -- 10.20.193.5:0/4132290043 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff490070a10 con 0x7ff4901504c0 2026-02-17T21:24:02.370 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.369+0000 7ff48cff9640 1 -- 10.20.193.5:0/4132290043 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 6) ==== 100189+0+0 (secure 0 0 0) 0x7ff484014b60 con 0x7ff4901504c0 2026-02-17T21:24:02.370 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.369+0000 7ff48cff9640 1 --2- 10.20.193.5:0/4132290043 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff460079220 0x7ff46007b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:02.370 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.369+0000 7ff48ffff640 1 --2- 10.20.193.5:0/4132290043 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff460079220 0x7ff46007b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:02.370 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.370+0000 7ff48ffff640 10 monclient: get_auth_request con 0x7ff460079220 auth_method 0 2026-02-17T21:24:02.371 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.370+0000 7ff48ffff640 1 --2- 10.20.193.5:0/4132290043 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff460079220 0x7ff46007b6e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff47c039000 tx=0x7ff47c033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:24:02.371 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.370+0000 7ff48cff9640 10 client.4282.objecter ms_handle_connect 0x7ff460079220 2026-02-17T21:24:02.372 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.371+0000 7ff48cff9640 1 -- 10.20.193.5:0/4132290043 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 2565+0+0 (secure 0 0 0) 0x7ff484098e00 con 0x7ff4901504c0 2026-02-17T21:24:02.372 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.371+0000 7ff48cff9640 10 client.4282.objecter ms_dispatch2 0x7ff490000b90 osd_map(19..19 src has 1..19) 2026-02-17T21:24:02.372 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.371+0000 7ff48cff9640 3 client.4282.objecter handle_osd_map got epochs [19,19] > 0 2026-02-17T21:24:02.372 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.371+0000 7ff48cff9640 3 client.4282.objecter handle_osd_map decoding full epoch 19 2026-02-17T21:24:02.372 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.371+0000 7ff48cff9640 20 client.4282.objecter dump_active .. 0 homeless 2026-02-17T21:24:02.473 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.472+0000 7ff48cff9640 1 -- 10.20.193.5:0/4132290043 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff490070a10 con 0x7ff4901504c0 2026-02-17T21:24:02.473 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.472+0000 7ff48cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:24:02.473 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.472+0000 7ff48cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:24:02.565 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.564+0000 7ff4965ca640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:24:02.566 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.564+0000 7ff4965ca640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:24:02.566 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.564+0000 7ff4965ca640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:24:02.566 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.564+0000 7ff4965ca640 1 -- 10.20.193.5:0/4132290043 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff490074c80 con 0x7ff4901504c0 2026-02-17T21:24:02.591 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.590+0000 7ff48cff9640 1 -- 10.20.193.5:0/4132290043 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12879 (secure 0 0 0) 0x7ff484063360 con 0x7ff4901504c0 2026-02-17T21:24:02.591 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.590+0000 7ff48cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:24:02.592 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.590+0000 7ff48cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:24:02.592 INFO:teuthology.misc.health.trial005.stdout: 2026-02-17T21:24:02.592 INFO:teuthology.misc.health.trial005.stdout:{"epoch":19,"fsid":"b1be373b-56c5-4b5b-a965-9bcc20042691","created":"2026-02-17T21:23:38.622021+0000","modified":"2026-02-17T21:23:44.366223+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:23:44.366223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8bffc5e9-1f92-4603-bf29-ce19225edc1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8ffdf919-2ec4-4c1f-a69f-aee5cea211e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d186244a-4bf7-416d-b6a0-0e0f5af50eb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"093b417e-53bf-4b60-a937-7c5ffee43e1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0a48e684-05b0-41b1-a553-022424011225","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d73b7c38-cef9-4993-b353-908c1d87603c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f7774c25-72e8-41b2-8634-517af7a213b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"30a68802-afce-499b-90ce-bd568bc69406","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"8b4a2001-3ac8-4756-9dcf-af38c6d12d44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"dfdfee67-eff6-4413-bd7a-adc0a019bfbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"fc24ee77-5a0d-41d4-88f5-8d03a77c7608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"1d737681-1923-453a-82f8-516eeb875559","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"c4f0322e-a862-4c5e-967e-4551087ede8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"0b5e9861-a194-4f11-a849-d8bb94ce95a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"6f182077-0c0d-481c-97b4-43ef48aa5aea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"537605ff-bedd-4f2b-922f-e2eaa8c17f48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:24:02.595 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.592+0000 7ff4965ca640 10 librados: watch_flush enter 2026-02-17T21:24:02.595 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.592+0000 7ff4965ca640 10 librados: watch_flush exit 2026-02-17T21:24:02.595 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.592+0000 7ff4965ca640 20 client.4282.objecter shutdown clearing up homeless session... 2026-02-17T21:24:02.595 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.592+0000 7ff4965ca640 10 client.4282.objecter successfully canceled tick 2026-02-17T21:24:02.595 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.593+0000 7ff4965ca640 1 -- 10.20.193.5:0/4132290043 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff460079220 msgr2=0x7ff46007b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:02.595 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.593+0000 7ff4965ca640 1 --2- 10.20.193.5:0/4132290043 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff460079220 0x7ff46007b6e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff47c039000 tx=0x7ff47c033000 comp rx=0 tx=0).stop 2026-02-17T21:24:02.595 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.593+0000 7ff4965ca640 10 monclient: shutdown 2026-02-17T21:24:02.595 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.593+0000 7ff4965ca640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:24:02.595 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.593+0000 7ff4965ca640 1 -- 10.20.193.5:0/4132290043 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff4901504c0 msgr2=0x7ff4901efd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:02.596 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.593+0000 7ff4965ca640 1 --2- 10.20.193.5:0/4132290043 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff4901504c0 0x7ff4901efd60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff484007e40 tx=0x7ff48400e4b0 comp rx=0 tx=0).stop 2026-02-17T21:24:02.596 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.593+0000 7ff4965ca640 1 -- 10.20.193.5:0/4132290043 shutdown_connections 2026-02-17T21:24:02.596 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.593+0000 7ff4965ca640 1 --2- 10.20.193.5:0/4132290043 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff460079220 0x7ff46007b6e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:02.596 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.593+0000 7ff4965ca640 1 --2- 10.20.193.5:0/4132290043 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff4901504c0 0x7ff4901efd60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:02.596 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.593+0000 7ff4965ca640 1 --2- 10.20.193.5:0/4132290043 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff4900c7550 0x7ff4901ef820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:02.596 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.593+0000 7ff4965ca640 1 --2- 10.20.193.5:0/4132290043 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff4900c7120 0x7ff4901f2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:02.596 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.593+0000 7ff4965ca640 1 -- 10.20.193.5:0/4132290043 >> 10.20.193.5:0/4132290043 conn(0x7ff4900c9f30 msgr2=0x7ff4900c9710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:24:02.596 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.593+0000 7ff4965ca640 1 -- 10.20.193.5:0/4132290043 shutdown_connections 2026-02-17T21:24:02.596 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.593+0000 7ff4965ca640 1 -- 10.20.193.5:0/4132290043 wait complete. 2026-02-17T21:24:02.596 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:02.593+0000 7ff4965ca640 1 librados: shutdown 2026-02-17T21:24:02.602 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T21:24:05.307 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:20.758 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.353 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:20.803 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.471 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:20.911 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.490 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:20.919 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.499 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:20.951 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.500 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:20.951 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.518 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:20.959 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.534 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:20.963 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.601 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:21.041 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.617 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:21.068 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.626 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:21.163 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.654 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:21.083 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.668 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:21.097 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.673 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:21.123 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.728 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:21.267 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.745 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:21.202 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.771 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:21.230 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.780 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:21.220 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.800 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:21.229 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.815 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:21.267 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.819 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:21.270 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.842 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:21.283 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.854 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:21.283 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.902 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:21.353 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.916 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:21.357 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.917 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:21.364 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.935 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:21.473 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.963 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:21.392 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.979 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:21.429 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:05.985 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:21.414 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.037 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:21.575 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.056 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:21.513 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.084 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:21.513 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.087 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:21.528 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.088 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:21.547 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.107 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:21.558 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.135 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:21.586 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.151 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:21.592 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.164 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:21.593 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.169 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:21.621 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.206 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:21.646 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.234 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:21.681 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.241 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:21.778 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.256 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:21.705 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.268 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:21.697 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.270 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:21.699 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.322 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:21.860 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.348 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:21.777 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.365 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:21.805 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.370 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:21.822 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.373 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:21.830 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.379 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:21.838 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.409 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:21.860 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.425 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:21.866 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.437 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:21.889 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.438 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:21.866 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.469 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:21.910 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.515 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:22.052 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.539 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:21.986 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.540 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:21.989 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.541 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:21.970 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.546 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:21.975 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.590 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:22.128 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.611 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:22.040 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.637 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:22.089 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.643 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:22.083 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.645 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:22.104 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.650 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:22.107 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.683 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:22.134 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.699 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:22.140 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.712 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:22.141 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.714 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:22.166 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.732 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:22.173 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.790 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:22.327 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.804 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:22.233 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.813 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:22.260 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.814 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:22.264 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.827 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:22.256 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.853 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:22.392 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.874 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:22.303 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.901 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:22.352 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.912 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:22.371 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.920 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:22.360 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.931 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:22.388 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.958 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:22.409 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.973 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:22.414 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.984 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:22.436 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:06.986 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:22.415 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.003 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:22.444 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.064 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:22.601 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.067 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:22.496 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.087 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:22.534 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.089 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:22.538 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.101 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:22.530 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.120 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:22.659 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.139 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:22.568 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.165 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:22.617 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.175 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:22.634 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.198 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:22.638 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.208 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:22.665 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.232 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:22.683 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.259 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:22.700 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.263 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:22.715 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.264 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:22.692 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.278 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:22.719 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.330 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:22.759 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.338 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:22.875 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.361 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:22.808 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.367 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:22.816 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.375 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:22.804 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.387 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:22.926 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.407 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:22.836 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.428 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:22.880 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.439 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:22.898 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.471 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:22.912 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.486 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:22.943 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.506 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:22.957 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.533 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:22.974 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.533 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:22.985 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.537 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:22.966 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.548 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:22.989 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.593 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:23.022 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.612 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:23.149 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.638 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:23.085 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.641 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:23.090 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.650 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:23.189 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.651 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:23.079 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.680 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:23.109 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.696 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:23.148 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.702 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:23.161 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.746 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:23.186 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.763 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:23.220 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.784 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:23.235 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.810 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:23.251 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.811 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:23.240 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.814 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:23.255 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.856 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:23.285 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.890 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:23.427 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.894 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:23.346 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.912 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:23.359 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.921 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:23.460 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.925 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:23.354 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.937 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:23.389 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.963 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:23.415 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.967 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:23.426 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.988 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:23.440 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:07.993 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:23.445 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.018 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:23.467 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.037 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:23.494 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.043 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:23.472 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.057 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:23.509 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.104 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:23.556 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.120 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:23.561 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.131 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:23.583 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.173 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:23.624 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.175 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:23.615 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.187 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:23.616 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.193 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:23.634 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.202 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:23.649 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.214 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:23.643 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.223 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:23.674 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.238 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:23.679 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.252 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:23.703 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.266 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:23.803 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.280 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:23.709 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.283 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:23.822 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.301 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:23.730 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.311 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:23.761 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.318 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:23.747 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.323 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:23.861 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.338 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:23.797 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.339 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:23.878 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.343 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:23.772 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.348 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:23.777 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.348 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:23.777 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.354 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:23.891 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.356 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:23.806 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.362 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:23.901 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.365 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:23.794 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.379 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:23.808 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.392 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:23.842 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.397 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:23.856 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.398 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:23.847 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.399 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:23.828 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.404 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:23.856 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.406 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:23.847 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.409 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:23.860 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.412 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:23.841 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.417 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:23.846 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.430 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:23.888 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.435 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:23.876 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.441 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:23.870 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.446 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:23.875 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.477 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:23.917 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.493 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:23.922 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.499 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:23.939 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.511 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:23.952 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.520 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:23.971 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.525 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:23.976 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.552 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:23.993 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.556 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:23.997 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.582 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:24.029 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.626 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:24.163 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.630 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:24.168 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.633 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:24.172 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.638 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:24.176 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.682 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:24.141 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.699 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:24.140 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.705 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:24.145 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.722 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:24.181 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.727 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:24.186 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.730 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:24.187 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.763 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:24.192 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.764 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:24.220 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.771 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:24.212 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.776 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:24.216 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.881 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:24.328 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.911 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:24.358 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.947 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:24.394 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:08.952 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:24.399 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:09.046 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:24.503 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:09.052 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:24.509 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:09.052 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:24.481 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:09.057 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:24.486 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:10.215 DEBUG:teuthology.orchestra.run.trial005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:24:10.278 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.276+0000 7f36187bc640 10 monclient: get_monmap_and_config 2026-02-17T21:24:10.278 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.276+0000 7f36187bc640 10 monclient: build_initial_monmap 2026-02-17T21:24:10.278 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.276+0000 7f36187bc640 10 monclient: monmap: 2026-02-17T21:24:10.278 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:24:10.278 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:10.279 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:24:10.277551+0000 2026-02-17T21:24:10.279 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:24:10.277551+0000 2026-02-17T21:24:10.279 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:24:10.279 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:10.279 INFO:teuthology.misc.health.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:24:10.279 INFO:teuthology.misc.health.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:24:10.279 INFO:teuthology.misc.health.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:24:10.279 INFO:teuthology.misc.health.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:24:10.279 INFO:teuthology.misc.health.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:24:10.279 INFO:teuthology.misc.health.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:24:10.279 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:10.282 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.277+0000 7f36187bc640 1 Processor -- start 2026-02-17T21:24:10.282 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.277+0000 7f36187bc640 1 -- start start 2026-02-17T21:24:10.282 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.277+0000 7f36187bc640 10 monclient: init 2026-02-17T21:24:10.282 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.277+0000 7f36187bc640 10 monclient: _reopen_session rank -1 2026-02-17T21:24:10.283 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.277+0000 7f36187bc640 10 monclient: _add_conns ranks=[0,2,5,1,4,3] 2026-02-17T21:24:10.283 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.277+0000 7f36187bc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f36100ce7d0 addr v1:10.20.193.5:6789/0 2026-02-17T21:24:10.283 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.277+0000 7f36187bc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f36100ccbf0 addr v1:10.20.193.135:6789/0 2026-02-17T21:24:10.283 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.277+0000 7f36187bc640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f361015d2b0 0x7f361015d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:10.283 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.277+0000 7f36187bc640 10 monclient(hunting): picked mon.noname-c con 0x7f361015d2b0 addr v2:10.20.193.135:3300/0 2026-02-17T21:24:10.283 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.277+0000 7f36187bc640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36100d0510 con 0x7f36100ce7d0 2026-02-17T21:24:10.283 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.277+0000 7f36187bc640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f361006d870 con 0x7f36100ccbf0 2026-02-17T21:24:10.283 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.277+0000 7f36187bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:10.283 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.277+0000 7f36187bc640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f361006db50 con 0x7f361015d2b0 2026-02-17T21:24:10.283 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.277+0000 7f36187bc640 10 monclient(hunting): _renew_subs 2026-02-17T21:24:10.283 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.277+0000 7f36187bc640 10 monclient(hunting): authenticate will time out at 955.842992s 2026-02-17T21:24:10.283 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.278+0000 7f3616531640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f36100ce7d0 0x7f361015c7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:44422/0 (socket says 10.20.193.5:44422) 2026-02-17T21:24:10.284 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.278+0000 7f3616531640 1 -- 10.20.193.5:0/207741218 learned_addr learned my addr 10.20.193.5:0/207741218 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:24:10.284 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.278+0000 7f3616d32640 1 --2- 10.20.193.5:0/207741218 >> v2:10.20.193.135:3300/0 conn(0x7f361015d2b0 0x7f361015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:10.284 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.278+0000 7f3616d32640 10 monclient(hunting): get_auth_request con 0x7f361015d2b0 auth_method 0 2026-02-17T21:24:10.284 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.278+0000 7f3616d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:10.284 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.278+0000 7f3616d32640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:10.284 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.278+0000 7f3616d32640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:10.284 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.279+0000 7f3616d32640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:10.284 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.279+0000 7f3616d32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:10.284 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.279+0000 7f3616d32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:10.284 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.279+0000 7f361552f640 1 -- 10.20.193.5:0/207741218 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1179260248 0 0) 0x7f36100d0510 con 0x7f36100ce7d0 2026-02-17T21:24:10.284 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.279+0000 7f361552f640 10 monclient(hunting): _negotiate 2026-02-17T21:24:10.284 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.279+0000 7f361552f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:10.285 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.279+0000 7f361552f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:10.285 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.279+0000 7f361552f640 10 monclient(hunting): my global_id is 4245 2026-02-17T21:24:10.285 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.279+0000 7f361552f640 1 -- 10.20.193.5:0/207741218 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35f8003620 con 0x7f36100ce7d0 2026-02-17T21:24:10.285 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.280+0000 7f3616d32640 10 monclient(hunting): handle_auth_done global_id 4280 payload 274 2026-02-17T21:24:10.285 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.280+0000 7f3616d32640 1 -- 10.20.193.5:0/207741218 >> v1:10.20.193.135:6789/0 conn(0x7f36100ccbf0 legacy=0x7f36100cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:10.285 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.280+0000 7f3616d32640 1 -- 10.20.193.5:0/207741218 >> v1:10.20.193.5:6789/0 conn(0x7f36100ce7d0 legacy=0x7f361015c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:10.285 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.280+0000 7f3616d32640 10 monclient: _finish_hunting 0 2026-02-17T21:24:10.285 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.280+0000 7f3616d32640 1 monclient: found mon.noname-c 2026-02-17T21:24:10.285 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.280+0000 7f3616d32640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:24:10.285 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.280+0000 7f3616d32640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:24:10.285 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.280+0000 7f3616d32640 1 -- 10.20.193.5:0/207741218 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f361006de30 con 0x7f361015d2b0 2026-02-17T21:24:10.286 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.283+0000 7f3616d32640 1 --2- 10.20.193.5:0/207741218 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f361015d2b0 0x7f361015d690 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f360c009d90 tx=0x7f360c02f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d67c70742d878bad server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:24:10.291 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.285+0000 7f361552f640 1 -- 10.20.193.5:0/207741218 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c03c070 con 0x7f361015d2b0 2026-02-17T21:24:10.291 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.285+0000 7f361552f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:10.292 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.285+0000 7f361552f640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:24:10.292 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.285+0000 7f361552f640 10 monclient: dump: 2026-02-17T21:24:10.292 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:10.292 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:10.292 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:10.292 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:10.292 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:10.292 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:10.292 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:10.292 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:10.293 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:10.293 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:10.293 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.285+0000 7f361552f640 10 monclient: _finish_auth 0 2026-02-17T21:24:10.293 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.285+0000 7f361552f640 10 monclient: _check_auth_tickets 2026-02-17T21:24:10.293 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.285+0000 7f361552f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:24:10.293 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.285+0000 7f36187bc640 5 monclient: authenticate success, global_id 4280 2026-02-17T21:24:10.293 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.285+0000 7f361552f640 1 -- 10.20.193.5:0/207741218 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f360c037440 con 0x7f361015d2b0 2026-02-17T21:24:10.293 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.285+0000 7f361552f640 10 monclient: handle_config config(0 keys) 2026-02-17T21:24:10.293 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.285+0000 7f36187bc640 10 monclient: get_monmap_and_config success 2026-02-17T21:24:10.293 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.285+0000 7f36187bc640 4 set_mon_vals no callback set 2026-02-17T21:24:10.293 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.285+0000 7f361552f640 1 -- 10.20.193.5:0/207741218 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c037810 con 0x7f361015d2b0 2026-02-17T21:24:10.294 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.285+0000 7f361552f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:10.294 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.285+0000 7f361552f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:24:10.294 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.285+0000 7f361552f640 10 monclient: dump: 2026-02-17T21:24:10.294 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:10.294 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:10.294 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:10.294 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:10.294 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:10.294 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:10.294 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:10.294 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:10.295 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:10.295 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:10.295 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.285+0000 7f36187bc640 10 monclient: shutdown 2026-02-17T21:24:10.295 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.285+0000 7f36187bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:24:10.295 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.285+0000 7f36187bc640 1 -- 10.20.193.5:0/207741218 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f361015d2b0 msgr2=0x7f361015d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:10.295 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.285+0000 7f36187bc640 1 --2- 10.20.193.5:0/207741218 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f361015d2b0 0x7f361015d690 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f360c009d90 tx=0x7f360c02f230 comp rx=0 tx=0).stop 2026-02-17T21:24:10.295 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.285+0000 7f36187bc640 1 -- 10.20.193.5:0/207741218 shutdown_connections 2026-02-17T21:24:10.295 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.285+0000 7f36187bc640 1 --2- 10.20.193.5:0/207741218 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f361015d2b0 0x7f361015d690 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:10.295 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.285+0000 7f36187bc640 1 -- 10.20.193.5:0/207741218 >> 10.20.193.5:0/207741218 conn(0x7f36100cc0d0 msgr2=0x7f36100cc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:24:10.295 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.285+0000 7f36187bc640 1 -- 10.20.193.5:0/207741218 shutdown_connections 2026-02-17T21:24:10.296 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.285+0000 7f36187bc640 1 -- 10.20.193.5:0/207741218 wait complete. 2026-02-17T21:24:10.296 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.286+0000 7f36187bc640 10 monclient: build_initial_monmap 2026-02-17T21:24:10.296 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.286+0000 7f36187bc640 10 monclient: monmap: 2026-02-17T21:24:10.296 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:24:10.296 INFO:teuthology.misc.health.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:24:10.296 INFO:teuthology.misc.health.trial005.stderr:last_changed 0.000000 2026-02-17T21:24:10.296 INFO:teuthology.misc.health.trial005.stderr:created 0.000000 2026-02-17T21:24:10.296 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:24:10.296 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:10.296 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:24:10.296 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:24:10.296 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:24:10.297 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:10.297 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.286+0000 7f36187bc640 1 librados: starting msgr at 2026-02-17T21:24:10.297 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.286+0000 7f36187bc640 1 librados: starting objecter 2026-02-17T21:24:10.297 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.286+0000 7f36187bc640 1 Processor -- start 2026-02-17T21:24:10.297 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.286+0000 7f36187bc640 1 -- start start 2026-02-17T21:24:10.297 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.286+0000 7f36187bc640 1 librados: setting wanted keys 2026-02-17T21:24:10.297 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.286+0000 7f36187bc640 1 librados: calling monclient init 2026-02-17T21:24:10.297 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.286+0000 7f36187bc640 10 monclient: init 2026-02-17T21:24:10.297 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.286+0000 7f36187bc640 10 monclient: _reopen_session rank -1 2026-02-17T21:24:10.297 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.286+0000 7f36187bc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:24:10.297 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.286+0000 7f36187bc640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f36100ccbf0 0x7f36101f7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:10.298 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.286+0000 7f36187bc640 10 monclient(hunting): picked mon.noname-b con 0x7f36100ccbf0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:24:10.298 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.286+0000 7f36187bc640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f36100ce7d0 0x7f3610159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:10.298 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.286+0000 7f36187bc640 10 monclient(hunting): picked mon.noname-a con 0x7f36100ce7d0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:24:10.298 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f36187bc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f361015d2b0 0x7f3610070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:10.298 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f36187bc640 10 monclient(hunting): picked mon.noname-c con 0x7f361015d2b0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:24:10.298 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f36187bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:10.298 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f36187bc640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f361006e6d0 con 0x7f36100ce7d0 2026-02-17T21:24:10.298 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f36187bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:10.298 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f36187bc640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f361006e3f0 con 0x7f36100ccbf0 2026-02-17T21:24:10.298 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f36187bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:10.298 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f36187bc640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3610074a10 con 0x7f361015d2b0 2026-02-17T21:24:10.299 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f36187bc640 10 monclient(hunting): _renew_subs 2026-02-17T21:24:10.299 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f36187bc640 10 monclient(hunting): authenticate will time out at 955.852020s 2026-02-17T21:24:10.299 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f3615d30640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f36100ce7d0 0x7f3610159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:10.299 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f3615d30640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f36100ce7d0 0x7f3610159010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:34238/0 (socket says 10.20.193.5:34238) 2026-02-17T21:24:10.299 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f3615d30640 1 -- 10.20.193.5:0/1758769023 learned_addr learned my addr 10.20.193.5:0/1758769023 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:24:10.299 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f3615d30640 10 monclient(hunting): get_auth_request con 0x7f36100ce7d0 auth_method 0 2026-02-17T21:24:10.299 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f3615d30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:10.299 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f3615d30640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:10.299 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f3615d30640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:10.299 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f3616d32640 1 --2- 10.20.193.5:0/1758769023 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f361015d2b0 0x7f3610070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:10.299 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f3616d32640 10 monclient(hunting): get_auth_request con 0x7f361015d2b0 auth_method 0 2026-02-17T21:24:10.300 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f3616d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:10.300 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f3616d32640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:10.300 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f3616d32640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:10.300 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f3615d30640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:10.300 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f3615d30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:10.300 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f3616531640 1 --2- 10.20.193.5:0/1758769023 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f36100ccbf0 0x7f36101f7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:10.300 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f3615d30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:10.300 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f3616531640 10 monclient(hunting): get_auth_request con 0x7f36100ccbf0 auth_method 0 2026-02-17T21:24:10.300 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f3616531640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:10.300 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f3616531640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:10.300 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.287+0000 7f3616531640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:10.301 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.288+0000 7f3616d32640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:10.301 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.288+0000 7f3616d32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:10.301 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.288+0000 7f3616d32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:10.301 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.288+0000 7f3616531640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:10.301 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.288+0000 7f3616531640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:10.301 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.288+0000 7f3616531640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:10.301 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.289+0000 7f3615d30640 10 monclient(hunting): handle_auth_done global_id 4248 payload 824 2026-02-17T21:24:10.301 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.289+0000 7f3615d30640 1 -- 10.20.193.5:0/1758769023 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f361015d2b0 msgr2=0x7f3610070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:10.301 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.289+0000 7f3615d30640 1 --2- 10.20.193.5:0/1758769023 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f361015d2b0 0x7f3610070fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:10.301 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.289+0000 7f3615d30640 1 -- 10.20.193.5:0/1758769023 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f36100ccbf0 msgr2=0x7f36101f7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:10.301 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.289+0000 7f3615d30640 1 --2- 10.20.193.5:0/1758769023 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f36100ccbf0 0x7f36101f7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:10.301 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.289+0000 7f3615d30640 10 monclient: _finish_hunting 0 2026-02-17T21:24:10.302 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.289+0000 7f3615d30640 1 monclient: found mon.noname-a 2026-02-17T21:24:10.302 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.289+0000 7f3615d30640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:24:10.302 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.289+0000 7f3615d30640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:24:10.302 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.289+0000 7f3615d30640 1 -- 10.20.193.5:0/1758769023 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36101f3bc0 con 0x7f36100ce7d0 2026-02-17T21:24:10.302 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.290+0000 7f3615d30640 1 --2- 10.20.193.5:0/1758769023 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f36100ce7d0 0x7f3610159010 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f360400c700 tx=0x7f360400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:24:10.302 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.290+0000 7f35f6ffd640 10 client.?.objecter ms_handle_connect 0x7f36100ce7d0 2026-02-17T21:24:10.302 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.290+0000 7f35f6ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:24:10.304 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f35f6ffd640 1 -- 10.20.193.5:0/1758769023 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36040052d0 con 0x7f36100ce7d0 2026-02-17T21:24:10.304 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f35f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:10.304 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f35f6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:24:10.304 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f35f6ffd640 10 monclient: dump: 2026-02-17T21:24:10.304 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:10.304 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:10.305 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:10.305 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:10.305 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:10.305 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:10.305 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:10.305 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:10.305 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:10.305 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:10.305 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f35f6ffd640 10 monclient: _finish_auth 0 2026-02-17T21:24:10.305 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f35f6ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:24:10.305 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f35f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:24:10.306 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f35f6ffd640 1 -- 10.20.193.5:0/1758769023 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3604005470 con 0x7f36100ce7d0 2026-02-17T21:24:10.306 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f35f6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:24:10.306 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f35f6ffd640 1 -- 10.20.193.5:0/1758769023 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360400a860 con 0x7f36100ce7d0 2026-02-17T21:24:10.306 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f35f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:10.306 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f35f6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:24:10.306 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f35f6ffd640 10 monclient: dump: 2026-02-17T21:24:10.306 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:10.306 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:10.306 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:10.306 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:10.306 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:10.307 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:10.307 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:10.307 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:10.307 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:10.307 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:10.307 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f3614d2e640 4 set_mon_vals no callback set 2026-02-17T21:24:10.307 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f36187bc640 5 monclient: authenticate success, global_id 4248 2026-02-17T21:24:10.307 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f36187bc640 10 monclient: _renew_subs 2026-02-17T21:24:10.307 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f36187bc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:24:10.308 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f36187bc640 1 -- 10.20.193.5:0/1758769023 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36101f3e80 con 0x7f36100ce7d0 2026-02-17T21:24:10.308 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f36187bc640 10 client.4248.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:24:10.308 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f36187bc640 10 monclient: _renew_subs 2026-02-17T21:24:10.308 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f36187bc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:24:10.308 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f36187bc640 1 -- 10.20.193.5:0/1758769023 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36101f4440 con 0x7f36100ce7d0 2026-02-17T21:24:10.308 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f36187bc640 1 librados: init done 2026-02-17T21:24:10.308 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f36187bc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:24:10.308 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f36187bc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:24:10.308 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f36187bc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:24:10.308 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.292+0000 7f36187bc640 1 -- 10.20.193.5:0/1758769023 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f361015d690 con 0x7f36100ce7d0 2026-02-17T21:24:10.310 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.304+0000 7f35f6ffd640 1 -- 10.20.193.5:0/1758769023 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 6) ==== 100189+0+0 (secure 0 0 0) 0x7f360400aa00 con 0x7f36100ce7d0 2026-02-17T21:24:10.310 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.305+0000 7f35f6ffd640 1 --2- 10.20.193.5:0/1758769023 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f35e00791f0 0x7f35e007b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:10.310 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.305+0000 7f3616531640 1 --2- 10.20.193.5:0/1758769023 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f35e00791f0 0x7f35e007b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:10.310 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.305+0000 7f3616531640 10 monclient: get_auth_request con 0x7f35e00791f0 auth_method 0 2026-02-17T21:24:10.310 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.306+0000 7f3616531640 1 --2- 10.20.193.5:0/1758769023 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f35e00791f0 0x7f35e007b6b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3600005980 tx=0x7f3600007dd0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:24:10.310 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.306+0000 7f35f6ffd640 10 client.4248.objecter ms_handle_connect 0x7f35e00791f0 2026-02-17T21:24:10.310 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.306+0000 7f35f6ffd640 1 -- 10.20.193.5:0/1758769023 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 2565+0+0 (secure 0 0 0) 0x7f360400ad20 con 0x7f36100ce7d0 2026-02-17T21:24:10.310 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.306+0000 7f35f6ffd640 10 client.4248.objecter ms_dispatch2 0x7f3610000b90 osd_map(19..19 src has 1..19) 2026-02-17T21:24:10.311 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.306+0000 7f35f6ffd640 3 client.4248.objecter handle_osd_map got epochs [19,19] > 0 2026-02-17T21:24:10.311 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.306+0000 7f35f6ffd640 3 client.4248.objecter handle_osd_map decoding full epoch 19 2026-02-17T21:24:10.311 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.306+0000 7f35f6ffd640 20 client.4248.objecter dump_active .. 0 homeless 2026-02-17T21:24:10.412 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.410+0000 7f35f6ffd640 1 -- 10.20.193.5:0/1758769023 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3604062340 con 0x7f36100ce7d0 2026-02-17T21:24:10.412 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.410+0000 7f35f6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:24:10.412 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.410+0000 7f35f6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:24:10.497 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.496+0000 7f36187bc640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:24:10.498 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.496+0000 7f36187bc640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:24:10.498 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.496+0000 7f36187bc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:24:10.498 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.496+0000 7f36187bc640 1 -- 10.20.193.5:0/1758769023 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36100ca190 con 0x7f36100ce7d0 2026-02-17T21:24:10.509 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.508+0000 7f35f6ffd640 1 -- 10.20.193.5:0/1758769023 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12879 (secure 0 0 0) 0x7f3604066640 con 0x7f36100ce7d0 2026-02-17T21:24:10.509 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.508+0000 7f35f6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:24:10.509 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.508+0000 7f35f6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:24:10.510 INFO:teuthology.misc.health.trial005.stdout: 2026-02-17T21:24:10.510 INFO:teuthology.misc.health.trial005.stdout:{"epoch":19,"fsid":"b1be373b-56c5-4b5b-a965-9bcc20042691","created":"2026-02-17T21:23:38.622021+0000","modified":"2026-02-17T21:23:44.366223+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:23:44.366223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8bffc5e9-1f92-4603-bf29-ce19225edc1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8ffdf919-2ec4-4c1f-a69f-aee5cea211e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d186244a-4bf7-416d-b6a0-0e0f5af50eb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"093b417e-53bf-4b60-a937-7c5ffee43e1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0a48e684-05b0-41b1-a553-022424011225","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d73b7c38-cef9-4993-b353-908c1d87603c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f7774c25-72e8-41b2-8634-517af7a213b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"30a68802-afce-499b-90ce-bd568bc69406","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"8b4a2001-3ac8-4756-9dcf-af38c6d12d44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"dfdfee67-eff6-4413-bd7a-adc0a019bfbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"fc24ee77-5a0d-41d4-88f5-8d03a77c7608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"1d737681-1923-453a-82f8-516eeb875559","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"c4f0322e-a862-4c5e-967e-4551087ede8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"0b5e9861-a194-4f11-a849-d8bb94ce95a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"6f182077-0c0d-481c-97b4-43ef48aa5aea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"537605ff-bedd-4f2b-922f-e2eaa8c17f48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:24:10.512 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.509+0000 7f36187bc640 10 librados: watch_flush enter 2026-02-17T21:24:10.512 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.509+0000 7f36187bc640 10 librados: watch_flush exit 2026-02-17T21:24:10.512 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.509+0000 7f36187bc640 20 client.4248.objecter shutdown clearing up homeless session... 2026-02-17T21:24:10.512 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.509+0000 7f36187bc640 10 client.4248.objecter successfully canceled tick 2026-02-17T21:24:10.512 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.509+0000 7f36187bc640 1 -- 10.20.193.5:0/1758769023 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f35e00791f0 msgr2=0x7f35e007b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:10.512 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.509+0000 7f36187bc640 1 --2- 10.20.193.5:0/1758769023 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f35e00791f0 0x7f35e007b6b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3600005980 tx=0x7f3600007dd0 comp rx=0 tx=0).stop 2026-02-17T21:24:10.512 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.509+0000 7f36187bc640 10 monclient: shutdown 2026-02-17T21:24:10.512 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.509+0000 7f36187bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:24:10.513 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.509+0000 7f36187bc640 1 -- 10.20.193.5:0/1758769023 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f36100ce7d0 msgr2=0x7f3610159010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:10.513 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.509+0000 7f36187bc640 1 --2- 10.20.193.5:0/1758769023 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f36100ce7d0 0x7f3610159010 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f360400c700 tx=0x7f360400cbd0 comp rx=0 tx=0).stop 2026-02-17T21:24:10.513 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.509+0000 7f36187bc640 1 -- 10.20.193.5:0/1758769023 shutdown_connections 2026-02-17T21:24:10.513 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.509+0000 7f36187bc640 1 --2- 10.20.193.5:0/1758769023 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f35e00791f0 0x7f35e007b6b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:10.513 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.509+0000 7f36187bc640 1 --2- 10.20.193.5:0/1758769023 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f361015d2b0 0x7f3610070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:10.513 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.509+0000 7f36187bc640 1 --2- 10.20.193.5:0/1758769023 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f36100ce7d0 0x7f3610159010 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:10.513 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.509+0000 7f36187bc640 1 --2- 10.20.193.5:0/1758769023 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f36100ccbf0 0x7f36101f7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:10.513 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.509+0000 7f36187bc640 1 -- 10.20.193.5:0/1758769023 >> 10.20.193.5:0/1758769023 conn(0x7f36100cc0d0 msgr2=0x7f36100ca6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:24:10.513 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.509+0000 7f36187bc640 1 -- 10.20.193.5:0/1758769023 shutdown_connections 2026-02-17T21:24:10.513 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.509+0000 7f36187bc640 1 -- 10.20.193.5:0/1758769023 wait complete. 2026-02-17T21:24:10.513 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:10.509+0000 7f36187bc640 1 librados: shutdown 2026-02-17T21:24:10.520 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T21:24:18.134 DEBUG:teuthology.orchestra.run.trial005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:24:18.197 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.194+0000 7fad4581b640 10 monclient: get_monmap_and_config 2026-02-17T21:24:18.197 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.194+0000 7fad4581b640 10 monclient: build_initial_monmap 2026-02-17T21:24:18.197 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.194+0000 7fad4581b640 10 monclient: monmap: 2026-02-17T21:24:18.197 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:24:18.198 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:18.198 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:24:18.195179+0000 2026-02-17T21:24:18.198 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:24:18.195179+0000 2026-02-17T21:24:18.198 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:24:18.198 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:18.198 INFO:teuthology.misc.health.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:24:18.198 INFO:teuthology.misc.health.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:24:18.198 INFO:teuthology.misc.health.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:24:18.198 INFO:teuthology.misc.health.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:24:18.198 INFO:teuthology.misc.health.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:24:18.198 INFO:teuthology.misc.health.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:24:18.199 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:18.199 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.194+0000 7fad4581b640 1 Processor -- start 2026-02-17T21:24:18.199 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.194+0000 7fad4581b640 1 -- start start 2026-02-17T21:24:18.199 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.194+0000 7fad4581b640 10 monclient: init 2026-02-17T21:24:18.199 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.195+0000 7fad4581b640 10 monclient: _reopen_session rank -1 2026-02-17T21:24:18.199 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.195+0000 7fad4581b640 10 monclient: _add_conns ranks=[2,4,1,5,3,0] 2026-02-17T21:24:18.199 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.195+0000 7fad4581b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fad401504c0 addr v1:10.20.193.135:6789/0 2026-02-17T21:24:18.199 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.195+0000 7fad4581b640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fad400c7120 0x7fad400c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:18.199 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.195+0000 7fad4581b640 10 monclient(hunting): picked mon.noname-b con 0x7fad400c7120 addr v2:10.20.193.119:3300/0 2026-02-17T21:24:18.199 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.195+0000 7fad4581b640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fad400c9050 addr v1:10.20.193.119:6789/0 2026-02-17T21:24:18.199 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.195+0000 7fad4581b640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad400c59d0 con 0x7fad400c9050 2026-02-17T21:24:18.200 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.195+0000 7fad4581b640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad4015def0 con 0x7fad401504c0 2026-02-17T21:24:18.200 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.195+0000 7fad4581b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:18.200 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.195+0000 7fad4581b640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fad400c5c70 con 0x7fad400c7120 2026-02-17T21:24:18.200 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.195+0000 7fad4581b640 10 monclient(hunting): _renew_subs 2026-02-17T21:24:18.200 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.195+0000 7fad4581b640 10 monclient(hunting): authenticate will time out at 963.760546s 2026-02-17T21:24:18.200 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.196+0000 7fad3e7fc640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fad400c7120 0x7fad400c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:18.200 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.196+0000 7fad3effd640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7fad401504c0 0x7fad400c52c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:49136/0 (socket says 10.20.193.5:49136) 2026-02-17T21:24:18.200 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.196+0000 7fad3effd640 1 -- 10.20.193.5:0/2325844586 learned_addr learned my addr 10.20.193.5:0/2325844586 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:24:18.202 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.196+0000 7fad3e7fc640 10 monclient(hunting): get_auth_request con 0x7fad400c7120 auth_method 0 2026-02-17T21:24:18.202 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.196+0000 7fad3e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:18.202 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.196+0000 7fad3e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:18.202 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.196+0000 7fad3e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:18.202 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.196+0000 7fad3e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:18.203 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.196+0000 7fad3e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:18.203 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.197+0000 7fad3e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:18.203 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.197+0000 7fad3dffb640 1 -- 10.20.193.5:0/2325844586 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1708762133 0 0) 0x7fad4015def0 con 0x7fad401504c0 2026-02-17T21:24:18.203 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.197+0000 7fad3dffb640 10 monclient(hunting): _negotiate 2026-02-17T21:24:18.203 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.197+0000 7fad3dffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:18.203 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.197+0000 7fad3dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:18.203 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.197+0000 7fad3dffb640 10 monclient(hunting): my global_id is 4289 2026-02-17T21:24:18.203 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.197+0000 7fad3dffb640 1 -- 10.20.193.5:0/2325844586 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad2c003620 con 0x7fad401504c0 2026-02-17T21:24:18.203 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.198+0000 7fad3e7fc640 10 monclient(hunting): handle_auth_done global_id 4288 payload 274 2026-02-17T21:24:18.203 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.198+0000 7fad3e7fc640 1 -- 10.20.193.5:0/2325844586 >> v1:10.20.193.135:6789/0 conn(0x7fad401504c0 legacy=0x7fad400c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:18.203 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.198+0000 7fad3e7fc640 1 -- 10.20.193.5:0/2325844586 >> v1:10.20.193.119:6789/0 conn(0x7fad400c9050 legacy=0x7fad4015d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:18.204 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.198+0000 7fad3e7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:24:18.204 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.198+0000 7fad3e7fc640 1 monclient: found mon.noname-b 2026-02-17T21:24:18.204 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.198+0000 7fad3e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:24:18.204 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.198+0000 7fad3e7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:24:18.204 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.198+0000 7fad3e7fc640 1 -- 10.20.193.5:0/2325844586 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad400c7fb0 con 0x7fad400c7120 2026-02-17T21:24:18.204 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.201+0000 7fad3e7fc640 1 --2- 10.20.193.5:0/2325844586 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fad400c7120 0x7fad400c7550 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fad280098a0 tx=0x7fad2802ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=141d422c49523ca6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:24:18.209 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad3dffb640 1 -- 10.20.193.5:0/2325844586 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2803c070 con 0x7fad400c7120 2026-02-17T21:24:18.209 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad3dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:18.209 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad3dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:24:18.209 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad3dffb640 10 monclient: dump: 2026-02-17T21:24:18.209 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:18.210 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:18.210 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:18.210 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:18.210 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:18.210 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:18.210 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:18.210 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:18.210 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:18.210 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:18.210 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad3dffb640 10 monclient: _finish_auth 0 2026-02-17T21:24:18.210 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad3dffb640 10 monclient: _check_auth_tickets 2026-02-17T21:24:18.210 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad3dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:24:18.211 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad3dffb640 1 -- 10.20.193.5:0/2325844586 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2802fca0 con 0x7fad400c7120 2026-02-17T21:24:18.211 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad4581b640 5 monclient: authenticate success, global_id 4288 2026-02-17T21:24:18.211 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad4581b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:24:18.211 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad3dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:24:18.211 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad3dffb640 1 -- 10.20.193.5:0/2325844586 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad28037660 con 0x7fad400c7120 2026-02-17T21:24:18.211 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad3dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:18.211 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad3dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:24:18.211 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad3dffb640 10 monclient: dump: 2026-02-17T21:24:18.211 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:18.211 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:18.211 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:18.212 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:18.212 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:18.212 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:18.212 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:18.212 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:18.212 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:18.212 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:18.212 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad4581b640 10 monclient: get_monmap_and_config success 2026-02-17T21:24:18.212 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad4581b640 4 set_mon_vals no callback set 2026-02-17T21:24:18.212 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad4581b640 10 monclient: shutdown 2026-02-17T21:24:18.212 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad4581b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:24:18.212 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad4581b640 1 -- 10.20.193.5:0/2325844586 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fad400c7120 msgr2=0x7fad400c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:18.213 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad4581b640 1 --2- 10.20.193.5:0/2325844586 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fad400c7120 0x7fad400c7550 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fad280098a0 tx=0x7fad2802ef90 comp rx=0 tx=0).stop 2026-02-17T21:24:18.213 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad4581b640 1 -- 10.20.193.5:0/2325844586 shutdown_connections 2026-02-17T21:24:18.213 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad4581b640 1 --2- 10.20.193.5:0/2325844586 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fad400c7120 0x7fad400c7550 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:18.213 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad4581b640 1 -- 10.20.193.5:0/2325844586 >> 10.20.193.5:0/2325844586 conn(0x7fad400c9f30 msgr2=0x7fad400ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:24:18.213 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad4581b640 1 -- 10.20.193.5:0/2325844586 shutdown_connections 2026-02-17T21:24:18.213 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.203+0000 7fad4581b640 1 -- 10.20.193.5:0/2325844586 wait complete. 2026-02-17T21:24:18.213 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.204+0000 7fad4581b640 10 monclient: build_initial_monmap 2026-02-17T21:24:18.213 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.204+0000 7fad4581b640 10 monclient: monmap: 2026-02-17T21:24:18.213 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:24:18.213 INFO:teuthology.misc.health.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:24:18.213 INFO:teuthology.misc.health.trial005.stderr:last_changed 0.000000 2026-02-17T21:24:18.214 INFO:teuthology.misc.health.trial005.stderr:created 0.000000 2026-02-17T21:24:18.214 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:24:18.214 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:18.214 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:24:18.214 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:24:18.214 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:24:18.214 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:18.214 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.204+0000 7fad4581b640 1 librados: starting msgr at 2026-02-17T21:24:18.214 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.204+0000 7fad4581b640 1 librados: starting objecter 2026-02-17T21:24:18.214 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.204+0000 7fad4581b640 1 Processor -- start 2026-02-17T21:24:18.214 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.204+0000 7fad4581b640 1 -- start start 2026-02-17T21:24:18.215 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.204+0000 7fad4581b640 1 librados: setting wanted keys 2026-02-17T21:24:18.215 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.204+0000 7fad4581b640 1 librados: calling monclient init 2026-02-17T21:24:18.215 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.204+0000 7fad4581b640 10 monclient: init 2026-02-17T21:24:18.215 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad4581b640 10 monclient: _reopen_session rank -1 2026-02-17T21:24:18.215 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad4581b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:24:18.215 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad4581b640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fad400c7120 0x7fad400726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:18.215 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad4581b640 10 monclient(hunting): picked mon.noname-b con 0x7fad400c7120 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:24:18.215 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad4581b640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fad400c9050 0x7fad40145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:18.215 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad4581b640 10 monclient(hunting): picked mon.noname-a con 0x7fad400c9050 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:24:18.215 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad4581b640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fad401504c0 0x7fad4014a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:18.215 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad4581b640 10 monclient(hunting): picked mon.noname-c con 0x7fad401504c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:24:18.215 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad4581b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:18.216 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad4581b640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fad400c8850 con 0x7fad400c9050 2026-02-17T21:24:18.216 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad4581b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:18.216 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad4581b640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fad400c8570 con 0x7fad400c7120 2026-02-17T21:24:18.216 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad4581b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:18.216 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad4581b640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fad400c8b30 con 0x7fad401504c0 2026-02-17T21:24:18.216 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad4581b640 10 monclient(hunting): _renew_subs 2026-02-17T21:24:18.216 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad4581b640 10 monclient(hunting): authenticate will time out at 963.770095s 2026-02-17T21:24:18.216 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad3effd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fad400c7120 0x7fad400726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:18.216 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad3f7fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fad401504c0 0x7fad4014a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:18.216 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad3e7fc640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fad400c9050 0x7fad40145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:18.216 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad3effd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fad400c7120 0x7fad400726b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:39628/0 (socket says 10.20.193.5:39628) 2026-02-17T21:24:18.216 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad3effd640 1 -- 10.20.193.5:0/3581435699 learned_addr learned my addr 10.20.193.5:0/3581435699 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:24:18.217 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad3effd640 10 monclient(hunting): get_auth_request con 0x7fad400c7120 auth_method 0 2026-02-17T21:24:18.217 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad3effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:18.217 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad3effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:18.217 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad3effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:18.217 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad3e7fc640 10 monclient(hunting): get_auth_request con 0x7fad400c9050 auth_method 0 2026-02-17T21:24:18.217 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad3e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:18.217 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad3e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:18.217 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad3e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:18.217 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad3f7fe640 10 monclient(hunting): get_auth_request con 0x7fad401504c0 auth_method 0 2026-02-17T21:24:18.217 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad3f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:18.217 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad3f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:18.217 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad3f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:18.218 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad3effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:18.218 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad3effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:18.218 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.205+0000 7fad3effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:18.218 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.206+0000 7fad3e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:18.218 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.206+0000 7fad3e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:18.218 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.206+0000 7fad3e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:18.218 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.206+0000 7fad3f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:18.218 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.206+0000 7fad3f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:18.218 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.206+0000 7fad3f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:18.218 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.207+0000 7fad3effd640 10 monclient(hunting): handle_auth_done global_id 4294 payload 824 2026-02-17T21:24:18.218 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.207+0000 7fad3effd640 1 -- 10.20.193.5:0/3581435699 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fad401504c0 msgr2=0x7fad4014a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:18.218 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.207+0000 7fad3effd640 1 --2- 10.20.193.5:0/3581435699 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fad401504c0 0x7fad4014a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:18.219 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.207+0000 7fad3effd640 1 -- 10.20.193.5:0/3581435699 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fad400c9050 msgr2=0x7fad40145bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:18.219 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.207+0000 7fad3effd640 1 --2- 10.20.193.5:0/3581435699 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fad400c9050 0x7fad40145bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:18.219 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.207+0000 7fad3effd640 10 monclient: _finish_hunting 0 2026-02-17T21:24:18.219 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.207+0000 7fad3effd640 1 monclient: found mon.noname-b 2026-02-17T21:24:18.219 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.207+0000 7fad3effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:24:18.219 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.207+0000 7fad3effd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:24:18.219 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.207+0000 7fad3effd640 1 -- 10.20.193.5:0/3581435699 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad401477e0 con 0x7fad400c7120 2026-02-17T21:24:18.221 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.208+0000 7fad3effd640 1 --2- 10.20.193.5:0/3581435699 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fad400c7120 0x7fad400726b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fad3400c520 tx=0x7fad3400c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:24:18.221 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.208+0000 7fad17fff640 10 client.?.objecter ms_handle_connect 0x7fad400c7120 2026-02-17T21:24:18.221 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.208+0000 7fad17fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:24:18.221 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.209+0000 7fad17fff640 1 -- 10.20.193.5:0/3581435699 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad34017070 con 0x7fad400c7120 2026-02-17T21:24:18.222 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.209+0000 7fad17fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:18.222 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.209+0000 7fad17fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:24:18.222 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.209+0000 7fad17fff640 10 monclient: dump: 2026-02-17T21:24:18.222 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:18.222 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:18.222 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:18.222 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:18.222 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:18.222 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:18.222 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:18.222 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:18.222 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:18.223 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:18.223 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.209+0000 7fad17fff640 10 monclient: _finish_auth 0 2026-02-17T21:24:18.223 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.209+0000 7fad17fff640 10 monclient: _check_auth_tickets 2026-02-17T21:24:18.223 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.209+0000 7fad17fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:24:18.223 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.209+0000 7fad4581b640 5 monclient: authenticate success, global_id 4294 2026-02-17T21:24:18.223 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.209+0000 7fad4581b640 10 monclient: _renew_subs 2026-02-17T21:24:18.223 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.209+0000 7fad4581b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:24:18.223 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.209+0000 7fad4581b640 1 -- 10.20.193.5:0/3581435699 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad40072f10 con 0x7fad400c7120 2026-02-17T21:24:18.223 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.209+0000 7fad4581b640 10 client.4294.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:24:18.223 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.209+0000 7fad4581b640 10 monclient: _renew_subs 2026-02-17T21:24:18.223 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.209+0000 7fad4581b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:24:18.223 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.209+0000 7fad4581b640 1 -- 10.20.193.5:0/3581435699 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad400734d0 con 0x7fad400c7120 2026-02-17T21:24:18.224 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.209+0000 7fad4581b640 1 librados: init done 2026-02-17T21:24:18.224 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.210+0000 7fad4581b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:24:18.224 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.210+0000 7fad4581b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:24:18.224 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.210+0000 7fad4581b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:24:18.224 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.210+0000 7fad4581b640 1 -- 10.20.193.5:0/3581435699 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad401508a0 con 0x7fad400c7120 2026-02-17T21:24:18.224 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.210+0000 7fad17fff640 1 -- 10.20.193.5:0/3581435699 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad34002a20 con 0x7fad400c7120 2026-02-17T21:24:18.224 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.210+0000 7fad17fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:24:18.224 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.210+0000 7fad17fff640 1 -- 10.20.193.5:0/3581435699 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad34021060 con 0x7fad400c7120 2026-02-17T21:24:18.224 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.210+0000 7fad17fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:18.224 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.210+0000 7fad17fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:24:18.224 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.210+0000 7fad17fff640 10 monclient: dump: 2026-02-17T21:24:18.224 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:18.225 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:18.225 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:18.225 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:18.225 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:18.225 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:18.225 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:18.225 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:18.225 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:18.225 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:18.225 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.210+0000 7fad3d7fa640 4 set_mon_vals no callback set 2026-02-17T21:24:18.320 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.319+0000 7fad17fff640 1 -- 10.20.193.5:0/3581435699 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 6) ==== 100189+0+0 (secure 0 0 0) 0x7fad34024080 con 0x7fad400c7120 2026-02-17T21:24:18.320 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.319+0000 7fad17fff640 1 --2- 10.20.193.5:0/3581435699 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fad100791f0 0x7fad1007b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:18.321 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.320+0000 7fad3e7fc640 1 --2- 10.20.193.5:0/3581435699 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fad100791f0 0x7fad1007b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:18.321 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.320+0000 7fad3e7fc640 10 monclient: get_auth_request con 0x7fad100791f0 auth_method 0 2026-02-17T21:24:18.321 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.320+0000 7fad3e7fc640 1 --2- 10.20.193.5:0/3581435699 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fad100791f0 0x7fad1007b6b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fad28039000 tx=0x7fad28033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:24:18.322 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.320+0000 7fad17fff640 10 client.4294.objecter ms_handle_connect 0x7fad100791f0 2026-02-17T21:24:18.322 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.321+0000 7fad17fff640 1 -- 10.20.193.5:0/3581435699 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 2565+0+0 (secure 0 0 0) 0x7fad3405d8a0 con 0x7fad400c7120 2026-02-17T21:24:18.322 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.321+0000 7fad17fff640 10 client.4294.objecter ms_dispatch2 0x7fad40000b90 osd_map(19..19 src has 1..19) 2026-02-17T21:24:18.322 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.321+0000 7fad17fff640 3 client.4294.objecter handle_osd_map got epochs [19,19] > 0 2026-02-17T21:24:18.323 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.321+0000 7fad17fff640 3 client.4294.objecter handle_osd_map decoding full epoch 19 2026-02-17T21:24:18.323 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.321+0000 7fad17fff640 20 client.4294.objecter dump_active .. 0 homeless 2026-02-17T21:24:18.328 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.327+0000 7fad17fff640 1 -- 10.20.193.5:0/3581435699 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fad34061860 con 0x7fad400c7120 2026-02-17T21:24:18.328 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.327+0000 7fad17fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:24:18.329 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.327+0000 7fad17fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:24:18.419 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.418+0000 7fad4581b640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:24:18.420 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.418+0000 7fad4581b640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:24:18.420 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.418+0000 7fad4581b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:24:18.420 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.418+0000 7fad4581b640 1 -- 10.20.193.5:0/3581435699 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fad40075050 con 0x7fad400c7120 2026-02-17T21:24:18.431 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.429+0000 7fad17fff640 1 -- 10.20.193.5:0/3581435699 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12879 (secure 0 0 0) 0x7fad34065b60 con 0x7fad400c7120 2026-02-17T21:24:18.431 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.429+0000 7fad17fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:24:18.431 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.429+0000 7fad17fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:24:18.431 INFO:teuthology.misc.health.trial005.stdout: 2026-02-17T21:24:18.431 INFO:teuthology.misc.health.trial005.stdout:{"epoch":19,"fsid":"b1be373b-56c5-4b5b-a965-9bcc20042691","created":"2026-02-17T21:23:38.622021+0000","modified":"2026-02-17T21:23:44.366223+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:23:44.366223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8bffc5e9-1f92-4603-bf29-ce19225edc1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8ffdf919-2ec4-4c1f-a69f-aee5cea211e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d186244a-4bf7-416d-b6a0-0e0f5af50eb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"093b417e-53bf-4b60-a937-7c5ffee43e1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0a48e684-05b0-41b1-a553-022424011225","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d73b7c38-cef9-4993-b353-908c1d87603c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f7774c25-72e8-41b2-8634-517af7a213b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"30a68802-afce-499b-90ce-bd568bc69406","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"8b4a2001-3ac8-4756-9dcf-af38c6d12d44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"dfdfee67-eff6-4413-bd7a-adc0a019bfbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"fc24ee77-5a0d-41d4-88f5-8d03a77c7608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"1d737681-1923-453a-82f8-516eeb875559","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"c4f0322e-a862-4c5e-967e-4551087ede8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"0b5e9861-a194-4f11-a849-d8bb94ce95a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"6f182077-0c0d-481c-97b4-43ef48aa5aea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"537605ff-bedd-4f2b-922f-e2eaa8c17f48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:24:18.434 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.432+0000 7fad4581b640 10 librados: watch_flush enter 2026-02-17T21:24:18.434 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.432+0000 7fad4581b640 10 librados: watch_flush exit 2026-02-17T21:24:18.434 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.432+0000 7fad4581b640 20 client.4294.objecter shutdown clearing up homeless session... 2026-02-17T21:24:18.435 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.432+0000 7fad4581b640 10 client.4294.objecter successfully canceled tick 2026-02-17T21:24:18.435 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.432+0000 7fad4581b640 1 -- 10.20.193.5:0/3581435699 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fad100791f0 msgr2=0x7fad1007b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:18.435 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.432+0000 7fad4581b640 1 --2- 10.20.193.5:0/3581435699 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fad100791f0 0x7fad1007b6b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fad28039000 tx=0x7fad28033000 comp rx=0 tx=0).stop 2026-02-17T21:24:18.435 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.432+0000 7fad4581b640 10 monclient: shutdown 2026-02-17T21:24:18.435 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.432+0000 7fad4581b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:24:18.435 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.432+0000 7fad4581b640 1 -- 10.20.193.5:0/3581435699 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fad400c7120 msgr2=0x7fad400726b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:18.435 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.432+0000 7fad4581b640 1 --2- 10.20.193.5:0/3581435699 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fad400c7120 0x7fad400726b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fad3400c520 tx=0x7fad3400c9f0 comp rx=0 tx=0).stop 2026-02-17T21:24:18.435 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.432+0000 7fad4581b640 1 -- 10.20.193.5:0/3581435699 shutdown_connections 2026-02-17T21:24:18.435 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.432+0000 7fad4581b640 1 --2- 10.20.193.5:0/3581435699 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fad100791f0 0x7fad1007b6b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:18.435 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.432+0000 7fad4581b640 1 --2- 10.20.193.5:0/3581435699 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fad401504c0 0x7fad4014a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:18.436 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.432+0000 7fad4581b640 1 --2- 10.20.193.5:0/3581435699 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fad400c9050 0x7fad40145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:18.436 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.432+0000 7fad4581b640 1 --2- 10.20.193.5:0/3581435699 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fad400c7120 0x7fad400726b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:18.436 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.432+0000 7fad4581b640 1 -- 10.20.193.5:0/3581435699 >> 10.20.193.5:0/3581435699 conn(0x7fad400c9f30 msgr2=0x7fad4014cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:24:18.436 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.432+0000 7fad4581b640 1 -- 10.20.193.5:0/3581435699 shutdown_connections 2026-02-17T21:24:18.436 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.432+0000 7fad4581b640 1 -- 10.20.193.5:0/3581435699 wait complete. 2026-02-17T21:24:18.436 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:18.432+0000 7fad4581b640 1 librados: shutdown 2026-02-17T21:24:18.441 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T21:24:19.551 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:35.002 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:19.891 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:35.343 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:19.983 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:35.433 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:20.075 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:35.504 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:20.171 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:35.621 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:20.177 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:35.606 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:20.207 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:35.636 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:20.250 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:35.691 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:20.496 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:36.035 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:20.528 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:36.065 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:20.612 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:36.052 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:20.676 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:36.116 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:20.688 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:36.146 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:20.826 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:36.255 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:20.868 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:36.314 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:21.002 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:36.459 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:21.662 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:37.113 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:21.691 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:37.143 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:21.694 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:37.146 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.008 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:37.459 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.043 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:37.495 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.046 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:37.498 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.263 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:37.692 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.295 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:37.744 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.302 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:37.731 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.305 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:37.734 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.339 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:37.789 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.342 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:37.792 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.411 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:37.839 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.519 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:37.948 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.524 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:37.975 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.549 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:37.978 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.552 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:37.981 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.572 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:38.013 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.605 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:38.046 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.608 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:38.049 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.698 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:38.127 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.701 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:38.130 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.813 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:38.264 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.816 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:38.268 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.826 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:38.364 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.850 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:38.389 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.853 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:38.392 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.869 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:38.406 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.903 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:38.440 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.906 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:38.444 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.952 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:38.380 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.961 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:38.401 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.978 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:38.407 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.981 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:38.410 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:22.988 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:38.428 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:23.002 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:38.461 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:23.034 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:38.475 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:23.037 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:38.478 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:23.208 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:38.654 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:23.236 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:38.677 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:23.239 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:38.680 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:23.244 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:38.691 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:23.247 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:38.693 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:23.278 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:38.737 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:23.281 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:38.740 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:23.350 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:38.808 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:23.382 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:38.840 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:23.385 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:38.843 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:23.482 INFO:tasks.ceph.osd.1.trial119.stderr:==00:00:00:38.933 26517== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:23.839 INFO:tasks.ceph.osd.5.trial119.stderr:==00:00:00:39.290 26516== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:24.140 INFO:tasks.ceph.osd.13.trial119.stderr:==00:00:00:39.589 26519== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:24.176 INFO:tasks.ceph.osd.3.trial176.stderr:==00:00:00:39.604 26823== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:24.270 INFO:tasks.ceph.osd.11.trial176.stderr:==00:00:00:39.699 26825== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:24.388 INFO:tasks.ceph.osd.6.trial135.stderr:==00:00:00:39.829 26767== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:24.395 INFO:tasks.ceph.osd.9.trial119.stderr:==00:00:00:39.846 26518== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:24.441 INFO:tasks.ceph.osd.0.trial005.stderr:==00:00:00:39.980 26912== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:24.529 INFO:tasks.ceph.osd.7.trial176.stderr:==00:00:00:39.957 26824== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:24.713 INFO:tasks.ceph.osd.4.trial005.stderr:==00:00:00:40.250 26913== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:24.745 INFO:tasks.ceph.osd.14.trial135.stderr:==00:00:00:40.185 26769== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:24.833 INFO:tasks.ceph.osd.15.trial176.stderr:==00:00:00:40.262 26826== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:25.010 INFO:tasks.ceph.osd.12.trial005.stderr:==00:00:00:40.468 26989== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:25.063 INFO:tasks.ceph.osd.2.trial135.stderr:==00:00:00:40.509 26766== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:25.080 INFO:tasks.ceph.osd.10.trial135.stderr:==00:00:00:40.520 26768== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:25.082 INFO:tasks.ceph.osd.8.trial005.stderr:==00:00:00:40.539 26990== Warning: unimplemented fcntl command: 1038 2026-02-17T21:24:26.053 DEBUG:teuthology.orchestra.run.trial005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:24:26.114 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.112+0000 7f6bd4256640 10 monclient: get_monmap_and_config 2026-02-17T21:24:26.114 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.112+0000 7f6bd4256640 10 monclient: build_initial_monmap 2026-02-17T21:24:26.114 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.112+0000 7f6bd4256640 10 monclient: monmap: 2026-02-17T21:24:26.114 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:24:26.114 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:26.114 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:24:26.113570+0000 2026-02-17T21:24:26.115 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:24:26.113570+0000 2026-02-17T21:24:26.115 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:24:26.115 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:26.115 INFO:teuthology.misc.health.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:24:26.115 INFO:teuthology.misc.health.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:24:26.115 INFO:teuthology.misc.health.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:24:26.115 INFO:teuthology.misc.health.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:24:26.115 INFO:teuthology.misc.health.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:24:26.115 INFO:teuthology.misc.health.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:24:26.115 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:26.118 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.113+0000 7f6bd4256640 1 Processor -- start 2026-02-17T21:24:26.118 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.113+0000 7f6bd4256640 1 -- start start 2026-02-17T21:24:26.119 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.113+0000 7f6bd4256640 10 monclient: init 2026-02-17T21:24:26.119 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.113+0000 7f6bd4256640 10 monclient: _reopen_session rank -1 2026-02-17T21:24:26.119 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.113+0000 7f6bd4256640 10 monclient: _add_conns ranks=[2,3,5,0,4,1] 2026-02-17T21:24:26.119 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.113+0000 7f6bd4256640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6bcc155ed0 addr v1:10.20.193.135:6789/0 2026-02-17T21:24:26.119 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.113+0000 7f6bd4256640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f6bcc15d590 0x7f6bcc15d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:26.119 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.113+0000 7f6bd4256640 10 monclient(hunting): picked mon.noname-a con 0x7f6bcc15d590 addr v2:10.20.193.5:3300/0 2026-02-17T21:24:26.119 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.113+0000 7f6bd4256640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f6bcc15f450 0x7f6bcc15f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:26.119 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.113+0000 7f6bd4256640 10 monclient(hunting): picked mon.noname-c con 0x7f6bcc15f450 addr v2:10.20.193.135:3300/0 2026-02-17T21:24:26.119 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.113+0000 7f6bd4256640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bcc15fe00 con 0x7f6bcc155ed0 2026-02-17T21:24:26.119 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.113+0000 7f6bd4256640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:26.119 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.113+0000 7f6bd4256640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6bcc15df10 con 0x7f6bcc15d590 2026-02-17T21:24:26.120 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.113+0000 7f6bd4256640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:26.120 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.113+0000 7f6bd4256640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f6bcc0cd030 con 0x7f6bcc15f450 2026-02-17T21:24:26.120 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.113+0000 7f6bd4256640 10 monclient(hunting): _renew_subs 2026-02-17T21:24:26.120 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.113+0000 7f6bd4256640 10 monclient(hunting): authenticate will time out at 971.678936s 2026-02-17T21:24:26.120 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.114+0000 7f6bd17ca640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f6bcc15d590 0x7f6bcc15d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:26.120 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.114+0000 7f6bd17ca640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f6bcc15d590 0x7f6bcc15d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:49160/0 (socket says 10.20.193.5:49160) 2026-02-17T21:24:26.120 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.114+0000 7f6bd17ca640 1 -- 10.20.193.5:0/734622519 learned_addr learned my addr 10.20.193.5:0/734622519 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:24:26.120 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.114+0000 7f6bd17ca640 10 monclient(hunting): get_auth_request con 0x7f6bcc15d590 auth_method 0 2026-02-17T21:24:26.120 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.114+0000 7f6bd17ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:26.120 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.114+0000 7f6bd17ca640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:26.120 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.114+0000 7f6bd17ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:26.121 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.114+0000 7f6bd27cc640 1 --2- 10.20.193.5:0/734622519 >> v2:10.20.193.135:3300/0 conn(0x7f6bcc15f450 0x7f6bcc15f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:26.121 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.114+0000 7f6bd17ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:26.121 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.114+0000 7f6bd17ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:26.121 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.114+0000 7f6bd17ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:26.121 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.114+0000 7f6bd27cc640 10 monclient(hunting): get_auth_request con 0x7f6bcc15f450 auth_method 0 2026-02-17T21:24:26.121 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.114+0000 7f6bd27cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:26.121 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.114+0000 7f6bd27cc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:26.121 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.114+0000 7f6bd27cc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:26.121 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.115+0000 7f6bd27cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:26.121 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.115+0000 7f6bd27cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:26.121 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.115+0000 7f6bd27cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:26.121 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.115+0000 7f6bd17ca640 10 monclient(hunting): handle_auth_done global_id 4254 payload 274 2026-02-17T21:24:26.122 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.115+0000 7f6bd17ca640 1 -- 10.20.193.5:0/734622519 >> v2:10.20.193.135:3300/0 conn(0x7f6bcc15f450 msgr2=0x7f6bcc15f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:24:26.122 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.115+0000 7f6bd17ca640 1 --2- 10.20.193.5:0/734622519 >> v2:10.20.193.135:3300/0 conn(0x7f6bcc15f450 0x7f6bcc15f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:26.122 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.115+0000 7f6bd17ca640 1 -- 10.20.193.5:0/734622519 >> v1:10.20.193.135:6789/0 conn(0x7f6bcc155ed0 legacy=0x7f6bcc06f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:26.122 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.115+0000 7f6bd17ca640 10 monclient: _finish_hunting 0 2026-02-17T21:24:26.122 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.115+0000 7f6bd17ca640 1 monclient: found mon.noname-a 2026-02-17T21:24:26.122 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.115+0000 7f6bd17ca640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:24:26.122 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.115+0000 7f6bd17ca640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:24:26.122 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.115+0000 7f6bd17ca640 1 -- 10.20.193.5:0/734622519 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bcc0cd310 con 0x7f6bcc15d590 2026-02-17T21:24:26.122 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.116+0000 7f6bd17ca640 1 --2- 10.20.193.5:0/734622519 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6bcc15d590 0x7f6bcc15d9d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc077110 tx=0x7f6bc002eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5565a4473273715d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:24:26.128 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd0fc9640 1 -- 10.20.193.5:0/734622519 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc003c070 con 0x7f6bcc15d590 2026-02-17T21:24:26.128 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd0fc9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:26.128 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd0fc9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:24:26.129 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd0fc9640 10 monclient: dump: 2026-02-17T21:24:26.129 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:26.129 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:26.129 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:26.129 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:26.129 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:26.129 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:26.129 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:26.129 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:26.129 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:26.129 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:26.130 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd0fc9640 10 monclient: _finish_auth 0 2026-02-17T21:24:26.130 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd0fc9640 10 monclient: _check_auth_tickets 2026-02-17T21:24:26.130 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd0fc9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:24:26.130 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd0fc9640 1 -- 10.20.193.5:0/734622519 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bc002fbe0 con 0x7f6bcc15d590 2026-02-17T21:24:26.130 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd0fc9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:24:26.130 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd0fc9640 1 -- 10.20.193.5:0/734622519 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0037440 con 0x7f6bcc15d590 2026-02-17T21:24:26.130 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd0fc9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:26.130 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd0fc9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:24:26.130 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd0fc9640 10 monclient: dump: 2026-02-17T21:24:26.130 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:26.130 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:26.130 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:26.131 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:26.131 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:26.131 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:26.131 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:26.131 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:26.131 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:26.131 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:26.131 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd4256640 5 monclient: authenticate success, global_id 4254 2026-02-17T21:24:26.131 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd4256640 10 monclient: get_monmap_and_config success 2026-02-17T21:24:26.131 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd4256640 4 set_mon_vals no callback set 2026-02-17T21:24:26.131 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd4256640 10 monclient: shutdown 2026-02-17T21:24:26.131 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd4256640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:24:26.131 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd4256640 1 -- 10.20.193.5:0/734622519 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6bcc15d590 msgr2=0x7f6bcc15d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:26.132 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd4256640 1 --2- 10.20.193.5:0/734622519 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6bcc15d590 0x7f6bcc15d9d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc077110 tx=0x7f6bc002eed0 comp rx=0 tx=0).stop 2026-02-17T21:24:26.132 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd4256640 1 -- 10.20.193.5:0/734622519 shutdown_connections 2026-02-17T21:24:26.132 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd4256640 1 --2- 10.20.193.5:0/734622519 >> v2:10.20.193.135:3300/0 conn(0x7f6bcc15f450 0x7f6bcc15f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:26.132 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd4256640 1 --2- 10.20.193.5:0/734622519 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6bcc15d590 0x7f6bcc15d9d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:26.132 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd4256640 1 -- 10.20.193.5:0/734622519 >> 10.20.193.5:0/734622519 conn(0x7f6bcc0ce820 msgr2=0x7f6bcc0cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:24:26.132 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd4256640 1 -- 10.20.193.5:0/734622519 shutdown_connections 2026-02-17T21:24:26.132 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.118+0000 7f6bd4256640 1 -- 10.20.193.5:0/734622519 wait complete. 2026-02-17T21:24:26.132 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.119+0000 7f6bd4256640 10 monclient: build_initial_monmap 2026-02-17T21:24:26.132 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.119+0000 7f6bd4256640 10 monclient: monmap: 2026-02-17T21:24:26.132 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:24:26.132 INFO:teuthology.misc.health.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:24:26.132 INFO:teuthology.misc.health.trial005.stderr:last_changed 0.000000 2026-02-17T21:24:26.132 INFO:teuthology.misc.health.trial005.stderr:created 0.000000 2026-02-17T21:24:26.133 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:24:26.133 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:26.133 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:24:26.133 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:24:26.133 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:24:26.133 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:26.133 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.119+0000 7f6bd4256640 1 librados: starting msgr at 2026-02-17T21:24:26.133 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.119+0000 7f6bd4256640 1 librados: starting objecter 2026-02-17T21:24:26.133 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.119+0000 7f6bd4256640 1 Processor -- start 2026-02-17T21:24:26.133 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.119+0000 7f6bd4256640 1 -- start start 2026-02-17T21:24:26.133 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.119+0000 7f6bd4256640 1 librados: setting wanted keys 2026-02-17T21:24:26.133 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.119+0000 7f6bd4256640 1 librados: calling monclient init 2026-02-17T21:24:26.134 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.119+0000 7f6bd4256640 10 monclient: init 2026-02-17T21:24:26.134 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd4256640 10 monclient: _reopen_session rank -1 2026-02-17T21:24:26.134 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd4256640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:24:26.134 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd4256640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6bcc155ed0 0x7f6bcc0d1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:26.134 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd4256640 10 monclient(hunting): picked mon.noname-c con 0x7f6bcc155ed0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:24:26.134 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd4256640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6bcc15d590 0x7f6bcc154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:26.134 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd4256640 10 monclient(hunting): picked mon.noname-b con 0x7f6bcc15d590 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:24:26.134 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd4256640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6bcc15f450 0x7f6bcc151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:26.134 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd4256640 10 monclient(hunting): picked mon.noname-a con 0x7f6bcc15f450 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:24:26.134 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd4256640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:26.134 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd4256640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6bcc0cdbb0 con 0x7f6bcc15f450 2026-02-17T21:24:26.134 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd4256640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:26.134 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd4256640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6bcc0cd8d0 con 0x7f6bcc15d590 2026-02-17T21:24:26.135 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd4256640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:26.135 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd4256640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6bcc0cde90 con 0x7f6bcc155ed0 2026-02-17T21:24:26.135 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd4256640 10 monclient(hunting): _renew_subs 2026-02-17T21:24:26.135 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd4256640 10 monclient(hunting): authenticate will time out at 971.685076s 2026-02-17T21:24:26.135 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd27cc640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6bcc15f450 0x7f6bcc151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:26.135 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd27cc640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6bcc15f450 0x7f6bcc151390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:49162/0 (socket says 10.20.193.5:49162) 2026-02-17T21:24:26.135 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd27cc640 1 -- 10.20.193.5:0/2969315569 learned_addr learned my addr 10.20.193.5:0/2969315569 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:24:26.135 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd27cc640 10 monclient(hunting): get_auth_request con 0x7f6bcc15f450 auth_method 0 2026-02-17T21:24:26.135 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd27cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:26.135 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd27cc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:26.135 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd27cc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:26.135 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd27cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:26.136 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd27cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:26.136 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd17ca640 1 --2- 10.20.193.5:0/2969315569 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6bcc15d590 0x7f6bcc154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:26.136 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd27cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:26.136 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd17ca640 10 monclient(hunting): get_auth_request con 0x7f6bcc15d590 auth_method 0 2026-02-17T21:24:26.136 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd17ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:26.136 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd17ca640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:26.136 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.120+0000 7f6bd17ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:26.136 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.121+0000 7f6bd1fcb640 1 --2- 10.20.193.5:0/2969315569 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6bcc155ed0 0x7f6bcc0d1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:26.136 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.121+0000 7f6bd17ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:26.136 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.121+0000 7f6bd17ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:26.136 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.121+0000 7f6bd17ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:26.136 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.121+0000 7f6bd1fcb640 10 monclient(hunting): get_auth_request con 0x7f6bcc155ed0 auth_method 0 2026-02-17T21:24:26.136 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.121+0000 7f6bd1fcb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:26.137 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.121+0000 7f6bd1fcb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:26.137 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.121+0000 7f6bd1fcb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:26.137 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.121+0000 7f6bd1fcb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:26.137 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.121+0000 7f6bd1fcb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:26.137 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.121+0000 7f6bd1fcb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:26.137 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.122+0000 7f6bd27cc640 10 monclient(hunting): handle_auth_done global_id 4257 payload 824 2026-02-17T21:24:26.137 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.122+0000 7f6bd27cc640 1 -- 10.20.193.5:0/2969315569 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6bcc155ed0 msgr2=0x7f6bcc0d1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:26.137 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.122+0000 7f6bd27cc640 1 --2- 10.20.193.5:0/2969315569 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6bcc155ed0 0x7f6bcc0d1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:26.137 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.122+0000 7f6bd27cc640 1 -- 10.20.193.5:0/2969315569 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6bcc15d590 msgr2=0x7f6bcc154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:26.137 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.122+0000 7f6bd27cc640 1 --2- 10.20.193.5:0/2969315569 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6bcc15d590 0x7f6bcc154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:26.137 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.122+0000 7f6bd27cc640 10 monclient: _finish_hunting 0 2026-02-17T21:24:26.137 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.122+0000 7f6bd27cc640 1 monclient: found mon.noname-a 2026-02-17T21:24:26.137 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.122+0000 7f6bd27cc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:24:26.138 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.122+0000 7f6bd27cc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:24:26.138 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.122+0000 7f6bd27cc640 1 -- 10.20.193.5:0/2969315569 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bcc0d15b0 con 0x7f6bcc15f450 2026-02-17T21:24:26.138 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.123+0000 7f6bd27cc640 1 --2- 10.20.193.5:0/2969315569 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6bcc15f450 0x7f6bcc151390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8009d30 tx=0x7f6bc800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:24:26.138 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.123+0000 7f6bba7fc640 10 client.?.objecter ms_handle_connect 0x7f6bcc15f450 2026-02-17T21:24:26.138 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.123+0000 7f6bba7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:24:26.138 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.124+0000 7f6bba7fc640 1 -- 10.20.193.5:0/2969315569 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8018020 con 0x7f6bcc15f450 2026-02-17T21:24:26.138 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.124+0000 7f6bba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:26.138 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.124+0000 7f6bba7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:24:26.138 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.124+0000 7f6bba7fc640 10 monclient: dump: 2026-02-17T21:24:26.138 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:26.138 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:26.138 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:26.139 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:26.139 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:26.139 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:26.139 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:26.139 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:26.139 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:26.139 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:26.139 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.124+0000 7f6bba7fc640 10 monclient: _finish_auth 0 2026-02-17T21:24:26.139 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.124+0000 7f6bba7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:24:26.139 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.124+0000 7f6bba7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:24:26.139 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.124+0000 7f6bba7fc640 1 -- 10.20.193.5:0/2969315569 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bc8014480 con 0x7f6bcc15f450 2026-02-17T21:24:26.140 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.124+0000 7f6bd4256640 5 monclient: authenticate success, global_id 4257 2026-02-17T21:24:26.140 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.124+0000 7f6bba7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:24:26.140 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.124+0000 7f6bba7fc640 1 -- 10.20.193.5:0/2969315569 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8014870 con 0x7f6bcc15f450 2026-02-17T21:24:26.140 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.124+0000 7f6bba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:26.140 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.124+0000 7f6bba7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:24:26.140 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.124+0000 7f6bba7fc640 10 monclient: dump: 2026-02-17T21:24:26.140 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:26.140 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:26.140 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:26.140 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:26.140 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:26.140 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:26.140 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:26.141 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:26.141 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:26.141 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:26.141 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.124+0000 7f6bbbfff640 4 set_mon_vals no callback set 2026-02-17T21:24:26.141 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.124+0000 7f6bd4256640 10 monclient: _renew_subs 2026-02-17T21:24:26.141 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.124+0000 7f6bd4256640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:24:26.141 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.124+0000 7f6bd4256640 1 -- 10.20.193.5:0/2969315569 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bcc1502f0 con 0x7f6bcc15f450 2026-02-17T21:24:26.141 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.124+0000 7f6bd4256640 10 client.4257.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:24:26.141 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.124+0000 7f6bd4256640 10 monclient: _renew_subs 2026-02-17T21:24:26.141 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.124+0000 7f6bd4256640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:24:26.141 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.124+0000 7f6bd4256640 1 -- 10.20.193.5:0/2969315569 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bcc1508b0 con 0x7f6bcc15f450 2026-02-17T21:24:26.141 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.124+0000 7f6bd4256640 1 librados: init done 2026-02-17T21:24:26.141 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.125+0000 7f6bd4256640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:24:26.142 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.125+0000 7f6bd4256640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:24:26.142 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.125+0000 7f6bd4256640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:24:26.142 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.125+0000 7f6bd4256640 1 -- 10.20.193.5:0/2969315569 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bcc1562b0 con 0x7f6bcc15f450 2026-02-17T21:24:26.143 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.137+0000 7f6bba7fc640 1 -- 10.20.193.5:0/2969315569 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 6) ==== 100189+0+0 (secure 0 0 0) 0x7f6bc8014a10 con 0x7f6bcc15f450 2026-02-17T21:24:26.143 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.138+0000 7f6bba7fc640 1 --2- 10.20.193.5:0/2969315569 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6b9c079240 0x7f6b9c07b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:26.143 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.138+0000 7f6bd1fcb640 1 --2- 10.20.193.5:0/2969315569 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6b9c079240 0x7f6b9c07b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:26.143 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.138+0000 7f6bd1fcb640 10 monclient: get_auth_request con 0x7f6b9c079240 auth_method 0 2026-02-17T21:24:26.143 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.138+0000 7f6bba7fc640 10 client.4257.objecter ms_handle_connect 0x7f6b9c079240 2026-02-17T21:24:26.144 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.138+0000 7f6bd1fcb640 1 --2- 10.20.193.5:0/2969315569 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6b9c079240 0x7f6b9c07b700 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc15ffd0 tx=0x7f6bbc007f50 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:24:26.144 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.140+0000 7f6bba7fc640 1 -- 10.20.193.5:0/2969315569 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 2565+0+0 (secure 0 0 0) 0x7f6bc805f110 con 0x7f6bcc15f450 2026-02-17T21:24:26.144 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.140+0000 7f6bba7fc640 10 client.4257.objecter ms_dispatch2 0x7f6bcc000b90 osd_map(19..19 src has 1..19) 2026-02-17T21:24:26.144 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.140+0000 7f6bba7fc640 3 client.4257.objecter handle_osd_map got epochs [19,19] > 0 2026-02-17T21:24:26.144 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.140+0000 7f6bba7fc640 3 client.4257.objecter handle_osd_map decoding full epoch 19 2026-02-17T21:24:26.144 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.140+0000 7f6bba7fc640 20 client.4257.objecter dump_active .. 0 homeless 2026-02-17T21:24:26.248 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.247+0000 7f6bba7fc640 1 -- 10.20.193.5:0/2969315569 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6bc8022070 con 0x7f6bcc15f450 2026-02-17T21:24:26.248 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.247+0000 7f6bba7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:24:26.248 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.247+0000 7f6bba7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:24:26.335 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.334+0000 7f6bd4256640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:24:26.336 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.334+0000 7f6bd4256640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:24:26.336 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.334+0000 7f6bd4256640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:24:26.336 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.334+0000 7f6bd4256640 1 -- 10.20.193.5:0/2969315569 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6bcc159880 con 0x7f6bcc15f450 2026-02-17T21:24:26.346 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.345+0000 7f6bba7fc640 1 -- 10.20.193.5:0/2969315569 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12879 (secure 0 0 0) 0x7f6bc8010040 con 0x7f6bcc15f450 2026-02-17T21:24:26.346 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.345+0000 7f6bba7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:24:26.347 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.345+0000 7f6bba7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:24:26.347 INFO:teuthology.misc.health.trial005.stdout: 2026-02-17T21:24:26.347 INFO:teuthology.misc.health.trial005.stdout:{"epoch":19,"fsid":"b1be373b-56c5-4b5b-a965-9bcc20042691","created":"2026-02-17T21:23:38.622021+0000","modified":"2026-02-17T21:23:44.366223+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:23:44.366223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8bffc5e9-1f92-4603-bf29-ce19225edc1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8ffdf919-2ec4-4c1f-a69f-aee5cea211e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d186244a-4bf7-416d-b6a0-0e0f5af50eb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"093b417e-53bf-4b60-a937-7c5ffee43e1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0a48e684-05b0-41b1-a553-022424011225","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d73b7c38-cef9-4993-b353-908c1d87603c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f7774c25-72e8-41b2-8634-517af7a213b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"30a68802-afce-499b-90ce-bd568bc69406","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"8b4a2001-3ac8-4756-9dcf-af38c6d12d44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"dfdfee67-eff6-4413-bd7a-adc0a019bfbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"fc24ee77-5a0d-41d4-88f5-8d03a77c7608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"1d737681-1923-453a-82f8-516eeb875559","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"c4f0322e-a862-4c5e-967e-4551087ede8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"0b5e9861-a194-4f11-a849-d8bb94ce95a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"6f182077-0c0d-481c-97b4-43ef48aa5aea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"537605ff-bedd-4f2b-922f-e2eaa8c17f48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:24:26.350 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.347+0000 7f6bd4256640 10 librados: watch_flush enter 2026-02-17T21:24:26.350 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.347+0000 7f6bd4256640 10 librados: watch_flush exit 2026-02-17T21:24:26.350 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.347+0000 7f6bd4256640 20 client.4257.objecter shutdown clearing up homeless session... 2026-02-17T21:24:26.350 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.347+0000 7f6bd4256640 10 client.4257.objecter successfully canceled tick 2026-02-17T21:24:26.350 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.347+0000 7f6bd4256640 1 -- 10.20.193.5:0/2969315569 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6b9c079240 msgr2=0x7f6b9c07b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:26.350 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.347+0000 7f6bd4256640 1 --2- 10.20.193.5:0/2969315569 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6b9c079240 0x7f6b9c07b700 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc15ffd0 tx=0x7f6bbc007f50 comp rx=0 tx=0).stop 2026-02-17T21:24:26.350 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.347+0000 7f6bd4256640 10 monclient: shutdown 2026-02-17T21:24:26.350 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.347+0000 7f6bd4256640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:24:26.350 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.347+0000 7f6bd4256640 1 -- 10.20.193.5:0/2969315569 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6bcc15f450 msgr2=0x7f6bcc151390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:26.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.347+0000 7f6bd4256640 1 --2- 10.20.193.5:0/2969315569 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6bcc15f450 0x7f6bcc151390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8009d30 tx=0x7f6bc800c490 comp rx=0 tx=0).stop 2026-02-17T21:24:26.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.347+0000 7f6bd4256640 1 -- 10.20.193.5:0/2969315569 shutdown_connections 2026-02-17T21:24:26.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.347+0000 7f6bd4256640 1 --2- 10.20.193.5:0/2969315569 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6b9c079240 0x7f6b9c07b700 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:26.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.347+0000 7f6bd4256640 1 --2- 10.20.193.5:0/2969315569 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6bcc15f450 0x7f6bcc151390 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:26.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.347+0000 7f6bd4256640 1 --2- 10.20.193.5:0/2969315569 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6bcc15d590 0x7f6bcc154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:26.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.347+0000 7f6bd4256640 1 --2- 10.20.193.5:0/2969315569 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6bcc155ed0 0x7f6bcc0d1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:26.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.347+0000 7f6bd4256640 1 -- 10.20.193.5:0/2969315569 >> 10.20.193.5:0/2969315569 conn(0x7f6bcc0ce820 msgr2=0x7f6bcc15e130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:24:26.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.347+0000 7f6bd4256640 1 -- 10.20.193.5:0/2969315569 shutdown_connections 2026-02-17T21:24:26.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.347+0000 7f6bd4256640 1 -- 10.20.193.5:0/2969315569 wait complete. 2026-02-17T21:24:26.351 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:26.347+0000 7f6bd4256640 1 librados: shutdown 2026-02-17T21:24:26.357 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T21:24:32.194 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:01:11.820 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:24:32.243 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:01:11.829 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:24:32.253 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:01:11.878 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:24:32.271 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:01:11.857 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:24:32.274 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:01:11.898 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:24:32.303 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:01:11.926 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:24:32.382 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:01:12.007 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:24:32.396 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:01:11.982 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:24:32.426 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:01:12.049 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:24:33.970 DEBUG:teuthology.orchestra.run.trial005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:24:34.036 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.034+0000 7fd5074da640 10 monclient: get_monmap_and_config 2026-02-17T21:24:34.036 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.034+0000 7fd5074da640 10 monclient: build_initial_monmap 2026-02-17T21:24:34.036 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.034+0000 7fd5074da640 10 monclient: monmap: 2026-02-17T21:24:34.036 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:24:34.036 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:34.036 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:24:34.035878+0000 2026-02-17T21:24:34.036 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:24:34.035878+0000 2026-02-17T21:24:34.036 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:24:34.036 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:34.036 INFO:teuthology.misc.health.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:24:34.036 INFO:teuthology.misc.health.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:24:34.036 INFO:teuthology.misc.health.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:24:34.037 INFO:teuthology.misc.health.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:24:34.037 INFO:teuthology.misc.health.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:24:34.037 INFO:teuthology.misc.health.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:24:34.037 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:34.038 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.034+0000 7fd5074da640 1 Processor -- start 2026-02-17T21:24:34.038 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.034+0000 7fd5074da640 1 -- start start 2026-02-17T21:24:34.038 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.034+0000 7fd5074da640 10 monclient: init 2026-02-17T21:24:34.038 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.035+0000 7fd5074da640 10 monclient: _reopen_session rank -1 2026-02-17T21:24:34.038 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.035+0000 7fd5074da640 10 monclient: _add_conns ranks=[2,1,4,5,0,3] 2026-02-17T21:24:34.038 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.035+0000 7fd5074da640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd50015f6e0 addr v1:10.20.193.135:6789/0 2026-02-17T21:24:34.038 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.035+0000 7fd5074da640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fd5000d23f0 addr v1:10.20.193.119:6789/0 2026-02-17T21:24:34.038 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.035+0000 7fd5074da640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fd5000c98e0 0x7fd5000c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:34.038 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.035+0000 7fd5074da640 10 monclient(hunting): picked mon.noname-b con 0x7fd5000c98e0 addr v2:10.20.193.119:3300/0 2026-02-17T21:24:34.038 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.035+0000 7fd5074da640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5000cd780 con 0x7fd5000d23f0 2026-02-17T21:24:34.038 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.035+0000 7fd5074da640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5000ccd00 con 0x7fd50015f6e0 2026-02-17T21:24:34.038 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.035+0000 7fd5074da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:34.038 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.035+0000 7fd5074da640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fd5000ca250 con 0x7fd5000c98e0 2026-02-17T21:24:34.038 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.035+0000 7fd5074da640 10 monclient(hunting): _renew_subs 2026-02-17T21:24:34.038 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.035+0000 7fd5074da640 10 monclient(hunting): authenticate will time out at 979.601274s 2026-02-17T21:24:34.038 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.035+0000 7fd50524f640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7fd50015f6e0 0x7fd5000cb6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:48814/0 (socket says 10.20.193.5:48814) 2026-02-17T21:24:34.038 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.035+0000 7fd50524f640 1 -- 10.20.193.5:0/192385862 learned_addr learned my addr 10.20.193.5:0/192385862 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:24:34.039 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.036+0000 7fd505a50640 1 --2- 10.20.193.5:0/192385862 >> v2:10.20.193.119:3300/0 conn(0x7fd5000c98e0 0x7fd5000c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:34.039 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.036+0000 7fd505a50640 10 monclient(hunting): get_auth_request con 0x7fd5000c98e0 auth_method 0 2026-02-17T21:24:34.039 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.036+0000 7fd505a50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:34.039 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.036+0000 7fd505a50640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:34.039 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.036+0000 7fd505a50640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:34.040 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.037+0000 7fd4effff640 1 -- 10.20.193.5:0/192385862 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 639612962 0 0) 0x7fd5000ccd00 con 0x7fd50015f6e0 2026-02-17T21:24:34.040 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.037+0000 7fd4effff640 10 monclient(hunting): _negotiate 2026-02-17T21:24:34.040 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.037+0000 7fd4effff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:34.041 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.037+0000 7fd4effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:34.041 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.037+0000 7fd4effff640 10 monclient(hunting): my global_id is 4301 2026-02-17T21:24:34.041 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.037+0000 7fd4effff640 1 -- 10.20.193.5:0/192385862 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4e8003620 con 0x7fd50015f6e0 2026-02-17T21:24:34.041 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.038+0000 7fd505a50640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:34.041 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.038+0000 7fd505a50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:34.041 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.038+0000 7fd505a50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:34.041 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.038+0000 7fd4effff640 1 -- 10.20.193.5:0/192385862 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 235849939 0 0) 0x7fd5000cd780 con 0x7fd5000d23f0 2026-02-17T21:24:34.041 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.038+0000 7fd4effff640 10 monclient(hunting): _negotiate 2026-02-17T21:24:34.041 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.038+0000 7fd4effff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:34.041 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.038+0000 7fd4effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:34.041 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.038+0000 7fd4effff640 10 monclient(hunting): my global_id is 4300 2026-02-17T21:24:34.041 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.038+0000 7fd4effff640 1 -- 10.20.193.5:0/192385862 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5000ccd00 con 0x7fd5000d23f0 2026-02-17T21:24:34.042 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.039+0000 7fd505a50640 10 monclient(hunting): handle_auth_done global_id 4303 payload 274 2026-02-17T21:24:34.042 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.039+0000 7fd505a50640 1 -- 10.20.193.5:0/192385862 >> v1:10.20.193.135:6789/0 conn(0x7fd50015f6e0 legacy=0x7fd5000cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:34.042 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.039+0000 7fd505a50640 1 -- 10.20.193.5:0/192385862 >> v1:10.20.193.119:6789/0 conn(0x7fd5000d23f0 legacy=0x7fd50015fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:34.042 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.039+0000 7fd505a50640 10 monclient: _finish_hunting 0 2026-02-17T21:24:34.042 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.039+0000 7fd505a50640 1 monclient: found mon.noname-b 2026-02-17T21:24:34.042 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.039+0000 7fd505a50640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:24:34.042 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.039+0000 7fd505a50640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:24:34.042 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.039+0000 7fd505a50640 1 -- 10.20.193.5:0/192385862 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5000ccfa0 con 0x7fd5000c98e0 2026-02-17T21:24:34.044 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.042+0000 7fd505a50640 1 --2- 10.20.193.5:0/192385862 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd5000c98e0 0x7fd5000c9d10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009d90 tx=0x7fd4fc02f2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0abda0c0243ede1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:24:34.047 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.044+0000 7fd4effff640 1 -- 10.20.193.5:0/192385862 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc03c070 con 0x7fd5000c98e0 2026-02-17T21:24:34.047 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.044+0000 7fd4effff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:34.047 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.044+0000 7fd4effff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:24:34.047 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.044+0000 7fd4effff640 10 monclient: dump: 2026-02-17T21:24:34.047 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:34.047 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:34.047 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:34.047 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:34.047 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:34.047 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:34.047 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:34.047 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:34.047 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:34.047 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:34.047 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.044+0000 7fd4effff640 10 monclient: _finish_auth 0 2026-02-17T21:24:34.047 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.044+0000 7fd4effff640 10 monclient: _check_auth_tickets 2026-02-17T21:24:34.047 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.044+0000 7fd4effff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:24:34.047 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.044+0000 7fd4effff640 1 -- 10.20.193.5:0/192385862 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4fc037440 con 0x7fd5000c98e0 2026-02-17T21:24:34.047 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.044+0000 7fd5074da640 5 monclient: authenticate success, global_id 4303 2026-02-17T21:24:34.047 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.044+0000 7fd5074da640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:24:34.047 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.044+0000 7fd4effff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:24:34.047 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.044+0000 7fd4effff640 1 -- 10.20.193.5:0/192385862 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc037810 con 0x7fd5000c98e0 2026-02-17T21:24:34.048 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.044+0000 7fd5074da640 10 monclient: get_monmap_and_config success 2026-02-17T21:24:34.048 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.044+0000 7fd4effff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:34.048 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.044+0000 7fd5074da640 4 set_mon_vals no callback set 2026-02-17T21:24:34.048 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.044+0000 7fd4effff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:24:34.048 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.044+0000 7fd4effff640 10 monclient: dump: 2026-02-17T21:24:34.048 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:34.048 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:34.048 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:34.048 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:34.048 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:34.048 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:34.048 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:34.048 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:34.048 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:34.048 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:34.050 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.045+0000 7fd5074da640 10 monclient: shutdown 2026-02-17T21:24:34.050 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.045+0000 7fd5074da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:24:34.050 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.045+0000 7fd5074da640 1 -- 10.20.193.5:0/192385862 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd5000c98e0 msgr2=0x7fd5000c9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:34.050 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.045+0000 7fd5074da640 1 --2- 10.20.193.5:0/192385862 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd5000c98e0 0x7fd5000c9d10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009d90 tx=0x7fd4fc02f2c0 comp rx=0 tx=0).stop 2026-02-17T21:24:34.050 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.045+0000 7fd5074da640 1 -- 10.20.193.5:0/192385862 shutdown_connections 2026-02-17T21:24:34.050 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.045+0000 7fd5074da640 1 --2- 10.20.193.5:0/192385862 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd5000c98e0 0x7fd5000c9d10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:34.050 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.045+0000 7fd5074da640 1 -- 10.20.193.5:0/192385862 >> 10.20.193.5:0/192385862 conn(0x7fd5000d18d0 msgr2=0x7fd5000d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:24:34.050 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.045+0000 7fd5074da640 1 -- 10.20.193.5:0/192385862 shutdown_connections 2026-02-17T21:24:34.050 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.045+0000 7fd5074da640 1 -- 10.20.193.5:0/192385862 wait complete. 2026-02-17T21:24:34.050 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.045+0000 7fd5074da640 10 monclient: build_initial_monmap 2026-02-17T21:24:34.050 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.045+0000 7fd5074da640 10 monclient: monmap: 2026-02-17T21:24:34.051 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:24:34.051 INFO:teuthology.misc.health.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:24:34.051 INFO:teuthology.misc.health.trial005.stderr:last_changed 0.000000 2026-02-17T21:24:34.051 INFO:teuthology.misc.health.trial005.stderr:created 0.000000 2026-02-17T21:24:34.051 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:24:34.051 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:34.051 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:24:34.051 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:24:34.051 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:24:34.051 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:34.051 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.045+0000 7fd5074da640 1 librados: starting msgr at 2026-02-17T21:24:34.051 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.045+0000 7fd5074da640 1 librados: starting objecter 2026-02-17T21:24:34.051 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.045+0000 7fd5074da640 1 Processor -- start 2026-02-17T21:24:34.051 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.045+0000 7fd5074da640 1 -- start start 2026-02-17T21:24:34.051 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.045+0000 7fd5074da640 1 librados: setting wanted keys 2026-02-17T21:24:34.051 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.045+0000 7fd5074da640 1 librados: calling monclient init 2026-02-17T21:24:34.052 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.045+0000 7fd5074da640 10 monclient: init 2026-02-17T21:24:34.052 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.046+0000 7fd5074da640 10 monclient: _reopen_session rank -1 2026-02-17T21:24:34.052 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.046+0000 7fd5074da640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:24:34.052 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.046+0000 7fd5074da640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd5000c98e0 0x7fd5001f4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:34.052 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.046+0000 7fd5074da640 10 monclient(hunting): picked mon.noname-b con 0x7fd5000c98e0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:24:34.052 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.046+0000 7fd5074da640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd5000d23f0 0x7fd50015e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:34.052 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.046+0000 7fd5074da640 10 monclient(hunting): picked mon.noname-a con 0x7fd5000d23f0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:24:34.052 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.046+0000 7fd5074da640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd50015f6e0 0x7fd5001470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:34.052 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.046+0000 7fd5074da640 10 monclient(hunting): picked mon.noname-c con 0x7fd50015f6e0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:24:34.052 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.046+0000 7fd5074da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:34.052 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.046+0000 7fd5074da640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd5000d2840 con 0x7fd5000d23f0 2026-02-17T21:24:34.052 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.046+0000 7fd5074da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:34.052 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.046+0000 7fd5074da640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd5000cd280 con 0x7fd5000c98e0 2026-02-17T21:24:34.052 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.046+0000 7fd5074da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:34.053 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.046+0000 7fd5074da640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd5000c90e0 con 0x7fd50015f6e0 2026-02-17T21:24:34.053 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.046+0000 7fd5074da640 10 monclient(hunting): _renew_subs 2026-02-17T21:24:34.053 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.046+0000 7fd5074da640 10 monclient(hunting): authenticate will time out at 979.612319s 2026-02-17T21:24:34.053 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.046+0000 7fd50524f640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd5000c98e0 0x7fd5001f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:34.053 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.046+0000 7fd505a50640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd50015f6e0 0x7fd5001470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:34.053 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.046+0000 7fd504a4e640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd5000d23f0 0x7fd50015e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:34.053 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.046+0000 7fd50524f640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd5000c98e0 0x7fd5001f4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:58834/0 (socket says 10.20.193.5:58834) 2026-02-17T21:24:34.053 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.046+0000 7fd50524f640 1 -- 10.20.193.5:0/3096309149 learned_addr learned my addr 10.20.193.5:0/3096309149 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:24:34.053 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.046+0000 7fd50524f640 10 monclient(hunting): get_auth_request con 0x7fd5000c98e0 auth_method 0 2026-02-17T21:24:34.053 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.047+0000 7fd50524f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:34.053 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.047+0000 7fd50524f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:34.053 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.047+0000 7fd50524f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:34.053 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.047+0000 7fd505a50640 10 monclient(hunting): get_auth_request con 0x7fd50015f6e0 auth_method 0 2026-02-17T21:24:34.053 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.047+0000 7fd505a50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:34.053 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.047+0000 7fd505a50640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:34.053 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.047+0000 7fd505a50640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:34.054 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.047+0000 7fd504a4e640 10 monclient(hunting): get_auth_request con 0x7fd5000d23f0 auth_method 0 2026-02-17T21:24:34.054 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.047+0000 7fd504a4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:34.054 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.047+0000 7fd504a4e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:34.054 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.047+0000 7fd504a4e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:34.054 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.047+0000 7fd50524f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:34.054 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.047+0000 7fd50524f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:34.054 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.047+0000 7fd50524f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:34.054 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.047+0000 7fd505a50640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:34.054 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.047+0000 7fd505a50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:34.054 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.047+0000 7fd505a50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:34.054 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.047+0000 7fd504a4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:34.054 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.047+0000 7fd504a4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:34.054 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.047+0000 7fd504a4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:34.055 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.049+0000 7fd50524f640 10 monclient(hunting): handle_auth_done global_id 4306 payload 824 2026-02-17T21:24:34.055 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.049+0000 7fd50524f640 1 -- 10.20.193.5:0/3096309149 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd50015f6e0 msgr2=0x7fd5001470d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:34.055 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.049+0000 7fd50524f640 1 --2- 10.20.193.5:0/3096309149 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd50015f6e0 0x7fd5001470d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:34.055 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.049+0000 7fd50524f640 1 -- 10.20.193.5:0/3096309149 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd5000d23f0 msgr2=0x7fd50015e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:34.055 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.049+0000 7fd50524f640 1 --2- 10.20.193.5:0/3096309149 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd5000d23f0 0x7fd50015e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.049+0000 7fd50524f640 10 monclient: _finish_hunting 0 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.049+0000 7fd50524f640 1 monclient: found mon.noname-b 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.049+0000 7fd50524f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.049+0000 7fd50524f640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.049+0000 7fd50524f640 1 -- 10.20.193.5:0/3096309149 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd500146030 con 0x7fd5000c98e0 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.050+0000 7fd50524f640 1 --2- 10.20.193.5:0/3096309149 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd5000c98e0 0x7fd5001f4860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd4f000c520 tx=0x7fd4f000c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.050+0000 7fd4edffb640 10 client.?.objecter ms_handle_connect 0x7fd5000c98e0 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.050+0000 7fd4edffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.052+0000 7fd4edffb640 1 -- 10.20.193.5:0/3096309149 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f0017070 con 0x7fd5000c98e0 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.052+0000 7fd4edffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.052+0000 7fd4edffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.052+0000 7fd4edffb640 10 monclient: dump: 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.052+0000 7fd4edffb640 10 monclient: _finish_auth 0 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.052+0000 7fd4edffb640 10 monclient: _check_auth_tickets 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.052+0000 7fd4edffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.052+0000 7fd4edffb640 1 -- 10.20.193.5:0/3096309149 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f0005e00 con 0x7fd5000c98e0 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.052+0000 7fd5074da640 5 monclient: authenticate success, global_id 4306 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.052+0000 7fd5074da640 10 monclient: _renew_subs 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.052+0000 7fd5074da640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.052+0000 7fd5074da640 1 -- 10.20.193.5:0/3096309149 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd500146310 con 0x7fd5000c98e0 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.052+0000 7fd4edffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.052+0000 7fd4edffb640 1 -- 10.20.193.5:0/3096309149 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f00072b0 con 0x7fd5000c98e0 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.052+0000 7fd4edffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.052+0000 7fd4edffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.052+0000 7fd4edffb640 10 monclient: dump: 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:34.056 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:34.057 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:34.057 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:34.057 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:34.057 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:34.057 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.052+0000 7fd4ef7fe640 4 set_mon_vals no callback set 2026-02-17T21:24:34.057 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.052+0000 7fd5074da640 10 client.4306.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:24:34.057 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.052+0000 7fd5074da640 10 monclient: _renew_subs 2026-02-17T21:24:34.057 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.052+0000 7fd5074da640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:24:34.057 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.052+0000 7fd5074da640 1 -- 10.20.193.5:0/3096309149 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5001468d0 con 0x7fd5000c98e0 2026-02-17T21:24:34.057 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.052+0000 7fd5074da640 1 librados: init done 2026-02-17T21:24:34.057 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.052+0000 7fd5074da640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:24:34.057 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.053+0000 7fd5074da640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:24:34.057 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.053+0000 7fd5074da640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:24:34.057 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.053+0000 7fd5074da640 1 -- 10.20.193.5:0/3096309149 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5000c93c0 con 0x7fd5000c98e0 2026-02-17T21:24:34.065 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.064+0000 7fd4edffb640 1 -- 10.20.193.5:0/3096309149 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 6) ==== 100189+0+0 (secure 0 0 0) 0x7fd4f0007510 con 0x7fd5000c98e0 2026-02-17T21:24:34.066 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.064+0000 7fd4edffb640 1 --2- 10.20.193.5:0/3096309149 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd4d00791f0 0x7fd4d007b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:34.066 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.064+0000 7fd504a4e640 1 --2- 10.20.193.5:0/3096309149 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd4d00791f0 0x7fd4d007b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:34.066 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.064+0000 7fd504a4e640 10 monclient: get_auth_request con 0x7fd4d00791f0 auth_method 0 2026-02-17T21:24:34.067 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.065+0000 7fd4edffb640 10 client.4306.objecter ms_handle_connect 0x7fd4d00791f0 2026-02-17T21:24:34.067 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.065+0000 7fd504a4e640 1 --2- 10.20.193.5:0/3096309149 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd4d00791f0 0x7fd4d007b6b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4002410 tx=0x7fd4f4003d50 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:24:34.068 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.066+0000 7fd4edffb640 1 -- 10.20.193.5:0/3096309149 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 2565+0+0 (secure 0 0 0) 0x7fd4f005db00 con 0x7fd5000c98e0 2026-02-17T21:24:34.068 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.066+0000 7fd4edffb640 10 client.4306.objecter ms_dispatch2 0x7fd500000b90 osd_map(19..19 src has 1..19) 2026-02-17T21:24:34.069 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.066+0000 7fd4edffb640 3 client.4306.objecter handle_osd_map got epochs [19,19] > 0 2026-02-17T21:24:34.069 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.066+0000 7fd4edffb640 3 client.4306.objecter handle_osd_map decoding full epoch 19 2026-02-17T21:24:34.069 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.066+0000 7fd4edffb640 20 client.4306.objecter dump_active .. 0 homeless 2026-02-17T21:24:34.173 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.171+0000 7fd4edffb640 1 -- 10.20.193.5:0/3096309149 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd4f0021070 con 0x7fd5000c98e0 2026-02-17T21:24:34.173 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.171+0000 7fd4edffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:24:34.173 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.171+0000 7fd4edffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:24:34.262 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.260+0000 7fd5074da640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:24:34.262 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.260+0000 7fd5074da640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:24:34.262 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.260+0000 7fd5074da640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:24:34.262 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.260+0000 7fd5074da640 1 -- 10.20.193.5:0/3096309149 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd50006f260 con 0x7fd5000c98e0 2026-02-17T21:24:34.278 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.276+0000 7fd4edffb640 1 -- 10.20.193.5:0/3096309149 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12879 (secure 0 0 0) 0x7fd4f0061ac0 con 0x7fd5000c98e0 2026-02-17T21:24:34.278 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.276+0000 7fd4edffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:24:34.279 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.276+0000 7fd4edffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:24:34.279 INFO:teuthology.misc.health.trial005.stdout: 2026-02-17T21:24:34.279 INFO:teuthology.misc.health.trial005.stdout:{"epoch":19,"fsid":"b1be373b-56c5-4b5b-a965-9bcc20042691","created":"2026-02-17T21:23:38.622021+0000","modified":"2026-02-17T21:23:44.366223+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:23:44.366223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8bffc5e9-1f92-4603-bf29-ce19225edc1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8ffdf919-2ec4-4c1f-a69f-aee5cea211e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d186244a-4bf7-416d-b6a0-0e0f5af50eb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"093b417e-53bf-4b60-a937-7c5ffee43e1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0a48e684-05b0-41b1-a553-022424011225","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d73b7c38-cef9-4993-b353-908c1d87603c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f7774c25-72e8-41b2-8634-517af7a213b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"30a68802-afce-499b-90ce-bd568bc69406","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"8b4a2001-3ac8-4756-9dcf-af38c6d12d44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"dfdfee67-eff6-4413-bd7a-adc0a019bfbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"fc24ee77-5a0d-41d4-88f5-8d03a77c7608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"1d737681-1923-453a-82f8-516eeb875559","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"c4f0322e-a862-4c5e-967e-4551087ede8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"0b5e9861-a194-4f11-a849-d8bb94ce95a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"6f182077-0c0d-481c-97b4-43ef48aa5aea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"537605ff-bedd-4f2b-922f-e2eaa8c17f48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:24:34.282 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.279+0000 7fd5074da640 10 librados: watch_flush enter 2026-02-17T21:24:34.282 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.279+0000 7fd5074da640 10 librados: watch_flush exit 2026-02-17T21:24:34.282 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.279+0000 7fd5074da640 20 client.4306.objecter shutdown clearing up homeless session... 2026-02-17T21:24:34.282 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.279+0000 7fd5074da640 10 client.4306.objecter successfully canceled tick 2026-02-17T21:24:34.282 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.279+0000 7fd5074da640 1 -- 10.20.193.5:0/3096309149 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd4d00791f0 msgr2=0x7fd4d007b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:34.283 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.279+0000 7fd5074da640 1 --2- 10.20.193.5:0/3096309149 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd4d00791f0 0x7fd4d007b6b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4002410 tx=0x7fd4f4003d50 comp rx=0 tx=0).stop 2026-02-17T21:24:34.283 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.279+0000 7fd5074da640 10 monclient: shutdown 2026-02-17T21:24:34.283 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.279+0000 7fd5074da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:24:34.283 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.279+0000 7fd5074da640 1 -- 10.20.193.5:0/3096309149 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd5000c98e0 msgr2=0x7fd5001f4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:34.283 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.279+0000 7fd5074da640 1 --2- 10.20.193.5:0/3096309149 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd5000c98e0 0x7fd5001f4860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd4f000c520 tx=0x7fd4f000c9f0 comp rx=0 tx=0).stop 2026-02-17T21:24:34.283 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.279+0000 7fd5074da640 1 -- 10.20.193.5:0/3096309149 shutdown_connections 2026-02-17T21:24:34.283 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.279+0000 7fd5074da640 1 --2- 10.20.193.5:0/3096309149 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd4d00791f0 0x7fd4d007b6b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:34.283 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.279+0000 7fd5074da640 1 --2- 10.20.193.5:0/3096309149 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd50015f6e0 0x7fd5001470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:34.283 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.279+0000 7fd5074da640 1 --2- 10.20.193.5:0/3096309149 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd5000d23f0 0x7fd50015e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:34.283 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.279+0000 7fd5074da640 1 --2- 10.20.193.5:0/3096309149 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd5000c98e0 0x7fd5001f4860 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:34.283 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.279+0000 7fd5074da640 1 -- 10.20.193.5:0/3096309149 >> 10.20.193.5:0/3096309149 conn(0x7fd5000d18d0 msgr2=0x7fd5000cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:24:34.283 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.279+0000 7fd5074da640 1 -- 10.20.193.5:0/3096309149 shutdown_connections 2026-02-17T21:24:34.284 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.279+0000 7fd5074da640 1 -- 10.20.193.5:0/3096309149 wait complete. 2026-02-17T21:24:34.284 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:34.279+0000 7fd5074da640 1 librados: shutdown 2026-02-17T21:24:34.290 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T21:24:41.904 DEBUG:teuthology.orchestra.run.trial005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:24:41.970 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.967+0000 7f5b88cf5640 10 monclient: get_monmap_and_config 2026-02-17T21:24:41.970 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.967+0000 7f5b88cf5640 10 monclient: build_initial_monmap 2026-02-17T21:24:41.970 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.967+0000 7f5b88cf5640 10 monclient: monmap: 2026-02-17T21:24:41.970 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:24:41.971 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:41.971 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:24:41.969236+0000 2026-02-17T21:24:41.971 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:24:41.969236+0000 2026-02-17T21:24:41.971 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:24:41.971 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:41.971 INFO:teuthology.misc.health.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:24:41.971 INFO:teuthology.misc.health.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:24:41.971 INFO:teuthology.misc.health.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:24:41.971 INFO:teuthology.misc.health.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:24:41.971 INFO:teuthology.misc.health.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:24:41.971 INFO:teuthology.misc.health.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:24:41.971 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:41.972 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.968+0000 7f5b88cf5640 1 Processor -- start 2026-02-17T21:24:41.972 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.968+0000 7f5b88cf5640 1 -- start start 2026-02-17T21:24:41.972 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.968+0000 7f5b88cf5640 10 monclient: init 2026-02-17T21:24:41.975 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.968+0000 7f5b88cf5640 10 monclient: _reopen_session rank -1 2026-02-17T21:24:41.975 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.968+0000 7f5b88cf5640 10 monclient: _add_conns ranks=[1,5,0,3,2,4] 2026-02-17T21:24:41.975 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.968+0000 7f5b88cf5640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f5b8415f770 addr v1:10.20.193.119:6789/0 2026-02-17T21:24:41.975 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.968+0000 7f5b88cf5640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f5b840cf100 0x7f5b8415fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:41.975 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.968+0000 7f5b88cf5640 10 monclient(hunting): picked mon.noname-c con 0x7f5b840cf100 addr v2:10.20.193.135:3300/0 2026-02-17T21:24:41.975 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.968+0000 7f5b88cf5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5b84160090 addr v1:10.20.193.5:6789/0 2026-02-17T21:24:41.975 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.968+0000 7f5b88cf5640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b8406f9b0 con 0x7f5b84160090 2026-02-17T21:24:41.975 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.968+0000 7f5b88cf5640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b8406f6d0 con 0x7f5b8415f770 2026-02-17T21:24:41.975 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.968+0000 7f5b88cf5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:41.975 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.968+0000 7f5b88cf5640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f5b8415d580 con 0x7f5b840cf100 2026-02-17T21:24:41.976 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.968+0000 7f5b88cf5640 10 monclient(hunting): _renew_subs 2026-02-17T21:24:41.976 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.968+0000 7f5b88cf5640 10 monclient(hunting): authenticate will time out at 987.534635s 2026-02-17T21:24:41.976 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.969+0000 7f5b82d76640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f5b84160090 0x7f5b8415e340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:46746/0 (socket says 10.20.193.5:46746) 2026-02-17T21:24:41.976 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.969+0000 7f5b82d76640 1 -- 10.20.193.5:0/954790024 learned_addr learned my addr 10.20.193.5:0/954790024 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:24:41.976 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.969+0000 7f5b81d74640 1 --2- 10.20.193.5:0/954790024 >> v2:10.20.193.135:3300/0 conn(0x7f5b840cf100 0x7f5b8415fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:41.976 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.969+0000 7f5b81d74640 10 monclient(hunting): get_auth_request con 0x7f5b840cf100 auth_method 0 2026-02-17T21:24:41.976 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.969+0000 7f5b81d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:41.976 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.969+0000 7f5b81d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:41.976 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.969+0000 7f5b81d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:41.976 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.969+0000 7f5b81d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:41.976 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.969+0000 7f5b81d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:41.977 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.969+0000 7f5b81d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:41.977 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.970+0000 7f5b81573640 1 -- 10.20.193.5:0/954790024 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1068116147 0 0) 0x7f5b8406f6d0 con 0x7f5b8415f770 2026-02-17T21:24:41.977 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.970+0000 7f5b81573640 10 monclient(hunting): _negotiate 2026-02-17T21:24:41.977 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.970+0000 7f5b81573640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:41.977 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.970+0000 7f5b81573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:41.977 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.970+0000 7f5b81573640 10 monclient(hunting): my global_id is 4309 2026-02-17T21:24:41.977 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.970+0000 7f5b81573640 1 -- 10.20.193.5:0/954790024 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b70003620 con 0x7f5b8415f770 2026-02-17T21:24:41.977 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.970+0000 7f5b81573640 1 -- 10.20.193.5:0/954790024 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 554933065 0 0) 0x7f5b8406f9b0 con 0x7f5b84160090 2026-02-17T21:24:41.977 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.970+0000 7f5b81573640 10 monclient(hunting): _negotiate 2026-02-17T21:24:41.977 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.970+0000 7f5b81573640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:41.977 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.970+0000 7f5b81573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:41.977 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.970+0000 7f5b81573640 10 monclient(hunting): my global_id is 4263 2026-02-17T21:24:41.978 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.970+0000 7f5b81573640 1 -- 10.20.193.5:0/954790024 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b8406f6d0 con 0x7f5b84160090 2026-02-17T21:24:41.978 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.971+0000 7f5b81d74640 10 monclient(hunting): handle_auth_done global_id 4307 payload 274 2026-02-17T21:24:41.978 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.971+0000 7f5b81d74640 1 -- 10.20.193.5:0/954790024 >> v1:10.20.193.119:6789/0 conn(0x7f5b8415f770 legacy=0x7f5b8406ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:41.978 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.971+0000 7f5b81d74640 1 -- 10.20.193.5:0/954790024 >> v1:10.20.193.5:6789/0 conn(0x7f5b84160090 legacy=0x7f5b8415e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:41.978 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.971+0000 7f5b81d74640 10 monclient: _finish_hunting 0 2026-02-17T21:24:41.978 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.971+0000 7f5b81d74640 1 monclient: found mon.noname-c 2026-02-17T21:24:41.978 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.971+0000 7f5b81d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:24:41.978 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.971+0000 7f5b81d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:24:41.978 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.971+0000 7f5b81d74640 1 -- 10.20.193.5:0/954790024 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b8415d860 con 0x7f5b840cf100 2026-02-17T21:24:41.978 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.972+0000 7f5b81d74640 1 --2- 10.20.193.5:0/954790024 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5b840cf100 0x7f5b8415fb50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0098a0 tx=0x7f5b6c02ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cde5a02e855b7ca1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:24:41.985 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.973+0000 7f5b81573640 1 -- 10.20.193.5:0/954790024 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c03c070 con 0x7f5b840cf100 2026-02-17T21:24:41.985 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.973+0000 7f5b81573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:41.985 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.973+0000 7f5b81573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:24:41.985 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.973+0000 7f5b81573640 10 monclient: dump: 2026-02-17T21:24:41.986 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:41.986 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:41.986 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:41.986 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:41.986 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:41.986 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:41.986 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:41.986 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:41.986 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:41.986 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:41.986 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.973+0000 7f5b81573640 10 monclient: _finish_auth 0 2026-02-17T21:24:41.986 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.973+0000 7f5b81573640 10 monclient: _check_auth_tickets 2026-02-17T21:24:41.987 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.973+0000 7f5b81573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:24:41.987 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.973+0000 7f5b88cf5640 5 monclient: authenticate success, global_id 4307 2026-02-17T21:24:41.987 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.973+0000 7f5b88cf5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:24:41.987 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.974+0000 7f5b81573640 1 -- 10.20.193.5:0/954790024 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b6c02fc10 con 0x7f5b840cf100 2026-02-17T21:24:41.987 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.974+0000 7f5b81573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:24:41.987 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.974+0000 7f5b81573640 1 -- 10.20.193.5:0/954790024 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c037440 con 0x7f5b840cf100 2026-02-17T21:24:41.987 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.974+0000 7f5b81573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:41.987 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.974+0000 7f5b81573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:24:41.987 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.974+0000 7f5b81573640 10 monclient: dump: 2026-02-17T21:24:41.987 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:41.987 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:41.987 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:41.988 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:41.988 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:41.988 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:41.988 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:41.988 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:41.988 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:41.988 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:41.988 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.974+0000 7f5b88cf5640 10 monclient: get_monmap_and_config success 2026-02-17T21:24:41.988 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.974+0000 7f5b88cf5640 4 set_mon_vals no callback set 2026-02-17T21:24:41.988 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.974+0000 7f5b88cf5640 10 monclient: shutdown 2026-02-17T21:24:41.988 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.974+0000 7f5b88cf5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:24:41.989 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.974+0000 7f5b88cf5640 1 -- 10.20.193.5:0/954790024 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5b840cf100 msgr2=0x7f5b8415fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:41.989 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.974+0000 7f5b88cf5640 1 --2- 10.20.193.5:0/954790024 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5b840cf100 0x7f5b8415fb50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0098a0 tx=0x7f5b6c02ef00 comp rx=0 tx=0).stop 2026-02-17T21:24:41.989 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.974+0000 7f5b88cf5640 1 -- 10.20.193.5:0/954790024 shutdown_connections 2026-02-17T21:24:41.989 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.974+0000 7f5b88cf5640 1 --2- 10.20.193.5:0/954790024 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5b840cf100 0x7f5b8415fb50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:41.989 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.974+0000 7f5b88cf5640 1 -- 10.20.193.5:0/954790024 >> 10.20.193.5:0/954790024 conn(0x7f5b840ce5e0 msgr2=0x7f5b840ce9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:24:41.989 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.974+0000 7f5b88cf5640 1 -- 10.20.193.5:0/954790024 shutdown_connections 2026-02-17T21:24:41.989 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.974+0000 7f5b88cf5640 1 -- 10.20.193.5:0/954790024 wait complete. 2026-02-17T21:24:41.989 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.974+0000 7f5b88cf5640 10 monclient: build_initial_monmap 2026-02-17T21:24:41.989 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.974+0000 7f5b88cf5640 10 monclient: monmap: 2026-02-17T21:24:41.989 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:24:41.989 INFO:teuthology.misc.health.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:24:41.989 INFO:teuthology.misc.health.trial005.stderr:last_changed 0.000000 2026-02-17T21:24:41.990 INFO:teuthology.misc.health.trial005.stderr:created 0.000000 2026-02-17T21:24:41.990 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:24:41.990 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:41.990 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:24:41.990 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:24:41.990 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:24:41.990 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:41.990 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.975+0000 7f5b88cf5640 1 librados: starting msgr at 2026-02-17T21:24:41.990 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.975+0000 7f5b88cf5640 1 librados: starting objecter 2026-02-17T21:24:41.990 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.975+0000 7f5b88cf5640 1 Processor -- start 2026-02-17T21:24:41.990 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.975+0000 7f5b88cf5640 1 -- start start 2026-02-17T21:24:41.990 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.975+0000 7f5b88cf5640 1 librados: setting wanted keys 2026-02-17T21:24:41.990 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.975+0000 7f5b88cf5640 1 librados: calling monclient init 2026-02-17T21:24:41.991 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.975+0000 7f5b88cf5640 10 monclient: init 2026-02-17T21:24:41.991 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.975+0000 7f5b88cf5640 10 monclient: _reopen_session rank -1 2026-02-17T21:24:41.991 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.975+0000 7f5b88cf5640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:24:41.991 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.975+0000 7f5b88cf5640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5b840cf100 0x7f5b84148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:41.991 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.975+0000 7f5b88cf5640 10 monclient(hunting): picked mon.noname-b con 0x7f5b840cf100 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:24:41.991 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.975+0000 7f5b88cf5640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5b8415f770 0x7f5b841f54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:41.991 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.975+0000 7f5b88cf5640 10 monclient(hunting): picked mon.noname-c con 0x7f5b8415f770 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:24:41.991 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.975+0000 7f5b88cf5640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5b84160090 0x7f5b841f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:41.991 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.975+0000 7f5b88cf5640 10 monclient(hunting): picked mon.noname-a con 0x7f5b84160090 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:24:41.991 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.975+0000 7f5b88cf5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:41.991 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.975+0000 7f5b88cf5640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5b84070530 con 0x7f5b84160090 2026-02-17T21:24:41.991 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.975+0000 7f5b88cf5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:41.992 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.975+0000 7f5b88cf5640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8415de20 con 0x7f5b840cf100 2026-02-17T21:24:41.992 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.975+0000 7f5b88cf5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:41.992 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.975+0000 7f5b88cf5640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5b840706b0 con 0x7f5b8415f770 2026-02-17T21:24:41.992 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.975+0000 7f5b88cf5640 10 monclient(hunting): _renew_subs 2026-02-17T21:24:41.992 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.975+0000 7f5b88cf5640 10 monclient(hunting): authenticate will time out at 987.541675s 2026-02-17T21:24:41.992 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.975+0000 7f5b82d76640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5b84160090 0x7f5b841f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:41.992 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.976+0000 7f5b81d74640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5b8415f770 0x7f5b841f54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:41.992 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.976+0000 7f5b82d76640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5b84160090 0x7f5b841f59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:37106/0 (socket says 10.20.193.5:37106) 2026-02-17T21:24:41.992 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.976+0000 7f5b82d76640 1 -- 10.20.193.5:0/910288801 learned_addr learned my addr 10.20.193.5:0/910288801 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:24:41.992 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.976+0000 7f5b82d76640 10 monclient(hunting): get_auth_request con 0x7f5b84160090 auth_method 0 2026-02-17T21:24:41.992 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.976+0000 7f5b82d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:41.992 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.976+0000 7f5b82d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:41.993 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.976+0000 7f5b82d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:41.993 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.976+0000 7f5b81d74640 10 monclient(hunting): get_auth_request con 0x7f5b8415f770 auth_method 0 2026-02-17T21:24:41.993 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.976+0000 7f5b81d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:41.993 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.976+0000 7f5b81d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:41.993 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.976+0000 7f5b81d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:41.993 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.976+0000 7f5b82575640 1 --2- 10.20.193.5:0/910288801 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5b840cf100 0x7f5b84148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:41.993 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.976+0000 7f5b82575640 10 monclient(hunting): get_auth_request con 0x7f5b840cf100 auth_method 0 2026-02-17T21:24:41.993 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.976+0000 7f5b82575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:41.993 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.976+0000 7f5b82575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:41.993 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.976+0000 7f5b82575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:41.993 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.976+0000 7f5b82d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:41.993 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.976+0000 7f5b82d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:41.993 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.976+0000 7f5b82d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:41.994 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.976+0000 7f5b81d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:41.994 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.976+0000 7f5b81d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:41.994 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.976+0000 7f5b81d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:41.994 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.976+0000 7f5b82575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:41.994 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.976+0000 7f5b82575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:41.994 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.976+0000 7f5b82575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:41.994 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.977+0000 7f5b81d74640 10 monclient(hunting): handle_auth_done global_id 4310 payload 824 2026-02-17T21:24:41.994 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.977+0000 7f5b81d74640 1 -- 10.20.193.5:0/910288801 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5b840cf100 msgr2=0x7f5b84148180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:41.994 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.977+0000 7f5b81d74640 1 --2- 10.20.193.5:0/910288801 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5b840cf100 0x7f5b84148180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:41.994 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.977+0000 7f5b81d74640 1 -- 10.20.193.5:0/910288801 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5b84160090 msgr2=0x7f5b841f59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:41.994 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.977+0000 7f5b81d74640 1 --2- 10.20.193.5:0/910288801 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5b84160090 0x7f5b841f59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:41.994 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.977+0000 7f5b81d74640 10 monclient: _finish_hunting 0 2026-02-17T21:24:41.994 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.977+0000 7f5b81d74640 1 monclient: found mon.noname-c 2026-02-17T21:24:41.995 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.977+0000 7f5b81d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:24:41.995 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.977+0000 7f5b81d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:24:41.995 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.977+0000 7f5b81d74640 1 -- 10.20.193.5:0/910288801 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b8414e190 con 0x7f5b8415f770 2026-02-17T21:24:41.995 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.979+0000 7f5b81d74640 1 --2- 10.20.193.5:0/910288801 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5b8415f770 0x7f5b841f54b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5b84075220 tx=0x7f5b6c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:24:41.995 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.979+0000 7f5b6affd640 10 client.?.objecter ms_handle_connect 0x7f5b8415f770 2026-02-17T21:24:41.995 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.979+0000 7f5b6affd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:24:41.995 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.980+0000 7f5b6affd640 1 -- 10.20.193.5:0/910288801 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c046020 con 0x7f5b8415f770 2026-02-17T21:24:41.995 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.980+0000 7f5b6affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:41.995 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.980+0000 7f5b6affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:24:41.995 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.980+0000 7f5b6affd640 10 monclient: dump: 2026-02-17T21:24:41.995 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:41.995 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:41.996 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:41.996 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:41.996 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:41.996 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:41.996 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:41.996 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:41.996 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:41.996 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:41.996 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.980+0000 7f5b6affd640 10 monclient: _finish_auth 0 2026-02-17T21:24:41.996 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.980+0000 7f5b6affd640 10 monclient: _check_auth_tickets 2026-02-17T21:24:41.996 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.980+0000 7f5b6affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:24:41.997 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.980+0000 7f5b88cf5640 5 monclient: authenticate success, global_id 4310 2026-02-17T21:24:41.997 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.980+0000 7f5b88cf5640 10 monclient: _renew_subs 2026-02-17T21:24:41.997 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.980+0000 7f5b88cf5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:24:41.997 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.980+0000 7f5b88cf5640 1 -- 10.20.193.5:0/910288801 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b8414e470 con 0x7f5b8415f770 2026-02-17T21:24:41.997 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.980+0000 7f5b88cf5640 10 client.4310.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:24:41.997 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.980+0000 7f5b88cf5640 10 monclient: _renew_subs 2026-02-17T21:24:41.997 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.980+0000 7f5b88cf5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:24:41.997 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.980+0000 7f5b88cf5640 1 -- 10.20.193.5:0/910288801 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b841f4cb0 con 0x7f5b8415f770 2026-02-17T21:24:41.997 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.980+0000 7f5b88cf5640 1 librados: init done 2026-02-17T21:24:41.997 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.980+0000 7f5b6affd640 1 -- 10.20.193.5:0/910288801 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b6c0039d0 con 0x7f5b8415f770 2026-02-17T21:24:41.997 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.980+0000 7f5b6affd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:24:41.997 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.980+0000 7f5b6affd640 1 -- 10.20.193.5:0/910288801 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c03c040 con 0x7f5b8415f770 2026-02-17T21:24:41.997 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.980+0000 7f5b6affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:41.998 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.980+0000 7f5b6affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:24:41.998 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.980+0000 7f5b88cf5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:24:41.998 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.980+0000 7f5b6affd640 10 monclient: dump: 2026-02-17T21:24:41.998 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:41.998 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:41.998 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:41.998 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:41.998 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:41.998 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:41.998 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:41.998 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:41.998 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:41.999 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:41.999 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.980+0000 7f5b80d72640 4 set_mon_vals no callback set 2026-02-17T21:24:41.999 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.981+0000 7f5b88cf5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:24:41.999 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.981+0000 7f5b88cf5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:24:41.999 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.981+0000 7f5b88cf5640 1 -- 10.20.193.5:0/910288801 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b8415fb50 con 0x7f5b8415f770 2026-02-17T21:24:42.000 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.993+0000 7f5b6affd640 1 -- 10.20.193.5:0/910288801 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 6) ==== 100189+0+0 (secure 0 0 0) 0x7f5b6c037440 con 0x7f5b8415f770 2026-02-17T21:24:42.001 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.993+0000 7f5b6affd640 1 --2- 10.20.193.5:0/910288801 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f5b50079220 0x7f5b5007b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:42.001 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.994+0000 7f5b82575640 1 --2- 10.20.193.5:0/910288801 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f5b50079220 0x7f5b5007b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:42.001 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.994+0000 7f5b82575640 10 monclient: get_auth_request con 0x7f5b50079220 auth_method 0 2026-02-17T21:24:42.001 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.994+0000 7f5b6affd640 10 client.4310.objecter ms_handle_connect 0x7f5b50079220 2026-02-17T21:24:42.001 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.994+0000 7f5b82575640 1 --2- 10.20.193.5:0/910288801 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f5b50079220 0x7f5b5007b6e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5b78007b50 tx=0x7f5b78007aa0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:24:42.001 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.994+0000 7f5b6affd640 1 -- 10.20.193.5:0/910288801 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 2565+0+0 (secure 0 0 0) 0x7f5b6c0bd280 con 0x7f5b8415f770 2026-02-17T21:24:42.001 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.994+0000 7f5b6affd640 10 client.4310.objecter ms_dispatch2 0x7f5b84000b90 osd_map(19..19 src has 1..19) 2026-02-17T21:24:42.001 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.994+0000 7f5b6affd640 3 client.4310.objecter handle_osd_map got epochs [19,19] > 0 2026-02-17T21:24:42.001 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.994+0000 7f5b6affd640 3 client.4310.objecter handle_osd_map decoding full epoch 19 2026-02-17T21:24:42.001 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:41.994+0000 7f5b6affd640 20 client.4310.objecter dump_active .. 0 homeless 2026-02-17T21:24:42.096 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.093+0000 7f5b6affd640 1 -- 10.20.193.5:0/910288801 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5b6c050020 con 0x7f5b8415f770 2026-02-17T21:24:42.096 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.093+0000 7f5b6affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:24:42.096 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.093+0000 7f5b6affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:24:42.187 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.184+0000 7f5b88cf5640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:24:42.187 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.184+0000 7f5b88cf5640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:24:42.187 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.184+0000 7f5b88cf5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:24:42.187 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.184+0000 7f5b88cf5640 1 -- 10.20.193.5:0/910288801 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5b8414c0f0 con 0x7f5b8415f770 2026-02-17T21:24:42.199 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.197+0000 7f5b6affd640 1 -- 10.20.193.5:0/910288801 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12879 (secure 0 0 0) 0x7f5b6c0878f0 con 0x7f5b8415f770 2026-02-17T21:24:42.199 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.197+0000 7f5b6affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:24:42.199 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.197+0000 7f5b6affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:24:42.200 INFO:teuthology.misc.health.trial005.stdout: 2026-02-17T21:24:42.200 INFO:teuthology.misc.health.trial005.stdout:{"epoch":19,"fsid":"b1be373b-56c5-4b5b-a965-9bcc20042691","created":"2026-02-17T21:23:38.622021+0000","modified":"2026-02-17T21:23:44.366223+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:23:44.366223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8bffc5e9-1f92-4603-bf29-ce19225edc1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8ffdf919-2ec4-4c1f-a69f-aee5cea211e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d186244a-4bf7-416d-b6a0-0e0f5af50eb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"093b417e-53bf-4b60-a937-7c5ffee43e1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0a48e684-05b0-41b1-a553-022424011225","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d73b7c38-cef9-4993-b353-908c1d87603c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f7774c25-72e8-41b2-8634-517af7a213b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"30a68802-afce-499b-90ce-bd568bc69406","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"8b4a2001-3ac8-4756-9dcf-af38c6d12d44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"dfdfee67-eff6-4413-bd7a-adc0a019bfbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"fc24ee77-5a0d-41d4-88f5-8d03a77c7608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"1d737681-1923-453a-82f8-516eeb875559","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"c4f0322e-a862-4c5e-967e-4551087ede8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"0b5e9861-a194-4f11-a849-d8bb94ce95a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"6f182077-0c0d-481c-97b4-43ef48aa5aea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"537605ff-bedd-4f2b-922f-e2eaa8c17f48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:24:42.202 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.199+0000 7f5b88cf5640 10 librados: watch_flush enter 2026-02-17T21:24:42.202 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.199+0000 7f5b88cf5640 10 librados: watch_flush exit 2026-02-17T21:24:42.203 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.199+0000 7f5b88cf5640 20 client.4310.objecter shutdown clearing up homeless session... 2026-02-17T21:24:42.203 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.199+0000 7f5b88cf5640 10 client.4310.objecter successfully canceled tick 2026-02-17T21:24:42.203 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.199+0000 7f5b88cf5640 1 -- 10.20.193.5:0/910288801 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f5b50079220 msgr2=0x7f5b5007b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:42.203 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.199+0000 7f5b88cf5640 1 --2- 10.20.193.5:0/910288801 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f5b50079220 0x7f5b5007b6e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5b78007b50 tx=0x7f5b78007aa0 comp rx=0 tx=0).stop 2026-02-17T21:24:42.203 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.199+0000 7f5b88cf5640 10 monclient: shutdown 2026-02-17T21:24:42.203 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.199+0000 7f5b88cf5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:24:42.203 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.199+0000 7f5b88cf5640 1 -- 10.20.193.5:0/910288801 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5b8415f770 msgr2=0x7f5b841f54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:42.203 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.199+0000 7f5b88cf5640 1 --2- 10.20.193.5:0/910288801 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5b8415f770 0x7f5b841f54b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5b84075220 tx=0x7f5b6c0047c0 comp rx=0 tx=0).stop 2026-02-17T21:24:42.203 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.199+0000 7f5b88cf5640 1 -- 10.20.193.5:0/910288801 shutdown_connections 2026-02-17T21:24:42.203 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.199+0000 7f5b88cf5640 1 --2- 10.20.193.5:0/910288801 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f5b50079220 0x7f5b5007b6e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:42.203 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.199+0000 7f5b88cf5640 1 --2- 10.20.193.5:0/910288801 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5b84160090 0x7f5b841f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:42.204 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.199+0000 7f5b88cf5640 1 --2- 10.20.193.5:0/910288801 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5b8415f770 0x7f5b841f54b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:42.204 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.199+0000 7f5b88cf5640 1 --2- 10.20.193.5:0/910288801 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5b840cf100 0x7f5b84148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:42.204 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.199+0000 7f5b88cf5640 1 -- 10.20.193.5:0/910288801 >> 10.20.193.5:0/910288801 conn(0x7f5b840ce5e0 msgr2=0x7f5b84153b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:24:42.204 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.199+0000 7f5b88cf5640 1 -- 10.20.193.5:0/910288801 shutdown_connections 2026-02-17T21:24:42.204 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.199+0000 7f5b88cf5640 1 -- 10.20.193.5:0/910288801 wait complete. 2026-02-17T21:24:42.204 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:42.199+0000 7f5b88cf5640 1 librados: shutdown 2026-02-17T21:24:42.212 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T21:24:49.826 DEBUG:teuthology.orchestra.run.trial005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:24:49.896 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.895+0000 7f1130b48640 10 monclient: get_monmap_and_config 2026-02-17T21:24:49.896 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.895+0000 7f1130b48640 10 monclient: build_initial_monmap 2026-02-17T21:24:49.896 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.895+0000 7f1130b48640 10 monclient: monmap: 2026-02-17T21:24:49.897 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:24:49.897 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:49.897 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:24:49.895711+0000 2026-02-17T21:24:49.897 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:24:49.895711+0000 2026-02-17T21:24:49.897 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:24:49.897 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:49.897 INFO:teuthology.misc.health.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:24:49.897 INFO:teuthology.misc.health.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:24:49.897 INFO:teuthology.misc.health.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:24:49.897 INFO:teuthology.misc.health.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:24:49.897 INFO:teuthology.misc.health.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:24:49.898 INFO:teuthology.misc.health.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:24:49.898 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:49.901 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.895+0000 7f1130b48640 1 Processor -- start 2026-02-17T21:24:49.901 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.895+0000 7f1130b48640 1 -- start start 2026-02-17T21:24:49.901 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.895+0000 7f1130b48640 10 monclient: init 2026-02-17T21:24:49.901 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.896+0000 7f1130b48640 10 monclient: _reopen_session rank -1 2026-02-17T21:24:49.901 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.896+0000 7f1130b48640 10 monclient: _add_conns ranks=[0,3,4,2,1,5] 2026-02-17T21:24:49.901 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.896+0000 7f1130b48640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f112c15c2c0 addr v1:10.20.193.5:6789/0 2026-02-17T21:24:49.901 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.896+0000 7f1130b48640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f112c0c6aa0 0x7f112c15c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:49.901 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.896+0000 7f1130b48640 10 monclient(hunting): picked mon.noname-a con 0x7f112c0c6aa0 addr v2:10.20.193.5:3300/0 2026-02-17T21:24:49.901 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.896+0000 7f1130b48640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f112c0c7e30 0x7f112c06dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:49.902 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.896+0000 7f1130b48640 10 monclient(hunting): picked mon.noname-b con 0x7f112c0c7e30 addr v2:10.20.193.119:3300/0 2026-02-17T21:24:49.902 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.896+0000 7f1130b48640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f112c06d5c0 con 0x7f112c15c2c0 2026-02-17T21:24:49.902 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.896+0000 7f1130b48640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:49.902 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.896+0000 7f1130b48640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f112c0c6fb0 con 0x7f112c0c6aa0 2026-02-17T21:24:49.902 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.896+0000 7f1130b48640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:49.902 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.896+0000 7f1130b48640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f112c0c7290 con 0x7f112c0c7e30 2026-02-17T21:24:49.902 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.896+0000 7f1130b48640 10 monclient(hunting): _renew_subs 2026-02-17T21:24:49.902 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.896+0000 7f1130b48640 10 monclient(hunting): authenticate will time out at 995.461106s 2026-02-17T21:24:49.902 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.896+0000 7f112ad76640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f112c0c7e30 0x7f112c06dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:49.902 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.896+0000 7f1129d74640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f112c0c6aa0 0x7f112c15c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:49.902 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.896+0000 7f112ad76640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f112c0c7e30 0x7f112c06dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:42764/0 (socket says 10.20.193.5:42764) 2026-02-17T21:24:49.903 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.896+0000 7f112ad76640 1 -- 10.20.193.5:0/3981073277 learned_addr learned my addr 10.20.193.5:0/3981073277 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:24:49.903 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.896+0000 7f112a575640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f112c15c2c0 0x7f112c070af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:46694/0 (socket says 10.20.193.5:46694) 2026-02-17T21:24:49.903 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.897+0000 7f112ad76640 10 monclient(hunting): get_auth_request con 0x7f112c0c7e30 auth_method 0 2026-02-17T21:24:49.903 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.897+0000 7f112ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:49.903 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.897+0000 7f112ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:49.903 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.897+0000 7f112ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:49.903 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.897+0000 7f1129d74640 10 monclient(hunting): get_auth_request con 0x7f112c0c6aa0 auth_method 0 2026-02-17T21:24:49.903 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.897+0000 7f1129d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:49.903 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.897+0000 7f1129d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:49.903 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.897+0000 7f1129d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:49.903 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.897+0000 7f112ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:49.904 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.897+0000 7f112ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:49.904 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.897+0000 7f112ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:49.904 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.897+0000 7f1129d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:49.904 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.897+0000 7f1129d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:49.904 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.897+0000 7f1129d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:49.904 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.898+0000 7f112ad76640 10 monclient(hunting): handle_auth_done global_id 4315 payload 274 2026-02-17T21:24:49.904 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.898+0000 7f112ad76640 1 -- 10.20.193.5:0/3981073277 >> v2:10.20.193.5:3300/0 conn(0x7f112c0c6aa0 msgr2=0x7f112c15c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:24:49.904 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.898+0000 7f112ad76640 1 --2- 10.20.193.5:0/3981073277 >> v2:10.20.193.5:3300/0 conn(0x7f112c0c6aa0 0x7f112c15c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:49.904 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.898+0000 7f112ad76640 1 -- 10.20.193.5:0/3981073277 >> v1:10.20.193.5:6789/0 conn(0x7f112c15c2c0 legacy=0x7f112c070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:49.904 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.898+0000 7f112ad76640 10 monclient: _finish_hunting 0 2026-02-17T21:24:49.904 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.898+0000 7f112ad76640 1 monclient: found mon.noname-b 2026-02-17T21:24:49.904 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.898+0000 7f112ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:24:49.905 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.898+0000 7f112ad76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:24:49.905 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.898+0000 7f112ad76640 1 -- 10.20.193.5:0/3981073277 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f112c0c7570 con 0x7f112c0c7e30 2026-02-17T21:24:49.905 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.899+0000 7f112ad76640 1 --2- 10.20.193.5:0/3981073277 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f112c0c7e30 0x7f112c06dd50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f112c1565a0 tx=0x7f111c02f310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8177e24ac575d961 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:24:49.911 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.900+0000 7f1129573640 1 -- 10.20.193.5:0/3981073277 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c02fe10 con 0x7f112c0c7e30 2026-02-17T21:24:49.911 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.900+0000 7f1129573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:49.911 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.900+0000 7f1129573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:24:49.911 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.900+0000 7f1129573640 10 monclient: dump: 2026-02-17T21:24:49.912 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:49.912 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:49.912 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:49.912 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:49.912 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:49.912 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:49.912 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:49.912 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:49.912 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:49.912 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:49.912 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.900+0000 7f1129573640 10 monclient: _finish_auth 0 2026-02-17T21:24:49.912 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.900+0000 7f1129573640 10 monclient: _check_auth_tickets 2026-02-17T21:24:49.913 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.900+0000 7f1129573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:24:49.913 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.900+0000 7f1130b48640 5 monclient: authenticate success, global_id 4315 2026-02-17T21:24:49.913 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.900+0000 7f1130b48640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:24:49.913 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.901+0000 7f1129573640 1 -- 10.20.193.5:0/3981073277 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f111c0373f0 con 0x7f112c0c7e30 2026-02-17T21:24:49.913 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.901+0000 7f1129573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:24:49.913 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.901+0000 7f1129573640 1 -- 10.20.193.5:0/3981073277 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c0377c0 con 0x7f112c0c7e30 2026-02-17T21:24:49.913 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.901+0000 7f1129573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:49.913 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.901+0000 7f1129573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:24:49.913 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.901+0000 7f1129573640 10 monclient: dump: 2026-02-17T21:24:49.913 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:49.913 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:49.913 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:49.914 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:49.914 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:49.914 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:49.914 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:49.914 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:49.914 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:49.914 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:49.914 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.901+0000 7f1130b48640 10 monclient: get_monmap_and_config success 2026-02-17T21:24:49.914 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.901+0000 7f1130b48640 4 set_mon_vals no callback set 2026-02-17T21:24:49.914 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.901+0000 7f1130b48640 10 monclient: shutdown 2026-02-17T21:24:49.914 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.901+0000 7f1130b48640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:24:49.914 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.901+0000 7f1130b48640 1 -- 10.20.193.5:0/3981073277 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f112c0c7e30 msgr2=0x7f112c06dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:49.914 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.901+0000 7f1130b48640 1 --2- 10.20.193.5:0/3981073277 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f112c0c7e30 0x7f112c06dd50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f112c1565a0 tx=0x7f111c02f310 comp rx=0 tx=0).stop 2026-02-17T21:24:49.915 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.901+0000 7f1130b48640 1 -- 10.20.193.5:0/3981073277 shutdown_connections 2026-02-17T21:24:49.915 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.901+0000 7f1130b48640 1 --2- 10.20.193.5:0/3981073277 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f112c0c7e30 0x7f112c06dd50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:49.915 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.901+0000 7f1130b48640 1 --2- 10.20.193.5:0/3981073277 >> v2:10.20.193.5:3300/0 conn(0x7f112c0c6aa0 0x7f112c15c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:49.915 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.901+0000 7f1130b48640 1 -- 10.20.193.5:0/3981073277 >> 10.20.193.5:0/3981073277 conn(0x7f112c0c9f30 msgr2=0x7f112c0ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:24:49.915 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.901+0000 7f1130b48640 1 -- 10.20.193.5:0/3981073277 shutdown_connections 2026-02-17T21:24:49.915 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.901+0000 7f1130b48640 1 -- 10.20.193.5:0/3981073277 wait complete. 2026-02-17T21:24:49.915 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.902+0000 7f1130b48640 10 monclient: build_initial_monmap 2026-02-17T21:24:49.915 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.902+0000 7f1130b48640 10 monclient: monmap: 2026-02-17T21:24:49.915 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:24:49.915 INFO:teuthology.misc.health.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:24:49.915 INFO:teuthology.misc.health.trial005.stderr:last_changed 0.000000 2026-02-17T21:24:49.915 INFO:teuthology.misc.health.trial005.stderr:created 0.000000 2026-02-17T21:24:49.916 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:24:49.916 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:49.916 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:24:49.916 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:24:49.916 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:24:49.916 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:49.916 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.902+0000 7f1130b48640 1 librados: starting msgr at 2026-02-17T21:24:49.916 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.902+0000 7f1130b48640 1 librados: starting objecter 2026-02-17T21:24:49.916 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.902+0000 7f1130b48640 1 Processor -- start 2026-02-17T21:24:49.916 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.902+0000 7f1130b48640 1 -- start start 2026-02-17T21:24:49.916 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.902+0000 7f1130b48640 1 librados: setting wanted keys 2026-02-17T21:24:49.916 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.902+0000 7f1130b48640 1 librados: calling monclient init 2026-02-17T21:24:49.916 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.902+0000 7f1130b48640 10 monclient: init 2026-02-17T21:24:49.917 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.902+0000 7f1130b48640 10 monclient: _reopen_session rank -1 2026-02-17T21:24:49.917 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.902+0000 7f1130b48640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:24:49.917 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.902+0000 7f1130b48640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f112c0c6aa0 0x7f112c1ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:49.917 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.902+0000 7f1130b48640 10 monclient(hunting): picked mon.noname-c con 0x7f112c0c6aa0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:24:49.917 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.902+0000 7f1130b48640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f112c0c7e30 0x7f112c147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:49.917 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.902+0000 7f1130b48640 10 monclient(hunting): picked mon.noname-a con 0x7f112c0c7e30 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:24:49.917 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.902+0000 7f1130b48640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f112c15c2c0 0x7f112c158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:49.917 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.902+0000 7f1130b48640 10 monclient(hunting): picked mon.noname-b con 0x7f112c15c2c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:24:49.917 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.902+0000 7f1130b48640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:49.917 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.902+0000 7f1130b48640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f112c06e290 con 0x7f112c0c7e30 2026-02-17T21:24:49.917 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.902+0000 7f1130b48640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:49.917 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.902+0000 7f1130b48640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f112c0c7850 con 0x7f112c15c2c0 2026-02-17T21:24:49.918 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.902+0000 7f1130b48640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:49.918 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.902+0000 7f1130b48640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f112c06e410 con 0x7f112c0c6aa0 2026-02-17T21:24:49.918 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.902+0000 7f1130b48640 10 monclient(hunting): _renew_subs 2026-02-17T21:24:49.918 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.902+0000 7f1130b48640 10 monclient(hunting): authenticate will time out at 995.467840s 2026-02-17T21:24:49.918 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.903+0000 7f1129d74640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f112c0c7e30 0x7f112c147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:49.918 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.903+0000 7f112ad76640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f112c15c2c0 0x7f112c158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:49.918 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.903+0000 7f1129d74640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f112c0c7e30 0x7f112c147050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:53032/0 (socket says 10.20.193.5:53032) 2026-02-17T21:24:49.918 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.903+0000 7f1129d74640 1 -- 10.20.193.5:0/3995145318 learned_addr learned my addr 10.20.193.5:0/3995145318 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:24:49.918 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.903+0000 7f1129d74640 10 monclient(hunting): get_auth_request con 0x7f112c0c7e30 auth_method 0 2026-02-17T21:24:49.918 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.903+0000 7f1129d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:49.918 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.903+0000 7f1129d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:49.918 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.903+0000 7f1129d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:49.919 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.903+0000 7f112ad76640 10 monclient(hunting): get_auth_request con 0x7f112c15c2c0 auth_method 0 2026-02-17T21:24:49.919 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.903+0000 7f112ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:49.919 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.903+0000 7f112ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:49.919 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.903+0000 7f112ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:49.919 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.903+0000 7f112a575640 1 --2- 10.20.193.5:0/3995145318 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f112c0c6aa0 0x7f112c1ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:49.919 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.903+0000 7f112ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:49.919 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.903+0000 7f112ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:49.919 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.903+0000 7f112ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:49.919 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.903+0000 7f1129d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:49.919 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.903+0000 7f1129d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:49.919 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.903+0000 7f1129d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:49.919 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.903+0000 7f112a575640 10 monclient(hunting): get_auth_request con 0x7f112c0c6aa0 auth_method 0 2026-02-17T21:24:49.919 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.903+0000 7f112a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:49.920 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.903+0000 7f112a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:49.920 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.903+0000 7f112a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:49.920 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.904+0000 7f112a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:49.920 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.904+0000 7f112a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:49.920 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.904+0000 7f112a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:49.920 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.905+0000 7f112ad76640 10 monclient(hunting): handle_auth_done global_id 4318 payload 824 2026-02-17T21:24:49.920 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.905+0000 7f112ad76640 1 -- 10.20.193.5:0/3995145318 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f112c0c6aa0 msgr2=0x7f112c1ed2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:49.920 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.905+0000 7f112ad76640 1 --2- 10.20.193.5:0/3995145318 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f112c0c6aa0 0x7f112c1ed2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:49.920 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.905+0000 7f112ad76640 1 -- 10.20.193.5:0/3995145318 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f112c0c7e30 msgr2=0x7f112c147050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:49.920 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.905+0000 7f112ad76640 1 --2- 10.20.193.5:0/3995145318 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f112c0c7e30 0x7f112c147050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:49.920 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.905+0000 7f112ad76640 10 monclient: _finish_hunting 0 2026-02-17T21:24:49.920 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.905+0000 7f112ad76640 1 monclient: found mon.noname-b 2026-02-17T21:24:49.921 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.905+0000 7f112ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:24:49.921 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.905+0000 7f112ad76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:24:49.921 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.905+0000 7f112ad76640 1 -- 10.20.193.5:0/3995145318 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f112c1593f0 con 0x7f112c15c2c0 2026-02-17T21:24:49.921 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.907+0000 7f112ad76640 1 --2- 10.20.193.5:0/3995145318 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f112c15c2c0 0x7f112c158a20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f111c035000 tx=0x7f111c004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:24:49.921 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.907+0000 7f1112ffd640 10 client.?.objecter ms_handle_connect 0x7f112c15c2c0 2026-02-17T21:24:49.921 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.907+0000 7f1112ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:24:49.921 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.908+0000 7f1112ffd640 1 -- 10.20.193.5:0/3995145318 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c046020 con 0x7f112c15c2c0 2026-02-17T21:24:49.921 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.908+0000 7f1112ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:49.921 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.908+0000 7f1112ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:24:49.921 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.908+0000 7f1112ffd640 10 monclient: dump: 2026-02-17T21:24:49.921 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:49.921 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:49.921 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:49.922 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:49.922 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:49.922 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:49.922 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:49.922 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:49.922 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:49.922 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:49.922 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.908+0000 7f1112ffd640 10 monclient: _finish_auth 0 2026-02-17T21:24:49.922 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.908+0000 7f1112ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:24:49.922 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.908+0000 7f1112ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:24:49.922 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.908+0000 7f1112ffd640 1 -- 10.20.193.5:0/3995145318 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f111c037e30 con 0x7f112c15c2c0 2026-02-17T21:24:49.922 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.908+0000 7f1130b48640 5 monclient: authenticate success, global_id 4318 2026-02-17T21:24:49.923 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.908+0000 7f1130b48640 10 monclient: _renew_subs 2026-02-17T21:24:49.923 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.908+0000 7f1130b48640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:24:49.923 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.908+0000 7f1130b48640 1 -- 10.20.193.5:0/3995145318 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f112c1596d0 con 0x7f112c15c2c0 2026-02-17T21:24:49.923 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.908+0000 7f1112ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:24:49.923 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.908+0000 7f1112ffd640 1 -- 10.20.193.5:0/3995145318 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c009510 con 0x7f112c15c2c0 2026-02-17T21:24:49.923 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.908+0000 7f1112ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:49.923 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.908+0000 7f1112ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:24:49.923 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.908+0000 7f1112ffd640 10 monclient: dump: 2026-02-17T21:24:49.923 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:49.923 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:49.923 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:49.923 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:49.923 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:49.924 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:49.924 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:49.924 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:49.924 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:49.924 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:49.924 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.908+0000 7f1128d72640 4 set_mon_vals no callback set 2026-02-17T21:24:49.924 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.908+0000 7f1130b48640 10 client.4318.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:24:49.924 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.908+0000 7f1130b48640 10 monclient: _renew_subs 2026-02-17T21:24:49.924 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.908+0000 7f1130b48640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:24:49.924 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.908+0000 7f1130b48640 1 -- 10.20.193.5:0/3995145318 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f112c1f7440 con 0x7f112c15c2c0 2026-02-17T21:24:49.924 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.908+0000 7f1130b48640 1 librados: init done 2026-02-17T21:24:49.924 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.909+0000 7f1130b48640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:24:49.924 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.909+0000 7f1130b48640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:24:49.925 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.909+0000 7f1130b48640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:24:49.925 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.909+0000 7f1130b48640 1 -- 10.20.193.5:0/3995145318 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f112c15c6a0 con 0x7f112c15c2c0 2026-02-17T21:24:49.985 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.983+0000 7f1112ffd640 1 -- 10.20.193.5:0/3995145318 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 6) ==== 100189+0+0 (secure 0 0 0) 0x7f111c007bf0 con 0x7f112c15c2c0 2026-02-17T21:24:49.985 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.983+0000 7f1112ffd640 1 --2- 10.20.193.5:0/3995145318 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f10f8079240 0x7f10f807b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:49.985 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.984+0000 7f112a575640 1 --2- 10.20.193.5:0/3995145318 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f10f8079240 0x7f10f807b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:49.985 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.984+0000 7f112a575640 10 monclient: get_auth_request con 0x7f10f8079240 auth_method 0 2026-02-17T21:24:49.986 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.984+0000 7f112a575640 1 --2- 10.20.193.5:0/3995145318 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f10f8079240 0x7f10f807b700 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1120002770 tx=0x7f1120007f40 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:24:49.986 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:49.984+0000 7f1112ffd640 10 client.4318.objecter ms_handle_connect 0x7f10f8079240 2026-02-17T21:24:50.027 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.025+0000 7f1112ffd640 1 -- 10.20.193.5:0/3995145318 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 2565+0+0 (secure 0 0 0) 0x7f111c083f80 con 0x7f112c15c2c0 2026-02-17T21:24:50.027 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.025+0000 7f1112ffd640 10 client.4318.objecter ms_dispatch2 0x7f112c000b90 osd_map(19..19 src has 1..19) 2026-02-17T21:24:50.027 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.025+0000 7f1112ffd640 3 client.4318.objecter handle_osd_map got epochs [19,19] > 0 2026-02-17T21:24:50.027 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.025+0000 7f1112ffd640 3 client.4318.objecter handle_osd_map decoding full epoch 19 2026-02-17T21:24:50.028 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.025+0000 7f1112ffd640 20 client.4318.objecter dump_active .. 0 homeless 2026-02-17T21:24:50.028 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.025+0000 7f1112ffd640 1 -- 10.20.193.5:0/3995145318 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f111c050030 con 0x7f112c15c2c0 2026-02-17T21:24:50.028 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.025+0000 7f1112ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:24:50.028 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.025+0000 7f1112ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:24:50.119 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.117+0000 7f1130b48640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:24:50.119 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.117+0000 7f1130b48640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:24:50.119 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.117+0000 7f1130b48640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:24:50.119 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.117+0000 7f1130b48640 1 -- 10.20.193.5:0/3995145318 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f112c159f70 con 0x7f112c15c2c0 2026-02-17T21:24:50.129 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.128+0000 7f1112ffd640 1 -- 10.20.193.5:0/3995145318 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12879 (secure 0 0 0) 0x7f111c087f40 con 0x7f112c15c2c0 2026-02-17T21:24:50.129 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.128+0000 7f1112ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:24:50.130 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.128+0000 7f1112ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:24:50.130 INFO:teuthology.misc.health.trial005.stdout: 2026-02-17T21:24:50.130 INFO:teuthology.misc.health.trial005.stdout:{"epoch":19,"fsid":"b1be373b-56c5-4b5b-a965-9bcc20042691","created":"2026-02-17T21:23:38.622021+0000","modified":"2026-02-17T21:23:44.366223+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:23:44.366223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8bffc5e9-1f92-4603-bf29-ce19225edc1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8ffdf919-2ec4-4c1f-a69f-aee5cea211e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d186244a-4bf7-416d-b6a0-0e0f5af50eb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"093b417e-53bf-4b60-a937-7c5ffee43e1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0a48e684-05b0-41b1-a553-022424011225","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d73b7c38-cef9-4993-b353-908c1d87603c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f7774c25-72e8-41b2-8634-517af7a213b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"30a68802-afce-499b-90ce-bd568bc69406","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"8b4a2001-3ac8-4756-9dcf-af38c6d12d44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"dfdfee67-eff6-4413-bd7a-adc0a019bfbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"fc24ee77-5a0d-41d4-88f5-8d03a77c7608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"1d737681-1923-453a-82f8-516eeb875559","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"c4f0322e-a862-4c5e-967e-4551087ede8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"0b5e9861-a194-4f11-a849-d8bb94ce95a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"6f182077-0c0d-481c-97b4-43ef48aa5aea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"537605ff-bedd-4f2b-922f-e2eaa8c17f48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:24:50.135 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.133+0000 7f1130b48640 10 librados: watch_flush enter 2026-02-17T21:24:50.135 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.133+0000 7f1130b48640 10 librados: watch_flush exit 2026-02-17T21:24:50.135 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.133+0000 7f1130b48640 20 client.4318.objecter shutdown clearing up homeless session... 2026-02-17T21:24:50.135 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.133+0000 7f1130b48640 10 client.4318.objecter successfully canceled tick 2026-02-17T21:24:50.136 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.133+0000 7f1130b48640 1 -- 10.20.193.5:0/3995145318 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f10f8079240 msgr2=0x7f10f807b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:50.136 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.133+0000 7f1130b48640 1 --2- 10.20.193.5:0/3995145318 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f10f8079240 0x7f10f807b700 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1120002770 tx=0x7f1120007f40 comp rx=0 tx=0).stop 2026-02-17T21:24:50.136 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.133+0000 7f1130b48640 10 monclient: shutdown 2026-02-17T21:24:50.136 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.133+0000 7f1130b48640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:24:50.136 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.133+0000 7f1130b48640 1 -- 10.20.193.5:0/3995145318 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f112c15c2c0 msgr2=0x7f112c158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:50.136 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.133+0000 7f1130b48640 1 --2- 10.20.193.5:0/3995145318 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f112c15c2c0 0x7f112c158a20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f111c035000 tx=0x7f111c004b40 comp rx=0 tx=0).stop 2026-02-17T21:24:50.136 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.133+0000 7f1130b48640 1 -- 10.20.193.5:0/3995145318 shutdown_connections 2026-02-17T21:24:50.136 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.133+0000 7f1130b48640 1 --2- 10.20.193.5:0/3995145318 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f10f8079240 0x7f10f807b700 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:50.136 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.133+0000 7f1130b48640 1 --2- 10.20.193.5:0/3995145318 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f112c15c2c0 0x7f112c158a20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:50.136 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.133+0000 7f1130b48640 1 --2- 10.20.193.5:0/3995145318 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f112c0c7e30 0x7f112c147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:50.136 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.133+0000 7f1130b48640 1 --2- 10.20.193.5:0/3995145318 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f112c0c6aa0 0x7f112c1ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:50.136 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.133+0000 7f1130b48640 1 -- 10.20.193.5:0/3995145318 >> 10.20.193.5:0/3995145318 conn(0x7f112c0c9f30 msgr2=0x7f112c14e160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:24:50.137 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.133+0000 7f1130b48640 1 -- 10.20.193.5:0/3995145318 shutdown_connections 2026-02-17T21:24:50.137 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.133+0000 7f1130b48640 1 -- 10.20.193.5:0/3995145318 wait complete. 2026-02-17T21:24:50.137 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:50.133+0000 7f1130b48640 1 librados: shutdown 2026-02-17T21:24:50.143 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T21:24:57.243 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:01:36.868 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:24:57.245 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:01:36.871 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:24:57.267 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:01:36.893 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:24:57.274 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:01:36.898 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:24:57.275 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:01:36.861 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:24:57.275 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:01:36.899 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:24:57.276 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:01:36.862 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:24:57.294 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:01:36.881 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:24:57.304 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:01:36.928 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:24:57.757 DEBUG:teuthology.orchestra.run.trial005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:24:57.822 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.821+0000 7f1d29d86640 10 monclient: get_monmap_and_config 2026-02-17T21:24:57.822 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.821+0000 7f1d29d86640 10 monclient: build_initial_monmap 2026-02-17T21:24:57.822 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.821+0000 7f1d29d86640 10 monclient: monmap: 2026-02-17T21:24:57.822 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:24:57.822 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:57.823 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:24:57.821711+0000 2026-02-17T21:24:57.823 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:24:57.821711+0000 2026-02-17T21:24:57.823 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:24:57.823 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:57.823 INFO:teuthology.misc.health.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:24:57.823 INFO:teuthology.misc.health.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:24:57.823 INFO:teuthology.misc.health.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:24:57.823 INFO:teuthology.misc.health.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:24:57.823 INFO:teuthology.misc.health.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:24:57.823 INFO:teuthology.misc.health.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:24:57.823 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:57.827 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.821+0000 7f1d29d86640 1 Processor -- start 2026-02-17T21:24:57.827 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.821+0000 7f1d29d86640 1 -- start start 2026-02-17T21:24:57.827 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.821+0000 7f1d29d86640 10 monclient: init 2026-02-17T21:24:57.827 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.822+0000 7f1d29d86640 10 monclient: _reopen_session rank -1 2026-02-17T21:24:57.827 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.822+0000 7f1d29d86640 10 monclient: _add_conns ranks=[3,1,5,0,2,4] 2026-02-17T21:24:57.827 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.822+0000 7f1d29d86640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f1d241504c0 0x7f1d240c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:57.827 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.822+0000 7f1d29d86640 10 monclient(hunting): picked mon.noname-a con 0x7f1d241504c0 addr v2:10.20.193.5:3300/0 2026-02-17T21:24:57.827 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.822+0000 7f1d29d86640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f1d240c7120 addr v1:10.20.193.119:6789/0 2026-02-17T21:24:57.827 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.822+0000 7f1d29d86640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f1d240c7550 0x7f1d2415d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:57.827 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.822+0000 7f1d29d86640 10 monclient(hunting): picked mon.noname-c con 0x7f1d240c7550 addr v2:10.20.193.135:3300/0 2026-02-17T21:24:57.828 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.822+0000 7f1d29d86640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d240c7930 con 0x7f1d240c7120 2026-02-17T21:24:57.828 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.822+0000 7f1d29d86640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:57.828 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.822+0000 7f1d29d86640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f1d240c5c70 con 0x7f1d241504c0 2026-02-17T21:24:57.828 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.822+0000 7f1d29d86640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:57.828 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.822+0000 7f1d29d86640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f1d2415def0 con 0x7f1d240c7550 2026-02-17T21:24:57.828 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.822+0000 7f1d29d86640 10 monclient(hunting): _renew_subs 2026-02-17T21:24:57.828 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.822+0000 7f1d29d86640 10 monclient(hunting): authenticate will time out at 1003.387094s 2026-02-17T21:24:57.828 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.822+0000 7f1d237fe640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f1d241504c0 0x7f1d240c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:57.828 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.822+0000 7f1d22ffd640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f1d240c7120 0x7f1d240c9050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:58002/0 (socket says 10.20.193.5:58002) 2026-02-17T21:24:57.828 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.822+0000 7f1d22ffd640 1 -- 10.20.193.5:0/3002757848 learned_addr learned my addr 10.20.193.5:0/3002757848 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:24:57.828 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.822+0000 7f1d23fff640 1 --2- 10.20.193.5:0/3002757848 >> v2:10.20.193.135:3300/0 conn(0x7f1d240c7550 0x7f1d2415d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:57.828 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.822+0000 7f1d237fe640 10 monclient(hunting): get_auth_request con 0x7f1d241504c0 auth_method 0 2026-02-17T21:24:57.829 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.822+0000 7f1d237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:57.829 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.822+0000 7f1d237fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:57.829 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.822+0000 7f1d237fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:57.829 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.823+0000 7f1d23fff640 10 monclient(hunting): get_auth_request con 0x7f1d240c7550 auth_method 0 2026-02-17T21:24:57.829 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.823+0000 7f1d23fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:57.829 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.823+0000 7f1d23fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:57.829 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.823+0000 7f1d23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:57.829 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.823+0000 7f1d237fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:57.829 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.823+0000 7f1d237fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:57.829 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.823+0000 7f1d237fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:57.829 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.823+0000 7f1d23fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:57.829 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.823+0000 7f1d23fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:57.830 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.823+0000 7f1d23fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:57.830 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.824+0000 7f1d227fc640 1 -- 10.20.193.5:0/3002757848 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3981592110 0 0) 0x7f1d240c7930 con 0x7f1d240c7120 2026-02-17T21:24:57.830 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.824+0000 7f1d227fc640 10 monclient(hunting): _negotiate 2026-02-17T21:24:57.830 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.824+0000 7f1d227fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:57.830 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.824+0000 7f1d227fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:57.830 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.824+0000 7f1d227fc640 10 monclient(hunting): my global_id is 4321 2026-02-17T21:24:57.830 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.824+0000 7f1d227fc640 1 -- 10.20.193.5:0/3002757848 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d08003620 con 0x7f1d240c7120 2026-02-17T21:24:57.830 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.824+0000 7f1d237fe640 10 monclient(hunting): handle_auth_done global_id 4278 payload 274 2026-02-17T21:24:57.830 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.824+0000 7f1d237fe640 1 -- 10.20.193.5:0/3002757848 >> v2:10.20.193.135:3300/0 conn(0x7f1d240c7550 msgr2=0x7f1d2415d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:24:57.830 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.824+0000 7f1d237fe640 1 --2- 10.20.193.5:0/3002757848 >> v2:10.20.193.135:3300/0 conn(0x7f1d240c7550 0x7f1d2415d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:57.830 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.824+0000 7f1d237fe640 1 -- 10.20.193.5:0/3002757848 >> v1:10.20.193.119:6789/0 conn(0x7f1d240c7120 legacy=0x7f1d240c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:57.830 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.824+0000 7f1d237fe640 10 monclient: _finish_hunting 0 2026-02-17T21:24:57.831 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.824+0000 7f1d237fe640 1 monclient: found mon.noname-a 2026-02-17T21:24:57.831 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.824+0000 7f1d237fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:24:57.831 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.824+0000 7f1d237fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:24:57.831 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.824+0000 7f1d237fe640 1 -- 10.20.193.5:0/3002757848 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d240c7fb0 con 0x7f1d241504c0 2026-02-17T21:24:57.831 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.825+0000 7f1d237fe640 1 --2- 10.20.193.5:0/3002757848 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1d241504c0 0x7f1d240c52c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1d240c9df0 tx=0x7f1d1002ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f04c4ab6844131 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:24:57.837 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.827+0000 7f1d227fc640 1 -- 10.20.193.5:0/3002757848 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d1003c070 con 0x7f1d241504c0 2026-02-17T21:24:57.837 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.827+0000 7f1d227fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:57.837 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.827+0000 7f1d227fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:24:57.837 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.827+0000 7f1d227fc640 10 monclient: dump: 2026-02-17T21:24:57.837 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:57.838 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:57.838 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:57.838 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:57.838 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:57.838 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:57.838 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:57.838 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:57.838 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:57.838 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:57.838 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.827+0000 7f1d227fc640 10 monclient: _finish_auth 0 2026-02-17T21:24:57.838 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.827+0000 7f1d227fc640 10 monclient: _check_auth_tickets 2026-02-17T21:24:57.838 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.827+0000 7f1d227fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:24:57.839 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.827+0000 7f1d227fc640 1 -- 10.20.193.5:0/3002757848 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d1002fc20 con 0x7f1d241504c0 2026-02-17T21:24:57.839 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.827+0000 7f1d227fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:24:57.839 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.827+0000 7f1d227fc640 1 -- 10.20.193.5:0/3002757848 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d10037440 con 0x7f1d241504c0 2026-02-17T21:24:57.839 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.827+0000 7f1d29d86640 5 monclient: authenticate success, global_id 4278 2026-02-17T21:24:57.839 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.827+0000 7f1d29d86640 10 monclient: get_monmap_and_config success 2026-02-17T21:24:57.839 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.827+0000 7f1d29d86640 4 set_mon_vals no callback set 2026-02-17T21:24:57.839 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.827+0000 7f1d227fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:57.839 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.827+0000 7f1d227fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:24:57.839 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.827+0000 7f1d227fc640 10 monclient: dump: 2026-02-17T21:24:57.839 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:57.839 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:57.839 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:57.839 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:57.840 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:57.840 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:57.840 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:57.840 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:57.840 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:57.840 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:57.840 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.828+0000 7f1d29d86640 10 monclient: shutdown 2026-02-17T21:24:57.840 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.828+0000 7f1d29d86640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:24:57.840 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.828+0000 7f1d29d86640 1 -- 10.20.193.5:0/3002757848 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1d241504c0 msgr2=0x7f1d240c52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:57.840 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.828+0000 7f1d29d86640 1 --2- 10.20.193.5:0/3002757848 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1d241504c0 0x7f1d240c52c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1d240c9df0 tx=0x7f1d1002ef10 comp rx=0 tx=0).stop 2026-02-17T21:24:57.840 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.828+0000 7f1d29d86640 1 -- 10.20.193.5:0/3002757848 shutdown_connections 2026-02-17T21:24:57.841 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.828+0000 7f1d29d86640 1 --2- 10.20.193.5:0/3002757848 >> v2:10.20.193.135:3300/0 conn(0x7f1d240c7550 0x7f1d2415d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:57.841 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.828+0000 7f1d29d86640 1 --2- 10.20.193.5:0/3002757848 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1d241504c0 0x7f1d240c52c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:57.841 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.828+0000 7f1d29d86640 1 -- 10.20.193.5:0/3002757848 >> 10.20.193.5:0/3002757848 conn(0x7f1d240c9f30 msgr2=0x7f1d240ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:24:57.841 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.828+0000 7f1d29d86640 1 -- 10.20.193.5:0/3002757848 shutdown_connections 2026-02-17T21:24:57.841 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.828+0000 7f1d29d86640 1 -- 10.20.193.5:0/3002757848 wait complete. 2026-02-17T21:24:57.841 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.828+0000 7f1d29d86640 10 monclient: build_initial_monmap 2026-02-17T21:24:57.841 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.828+0000 7f1d29d86640 10 monclient: monmap: 2026-02-17T21:24:57.841 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:24:57.841 INFO:teuthology.misc.health.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:24:57.841 INFO:teuthology.misc.health.trial005.stderr:last_changed 0.000000 2026-02-17T21:24:57.841 INFO:teuthology.misc.health.trial005.stderr:created 0.000000 2026-02-17T21:24:57.841 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:24:57.841 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:57.842 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:24:57.842 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:24:57.842 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:24:57.842 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:57.842 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d29d86640 1 librados: starting msgr at 2026-02-17T21:24:57.842 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d29d86640 1 librados: starting objecter 2026-02-17T21:24:57.842 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d29d86640 1 Processor -- start 2026-02-17T21:24:57.842 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d29d86640 1 -- start start 2026-02-17T21:24:57.842 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d29d86640 1 librados: setting wanted keys 2026-02-17T21:24:57.842 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d29d86640 1 librados: calling monclient init 2026-02-17T21:24:57.842 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d29d86640 10 monclient: init 2026-02-17T21:24:57.842 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d29d86640 10 monclient: _reopen_session rank -1 2026-02-17T21:24:57.843 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d29d86640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:24:57.843 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d29d86640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1d240c7120 0x7f1d241f3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:57.843 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d29d86640 10 monclient(hunting): picked mon.noname-c con 0x7f1d240c7120 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:24:57.843 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d29d86640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1d240c7550 0x7f1d241f3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:57.843 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d29d86640 10 monclient(hunting): picked mon.noname-a con 0x7f1d240c7550 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:24:57.843 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d29d86640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1d241504c0 0x7f1d241f4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:57.843 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d29d86640 10 monclient(hunting): picked mon.noname-b con 0x7f1d241504c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:24:57.843 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d29d86640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:57.843 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d29d86640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1d240c8850 con 0x7f1d240c7550 2026-02-17T21:24:57.843 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d29d86640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:57.843 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d29d86640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1d240c8570 con 0x7f1d241504c0 2026-02-17T21:24:57.843 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d29d86640 10 monclient(hunting): start opening mon connection 2026-02-17T21:24:57.843 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d29d86640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1d240c8b30 con 0x7f1d240c7120 2026-02-17T21:24:57.844 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d29d86640 10 monclient(hunting): _renew_subs 2026-02-17T21:24:57.844 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d29d86640 10 monclient(hunting): authenticate will time out at 1003.394608s 2026-02-17T21:24:57.844 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d22ffd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1d240c7550 0x7f1d241f3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:57.844 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d22ffd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1d240c7550 0x7f1d241f3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:51964/0 (socket says 10.20.193.5:51964) 2026-02-17T21:24:57.844 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d22ffd640 1 -- 10.20.193.5:0/4032168510 learned_addr learned my addr 10.20.193.5:0/4032168510 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:24:57.844 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d22ffd640 10 monclient(hunting): get_auth_request con 0x7f1d240c7550 auth_method 0 2026-02-17T21:24:57.844 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d22ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:57.844 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d22ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:57.844 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.829+0000 7f1d22ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:57.844 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.830+0000 7f1d23fff640 1 --2- 10.20.193.5:0/4032168510 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1d241504c0 0x7f1d241f4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:57.844 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.830+0000 7f1d237fe640 1 --2- 10.20.193.5:0/4032168510 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1d240c7120 0x7f1d241f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:57.845 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.830+0000 7f1d22ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:57.845 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.830+0000 7f1d22ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:57.845 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.830+0000 7f1d22ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:57.845 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.830+0000 7f1d23fff640 10 monclient(hunting): get_auth_request con 0x7f1d241504c0 auth_method 0 2026-02-17T21:24:57.845 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.830+0000 7f1d23fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:57.845 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.830+0000 7f1d23fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:57.845 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.830+0000 7f1d23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:57.845 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.830+0000 7f1d237fe640 10 monclient(hunting): get_auth_request con 0x7f1d240c7120 auth_method 0 2026-02-17T21:24:57.845 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.830+0000 7f1d237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:24:57.845 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.830+0000 7f1d237fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:24:57.845 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.830+0000 7f1d237fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:24:57.845 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.830+0000 7f1d23fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:57.846 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.830+0000 7f1d23fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:57.846 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.830+0000 7f1d23fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:57.846 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.830+0000 7f1d237fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:24:57.846 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.830+0000 7f1d237fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:24:57.846 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.830+0000 7f1d237fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:24:57.846 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.831+0000 7f1d22ffd640 10 monclient(hunting): handle_auth_done global_id 4281 payload 824 2026-02-17T21:24:57.846 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.832+0000 7f1d22ffd640 1 -- 10.20.193.5:0/4032168510 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1d240c7120 msgr2=0x7f1d241f3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:57.846 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.832+0000 7f1d22ffd640 1 --2- 10.20.193.5:0/4032168510 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1d240c7120 0x7f1d241f3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:57.846 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.832+0000 7f1d22ffd640 1 -- 10.20.193.5:0/4032168510 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1d241504c0 msgr2=0x7f1d241f4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:57.846 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.832+0000 7f1d22ffd640 1 --2- 10.20.193.5:0/4032168510 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1d241504c0 0x7f1d241f4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:57.846 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.832+0000 7f1d22ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:24:57.846 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.832+0000 7f1d22ffd640 1 monclient: found mon.noname-a 2026-02-17T21:24:57.847 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.832+0000 7f1d22ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:24:57.847 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.832+0000 7f1d22ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:24:57.847 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.832+0000 7f1d22ffd640 1 -- 10.20.193.5:0/4032168510 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d241f24f0 con 0x7f1d240c7550 2026-02-17T21:24:57.847 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.833+0000 7f1d22ffd640 1 --2- 10.20.193.5:0/4032168510 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1d240c7550 0x7f1d241f3780 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1d1400c760 tx=0x7f1d1400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:24:57.847 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.833+0000 7f1cfffff640 10 client.?.objecter ms_handle_connect 0x7f1d240c7550 2026-02-17T21:24:57.847 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.833+0000 7f1cfffff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:24:57.847 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1cfffff640 1 -- 10.20.193.5:0/4032168510 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d14017070 con 0x7f1d240c7550 2026-02-17T21:24:57.847 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1cfffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:57.847 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1cfffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:24:57.847 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1cfffff640 10 monclient: dump: 2026-02-17T21:24:57.847 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:57.847 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:57.847 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:57.848 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:57.848 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:57.848 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:57.848 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:57.848 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:57.848 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:57.848 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:57.848 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1cfffff640 10 monclient: _finish_auth 0 2026-02-17T21:24:57.848 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1cfffff640 10 monclient: _check_auth_tickets 2026-02-17T21:24:57.848 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1cfffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:24:57.848 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1cfffff640 1 -- 10.20.193.5:0/4032168510 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d14005bb0 con 0x7f1d240c7550 2026-02-17T21:24:57.848 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1cfffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:24:57.848 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1cfffff640 1 -- 10.20.193.5:0/4032168510 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d14007070 con 0x7f1d240c7550 2026-02-17T21:24:57.849 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1d29d86640 5 monclient: authenticate success, global_id 4281 2026-02-17T21:24:57.849 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1d29d86640 10 monclient: _renew_subs 2026-02-17T21:24:57.849 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1d29d86640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:24:57.849 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1d29d86640 1 -- 10.20.193.5:0/4032168510 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d2414a130 con 0x7f1d240c7550 2026-02-17T21:24:57.849 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1d21ffb640 4 set_mon_vals no callback set 2026-02-17T21:24:57.849 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1cfffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:24:57.849 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1cfffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:24:57.849 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1cfffff640 10 monclient: dump: 2026-02-17T21:24:57.849 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:24:57.849 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:24:57.849 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:57.849 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:24:57.849 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:24:57.850 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:24:57.850 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:24:57.850 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:24:57.850 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:24:57.850 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:24:57.850 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1d29d86640 10 client.4281.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:24:57.850 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1d29d86640 10 monclient: _renew_subs 2026-02-17T21:24:57.850 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1d29d86640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:24:57.850 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1d29d86640 1 -- 10.20.193.5:0/4032168510 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d241f2760 con 0x7f1d240c7550 2026-02-17T21:24:57.850 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1d29d86640 1 librados: init done 2026-02-17T21:24:57.850 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1d29d86640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:24:57.850 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1d29d86640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:24:57.851 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1d29d86640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:24:57.851 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.835+0000 7f1d29d86640 1 -- 10.20.193.5:0/4032168510 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d241508a0 con 0x7f1d240c7550 2026-02-17T21:24:57.852 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.847+0000 7f1cfffff640 1 -- 10.20.193.5:0/4032168510 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 6) ==== 100189+0+0 (secure 0 0 0) 0x7f1d14007210 con 0x7f1d240c7550 2026-02-17T21:24:57.852 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.847+0000 7f1cfffff640 1 --2- 10.20.193.5:0/4032168510 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1cf40791f0 0x7f1cf407b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:24:57.852 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.848+0000 7f1d237fe640 1 --2- 10.20.193.5:0/4032168510 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1cf40791f0 0x7f1cf407b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:24:57.852 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.848+0000 7f1d237fe640 10 monclient: get_auth_request con 0x7f1cf40791f0 auth_method 0 2026-02-17T21:24:57.852 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.848+0000 7f1cfffff640 10 client.4281.objecter ms_handle_connect 0x7f1cf40791f0 2026-02-17T21:24:57.852 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.848+0000 7f1d237fe640 1 --2- 10.20.193.5:0/4032168510 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1cf40791f0 0x7f1cf407b6b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1d10039000 tx=0x7f1d10033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:24:57.853 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.852+0000 7f1cfffff640 1 -- 10.20.193.5:0/4032168510 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 2565+0+0 (secure 0 0 0) 0x7f1d1405d7b0 con 0x7f1d240c7550 2026-02-17T21:24:57.853 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.852+0000 7f1cfffff640 10 client.4281.objecter ms_dispatch2 0x7f1d24000b90 osd_map(19..19 src has 1..19) 2026-02-17T21:24:57.853 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.852+0000 7f1cfffff640 3 client.4281.objecter handle_osd_map got epochs [19,19] > 0 2026-02-17T21:24:57.854 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.852+0000 7f1cfffff640 3 client.4281.objecter handle_osd_map decoding full epoch 19 2026-02-17T21:24:57.854 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.852+0000 7f1cfffff640 20 client.4281.objecter dump_active .. 0 homeless 2026-02-17T21:24:57.959 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.958+0000 7f1cfffff640 1 -- 10.20.193.5:0/4032168510 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1d14021020 con 0x7f1d240c7550 2026-02-17T21:24:57.959 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.958+0000 7f1cfffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:24:57.960 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:57.958+0000 7f1cfffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:24:58.049 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.047+0000 7f1d29d86640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:24:58.049 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.047+0000 7f1d29d86640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:24:58.049 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.047+0000 7f1d29d86640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:24:58.049 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.047+0000 7f1d29d86640 1 -- 10.20.193.5:0/4032168510 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d24074c80 con 0x7f1d240c7550 2026-02-17T21:24:58.060 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.058+0000 7f1cfffff640 1 -- 10.20.193.5:0/4032168510 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12879 (secure 0 0 0) 0x7f1d24074c80 con 0x7f1d240c7550 2026-02-17T21:24:58.060 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.058+0000 7f1cfffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:24:58.060 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.058+0000 7f1cfffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:24:58.060 INFO:teuthology.misc.health.trial005.stdout: 2026-02-17T21:24:58.060 INFO:teuthology.misc.health.trial005.stdout:{"epoch":19,"fsid":"b1be373b-56c5-4b5b-a965-9bcc20042691","created":"2026-02-17T21:23:38.622021+0000","modified":"2026-02-17T21:23:44.366223+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:23:44.366223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8bffc5e9-1f92-4603-bf29-ce19225edc1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8ffdf919-2ec4-4c1f-a69f-aee5cea211e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d186244a-4bf7-416d-b6a0-0e0f5af50eb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"093b417e-53bf-4b60-a937-7c5ffee43e1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0a48e684-05b0-41b1-a553-022424011225","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d73b7c38-cef9-4993-b353-908c1d87603c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f7774c25-72e8-41b2-8634-517af7a213b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"30a68802-afce-499b-90ce-bd568bc69406","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"8b4a2001-3ac8-4756-9dcf-af38c6d12d44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"dfdfee67-eff6-4413-bd7a-adc0a019bfbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"fc24ee77-5a0d-41d4-88f5-8d03a77c7608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"1d737681-1923-453a-82f8-516eeb875559","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"c4f0322e-a862-4c5e-967e-4551087ede8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"0b5e9861-a194-4f11-a849-d8bb94ce95a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"6f182077-0c0d-481c-97b4-43ef48aa5aea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"537605ff-bedd-4f2b-922f-e2eaa8c17f48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:24:58.063 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.061+0000 7f1d29d86640 10 librados: watch_flush enter 2026-02-17T21:24:58.063 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.061+0000 7f1d29d86640 10 librados: watch_flush exit 2026-02-17T21:24:58.063 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.061+0000 7f1d29d86640 20 client.4281.objecter shutdown clearing up homeless session... 2026-02-17T21:24:58.063 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.061+0000 7f1d29d86640 10 client.4281.objecter successfully canceled tick 2026-02-17T21:24:58.064 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.061+0000 7f1d29d86640 1 -- 10.20.193.5:0/4032168510 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1cf40791f0 msgr2=0x7f1cf407b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:58.064 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.061+0000 7f1d29d86640 1 --2- 10.20.193.5:0/4032168510 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1cf40791f0 0x7f1cf407b6b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1d10039000 tx=0x7f1d10033000 comp rx=0 tx=0).stop 2026-02-17T21:24:58.064 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.061+0000 7f1d29d86640 10 monclient: shutdown 2026-02-17T21:24:58.064 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.061+0000 7f1d29d86640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:24:58.064 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.061+0000 7f1d29d86640 1 -- 10.20.193.5:0/4032168510 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1d240c7550 msgr2=0x7f1d241f3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:24:58.064 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.061+0000 7f1d29d86640 1 --2- 10.20.193.5:0/4032168510 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1d240c7550 0x7f1d241f3780 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1d1400c760 tx=0x7f1d1400cc30 comp rx=0 tx=0).stop 2026-02-17T21:24:58.064 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.061+0000 7f1d29d86640 1 -- 10.20.193.5:0/4032168510 shutdown_connections 2026-02-17T21:24:58.064 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.061+0000 7f1d29d86640 1 --2- 10.20.193.5:0/4032168510 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1cf40791f0 0x7f1cf407b6b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:58.064 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.061+0000 7f1d29d86640 1 --2- 10.20.193.5:0/4032168510 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1d241504c0 0x7f1d241f4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:58.064 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.061+0000 7f1d29d86640 1 --2- 10.20.193.5:0/4032168510 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1d240c7550 0x7f1d241f3780 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:58.064 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.061+0000 7f1d29d86640 1 --2- 10.20.193.5:0/4032168510 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1d240c7120 0x7f1d241f3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:24:58.064 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.061+0000 7f1d29d86640 1 -- 10.20.193.5:0/4032168510 >> 10.20.193.5:0/4032168510 conn(0x7f1d240c9f30 msgr2=0x7f1d2406fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:24:58.065 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.061+0000 7f1d29d86640 1 -- 10.20.193.5:0/4032168510 shutdown_connections 2026-02-17T21:24:58.065 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.061+0000 7f1d29d86640 1 -- 10.20.193.5:0/4032168510 wait complete. 2026-02-17T21:24:58.065 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:24:58.061+0000 7f1d29d86640 1 librados: shutdown 2026-02-17T21:24:58.071 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T21:25:05.684 DEBUG:teuthology.orchestra.run.trial005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:25:05.744 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.743+0000 7f564e722640 10 monclient: get_monmap_and_config 2026-02-17T21:25:05.744 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.743+0000 7f564e722640 10 monclient: build_initial_monmap 2026-02-17T21:25:05.745 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.743+0000 7f564e722640 10 monclient: monmap: 2026-02-17T21:25:05.745 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:25:05.745 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:05.745 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:25:05.744397+0000 2026-02-17T21:25:05.745 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:25:05.744397+0000 2026-02-17T21:25:05.745 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:05.745 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:25:05.745 INFO:teuthology.misc.health.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:05.745 INFO:teuthology.misc.health.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:05.745 INFO:teuthology.misc.health.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:05.745 INFO:teuthology.misc.health.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:05.745 INFO:teuthology.misc.health.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:05.745 INFO:teuthology.misc.health.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:05.745 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:25:05.745 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.744+0000 7f564e722640 1 Processor -- start 2026-02-17T21:25:05.745 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.744+0000 7f564e722640 1 -- start start 2026-02-17T21:25:05.745 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.744+0000 7f564e722640 10 monclient: init 2026-02-17T21:25:05.745 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.744+0000 7f564e722640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:05.745 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.744+0000 7f564e722640 10 monclient: _add_conns ranks=[0,2,5,3,1,4] 2026-02-17T21:25:05.745 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.744+0000 7f564e722640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f564815c2c0 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:05.745 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.744+0000 7f564e722640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f56480c6aa0 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:05.745 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.744+0000 7f564e722640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f564815c6a0 0x7f564806dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:05.745 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.744+0000 7f564e722640 10 monclient(hunting): picked mon.noname-c con 0x7f564815c6a0 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:05.745 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.744+0000 7f564e722640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f564806d5c0 con 0x7f564815c2c0 2026-02-17T21:25:05.746 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.744+0000 7f564e722640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56480c6fb0 con 0x7f56480c6aa0 2026-02-17T21:25:05.746 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.744+0000 7f564e722640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:05.746 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.744+0000 7f564e722640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f56480c8540 con 0x7f564815c6a0 2026-02-17T21:25:05.746 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.744+0000 7f564e722640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:05.746 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.744+0000 7f564e722640 10 monclient(hunting): authenticate will time out at 1011.309685s 2026-02-17T21:25:05.746 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.745+0000 7f5647fff640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f564815c2c0 0x7f5648070af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:39080/0 (socket says 10.20.193.5:39080) 2026-02-17T21:25:05.746 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.745+0000 7f5647fff640 1 -- 10.20.193.5:0/2061492246 learned_addr learned my addr 10.20.193.5:0/2061492246 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:05.746 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.745+0000 7f564cc98640 1 --2- 10.20.193.5:0/2061492246 >> v2:10.20.193.135:3300/0 conn(0x7f564815c6a0 0x7f564806dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:05.746 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.745+0000 7f564cc98640 10 monclient(hunting): get_auth_request con 0x7f564815c6a0 auth_method 0 2026-02-17T21:25:05.746 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.745+0000 7f564cc98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:05.746 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.745+0000 7f564cc98640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:05.746 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.745+0000 7f564cc98640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:05.747 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.746+0000 7f564cc98640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:05.747 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.746+0000 7f564cc98640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:05.747 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.746+0000 7f564cc98640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:05.747 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.746+0000 7f5646ffd640 1 -- 10.20.193.5:0/2061492246 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2859228645 0 0) 0x7f564806d5c0 con 0x7f564815c2c0 2026-02-17T21:25:05.747 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.746+0000 7f5646ffd640 10 monclient(hunting): _negotiate 2026-02-17T21:25:05.747 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.746+0000 7f5646ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:05.747 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.746+0000 7f5646ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:05.747 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.746+0000 7f5646ffd640 10 monclient(hunting): my global_id is 4284 2026-02-17T21:25:05.747 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.746+0000 7f5646ffd640 1 -- 10.20.193.5:0/2061492246 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f562c003620 con 0x7f564815c2c0 2026-02-17T21:25:05.748 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.747+0000 7f564cc98640 10 monclient(hunting): handle_auth_done global_id 4322 payload 274 2026-02-17T21:25:05.748 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.747+0000 7f564cc98640 1 -- 10.20.193.5:0/2061492246 >> v1:10.20.193.135:6789/0 conn(0x7f56480c6aa0 legacy=0x7f56480c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:05.748 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.747+0000 7f564cc98640 1 -- 10.20.193.5:0/2061492246 >> v1:10.20.193.5:6789/0 conn(0x7f564815c2c0 legacy=0x7f5648070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:05.748 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.747+0000 7f564cc98640 10 monclient: _finish_hunting 0 2026-02-17T21:25:05.748 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.747+0000 7f564cc98640 1 monclient: found mon.noname-c 2026-02-17T21:25:05.748 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.747+0000 7f564cc98640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:05.748 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.747+0000 7f564cc98640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:05.749 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.747+0000 7f564cc98640 1 -- 10.20.193.5:0/2061492246 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56480c7290 con 0x7f564815c6a0 2026-02-17T21:25:05.751 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.750+0000 7f564cc98640 1 --2- 10.20.193.5:0/2061492246 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f564815c6a0 0x7f564806dd50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f563c009d90 tx=0x7f563c02f2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84a9b591b0fa442e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:05.753 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.752+0000 7f5646ffd640 1 -- 10.20.193.5:0/2061492246 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c03c070 con 0x7f564815c6a0 2026-02-17T21:25:05.753 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.752+0000 7f5646ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:05.753 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.752+0000 7f5646ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:05.753 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.752+0000 7f5646ffd640 10 monclient: dump: 2026-02-17T21:25:05.753 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:25:05.753 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:05.753 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:05.753 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:05.753 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.752+0000 7f5646ffd640 10 monclient: _finish_auth 0 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.752+0000 7f5646ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.752+0000 7f5646ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.752+0000 7f5646ffd640 1 -- 10.20.193.5:0/2061492246 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f563c037440 con 0x7f564815c6a0 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.752+0000 7f5646ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.752+0000 7f5646ffd640 1 -- 10.20.193.5:0/2061492246 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c037810 con 0x7f564815c6a0 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.752+0000 7f5646ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.752+0000 7f5646ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.752+0000 7f5646ffd640 10 monclient: dump: 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.752+0000 7f564e722640 5 monclient: authenticate success, global_id 4322 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.752+0000 7f564e722640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:05.754 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.752+0000 7f564e722640 4 set_mon_vals no callback set 2026-02-17T21:25:05.755 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.752+0000 7f564e722640 10 monclient: shutdown 2026-02-17T21:25:05.755 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.752+0000 7f564e722640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:05.755 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.752+0000 7f564e722640 1 -- 10.20.193.5:0/2061492246 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f564815c6a0 msgr2=0x7f564806dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:05.755 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.752+0000 7f564e722640 1 --2- 10.20.193.5:0/2061492246 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f564815c6a0 0x7f564806dd50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f563c009d90 tx=0x7f563c02f2c0 comp rx=0 tx=0).stop 2026-02-17T21:25:05.755 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.753+0000 7f564e722640 1 -- 10.20.193.5:0/2061492246 shutdown_connections 2026-02-17T21:25:05.755 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.753+0000 7f564e722640 1 --2- 10.20.193.5:0/2061492246 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f564815c6a0 0x7f564806dd50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:05.755 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.753+0000 7f564e722640 1 -- 10.20.193.5:0/2061492246 >> 10.20.193.5:0/2061492246 conn(0x7f56480c9f30 msgr2=0x7f56480ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:05.755 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.753+0000 7f564e722640 1 -- 10.20.193.5:0/2061492246 shutdown_connections 2026-02-17T21:25:05.755 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.753+0000 7f564e722640 1 -- 10.20.193.5:0/2061492246 wait complete. 2026-02-17T21:25:05.755 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.753+0000 7f564e722640 10 monclient: build_initial_monmap 2026-02-17T21:25:05.755 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.753+0000 7f564e722640 10 monclient: monmap: 2026-02-17T21:25:05.755 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:25:05.755 INFO:teuthology.misc.health.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:05.755 INFO:teuthology.misc.health.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:05.755 INFO:teuthology.misc.health.trial005.stderr:created 0.000000 2026-02-17T21:25:05.755 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:05.755 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:25:05.755 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:05.755 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:05.755 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:05.755 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:25:05.755 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.753+0000 7f564e722640 1 librados: starting msgr at 2026-02-17T21:25:05.755 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.753+0000 7f564e722640 1 librados: starting objecter 2026-02-17T21:25:05.755 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.753+0000 7f564e722640 1 Processor -- start 2026-02-17T21:25:05.756 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.753+0000 7f564e722640 1 -- start start 2026-02-17T21:25:05.756 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.753+0000 7f564e722640 1 librados: setting wanted keys 2026-02-17T21:25:05.756 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.753+0000 7f564e722640 1 librados: calling monclient init 2026-02-17T21:25:05.756 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.753+0000 7f564e722640 10 monclient: init 2026-02-17T21:25:05.756 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564e722640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:05.756 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564e722640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:25:05.756 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564e722640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f56480c6aa0 0x7f56481f3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:05.756 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564e722640 10 monclient(hunting): picked mon.noname-b con 0x7f56480c6aa0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:05.756 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564e722640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f564815c2c0 0x7f56481427c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:05.756 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564e722640 10 monclient(hunting): picked mon.noname-c con 0x7f564815c2c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:05.756 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564e722640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f564815c6a0 0x7f564814b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:05.756 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564e722640 10 monclient(hunting): picked mon.noname-a con 0x7f564815c6a0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:05.756 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564e722640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:05.756 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564e722640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f56480c7850 con 0x7f564815c6a0 2026-02-17T21:25:05.756 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564e722640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:05.756 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564e722640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f564806d830 con 0x7f56480c6aa0 2026-02-17T21:25:05.756 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564e722640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:05.756 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564e722640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f564806e290 con 0x7f564815c2c0 2026-02-17T21:25:05.756 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564e722640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:05.756 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564e722640 10 monclient(hunting): authenticate will time out at 1011.319157s 2026-02-17T21:25:05.756 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564cc98640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f564815c6a0 0x7f564814b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:05.756 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f56477fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f564815c2c0 0x7f56481427c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:05.756 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564cc98640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f564815c6a0 0x7f564814b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:51974/0 (socket says 10.20.193.5:51974) 2026-02-17T21:25:05.756 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564cc98640 1 -- 10.20.193.5:0/446162857 learned_addr learned my addr 10.20.193.5:0/446162857 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564cc98640 10 monclient(hunting): get_auth_request con 0x7f564815c6a0 auth_method 0 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564cc98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564cc98640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564cc98640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f5647fff640 1 --2- 10.20.193.5:0/446162857 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f56480c6aa0 0x7f56481f3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f56477fe640 10 monclient(hunting): get_auth_request con 0x7f564815c2c0 auth_method 0 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f56477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f56477fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f56477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564cc98640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564cc98640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f564cc98640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f5647fff640 10 monclient(hunting): get_auth_request con 0x7f56480c6aa0 auth_method 0 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f5647fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f5647fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.754+0000 7f5647fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.755+0000 7f56477fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.755+0000 7f56477fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.755+0000 7f56477fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.755+0000 7f5647fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.755+0000 7f5647fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.755+0000 7f5647fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.756+0000 7f564cc98640 10 monclient(hunting): handle_auth_done global_id 4287 payload 824 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.756+0000 7f564cc98640 1 -- 10.20.193.5:0/446162857 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f564815c2c0 msgr2=0x7f56481427c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.756+0000 7f564cc98640 1 --2- 10.20.193.5:0/446162857 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f564815c2c0 0x7f56481427c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.756+0000 7f564cc98640 1 -- 10.20.193.5:0/446162857 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f56480c6aa0 msgr2=0x7f56481f3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.756+0000 7f564cc98640 1 --2- 10.20.193.5:0/446162857 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f56480c6aa0 0x7f56481f3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.756+0000 7f564cc98640 10 monclient: _finish_hunting 0 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.756+0000 7f564cc98640 1 monclient: found mon.noname-a 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.756+0000 7f564cc98640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.756+0000 7f564cc98640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:05.757 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.756+0000 7f564cc98640 1 -- 10.20.193.5:0/446162857 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56481f44e0 con 0x7f564815c6a0 2026-02-17T21:25:05.759 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.758+0000 7f564cc98640 1 --2- 10.20.193.5:0/446162857 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f564815c6a0 0x7f564814b530 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f563c03a040 tx=0x7f563c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:05.759 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.758+0000 7f5644ff9640 10 client.?.objecter ms_handle_connect 0x7f564815c6a0 2026-02-17T21:25:05.759 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.758+0000 7f5644ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:05.761 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.760+0000 7f5644ff9640 1 -- 10.20.193.5:0/446162857 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c03c050 con 0x7f564815c6a0 2026-02-17T21:25:05.761 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.760+0000 7f5644ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:05.761 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.760+0000 7f5644ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:05.761 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.760+0000 7f5644ff9640 10 monclient: dump: 2026-02-17T21:25:05.761 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.760+0000 7f5644ff9640 10 monclient: _finish_auth 0 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.760+0000 7f5644ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.760+0000 7f5644ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.760+0000 7f5644ff9640 1 -- 10.20.193.5:0/446162857 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f563c048070 con 0x7f564815c6a0 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.760+0000 7f564e722640 5 monclient: authenticate success, global_id 4287 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.760+0000 7f564e722640 10 monclient: _renew_subs 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.760+0000 7f564e722640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.760+0000 7f564e722640 1 -- 10.20.193.5:0/446162857 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56481f47c0 con 0x7f564815c6a0 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.760+0000 7f5644ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.760+0000 7f5644ff9640 1 -- 10.20.193.5:0/446162857 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c041a30 con 0x7f564815c6a0 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.760+0000 7f5644ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.760+0000 7f56467fc640 4 set_mon_vals no callback set 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.760+0000 7f5644ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.760+0000 7f5644ff9640 10 monclient: dump: 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.760+0000 7f564e722640 10 client.4287.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.760+0000 7f564e722640 10 monclient: _renew_subs 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.760+0000 7f564e722640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.760+0000 7f564e722640 1 -- 10.20.193.5:0/446162857 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56480736b0 con 0x7f564815c6a0 2026-02-17T21:25:05.762 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.760+0000 7f564e722640 1 librados: init done 2026-02-17T21:25:05.763 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.761+0000 7f564e722640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:05.763 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.761+0000 7f564e722640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:05.763 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.761+0000 7f564e722640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:05.763 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.761+0000 7f564e722640 1 -- 10.20.193.5:0/446162857 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f564806e6c0 con 0x7f564815c6a0 2026-02-17T21:25:05.776 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.775+0000 7f5644ff9640 1 -- 10.20.193.5:0/446162857 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 6) ==== 100189+0+0 (secure 0 0 0) 0x7f563c041bd0 con 0x7f564815c6a0 2026-02-17T21:25:05.776 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.775+0000 7f5644ff9640 1 --2- 10.20.193.5:0/446162857 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f56180791f0 0x7f561807b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:05.777 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.776+0000 7f5647fff640 1 --2- 10.20.193.5:0/446162857 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f56180791f0 0x7f561807b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:05.777 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.776+0000 7f5647fff640 10 monclient: get_auth_request con 0x7f56180791f0 auth_method 0 2026-02-17T21:25:05.777 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.776+0000 7f5644ff9640 10 client.4287.objecter ms_handle_connect 0x7f56180791f0 2026-02-17T21:25:05.777 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.776+0000 7f5647fff640 1 --2- 10.20.193.5:0/446162857 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f56180791f0 0x7f561807b6b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5634005980 tx=0x7f5634007dd0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:05.779 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.778+0000 7f5644ff9640 1 -- 10.20.193.5:0/446162857 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 2565+0+0 (secure 0 0 0) 0x7f563c084760 con 0x7f564815c6a0 2026-02-17T21:25:05.779 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.778+0000 7f5644ff9640 10 client.4287.objecter ms_dispatch2 0x7f5648000b90 osd_map(19..19 src has 1..19) 2026-02-17T21:25:05.779 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.778+0000 7f5644ff9640 3 client.4287.objecter handle_osd_map got epochs [19,19] > 0 2026-02-17T21:25:05.779 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.778+0000 7f5644ff9640 3 client.4287.objecter handle_osd_map decoding full epoch 19 2026-02-17T21:25:05.779 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.778+0000 7f5644ff9640 20 client.4287.objecter dump_active .. 0 homeless 2026-02-17T21:25:05.885 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.884+0000 7f5644ff9640 1 -- 10.20.193.5:0/446162857 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f563c088720 con 0x7f564815c6a0 2026-02-17T21:25:05.885 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.884+0000 7f5644ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:05.885 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.884+0000 7f5644ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:05.974 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.973+0000 7f564e722640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:25:05.974 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.973+0000 7f564e722640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:25:05.975 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.973+0000 7f564e722640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:05.975 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.973+0000 7f564e722640 1 -- 10.20.193.5:0/446162857 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f56480c9c20 con 0x7f564815c6a0 2026-02-17T21:25:05.985 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.984+0000 7f5644ff9640 1 -- 10.20.193.5:0/446162857 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12879 (secure 0 0 0) 0x7f563c08ca20 con 0x7f564815c6a0 2026-02-17T21:25:05.985 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.984+0000 7f5644ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:25:05.985 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.984+0000 7f5644ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:05.986 INFO:teuthology.misc.health.trial005.stdout: 2026-02-17T21:25:05.986 INFO:teuthology.misc.health.trial005.stdout:{"epoch":19,"fsid":"b1be373b-56c5-4b5b-a965-9bcc20042691","created":"2026-02-17T21:23:38.622021+0000","modified":"2026-02-17T21:23:44.366223+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:23:44.366223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8bffc5e9-1f92-4603-bf29-ce19225edc1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8ffdf919-2ec4-4c1f-a69f-aee5cea211e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d186244a-4bf7-416d-b6a0-0e0f5af50eb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"093b417e-53bf-4b60-a937-7c5ffee43e1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0a48e684-05b0-41b1-a553-022424011225","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d73b7c38-cef9-4993-b353-908c1d87603c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f7774c25-72e8-41b2-8634-517af7a213b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"30a68802-afce-499b-90ce-bd568bc69406","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"8b4a2001-3ac8-4756-9dcf-af38c6d12d44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"dfdfee67-eff6-4413-bd7a-adc0a019bfbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"fc24ee77-5a0d-41d4-88f5-8d03a77c7608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"1d737681-1923-453a-82f8-516eeb875559","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"c4f0322e-a862-4c5e-967e-4551087ede8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"0b5e9861-a194-4f11-a849-d8bb94ce95a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"6f182077-0c0d-481c-97b4-43ef48aa5aea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"537605ff-bedd-4f2b-922f-e2eaa8c17f48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:25:05.989 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.986+0000 7f564e722640 10 librados: watch_flush enter 2026-02-17T21:25:05.989 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.986+0000 7f564e722640 10 librados: watch_flush exit 2026-02-17T21:25:05.989 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.986+0000 7f564e722640 20 client.4287.objecter shutdown clearing up homeless session... 2026-02-17T21:25:05.989 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.986+0000 7f564e722640 10 client.4287.objecter successfully canceled tick 2026-02-17T21:25:05.990 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.986+0000 7f564e722640 1 -- 10.20.193.5:0/446162857 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f56180791f0 msgr2=0x7f561807b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:05.990 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.986+0000 7f564e722640 1 --2- 10.20.193.5:0/446162857 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f56180791f0 0x7f561807b6b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5634005980 tx=0x7f5634007dd0 comp rx=0 tx=0).stop 2026-02-17T21:25:05.990 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.986+0000 7f564e722640 10 monclient: shutdown 2026-02-17T21:25:05.990 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.986+0000 7f564e722640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:05.990 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.986+0000 7f564e722640 1 -- 10.20.193.5:0/446162857 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f564815c6a0 msgr2=0x7f564814b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:05.990 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.986+0000 7f564e722640 1 --2- 10.20.193.5:0/446162857 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f564815c6a0 0x7f564814b530 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f563c03a040 tx=0x7f563c004b40 comp rx=0 tx=0).stop 2026-02-17T21:25:05.990 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.986+0000 7f564e722640 1 -- 10.20.193.5:0/446162857 shutdown_connections 2026-02-17T21:25:05.991 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.986+0000 7f564e722640 1 --2- 10.20.193.5:0/446162857 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f56180791f0 0x7f561807b6b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:05.991 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.986+0000 7f564e722640 1 --2- 10.20.193.5:0/446162857 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f564815c6a0 0x7f564814b530 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:05.991 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.986+0000 7f564e722640 1 --2- 10.20.193.5:0/446162857 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f564815c2c0 0x7f56481427c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:05.991 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.986+0000 7f564e722640 1 --2- 10.20.193.5:0/446162857 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f56480c6aa0 0x7f56481f3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:05.991 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.986+0000 7f564e722640 1 -- 10.20.193.5:0/446162857 >> 10.20.193.5:0/446162857 conn(0x7f56480c9f30 msgr2=0x7f564814d680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:05.991 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.986+0000 7f564e722640 1 -- 10.20.193.5:0/446162857 shutdown_connections 2026-02-17T21:25:05.991 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.986+0000 7f564e722640 1 -- 10.20.193.5:0/446162857 wait complete. 2026-02-17T21:25:05.991 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:05.986+0000 7f564e722640 1 librados: shutdown 2026-02-17T21:25:05.998 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T21:25:13.609 DEBUG:teuthology.orchestra.run.trial005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:25:13.674 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.672+0000 7fbc6e7fe640 10 monclient: get_monmap_and_config 2026-02-17T21:25:13.674 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.672+0000 7fbc6e7fe640 10 monclient: build_initial_monmap 2026-02-17T21:25:13.674 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.672+0000 7fbc6e7fe640 10 monclient: monmap: 2026-02-17T21:25:13.674 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:25:13.674 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:13.674 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:25:13.673375+0000 2026-02-17T21:25:13.674 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:25:13.673375+0000 2026-02-17T21:25:13.675 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:13.675 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:25:13.675 INFO:teuthology.misc.health.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:13.675 INFO:teuthology.misc.health.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:13.675 INFO:teuthology.misc.health.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:13.675 INFO:teuthology.misc.health.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:13.675 INFO:teuthology.misc.health.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:13.675 INFO:teuthology.misc.health.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:13.675 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:25:13.678 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.673+0000 7fbc6e7fe640 1 Processor -- start 2026-02-17T21:25:13.678 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.673+0000 7fbc6e7fe640 1 -- start start 2026-02-17T21:25:13.678 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.673+0000 7fbc6e7fe640 10 monclient: init 2026-02-17T21:25:13.678 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.673+0000 7fbc6e7fe640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:13.679 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.673+0000 7fbc6e7fe640 10 monclient: _add_conns ranks=[1,0,3,5,2,4] 2026-02-17T21:25:13.679 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.673+0000 7fbc6e7fe640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fbc681504c0 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:13.679 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.673+0000 7fbc6e7fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbc680c7120 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:13.679 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.673+0000 7fbc6e7fe640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fbc680c7550 0x7fbc6815d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:13.679 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.673+0000 7fbc6e7fe640 10 monclient(hunting): picked mon.noname-a con 0x7fbc680c7550 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:13.679 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.673+0000 7fbc6e7fe640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc680c7930 con 0x7fbc680c7120 2026-02-17T21:25:13.679 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.673+0000 7fbc6e7fe640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc680c59d0 con 0x7fbc681504c0 2026-02-17T21:25:13.679 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.673+0000 7fbc6e7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:13.679 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.673+0000 7fbc6e7fe640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fbc680c5c70 con 0x7fbc680c7550 2026-02-17T21:25:13.679 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.673+0000 7fbc6e7fe640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:13.679 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.673+0000 7fbc6e7fe640 10 monclient(hunting): authenticate will time out at 1019.238767s 2026-02-17T21:25:13.679 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.674+0000 7fbc6cd74640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fbc680c7550 0x7fbc6815d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:13.680 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.674+0000 7fbc67fff640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7fbc681504c0 0x7fbc680c52c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:56082/0 (socket says 10.20.193.5:56082) 2026-02-17T21:25:13.680 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.674+0000 7fbc67fff640 1 -- 10.20.193.5:0/2185630298 learned_addr learned my addr 10.20.193.5:0/2185630298 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:13.680 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.674+0000 7fbc6cd74640 10 monclient(hunting): get_auth_request con 0x7fbc680c7550 auth_method 0 2026-02-17T21:25:13.680 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.674+0000 7fbc6cd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:13.680 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.674+0000 7fbc6cd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:13.680 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.674+0000 7fbc6cd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:13.680 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.675+0000 7fbc6cd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:13.680 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.675+0000 7fbc6cd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:13.680 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.675+0000 7fbc6cd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:13.680 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.676+0000 7fbc66ffd640 1 -- 10.20.193.5:0/2185630298 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 358535263 0 0) 0x7fbc680c59d0 con 0x7fbc681504c0 2026-02-17T21:25:13.680 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.676+0000 7fbc66ffd640 10 monclient(hunting): _negotiate 2026-02-17T21:25:13.680 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.676+0000 7fbc66ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:13.681 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.676+0000 7fbc66ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:13.681 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.676+0000 7fbc66ffd640 10 monclient(hunting): my global_id is 4330 2026-02-17T21:25:13.681 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.676+0000 7fbc66ffd640 1 -- 10.20.193.5:0/2185630298 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc4c003620 con 0x7fbc681504c0 2026-02-17T21:25:13.681 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.676+0000 7fbc6cd74640 10 monclient(hunting): handle_auth_done global_id 4290 payload 274 2026-02-17T21:25:13.681 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.676+0000 7fbc6cd74640 1 -- 10.20.193.5:0/2185630298 >> v1:10.20.193.119:6789/0 conn(0x7fbc681504c0 legacy=0x7fbc680c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:13.681 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.676+0000 7fbc6cd74640 1 -- 10.20.193.5:0/2185630298 >> v1:10.20.193.5:6789/0 conn(0x7fbc680c7120 legacy=0x7fbc680c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:13.681 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.676+0000 7fbc6cd74640 10 monclient: _finish_hunting 0 2026-02-17T21:25:13.681 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.676+0000 7fbc6cd74640 1 monclient: found mon.noname-a 2026-02-17T21:25:13.681 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.676+0000 7fbc6cd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:13.681 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.676+0000 7fbc6cd74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:13.681 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.676+0000 7fbc6cd74640 1 -- 10.20.193.5:0/2185630298 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc6815def0 con 0x7fbc680c7550 2026-02-17T21:25:13.687 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.678+0000 7fbc6cd74640 1 --2- 10.20.193.5:0/2185630298 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbc680c7550 0x7fbc6815d080 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbc680c5ba0 tx=0x7fbc5c02f360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6090c332005103 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:13.687 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.680+0000 7fbc66ffd640 1 -- 10.20.193.5:0/2185630298 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c03c070 con 0x7fbc680c7550 2026-02-17T21:25:13.687 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.680+0000 7fbc66ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:13.688 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.680+0000 7fbc66ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:13.688 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.680+0000 7fbc66ffd640 10 monclient: dump: 2026-02-17T21:25:13.688 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:25:13.688 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:13.688 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:13.688 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:13.688 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:13.688 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:25:13.688 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:13.688 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:13.689 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:13.689 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:25:13.689 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.680+0000 7fbc66ffd640 10 monclient: _finish_auth 0 2026-02-17T21:25:13.689 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.680+0000 7fbc66ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:13.689 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.680+0000 7fbc66ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:13.689 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.680+0000 7fbc66ffd640 1 -- 10.20.193.5:0/2185630298 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc5c037640 con 0x7fbc680c7550 2026-02-17T21:25:13.689 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.680+0000 7fbc66ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:13.689 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.680+0000 7fbc66ffd640 1 -- 10.20.193.5:0/2185630298 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c037a10 con 0x7fbc680c7550 2026-02-17T21:25:13.689 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.680+0000 7fbc6e7fe640 5 monclient: authenticate success, global_id 4290 2026-02-17T21:25:13.689 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.680+0000 7fbc6e7fe640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:13.689 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.680+0000 7fbc6e7fe640 4 set_mon_vals no callback set 2026-02-17T21:25:13.690 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.680+0000 7fbc66ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:13.690 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.680+0000 7fbc66ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:13.690 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.680+0000 7fbc66ffd640 10 monclient: dump: 2026-02-17T21:25:13.690 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:25:13.690 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:13.690 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:13.690 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:13.690 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:13.690 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:25:13.690 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:13.690 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:13.691 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:13.691 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:25:13.691 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.681+0000 7fbc6e7fe640 10 monclient: shutdown 2026-02-17T21:25:13.691 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.681+0000 7fbc6e7fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:13.691 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.681+0000 7fbc6e7fe640 1 -- 10.20.193.5:0/2185630298 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbc680c7550 msgr2=0x7fbc6815d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:13.691 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.681+0000 7fbc6e7fe640 1 --2- 10.20.193.5:0/2185630298 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbc680c7550 0x7fbc6815d080 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbc680c5ba0 tx=0x7fbc5c02f360 comp rx=0 tx=0).stop 2026-02-17T21:25:13.691 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.681+0000 7fbc6e7fe640 1 -- 10.20.193.5:0/2185630298 shutdown_connections 2026-02-17T21:25:13.691 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.681+0000 7fbc6e7fe640 1 --2- 10.20.193.5:0/2185630298 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbc680c7550 0x7fbc6815d080 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:13.691 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.681+0000 7fbc6e7fe640 1 -- 10.20.193.5:0/2185630298 >> 10.20.193.5:0/2185630298 conn(0x7fbc680c9f30 msgr2=0x7fbc680ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:13.691 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.681+0000 7fbc6e7fe640 1 -- 10.20.193.5:0/2185630298 shutdown_connections 2026-02-17T21:25:13.692 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.681+0000 7fbc6e7fe640 1 -- 10.20.193.5:0/2185630298 wait complete. 2026-02-17T21:25:13.692 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.681+0000 7fbc6e7fe640 10 monclient: build_initial_monmap 2026-02-17T21:25:13.692 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.681+0000 7fbc6e7fe640 10 monclient: monmap: 2026-02-17T21:25:13.692 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:25:13.692 INFO:teuthology.misc.health.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:13.692 INFO:teuthology.misc.health.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:13.692 INFO:teuthology.misc.health.trial005.stderr:created 0.000000 2026-02-17T21:25:13.692 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:13.692 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:25:13.692 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:13.692 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:13.693 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:13.693 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:25:13.693 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6e7fe640 1 librados: starting msgr at 2026-02-17T21:25:13.693 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6e7fe640 1 librados: starting objecter 2026-02-17T21:25:13.693 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6e7fe640 1 Processor -- start 2026-02-17T21:25:13.693 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6e7fe640 1 -- start start 2026-02-17T21:25:13.693 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6e7fe640 1 librados: setting wanted keys 2026-02-17T21:25:13.693 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6e7fe640 1 librados: calling monclient init 2026-02-17T21:25:13.693 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6e7fe640 10 monclient: init 2026-02-17T21:25:13.693 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6e7fe640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:13.693 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6e7fe640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:25:13.693 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6e7fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbc680c7120 0x7fbc680744e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:13.694 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6e7fe640 10 monclient(hunting): picked mon.noname-c con 0x7fbc680c7120 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:13.694 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6e7fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbc680c7550 0x7fbc6806f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:13.694 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6e7fe640 10 monclient(hunting): picked mon.noname-b con 0x7fbc680c7550 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:13.694 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6e7fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbc681504c0 0x7fbc680cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:13.694 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6e7fe640 10 monclient(hunting): picked mon.noname-a con 0x7fbc681504c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:13.694 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6e7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:13.694 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6e7fe640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbc680c8570 con 0x7fbc681504c0 2026-02-17T21:25:13.694 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6e7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:13.694 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6e7fe640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbc680c8290 con 0x7fbc680c7550 2026-02-17T21:25:13.694 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6e7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:13.694 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6e7fe640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbc680c8850 con 0x7fbc680c7120 2026-02-17T21:25:13.695 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6e7fe640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:13.695 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6e7fe640 10 monclient(hunting): authenticate will time out at 1019.247557s 2026-02-17T21:25:13.695 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6cd74640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbc681504c0 0x7fbc680cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:13.695 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6cd74640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbc681504c0 0x7fbc680cc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:35226/0 (socket says 10.20.193.5:35226) 2026-02-17T21:25:13.695 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6cd74640 1 -- 10.20.193.5:0/2593855190 learned_addr learned my addr 10.20.193.5:0/2593855190 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:13.695 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6cd74640 10 monclient(hunting): get_auth_request con 0x7fbc681504c0 auth_method 0 2026-02-17T21:25:13.695 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6cd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:13.695 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6cd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:13.695 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.682+0000 7fbc6cd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:13.695 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.683+0000 7fbc677fe640 1 --2- 10.20.193.5:0/2593855190 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbc680c7550 0x7fbc6806f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:13.695 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.683+0000 7fbc6cd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:13.696 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.683+0000 7fbc6cd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:13.696 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.683+0000 7fbc6cd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:13.696 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.683+0000 7fbc67fff640 1 --2- 10.20.193.5:0/2593855190 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbc680c7120 0x7fbc680744e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:13.696 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.683+0000 7fbc677fe640 10 monclient(hunting): get_auth_request con 0x7fbc680c7550 auth_method 0 2026-02-17T21:25:13.696 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.683+0000 7fbc677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:13.696 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.683+0000 7fbc677fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:13.696 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.683+0000 7fbc677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:13.696 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.683+0000 7fbc67fff640 10 monclient(hunting): get_auth_request con 0x7fbc680c7120 auth_method 0 2026-02-17T21:25:13.696 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.683+0000 7fbc67fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:13.696 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.683+0000 7fbc67fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:13.696 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.683+0000 7fbc67fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:13.697 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.683+0000 7fbc677fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:13.697 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.683+0000 7fbc677fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:13.697 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.683+0000 7fbc677fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:13.697 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.683+0000 7fbc67fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:13.697 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.683+0000 7fbc67fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:13.697 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.683+0000 7fbc67fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:13.697 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.684+0000 7fbc6cd74640 10 monclient(hunting): handle_auth_done global_id 4296 payload 824 2026-02-17T21:25:13.697 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.684+0000 7fbc6cd74640 1 -- 10.20.193.5:0/2593855190 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbc680c7120 msgr2=0x7fbc680744e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:13.697 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.684+0000 7fbc6cd74640 1 --2- 10.20.193.5:0/2593855190 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbc680c7120 0x7fbc680744e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:13.697 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.684+0000 7fbc6cd74640 1 -- 10.20.193.5:0/2593855190 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbc680c7550 msgr2=0x7fbc6806f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:13.697 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.684+0000 7fbc6cd74640 1 --2- 10.20.193.5:0/2593855190 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbc680c7550 0x7fbc6806f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:13.697 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.684+0000 7fbc6cd74640 10 monclient: _finish_hunting 0 2026-02-17T21:25:13.698 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.684+0000 7fbc6cd74640 1 monclient: found mon.noname-a 2026-02-17T21:25:13.698 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.684+0000 7fbc6cd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:13.698 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.684+0000 7fbc6cd74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:13.698 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.684+0000 7fbc6cd74640 1 -- 10.20.193.5:0/2593855190 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc68074a20 con 0x7fbc681504c0 2026-02-17T21:25:13.698 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.685+0000 7fbc6cd74640 1 --2- 10.20.193.5:0/2593855190 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbc681504c0 0x7fbc680cc550 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c017330 tx=0x7fbc5c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:13.698 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.685+0000 7fbc64ff9640 10 client.?.objecter ms_handle_connect 0x7fbc681504c0 2026-02-17T21:25:13.698 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.685+0000 7fbc64ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:13.700 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.687+0000 7fbc64ff9640 1 -- 10.20.193.5:0/2593855190 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c03c050 con 0x7fbc681504c0 2026-02-17T21:25:13.700 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.687+0000 7fbc64ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:13.700 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.687+0000 7fbc64ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:13.701 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.687+0000 7fbc64ff9640 10 monclient: dump: 2026-02-17T21:25:13.701 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:25:13.701 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:13.701 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:13.701 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:13.701 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:13.701 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:25:13.701 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:13.701 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:13.701 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:13.701 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:25:13.702 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.687+0000 7fbc64ff9640 10 monclient: _finish_auth 0 2026-02-17T21:25:13.702 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.687+0000 7fbc64ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:25:13.702 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.687+0000 7fbc64ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:13.702 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.687+0000 7fbc64ff9640 1 -- 10.20.193.5:0/2593855190 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc5c048070 con 0x7fbc681504c0 2026-02-17T21:25:13.702 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.687+0000 7fbc64ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:13.702 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.687+0000 7fbc6e7fe640 5 monclient: authenticate success, global_id 4296 2026-02-17T21:25:13.702 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.687+0000 7fbc64ff9640 1 -- 10.20.193.5:0/2593855190 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c009450 con 0x7fbc681504c0 2026-02-17T21:25:13.702 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.687+0000 7fbc6e7fe640 10 monclient: _renew_subs 2026-02-17T21:25:13.702 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.687+0000 7fbc6e7fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:13.702 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.687+0000 7fbc6e7fe640 1 -- 10.20.193.5:0/2593855190 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc681544b0 con 0x7fbc681504c0 2026-02-17T21:25:13.702 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.687+0000 7fbc64ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:13.702 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.687+0000 7fbc64ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:13.703 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.687+0000 7fbc667fc640 4 set_mon_vals no callback set 2026-02-17T21:25:13.703 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.687+0000 7fbc64ff9640 10 monclient: dump: 2026-02-17T21:25:13.703 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:25:13.703 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:13.703 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:13.703 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:13.703 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:13.703 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:25:13.703 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:13.703 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:13.703 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:13.703 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:25:13.704 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.687+0000 7fbc6e7fe640 10 client.4296.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:13.704 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.687+0000 7fbc6e7fe640 10 monclient: _renew_subs 2026-02-17T21:25:13.704 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.687+0000 7fbc6e7fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:13.704 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.687+0000 7fbc6e7fe640 1 -- 10.20.193.5:0/2593855190 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc68154a70 con 0x7fbc681504c0 2026-02-17T21:25:13.704 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.687+0000 7fbc6e7fe640 1 librados: init done 2026-02-17T21:25:13.704 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.688+0000 7fbc6e7fe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:13.704 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.688+0000 7fbc6e7fe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:13.704 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.688+0000 7fbc6e7fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:13.704 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.688+0000 7fbc6e7fe640 1 -- 10.20.193.5:0/2593855190 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc680c8b30 con 0x7fbc681504c0 2026-02-17T21:25:13.705 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.700+0000 7fbc64ff9640 1 -- 10.20.193.5:0/2593855190 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 6) ==== 100189+0+0 (secure 0 0 0) 0x7fbc5c035b40 con 0x7fbc681504c0 2026-02-17T21:25:13.705 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.701+0000 7fbc64ff9640 1 --2- 10.20.193.5:0/2593855190 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbc380791f0 0x7fbc3807b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:13.705 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.701+0000 7fbc67fff640 1 --2- 10.20.193.5:0/2593855190 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbc380791f0 0x7fbc3807b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:13.706 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.701+0000 7fbc67fff640 10 monclient: get_auth_request con 0x7fbc380791f0 auth_method 0 2026-02-17T21:25:13.706 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.702+0000 7fbc64ff9640 10 client.4296.objecter ms_handle_connect 0x7fbc380791f0 2026-02-17T21:25:13.706 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.702+0000 7fbc67fff640 1 --2- 10.20.193.5:0/2593855190 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbc380791f0 0x7fbc3807b6b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbc54005980 tx=0x7fbc54007dd0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:13.810 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.808+0000 7fbc64ff9640 1 -- 10.20.193.5:0/2593855190 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 2565+0+0 (secure 0 0 0) 0x7fbc5c084790 con 0x7fbc681504c0 2026-02-17T21:25:13.810 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.808+0000 7fbc64ff9640 10 client.4296.objecter ms_dispatch2 0x7fbc68000b90 osd_map(19..19 src has 1..19) 2026-02-17T21:25:13.810 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.808+0000 7fbc64ff9640 3 client.4296.objecter handle_osd_map got epochs [19,19] > 0 2026-02-17T21:25:13.810 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.808+0000 7fbc64ff9640 3 client.4296.objecter handle_osd_map decoding full epoch 19 2026-02-17T21:25:13.810 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.808+0000 7fbc64ff9640 20 client.4296.objecter dump_active .. 0 homeless 2026-02-17T21:25:13.810 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.808+0000 7fbc64ff9640 1 -- 10.20.193.5:0/2593855190 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbc5c088750 con 0x7fbc681504c0 2026-02-17T21:25:13.811 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.808+0000 7fbc64ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:13.811 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.808+0000 7fbc64ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:13.900 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.899+0000 7fbc6e7fe640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:25:13.901 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.899+0000 7fbc6e7fe640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:25:13.901 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.899+0000 7fbc6e7fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:13.901 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.899+0000 7fbc6e7fe640 1 -- 10.20.193.5:0/2593855190 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc681574b0 con 0x7fbc681504c0 2026-02-17T21:25:13.911 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.910+0000 7fbc64ff9640 1 -- 10.20.193.5:0/2593855190 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12879 (secure 0 0 0) 0x7fbc5c08ca50 con 0x7fbc681504c0 2026-02-17T21:25:13.911 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.910+0000 7fbc64ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:25:13.911 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.910+0000 7fbc64ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:13.911 INFO:teuthology.misc.health.trial005.stdout: 2026-02-17T21:25:13.912 INFO:teuthology.misc.health.trial005.stdout:{"epoch":19,"fsid":"b1be373b-56c5-4b5b-a965-9bcc20042691","created":"2026-02-17T21:23:38.622021+0000","modified":"2026-02-17T21:23:44.366223+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:23:44.366223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8bffc5e9-1f92-4603-bf29-ce19225edc1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8ffdf919-2ec4-4c1f-a69f-aee5cea211e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d186244a-4bf7-416d-b6a0-0e0f5af50eb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"093b417e-53bf-4b60-a937-7c5ffee43e1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0a48e684-05b0-41b1-a553-022424011225","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d73b7c38-cef9-4993-b353-908c1d87603c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f7774c25-72e8-41b2-8634-517af7a213b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"30a68802-afce-499b-90ce-bd568bc69406","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"8b4a2001-3ac8-4756-9dcf-af38c6d12d44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"dfdfee67-eff6-4413-bd7a-adc0a019bfbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"fc24ee77-5a0d-41d4-88f5-8d03a77c7608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"1d737681-1923-453a-82f8-516eeb875559","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"c4f0322e-a862-4c5e-967e-4551087ede8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"0b5e9861-a194-4f11-a849-d8bb94ce95a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"6f182077-0c0d-481c-97b4-43ef48aa5aea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"537605ff-bedd-4f2b-922f-e2eaa8c17f48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:25:13.914 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.912+0000 7fbc6e7fe640 10 librados: watch_flush enter 2026-02-17T21:25:13.914 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.912+0000 7fbc6e7fe640 10 librados: watch_flush exit 2026-02-17T21:25:13.914 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.912+0000 7fbc6e7fe640 20 client.4296.objecter shutdown clearing up homeless session... 2026-02-17T21:25:13.914 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.912+0000 7fbc6e7fe640 10 client.4296.objecter successfully canceled tick 2026-02-17T21:25:13.915 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.912+0000 7fbc6e7fe640 1 -- 10.20.193.5:0/2593855190 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbc380791f0 msgr2=0x7fbc3807b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:13.915 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.912+0000 7fbc6e7fe640 1 --2- 10.20.193.5:0/2593855190 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbc380791f0 0x7fbc3807b6b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbc54005980 tx=0x7fbc54007dd0 comp rx=0 tx=0).stop 2026-02-17T21:25:13.915 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.912+0000 7fbc6e7fe640 10 monclient: shutdown 2026-02-17T21:25:13.915 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.912+0000 7fbc6e7fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:13.915 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.912+0000 7fbc6e7fe640 1 -- 10.20.193.5:0/2593855190 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbc681504c0 msgr2=0x7fbc680cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:13.915 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.912+0000 7fbc6e7fe640 1 --2- 10.20.193.5:0/2593855190 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbc681504c0 0x7fbc680cc550 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c017330 tx=0x7fbc5c004b40 comp rx=0 tx=0).stop 2026-02-17T21:25:13.915 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.912+0000 7fbc6e7fe640 1 -- 10.20.193.5:0/2593855190 shutdown_connections 2026-02-17T21:25:13.915 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.912+0000 7fbc6e7fe640 1 --2- 10.20.193.5:0/2593855190 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbc380791f0 0x7fbc3807b6b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:13.915 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.912+0000 7fbc6e7fe640 1 --2- 10.20.193.5:0/2593855190 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbc681504c0 0x7fbc680cc550 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:13.915 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.912+0000 7fbc6e7fe640 1 --2- 10.20.193.5:0/2593855190 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbc680c7550 0x7fbc6806f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:13.915 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.912+0000 7fbc6e7fe640 1 --2- 10.20.193.5:0/2593855190 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbc680c7120 0x7fbc680744e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:13.916 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.912+0000 7fbc6e7fe640 1 -- 10.20.193.5:0/2593855190 >> 10.20.193.5:0/2593855190 conn(0x7fbc680c9f30 msgr2=0x7fbc6814d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:13.916 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.912+0000 7fbc6e7fe640 1 -- 10.20.193.5:0/2593855190 shutdown_connections 2026-02-17T21:25:13.916 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.912+0000 7fbc6e7fe640 1 -- 10.20.193.5:0/2593855190 wait complete. 2026-02-17T21:25:13.916 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:13.912+0000 7fbc6e7fe640 1 librados: shutdown 2026-02-17T21:25:13.923 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T21:25:15.395 INFO:tasks.ceph.osd.5.trial119.stderr:2026-02-17T21:25:15.391+0000 77b6940 -1 osd.5 0 log_to_monitors true 2026-02-17T21:25:15.461 INFO:tasks.ceph.osd.1.trial119.stderr:2026-02-17T21:25:15.457+0000 77b6940 -1 osd.1 0 log_to_monitors true 2026-02-17T21:25:15.532 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:15.528+0000 77b6940 -1 osd.13 0 log_to_monitors true 2026-02-17T21:25:15.922 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:15.918+0000 77b6940 -1 osd.9 0 log_to_monitors true 2026-02-17T21:25:16.719 INFO:tasks.ceph.osd.11.trial176.stderr:2026-02-17T21:25:16.713+0000 77b6940 -1 osd.11 0 log_to_monitors true 2026-02-17T21:25:16.900 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:16.895+0000 77b6940 -1 osd.3 0 log_to_monitors true 2026-02-17T21:25:17.097 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:17.094+0000 77b6940 -1 osd.6 0 log_to_monitors true 2026-02-17T21:25:17.137 INFO:tasks.ceph.osd.7.trial176.stderr:2026-02-17T21:25:17.129+0000 77b6940 -1 osd.7 0 log_to_monitors true 2026-02-17T21:25:17.227 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:17.221+0000 77b6940 -1 osd.15 0 log_to_monitors true 2026-02-17T21:25:17.275 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:01:56.900 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:17.277 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:01:56.902 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:17.286 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:01:56.911 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:17.302 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:01:56.926 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:17.305 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:01:56.891 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:17.306 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:01:56.893 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:17.312 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:01:56.936 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:17.316 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:01:56.902 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:17.321 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:01:56.945 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:17.527 INFO:tasks.ceph.osd.0.trial005.stderr:2026-02-17T21:25:17.523+0000 77b6940 -1 osd.0 0 log_to_monitors true 2026-02-17T21:25:17.751 INFO:tasks.ceph.osd.14.trial135.stderr:2026-02-17T21:25:17.749+0000 77b6940 -1 osd.14 0 log_to_monitors true 2026-02-17T21:25:17.801 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:17.796+0000 77b6940 -1 osd.4 0 log_to_monitors true 2026-02-17T21:25:17.817 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:17.811+0000 77b6940 -1 osd.10 0 log_to_monitors true 2026-02-17T21:25:17.871 INFO:tasks.ceph.osd.5.trial119.stderr:2026-02-17T21:25:17.867+0000 deb0640 -1 osd.5 0 waiting for initial osdmap 2026-02-17T21:25:17.877 INFO:tasks.ceph.osd.1.trial119.stderr:2026-02-17T21:25:17.873+0000 deb0640 -1 osd.1 0 waiting for initial osdmap 2026-02-17T21:25:18.004 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:17.999+0000 77b6940 -1 osd.2 0 log_to_monitors true 2026-02-17T21:25:18.075 INFO:tasks.ceph.osd.1.trial119.stderr:2026-02-17T21:25:18.067+0000 11c74640 -1 osd.1 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:25:18.084 INFO:tasks.ceph.osd.5.trial119.stderr:2026-02-17T21:25:18.076+0000 11c74640 -1 osd.5 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:25:18.103 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:18.099+0000 77b6940 -1 osd.8 0 log_to_monitors true 2026-02-17T21:25:18.226 INFO:tasks.ceph.osd.12.trial005.stderr:2026-02-17T21:25:18.222+0000 77b6940 -1 osd.12 0 log_to_monitors true 2026-02-17T21:25:18.923 INFO:tasks.ceph.osd.7.trial176.stderr:2026-02-17T21:25:18.917+0000 ce9c640 -1 osd.7 0 waiting for initial osdmap 2026-02-17T21:25:18.947 INFO:tasks.ceph.osd.11.trial176.stderr:2026-02-17T21:25:18.941+0000 ce9c640 -1 osd.11 0 waiting for initial osdmap 2026-02-17T21:25:19.112 INFO:tasks.ceph.osd.7.trial176.stderr:2026-02-17T21:25:19.101+0000 11c74640 -1 osd.7 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:25:19.131 INFO:tasks.ceph.osd.11.trial176.stderr:2026-02-17T21:25:19.120+0000 11c74640 -1 osd.11 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:25:19.937 INFO:tasks.ceph.osd.12.trial005.stderr:2026-02-17T21:25:19.933+0000 deb0640 -1 osd.12 0 waiting for initial osdmap 2026-02-17T21:25:20.006 INFO:tasks.ceph.osd.14.trial135.stderr:2026-02-17T21:25:20.003+0000 ce9c640 -1 osd.14 0 waiting for initial osdmap 2026-02-17T21:25:20.035 INFO:tasks.ceph.osd.0.trial005.stderr:2026-02-17T21:25:20.031+0000 deb0640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T21:25:20.222 INFO:tasks.ceph.osd.12.trial005.stderr:2026-02-17T21:25:20.213+0000 11c74640 -1 osd.12 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:25:20.227 INFO:tasks.ceph.osd.14.trial135.stderr:2026-02-17T21:25:20.220+0000 11c74640 -1 osd.14 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:25:20.263 INFO:tasks.ceph.osd.0.trial005.stderr:2026-02-17T21:25:20.254+0000 11c74640 -1 osd.0 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:25:21.223 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.203+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.233 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.208+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:25:21.234 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.223+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:25:21.235 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.225+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.240 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.231+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:25:21.242 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.234+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.247 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.240+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.250 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.234+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:25:21.253 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.245+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.264 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.238+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:25:21.264 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.248+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:25:21.275 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.258+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:25:21.306 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.262+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:25:21.306 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.274+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:25:21.307 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.304+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:25:21.307 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.251+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.307 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.262+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.318 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.281+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.335 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.310+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:25:21.340 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.305+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.347 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.339+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.348 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.341+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:25:21.348 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.345+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:25:21.348 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.345+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.372 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.360+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.382 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.370+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.382 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.380+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.394 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.359+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 2 2026-02-17T21:25:21.396 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.387+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.406 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.393+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:25:21.416 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.411+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.425 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.420+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 2 2026-02-17T21:25:21.457 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.440+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.457 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.445+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.460 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.435+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:25:21.474 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.454+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.477 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.463+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.483 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.459+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 2 2026-02-17T21:25:21.495 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.481+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:25:21.497 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.475+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.497 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.489+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.517 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.495+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.532 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.493+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 2 2026-02-17T21:25:21.534 DEBUG:teuthology.orchestra.run.trial005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:25:21.537 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.515+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 3 2026-02-17T21:25:21.538 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.535+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.547 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.545+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.550 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.529+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:25:21.551 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.538+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:25:21.566 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.548+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:25:21.581 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.568+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.593 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.590+0000 7f481b9a7640 10 monclient: get_monmap_and_config 2026-02-17T21:25:21.593 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.590+0000 7f481b9a7640 10 monclient: build_initial_monmap 2026-02-17T21:25:21.593 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.590+0000 7f481b9a7640 10 monclient: monmap: 2026-02-17T21:25:21.593 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:25:21.593 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:21.593 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:25:21.592579+0000 2026-02-17T21:25:21.594 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:25:21.592579+0000 2026-02-17T21:25:21.594 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:21.594 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:25:21.594 INFO:teuthology.misc.health.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:21.594 INFO:teuthology.misc.health.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:21.594 INFO:teuthology.misc.health.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:21.594 INFO:teuthology.misc.health.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:21.594 INFO:teuthology.misc.health.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:21.594 INFO:teuthology.misc.health.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:21.594 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:25:21.597 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.591+0000 7f481b9a7640 1 Processor -- start 2026-02-17T21:25:21.597 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.591+0000 7f481b9a7640 1 -- start start 2026-02-17T21:25:21.598 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.591+0000 7f481b9a7640 10 monclient: init 2026-02-17T21:25:21.598 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.591+0000 7f481b9a7640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:21.598 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.591+0000 7f481b9a7640 10 monclient: _add_conns ranks=[5,0,4,2,1,3] 2026-02-17T21:25:21.598 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.591+0000 7f481b9a7640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f48141504c0 0x7f48140c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:21.598 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.591+0000 7f481b9a7640 10 monclient(hunting): picked mon.noname-c con 0x7f48141504c0 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:21.598 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.591+0000 7f481b9a7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f48140c7120 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:21.598 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.591+0000 7f481b9a7640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f48140c7550 0x7f481415d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:21.598 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.591+0000 7f481b9a7640 10 monclient(hunting): picked mon.noname-b con 0x7f48140c7550 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:21.598 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.591+0000 7f481b9a7640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48140c7930 con 0x7f48140c7120 2026-02-17T21:25:21.598 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.591+0000 7f481b9a7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:21.598 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.591+0000 7f481b9a7640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f48140c5c70 con 0x7f48140c7550 2026-02-17T21:25:21.598 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.592+0000 7f481b9a7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:21.599 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.592+0000 7f481b9a7640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f481415def0 con 0x7f48141504c0 2026-02-17T21:25:21.599 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.592+0000 7f481b9a7640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:21.599 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.592+0000 7f481b9a7640 10 monclient(hunting): authenticate will time out at 1027.158026s 2026-02-17T21:25:21.599 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.592+0000 7f481971c640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f48141504c0 0x7f48140c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:21.599 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.592+0000 7f4819f1d640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f48140c7550 0x7f481415d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:21.599 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.592+0000 7f481971c640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f48141504c0 0x7f48140c52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:48908/0 (socket says 10.20.193.5:48908) 2026-02-17T21:25:21.599 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.592+0000 7f481971c640 1 -- 10.20.193.5:0/2701772575 learned_addr learned my addr 10.20.193.5:0/2701772575 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:21.599 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.592+0000 7f481971c640 10 monclient(hunting): get_auth_request con 0x7f48141504c0 auth_method 0 2026-02-17T21:25:21.599 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.592+0000 7f481971c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:21.599 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.592+0000 7f481971c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:21.599 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.592+0000 7f481971c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:21.599 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.592+0000 7f4819f1d640 10 monclient(hunting): get_auth_request con 0x7f48140c7550 auth_method 0 2026-02-17T21:25:21.600 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.592+0000 7f4819f1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:21.600 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.592+0000 7f4819f1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:21.600 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.592+0000 7f4819f1d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:21.600 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.592+0000 7f481971c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:21.600 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.592+0000 7f481971c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:21.600 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.592+0000 7f481971c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:21.600 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.593+0000 7f4819f1d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:21.600 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.593+0000 7f4819f1d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:21.600 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.593+0000 7f4819f1d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:21.600 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.594+0000 7f481971c640 10 monclient(hunting): handle_auth_done global_id 4382 payload 274 2026-02-17T21:25:21.600 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.594+0000 7f481971c640 1 -- 10.20.193.5:0/2701772575 >> v2:10.20.193.119:3300/0 conn(0x7f48140c7550 msgr2=0x7f481415d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:21.600 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.594+0000 7f481971c640 1 --2- 10.20.193.5:0/2701772575 >> v2:10.20.193.119:3300/0 conn(0x7f48140c7550 0x7f481415d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:21.601 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.594+0000 7f481971c640 1 -- 10.20.193.5:0/2701772575 >> v1:10.20.193.5:6789/0 conn(0x7f48140c7120 legacy=0x7f48140c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:21.601 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.594+0000 7f481971c640 10 monclient: _finish_hunting 0 2026-02-17T21:25:21.601 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.594+0000 7f481971c640 1 monclient: found mon.noname-c 2026-02-17T21:25:21.601 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.594+0000 7f481971c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:21.601 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.594+0000 7f481971c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:21.601 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.594+0000 7f481971c640 1 -- 10.20.193.5:0/2701772575 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48140c7fb0 con 0x7f48141504c0 2026-02-17T21:25:21.607 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.595+0000 7f481971c640 1 --2- 10.20.193.5:0/2701772575 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f48141504c0 0x7f48140c52c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4814072320 tx=0x7f480402efe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5da8a3a8de803085 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:21.608 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.597+0000 7f4803fff640 1 -- 10.20.193.5:0/2701772575 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480403c070 con 0x7f48141504c0 2026-02-17T21:25:21.608 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.597+0000 7f4803fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:21.608 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.597+0000 7f4803fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:21.608 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.597+0000 7f4803fff640 10 monclient: dump: 2026-02-17T21:25:21.608 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:25:21.608 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:21.608 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:21.608 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:21.608 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:21.608 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:25:21.609 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:21.609 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:21.609 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:21.609 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:25:21.609 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.597+0000 7f4803fff640 10 monclient: _finish_auth 0 2026-02-17T21:25:21.609 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.597+0000 7f4803fff640 10 monclient: _check_auth_tickets 2026-02-17T21:25:21.609 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.597+0000 7f4803fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:21.609 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.597+0000 7f4803fff640 1 -- 10.20.193.5:0/2701772575 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f480402fcf0 con 0x7f48141504c0 2026-02-17T21:25:21.609 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.597+0000 7f4803fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:21.609 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.597+0000 7f4803fff640 1 -- 10.20.193.5:0/2701772575 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4804037660 con 0x7f48141504c0 2026-02-17T21:25:21.609 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.597+0000 7f4803fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:21.610 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.597+0000 7f4803fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:21.610 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.597+0000 7f4803fff640 10 monclient: dump: 2026-02-17T21:25:21.610 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:25:21.610 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:21.610 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:21.610 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:21.610 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:21.610 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:25:21.610 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:21.610 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:21.610 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:21.610 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:25:21.611 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.597+0000 7f481b9a7640 5 monclient: authenticate success, global_id 4382 2026-02-17T21:25:21.611 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.597+0000 7f481b9a7640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:21.611 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.597+0000 7f481b9a7640 4 set_mon_vals no callback set 2026-02-17T21:25:21.611 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.597+0000 7f481b9a7640 10 monclient: shutdown 2026-02-17T21:25:21.611 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.597+0000 7f481b9a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:21.611 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.597+0000 7f481b9a7640 1 -- 10.20.193.5:0/2701772575 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f48141504c0 msgr2=0x7f48140c52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:21.611 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.597+0000 7f481b9a7640 1 --2- 10.20.193.5:0/2701772575 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f48141504c0 0x7f48140c52c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4814072320 tx=0x7f480402efe0 comp rx=0 tx=0).stop 2026-02-17T21:25:21.611 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.598+0000 7f481b9a7640 1 -- 10.20.193.5:0/2701772575 shutdown_connections 2026-02-17T21:25:21.611 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.598+0000 7f481b9a7640 1 --2- 10.20.193.5:0/2701772575 >> v2:10.20.193.119:3300/0 conn(0x7f48140c7550 0x7f481415d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:21.611 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.598+0000 7f481b9a7640 1 --2- 10.20.193.5:0/2701772575 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f48141504c0 0x7f48140c52c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:21.611 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.598+0000 7f481b9a7640 1 -- 10.20.193.5:0/2701772575 >> 10.20.193.5:0/2701772575 conn(0x7f48140c9f30 msgr2=0x7f48140ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:21.611 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.598+0000 7f481b9a7640 1 -- 10.20.193.5:0/2701772575 shutdown_connections 2026-02-17T21:25:21.612 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.598+0000 7f481b9a7640 1 -- 10.20.193.5:0/2701772575 wait complete. 2026-02-17T21:25:21.612 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.598+0000 7f481b9a7640 10 monclient: build_initial_monmap 2026-02-17T21:25:21.612 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.598+0000 7f481b9a7640 10 monclient: monmap: 2026-02-17T21:25:21.612 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:25:21.612 INFO:teuthology.misc.health.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:21.612 INFO:teuthology.misc.health.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:21.612 INFO:teuthology.misc.health.trial005.stderr:created 0.000000 2026-02-17T21:25:21.612 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:21.612 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:25:21.612 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:21.612 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:21.612 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:21.613 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:25:21.613 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.598+0000 7f481b9a7640 1 librados: starting msgr at 2026-02-17T21:25:21.613 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.598+0000 7f481b9a7640 1 librados: starting objecter 2026-02-17T21:25:21.613 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.598+0000 7f481b9a7640 1 Processor -- start 2026-02-17T21:25:21.613 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.598+0000 7f481b9a7640 1 -- start start 2026-02-17T21:25:21.613 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.598+0000 7f481b9a7640 1 librados: setting wanted keys 2026-02-17T21:25:21.613 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.598+0000 7f481b9a7640 1 librados: calling monclient init 2026-02-17T21:25:21.613 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.598+0000 7f481b9a7640 10 monclient: init 2026-02-17T21:25:21.613 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f481b9a7640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:21.613 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f481b9a7640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:25:21.613 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f481b9a7640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f48140c7120 0x7f4814154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:21.613 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f481b9a7640 10 monclient(hunting): picked mon.noname-c con 0x7f48140c7120 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:21.614 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f481b9a7640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f48140c7550 0x7f481413f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:21.614 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f481b9a7640 10 monclient(hunting): picked mon.noname-b con 0x7f48140c7550 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:21.614 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f481b9a7640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f48141504c0 0x7f481413e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:21.614 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f481b9a7640 10 monclient(hunting): picked mon.noname-a con 0x7f48141504c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:21.614 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f481b9a7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:21.614 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f481b9a7640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f48140c8850 con 0x7f48141504c0 2026-02-17T21:25:21.614 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f481b9a7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:21.614 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f481b9a7640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f48140c8570 con 0x7f48140c7550 2026-02-17T21:25:21.614 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f481b9a7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:21.614 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f481b9a7640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f48140c8b30 con 0x7f48140c7120 2026-02-17T21:25:21.614 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f481b9a7640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:21.614 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f481b9a7640 10 monclient(hunting): authenticate will time out at 1027.165238s 2026-02-17T21:25:21.615 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f4819f1d640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f48141504c0 0x7f481413e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:21.615 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f4818f1b640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f48140c7550 0x7f481413f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:21.615 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f481971c640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f48140c7120 0x7f4814154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:21.615 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f4819f1d640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f48141504c0 0x7f481413e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:40642/0 (socket says 10.20.193.5:40642) 2026-02-17T21:25:21.615 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f4819f1d640 1 -- 10.20.193.5:0/1640169860 learned_addr learned my addr 10.20.193.5:0/1640169860 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:21.615 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f4819f1d640 10 monclient(hunting): get_auth_request con 0x7f48141504c0 auth_method 0 2026-02-17T21:25:21.615 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f4819f1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:21.615 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f4819f1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:21.615 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f4819f1d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:21.615 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f481971c640 10 monclient(hunting): get_auth_request con 0x7f48140c7120 auth_method 0 2026-02-17T21:25:21.615 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f481971c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:21.616 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f481971c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:21.616 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f481971c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:21.616 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f4818f1b640 10 monclient(hunting): get_auth_request con 0x7f48140c7550 auth_method 0 2026-02-17T21:25:21.616 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f4818f1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:21.616 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f4818f1b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:21.616 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.599+0000 7f4818f1b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:21.616 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.600+0000 7f481971c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:21.616 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.600+0000 7f481971c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:21.616 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.600+0000 7f481971c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:21.616 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.600+0000 7f4819f1d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:21.616 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.600+0000 7f4819f1d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:21.616 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.600+0000 7f4819f1d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:21.617 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.600+0000 7f4818f1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:21.617 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.600+0000 7f4818f1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:21.617 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.600+0000 7f4818f1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:21.617 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.601+0000 7f481971c640 10 monclient(hunting): handle_auth_done global_id 4385 payload 824 2026-02-17T21:25:21.617 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.601+0000 7f481971c640 1 -- 10.20.193.5:0/1640169860 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f48140c7550 msgr2=0x7f481413f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:21.617 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.601+0000 7f481971c640 1 --2- 10.20.193.5:0/1640169860 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f48140c7550 0x7f481413f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:21.617 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.601+0000 7f481971c640 1 -- 10.20.193.5:0/1640169860 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f48141504c0 msgr2=0x7f481413e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:21.617 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.601+0000 7f481971c640 1 --2- 10.20.193.5:0/1640169860 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f48141504c0 0x7f481413e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:21.617 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.601+0000 7f481971c640 10 monclient: _finish_hunting 0 2026-02-17T21:25:21.617 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.601+0000 7f481971c640 1 monclient: found mon.noname-c 2026-02-17T21:25:21.617 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.601+0000 7f481971c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:21.617 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.601+0000 7f481971c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:21.618 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.601+0000 7f481971c640 1 -- 10.20.193.5:0/1640169860 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48140cc060 con 0x7f48140c7120 2026-02-17T21:25:21.618 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.602+0000 7f481971c640 1 --2- 10.20.193.5:0/1640169860 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f48140c7120 0x7f4814154380 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4814069890 tx=0x7f48040047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:21.618 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.602+0000 7f4801ffb640 10 client.?.objecter ms_handle_connect 0x7f48140c7120 2026-02-17T21:25:21.618 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.602+0000 7f4801ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:21.618 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.604+0000 7f4801ffb640 1 -- 10.20.193.5:0/1640169860 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480403c040 con 0x7f48140c7120 2026-02-17T21:25:21.618 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.604+0000 7f4801ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:21.618 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.604+0000 7f4801ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:21.618 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.604+0000 7f4801ffb640 10 monclient: dump: 2026-02-17T21:25:21.618 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:25:21.618 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:21.618 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:21.619 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:21.619 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:21.619 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:25:21.619 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:21.619 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:21.619 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:21.619 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:25:21.619 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.604+0000 7f4801ffb640 10 monclient: _finish_auth 0 2026-02-17T21:25:21.619 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.604+0000 7f4801ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:25:21.619 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.604+0000 7f4801ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:21.619 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.604+0000 7f4801ffb640 1 -- 10.20.193.5:0/1640169860 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4804042650 con 0x7f48140c7120 2026-02-17T21:25:21.619 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.604+0000 7f4801ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:21.620 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.604+0000 7f4801ffb640 1 -- 10.20.193.5:0/1640169860 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4804042a40 con 0x7f48140c7120 2026-02-17T21:25:21.620 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.604+0000 7f4801ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:21.620 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.604+0000 7f4801ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:21.620 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.604+0000 7f48037fe640 4 set_mon_vals no callback set 2026-02-17T21:25:21.620 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.604+0000 7f4801ffb640 10 monclient: dump: 2026-02-17T21:25:21.620 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:25:21.620 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:21.620 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:21.620 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:21.620 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:21.620 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:25:21.620 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:21.621 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:21.621 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:21.621 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:25:21.621 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.604+0000 7f481b9a7640 5 monclient: authenticate success, global_id 4385 2026-02-17T21:25:21.621 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.604+0000 7f481b9a7640 10 monclient: _renew_subs 2026-02-17T21:25:21.621 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.604+0000 7f481b9a7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:21.621 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.604+0000 7f481b9a7640 1 -- 10.20.193.5:0/1640169860 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48140cc340 con 0x7f48140c7120 2026-02-17T21:25:21.621 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.604+0000 7f481b9a7640 10 client.4385.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:21.621 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.604+0000 7f481b9a7640 10 monclient: _renew_subs 2026-02-17T21:25:21.621 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.604+0000 7f481b9a7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:21.621 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.604+0000 7f481b9a7640 1 -- 10.20.193.5:0/1640169860 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48140cc900 con 0x7f48140c7120 2026-02-17T21:25:21.622 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.604+0000 7f481b9a7640 1 librados: init done 2026-02-17T21:25:21.622 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.605+0000 7f481b9a7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:21.622 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.605+0000 7f481b9a7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:21.622 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.605+0000 7f481b9a7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:21.622 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.605+0000 7f481b9a7640 1 -- 10.20.193.5:0/1640169860 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48141508a0 con 0x7f48140c7120 2026-02-17T21:25:21.623 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.564+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:25:21.624 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.616+0000 7f4801ffb640 1 -- 10.20.193.5:0/1640169860 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 6) ==== 100189+0+0 (secure 0 0 0) 0x7f4804042be0 con 0x7f48140c7120 2026-02-17T21:25:21.624 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.616+0000 7f4801ffb640 1 --2- 10.20.193.5:0/1640169860 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f47e4079240 0x7f47e407b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:21.624 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.616+0000 7f4818f1b640 1 --2- 10.20.193.5:0/1640169860 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f47e4079240 0x7f47e407b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:21.625 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.617+0000 7f4818f1b640 10 monclient: get_auth_request con 0x7f47e4079240 auth_method 0 2026-02-17T21:25:21.625 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.617+0000 7f4801ffb640 10 client.4385.objecter ms_handle_connect 0x7f47e4079240 2026-02-17T21:25:21.625 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.617+0000 7f4818f1b640 1 --2- 10.20.193.5:0/1640169860 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f47e4079240 0x7f47e407b700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f481413f4b0 tx=0x7f4808007f30 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:21.625 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.618+0000 7f4801ffb640 1 -- 10.20.193.5:0/1640169860 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6043+0+0 (secure 0 0 0) 0x7f480402fbb0 con 0x7f48140c7120 2026-02-17T21:25:21.625 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.618+0000 7f4801ffb640 10 client.4385.objecter ms_dispatch2 0x7f4814000b90 osd_map(24..24 src has 1..24) 2026-02-17T21:25:21.625 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.618+0000 7f4801ffb640 3 client.4385.objecter handle_osd_map got epochs [24,24] > 0 2026-02-17T21:25:21.625 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.618+0000 7f4801ffb640 3 client.4385.objecter handle_osd_map decoding full epoch 24 2026-02-17T21:25:21.625 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.619+0000 7f4801ffb640 20 client.4385.objecter dump_active .. 0 homeless 2026-02-17T21:25:21.627 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.625+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:25:21.628 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.579+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.637 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.591+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.637 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.602+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.637 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.634+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.677 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.645+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:25:21.682 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:21.651+0000 77b6940 -1 bdev(0x1ab192e0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-17T21:25:21.683 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:21.675+0000 77b6940 -1 bdev(0x1a6e0540 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:25:21.723 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.721+0000 7f4801ffb640 1 -- 10.20.193.5:0/1640169860 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f48040879d0 con 0x7f48140c7120 2026-02-17T21:25:21.723 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.721+0000 7f4801ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:21.724 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.721+0000 7f4801ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:21.810 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.807+0000 7f481b9a7640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:25:21.810 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.807+0000 7f481b9a7640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:25:21.810 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.807+0000 7f481b9a7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:21.810 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.807+0000 7f481b9a7640 1 -- 10.20.193.5:0/1640169860 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f48141574b0 con 0x7f48140c7120 2026-02-17T21:25:21.850 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.848+0000 7f4801ffb640 1 -- 10.20.193.5:0/1640169860 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+17919 (secure 0 0 0) 0x7f480408bcd0 con 0x7f48140c7120 2026-02-17T21:25:21.851 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.848+0000 7f4801ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:25:21.851 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.848+0000 7f4801ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:21.851 INFO:teuthology.misc.health.trial005.stdout: 2026-02-17T21:25:21.851 INFO:teuthology.misc.health.trial005.stdout:{"epoch":24,"fsid":"b1be373b-56c5-4b5b-a965-9bcc20042691","created":"2026-02-17T21:23:38.622021+0000","modified":"2026-02-17T21:25:20.927446+0000","last_up_change":"2026-02-17T21:25:20.927446+0000","last_in_change":"2026-02-17T21:23:44.366223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T21:25:19.677742+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"8bffc5e9-1f92-4603-bf29-ce19225edc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6808","nonce":3662168592},{"type":"v1","addr":"10.20.193.5:6809","nonce":3662168592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6810","nonce":3662168592},{"type":"v1","addr":"10.20.193.5:6811","nonce":3662168592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6814","nonce":3662168592},{"type":"v1","addr":"10.20.193.5:6815","nonce":3662168592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6812","nonce":3662168592},{"type":"v1","addr":"10.20.193.5:6813","nonce":3662168592}]},"public_addr":"10.20.193.5:6809/3662168592","cluster_addr":"10.20.193.5:6811/3662168592","heartbeat_back_addr":"10.20.193.5:6815/3662168592","heartbeat_front_addr":"10.20.193.5:6813/3662168592","state":["exists","up"]},{"osd":1,"uuid":"8ffdf919-2ec4-4c1f-a69f-aee5cea211e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6800","nonce":267553149},{"type":"v1","addr":"10.20.193.119:6801","nonce":267553149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6802","nonce":267553149},{"type":"v1","addr":"10.20.193.119:6803","nonce":267553149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6806","nonce":267553149},{"type":"v1","addr":"10.20.193.119:6807","nonce":267553149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6804","nonce":267553149},{"type":"v1","addr":"10.20.193.119:6805","nonce":267553149}]},"public_addr":"10.20.193.119:6801/267553149","cluster_addr":"10.20.193.119:6803/267553149","heartbeat_back_addr":"10.20.193.119:6807/267553149","heartbeat_front_addr":"10.20.193.119:6805/267553149","state":["exists","up"]},{"osd":2,"uuid":"d186244a-4bf7-416d-b6a0-0e0f5af50eb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"093b417e-53bf-4b60-a937-7c5ffee43e1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0a48e684-05b0-41b1-a553-022424011225","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d73b7c38-cef9-4993-b353-908c1d87603c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6818","nonce":4010664603},{"type":"v1","addr":"10.20.193.119:6820","nonce":4010664603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6824","nonce":4010664603},{"type":"v1","addr":"10.20.193.119:6825","nonce":4010664603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6830","nonce":4010664603},{"type":"v1","addr":"10.20.193.119:6831","nonce":4010664603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6828","nonce":4010664603},{"type":"v1","addr":"10.20.193.119:6829","nonce":4010664603}]},"public_addr":"10.20.193.119:6820/4010664603","cluster_addr":"10.20.193.119:6825/4010664603","heartbeat_back_addr":"10.20.193.119:6831/4010664603","heartbeat_front_addr":"10.20.193.119:6829/4010664603","state":["exists","up"]},{"osd":6,"uuid":"f7774c25-72e8-41b2-8634-517af7a213b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"30a68802-afce-499b-90ce-bd568bc69406","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6826","nonce":1604873931},{"type":"v1","addr":"10.20.193.176:6827","nonce":1604873931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6828","nonce":1604873931},{"type":"v1","addr":"10.20.193.176:6829","nonce":1604873931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6832","nonce":1604873931},{"type":"v1","addr":"10.20.193.176:6833","nonce":1604873931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6830","nonce":1604873931},{"type":"v1","addr":"10.20.193.176:6831","nonce":1604873931}]},"public_addr":"10.20.193.176:6827/1604873931","cluster_addr":"10.20.193.176:6829/1604873931","heartbeat_back_addr":"10.20.193.176:6833/1604873931","heartbeat_front_addr":"10.20.193.176:6831/1604873931","state":["exists","up"]},{"osd":8,"uuid":"8b4a2001-3ac8-4756-9dcf-af38c6d12d44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"dfdfee67-eff6-4413-bd7a-adc0a019bfbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"fc24ee77-5a0d-41d4-88f5-8d03a77c7608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"1d737681-1923-453a-82f8-516eeb875559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6802","nonce":3067818664},{"type":"v1","addr":"10.20.193.176:6803","nonce":3067818664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6804","nonce":3067818664},{"type":"v1","addr":"10.20.193.176:6805","nonce":3067818664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6808","nonce":3067818664},{"type":"v1","addr":"10.20.193.176:6809","nonce":3067818664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6806","nonce":3067818664},{"type":"v1","addr":"10.20.193.176:6807","nonce":3067818664}]},"public_addr":"10.20.193.176:6803/3067818664","cluster_addr":"10.20.193.176:6805/3067818664","heartbeat_back_addr":"10.20.193.176:6809/3067818664","heartbeat_front_addr":"10.20.193.176:6807/3067818664","state":["exists","up"]},{"osd":12,"uuid":"c4f0322e-a862-4c5e-967e-4551087ede8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6818","nonce":2028057944},{"type":"v1","addr":"10.20.193.5:6819","nonce":2028057944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6823","nonce":2028057944},{"type":"v1","addr":"10.20.193.5:6825","nonce":2028057944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6830","nonce":2028057944},{"type":"v1","addr":"10.20.193.5:6831","nonce":2028057944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6827","nonce":2028057944},{"type":"v1","addr":"10.20.193.5:6829","nonce":2028057944}]},"public_addr":"10.20.193.5:6819/2028057944","cluster_addr":"10.20.193.5:6825/2028057944","heartbeat_back_addr":"10.20.193.5:6831/2028057944","heartbeat_front_addr":"10.20.193.5:6829/2028057944","state":["exists","up"]},{"osd":13,"uuid":"0b5e9861-a194-4f11-a849-d8bb94ce95a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"6f182077-0c0d-481c-97b4-43ef48aa5aea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6816","nonce":1552304264},{"type":"v1","addr":"10.20.193.135:6817","nonce":1552304264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6818","nonce":1552304264},{"type":"v1","addr":"10.20.193.135:6819","nonce":1552304264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6822","nonce":1552304264},{"type":"v1","addr":"10.20.193.135:6823","nonce":1552304264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6820","nonce":1552304264},{"type":"v1","addr":"10.20.193.135:6821","nonce":1552304264}]},"public_addr":"10.20.193.135:6817/1552304264","cluster_addr":"10.20.193.135:6819/1552304264","heartbeat_back_addr":"10.20.193.135:6823/1552304264","heartbeat_front_addr":"10.20.193.135:6821/1552304264","state":["exists","up"]},{"osd":15,"uuid":"537605ff-bedd-4f2b-922f-e2eaa8c17f48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:16.831330+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:16.741791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.473911+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.075749+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:25:21.854 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.850+0000 7f481b9a7640 10 librados: watch_flush enter 2026-02-17T21:25:21.854 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.850+0000 7f481b9a7640 10 librados: watch_flush exit 2026-02-17T21:25:21.854 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.850+0000 7f481b9a7640 20 client.4385.objecter shutdown clearing up homeless session... 2026-02-17T21:25:21.854 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.850+0000 7f481b9a7640 10 client.4385.objecter successfully canceled tick 2026-02-17T21:25:21.854 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.850+0000 7f481b9a7640 1 -- 10.20.193.5:0/1640169860 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f47e4079240 msgr2=0x7f47e407b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:21.854 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.850+0000 7f481b9a7640 1 --2- 10.20.193.5:0/1640169860 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f47e4079240 0x7f47e407b700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f481413f4b0 tx=0x7f4808007f30 comp rx=0 tx=0).stop 2026-02-17T21:25:21.854 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.850+0000 7f481b9a7640 10 monclient: shutdown 2026-02-17T21:25:21.854 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.850+0000 7f481b9a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:21.854 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.850+0000 7f481b9a7640 1 -- 10.20.193.5:0/1640169860 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f48140c7120 msgr2=0x7f4814154380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:21.854 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.850+0000 7f481b9a7640 1 --2- 10.20.193.5:0/1640169860 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f48140c7120 0x7f4814154380 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4814069890 tx=0x7f48040047c0 comp rx=0 tx=0).stop 2026-02-17T21:25:21.855 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.850+0000 7f481b9a7640 1 -- 10.20.193.5:0/1640169860 shutdown_connections 2026-02-17T21:25:21.855 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.850+0000 7f481b9a7640 1 --2- 10.20.193.5:0/1640169860 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f47e4079240 0x7f47e407b700 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:21.855 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.850+0000 7f481b9a7640 1 --2- 10.20.193.5:0/1640169860 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f48141504c0 0x7f481413e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:21.855 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.850+0000 7f481b9a7640 1 --2- 10.20.193.5:0/1640169860 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f48140c7550 0x7f481413f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:21.855 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.850+0000 7f481b9a7640 1 --2- 10.20.193.5:0/1640169860 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f48140c7120 0x7f4814154380 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:21.855 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.850+0000 7f481b9a7640 1 -- 10.20.193.5:0/1640169860 >> 10.20.193.5:0/1640169860 conn(0x7f48140c9f30 msgr2=0x7f48140ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:21.855 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.850+0000 7f481b9a7640 1 -- 10.20.193.5:0/1640169860 shutdown_connections 2026-02-17T21:25:21.855 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.850+0000 7f481b9a7640 1 -- 10.20.193.5:0/1640169860 wait complete. 2026-02-17T21:25:21.855 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:21.850+0000 7f481b9a7640 1 librados: shutdown 2026-02-17T21:25:21.860 DEBUG:teuthology.misc:7 of 16 OSDs are up 2026-02-17T21:25:22.081 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:22.076+0000 deb0640 -1 osd.9 0 waiting for initial osdmap 2026-02-17T21:25:22.089 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:22.084+0000 ce9c640 -1 osd.13 0 waiting for initial osdmap 2026-02-17T21:25:22.220 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.208+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.225 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.216+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.238 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.223+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.243 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.234+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.249 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.239+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.260 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.245+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.266 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.256+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.273 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.252+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.280 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.266+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.285 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.273+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.286 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.279+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.294 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.273+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.294 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.284+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.302 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.285+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.302 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.300+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.310 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.290+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.321 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.306+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.329 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:25:22.321+0000 15c7c640 -1 osd.13 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:25:22.333 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.318+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.335 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.310+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.336 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.328+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.346 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:25:22.337+0000 15c7c640 -1 osd.9 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:25:22.347 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.343+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.347 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.335+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.357 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.346+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.377 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.369+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.377 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.376+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.387 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.386+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.388 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.348+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 2 2026-02-17T21:25:22.388 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.372+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.398 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.390+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.404 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.400+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.423 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.412+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 2 2026-02-17T21:25:22.432 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.431+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.448 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.427+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.449 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.447+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.456 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.444+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.469 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.452+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 2 2026-02-17T21:25:22.469 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.458+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.483 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.472+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 4 2026-02-17T21:25:22.489 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.482+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.502 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.495+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.504 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.501+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.506 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.504+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.527 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.499+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.531 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.524+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 2 2026-02-17T21:25:22.543 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.528+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.552 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.526+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.553 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.540+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.563 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.551+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.565 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.549+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.575 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.562+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.576 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.572+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.588 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.574+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.588 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.587+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.620 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.605+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.633 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.624+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.633 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.632+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.648 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.616+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.649 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.633+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.660 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.637+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.660 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.648+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.670 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.628+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.670 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:22.645+0000 77b6940 -1 bdev(0x1a770be0 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T21:25:22.674 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.667+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 2 2026-02-17T21:25:22.704 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.677+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 2 2026-02-17T21:25:22.705 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.692+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.716 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.704+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:22.728 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:22.716+0000 77b6940 -1 bdev(0x1ae5a390 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T21:25:23.080 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:23.074+0000 ce9c640 -1 osd.3 0 waiting for initial osdmap 2026-02-17T21:25:23.134 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:23.119+0000 deb0640 -1 osd.6 0 waiting for initial osdmap 2026-02-17T21:25:23.256 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.253+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.286 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.270+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.302 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.283+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.308 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.297+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.311 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:25:23.301+0000 15c7c640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:25:23.320 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.284+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.320 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.308+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.320 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.312+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.330 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.319+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.332 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.318+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.335 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.330+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.339 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.330+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.344 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.324+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.345 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.337+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.352 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.338+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.352 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.350+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.356 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.330+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.356 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.342+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.358 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.344+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.358 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.343+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.359 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.349+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.364 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.356+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.364 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.355+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.367 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.363+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.370 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.362+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.371 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.369+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.372 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.360+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.377 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.366+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.377 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.375+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.377 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.370+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.378 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.354+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.381 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.368+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.382 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.379+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.383 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.376+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.391 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:25:23.384+0000 15c7c640 -1 osd.6 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:25:23.394 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.368+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.395 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.381+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 2 2026-02-17T21:25:23.395 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.382+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.398 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.390+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.400 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.385+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.404 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.396+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.407 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.402+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.411 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.393+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.416 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.399+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.421 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.405+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.423 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.419+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.424 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.391+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 3 2026-02-17T21:25:23.424 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.409+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.427 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.424+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.433 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.426+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.445 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.433+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 2 2026-02-17T21:25:23.447 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.444+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.449 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.394+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.449 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.401+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.450 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.437+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.451 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.447+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.456 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.420+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.456 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.448+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.456 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.431+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.457 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.446+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.457 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.448+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.457 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.449+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.458 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.455+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.458 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.428+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 4 2026-02-17T21:25:23.463 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.455+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.467 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.452+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 2 2026-02-17T21:25:23.480 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.461+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.488 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.473+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.488 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.455+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.490 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.456+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.490 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.481+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.491 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.484+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.491 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.477+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.492 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.490+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.495 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.464+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.495 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.480+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.502 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.489+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.505 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.475+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.506 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.504+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.507 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.503+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.508 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.488+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.508 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.495+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.509 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.505+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.517 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.510+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.517 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.516+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.518 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.492+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.523 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.516+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.525 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.523+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.529 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.514+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.535 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.524+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.543 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.524+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.548 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.530+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 3 2026-02-17T21:25:23.548 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.536+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.555 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.545+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.557 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.536+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.563 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.556+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.564 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.547+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.565 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.553+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.569 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.560+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.577 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.562+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.577 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.568+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.580 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.544+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 2 2026-02-17T21:25:23.586 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.551+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.587 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.578+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.591 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.564+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.603 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.582+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 2 2026-02-17T21:25:23.607 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.585+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.607 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.605+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 2 2026-02-17T21:25:23.609 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.594+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.612 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.603+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 3 2026-02-17T21:25:23.614 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.576+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.617 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.591+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.618 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.611+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.620 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.600+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.621 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.605+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.621 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.611+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.629 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.617+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 2 2026-02-17T21:25:23.634 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.585+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.636 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.610+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.638 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.617+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.641 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.634+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.643 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.623+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.643 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.629+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.645 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.600+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.648 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.645+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 2 2026-02-17T21:25:23.651 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.613+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.651 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.633+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.655 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.641+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.658 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.628+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.665 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.652+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.666 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.657+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.666 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.664+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.667 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.662+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.667 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.644+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.667 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.666+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.671 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.654+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.676 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.663+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.682 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.658+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.684 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.668+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.684 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.671+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.684 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.675+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.693 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.662+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.694 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.668+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.694 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.689+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.698 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.681+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.699 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.674+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.704 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.683+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.708 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.697+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.709 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.705+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.718 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.697+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.722 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.680+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.723 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.703+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.724 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.682+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.724 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.706+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.727 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.726+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 4 2026-02-17T21:25:23.729 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.722+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.731 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.714+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.733 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.697+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.738 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.734+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 2 2026-02-17T21:25:23.744 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.716+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.744 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.736+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.747 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.720+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.747 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.745+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-17T21:25:23.755 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.742+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.756 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.727+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.756 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.744+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.763 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.746+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 2 2026-02-17T21:25:23.763 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.762+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.767 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.753+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.768 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:23.757+0000 77b6940 -1 bdev(0x16f50250 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 5 2026-02-17T21:25:23.768 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:23.763+0000 77b6940 -1 bdev(0x1a763610 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:25:23.784 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.769+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.784 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:23.783+0000 77b6940 -1 bdev(0x16f39e80 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T21:25:23.796 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.770+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:23.804 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.765+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.810 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.794+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.810 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:23.802+0000 77b6940 -1 bdev(0x16f2ede0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2026-02-17T21:25:23.818 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.795+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 2 2026-02-17T21:25:23.832 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:23.817+0000 77b6940 -1 bdev(0x16f647d0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:25:24.145 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:24.128+0000 ce9c640 -1 osd.8 0 waiting for initial osdmap 2026-02-17T21:25:24.168 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:24.162+0000 ce9c640 -1 osd.15 0 waiting for initial osdmap 2026-02-17T21:25:24.180 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:24.178+0000 deb0640 -1 osd.10 0 waiting for initial osdmap 2026-02-17T21:25:24.212 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:24.208+0000 ce9c640 -1 osd.4 0 waiting for initial osdmap 2026-02-17T21:25:24.243 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:24.240+0000 deb0640 -1 osd.2 0 waiting for initial osdmap 2026-02-17T21:25:24.419 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:25:24.410+0000 15c7c640 -1 osd.8 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:25:24.425 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:25:24.417+0000 15c7c640 -1 osd.10 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:25:24.431 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:25:24.421+0000 15c7c640 -1 osd.15 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:25:24.455 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:25:24.446+0000 15c7c640 -1 osd.4 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:25:24.461 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:25:24.454+0000 15c7c640 -1 osd.2 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:25:29.473 DEBUG:teuthology.orchestra.run.trial005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:25:29.533 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.530+0000 7f9e54ded640 10 monclient: get_monmap_and_config 2026-02-17T21:25:29.533 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.530+0000 7f9e54ded640 10 monclient: build_initial_monmap 2026-02-17T21:25:29.534 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.530+0000 7f9e54ded640 10 monclient: monmap: 2026-02-17T21:25:29.534 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:25:29.534 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:29.534 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:25:29.532396+0000 2026-02-17T21:25:29.534 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:25:29.532396+0000 2026-02-17T21:25:29.534 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:29.534 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:25:29.534 INFO:teuthology.misc.health.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:29.534 INFO:teuthology.misc.health.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:29.534 INFO:teuthology.misc.health.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:29.535 INFO:teuthology.misc.health.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:29.535 INFO:teuthology.misc.health.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:29.535 INFO:teuthology.misc.health.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:29.535 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:25:29.535 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.531+0000 7f9e54ded640 1 Processor -- start 2026-02-17T21:25:29.535 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.531+0000 7f9e54ded640 1 -- start start 2026-02-17T21:25:29.535 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.531+0000 7f9e54ded640 10 monclient: init 2026-02-17T21:25:29.542 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.531+0000 7f9e54ded640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:29.543 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.531+0000 7f9e54ded640 10 monclient: _add_conns ranks=[2,4,3,5,0,1] 2026-02-17T21:25:29.543 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.531+0000 7f9e54ded640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9e5015c2c0 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:29.543 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.531+0000 7f9e54ded640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f9e500c6aa0 0x7f9e5015c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:29.543 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.531+0000 7f9e54ded640 10 monclient(hunting): picked mon.noname-b con 0x7f9e500c6aa0 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:29.543 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.531+0000 7f9e54ded640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f9e500c7e30 0x7f9e5006dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:29.543 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.531+0000 7f9e54ded640 10 monclient(hunting): picked mon.noname-a con 0x7f9e500c7e30 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:29.543 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.531+0000 7f9e54ded640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e5006d5c0 con 0x7f9e5015c2c0 2026-02-17T21:25:29.543 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.531+0000 7f9e54ded640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:29.543 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.531+0000 7f9e54ded640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9e500c6fb0 con 0x7f9e500c7e30 2026-02-17T21:25:29.543 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.531+0000 7f9e54ded640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:29.544 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.531+0000 7f9e54ded640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f9e500c7290 con 0x7f9e500c6aa0 2026-02-17T21:25:29.544 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.531+0000 7f9e54ded640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:29.544 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.531+0000 7f9e54ded640 10 monclient(hunting): authenticate will time out at 1035.097696s 2026-02-17T21:25:29.544 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.532+0000 7f9e4e575640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f9e5015c2c0 0x7f9e50070af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:45210/0 (socket says 10.20.193.5:45210) 2026-02-17T21:25:29.544 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.532+0000 7f9e4e575640 1 -- 10.20.193.5:0/3619509427 learned_addr learned my addr 10.20.193.5:0/3619509427 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:29.544 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.532+0000 7f9e4dd74640 1 --2- 10.20.193.5:0/3619509427 >> v2:10.20.193.119:3300/0 conn(0x7f9e500c6aa0 0x7f9e5015c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:29.544 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.532+0000 7f9e4ed76640 1 --2- 10.20.193.5:0/3619509427 >> v2:10.20.193.5:3300/0 conn(0x7f9e500c7e30 0x7f9e5006dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:29.544 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.532+0000 7f9e4dd74640 10 monclient(hunting): get_auth_request con 0x7f9e500c6aa0 auth_method 0 2026-02-17T21:25:29.544 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.532+0000 7f9e4dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:29.544 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.532+0000 7f9e4dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:29.545 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.532+0000 7f9e4dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:29.545 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.532+0000 7f9e4ed76640 10 monclient(hunting): get_auth_request con 0x7f9e500c7e30 auth_method 0 2026-02-17T21:25:29.545 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.532+0000 7f9e4ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:29.545 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.532+0000 7f9e4ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:29.545 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.532+0000 7f9e4ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:29.545 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.532+0000 7f9e4dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:29.545 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.532+0000 7f9e4dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:29.545 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.532+0000 7f9e4dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:29.545 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.532+0000 7f9e4ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:29.545 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.532+0000 7f9e4ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:29.545 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.532+0000 7f9e4ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:29.546 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.533+0000 7f9e4dd74640 10 monclient(hunting): handle_auth_done global_id 4390 payload 274 2026-02-17T21:25:29.546 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.533+0000 7f9e4dd74640 1 -- 10.20.193.5:0/3619509427 >> v2:10.20.193.5:3300/0 conn(0x7f9e500c7e30 msgr2=0x7f9e5006dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:29.546 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.533+0000 7f9e4dd74640 1 --2- 10.20.193.5:0/3619509427 >> v2:10.20.193.5:3300/0 conn(0x7f9e500c7e30 0x7f9e5006dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:29.546 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.533+0000 7f9e4dd74640 1 -- 10.20.193.5:0/3619509427 >> v1:10.20.193.135:6789/0 conn(0x7f9e5015c2c0 legacy=0x7f9e50070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:29.546 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.533+0000 7f9e4dd74640 10 monclient: _finish_hunting 0 2026-02-17T21:25:29.546 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.533+0000 7f9e4dd74640 1 monclient: found mon.noname-b 2026-02-17T21:25:29.546 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.533+0000 7f9e4dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:29.546 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.533+0000 7f9e4dd74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:29.546 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.533+0000 7f9e4dd74640 1 -- 10.20.193.5:0/3619509427 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e500c7570 con 0x7f9e500c6aa0 2026-02-17T21:25:29.546 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.534+0000 7f9e4dd74640 1 --2- 10.20.193.5:0/3619509427 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9e500c6aa0 0x7f9e5015c6a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9e500c4780 tx=0x7f9e3802eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fc7ae1e3dd3071a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:29.546 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e4d573640 1 -- 10.20.193.5:0/3619509427 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3803c070 con 0x7f9e500c6aa0 2026-02-17T21:25:29.546 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e4d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:29.547 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e4d573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:29.547 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e4d573640 10 monclient: dump: 2026-02-17T21:25:29.547 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:25:29.547 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:29.547 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:29.547 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:29.547 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:29.547 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:25:29.547 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:29.547 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:29.547 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:29.547 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:25:29.548 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e4d573640 10 monclient: _finish_auth 0 2026-02-17T21:25:29.548 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e4d573640 10 monclient: _check_auth_tickets 2026-02-17T21:25:29.548 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e4d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:29.548 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e4d573640 1 -- 10.20.193.5:0/3619509427 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e3802fb80 con 0x7f9e500c6aa0 2026-02-17T21:25:29.548 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e4d573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:29.548 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e4d573640 1 -- 10.20.193.5:0/3619509427 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e38037440 con 0x7f9e500c6aa0 2026-02-17T21:25:29.548 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e54ded640 5 monclient: authenticate success, global_id 4390 2026-02-17T21:25:29.548 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e54ded640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:29.548 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e54ded640 4 set_mon_vals no callback set 2026-02-17T21:25:29.548 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e4d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:29.548 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e4d573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:29.548 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e4d573640 10 monclient: dump: 2026-02-17T21:25:29.548 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:25:29.549 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:29.549 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:29.549 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:29.549 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:29.549 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:25:29.549 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:29.549 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:29.549 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:29.549 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:25:29.549 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e54ded640 10 monclient: shutdown 2026-02-17T21:25:29.549 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e54ded640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:29.549 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e54ded640 1 -- 10.20.193.5:0/3619509427 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9e500c6aa0 msgr2=0x7f9e5015c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:29.550 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e54ded640 1 --2- 10.20.193.5:0/3619509427 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9e500c6aa0 0x7f9e5015c6a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9e500c4780 tx=0x7f9e3802eeb0 comp rx=0 tx=0).stop 2026-02-17T21:25:29.550 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e54ded640 1 -- 10.20.193.5:0/3619509427 shutdown_connections 2026-02-17T21:25:29.550 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e54ded640 1 --2- 10.20.193.5:0/3619509427 >> v2:10.20.193.5:3300/0 conn(0x7f9e500c7e30 0x7f9e5006dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:29.550 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e54ded640 1 --2- 10.20.193.5:0/3619509427 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9e500c6aa0 0x7f9e5015c6a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:29.550 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e54ded640 1 -- 10.20.193.5:0/3619509427 >> 10.20.193.5:0/3619509427 conn(0x7f9e500c9f30 msgr2=0x7f9e500ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:29.550 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e54ded640 1 -- 10.20.193.5:0/3619509427 shutdown_connections 2026-02-17T21:25:29.550 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.536+0000 7f9e54ded640 1 -- 10.20.193.5:0/3619509427 wait complete. 2026-02-17T21:25:29.550 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.537+0000 7f9e54ded640 10 monclient: build_initial_monmap 2026-02-17T21:25:29.550 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.537+0000 7f9e54ded640 10 monclient: monmap: 2026-02-17T21:25:29.550 INFO:teuthology.misc.health.trial005.stderr:epoch 0 2026-02-17T21:25:29.550 INFO:teuthology.misc.health.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:29.550 INFO:teuthology.misc.health.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:29.551 INFO:teuthology.misc.health.trial005.stderr:created 0.000000 2026-02-17T21:25:29.551 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:29.551 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:25:29.551 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:29.551 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:29.551 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:29.551 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:25:29.551 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.537+0000 7f9e54ded640 1 librados: starting msgr at 2026-02-17T21:25:29.551 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.537+0000 7f9e54ded640 1 librados: starting objecter 2026-02-17T21:25:29.551 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.537+0000 7f9e54ded640 1 Processor -- start 2026-02-17T21:25:29.551 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.537+0000 7f9e54ded640 1 -- start start 2026-02-17T21:25:29.551 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.537+0000 7f9e54ded640 1 librados: setting wanted keys 2026-02-17T21:25:29.551 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.537+0000 7f9e54ded640 1 librados: calling monclient init 2026-02-17T21:25:29.551 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.537+0000 7f9e54ded640 10 monclient: init 2026-02-17T21:25:29.552 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.537+0000 7f9e54ded640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:29.552 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.537+0000 7f9e54ded640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:25:29.552 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.537+0000 7f9e54ded640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9e500c6aa0 0x7f9e500c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:29.552 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.537+0000 7f9e54ded640 10 monclient(hunting): picked mon.noname-c con 0x7f9e500c6aa0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:29.552 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.537+0000 7f9e54ded640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9e500c7e30 0x7f9e500733e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:29.552 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.537+0000 7f9e54ded640 10 monclient(hunting): picked mon.noname-b con 0x7f9e500c7e30 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:29.552 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.537+0000 7f9e54ded640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9e5015c2c0 0x7f9e5014a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:29.552 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.537+0000 7f9e54ded640 10 monclient(hunting): picked mon.noname-a con 0x7f9e5015c2c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:29.552 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.537+0000 7f9e54ded640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:29.552 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.537+0000 7f9e54ded640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9e500c82a0 con 0x7f9e5015c2c0 2026-02-17T21:25:29.552 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.537+0000 7f9e54ded640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:29.552 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.537+0000 7f9e54ded640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9e500c7850 con 0x7f9e500c7e30 2026-02-17T21:25:29.552 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.537+0000 7f9e54ded640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:29.552 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.537+0000 7f9e54ded640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9e500c8420 con 0x7f9e500c6aa0 2026-02-17T21:25:29.553 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.537+0000 7f9e54ded640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:29.553 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.537+0000 7f9e54ded640 10 monclient(hunting): authenticate will time out at 1035.103975s 2026-02-17T21:25:29.553 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4e575640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9e500c6aa0 0x7f9e500c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:29.553 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4dd74640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9e500c7e30 0x7f9e500733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:29.553 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4ed76640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9e5015c2c0 0x7f9e5014a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:29.553 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4dd74640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9e500c7e30 0x7f9e500733e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:37552/0 (socket says 10.20.193.5:37552) 2026-02-17T21:25:29.553 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4dd74640 1 -- 10.20.193.5:0/2572300127 learned_addr learned my addr 10.20.193.5:0/2572300127 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:29.553 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4dd74640 10 monclient(hunting): get_auth_request con 0x7f9e500c7e30 auth_method 0 2026-02-17T21:25:29.553 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:29.553 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:29.553 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:29.553 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4e575640 10 monclient(hunting): get_auth_request con 0x7f9e500c6aa0 auth_method 0 2026-02-17T21:25:29.553 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:29.553 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:29.553 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:29.553 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4ed76640 10 monclient(hunting): get_auth_request con 0x7f9e5015c2c0 auth_method 0 2026-02-17T21:25:29.553 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:29.554 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:29.554 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:29.554 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:29.554 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:29.554 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:29.554 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:29.554 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:29.554 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:29.554 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:29.554 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:29.554 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.538+0000 7f9e4ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:29.554 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.539+0000 7f9e4dd74640 10 monclient(hunting): handle_auth_done global_id 4393 payload 824 2026-02-17T21:25:29.554 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.539+0000 7f9e4dd74640 1 -- 10.20.193.5:0/2572300127 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9e500c6aa0 msgr2=0x7f9e500c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:29.554 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.539+0000 7f9e4dd74640 1 --2- 10.20.193.5:0/2572300127 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9e500c6aa0 0x7f9e500c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:29.554 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.539+0000 7f9e4dd74640 1 -- 10.20.193.5:0/2572300127 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9e5015c2c0 msgr2=0x7f9e5014a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:29.554 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.539+0000 7f9e4dd74640 1 --2- 10.20.193.5:0/2572300127 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9e5015c2c0 0x7f9e5014a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:29.554 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.539+0000 7f9e4dd74640 10 monclient: _finish_hunting 0 2026-02-17T21:25:29.555 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.539+0000 7f9e4dd74640 1 monclient: found mon.noname-b 2026-02-17T21:25:29.555 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.539+0000 7f9e4dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:29.555 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.539+0000 7f9e4dd74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:29.555 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.539+0000 7f9e4dd74640 1 -- 10.20.193.5:0/2572300127 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e50149a70 con 0x7f9e500c7e30 2026-02-17T21:25:29.556 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.540+0000 7f9e4dd74640 1 --2- 10.20.193.5:0/2572300127 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9e500c7e30 0x7f9e500733e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9e3803a040 tx=0x7f9e380047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:29.556 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.540+0000 7f9e36ffd640 10 client.?.objecter ms_handle_connect 0x7f9e500c7e30 2026-02-17T21:25:29.556 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.540+0000 7f9e36ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:29.556 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.542+0000 7f9e36ffd640 1 -- 10.20.193.5:0/2572300127 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3803c040 con 0x7f9e500c7e30 2026-02-17T21:25:29.556 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.542+0000 7f9e36ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:29.556 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.542+0000 7f9e36ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:29.556 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.542+0000 7f9e36ffd640 10 monclient: dump: 2026-02-17T21:25:29.556 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:25:29.556 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:29.557 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:29.557 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:29.557 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:29.557 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:25:29.557 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:29.557 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:29.557 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:29.557 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:25:29.557 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.542+0000 7f9e36ffd640 10 monclient: _finish_auth 0 2026-02-17T21:25:29.557 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.542+0000 7f9e36ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:29.557 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.542+0000 7f9e36ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:29.557 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.542+0000 7f9e36ffd640 1 -- 10.20.193.5:0/2572300127 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e38042610 con 0x7f9e500c7e30 2026-02-17T21:25:29.557 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.542+0000 7f9e54ded640 5 monclient: authenticate success, global_id 4393 2026-02-17T21:25:29.557 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.542+0000 7f9e54ded640 10 monclient: _renew_subs 2026-02-17T21:25:29.557 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.542+0000 7f9e54ded640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:29.557 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.542+0000 7f9e54ded640 1 -- 10.20.193.5:0/2572300127 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e50149d50 con 0x7f9e500c7e30 2026-02-17T21:25:29.557 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.542+0000 7f9e36ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:29.557 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.542+0000 7f9e36ffd640 1 -- 10.20.193.5:0/2572300127 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e380429e0 con 0x7f9e500c7e30 2026-02-17T21:25:29.558 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.542+0000 7f9e36ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:29.558 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.542+0000 7f9e36ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:29.558 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.542+0000 7f9e4cd72640 4 set_mon_vals no callback set 2026-02-17T21:25:29.558 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.542+0000 7f9e36ffd640 10 monclient: dump: 2026-02-17T21:25:29.558 INFO:teuthology.misc.health.trial005.stderr:epoch 1 2026-02-17T21:25:29.558 INFO:teuthology.misc.health.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:29.558 INFO:teuthology.misc.health.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:29.558 INFO:teuthology.misc.health.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:29.558 INFO:teuthology.misc.health.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:29.558 INFO:teuthology.misc.health.trial005.stderr:election_strategy: 1 2026-02-17T21:25:29.558 INFO:teuthology.misc.health.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:29.558 INFO:teuthology.misc.health.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:29.558 INFO:teuthology.misc.health.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:29.558 INFO:teuthology.misc.health.trial005.stderr: 2026-02-17T21:25:29.558 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.542+0000 7f9e54ded640 10 client.4393.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:29.558 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.542+0000 7f9e54ded640 10 monclient: _renew_subs 2026-02-17T21:25:29.558 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.542+0000 7f9e54ded640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:29.558 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.542+0000 7f9e54ded640 1 -- 10.20.193.5:0/2572300127 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e50072be0 con 0x7f9e500c7e30 2026-02-17T21:25:29.558 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.542+0000 7f9e54ded640 1 librados: init done 2026-02-17T21:25:29.559 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.543+0000 7f9e54ded640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:29.559 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.543+0000 7f9e54ded640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:29.559 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.543+0000 7f9e54ded640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:29.559 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.543+0000 7f9e54ded640 1 -- 10.20.193.5:0/2572300127 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e5015c6a0 con 0x7f9e500c7e30 2026-02-17T21:25:29.653 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.651+0000 7f9e36ffd640 1 -- 10.20.193.5:0/2572300127 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 6) ==== 100189+0+0 (secure 0 0 0) 0x7f9e3804b450 con 0x7f9e500c7e30 2026-02-17T21:25:29.653 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.651+0000 7f9e36ffd640 1 --2- 10.20.193.5:0/2572300127 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9e1c0791f0 0x7f9e1c07b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:29.654 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.652+0000 7f9e4e575640 1 --2- 10.20.193.5:0/2572300127 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9e1c0791f0 0x7f9e1c07b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:29.654 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.652+0000 7f9e4e575640 10 monclient: get_auth_request con 0x7f9e1c0791f0 auth_method 0 2026-02-17T21:25:29.655 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.653+0000 7f9e4e575640 1 --2- 10.20.193.5:0/2572300127 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9e1c0791f0 0x7f9e1c07b6b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9e44002770 tx=0x7f9e44009040 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:29.655 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.653+0000 7f9e36ffd640 10 client.4393.objecter ms_handle_connect 0x7f9e1c0791f0 2026-02-17T21:25:29.656 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.653+0000 7f9e36ffd640 1 -- 10.20.193.5:0/2572300127 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 8563+0+0 (secure 0 0 0) 0x7f9e3802fb00 con 0x7f9e500c7e30 2026-02-17T21:25:29.656 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.653+0000 7f9e36ffd640 10 client.4393.objecter ms_dispatch2 0x7f9e50000b90 osd_map(30..30 src has 1..30) 2026-02-17T21:25:29.656 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.653+0000 7f9e36ffd640 3 client.4393.objecter handle_osd_map got epochs [30,30] > 0 2026-02-17T21:25:29.656 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.653+0000 7f9e36ffd640 3 client.4393.objecter handle_osd_map decoding full epoch 30 2026-02-17T21:25:29.656 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.653+0000 7f9e36ffd640 20 client.4393.objecter dump_active .. 0 homeless 2026-02-17T21:25:29.662 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.661+0000 7f9e36ffd640 1 -- 10.20.193.5:0/2572300127 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9e38086d10 con 0x7f9e500c7e30 2026-02-17T21:25:29.662 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.661+0000 7f9e36ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:29.662 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.661+0000 7f9e36ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:29.745 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.743+0000 7f9e54ded640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:25:29.746 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.743+0000 7f9e54ded640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:25:29.746 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.743+0000 7f9e54ded640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:29.746 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.743+0000 7f9e54ded640 1 -- 10.20.193.5:0/2572300127 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e50070e90 con 0x7f9e500c7e30 2026-02-17T21:25:29.922 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.920+0000 7f9e36ffd640 1 -- 10.20.193.5:0/2572300127 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f9e38082d50 con 0x7f9e500c7e30 2026-02-17T21:25:29.997 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.994+0000 7f9e36ffd640 1 -- 10.20.193.5:0/2572300127 <== mon.1 v2:10.20.193.119:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+22766 (secure 0 0 0) 0x7f9e3803d280 con 0x7f9e500c7e30 2026-02-17T21:25:29.997 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.994+0000 7f9e36ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:25:29.997 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.994+0000 7f9e36ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:29.997 INFO:teuthology.misc.health.trial005.stdout: 2026-02-17T21:25:29.997 INFO:teuthology.misc.health.trial005.stdout:{"epoch":30,"fsid":"b1be373b-56c5-4b5b-a965-9bcc20042691","created":"2026-02-17T21:23:38.622021+0000","modified":"2026-02-17T21:25:27.509722+0000","last_up_change":"2026-02-17T21:25:25.434771+0000","last_in_change":"2026-02-17T21:23:44.366223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T21:25:19.677742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8bffc5e9-1f92-4603-bf29-ce19225edc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6808","nonce":3662168592},{"type":"v1","addr":"10.20.193.5:6809","nonce":3662168592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6810","nonce":3662168592},{"type":"v1","addr":"10.20.193.5:6811","nonce":3662168592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6814","nonce":3662168592},{"type":"v1","addr":"10.20.193.5:6815","nonce":3662168592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6812","nonce":3662168592},{"type":"v1","addr":"10.20.193.5:6813","nonce":3662168592}]},"public_addr":"10.20.193.5:6809/3662168592","cluster_addr":"10.20.193.5:6811/3662168592","heartbeat_back_addr":"10.20.193.5:6815/3662168592","heartbeat_front_addr":"10.20.193.5:6813/3662168592","state":["exists","up"]},{"osd":1,"uuid":"8ffdf919-2ec4-4c1f-a69f-aee5cea211e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6800","nonce":267553149},{"type":"v1","addr":"10.20.193.119:6801","nonce":267553149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6802","nonce":267553149},{"type":"v1","addr":"10.20.193.119:6803","nonce":267553149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6806","nonce":267553149},{"type":"v1","addr":"10.20.193.119:6807","nonce":267553149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6804","nonce":267553149},{"type":"v1","addr":"10.20.193.119:6805","nonce":267553149}]},"public_addr":"10.20.193.119:6801/267553149","cluster_addr":"10.20.193.119:6803/267553149","heartbeat_back_addr":"10.20.193.119:6807/267553149","heartbeat_front_addr":"10.20.193.119:6805/267553149","state":["exists","up"]},{"osd":2,"uuid":"d186244a-4bf7-416d-b6a0-0e0f5af50eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6824","nonce":692096764},{"type":"v1","addr":"10.20.193.135:6825","nonce":692096764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6826","nonce":692096764},{"type":"v1","addr":"10.20.193.135:6827","nonce":692096764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6830","nonce":692096764},{"type":"v1","addr":"10.20.193.135:6831","nonce":692096764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6828","nonce":692096764},{"type":"v1","addr":"10.20.193.135:6829","nonce":692096764}]},"public_addr":"10.20.193.135:6825/692096764","cluster_addr":"10.20.193.135:6827/692096764","heartbeat_back_addr":"10.20.193.135:6831/692096764","heartbeat_front_addr":"10.20.193.135:6829/692096764","state":["exists","up"]},{"osd":3,"uuid":"093b417e-53bf-4b60-a937-7c5ffee43e1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6818","nonce":1862950168},{"type":"v1","addr":"10.20.193.176:6819","nonce":1862950168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6820","nonce":1862950168},{"type":"v1","addr":"10.20.193.176:6821","nonce":1862950168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6824","nonce":1862950168},{"type":"v1","addr":"10.20.193.176:6825","nonce":1862950168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6822","nonce":1862950168},{"type":"v1","addr":"10.20.193.176:6823","nonce":1862950168}]},"public_addr":"10.20.193.176:6819/1862950168","cluster_addr":"10.20.193.176:6821/1862950168","heartbeat_back_addr":"10.20.193.176:6825/1862950168","heartbeat_front_addr":"10.20.193.176:6823/1862950168","state":["exists","up"]},{"osd":4,"uuid":"0a48e684-05b0-41b1-a553-022424011225","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6800","nonce":234574736},{"type":"v1","addr":"10.20.193.5:6801","nonce":234574736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6802","nonce":234574736},{"type":"v1","addr":"10.20.193.5:6803","nonce":234574736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6806","nonce":234574736},{"type":"v1","addr":"10.20.193.5:6807","nonce":234574736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6804","nonce":234574736},{"type":"v1","addr":"10.20.193.5:6805","nonce":234574736}]},"public_addr":"10.20.193.5:6801/234574736","cluster_addr":"10.20.193.5:6803/234574736","heartbeat_back_addr":"10.20.193.5:6807/234574736","heartbeat_front_addr":"10.20.193.5:6805/234574736","state":["exists","up"]},{"osd":5,"uuid":"d73b7c38-cef9-4993-b353-908c1d87603c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6818","nonce":4010664603},{"type":"v1","addr":"10.20.193.119:6820","nonce":4010664603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6824","nonce":4010664603},{"type":"v1","addr":"10.20.193.119:6825","nonce":4010664603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6830","nonce":4010664603},{"type":"v1","addr":"10.20.193.119:6831","nonce":4010664603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6828","nonce":4010664603},{"type":"v1","addr":"10.20.193.119:6829","nonce":4010664603}]},"public_addr":"10.20.193.119:6820/4010664603","cluster_addr":"10.20.193.119:6825/4010664603","heartbeat_back_addr":"10.20.193.119:6831/4010664603","heartbeat_front_addr":"10.20.193.119:6829/4010664603","state":["exists","up"]},{"osd":6,"uuid":"f7774c25-72e8-41b2-8634-517af7a213b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6808","nonce":1853988335},{"type":"v1","addr":"10.20.193.135:6809","nonce":1853988335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6810","nonce":1853988335},{"type":"v1","addr":"10.20.193.135:6811","nonce":1853988335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6814","nonce":1853988335},{"type":"v1","addr":"10.20.193.135:6815","nonce":1853988335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6812","nonce":1853988335},{"type":"v1","addr":"10.20.193.135:6813","nonce":1853988335}]},"public_addr":"10.20.193.135:6809/1853988335","cluster_addr":"10.20.193.135:6811/1853988335","heartbeat_back_addr":"10.20.193.135:6815/1853988335","heartbeat_front_addr":"10.20.193.135:6813/1853988335","state":["exists","up"]},{"osd":7,"uuid":"30a68802-afce-499b-90ce-bd568bc69406","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6826","nonce":1604873931},{"type":"v1","addr":"10.20.193.176:6827","nonce":1604873931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6828","nonce":1604873931},{"type":"v1","addr":"10.20.193.176:6829","nonce":1604873931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6832","nonce":1604873931},{"type":"v1","addr":"10.20.193.176:6833","nonce":1604873931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6830","nonce":1604873931},{"type":"v1","addr":"10.20.193.176:6831","nonce":1604873931}]},"public_addr":"10.20.193.176:6827/1604873931","cluster_addr":"10.20.193.176:6829/1604873931","heartbeat_back_addr":"10.20.193.176:6833/1604873931","heartbeat_front_addr":"10.20.193.176:6831/1604873931","state":["exists","up"]},{"osd":8,"uuid":"8b4a2001-3ac8-4756-9dcf-af38c6d12d44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6816","nonce":1609723815},{"type":"v1","addr":"10.20.193.5:6817","nonce":1609723815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6820","nonce":1609723815},{"type":"v1","addr":"10.20.193.5:6821","nonce":1609723815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6826","nonce":1609723815},{"type":"v1","addr":"10.20.193.5:6828","nonce":1609723815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6822","nonce":1609723815},{"type":"v1","addr":"10.20.193.5:6824","nonce":1609723815}]},"public_addr":"10.20.193.5:6817/1609723815","cluster_addr":"10.20.193.5:6821/1609723815","heartbeat_back_addr":"10.20.193.5:6828/1609723815","heartbeat_front_addr":"10.20.193.5:6824/1609723815","state":["exists","up"]},{"osd":9,"uuid":"dfdfee67-eff6-4413-bd7a-adc0a019bfbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6816","nonce":576833933},{"type":"v1","addr":"10.20.193.119:6817","nonce":576833933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6819","nonce":576833933},{"type":"v1","addr":"10.20.193.119:6821","nonce":576833933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6826","nonce":576833933},{"type":"v1","addr":"10.20.193.119:6827","nonce":576833933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6822","nonce":576833933},{"type":"v1","addr":"10.20.193.119:6823","nonce":576833933}]},"public_addr":"10.20.193.119:6817/576833933","cluster_addr":"10.20.193.119:6821/576833933","heartbeat_back_addr":"10.20.193.119:6827/576833933","heartbeat_front_addr":"10.20.193.119:6823/576833933","state":["exists","up"]},{"osd":10,"uuid":"fc24ee77-5a0d-41d4-88f5-8d03a77c7608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6800","nonce":3469915965},{"type":"v1","addr":"10.20.193.135:6801","nonce":3469915965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6802","nonce":3469915965},{"type":"v1","addr":"10.20.193.135:6803","nonce":3469915965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6806","nonce":3469915965},{"type":"v1","addr":"10.20.193.135:6807","nonce":3469915965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6804","nonce":3469915965},{"type":"v1","addr":"10.20.193.135:6805","nonce":3469915965}]},"public_addr":"10.20.193.135:6801/3469915965","cluster_addr":"10.20.193.135:6803/3469915965","heartbeat_back_addr":"10.20.193.135:6807/3469915965","heartbeat_front_addr":"10.20.193.135:6805/3469915965","state":["exists","up"]},{"osd":11,"uuid":"1d737681-1923-453a-82f8-516eeb875559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6802","nonce":3067818664},{"type":"v1","addr":"10.20.193.176:6803","nonce":3067818664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6804","nonce":3067818664},{"type":"v1","addr":"10.20.193.176:6805","nonce":3067818664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6808","nonce":3067818664},{"type":"v1","addr":"10.20.193.176:6809","nonce":3067818664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6806","nonce":3067818664},{"type":"v1","addr":"10.20.193.176:6807","nonce":3067818664}]},"public_addr":"10.20.193.176:6803/3067818664","cluster_addr":"10.20.193.176:6805/3067818664","heartbeat_back_addr":"10.20.193.176:6809/3067818664","heartbeat_front_addr":"10.20.193.176:6807/3067818664","state":["exists","up"]},{"osd":12,"uuid":"c4f0322e-a862-4c5e-967e-4551087ede8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6818","nonce":2028057944},{"type":"v1","addr":"10.20.193.5:6819","nonce":2028057944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6823","nonce":2028057944},{"type":"v1","addr":"10.20.193.5:6825","nonce":2028057944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6830","nonce":2028057944},{"type":"v1","addr":"10.20.193.5:6831","nonce":2028057944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6827","nonce":2028057944},{"type":"v1","addr":"10.20.193.5:6829","nonce":2028057944}]},"public_addr":"10.20.193.5:6819/2028057944","cluster_addr":"10.20.193.5:6825/2028057944","heartbeat_back_addr":"10.20.193.5:6831/2028057944","heartbeat_front_addr":"10.20.193.5:6829/2028057944","state":["exists","up"]},{"osd":13,"uuid":"0b5e9861-a194-4f11-a849-d8bb94ce95a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6808","nonce":1303925174},{"type":"v1","addr":"10.20.193.119:6809","nonce":1303925174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6810","nonce":1303925174},{"type":"v1","addr":"10.20.193.119:6811","nonce":1303925174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6814","nonce":1303925174},{"type":"v1","addr":"10.20.193.119:6815","nonce":1303925174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6812","nonce":1303925174},{"type":"v1","addr":"10.20.193.119:6813","nonce":1303925174}]},"public_addr":"10.20.193.119:6809/1303925174","cluster_addr":"10.20.193.119:6811/1303925174","heartbeat_back_addr":"10.20.193.119:6815/1303925174","heartbeat_front_addr":"10.20.193.119:6813/1303925174","state":["exists","up"]},{"osd":14,"uuid":"6f182077-0c0d-481c-97b4-43ef48aa5aea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6816","nonce":1552304264},{"type":"v1","addr":"10.20.193.135:6817","nonce":1552304264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6818","nonce":1552304264},{"type":"v1","addr":"10.20.193.135:6819","nonce":1552304264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6822","nonce":1552304264},{"type":"v1","addr":"10.20.193.135:6823","nonce":1552304264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6820","nonce":1552304264},{"type":"v1","addr":"10.20.193.135:6821","nonce":1552304264}]},"public_addr":"10.20.193.135:6817/1552304264","cluster_addr":"10.20.193.135:6819/1552304264","heartbeat_back_addr":"10.20.193.135:6823/1552304264","heartbeat_front_addr":"10.20.193.135:6821/1552304264","state":["exists","up"]},{"osd":15,"uuid":"537605ff-bedd-4f2b-922f-e2eaa8c17f48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6810","nonce":1976318959},{"type":"v1","addr":"10.20.193.176:6811","nonce":1976318959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6812","nonce":1976318959},{"type":"v1","addr":"10.20.193.176:6813","nonce":1976318959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6816","nonce":1976318959},{"type":"v1","addr":"10.20.193.176:6817","nonce":1976318959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6814","nonce":1976318959},{"type":"v1","addr":"10.20.193.176:6815","nonce":1976318959}]},"public_addr":"10.20.193.176:6811/1976318959","cluster_addr":"10.20.193.176:6813/1976318959","heartbeat_back_addr":"10.20.193.176:6817/1976318959","heartbeat_front_addr":"10.20.193.176:6815/1976318959","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.964722+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:16.831330+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:19.360415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.257999+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:19.239391+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:16.741791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.466814+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.473911+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:19.537915+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:17.261755+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:19.188280+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.075749+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:19.610371+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:16.923597+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:19.117422+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.626513+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:25:29.999 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.996+0000 7f9e54ded640 10 librados: watch_flush enter 2026-02-17T21:25:30.000 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.996+0000 7f9e54ded640 10 librados: watch_flush exit 2026-02-17T21:25:30.000 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.996+0000 7f9e54ded640 20 client.4393.objecter shutdown clearing up homeless session... 2026-02-17T21:25:30.000 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.996+0000 7f9e54ded640 10 client.4393.objecter successfully canceled tick 2026-02-17T21:25:30.000 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.996+0000 7f9e54ded640 1 -- 10.20.193.5:0/2572300127 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9e1c0791f0 msgr2=0x7f9e1c07b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:30.000 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.996+0000 7f9e54ded640 1 --2- 10.20.193.5:0/2572300127 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9e1c0791f0 0x7f9e1c07b6b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9e44002770 tx=0x7f9e44009040 comp rx=0 tx=0).stop 2026-02-17T21:25:30.000 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.996+0000 7f9e54ded640 10 monclient: shutdown 2026-02-17T21:25:30.000 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.996+0000 7f9e54ded640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:30.000 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.996+0000 7f9e54ded640 1 -- 10.20.193.5:0/2572300127 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9e500c7e30 msgr2=0x7f9e500733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:30.000 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.996+0000 7f9e54ded640 1 --2- 10.20.193.5:0/2572300127 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9e500c7e30 0x7f9e500733e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9e3803a040 tx=0x7f9e380047c0 comp rx=0 tx=0).stop 2026-02-17T21:25:30.000 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.996+0000 7f9e54ded640 1 -- 10.20.193.5:0/2572300127 shutdown_connections 2026-02-17T21:25:30.001 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.996+0000 7f9e54ded640 1 --2- 10.20.193.5:0/2572300127 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9e1c0791f0 0x7f9e1c07b6b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:30.001 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.996+0000 7f9e54ded640 1 --2- 10.20.193.5:0/2572300127 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9e5015c2c0 0x7f9e5014a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:30.001 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.996+0000 7f9e54ded640 1 --2- 10.20.193.5:0/2572300127 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9e500c7e30 0x7f9e500733e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:30.001 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.996+0000 7f9e54ded640 1 --2- 10.20.193.5:0/2572300127 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9e500c6aa0 0x7f9e500c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:30.001 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.996+0000 7f9e54ded640 1 -- 10.20.193.5:0/2572300127 >> 10.20.193.5:0/2572300127 conn(0x7f9e500c9f30 msgr2=0x7f9e5006f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:30.001 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.996+0000 7f9e54ded640 1 -- 10.20.193.5:0/2572300127 shutdown_connections 2026-02-17T21:25:30.001 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.996+0000 7f9e54ded640 1 -- 10.20.193.5:0/2572300127 wait complete. 2026-02-17T21:25:30.001 INFO:teuthology.misc.health.trial005.stderr:2026-02-17T21:25:29.996+0000 7f9e54ded640 1 librados: shutdown 2026-02-17T21:25:30.006 DEBUG:teuthology.misc:16 of 16 OSDs are up 2026-02-17T21:25:30.006 INFO:tasks.ceph:Creating RBD pool 2026-02-17T21:25:30.007 DEBUG:teuthology.orchestra.run.trial005:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-17T21:25:30.074 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.071+0000 7f124667c640 10 monclient: get_monmap_and_config 2026-02-17T21:25:30.074 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.071+0000 7f124667c640 10 monclient: build_initial_monmap 2026-02-17T21:25:30.074 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.071+0000 7f124667c640 10 monclient: monmap: 2026-02-17T21:25:30.074 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:30.074 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:30.074 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:30.073278+0000 2026-02-17T21:25:30.074 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:30.073278+0000 2026-02-17T21:25:30.074 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:30.074 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:30.075 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:30.075 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:30.075 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:30.075 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:30.075 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:30.075 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:30.075 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:30.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.072+0000 7f124667c640 1 Processor -- start 2026-02-17T21:25:30.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.072+0000 7f124667c640 1 -- start start 2026-02-17T21:25:30.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.072+0000 7f124667c640 10 monclient: init 2026-02-17T21:25:30.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.072+0000 7f124667c640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:30.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.072+0000 7f124667c640 10 monclient: _add_conns ranks=[1,4,0,3,2,5] 2026-02-17T21:25:30.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.072+0000 7f124667c640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f124015d370 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:30.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.072+0000 7f124667c640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f12400c7e20 0x7f124015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:30.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.072+0000 7f124667c640 10 monclient(hunting): picked mon.noname-b con 0x7f12400c7e20 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:30.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.072+0000 7f124667c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f12400c74c0 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:30.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.072+0000 7f124667c640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12400c8350 con 0x7f12400c74c0 2026-02-17T21:25:30.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.072+0000 7f124667c640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12400c8630 con 0x7f124015d370 2026-02-17T21:25:30.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.072+0000 7f124667c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:30.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.072+0000 7f124667c640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f124015b710 con 0x7f12400c7e20 2026-02-17T21:25:30.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.072+0000 7f124667c640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:30.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.072+0000 7f124667c640 10 monclient(hunting): authenticate will time out at 1035.638678s 2026-02-17T21:25:30.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.073+0000 7f1244bf2640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f12400c74c0 0x7f12400c52b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:42798/0 (socket says 10.20.193.5:42798) 2026-02-17T21:25:30.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.073+0000 7f1244bf2640 1 -- 10.20.193.5:0/864960028 learned_addr learned my addr 10.20.193.5:0/864960028 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:30.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.073+0000 7f123f7fe640 1 --2- 10.20.193.5:0/864960028 >> v2:10.20.193.119:3300/0 conn(0x7f12400c7e20 0x7f124015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:30.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.073+0000 7f123f7fe640 10 monclient(hunting): get_auth_request con 0x7f12400c7e20 auth_method 0 2026-02-17T21:25:30.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.073+0000 7f123f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:30.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.073+0000 7f123f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:30.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.073+0000 7f123f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:30.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.074+0000 7f123effd640 1 -- 10.20.193.5:0/864960028 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 603707360 0 0) 0x7f12400c8350 con 0x7f12400c74c0 2026-02-17T21:25:30.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.074+0000 7f123effd640 10 monclient(hunting): _negotiate 2026-02-17T21:25:30.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.074+0000 7f123effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:30.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.074+0000 7f123effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:30.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.074+0000 7f123effd640 10 monclient(hunting): my global_id is 4362 2026-02-17T21:25:30.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.074+0000 7f123effd640 1 -- 10.20.193.5:0/864960028 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1224003620 con 0x7f12400c74c0 2026-02-17T21:25:30.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.074+0000 7f123f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:30.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.074+0000 7f123f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:30.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.074+0000 7f123f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:30.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.076+0000 7f123f7fe640 10 monclient(hunting): handle_auth_done global_id 4396 payload 274 2026-02-17T21:25:30.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.076+0000 7f123f7fe640 1 -- 10.20.193.5:0/864960028 >> v1:10.20.193.119:6789/0 conn(0x7f124015d370 legacy=0x7f124015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:30.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.076+0000 7f123f7fe640 1 -- 10.20.193.5:0/864960028 >> v1:10.20.193.5:6789/0 conn(0x7f12400c74c0 legacy=0x7f12400c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:30.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.076+0000 7f123f7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:25:30.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.076+0000 7f123f7fe640 1 monclient: found mon.noname-b 2026-02-17T21:25:30.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.076+0000 7f123f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:30.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.076+0000 7f123f7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:30.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.076+0000 7f123f7fe640 1 -- 10.20.193.5:0/864960028 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12400c8910 con 0x7f12400c7e20 2026-02-17T21:25:30.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.078+0000 7f123f7fe640 1 --2- 10.20.193.5:0/864960028 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f12400c7e20 0x7f124015d750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f12300098a0 tx=0x7f123002ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c21b7209a74d2ad7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:30.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.080+0000 7f123effd640 1 -- 10.20.193.5:0/864960028 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123003c070 con 0x7f12400c7e20 2026-02-17T21:25:30.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.080+0000 7f123effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:30.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.080+0000 7f123effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:30.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.080+0000 7f123effd640 10 monclient: dump: 2026-02-17T21:25:30.087 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:30.087 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:30.087 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:30.087 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:30.087 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:30.087 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:30.087 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:30.087 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:30.087 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:30.088 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:30.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.080+0000 7f123effd640 10 monclient: _finish_auth 0 2026-02-17T21:25:30.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.080+0000 7f123effd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:30.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.080+0000 7f123effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:30.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.080+0000 7f123effd640 1 -- 10.20.193.5:0/864960028 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f123002fb70 con 0x7f12400c7e20 2026-02-17T21:25:30.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.080+0000 7f123effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:30.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.080+0000 7f123effd640 1 -- 10.20.193.5:0/864960028 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1230037440 con 0x7f12400c7e20 2026-02-17T21:25:30.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.080+0000 7f123effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:30.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.080+0000 7f123effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:30.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.080+0000 7f123effd640 10 monclient: dump: 2026-02-17T21:25:30.088 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:30.089 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:30.089 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:30.089 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:30.089 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:30.089 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:30.089 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:30.089 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:30.089 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:30.089 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:30.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.080+0000 7f124667c640 5 monclient: authenticate success, global_id 4396 2026-02-17T21:25:30.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.080+0000 7f124667c640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:30.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.080+0000 7f124667c640 4 set_mon_vals no callback set 2026-02-17T21:25:30.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.080+0000 7f124667c640 10 monclient: shutdown 2026-02-17T21:25:30.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.080+0000 7f124667c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:30.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.080+0000 7f124667c640 1 -- 10.20.193.5:0/864960028 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f12400c7e20 msgr2=0x7f124015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:30.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.080+0000 7f124667c640 1 --2- 10.20.193.5:0/864960028 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f12400c7e20 0x7f124015d750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f12300098a0 tx=0x7f123002ee60 comp rx=0 tx=0).stop 2026-02-17T21:25:30.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.080+0000 7f124667c640 1 -- 10.20.193.5:0/864960028 shutdown_connections 2026-02-17T21:25:30.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.080+0000 7f124667c640 1 --2- 10.20.193.5:0/864960028 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f12400c7e20 0x7f124015d750 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:30.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.080+0000 7f124667c640 1 -- 10.20.193.5:0/864960028 >> 10.20.193.5:0/864960028 conn(0x7f12400c9f20 msgr2=0x7f12400ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:30.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.080+0000 7f124667c640 1 -- 10.20.193.5:0/864960028 shutdown_connections 2026-02-17T21:25:30.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.080+0000 7f124667c640 1 -- 10.20.193.5:0/864960028 wait complete. 2026-02-17T21:25:30.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.081+0000 7f124667c640 10 monclient: build_initial_monmap 2026-02-17T21:25:30.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.081+0000 7f124667c640 10 monclient: monmap: 2026-02-17T21:25:30.090 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:30.090 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:30.091 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:30.091 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:30.091 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:30.091 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:30.091 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:30.091 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:30.091 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:30.091 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:30.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.081+0000 7f124667c640 1 librados: starting msgr at 2026-02-17T21:25:30.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.081+0000 7f124667c640 1 librados: starting objecter 2026-02-17T21:25:30.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.081+0000 7f124667c640 1 Processor -- start 2026-02-17T21:25:30.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.081+0000 7f124667c640 1 -- start start 2026-02-17T21:25:30.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.081+0000 7f124667c640 1 librados: setting wanted keys 2026-02-17T21:25:30.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.081+0000 7f124667c640 1 librados: calling monclient init 2026-02-17T21:25:30.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.081+0000 7f124667c640 10 monclient: init 2026-02-17T21:25:30.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.081+0000 7f124667c640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:30.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.081+0000 7f124667c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:25:30.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.081+0000 7f124667c640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f12400c74c0 0x7f124014d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:30.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.081+0000 7f124667c640 10 monclient(hunting): picked mon.noname-b con 0x7f12400c74c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:30.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.081+0000 7f124667c640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f12400c7e20 0x7f12401f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:30.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.081+0000 7f124667c640 10 monclient(hunting): picked mon.noname-a con 0x7f12400c7e20 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:30.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.081+0000 7f124667c640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f124015d370 0x7f12401f2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:30.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.081+0000 7f124667c640 10 monclient(hunting): picked mon.noname-c con 0x7f124015d370 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:30.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.081+0000 7f124667c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:30.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.081+0000 7f124667c640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f12400c8ed0 con 0x7f12400c7e20 2026-02-17T21:25:30.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.081+0000 7f124667c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:30.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.081+0000 7f124667c640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f12400c9240 con 0x7f12400c74c0 2026-02-17T21:25:30.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.081+0000 7f124667c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:30.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.081+0000 7f124667c640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f12400c96d0 con 0x7f124015d370 2026-02-17T21:25:30.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.081+0000 7f124667c640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:30.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.081+0000 7f124667c640 10 monclient(hunting): authenticate will time out at 1035.647795s 2026-02-17T21:25:30.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123f7fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f12400c7e20 0x7f12401f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:30.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123ffff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f12400c74c0 0x7f124014d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:30.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123f7fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f12400c7e20 0x7f12401f25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:49934/0 (socket says 10.20.193.5:49934) 2026-02-17T21:25:30.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123f7fe640 1 -- 10.20.193.5:0/2333695696 learned_addr learned my addr 10.20.193.5:0/2333695696 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:30.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123f7fe640 10 monclient(hunting): get_auth_request con 0x7f12400c7e20 auth_method 0 2026-02-17T21:25:30.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:30.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:30.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:30.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123ffff640 10 monclient(hunting): get_auth_request con 0x7f12400c74c0 auth_method 0 2026-02-17T21:25:30.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:30.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:30.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:30.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f1244bf2640 1 --2- 10.20.193.5:0/2333695696 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f124015d370 0x7f12401f2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:30.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:30.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:30.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:30.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f1244bf2640 10 monclient(hunting): get_auth_request con 0x7f124015d370 auth_method 0 2026-02-17T21:25:30.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f1244bf2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:30.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f1244bf2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:30.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f1244bf2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:30.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:30.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:30.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:30.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f1244bf2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:30.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f1244bf2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:30.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f1244bf2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:30.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123f7fe640 10 monclient(hunting): handle_auth_done global_id 4365 payload 824 2026-02-17T21:25:30.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123f7fe640 1 -- 10.20.193.5:0/2333695696 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f124015d370 msgr2=0x7f12401f2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:30.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123f7fe640 1 --2- 10.20.193.5:0/2333695696 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f124015d370 0x7f12401f2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:30.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123f7fe640 1 -- 10.20.193.5:0/2333695696 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f12400c74c0 msgr2=0x7f124014d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:30.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123f7fe640 1 --2- 10.20.193.5:0/2333695696 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f12400c74c0 0x7f124014d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:30.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123f7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:25:30.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123f7fe640 1 monclient: found mon.noname-a 2026-02-17T21:25:30.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:30.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:30.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.083+0000 7f123f7fe640 1 -- 10.20.193.5:0/2333695696 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1240073c80 con 0x7f12400c7e20 2026-02-17T21:25:30.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.084+0000 7f123f7fe640 1 --2- 10.20.193.5:0/2333695696 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f12400c7e20 0x7f12401f25f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1230009130 tx=0x7f12300047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:30.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.085+0000 7f123cff9640 10 client.?.objecter ms_handle_connect 0x7f12400c7e20 2026-02-17T21:25:30.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.085+0000 7f123cff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:30.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f123cff9640 1 -- 10.20.193.5:0/2333695696 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123003c040 con 0x7f12400c7e20 2026-02-17T21:25:30.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f123cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:30.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f123cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:30.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f123cff9640 10 monclient: dump: 2026-02-17T21:25:30.098 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:30.098 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:30.098 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:30.098 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:30.098 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:30.098 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:30.098 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:30.099 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:30.099 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:30.099 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:30.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f123cff9640 10 monclient: _finish_auth 0 2026-02-17T21:25:30.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f123cff9640 10 monclient: _check_auth_tickets 2026-02-17T21:25:30.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f123cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:30.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f123cff9640 1 -- 10.20.193.5:0/2333695696 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1230042630 con 0x7f12400c7e20 2026-02-17T21:25:30.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f123cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:30.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f123cff9640 1 -- 10.20.193.5:0/2333695696 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1230042a20 con 0x7f12400c7e20 2026-02-17T21:25:30.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f123cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:30.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f123cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:30.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f123cff9640 10 monclient: dump: 2026-02-17T21:25:30.100 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:30.100 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:30.100 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:30.100 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:30.100 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:30.100 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:30.100 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:30.100 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:30.100 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:30.100 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:30.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f123e7fc640 4 set_mon_vals no callback set 2026-02-17T21:25:30.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f124667c640 5 monclient: authenticate success, global_id 4365 2026-02-17T21:25:30.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f124667c640 10 monclient: _renew_subs 2026-02-17T21:25:30.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f124667c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:30.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f124667c640 1 -- 10.20.193.5:0/2333695696 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1240073f60 con 0x7f12400c7e20 2026-02-17T21:25:30.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f124667c640 10 client.4365.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:30.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f124667c640 10 monclient: _renew_subs 2026-02-17T21:25:30.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f124667c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:30.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f124667c640 1 -- 10.20.193.5:0/2333695696 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1240074520 con 0x7f12400c7e20 2026-02-17T21:25:30.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f124667c640 1 librados: init done 2026-02-17T21:25:30.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f124667c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:30.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f124667c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:30.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f124667c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:30.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.087+0000 7f124667c640 1 -- 10.20.193.5:0/2333695696 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f124015d750 con 0x7f12400c7e20 2026-02-17T21:25:30.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.098+0000 7f123cff9640 1 -- 10.20.193.5:0/2333695696 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f123004b450 con 0x7f12400c7e20 2026-02-17T21:25:30.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.100+0000 7f123cff9640 1 --2- 10.20.193.5:0/2333695696 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1210079280 0x7f121007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:30.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.100+0000 7f123ffff640 1 --2- 10.20.193.5:0/2333695696 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1210079280 0x7f121007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:30.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.100+0000 7f123ffff640 10 monclient: get_auth_request con 0x7f1210079280 auth_method 0 2026-02-17T21:25:30.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.100+0000 7f123ffff640 1 --2- 10.20.193.5:0/2333695696 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1210079280 0x7f121007b740 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f122c002770 tx=0x7f122c007ef0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:30.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.100+0000 7f123cff9640 10 client.4365.objecter ms_handle_connect 0x7f1210079280 2026-02-17T21:25:30.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.101+0000 7f123cff9640 1 -- 10.20.193.5:0/2333695696 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 8563+0+0 (secure 0 0 0) 0x7f123002fab0 con 0x7f12400c7e20 2026-02-17T21:25:30.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.101+0000 7f123cff9640 10 client.4365.objecter ms_dispatch2 0x7f1240000b90 osd_map(30..30 src has 1..30) 2026-02-17T21:25:30.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.101+0000 7f123cff9640 3 client.4365.objecter handle_osd_map got epochs [30,30] > 0 2026-02-17T21:25:30.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.101+0000 7f123cff9640 3 client.4365.objecter handle_osd_map decoding full epoch 30 2026-02-17T21:25:30.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.101+0000 7f123cff9640 20 client.4365.objecter dump_active .. 0 homeless 2026-02-17T21:25:30.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.204+0000 7f123cff9640 1 -- 10.20.193.5:0/2333695696 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1230086d30 con 0x7f12400c7e20 2026-02-17T21:25:30.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.204+0000 7f123cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:30.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.204+0000 7f123cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:30.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.287+0000 7f124667c640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-17T21:25:30.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.287+0000 7f124667c640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-17T21:25:30.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.287+0000 7f124667c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:30.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.287+0000 7f124667c640 1 -- 10.20.193.5:0/2333695696 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f1240074be0 con 0x7f12400c7e20 2026-02-17T21:25:30.766 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.764+0000 7f123cff9640 1 -- 10.20.193.5:0/2333695696 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v31) ==== 109+0+0 (secure 0 0 0) 0x7f123008b030 con 0x7f12400c7e20 2026-02-17T21:25:30.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.764+0000 7f123cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-17T21:25:30.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.764+0000 7f123cff9640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2026-02-17T21:25:30.767 INFO:teuthology.orchestra.run.trial005.stderr:pool 'rbd' created 2026-02-17T21:25:30.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.766+0000 7f124667c640 10 librados: watch_flush enter 2026-02-17T21:25:30.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.766+0000 7f124667c640 10 librados: watch_flush exit 2026-02-17T21:25:30.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.766+0000 7f124667c640 20 client.4365.objecter shutdown clearing up homeless session... 2026-02-17T21:25:30.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.766+0000 7f124667c640 10 client.4365.objecter successfully canceled tick 2026-02-17T21:25:30.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.766+0000 7f124667c640 1 -- 10.20.193.5:0/2333695696 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1210079280 msgr2=0x7f121007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:30.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.766+0000 7f124667c640 1 --2- 10.20.193.5:0/2333695696 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1210079280 0x7f121007b740 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f122c002770 tx=0x7f122c007ef0 comp rx=0 tx=0).stop 2026-02-17T21:25:30.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.766+0000 7f124667c640 10 monclient: shutdown 2026-02-17T21:25:30.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.766+0000 7f124667c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:30.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.766+0000 7f124667c640 1 -- 10.20.193.5:0/2333695696 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f12400c7e20 msgr2=0x7f12401f25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:30.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.766+0000 7f124667c640 1 --2- 10.20.193.5:0/2333695696 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f12400c7e20 0x7f12401f25f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1230009130 tx=0x7f12300047c0 comp rx=0 tx=0).stop 2026-02-17T21:25:30.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.766+0000 7f124667c640 1 -- 10.20.193.5:0/2333695696 shutdown_connections 2026-02-17T21:25:30.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.766+0000 7f124667c640 1 --2- 10.20.193.5:0/2333695696 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1210079280 0x7f121007b740 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:30.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.766+0000 7f124667c640 1 --2- 10.20.193.5:0/2333695696 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f124015d370 0x7f12401f2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:30.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.766+0000 7f124667c640 1 --2- 10.20.193.5:0/2333695696 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f12400c7e20 0x7f12401f25f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:30.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.766+0000 7f124667c640 1 --2- 10.20.193.5:0/2333695696 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f12400c74c0 0x7f124014d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:30.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.766+0000 7f124667c640 1 -- 10.20.193.5:0/2333695696 >> 10.20.193.5:0/2333695696 conn(0x7f12400c9f20 msgr2=0x7f12400ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:30.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.766+0000 7f124667c640 1 -- 10.20.193.5:0/2333695696 shutdown_connections 2026-02-17T21:25:30.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.766+0000 7f124667c640 1 -- 10.20.193.5:0/2333695696 wait complete. 2026-02-17T21:25:30.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.767+0000 7f124667c640 1 librados: shutdown 2026-02-17T21:25:30.778 DEBUG:teuthology.orchestra.run.trial005:> rbd --cluster ceph pool init rbd 2026-02-17T21:25:30.809 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.807+0000 7f534fbab0c0 10 monclient: get_monmap_and_config 2026-02-17T21:25:30.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.807+0000 7f534fbab0c0 10 monclient: build_initial_monmap 2026-02-17T21:25:30.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.807+0000 7f534fbab0c0 10 monclient: monmap: 2026-02-17T21:25:30.810 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:30.810 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:30.810 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:30.808584+0000 2026-02-17T21:25:30.810 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:30.808584+0000 2026-02-17T21:25:30.810 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:30.810 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:30.811 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:30.811 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:30.811 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:30.811 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:30.811 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:30.811 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:30.811 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:30.811 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.808+0000 7f534fbab0c0 1 Processor -- start 2026-02-17T21:25:30.811 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.808+0000 7f534fbab0c0 1 -- start start 2026-02-17T21:25:30.811 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.808+0000 7f534fbab0c0 10 monclient: init 2026-02-17T21:25:30.814 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.808+0000 7f534fbab0c0 10 monclient: _reopen_session rank -1 2026-02-17T21:25:30.814 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.808+0000 7f534fbab0c0 10 monclient: _add_conns ranks=[3,4,1,5,0,2] 2026-02-17T21:25:30.814 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.808+0000 7f534fbab0c0 1 --2- >> v2:10.20.193.5:3300/0 conn(0x55d23272e570 0x55d232725df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:30.814 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.808+0000 7f534fbab0c0 10 monclient(hunting): picked mon.noname-a con 0x55d23272e570 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:30.814 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.808+0000 7f534fbab0c0 1 --2- >> v2:10.20.193.119:3300/0 conn(0x55d232726330 0x55d2327f2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:30.814 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.808+0000 7f534fbab0c0 10 monclient(hunting): picked mon.noname-b con 0x55d232726330 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:30.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.808+0000 7f534fbab0c0 10 monclient(hunting): picked mon.noname-b-legacy con 0x55d23272e950 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:30.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.808+0000 7f534fbab0c0 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55d23258ed20 con 0x55d23272e950 2026-02-17T21:25:30.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.808+0000 7f534fbab0c0 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:30.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.808+0000 7f534fbab0c0 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x55d2325bb720 con 0x55d23272e570 2026-02-17T21:25:30.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.808+0000 7f534fbab0c0 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:30.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.808+0000 7f534fbab0c0 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x55d23260fe80 con 0x55d232726330 2026-02-17T21:25:30.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.808+0000 7f534fbab0c0 10 monclient(hunting): _renew_subs 2026-02-17T21:25:30.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.809+0000 7f534fbab0c0 10 monclient(hunting): authenticate will time out at 1036.374005s 2026-02-17T21:25:30.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.809+0000 7f534e673640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x55d23272e570 0x55d232725df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:30.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.809+0000 7f534e673640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x55d23272e570 0x55d232725df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:49946/0 (socket says 10.20.193.5:49946) 2026-02-17T21:25:30.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.809+0000 7f534e673640 1 -- 10.20.193.5:0/3691335701 learned_addr learned my addr 10.20.193.5:0/3691335701 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:30.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.809+0000 7f534e673640 10 monclient(hunting): get_auth_request con 0x55d23272e570 auth_method 0 2026-02-17T21:25:30.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.809+0000 7f534e673640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:30.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.809+0000 7f534e673640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:30.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.809+0000 7f534e673640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:30.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.809+0000 7f534e673640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:30.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.809+0000 7f534e673640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:30.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.809+0000 7f534e673640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:30.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.810+0000 7f534e673640 10 monclient(hunting): handle_auth_done global_id 4368 payload 274 2026-02-17T21:25:30.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.810+0000 7f534e673640 1 -- 10.20.193.5:0/3691335701 >> v2:10.20.193.119:3300/0 conn(0x55d232726330 msgr2=0x55d2327f2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:30.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.810+0000 7f534e673640 1 --2- 10.20.193.5:0/3691335701 >> v2:10.20.193.119:3300/0 conn(0x55d232726330 0x55d2327f2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:30.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.810+0000 7f534e673640 1 -- 10.20.193.5:0/3691335701 >> v1:10.20.193.119:6789/0 conn(0x55d23272e950 legacy=0x55d2327ffb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:30.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.810+0000 7f534e673640 10 monclient: _finish_hunting 0 2026-02-17T21:25:30.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.810+0000 7f534e673640 1 monclient: found mon.noname-a 2026-02-17T21:25:30.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.810+0000 7f534e673640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:30.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.810+0000 7f534e673640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:30.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.810+0000 7f534e673640 1 -- 10.20.193.5:0/3691335701 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2327fda10 con 0x55d23272e570 2026-02-17T21:25:30.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.812+0000 7f534e673640 1 --2- 10.20.193.5:0/3691335701 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x55d23272e570 0x55d232725df0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55d23276f980 tx=0x7f5344058700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d7bc086b97182d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:30.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.814+0000 7f534d671640 1 -- 10.20.193.5:0/3691335701 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534406d070 con 0x55d23272e570 2026-02-17T21:25:30.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.814+0000 7f534d671640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:30.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.814+0000 7f534d671640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:30.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.814+0000 7f534d671640 10 monclient: dump: 2026-02-17T21:25:30.823 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:30.823 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:30.823 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:30.823 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:30.823 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:30.824 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:30.824 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:30.824 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:30.824 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:30.824 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:30.824 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.814+0000 7f534d671640 10 monclient: _finish_auth 0 2026-02-17T21:25:30.824 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.814+0000 7f534d671640 10 monclient: _check_auth_tickets 2026-02-17T21:25:30.824 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.814+0000 7f534d671640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:30.824 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.814+0000 7f534fbab0c0 5 monclient: authenticate success, global_id 4368 2026-02-17T21:25:30.824 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.814+0000 7f534fbab0c0 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:30.824 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.815+0000 7f534d671640 1 -- 10.20.193.5:0/3691335701 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5344060dc0 con 0x55d23272e570 2026-02-17T21:25:30.824 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.815+0000 7f534d671640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:30.825 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.815+0000 7f534d671640 1 -- 10.20.193.5:0/3691335701 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5344068680 con 0x55d23272e570 2026-02-17T21:25:30.825 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.815+0000 7f534d671640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:30.825 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.815+0000 7f534d671640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:30.825 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.815+0000 7f534d671640 10 monclient: dump: 2026-02-17T21:25:30.825 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:30.825 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:30.825 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:30.825 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:30.825 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:30.825 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:30.825 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:30.825 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:30.826 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:30.826 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:30.826 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.815+0000 7f534fbab0c0 10 monclient: get_monmap_and_config success 2026-02-17T21:25:30.826 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.815+0000 7f534fbab0c0 4 set_mon_vals no callback set 2026-02-17T21:25:30.826 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.815+0000 7f534fbab0c0 10 monclient: shutdown 2026-02-17T21:25:30.826 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.815+0000 7f534fbab0c0 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:30.826 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.815+0000 7f534fbab0c0 1 -- 10.20.193.5:0/3691335701 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x55d23272e570 msgr2=0x55d232725df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:30.826 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.815+0000 7f534fbab0c0 1 --2- 10.20.193.5:0/3691335701 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x55d23272e570 0x55d232725df0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55d23276f980 tx=0x7f5344058700 comp rx=0 tx=0).stop 2026-02-17T21:25:30.826 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.815+0000 7f534fbab0c0 1 -- 10.20.193.5:0/3691335701 shutdown_connections 2026-02-17T21:25:30.826 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.815+0000 7f534fbab0c0 1 --2- 10.20.193.5:0/3691335701 >> v2:10.20.193.119:3300/0 conn(0x55d232726330 0x55d2327f2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:30.826 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.815+0000 7f534fbab0c0 1 --2- 10.20.193.5:0/3691335701 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x55d23272e570 0x55d232725df0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:30.826 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.815+0000 7f534fbab0c0 1 -- 10.20.193.5:0/3691335701 >> 10.20.193.5:0/3691335701 conn(0x55d23276ed50 msgr2=0x55d23276f160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:30.827 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.815+0000 7f534fbab0c0 1 -- 10.20.193.5:0/3691335701 shutdown_connections 2026-02-17T21:25:30.827 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.815+0000 7f534fbab0c0 1 -- 10.20.193.5:0/3691335701 wait complete. 2026-02-17T21:25:30.827 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.816+0000 7f534fbab0c0 10 monclient: build_initial_monmap 2026-02-17T21:25:30.827 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.816+0000 7f534fbab0c0 10 monclient: monmap: 2026-02-17T21:25:30.827 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:30.827 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:30.827 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:30.827 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:30.827 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:30.827 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:30.827 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:30.827 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:30.828 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:30.828 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:30.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.816+0000 7f534fbab0c0 1 librados: starting msgr at 2026-02-17T21:25:30.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.816+0000 7f534fbab0c0 1 librados: starting objecter 2026-02-17T21:25:30.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.816+0000 7f534fbab0c0 1 Processor -- start 2026-02-17T21:25:30.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.816+0000 7f534fbab0c0 1 -- start start 2026-02-17T21:25:30.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.816+0000 7f534fbab0c0 1 librados: setting wanted keys 2026-02-17T21:25:30.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.816+0000 7f534fbab0c0 1 librados: calling monclient init 2026-02-17T21:25:30.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.816+0000 7f534fbab0c0 10 monclient: init 2026-02-17T21:25:30.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.816+0000 7f534fbab0c0 10 monclient: _reopen_session rank -1 2026-02-17T21:25:30.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.816+0000 7f534fbab0c0 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:25:30.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.816+0000 7f534fbab0c0 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x55d232726330 0x55d2327f9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:30.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.816+0000 7f534fbab0c0 10 monclient(hunting): picked mon.noname-b con 0x55d232726330 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:30.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.816+0000 7f534fbab0c0 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x55d23272e570 0x55d2327f7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:30.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.816+0000 7f534fbab0c0 10 monclient(hunting): picked mon.noname-a con 0x55d23272e570 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:30.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.816+0000 7f534fbab0c0 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x55d23272e950 0x55d23280c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:30.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.816+0000 7f534fbab0c0 10 monclient(hunting): picked mon.noname-c con 0x55d23272e950 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:30.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.816+0000 7f534fbab0c0 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:30.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.816+0000 7f534fbab0c0 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x55d2325aae50 con 0x55d23272e570 2026-02-17T21:25:30.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.816+0000 7f534fbab0c0 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:30.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.816+0000 7f534fbab0c0 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x55d23260bdb0 con 0x55d232726330 2026-02-17T21:25:30.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.816+0000 7f534fbab0c0 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:30.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.816+0000 7f534fbab0c0 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x55d2327f83a0 con 0x55d23272e950 2026-02-17T21:25:30.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.816+0000 7f534fbab0c0 10 monclient(hunting): _renew_subs 2026-02-17T21:25:30.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.816+0000 7f534fbab0c0 10 monclient(hunting): authenticate will time out at 1036.381826s 2026-02-17T21:25:30.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.817+0000 7f534e673640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x55d232726330 0x55d2327f9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:30.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.817+0000 7f534e673640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x55d232726330 0x55d2327f9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:37600/0 (socket says 10.20.193.5:37600) 2026-02-17T21:25:30.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.817+0000 7f534e673640 1 -- 10.20.193.5:0/799884612 learned_addr learned my addr 10.20.193.5:0/799884612 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:30.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.817+0000 7f534e673640 10 monclient(hunting): get_auth_request con 0x55d232726330 auth_method 0 2026-02-17T21:25:30.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.817+0000 7f534e673640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:30.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.817+0000 7f534e673640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:30.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.817+0000 7f534e673640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:30.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.817+0000 7f534e673640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:30.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.817+0000 7f534e673640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:30.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.817+0000 7f534e673640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:30.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.817+0000 7f534de72640 1 --2- 10.20.193.5:0/799884612 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x55d23272e570 0x55d2327f7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:30.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.818+0000 7f534f8fc640 1 --2- 10.20.193.5:0/799884612 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x55d23272e950 0x55d23280c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:30.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.818+0000 7f534de72640 10 monclient(hunting): get_auth_request con 0x55d23272e570 auth_method 0 2026-02-17T21:25:30.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.818+0000 7f534de72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:30.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.818+0000 7f534de72640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:30.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.818+0000 7f534de72640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:30.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.818+0000 7f534f8fc640 10 monclient(hunting): get_auth_request con 0x55d23272e950 auth_method 0 2026-02-17T21:25:30.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.818+0000 7f534f8fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:30.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.818+0000 7f534f8fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:30.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.818+0000 7f534f8fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:30.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.818+0000 7f534de72640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:30.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.818+0000 7f534de72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:30.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.818+0000 7f534de72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:30.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.818+0000 7f534f8fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:30.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.818+0000 7f534f8fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:30.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.818+0000 7f534f8fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:30.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.819+0000 7f534e673640 10 monclient(hunting): handle_auth_done global_id 4405 payload 824 2026-02-17T21:25:30.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.819+0000 7f534e673640 1 -- 10.20.193.5:0/799884612 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x55d23272e950 msgr2=0x55d23280c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:30.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.819+0000 7f534e673640 1 --2- 10.20.193.5:0/799884612 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x55d23272e950 0x55d23280c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:30.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.819+0000 7f534e673640 1 -- 10.20.193.5:0/799884612 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x55d23272e570 msgr2=0x55d2327f7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:30.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.819+0000 7f534e673640 1 --2- 10.20.193.5:0/799884612 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x55d23272e570 0x55d2327f7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:30.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.819+0000 7f534e673640 10 monclient: _finish_hunting 0 2026-02-17T21:25:30.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.819+0000 7f534e673640 1 monclient: found mon.noname-b 2026-02-17T21:25:30.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.819+0000 7f534e673640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:30.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.819+0000 7f534e673640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:30.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.819+0000 7f534e673640 1 -- 10.20.193.5:0/799884612 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2327f85c0 con 0x55d232726330 2026-02-17T21:25:30.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.820+0000 7f534e673640 1 --2- 10.20.193.5:0/799884612 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x55d232726330 0x55d2327f9330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5344027c30 tx=0x7f5344002fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:30.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.820+0000 7f533e7fc640 10 client.?.objecter ms_handle_connect 0x55d232726330 2026-02-17T21:25:30.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.820+0000 7f533e7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:30.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.822+0000 7f533e7fc640 1 -- 10.20.193.5:0/799884612 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5344078020 con 0x55d232726330 2026-02-17T21:25:30.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.822+0000 7f533e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:30.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.822+0000 7f533e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:30.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.822+0000 7f533e7fc640 10 monclient: dump: 2026-02-17T21:25:30.834 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:30.834 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:30.834 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:30.834 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:30.835 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:30.835 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:30.835 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:30.835 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:30.835 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:30.835 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:30.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.822+0000 7f533e7fc640 10 monclient: _finish_auth 0 2026-02-17T21:25:30.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.822+0000 7f533e7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:25:30.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.822+0000 7f533e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:30.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.822+0000 7f533e7fc640 1 -- 10.20.193.5:0/799884612 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f534406e040 con 0x55d232726330 2026-02-17T21:25:30.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.822+0000 7f533e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:30.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.822+0000 7f533e7fc640 1 -- 10.20.193.5:0/799884612 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534406d070 con 0x55d232726330 2026-02-17T21:25:30.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.822+0000 7f533e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:30.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.822+0000 7f533e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:30.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.822+0000 7f533e7fc640 10 monclient: dump: 2026-02-17T21:25:30.836 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:30.836 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:30.836 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:30.836 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:30.836 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:30.836 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:30.836 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:30.836 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:30.837 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:30.837 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:30.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.822+0000 7f534fbab0c0 5 monclient: authenticate success, global_id 4405 2026-02-17T21:25:30.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.822+0000 7f534fbab0c0 10 monclient: _renew_subs 2026-02-17T21:25:30.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.822+0000 7f534fbab0c0 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:30.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.822+0000 7f534fbab0c0 1 -- 10.20.193.5:0/799884612 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d2327f88a0 con 0x55d232726330 2026-02-17T21:25:30.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.822+0000 7f534ce70640 4 set_mon_vals no callback set 2026-02-17T21:25:30.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.822+0000 7f534fbab0c0 10 client.4405.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:30.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.822+0000 7f534fbab0c0 10 monclient: _renew_subs 2026-02-17T21:25:30.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.822+0000 7f534fbab0c0 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:30.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.822+0000 7f534fbab0c0 1 -- 10.20.193.5:0/799884612 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2327f8e60 con 0x55d232726330 2026-02-17T21:25:30.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.822+0000 7f534fbab0c0 1 librados: init done 2026-02-17T21:25:30.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.822+0000 7f534fbab0c0 10 librados: wait_for_osdmap waiting 2026-02-17T21:25:30.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.834+0000 7f533e7fc640 1 -- 10.20.193.5:0/799884612 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f5344068ba0 con 0x55d232726330 2026-02-17T21:25:30.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.835+0000 7f533e7fc640 1 --2- 10.20.193.5:0/799884612 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f532c077300 0x7f532c0797c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:30.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.835+0000 7f534de72640 1 --2- 10.20.193.5:0/799884612 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f532c077300 0x7f532c0797c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:30.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.835+0000 7f534de72640 10 monclient: get_auth_request con 0x7f532c077300 auth_method 0 2026-02-17T21:25:30.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.836+0000 7f534de72640 1 --2- 10.20.193.5:0/799884612 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f532c077300 0x7f532c0797c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5338005fd0 tx=0x7f53380058f0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:30.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.836+0000 7f533e7fc640 10 client.4405.objecter ms_handle_connect 0x7f532c077300 2026-02-17T21:25:30.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.837+0000 7f533e7fc640 1 -- 10.20.193.5:0/799884612 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 8905+0+0 (secure 0 0 0) 0x7f53440b4430 con 0x55d232726330 2026-02-17T21:25:30.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.837+0000 7f533e7fc640 10 client.4405.objecter ms_dispatch2 0x55d2326265a0 osd_map(31..31 src has 1..31) 2026-02-17T21:25:30.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.837+0000 7f533e7fc640 3 client.4405.objecter handle_osd_map got epochs [31,31] > 0 2026-02-17T21:25:30.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.837+0000 7f533e7fc640 3 client.4405.objecter handle_osd_map decoding full epoch 31 2026-02-17T21:25:30.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.838+0000 7f533e7fc640 20 client.4405.objecter dump_active .. 0 homeless 2026-02-17T21:25:30.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.838+0000 7f534fbab0c0 10 librados: wait_for_osdmap done waiting 2026-02-17T21:25:30.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.838+0000 7f534fbab0c0 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-17T21:25:30.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.838+0000 7f534fbab0c0 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-17T21:25:30.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.838+0000 7f534fbab0c0 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:30.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:30.838+0000 7f534fbab0c0 1 -- 10.20.193.5:0/799884612 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x55d23276d970 con 0x55d232726330 2026-02-17T21:25:31.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.808+0000 7f533e7fc640 1 -- 10.20.193.5:0/799884612 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v32) ==== 141+0+0 (secure 0 0 0) 0x7f5344082030 con 0x55d232726330 2026-02-17T21:25:31.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.808+0000 7f533e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-17T21:25:31.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.808+0000 7f533e7fc640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2026-02-17T21:25:31.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.808+0000 7f534fbab0c0 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:31.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.808+0000 7f534fbab0c0 1 -- 10.20.193.5:0/799884612 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5344060dc0 con 0x55d232726330 2026-02-17T21:25:31.813 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.811+0000 7f533e7fc640 1 -- 10.20.193.5:0/799884612 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f53440b47f0 con 0x55d232726330 2026-02-17T21:25:31.813 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.811+0000 7f533e7fc640 10 monclient: handle_get_version_reply finishing 1 version 32 2026-02-17T21:25:31.813 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.811+0000 7f534ce70640 10 client.4405.objecter _get_latest_version latest 32, waiting 2026-02-17T21:25:31.813 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.811+0000 7f534ce70640 10 client.4405.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:31.813 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.811+0000 7f534ce70640 10 monclient: _renew_subs 2026-02-17T21:25:31.814 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.811+0000 7f534ce70640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:31.814 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.811+0000 7f534ce70640 1 -- 10.20.193.5:0/799884612 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=32}) -- 0x7f5330003c90 con 0x55d232726330 2026-02-17T21:25:31.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.813+0000 7f533e7fc640 1 -- 10.20.193.5:0/799884612 <== mon.1 v2:10.20.193.119:3300/0 8 ==== osd_map(32..32 src has 1..32) ==== 682+0+0 (secure 0 0 0) 0x7f53440b7cb0 con 0x55d232726330 2026-02-17T21:25:31.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.813+0000 7f533e7fc640 10 client.4405.objecter ms_dispatch2 0x55d2326265a0 osd_map(32..32 src has 1..32) 2026-02-17T21:25:31.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.813+0000 7f533e7fc640 3 client.4405.objecter handle_osd_map got epochs [32,32] > 31 2026-02-17T21:25:31.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.813+0000 7f533e7fc640 3 client.4405.objecter handle_osd_map decoding incremental epoch 32 2026-02-17T21:25:31.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.813+0000 7f533e7fc640 20 client.4405.objecter dump_active .. 0 homeless 2026-02-17T21:25:31.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.813+0000 7f534fbab0c0 10 librados: create oid=rbd_trash nspace= 2026-02-17T21:25:31.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.813+0000 7f534fbab0c0 10 client.4405.objecter _op_submit op 0x55d23280d620 2026-02-17T21:25:31.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.813+0000 7f534fbab0c0 20 client.4405.objecter _calc_target epoch 32 base rbd_trash @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-17T21:25:31.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.813+0000 7f534fbab0c0 20 client.4405.objecter _calc_target target rbd_trash @2 -> pgid 2.5a749323 2026-02-17T21:25:31.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.813+0000 7f534fbab0c0 10 client.4405.objecter _calc_target raw pgid 2.5a749323 -> actual 2.3 acting [4,15] primary 4 2026-02-17T21:25:31.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.813+0000 7f534fbab0c0 1 --2- 10.20.193.5:0/799884612 >> [v2:10.20.193.5:6800/234574736,v1:10.20.193.5:6801/234574736] conn(0x55d23280e3f0 0x55d23280e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:31.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.813+0000 7f534fbab0c0 20 client.4405.objecter _get_session s=0x55d2325ab230 osd=4 3 2026-02-17T21:25:31.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.813+0000 7f534fbab0c0 10 client.4405.objecter _op_submit oid rbd_trash '@2' '@2' [create] tid 1 osd.4 2026-02-17T21:25:31.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.813+0000 7f534fbab0c0 20 client.4405.objecter get_session s=0x55d2325ab230 osd=4 3 2026-02-17T21:25:31.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.813+0000 7f534fbab0c0 15 client.4405.objecter _session_op_assign 4 1 2026-02-17T21:25:31.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.813+0000 7f534fbab0c0 15 client.4405.objecter _send_op 1 to 2.3 on osd.4 2026-02-17T21:25:31.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.813+0000 7f534fbab0c0 1 -- 10.20.193.5:0/799884612 --> [v2:10.20.193.5:6800/234574736,v1:10.20.193.5:6801/234574736] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d23280f0d0 con 0x55d23280e3f0 2026-02-17T21:25:31.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.813+0000 7f534fbab0c0 20 client.4405.objecter put_session s=0x55d2325ab230 osd=4 4 2026-02-17T21:25:31.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.813+0000 7f534fbab0c0 5 client.4405.objecter 1 in flight 2026-02-17T21:25:31.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.856+0000 7f534f8fc640 1 --2- 10.20.193.5:0/799884612 >> [v2:10.20.193.5:6800/234574736,v1:10.20.193.5:6801/234574736] conn(0x55d23280e3f0 0x55d23280e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:31.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.857+0000 7f534f8fc640 10 monclient: get_auth_request con 0x55d23280e3f0 auth_method 0 2026-02-17T21:25:31.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.861+0000 7f533e7fc640 10 client.4405.objecter ms_handle_connect 0x55d23280e3f0 2026-02-17T21:25:31.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:31.861+0000 7f534f8fc640 1 --2- 10.20.193.5:0/799884612 >> [v2:10.20.193.5:6800/234574736,v1:10.20.193.5:6801/234574736] conn(0x55d23280e3f0 0x55d23280e7d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:32.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.244+0000 7f534f8fc640 1 -- 10.20.193.5:0/799884612 <== osd.4 v2:10.20.193.5:6800/234574736 1 ==== osd_op_reply(1 rbd_trash [create] v32'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f534000b7c0 con 0x55d23280e3f0 2026-02-17T21:25:32.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.244+0000 7f534f8fc640 10 client.4405.objecter ms_dispatch2 0x55d2326265a0 osd_op_reply(1 rbd_trash [create] v32'1 uv1 ondisk = 0) 2026-02-17T21:25:32.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.244+0000 7f534f8fc640 10 client.4405.objecter in handle_osd_op_reply 2026-02-17T21:25:32.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.244+0000 7f534f8fc640 7 client.4405.objecter handle_osd_op_reply 1 ondisk uv 1 in 2.3 attempt 0 2026-02-17T21:25:32.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.244+0000 7f534f8fc640 10 client.4405.objecter op 0 rval 0 len 0 2026-02-17T21:25:32.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.244+0000 7f534f8fc640 15 client.4405.objecter handle_osd_op_reply completed tid 1 2026-02-17T21:25:32.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.244+0000 7f534f8fc640 15 client.4405.objecter _finish_op 1 2026-02-17T21:25:32.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.244+0000 7f534f8fc640 20 client.4405.objecter put_session s=0x55d2325ab230 osd=4 4 2026-02-17T21:25:32.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.244+0000 7f534f8fc640 15 client.4405.objecter _session_op_remove 4 1 2026-02-17T21:25:32.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.244+0000 7f534f8fc640 5 client.4405.objecter 0 in flight 2026-02-17T21:25:32.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.244+0000 7f534fbab0c0 10 librados: Objecter returned from create r=0 2026-02-17T21:25:32.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.245+0000 7f534fbab0c0 10 client.4405.objecter _op_submit op 0x55d232868a60 2026-02-17T21:25:32.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.245+0000 7f534fbab0c0 20 client.4405.objecter _calc_target epoch 32 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-17T21:25:32.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.245+0000 7f534fbab0c0 20 client.4405.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-17T21:25:32.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.245+0000 7f534fbab0c0 10 client.4405.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [3,9] primary 3 2026-02-17T21:25:32.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.245+0000 7f534fbab0c0 1 --2- 10.20.193.5:0/799884612 >> [v2:10.20.193.176:6818/1862950168,v1:10.20.193.176:6819/1862950168] conn(0x55d232869610 0x55d23286baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:32.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.245+0000 7f534fbab0c0 20 client.4405.objecter _get_session s=0x55d232868f90 osd=3 3 2026-02-17T21:25:32.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.245+0000 7f534fbab0c0 10 client.4405.objecter _op_submit oid rbd_info '@2' '@2' [call rbd.metadata_list in=33b] tid 2 osd.3 2026-02-17T21:25:32.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.245+0000 7f534fbab0c0 20 client.4405.objecter get_session s=0x55d232868f90 osd=3 3 2026-02-17T21:25:32.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.245+0000 7f534fbab0c0 15 client.4405.objecter _session_op_assign 3 2 2026-02-17T21:25:32.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.245+0000 7f534fbab0c0 15 client.4405.objecter _send_op 2 to 2.2 on osd.3 2026-02-17T21:25:32.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.245+0000 7f534fbab0c0 1 -- 10.20.193.5:0/799884612 --> [v2:10.20.193.176:6818/1862950168,v1:10.20.193.176:6819/1862950168] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d23286c020 con 0x55d232869610 2026-02-17T21:25:32.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.245+0000 7f534fbab0c0 20 client.4405.objecter put_session s=0x55d232868f90 osd=3 4 2026-02-17T21:25:32.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.245+0000 7f534fbab0c0 5 client.4405.objecter 1 in flight 2026-02-17T21:25:32.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.246+0000 7f534e673640 1 --2- 10.20.193.5:0/799884612 >> [v2:10.20.193.176:6818/1862950168,v1:10.20.193.176:6819/1862950168] conn(0x55d232869610 0x55d23286baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:32.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.246+0000 7f534e673640 10 monclient: get_auth_request con 0x55d232869610 auth_method 0 2026-02-17T21:25:32.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.249+0000 7f534e673640 1 --2- 10.20.193.5:0/799884612 >> [v2:10.20.193.176:6818/1862950168,v1:10.20.193.176:6819/1862950168] conn(0x55d232869610 0x55d23286baa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:32.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.249+0000 7f533e7fc640 10 client.4405.objecter ms_handle_connect 0x55d232869610 2026-02-17T21:25:32.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.304+0000 7f534e673640 1 -- 10.20.193.5:0/799884612 <== osd.3 v2:10.20.193.176:6818/1862950168 1 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f53440b8650 con 0x55d232869610 2026-02-17T21:25:32.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.304+0000 7f534e673640 10 client.4405.objecter ms_dispatch2 0x55d2326265a0 osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-17T21:25:32.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.304+0000 7f534e673640 10 client.4405.objecter in handle_osd_op_reply 2026-02-17T21:25:32.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.304+0000 7f534e673640 7 client.4405.objecter handle_osd_op_reply 2 ondisk uv 0 in 2.2 attempt 0 2026-02-17T21:25:32.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.304+0000 7f534e673640 10 client.4405.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-17T21:25:32.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.304+0000 7f534e673640 10 client.4405.objecter op 0 rval 0 len 0 2026-02-17T21:25:32.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.304+0000 7f534e673640 15 client.4405.objecter handle_osd_op_reply completed tid 2 2026-02-17T21:25:32.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.304+0000 7f534e673640 15 client.4405.objecter _finish_op 2 2026-02-17T21:25:32.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.304+0000 7f534e673640 20 client.4405.objecter put_session s=0x55d232868f90 osd=3 4 2026-02-17T21:25:32.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.304+0000 7f534e673640 15 client.4405.objecter _session_op_remove 3 2 2026-02-17T21:25:32.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.304+0000 7f534e673640 5 client.4405.objecter 0 in flight 2026-02-17T21:25:32.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.304+0000 7f534fbab0c0 10 client.4405.objecter _op_submit op 0x55d232867c40 2026-02-17T21:25:32.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.304+0000 7f534fbab0c0 20 client.4405.objecter _calc_target epoch 32 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-17T21:25:32.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.304+0000 7f534fbab0c0 20 client.4405.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-17T21:25:32.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.304+0000 7f534fbab0c0 10 client.4405.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [3,9] primary 3 2026-02-17T21:25:32.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.304+0000 7f534fbab0c0 20 client.4405.objecter _get_session s=0x55d232868f90 osd=3 3 2026-02-17T21:25:32.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.304+0000 7f534fbab0c0 10 client.4405.objecter _op_submit oid rbd_info '@2' '@2' [read 0~0] tid 3 osd.3 2026-02-17T21:25:32.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.304+0000 7f534fbab0c0 20 client.4405.objecter get_session s=0x55d232868f90 osd=3 3 2026-02-17T21:25:32.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.304+0000 7f534fbab0c0 15 client.4405.objecter _session_op_assign 3 3 2026-02-17T21:25:32.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.304+0000 7f534fbab0c0 15 client.4405.objecter _send_op 3 to 2.2 on osd.3 2026-02-17T21:25:32.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.304+0000 7f534fbab0c0 1 -- 10.20.193.5:0/799884612 --> [v2:10.20.193.176:6818/1862950168,v1:10.20.193.176:6819/1862950168] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2328680f0 con 0x55d232869610 2026-02-17T21:25:32.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.304+0000 7f534fbab0c0 20 client.4405.objecter put_session s=0x55d232868f90 osd=3 4 2026-02-17T21:25:32.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.304+0000 7f534fbab0c0 5 client.4405.objecter 1 in flight 2026-02-17T21:25:32.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.308+0000 7f534e673640 1 -- 10.20.193.5:0/799884612 <== osd.3 v2:10.20.193.176:6818/1862950168 2 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f53440b8650 con 0x55d232869610 2026-02-17T21:25:32.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.308+0000 7f534e673640 10 client.4405.objecter ms_dispatch2 0x55d2326265a0 osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-17T21:25:32.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.308+0000 7f534e673640 10 client.4405.objecter in handle_osd_op_reply 2026-02-17T21:25:32.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.308+0000 7f534e673640 7 client.4405.objecter handle_osd_op_reply 3 ondisk uv 0 in 2.2 attempt 0 2026-02-17T21:25:32.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.308+0000 7f534e673640 10 client.4405.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-17T21:25:32.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.308+0000 7f534e673640 10 client.4405.objecter op 0 rval 0 len 0 2026-02-17T21:25:32.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.308+0000 7f534e673640 15 client.4405.objecter handle_osd_op_reply completed tid 3 2026-02-17T21:25:32.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.308+0000 7f534e673640 15 client.4405.objecter _finish_op 3 2026-02-17T21:25:32.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.308+0000 7f534e673640 20 client.4405.objecter put_session s=0x55d232868f90 osd=3 4 2026-02-17T21:25:32.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.308+0000 7f534e673640 15 client.4405.objecter _session_op_remove 3 3 2026-02-17T21:25:32.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.308+0000 7f534e673640 5 client.4405.objecter 0 in flight 2026-02-17T21:25:32.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.308+0000 7f533ffff640 10 client.4405.objecter allocate_selfmanaged_snap; pool: 2 2026-02-17T21:25:32.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.308+0000 7f533ffff640 10 client.4405.objecter pool_op_submit 4 2026-02-17T21:25:32.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.308+0000 7f533ffff640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:32.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.308+0000 7f533ffff640 1 -- 10.20.193.5:0/799884612 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f53240030d0 con 0x55d232726330 2026-02-17T21:25:32.960 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.958+0000 7f533e7fc640 1 -- 10.20.193.5:0/799884612 <== mon.1 v2:10.20.193.119:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v33) ==== 55+0+0 (secure 0 0 0) 0x7f53440217d0 con 0x55d232726330 2026-02-17T21:25:32.960 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.959+0000 7f533e7fc640 10 client.4405.objecter ms_dispatch2 0x55d2326265a0 pool_op_reply(tid 4 (0) Success v33) 2026-02-17T21:25:32.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.959+0000 7f533e7fc640 10 client.4405.objecter handle_pool_op_reply pool_op_reply(tid 4 (0) Success v33) 2026-02-17T21:25:32.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.959+0000 7f533e7fc640 10 client.4405.objecter have request 4 at 0x7f5324003060 Op: create unmanaged snap 2026-02-17T21:25:32.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.959+0000 7f533e7fc640 20 client.4405.objecter waiting for client to reach epoch 33 before calling back 2026-02-17T21:25:32.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.959+0000 7f533e7fc640 10 client.4405.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:32.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.959+0000 7f533e7fc640 10 monclient: _renew_subs 2026-02-17T21:25:32.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.959+0000 7f533e7fc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:32.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.959+0000 7f533e7fc640 1 -- 10.20.193.5:0/799884612 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=33}) -- 0x7f532c07fa90 con 0x55d232726330 2026-02-17T21:25:32.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.959+0000 7f533e7fc640 10 client.4405.objecter done 2026-02-17T21:25:32.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.960+0000 7f533e7fc640 1 -- 10.20.193.5:0/799884612 <== mon.1 v2:10.20.193.119:3300/0 10 ==== osd_map(33..33 src has 1..33) ==== 626+0+0 (secure 0 0 0) 0x7f53440c1110 con 0x55d232726330 2026-02-17T21:25:32.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.960+0000 7f533e7fc640 10 client.4405.objecter ms_dispatch2 0x55d2326265a0 osd_map(33..33 src has 1..33) 2026-02-17T21:25:32.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.960+0000 7f533e7fc640 3 client.4405.objecter handle_osd_map got epochs [33,33] > 32 2026-02-17T21:25:32.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.960+0000 7f533e7fc640 3 client.4405.objecter handle_osd_map decoding incremental epoch 33 2026-02-17T21:25:32.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.960+0000 7f533e7fc640 20 client.4405.objecter dump_active .. 0 homeless 2026-02-17T21:25:32.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.960+0000 7f534ce70640 20 librados: queue_aio_write 0x55d232863ff0 completion 0x55d2325cf5f0 write_seq 1 2026-02-17T21:25:32.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.960+0000 7f534ce70640 10 client.4405.objecter _op_submit op 0x7f53300062b0 2026-02-17T21:25:32.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.960+0000 7f534ce70640 20 client.4405.objecter _calc_target epoch 33 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-17T21:25:32.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.960+0000 7f534ce70640 20 client.4405.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-17T21:25:32.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.960+0000 7f534ce70640 10 client.4405.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [3,9] primary 3 2026-02-17T21:25:32.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.960+0000 7f534ce70640 20 client.4405.objecter _get_session s=0x55d232868f90 osd=3 3 2026-02-17T21:25:32.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.960+0000 7f534ce70640 10 client.4405.objecter _op_submit oid rbd_info '@2' '@2' [create,write 0~8 in=8b] tid 5 osd.3 2026-02-17T21:25:32.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.960+0000 7f534ce70640 20 client.4405.objecter get_session s=0x55d232868f90 osd=3 3 2026-02-17T21:25:32.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.960+0000 7f534ce70640 15 client.4405.objecter _session_op_assign 3 5 2026-02-17T21:25:32.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.960+0000 7f534ce70640 15 client.4405.objecter _send_op 5 to 2.2 on osd.3 2026-02-17T21:25:32.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.960+0000 7f534ce70640 1 -- 10.20.193.5:0/799884612 --> [v2:10.20.193.176:6818/1862950168,v1:10.20.193.176:6819/1862950168] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x7f5330006950 con 0x55d232869610 2026-02-17T21:25:32.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.960+0000 7f534ce70640 20 client.4405.objecter put_session s=0x55d232868f90 osd=3 4 2026-02-17T21:25:32.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:32.960+0000 7f534ce70640 5 client.4405.objecter 1 in flight 2026-02-17T21:25:33.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:33.219+0000 7f534e673640 1 -- 10.20.193.5:0/799884612 <== osd.3 v2:10.20.193.176:6818/1862950168 3 ==== osd_op_reply(5 rbd_info [create,write 0~8] v33'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f53440b8650 con 0x55d232869610 2026-02-17T21:25:33.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:33.219+0000 7f534e673640 10 client.4405.objecter ms_dispatch2 0x55d2326265a0 osd_op_reply(5 rbd_info [create,write 0~8] v33'1 uv1 ondisk = 0) 2026-02-17T21:25:33.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:33.219+0000 7f534e673640 10 client.4405.objecter in handle_osd_op_reply 2026-02-17T21:25:33.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:33.219+0000 7f534e673640 7 client.4405.objecter handle_osd_op_reply 5 ondisk uv 1 in 2.2 attempt 0 2026-02-17T21:25:33.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:33.219+0000 7f534e673640 10 client.4405.objecter op 0 rval 0 len 0 2026-02-17T21:25:33.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:33.219+0000 7f534e673640 10 client.4405.objecter op 1 rval 0 len 0 2026-02-17T21:25:33.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:33.219+0000 7f534e673640 15 client.4405.objecter handle_osd_op_reply completed tid 5 2026-02-17T21:25:33.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:33.219+0000 7f534e673640 15 client.4405.objecter _finish_op 5 2026-02-17T21:25:33.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:33.219+0000 7f534e673640 20 client.4405.objecter put_session s=0x55d232868f90 osd=3 4 2026-02-17T21:25:33.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:33.219+0000 7f534e673640 15 client.4405.objecter _session_op_remove 3 5 2026-02-17T21:25:33.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:33.219+0000 7f534e673640 5 client.4405.objecter 0 in flight 2026-02-17T21:25:33.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:33.219+0000 7f534e673640 20 librados: complete_aio_write 0x55d2325cf5f0 2026-02-17T21:25:33.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:33.219+0000 7f533ffff640 10 client.4405.objecter delete_selfmanaged_snap; pool: 2; snap: 2 2026-02-17T21:25:33.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:33.219+0000 7f533ffff640 10 client.4405.objecter pool_op_submit 6 2026-02-17T21:25:33.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:33.219+0000 7f533ffff640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:33.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:33.219+0000 7f533ffff640 1 -- 10.20.193.5:0/799884612 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v33) -- 0x7f5324004520 con 0x55d232726330 2026-02-17T21:25:33.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:33.816+0000 7f533d7fa640 10 monclient: tick 2026-02-17T21:25:33.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:33.816+0000 7f533d7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:25:33.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:33.816+0000 7f533d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:33.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:33.816+0000 7f533d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:34.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.316+0000 7f533e7fc640 1 -- 10.20.193.5:0/799884612 <== mon.1 v2:10.20.193.119:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v34) ==== 43+0+0 (secure 0 0 0) 0x7f5344023a20 con 0x55d232726330 2026-02-17T21:25:34.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.316+0000 7f533e7fc640 10 client.4405.objecter ms_dispatch2 0x55d2326265a0 pool_op_reply(tid 6 (0) Success v34) 2026-02-17T21:25:34.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.316+0000 7f533e7fc640 10 client.4405.objecter handle_pool_op_reply pool_op_reply(tid 6 (0) Success v34) 2026-02-17T21:25:34.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.316+0000 7f533e7fc640 10 client.4405.objecter have request 6 at 0x7f5324003060 Op: delete unmanaged snap 2026-02-17T21:25:34.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.316+0000 7f533e7fc640 20 client.4405.objecter waiting for client to reach epoch 34 before calling back 2026-02-17T21:25:34.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.316+0000 7f533e7fc640 10 client.4405.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:34.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.316+0000 7f533e7fc640 10 monclient: _renew_subs 2026-02-17T21:25:34.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.316+0000 7f533e7fc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:34.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.316+0000 7f533e7fc640 1 -- 10.20.193.5:0/799884612 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=34}) -- 0x7f532c07fb40 con 0x55d232726330 2026-02-17T21:25:34.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.316+0000 7f533e7fc640 10 client.4405.objecter done 2026-02-17T21:25:34.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.318+0000 7f533e7fc640 1 -- 10.20.193.5:0/799884612 <== mon.1 v2:10.20.193.119:3300/0 12 ==== osd_map(34..34 src has 1..34) ==== 654+0+0 (secure 0 0 0) 0x7f53440c1310 con 0x55d232726330 2026-02-17T21:25:34.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.318+0000 7f533e7fc640 10 client.4405.objecter ms_dispatch2 0x55d2326265a0 osd_map(34..34 src has 1..34) 2026-02-17T21:25:34.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.318+0000 7f533e7fc640 3 client.4405.objecter handle_osd_map got epochs [34,34] > 33 2026-02-17T21:25:34.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.318+0000 7f533e7fc640 3 client.4405.objecter handle_osd_map decoding incremental epoch 34 2026-02-17T21:25:34.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.318+0000 7f533e7fc640 20 client.4405.objecter dump_active .. 0 homeless 2026-02-17T21:25:34.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.318+0000 7f534ce70640 20 librados: queue_aio_write 0x55d232863ff0 completion 0x7f5324001d60 write_seq 2 2026-02-17T21:25:34.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.318+0000 7f534ce70640 10 client.4405.objecter _op_submit op 0x7f53300062b0 2026-02-17T21:25:34.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.318+0000 7f534ce70640 20 client.4405.objecter _calc_target epoch 34 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-17T21:25:34.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.318+0000 7f534ce70640 20 client.4405.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-17T21:25:34.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.318+0000 7f534ce70640 10 client.4405.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [3,9] primary 3 2026-02-17T21:25:34.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.318+0000 7f534ce70640 20 client.4405.objecter _get_session s=0x55d232868f90 osd=3 3 2026-02-17T21:25:34.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.318+0000 7f534ce70640 10 client.4405.objecter _op_submit oid rbd_info '@2' '@2' [write 0~19 in=19b] tid 7 osd.3 2026-02-17T21:25:34.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.318+0000 7f534ce70640 20 client.4405.objecter get_session s=0x55d232868f90 osd=3 3 2026-02-17T21:25:34.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.318+0000 7f534ce70640 15 client.4405.objecter _session_op_assign 3 7 2026-02-17T21:25:34.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.318+0000 7f534ce70640 15 client.4405.objecter _send_op 7 to 2.2 on osd.3 2026-02-17T21:25:34.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.318+0000 7f534ce70640 1 -- 10.20.193.5:0/799884612 --> [v2:10.20.193.176:6818/1862950168,v1:10.20.193.176:6819/1862950168] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x7f5330006cf0 con 0x55d232869610 2026-02-17T21:25:34.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.318+0000 7f534ce70640 20 client.4405.objecter put_session s=0x55d232868f90 osd=3 4 2026-02-17T21:25:34.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.318+0000 7f534ce70640 5 client.4405.objecter 1 in flight 2026-02-17T21:25:34.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.816+0000 7f533d7fa640 10 monclient: tick 2026-02-17T21:25:34.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.817+0000 7f533d7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:25:34.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.817+0000 7f533d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:34.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.970+0000 7f534e673640 1 -- 10.20.193.5:0/799884612 <== osd.3 v2:10.20.193.176:6818/1862950168 4 ==== osd_op_reply(7 rbd_info [write 0~19] v34'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53440b8650 con 0x55d232869610 2026-02-17T21:25:34.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.970+0000 7f534e673640 10 client.4405.objecter ms_dispatch2 0x55d2326265a0 osd_op_reply(7 rbd_info [write 0~19] v34'2 uv2 ondisk = 0) 2026-02-17T21:25:34.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.970+0000 7f534e673640 10 client.4405.objecter in handle_osd_op_reply 2026-02-17T21:25:34.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.970+0000 7f534e673640 7 client.4405.objecter handle_osd_op_reply 7 ondisk uv 2 in 2.2 attempt 0 2026-02-17T21:25:34.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.970+0000 7f534e673640 10 client.4405.objecter op 0 rval 0 len 0 2026-02-17T21:25:34.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.970+0000 7f534e673640 15 client.4405.objecter handle_osd_op_reply completed tid 7 2026-02-17T21:25:34.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.970+0000 7f534e673640 15 client.4405.objecter _finish_op 7 2026-02-17T21:25:34.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.970+0000 7f534e673640 20 client.4405.objecter put_session s=0x55d232868f90 osd=3 4 2026-02-17T21:25:34.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.970+0000 7f534e673640 15 client.4405.objecter _session_op_remove 3 7 2026-02-17T21:25:34.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.970+0000 7f534e673640 5 client.4405.objecter 0 in flight 2026-02-17T21:25:34.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.970+0000 7f534e673640 20 librados: complete_aio_write 0x7f5324001d60 2026-02-17T21:25:34.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.971+0000 7f534fbab0c0 10 librados: watch_flush enter 2026-02-17T21:25:34.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.971+0000 7f534fbab0c0 10 librados: watch_flush exit 2026-02-17T21:25:34.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.971+0000 7f534fbab0c0 10 client.4405.objecter close_session for osd.3 2026-02-17T21:25:34.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.971+0000 7f534fbab0c0 1 -- 10.20.193.5:0/799884612 >> [v2:10.20.193.176:6818/1862950168,v1:10.20.193.176:6819/1862950168] conn(0x55d232869610 msgr2=0x55d23286baa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:34.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.971+0000 7f534fbab0c0 1 --2- 10.20.193.5:0/799884612 >> [v2:10.20.193.176:6818/1862950168,v1:10.20.193.176:6819/1862950168] conn(0x55d232869610 0x55d23286baa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:34.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.971+0000 7f534fbab0c0 20 client.4405.objecter put_session s=0x55d232868f90 osd=3 1 2026-02-17T21:25:34.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.971+0000 7f534fbab0c0 10 client.4405.objecter close_session for osd.4 2026-02-17T21:25:34.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.971+0000 7f534fbab0c0 1 -- 10.20.193.5:0/799884612 >> [v2:10.20.193.5:6800/234574736,v1:10.20.193.5:6801/234574736] conn(0x55d23280e3f0 msgr2=0x55d23280e7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:34.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.971+0000 7f534fbab0c0 1 --2- 10.20.193.5:0/799884612 >> [v2:10.20.193.5:6800/234574736,v1:10.20.193.5:6801/234574736] conn(0x55d23280e3f0 0x55d23280e7d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:34.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.971+0000 7f534fbab0c0 20 client.4405.objecter put_session s=0x55d2325ab230 osd=4 1 2026-02-17T21:25:34.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.971+0000 7f534fbab0c0 20 client.4405.objecter shutdown clearing up homeless session... 2026-02-17T21:25:34.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.971+0000 7f534fbab0c0 10 client.4405.objecter successfully canceled tick 2026-02-17T21:25:34.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.971+0000 7f534fbab0c0 1 -- 10.20.193.5:0/799884612 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f532c077300 msgr2=0x7f532c0797c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:34.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.971+0000 7f534fbab0c0 1 --2- 10.20.193.5:0/799884612 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f532c077300 0x7f532c0797c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5338005fd0 tx=0x7f53380058f0 comp rx=0 tx=0).stop 2026-02-17T21:25:34.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.971+0000 7f534fbab0c0 10 monclient: shutdown 2026-02-17T21:25:34.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.971+0000 7f534fbab0c0 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:34.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.971+0000 7f534fbab0c0 1 -- 10.20.193.5:0/799884612 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x55d232726330 msgr2=0x55d2327f9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:34.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.971+0000 7f534fbab0c0 1 --2- 10.20.193.5:0/799884612 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x55d232726330 0x55d2327f9330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5344027c30 tx=0x7f5344002fb0 comp rx=0 tx=0).stop 2026-02-17T21:25:34.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.971+0000 7f534f8fc640 1 -- 10.20.193.5:0/799884612 reap_dead start 2026-02-17T21:25:34.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.971+0000 7f534f8fc640 1 -- 10.20.193.5:0/799884612 reap_dead start 2026-02-17T21:25:34.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.971+0000 7f534fbab0c0 1 -- 10.20.193.5:0/799884612 shutdown_connections 2026-02-17T21:25:34.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.971+0000 7f534fbab0c0 1 -- 10.20.193.5:0/799884612 >> 10.20.193.5:0/799884612 conn(0x55d23276ed50 msgr2=0x55d2327ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:34.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.971+0000 7f534fbab0c0 1 -- 10.20.193.5:0/799884612 shutdown_connections 2026-02-17T21:25:34.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.971+0000 7f534fbab0c0 1 -- 10.20.193.5:0/799884612 wait complete. 2026-02-17T21:25:34.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:34.971+0000 7f534fbab0c0 1 librados: shutdown 2026-02-17T21:25:34.978 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-17T21:25:34.979 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T21:25:34.979 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-17T21:25:34.979 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-17T21:25:34.980 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-17T21:25:35.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.086+0000 7f81342c9640 10 monclient: get_monmap_and_config 2026-02-17T21:25:35.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.086+0000 7f81342c9640 10 monclient: build_initial_monmap 2026-02-17T21:25:35.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.086+0000 7f81342c9640 10 monclient: monmap: 2026-02-17T21:25:35.088 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:35.088 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:35.088 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:35.086961+0000 2026-02-17T21:25:35.088 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:35.086961+0000 2026-02-17T21:25:35.088 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:35.088 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:35.088 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:35.088 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:35.089 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:35.089 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:35.089 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:35.089 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:35.089 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:35.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.086+0000 7f81342c9640 1 Processor -- start 2026-02-17T21:25:35.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.086+0000 7f81342c9640 1 -- start start 2026-02-17T21:25:35.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.086+0000 7f81342c9640 10 monclient: init 2026-02-17T21:25:35.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.087+0000 7f81342c9640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:35.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.087+0000 7f81342c9640 10 monclient: _add_conns ranks=[4,5,0,2,1,3] 2026-02-17T21:25:35.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.087+0000 7f81342c9640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f812c0c7170 0x7f812c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:35.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.087+0000 7f81342c9640 10 monclient(hunting): picked mon.noname-b con 0x7f812c0c7170 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:35.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.087+0000 7f81342c9640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f812c0c48c0 0x7f812c0749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:35.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.087+0000 7f81342c9640 10 monclient(hunting): picked mon.noname-c con 0x7f812c0c48c0 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:35.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.087+0000 7f81342c9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f812c074ef0 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:35.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.087+0000 7f81342c9640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f812c15a9a0 con 0x7f812c074ef0 2026-02-17T21:25:35.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.087+0000 7f81342c9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:35.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.087+0000 7f81342c9640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f812c0c8530 con 0x7f812c0c7170 2026-02-17T21:25:35.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.087+0000 7f81342c9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:35.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.087+0000 7f81342c9640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f812c0c5270 con 0x7f812c0c48c0 2026-02-17T21:25:35.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.087+0000 7f81342c9640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:35.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.087+0000 7f81342c9640 10 monclient(hunting): authenticate will time out at 1040.652273s 2026-02-17T21:25:35.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.087+0000 7f813283f640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f812c074ef0 0x7f812c0c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:42806/0 (socket says 10.20.193.5:42806) 2026-02-17T21:25:35.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.087+0000 7f813283f640 1 -- 10.20.193.5:0/2501595597 learned_addr learned my addr 10.20.193.5:0/2501595597 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:35.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.087+0000 7f813203e640 1 --2- 10.20.193.5:0/2501595597 >> v2:10.20.193.119:3300/0 conn(0x7f812c0c7170 0x7f812c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:35.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.087+0000 7f813183d640 1 --2- 10.20.193.5:0/2501595597 >> v2:10.20.193.135:3300/0 conn(0x7f812c0c48c0 0x7f812c0749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:35.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.088+0000 7f813203e640 10 monclient(hunting): get_auth_request con 0x7f812c0c7170 auth_method 0 2026-02-17T21:25:35.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.088+0000 7f813203e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:35.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.088+0000 7f813203e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:35.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.088+0000 7f813203e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:35.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.088+0000 7f813183d640 10 monclient(hunting): get_auth_request con 0x7f812c0c48c0 auth_method 0 2026-02-17T21:25:35.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.088+0000 7f813183d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:35.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.088+0000 7f813183d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:35.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.088+0000 7f813183d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:35.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.088+0000 7f813203e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:35.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.088+0000 7f813203e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:35.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.088+0000 7f813203e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:35.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.088+0000 7f813183d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:35.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.088+0000 7f813183d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:35.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.088+0000 7f813183d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:35.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.089+0000 7f813203e640 10 monclient(hunting): handle_auth_done global_id 4411 payload 274 2026-02-17T21:25:35.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.089+0000 7f813203e640 1 -- 10.20.193.5:0/2501595597 >> v2:10.20.193.135:3300/0 conn(0x7f812c0c48c0 msgr2=0x7f812c0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:35.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.089+0000 7f813203e640 1 --2- 10.20.193.5:0/2501595597 >> v2:10.20.193.135:3300/0 conn(0x7f812c0c48c0 0x7f812c0749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.089+0000 7f813203e640 1 -- 10.20.193.5:0/2501595597 >> v1:10.20.193.5:6789/0 conn(0x7f812c074ef0 legacy=0x7f812c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:35.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.089+0000 7f813203e640 10 monclient: _finish_hunting 0 2026-02-17T21:25:35.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.089+0000 7f813203e640 1 monclient: found mon.noname-b 2026-02-17T21:25:35.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.089+0000 7f813203e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:35.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.089+0000 7f813203e640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:35.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.089+0000 7f813103c640 1 -- 10.20.193.5:0/2501595597 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1044328350 0 0) 0x7f812c15a9a0 con 0x7f812c074ef0 2026-02-17T21:25:35.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.089+0000 7f813203e640 1 -- 10.20.193.5:0/2501595597 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812c0c5550 con 0x7f812c0c7170 2026-02-17T21:25:35.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.089+0000 7f813103c640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-17T21:25:35.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.090+0000 7f813203e640 1 --2- 10.20.193.5:0/2501595597 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f812c0c7170 0x7f812c0c7550 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f812c0c7a90 tx=0x7f811c02ede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf499a9df5685d13 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:35.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.091+0000 7f813103c640 1 -- 10.20.193.5:0/2501595597 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811c03c070 con 0x7f812c0c7170 2026-02-17T21:25:35.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.091+0000 7f813103c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:35.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.091+0000 7f813103c640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:35.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.091+0000 7f813103c640 10 monclient: dump: 2026-02-17T21:25:35.103 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:35.103 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:35.103 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.104 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.104 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:35.104 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:35.104 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:35.104 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:35.104 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:35.104 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:35.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.091+0000 7f813103c640 10 monclient: _finish_auth 0 2026-02-17T21:25:35.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.091+0000 7f813103c640 10 monclient: _check_auth_tickets 2026-02-17T21:25:35.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.091+0000 7f813103c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:35.105 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.091+0000 7f81342c9640 5 monclient: authenticate success, global_id 4411 2026-02-17T21:25:35.105 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.091+0000 7f81342c9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:35.105 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.092+0000 7f813103c640 1 -- 10.20.193.5:0/2501595597 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f811c02faf0 con 0x7f812c0c7170 2026-02-17T21:25:35.105 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.092+0000 7f813103c640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:35.105 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.092+0000 7f813103c640 1 -- 10.20.193.5:0/2501595597 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811c037440 con 0x7f812c0c7170 2026-02-17T21:25:35.105 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.092+0000 7f813103c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:35.105 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.092+0000 7f813103c640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:35.105 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.092+0000 7f813103c640 10 monclient: dump: 2026-02-17T21:25:35.105 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:35.105 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:35.105 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.106 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.106 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:35.106 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:35.106 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:35.106 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:35.106 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:35.106 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:35.106 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.092+0000 7f81342c9640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:35.106 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.092+0000 7f81342c9640 4 set_mon_vals no callback set 2026-02-17T21:25:35.106 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.092+0000 7f81342c9640 10 monclient: shutdown 2026-02-17T21:25:35.106 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.092+0000 7f81342c9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:35.106 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.092+0000 7f81342c9640 1 -- 10.20.193.5:0/2501595597 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f812c0c7170 msgr2=0x7f812c0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:35.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.092+0000 7f81342c9640 1 --2- 10.20.193.5:0/2501595597 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f812c0c7170 0x7f812c0c7550 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f812c0c7a90 tx=0x7f811c02ede0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.092+0000 7f81342c9640 1 -- 10.20.193.5:0/2501595597 shutdown_connections 2026-02-17T21:25:35.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.092+0000 7f81342c9640 1 --2- 10.20.193.5:0/2501595597 >> v2:10.20.193.135:3300/0 conn(0x7f812c0c48c0 0x7f812c0749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.092+0000 7f81342c9640 1 --2- 10.20.193.5:0/2501595597 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f812c0c7170 0x7f812c0c7550 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.092+0000 7f81342c9640 1 -- 10.20.193.5:0/2501595597 >> 10.20.193.5:0/2501595597 conn(0x7f812c0c9f40 msgr2=0x7f812c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:35.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.092+0000 7f81342c9640 1 -- 10.20.193.5:0/2501595597 shutdown_connections 2026-02-17T21:25:35.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.092+0000 7f81342c9640 1 -- 10.20.193.5:0/2501595597 wait complete. 2026-02-17T21:25:35.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.093+0000 7f81342c9640 10 monclient: build_initial_monmap 2026-02-17T21:25:35.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.093+0000 7f81342c9640 10 monclient: monmap: 2026-02-17T21:25:35.107 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:35.107 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:35.107 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:35.108 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:35.108 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:35.108 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:35.108 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:35.108 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:35.108 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:35.108 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:35.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.093+0000 7f81342c9640 1 librados: starting msgr at 2026-02-17T21:25:35.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.093+0000 7f81342c9640 1 librados: starting objecter 2026-02-17T21:25:35.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.093+0000 7f81342c9640 1 Processor -- start 2026-02-17T21:25:35.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.093+0000 7f81342c9640 1 -- start start 2026-02-17T21:25:35.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.093+0000 7f81342c9640 1 librados: setting wanted keys 2026-02-17T21:25:35.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.093+0000 7f81342c9640 1 librados: calling monclient init 2026-02-17T21:25:35.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.093+0000 7f81342c9640 10 monclient: init 2026-02-17T21:25:35.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.093+0000 7f81342c9640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:35.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.093+0000 7f81342c9640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:25:35.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.093+0000 7f81342c9640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f812c074ef0 0x7f812c1543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:35.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.093+0000 7f81342c9640 10 monclient(hunting): picked mon.noname-b con 0x7f812c074ef0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:35.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.093+0000 7f81342c9640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f812c0c48c0 0x7f812c1f4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:35.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.093+0000 7f81342c9640 10 monclient(hunting): picked mon.noname-c con 0x7f812c0c48c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:35.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.093+0000 7f81342c9640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f812c0c7170 0x7f812c1f4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:35.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.093+0000 7f81342c9640 10 monclient(hunting): picked mon.noname-a con 0x7f812c0c7170 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:35.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.093+0000 7f81342c9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:35.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.093+0000 7f81342c9640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f812c0c81c0 con 0x7f812c0c7170 2026-02-17T21:25:35.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.093+0000 7f81342c9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:35.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.093+0000 7f81342c9640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f812c0c7ee0 con 0x7f812c074ef0 2026-02-17T21:25:35.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.093+0000 7f81342c9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:35.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.093+0000 7f81342c9640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f812c0c90d0 con 0x7f812c0c48c0 2026-02-17T21:25:35.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.093+0000 7f81342c9640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:35.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.093+0000 7f81342c9640 10 monclient(hunting): authenticate will time out at 1040.658795s 2026-02-17T21:25:35.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813203e640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f812c074ef0 0x7f812c1543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:35.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813283f640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f812c0c7170 0x7f812c1f4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:35.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813183d640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f812c0c48c0 0x7f812c1f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:35.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813203e640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f812c074ef0 0x7f812c1543c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:37608/0 (socket says 10.20.193.5:37608) 2026-02-17T21:25:35.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813203e640 1 -- 10.20.193.5:0/1157986675 learned_addr learned my addr 10.20.193.5:0/1157986675 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:35.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813203e640 10 monclient(hunting): get_auth_request con 0x7f812c074ef0 auth_method 0 2026-02-17T21:25:35.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813203e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:35.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813203e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:35.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813203e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:35.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813283f640 10 monclient(hunting): get_auth_request con 0x7f812c0c7170 auth_method 0 2026-02-17T21:25:35.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813283f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:35.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813283f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:35.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813283f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:35.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813183d640 10 monclient(hunting): get_auth_request con 0x7f812c0c48c0 auth_method 0 2026-02-17T21:25:35.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813183d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:35.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813183d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:35.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813183d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:35.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813183d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:35.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813183d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:35.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813183d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:35.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813283f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:35.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813283f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:35.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813283f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:35.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813203e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:35.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813203e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:35.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.094+0000 7f813203e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:35.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.096+0000 7f813203e640 10 monclient(hunting): handle_auth_done global_id 4414 payload 824 2026-02-17T21:25:35.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.096+0000 7f813203e640 1 -- 10.20.193.5:0/1157986675 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f812c0c48c0 msgr2=0x7f812c1f4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:35.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.096+0000 7f813203e640 1 --2- 10.20.193.5:0/1157986675 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f812c0c48c0 0x7f812c1f4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.096+0000 7f813203e640 1 -- 10.20.193.5:0/1157986675 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f812c0c7170 msgr2=0x7f812c1f4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:35.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.096+0000 7f813203e640 1 --2- 10.20.193.5:0/1157986675 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f812c0c7170 0x7f812c1f4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.096+0000 7f813203e640 10 monclient: _finish_hunting 0 2026-02-17T21:25:35.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.096+0000 7f813203e640 1 monclient: found mon.noname-b 2026-02-17T21:25:35.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.096+0000 7f813203e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:35.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.096+0000 7f813203e640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:35.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.096+0000 7f813203e640 1 -- 10.20.193.5:0/1157986675 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812c14d390 con 0x7f812c074ef0 2026-02-17T21:25:35.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.097+0000 7f813203e640 1 --2- 10.20.193.5:0/1157986675 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f812c074ef0 0x7f812c1543c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f811c009130 tx=0x7f811c0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:35.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.097+0000 7f8112ffd640 10 client.?.objecter ms_handle_connect 0x7f812c074ef0 2026-02-17T21:25:35.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.097+0000 7f8112ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:35.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.098+0000 7f8112ffd640 1 -- 10.20.193.5:0/1157986675 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811c03c040 con 0x7f812c074ef0 2026-02-17T21:25:35.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.098+0000 7f8112ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:35.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.098+0000 7f8112ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:35.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.098+0000 7f8112ffd640 10 monclient: dump: 2026-02-17T21:25:35.113 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:35.114 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:35.114 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.114 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.114 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:35.114 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:35.114 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:35.114 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:35.114 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:35.114 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:35.114 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.098+0000 7f8112ffd640 10 monclient: _finish_auth 0 2026-02-17T21:25:35.114 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.098+0000 7f8112ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:35.114 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.098+0000 7f8112ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:35.114 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.098+0000 7f8112ffd640 1 -- 10.20.193.5:0/1157986675 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f811c042610 con 0x7f812c074ef0 2026-02-17T21:25:35.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.098+0000 7f81342c9640 5 monclient: authenticate success, global_id 4414 2026-02-17T21:25:35.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.098+0000 7f81342c9640 10 monclient: _renew_subs 2026-02-17T21:25:35.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.098+0000 7f81342c9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:35.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.098+0000 7f81342c9640 1 -- 10.20.193.5:0/1157986675 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f812c156640 con 0x7f812c074ef0 2026-02-17T21:25:35.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.098+0000 7f8112ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:35.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.098+0000 7f8112ffd640 1 -- 10.20.193.5:0/1157986675 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811c0429e0 con 0x7f812c074ef0 2026-02-17T21:25:35.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.098+0000 7f8112ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:35.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.098+0000 7f8112ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:35.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.098+0000 7f813083b640 4 set_mon_vals no callback set 2026-02-17T21:25:35.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.098+0000 7f8112ffd640 10 monclient: dump: 2026-02-17T21:25:35.115 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:35.115 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:35.115 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.116 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.116 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:35.116 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:35.116 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:35.116 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:35.116 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:35.116 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:35.116 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.098+0000 7f81342c9640 10 client.4414.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:35.116 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.098+0000 7f81342c9640 10 monclient: _renew_subs 2026-02-17T21:25:35.116 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.098+0000 7f81342c9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:35.116 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.098+0000 7f81342c9640 1 -- 10.20.193.5:0/1157986675 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f812c156c00 con 0x7f812c074ef0 2026-02-17T21:25:35.116 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.098+0000 7f81342c9640 1 librados: init done 2026-02-17T21:25:35.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.099+0000 7f81342c9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:35.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.099+0000 7f81342c9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:35.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.099+0000 7f81342c9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:35.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.099+0000 7f81342c9640 1 -- 10.20.193.5:0/1157986675 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f812c0c4d10 con 0x7f812c074ef0 2026-02-17T21:25:35.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.111+0000 7f8112ffd640 1 -- 10.20.193.5:0/1157986675 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f811c04b450 con 0x7f812c074ef0 2026-02-17T21:25:35.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.111+0000 7f8112ffd640 1 --2- 10.20.193.5:0/1157986675 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f80fc0792b0 0x7f80fc07b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:35.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.111+0000 7f813183d640 1 --2- 10.20.193.5:0/1157986675 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f80fc0792b0 0x7f80fc07b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:35.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.111+0000 7f813183d640 10 monclient: get_auth_request con 0x7f80fc0792b0 auth_method 0 2026-02-17T21:25:35.119 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.112+0000 7f8112ffd640 10 client.4414.objecter ms_handle_connect 0x7f80fc0792b0 2026-02-17T21:25:35.119 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.112+0000 7f813183d640 1 --2- 10.20.193.5:0/1157986675 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f80fc0792b0 0x7f80fc07b770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f812c0caec0 tx=0x7f8120009290 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:35.119 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.114+0000 7f8112ffd640 1 -- 10.20.193.5:0/1157986675 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f811c02fa70 con 0x7f812c074ef0 2026-02-17T21:25:35.119 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.114+0000 7f8112ffd640 10 client.4414.objecter ms_dispatch2 0x7f812c000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:35.119 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.114+0000 7f8112ffd640 3 client.4414.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:35.119 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.114+0000 7f8112ffd640 3 client.4414.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:35.119 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.114+0000 7f8112ffd640 20 client.4414.objecter dump_active .. 0 homeless 2026-02-17T21:25:35.216 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.215+0000 7f8112ffd640 1 -- 10.20.193.5:0/1157986675 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f811c086d30 con 0x7f812c074ef0 2026-02-17T21:25:35.217 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.215+0000 7f8112ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:35.217 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.215+0000 7f8112ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:35.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.321+0000 7f81342c9640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2026-02-17T21:25:35.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.321+0000 7f81342c9640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-17T21:25:35.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.321+0000 7f81342c9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:35.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.321+0000 7f81342c9640 1 -- 10.20.193.5:0/1157986675 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f812c0c8d40 con 0x7f812c074ef0 2026-02-17T21:25:35.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.393+0000 7f8112ffd640 1 -- 10.20.193.5:0/1157986675 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v7) ==== 74+0+192458 (secure 0 0 0) 0x7f811c08b030 con 0x7f812c074ef0 2026-02-17T21:25:35.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.393+0000 7f8112ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-17T21:25:35.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.393+0000 7f8112ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:35.399 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:25:35.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.396+0000 7f81342c9640 10 librados: watch_flush enter 2026-02-17T21:25:35.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.396+0000 7f81342c9640 10 librados: watch_flush exit 2026-02-17T21:25:35.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.396+0000 7f81342c9640 20 client.4414.objecter shutdown clearing up homeless session... 2026-02-17T21:25:35.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.396+0000 7f81342c9640 10 client.4414.objecter successfully canceled tick 2026-02-17T21:25:35.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.396+0000 7f81342c9640 1 -- 10.20.193.5:0/1157986675 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f80fc0792b0 msgr2=0x7f80fc07b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:35.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.396+0000 7f81342c9640 1 --2- 10.20.193.5:0/1157986675 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f80fc0792b0 0x7f80fc07b770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f812c0caec0 tx=0x7f8120009290 comp rx=0 tx=0).stop 2026-02-17T21:25:35.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.396+0000 7f81342c9640 10 monclient: shutdown 2026-02-17T21:25:35.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.396+0000 7f81342c9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:35.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.396+0000 7f81342c9640 1 -- 10.20.193.5:0/1157986675 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f812c074ef0 msgr2=0x7f812c1543c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:35.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.396+0000 7f81342c9640 1 --2- 10.20.193.5:0/1157986675 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f812c074ef0 0x7f812c1543c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f811c009130 tx=0x7f811c0047c0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.396+0000 7f81342c9640 1 -- 10.20.193.5:0/1157986675 shutdown_connections 2026-02-17T21:25:35.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.396+0000 7f81342c9640 1 --2- 10.20.193.5:0/1157986675 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f80fc0792b0 0x7f80fc07b770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.396+0000 7f81342c9640 1 --2- 10.20.193.5:0/1157986675 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f812c0c7170 0x7f812c1f4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.396+0000 7f81342c9640 1 --2- 10.20.193.5:0/1157986675 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f812c0c48c0 0x7f812c1f4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.396+0000 7f81342c9640 1 --2- 10.20.193.5:0/1157986675 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f812c074ef0 0x7f812c1543c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.396+0000 7f81342c9640 1 -- 10.20.193.5:0/1157986675 >> 10.20.193.5:0/1157986675 conn(0x7f812c0c9f40 msgr2=0x7f812c14f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:35.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.396+0000 7f81342c9640 1 -- 10.20.193.5:0/1157986675 shutdown_connections 2026-02-17T21:25:35.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.396+0000 7f81342c9640 1 -- 10.20.193.5:0/1157986675 wait complete. 2026-02-17T21:25:35.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.396+0000 7f81342c9640 1 librados: shutdown 2026-02-17T21:25:35.406 INFO:teuthology.orchestra.run.trial005.stdout:{"epoch":7,"flags":0,"active_gid":4131,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6800","nonce":2898618020},{"type":"v1","addr":"10.20.193.176:6801","nonce":2898618020}]},"active_addr":"10.20.193.176:6801/2898618020","active_change":"2026-02-17T21:23:43.349403+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4114,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":15,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.176:0","nonce":1962698601}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.176:0","nonce":2272995369}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.176:0","nonce":3805521384}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.176:0","nonce":296160988}]}]} 2026-02-17T21:25:35.413 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-17T21:25:35.413 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-17T21:25:35.414 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T21:25:35.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.511+0000 7fec36f14640 10 monclient: get_monmap_and_config 2026-02-17T21:25:35.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.511+0000 7fec36f14640 10 monclient: build_initial_monmap 2026-02-17T21:25:35.514 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.511+0000 7fec36f14640 10 monclient: monmap: 2026-02-17T21:25:35.514 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:35.514 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:35.514 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:35.512638+0000 2026-02-17T21:25:35.514 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:35.512638+0000 2026-02-17T21:25:35.514 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:35.514 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:35.514 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:35.514 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:35.514 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:35.515 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:35.515 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:35.515 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:35.515 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:35.515 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.512+0000 7fec36f14640 1 Processor -- start 2026-02-17T21:25:35.515 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.512+0000 7fec36f14640 1 -- start start 2026-02-17T21:25:35.515 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.512+0000 7fec36f14640 10 monclient: init 2026-02-17T21:25:35.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.512+0000 7fec36f14640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:35.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.512+0000 7fec36f14640 10 monclient: _add_conns ranks=[3,5,0,1,2,4] 2026-02-17T21:25:35.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.512+0000 7fec36f14640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fec3015d370 0x7fec3015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:35.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.512+0000 7fec36f14640 10 monclient(hunting): picked mon.noname-a con 0x7fec3015d370 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:35.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.512+0000 7fec36f14640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fec300c7e20 0x7fec300c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:35.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.512+0000 7fec36f14640 10 monclient(hunting): picked mon.noname-c con 0x7fec300c7e20 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:35.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.512+0000 7fec36f14640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fec3015b000 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:35.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.512+0000 7fec36f14640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec300c8350 con 0x7fec3015b000 2026-02-17T21:25:35.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.512+0000 7fec36f14640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:35.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.512+0000 7fec36f14640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fec300c9240 con 0x7fec3015d370 2026-02-17T21:25:35.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.512+0000 7fec36f14640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:35.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.512+0000 7fec36f14640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fec300c8630 con 0x7fec300c7e20 2026-02-17T21:25:35.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.512+0000 7fec36f14640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:35.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.512+0000 7fec36f14640 10 monclient(hunting): authenticate will time out at 1041.077930s 2026-02-17T21:25:35.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.513+0000 7fec34c89640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fec3015d370 0x7fec3015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:35.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.513+0000 7fec34c89640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fec3015d370 0x7fec3015d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:49958/0 (socket says 10.20.193.5:49958) 2026-02-17T21:25:35.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.513+0000 7fec34c89640 1 -- 10.20.193.5:0/3410130054 learned_addr learned my addr 10.20.193.5:0/3410130054 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:35.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.513+0000 7fec34c89640 10 monclient(hunting): get_auth_request con 0x7fec3015d370 auth_method 0 2026-02-17T21:25:35.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.513+0000 7fec34c89640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:35.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.513+0000 7fec34c89640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:35.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.513+0000 7fec34c89640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:35.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.514+0000 7fec27fff640 1 --2- 10.20.193.5:0/3410130054 >> v2:10.20.193.135:3300/0 conn(0x7fec300c7e20 0x7fec300c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:35.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.514+0000 7fec34c89640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:35.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.514+0000 7fec34c89640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:35.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.514+0000 7fec34c89640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:35.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.514+0000 7fec27fff640 10 monclient(hunting): get_auth_request con 0x7fec300c7e20 auth_method 0 2026-02-17T21:25:35.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.514+0000 7fec27fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:35.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.514+0000 7fec27fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:35.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.514+0000 7fec27fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:35.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.514+0000 7fec27fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:35.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.514+0000 7fec27fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:35.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.514+0000 7fec27fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:35.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.515+0000 7fec34c89640 10 monclient(hunting): handle_auth_done global_id 4383 payload 274 2026-02-17T21:25:35.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.515+0000 7fec34c89640 1 -- 10.20.193.5:0/3410130054 >> v2:10.20.193.135:3300/0 conn(0x7fec300c7e20 msgr2=0x7fec300c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:35.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.515+0000 7fec34c89640 1 --2- 10.20.193.5:0/3410130054 >> v2:10.20.193.135:3300/0 conn(0x7fec300c7e20 0x7fec300c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.515+0000 7fec34c89640 1 -- 10.20.193.5:0/3410130054 >> v1:10.20.193.5:6789/0 conn(0x7fec3015b000 legacy=0x7fec300c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:35.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.515+0000 7fec34c89640 10 monclient: _finish_hunting 0 2026-02-17T21:25:35.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.515+0000 7fec34c89640 1 monclient: found mon.noname-a 2026-02-17T21:25:35.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.515+0000 7fec34c89640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:35.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.515+0000 7fec34c89640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:35.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.515+0000 7fec34c89640 1 -- 10.20.193.5:0/3410130054 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec300c8910 con 0x7fec3015d370 2026-02-17T21:25:35.522 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.518+0000 7fec34c89640 1 --2- 10.20.193.5:0/3410130054 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fec3015d370 0x7fec3015d750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fec3015d060 tx=0x7fec2002eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24eb19c6fa26f1b1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:35.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.527+0000 7fec277fe640 1 -- 10.20.193.5:0/3410130054 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2003c070 con 0x7fec3015d370 2026-02-17T21:25:35.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.527+0000 7fec277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:35.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.527+0000 7fec277fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:35.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.527+0000 7fec277fe640 10 monclient: dump: 2026-02-17T21:25:35.529 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:35.529 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:35.529 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.529 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.529 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:35.529 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:35.529 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:35.530 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:35.530 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:35.530 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:35.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.527+0000 7fec277fe640 10 monclient: _finish_auth 0 2026-02-17T21:25:35.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.527+0000 7fec277fe640 10 monclient: _check_auth_tickets 2026-02-17T21:25:35.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.527+0000 7fec277fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:35.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.527+0000 7fec36f14640 5 monclient: authenticate success, global_id 4383 2026-02-17T21:25:35.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.527+0000 7fec36f14640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:35.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.528+0000 7fec277fe640 1 -- 10.20.193.5:0/3410130054 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec2002fbe0 con 0x7fec3015d370 2026-02-17T21:25:35.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.528+0000 7fec277fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:35.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.528+0000 7fec277fe640 1 -- 10.20.193.5:0/3410130054 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec20037440 con 0x7fec3015d370 2026-02-17T21:25:35.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.528+0000 7fec36f14640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:35.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.528+0000 7fec277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:35.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.528+0000 7fec36f14640 4 set_mon_vals no callback set 2026-02-17T21:25:35.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.528+0000 7fec277fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:35.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.528+0000 7fec277fe640 10 monclient: dump: 2026-02-17T21:25:35.537 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:35.537 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:35.537 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.537 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.537 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:35.537 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:35.537 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:35.538 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:35.538 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:35.538 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:35.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.528+0000 7fec36f14640 10 monclient: shutdown 2026-02-17T21:25:35.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.528+0000 7fec36f14640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:35.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.528+0000 7fec36f14640 1 -- 10.20.193.5:0/3410130054 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fec3015d370 msgr2=0x7fec3015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:35.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.528+0000 7fec36f14640 1 --2- 10.20.193.5:0/3410130054 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fec3015d370 0x7fec3015d750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fec3015d060 tx=0x7fec2002eed0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.528+0000 7fec36f14640 1 -- 10.20.193.5:0/3410130054 shutdown_connections 2026-02-17T21:25:35.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.528+0000 7fec36f14640 1 --2- 10.20.193.5:0/3410130054 >> v2:10.20.193.135:3300/0 conn(0x7fec300c7e20 0x7fec300c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.528+0000 7fec36f14640 1 --2- 10.20.193.5:0/3410130054 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fec3015d370 0x7fec3015d750 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.528+0000 7fec36f14640 1 -- 10.20.193.5:0/3410130054 >> 10.20.193.5:0/3410130054 conn(0x7fec300c9f20 msgr2=0x7fec300ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:35.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.528+0000 7fec36f14640 1 -- 10.20.193.5:0/3410130054 shutdown_connections 2026-02-17T21:25:35.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.528+0000 7fec36f14640 1 -- 10.20.193.5:0/3410130054 wait complete. 2026-02-17T21:25:35.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.528+0000 7fec36f14640 10 monclient: build_initial_monmap 2026-02-17T21:25:35.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.528+0000 7fec36f14640 10 monclient: monmap: 2026-02-17T21:25:35.539 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:35.539 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:35.539 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:35.539 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:35.539 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:35.539 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:35.539 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:35.539 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:35.539 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:35.539 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:35.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.528+0000 7fec36f14640 1 librados: starting msgr at 2026-02-17T21:25:35.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.528+0000 7fec36f14640 1 librados: starting objecter 2026-02-17T21:25:35.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.529+0000 7fec36f14640 1 Processor -- start 2026-02-17T21:25:35.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.529+0000 7fec36f14640 1 -- start start 2026-02-17T21:25:35.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.529+0000 7fec36f14640 1 librados: setting wanted keys 2026-02-17T21:25:35.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.529+0000 7fec36f14640 1 librados: calling monclient init 2026-02-17T21:25:35.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.529+0000 7fec36f14640 10 monclient: init 2026-02-17T21:25:35.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.529+0000 7fec36f14640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:35.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.529+0000 7fec36f14640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:25:35.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.529+0000 7fec36f14640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fec300c7e20 0x7fec301f6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:35.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.529+0000 7fec36f14640 10 monclient(hunting): picked mon.noname-b con 0x7fec300c7e20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:35.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.529+0000 7fec36f14640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fec3015b000 0x7fec300cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:35.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.529+0000 7fec36f14640 10 monclient(hunting): picked mon.noname-c con 0x7fec3015b000 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:35.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.529+0000 7fec36f14640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fec3015d370 0x7fec300cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:35.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.529+0000 7fec36f14640 10 monclient(hunting): picked mon.noname-a con 0x7fec3015d370 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:35.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.529+0000 7fec36f14640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:35.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.529+0000 7fec36f14640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fec300c96d0 con 0x7fec3015d370 2026-02-17T21:25:35.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.529+0000 7fec36f14640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:35.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.529+0000 7fec36f14640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fec300c8ed0 con 0x7fec300c7e20 2026-02-17T21:25:35.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.529+0000 7fec36f14640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:35.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.529+0000 7fec36f14640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fec3015a8d0 con 0x7fec3015b000 2026-02-17T21:25:35.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.529+0000 7fec36f14640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:35.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.529+0000 7fec36f14640 10 monclient(hunting): authenticate will time out at 1041.094493s 2026-02-17T21:25:35.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.529+0000 7fec3548a640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fec3015d370 0x7fec300cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:35.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.529+0000 7fec27fff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fec3015b000 0x7fec300cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:35.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.529+0000 7fec34c89640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fec300c7e20 0x7fec301f6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:35.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.530+0000 7fec3548a640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fec3015d370 0x7fec300cc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:49974/0 (socket says 10.20.193.5:49974) 2026-02-17T21:25:35.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.530+0000 7fec3548a640 1 -- 10.20.193.5:0/4011451178 learned_addr learned my addr 10.20.193.5:0/4011451178 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:35.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.530+0000 7fec3548a640 10 monclient(hunting): get_auth_request con 0x7fec3015d370 auth_method 0 2026-02-17T21:25:35.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.530+0000 7fec3548a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:35.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.530+0000 7fec3548a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:35.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.530+0000 7fec3548a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:35.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.530+0000 7fec27fff640 10 monclient(hunting): get_auth_request con 0x7fec3015b000 auth_method 0 2026-02-17T21:25:35.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.530+0000 7fec27fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:35.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.530+0000 7fec27fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:35.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.530+0000 7fec27fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:35.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.530+0000 7fec34c89640 10 monclient(hunting): get_auth_request con 0x7fec300c7e20 auth_method 0 2026-02-17T21:25:35.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.530+0000 7fec34c89640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:35.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.530+0000 7fec34c89640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:35.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.530+0000 7fec34c89640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:35.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.530+0000 7fec3548a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:35.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.530+0000 7fec3548a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:35.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.530+0000 7fec3548a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:35.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.530+0000 7fec27fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:35.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.530+0000 7fec27fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:35.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.530+0000 7fec27fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:35.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.530+0000 7fec34c89640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:35.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.530+0000 7fec34c89640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:35.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.530+0000 7fec34c89640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:35.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.531+0000 7fec27fff640 10 monclient(hunting): handle_auth_done global_id 4418 payload 824 2026-02-17T21:25:35.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.531+0000 7fec27fff640 1 -- 10.20.193.5:0/4011451178 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fec300c7e20 msgr2=0x7fec301f6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:35.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.531+0000 7fec27fff640 1 --2- 10.20.193.5:0/4011451178 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fec300c7e20 0x7fec301f6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.531+0000 7fec27fff640 1 -- 10.20.193.5:0/4011451178 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fec3015d370 msgr2=0x7fec300cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:35.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.531+0000 7fec27fff640 1 --2- 10.20.193.5:0/4011451178 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fec3015d370 0x7fec300cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.531+0000 7fec27fff640 10 monclient: _finish_hunting 0 2026-02-17T21:25:35.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.531+0000 7fec27fff640 1 monclient: found mon.noname-c 2026-02-17T21:25:35.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.531+0000 7fec27fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:35.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.531+0000 7fec27fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:35.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.531+0000 7fec27fff640 1 -- 10.20.193.5:0/4011451178 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec3015a5f0 con 0x7fec3015b000 2026-02-17T21:25:35.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.532+0000 7fec27fff640 1 --2- 10.20.193.5:0/4011451178 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fec3015b000 0x7fec300cc100 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fec1800e9e0 tx=0x7fec1800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:35.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.532+0000 7fec257fa640 10 client.?.objecter ms_handle_connect 0x7fec3015b000 2026-02-17T21:25:35.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.532+0000 7fec257fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:35.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.533+0000 7fec257fa640 1 -- 10.20.193.5:0/4011451178 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec18017070 con 0x7fec3015b000 2026-02-17T21:25:35.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.533+0000 7fec257fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:35.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.533+0000 7fec257fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:35.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.533+0000 7fec257fa640 10 monclient: dump: 2026-02-17T21:25:35.545 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:35.545 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:35.545 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.545 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.545 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:35.545 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:35.545 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:35.545 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:35.545 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:35.545 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:35.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.533+0000 7fec257fa640 10 monclient: _finish_auth 0 2026-02-17T21:25:35.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.533+0000 7fec257fa640 10 monclient: _check_auth_tickets 2026-02-17T21:25:35.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.533+0000 7fec257fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:35.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.533+0000 7fec36f14640 5 monclient: authenticate success, global_id 4418 2026-02-17T21:25:35.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.533+0000 7fec36f14640 10 monclient: _renew_subs 2026-02-17T21:25:35.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.533+0000 7fec36f14640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:35.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.533+0000 7fec36f14640 1 -- 10.20.193.5:0/4011451178 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec300cb340 con 0x7fec3015b000 2026-02-17T21:25:35.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.533+0000 7fec36f14640 10 client.4418.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:35.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.533+0000 7fec36f14640 10 monclient: _renew_subs 2026-02-17T21:25:35.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.533+0000 7fec36f14640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:35.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.533+0000 7fec36f14640 1 -- 10.20.193.5:0/4011451178 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec300cb900 con 0x7fec3015b000 2026-02-17T21:25:35.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.533+0000 7fec36f14640 1 librados: init done 2026-02-17T21:25:35.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.534+0000 7fec36f14640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:35.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.534+0000 7fec36f14640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:35.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.534+0000 7fec36f14640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:35.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.534+0000 7fec36f14640 1 -- 10.20.193.5:0/4011451178 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec3015b490 con 0x7fec3015b000 2026-02-17T21:25:35.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.534+0000 7fec257fa640 1 -- 10.20.193.5:0/4011451178 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec18005a90 con 0x7fec3015b000 2026-02-17T21:25:35.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.534+0000 7fec257fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:35.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.534+0000 7fec257fa640 1 -- 10.20.193.5:0/4011451178 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec18021060 con 0x7fec3015b000 2026-02-17T21:25:35.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.534+0000 7fec257fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:35.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.534+0000 7fec257fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:35.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.534+0000 7fec257fa640 10 monclient: dump: 2026-02-17T21:25:35.547 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:35.547 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:35.547 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.547 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.547 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:35.548 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:35.548 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:35.548 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:35.548 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:35.548 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:35.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.534+0000 7fec26ffd640 4 set_mon_vals no callback set 2026-02-17T21:25:35.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.642+0000 7fec257fa640 1 -- 10.20.193.5:0/4011451178 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fec1800ca00 con 0x7fec3015b000 2026-02-17T21:25:35.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.642+0000 7fec257fa640 1 --2- 10.20.193.5:0/4011451178 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fec00079280 0x7fec0007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:35.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.642+0000 7fec34c89640 1 --2- 10.20.193.5:0/4011451178 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fec00079280 0x7fec0007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:35.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.643+0000 7fec34c89640 10 monclient: get_auth_request con 0x7fec00079280 auth_method 0 2026-02-17T21:25:35.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.643+0000 7fec34c89640 1 --2- 10.20.193.5:0/4011451178 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fec00079280 0x7fec0007b740 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fec3015dcf0 tx=0x7fec20039040 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:35.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.643+0000 7fec257fa640 10 client.4418.objecter ms_handle_connect 0x7fec00079280 2026-02-17T21:25:35.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.644+0000 7fec257fa640 1 -- 10.20.193.5:0/4011451178 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fec1800cd20 con 0x7fec3015b000 2026-02-17T21:25:35.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.644+0000 7fec257fa640 10 client.4418.objecter ms_dispatch2 0x7fec30000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:35.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.644+0000 7fec257fa640 3 client.4418.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:35.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.644+0000 7fec257fa640 3 client.4418.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:35.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.644+0000 7fec257fa640 20 client.4418.objecter dump_active .. 0 homeless 2026-02-17T21:25:35.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.652+0000 7fec257fa640 1 -- 10.20.193.5:0/4011451178 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fec18062730 con 0x7fec3015b000 2026-02-17T21:25:35.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.652+0000 7fec257fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:35.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.652+0000 7fec257fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:35.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.734+0000 7fec36f14640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:25:35.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.734+0000 7fec36f14640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:25:35.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.734+0000 7fec36f14640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:35.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.734+0000 7fec36f14640 1 -- 10.20.193.5:0/4011451178 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec30070000 con 0x7fec3015b000 2026-02-17T21:25:35.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.765+0000 7fec257fa640 1 -- 10.20.193.5:0/4011451178 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+24719 (secure 0 0 0) 0x7fec18066a30 con 0x7fec3015b000 2026-02-17T21:25:35.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.765+0000 7fec257fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:25:35.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.765+0000 7fec257fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:35.768 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:25:35.768 INFO:teuthology.orchestra.run.trial005.stdout:{"epoch":34,"fsid":"b1be373b-56c5-4b5b-a965-9bcc20042691","created":"2026-02-17T21:23:38.622021+0000","modified":"2026-02-17T21:25:33.947844+0000","last_up_change":"2026-02-17T21:25:25.434771+0000","last_in_change":"2026-02-17T21:23:44.366223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T21:25:19.677742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T21:25:30.292349+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":34,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.0199999809265137,"score_stable":4.0199999809265137,"optimal_score":0.56000000238418579,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8bffc5e9-1f92-4603-bf29-ce19225edc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6808","nonce":3662168592},{"type":"v1","addr":"10.20.193.5:6809","nonce":3662168592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6810","nonce":3662168592},{"type":"v1","addr":"10.20.193.5:6811","nonce":3662168592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6814","nonce":3662168592},{"type":"v1","addr":"10.20.193.5:6815","nonce":3662168592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6812","nonce":3662168592},{"type":"v1","addr":"10.20.193.5:6813","nonce":3662168592}]},"public_addr":"10.20.193.5:6809/3662168592","cluster_addr":"10.20.193.5:6811/3662168592","heartbeat_back_addr":"10.20.193.5:6815/3662168592","heartbeat_front_addr":"10.20.193.5:6813/3662168592","state":["exists","up"]},{"osd":1,"uuid":"8ffdf919-2ec4-4c1f-a69f-aee5cea211e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6800","nonce":267553149},{"type":"v1","addr":"10.20.193.119:6801","nonce":267553149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6802","nonce":267553149},{"type":"v1","addr":"10.20.193.119:6803","nonce":267553149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6806","nonce":267553149},{"type":"v1","addr":"10.20.193.119:6807","nonce":267553149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6804","nonce":267553149},{"type":"v1","addr":"10.20.193.119:6805","nonce":267553149}]},"public_addr":"10.20.193.119:6801/267553149","cluster_addr":"10.20.193.119:6803/267553149","heartbeat_back_addr":"10.20.193.119:6807/267553149","heartbeat_front_addr":"10.20.193.119:6805/267553149","state":["exists","up"]},{"osd":2,"uuid":"d186244a-4bf7-416d-b6a0-0e0f5af50eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6824","nonce":692096764},{"type":"v1","addr":"10.20.193.135:6825","nonce":692096764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6826","nonce":692096764},{"type":"v1","addr":"10.20.193.135:6827","nonce":692096764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6830","nonce":692096764},{"type":"v1","addr":"10.20.193.135:6831","nonce":692096764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6828","nonce":692096764},{"type":"v1","addr":"10.20.193.135:6829","nonce":692096764}]},"public_addr":"10.20.193.135:6825/692096764","cluster_addr":"10.20.193.135:6827/692096764","heartbeat_back_addr":"10.20.193.135:6831/692096764","heartbeat_front_addr":"10.20.193.135:6829/692096764","state":["exists","up"]},{"osd":3,"uuid":"093b417e-53bf-4b60-a937-7c5ffee43e1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6818","nonce":1862950168},{"type":"v1","addr":"10.20.193.176:6819","nonce":1862950168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6820","nonce":1862950168},{"type":"v1","addr":"10.20.193.176:6821","nonce":1862950168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6824","nonce":1862950168},{"type":"v1","addr":"10.20.193.176:6825","nonce":1862950168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6822","nonce":1862950168},{"type":"v1","addr":"10.20.193.176:6823","nonce":1862950168}]},"public_addr":"10.20.193.176:6819/1862950168","cluster_addr":"10.20.193.176:6821/1862950168","heartbeat_back_addr":"10.20.193.176:6825/1862950168","heartbeat_front_addr":"10.20.193.176:6823/1862950168","state":["exists","up"]},{"osd":4,"uuid":"0a48e684-05b0-41b1-a553-022424011225","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6800","nonce":234574736},{"type":"v1","addr":"10.20.193.5:6801","nonce":234574736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6802","nonce":234574736},{"type":"v1","addr":"10.20.193.5:6803","nonce":234574736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6806","nonce":234574736},{"type":"v1","addr":"10.20.193.5:6807","nonce":234574736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6804","nonce":234574736},{"type":"v1","addr":"10.20.193.5:6805","nonce":234574736}]},"public_addr":"10.20.193.5:6801/234574736","cluster_addr":"10.20.193.5:6803/234574736","heartbeat_back_addr":"10.20.193.5:6807/234574736","heartbeat_front_addr":"10.20.193.5:6805/234574736","state":["exists","up"]},{"osd":5,"uuid":"d73b7c38-cef9-4993-b353-908c1d87603c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6818","nonce":4010664603},{"type":"v1","addr":"10.20.193.119:6820","nonce":4010664603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6824","nonce":4010664603},{"type":"v1","addr":"10.20.193.119:6825","nonce":4010664603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6830","nonce":4010664603},{"type":"v1","addr":"10.20.193.119:6831","nonce":4010664603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6828","nonce":4010664603},{"type":"v1","addr":"10.20.193.119:6829","nonce":4010664603}]},"public_addr":"10.20.193.119:6820/4010664603","cluster_addr":"10.20.193.119:6825/4010664603","heartbeat_back_addr":"10.20.193.119:6831/4010664603","heartbeat_front_addr":"10.20.193.119:6829/4010664603","state":["exists","up"]},{"osd":6,"uuid":"f7774c25-72e8-41b2-8634-517af7a213b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6808","nonce":1853988335},{"type":"v1","addr":"10.20.193.135:6809","nonce":1853988335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6810","nonce":1853988335},{"type":"v1","addr":"10.20.193.135:6811","nonce":1853988335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6814","nonce":1853988335},{"type":"v1","addr":"10.20.193.135:6815","nonce":1853988335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6812","nonce":1853988335},{"type":"v1","addr":"10.20.193.135:6813","nonce":1853988335}]},"public_addr":"10.20.193.135:6809/1853988335","cluster_addr":"10.20.193.135:6811/1853988335","heartbeat_back_addr":"10.20.193.135:6815/1853988335","heartbeat_front_addr":"10.20.193.135:6813/1853988335","state":["exists","up"]},{"osd":7,"uuid":"30a68802-afce-499b-90ce-bd568bc69406","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6826","nonce":1604873931},{"type":"v1","addr":"10.20.193.176:6827","nonce":1604873931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6828","nonce":1604873931},{"type":"v1","addr":"10.20.193.176:6829","nonce":1604873931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6832","nonce":1604873931},{"type":"v1","addr":"10.20.193.176:6833","nonce":1604873931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6830","nonce":1604873931},{"type":"v1","addr":"10.20.193.176:6831","nonce":1604873931}]},"public_addr":"10.20.193.176:6827/1604873931","cluster_addr":"10.20.193.176:6829/1604873931","heartbeat_back_addr":"10.20.193.176:6833/1604873931","heartbeat_front_addr":"10.20.193.176:6831/1604873931","state":["exists","up"]},{"osd":8,"uuid":"8b4a2001-3ac8-4756-9dcf-af38c6d12d44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6816","nonce":1609723815},{"type":"v1","addr":"10.20.193.5:6817","nonce":1609723815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6820","nonce":1609723815},{"type":"v1","addr":"10.20.193.5:6821","nonce":1609723815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6826","nonce":1609723815},{"type":"v1","addr":"10.20.193.5:6828","nonce":1609723815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6822","nonce":1609723815},{"type":"v1","addr":"10.20.193.5:6824","nonce":1609723815}]},"public_addr":"10.20.193.5:6817/1609723815","cluster_addr":"10.20.193.5:6821/1609723815","heartbeat_back_addr":"10.20.193.5:6828/1609723815","heartbeat_front_addr":"10.20.193.5:6824/1609723815","state":["exists","up"]},{"osd":9,"uuid":"dfdfee67-eff6-4413-bd7a-adc0a019bfbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6816","nonce":576833933},{"type":"v1","addr":"10.20.193.119:6817","nonce":576833933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6819","nonce":576833933},{"type":"v1","addr":"10.20.193.119:6821","nonce":576833933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6826","nonce":576833933},{"type":"v1","addr":"10.20.193.119:6827","nonce":576833933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6822","nonce":576833933},{"type":"v1","addr":"10.20.193.119:6823","nonce":576833933}]},"public_addr":"10.20.193.119:6817/576833933","cluster_addr":"10.20.193.119:6821/576833933","heartbeat_back_addr":"10.20.193.119:6827/576833933","heartbeat_front_addr":"10.20.193.119:6823/576833933","state":["exists","up"]},{"osd":10,"uuid":"fc24ee77-5a0d-41d4-88f5-8d03a77c7608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6800","nonce":3469915965},{"type":"v1","addr":"10.20.193.135:6801","nonce":3469915965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6802","nonce":3469915965},{"type":"v1","addr":"10.20.193.135:6803","nonce":3469915965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6806","nonce":3469915965},{"type":"v1","addr":"10.20.193.135:6807","nonce":3469915965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6804","nonce":3469915965},{"type":"v1","addr":"10.20.193.135:6805","nonce":3469915965}]},"public_addr":"10.20.193.135:6801/3469915965","cluster_addr":"10.20.193.135:6803/3469915965","heartbeat_back_addr":"10.20.193.135:6807/3469915965","heartbeat_front_addr":"10.20.193.135:6805/3469915965","state":["exists","up"]},{"osd":11,"uuid":"1d737681-1923-453a-82f8-516eeb875559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6802","nonce":3067818664},{"type":"v1","addr":"10.20.193.176:6803","nonce":3067818664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6804","nonce":3067818664},{"type":"v1","addr":"10.20.193.176:6805","nonce":3067818664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6808","nonce":3067818664},{"type":"v1","addr":"10.20.193.176:6809","nonce":3067818664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6806","nonce":3067818664},{"type":"v1","addr":"10.20.193.176:6807","nonce":3067818664}]},"public_addr":"10.20.193.176:6803/3067818664","cluster_addr":"10.20.193.176:6805/3067818664","heartbeat_back_addr":"10.20.193.176:6809/3067818664","heartbeat_front_addr":"10.20.193.176:6807/3067818664","state":["exists","up"]},{"osd":12,"uuid":"c4f0322e-a862-4c5e-967e-4551087ede8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6818","nonce":2028057944},{"type":"v1","addr":"10.20.193.5:6819","nonce":2028057944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6823","nonce":2028057944},{"type":"v1","addr":"10.20.193.5:6825","nonce":2028057944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6830","nonce":2028057944},{"type":"v1","addr":"10.20.193.5:6831","nonce":2028057944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6827","nonce":2028057944},{"type":"v1","addr":"10.20.193.5:6829","nonce":2028057944}]},"public_addr":"10.20.193.5:6819/2028057944","cluster_addr":"10.20.193.5:6825/2028057944","heartbeat_back_addr":"10.20.193.5:6831/2028057944","heartbeat_front_addr":"10.20.193.5:6829/2028057944","state":["exists","up"]},{"osd":13,"uuid":"0b5e9861-a194-4f11-a849-d8bb94ce95a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6808","nonce":1303925174},{"type":"v1","addr":"10.20.193.119:6809","nonce":1303925174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6810","nonce":1303925174},{"type":"v1","addr":"10.20.193.119:6811","nonce":1303925174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6814","nonce":1303925174},{"type":"v1","addr":"10.20.193.119:6815","nonce":1303925174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6812","nonce":1303925174},{"type":"v1","addr":"10.20.193.119:6813","nonce":1303925174}]},"public_addr":"10.20.193.119:6809/1303925174","cluster_addr":"10.20.193.119:6811/1303925174","heartbeat_back_addr":"10.20.193.119:6815/1303925174","heartbeat_front_addr":"10.20.193.119:6813/1303925174","state":["exists","up"]},{"osd":14,"uuid":"6f182077-0c0d-481c-97b4-43ef48aa5aea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6816","nonce":1552304264},{"type":"v1","addr":"10.20.193.135:6817","nonce":1552304264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6818","nonce":1552304264},{"type":"v1","addr":"10.20.193.135:6819","nonce":1552304264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6822","nonce":1552304264},{"type":"v1","addr":"10.20.193.135:6823","nonce":1552304264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6820","nonce":1552304264},{"type":"v1","addr":"10.20.193.135:6821","nonce":1552304264}]},"public_addr":"10.20.193.135:6817/1552304264","cluster_addr":"10.20.193.135:6819/1552304264","heartbeat_back_addr":"10.20.193.135:6823/1552304264","heartbeat_front_addr":"10.20.193.135:6821/1552304264","state":["exists","up"]},{"osd":15,"uuid":"537605ff-bedd-4f2b-922f-e2eaa8c17f48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6810","nonce":1976318959},{"type":"v1","addr":"10.20.193.176:6811","nonce":1976318959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6812","nonce":1976318959},{"type":"v1","addr":"10.20.193.176:6813","nonce":1976318959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6816","nonce":1976318959},{"type":"v1","addr":"10.20.193.176:6817","nonce":1976318959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6814","nonce":1976318959},{"type":"v1","addr":"10.20.193.176:6815","nonce":1976318959}]},"public_addr":"10.20.193.176:6811/1976318959","cluster_addr":"10.20.193.176:6813/1976318959","heartbeat_back_addr":"10.20.193.176:6817/1976318959","heartbeat_front_addr":"10.20.193.176:6815/1976318959","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.964722+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:16.831330+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:19.360415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.257999+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:19.239391+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:16.741791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.466814+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.473911+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:19.537915+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:17.261755+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:19.188280+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.075749+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:19.610371+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:16.923597+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:19.117422+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.626513+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:25:35.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.766+0000 7fec36f14640 10 librados: watch_flush enter 2026-02-17T21:25:35.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.766+0000 7fec36f14640 10 librados: watch_flush exit 2026-02-17T21:25:35.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.766+0000 7fec36f14640 20 client.4418.objecter shutdown clearing up homeless session... 2026-02-17T21:25:35.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.766+0000 7fec36f14640 10 client.4418.objecter successfully canceled tick 2026-02-17T21:25:35.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.766+0000 7fec36f14640 1 -- 10.20.193.5:0/4011451178 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fec00079280 msgr2=0x7fec0007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:35.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.766+0000 7fec36f14640 1 --2- 10.20.193.5:0/4011451178 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fec00079280 0x7fec0007b740 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fec3015dcf0 tx=0x7fec20039040 comp rx=0 tx=0).stop 2026-02-17T21:25:35.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.766+0000 7fec36f14640 10 monclient: shutdown 2026-02-17T21:25:35.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.766+0000 7fec36f14640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:35.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.766+0000 7fec36f14640 1 -- 10.20.193.5:0/4011451178 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fec3015b000 msgr2=0x7fec300cc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:35.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.766+0000 7fec36f14640 1 --2- 10.20.193.5:0/4011451178 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fec3015b000 0x7fec300cc100 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fec1800e9e0 tx=0x7fec1800eeb0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.766+0000 7fec36f14640 1 -- 10.20.193.5:0/4011451178 shutdown_connections 2026-02-17T21:25:35.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.766+0000 7fec36f14640 1 --2- 10.20.193.5:0/4011451178 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fec00079280 0x7fec0007b740 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.766+0000 7fec36f14640 1 --2- 10.20.193.5:0/4011451178 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fec3015d370 0x7fec300cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.766+0000 7fec36f14640 1 --2- 10.20.193.5:0/4011451178 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fec3015b000 0x7fec300cc100 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.766+0000 7fec36f14640 1 --2- 10.20.193.5:0/4011451178 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fec300c7e20 0x7fec301f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.766+0000 7fec36f14640 1 -- 10.20.193.5:0/4011451178 >> 10.20.193.5:0/4011451178 conn(0x7fec300c9f20 msgr2=0x7fec300ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:35.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.766+0000 7fec36f14640 1 -- 10.20.193.5:0/4011451178 shutdown_connections 2026-02-17T21:25:35.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.766+0000 7fec36f14640 1 -- 10.20.193.5:0/4011451178 wait complete. 2026-02-17T21:25:35.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.766+0000 7fec36f14640 1 librados: shutdown 2026-02-17T21:25:35.778 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-17T21:25:35.778 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T21:25:35.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.845+0000 7febf8d86640 10 monclient: get_monmap_and_config 2026-02-17T21:25:35.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.845+0000 7febf8d86640 10 monclient: build_initial_monmap 2026-02-17T21:25:35.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.845+0000 7febf8d86640 10 monclient: monmap: 2026-02-17T21:25:35.847 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:35.847 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:35.847 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:35.845920+0000 2026-02-17T21:25:35.847 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:35.845920+0000 2026-02-17T21:25:35.847 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:35.847 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:35.847 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:35.847 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:35.847 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:35.848 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:35.848 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:35.848 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:35.848 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:35.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.845+0000 7febf8d86640 1 Processor -- start 2026-02-17T21:25:35.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.845+0000 7febf8d86640 1 -- start start 2026-02-17T21:25:35.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.845+0000 7febf8d86640 10 monclient: init 2026-02-17T21:25:35.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.846+0000 7febf8d86640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:35.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.846+0000 7febf8d86640 10 monclient: _add_conns ranks=[2,0,1,4,5,3] 2026-02-17T21:25:35.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.846+0000 7febf8d86640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7febf40c7170 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:35.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.846+0000 7febf8d86640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7febf40c7550 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:35.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.846+0000 7febf8d86640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7febf40c89c0 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:35.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.846+0000 7febf8d86640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febf40c4fd0 con 0x7febf40c7550 2026-02-17T21:25:35.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.846+0000 7febf8d86640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febf415a9a0 con 0x7febf40c89c0 2026-02-17T21:25:35.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.846+0000 7febf8d86640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febf40c5270 con 0x7febf40c7170 2026-02-17T21:25:35.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.846+0000 7febf8d86640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:35.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.846+0000 7febf8d86640 10 monclient(hunting): authenticate will time out at 1041.411380s 2026-02-17T21:25:35.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.846+0000 7febf2d76640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7febf40c89c0 0x7febf41646d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:57580/0 (socket says 10.20.193.5:57580) 2026-02-17T21:25:35.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.846+0000 7febf2d76640 1 -- 10.20.193.5:0/3899809777 learned_addr learned my addr 10.20.193.5:0/3899809777 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:35.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.848+0000 7febf1573640 1 -- 10.20.193.5:0/3899809777 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2686736776 0 0) 0x7febf40c4fd0 con 0x7febf40c7550 2026-02-17T21:25:35.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.848+0000 7febf1573640 10 monclient(hunting): _negotiate 2026-02-17T21:25:35.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.848+0000 7febf1573640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:35.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.848+0000 7febf1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:35.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.848+0000 7febf1573640 10 monclient(hunting): my global_id is 4392 2026-02-17T21:25:35.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.848+0000 7febf1573640 1 -- 10.20.193.5:0/3899809777 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febe0003620 con 0x7febf40c7550 2026-02-17T21:25:35.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.848+0000 7febf1573640 1 -- 10.20.193.5:0/3899809777 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1544880998 0 0) 0x7febf40c5270 con 0x7febf40c7170 2026-02-17T21:25:35.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.848+0000 7febf1573640 10 monclient(hunting): _negotiate 2026-02-17T21:25:35.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.848+0000 7febf1573640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:35.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.848+0000 7febf1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:35.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.848+0000 7febf1573640 10 monclient(hunting): my global_id is 4421 2026-02-17T21:25:35.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.848+0000 7febf1573640 1 -- 10.20.193.5:0/3899809777 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febf40c4fd0 con 0x7febf40c7170 2026-02-17T21:25:35.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.848+0000 7febf1573640 1 -- 10.20.193.5:0/3899809777 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2280414010 0 0) 0x7febf415a9a0 con 0x7febf40c89c0 2026-02-17T21:25:35.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.848+0000 7febf1573640 10 monclient(hunting): _negotiate 2026-02-17T21:25:35.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.848+0000 7febf1573640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:35.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.848+0000 7febf1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:35.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.848+0000 7febf1573640 10 monclient(hunting): my global_id is 4420 2026-02-17T21:25:35.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.848+0000 7febf1573640 1 -- 10.20.193.5:0/3899809777 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febf40c5270 con 0x7febf40c89c0 2026-02-17T21:25:35.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 1 -- 10.20.193.5:0/3899809777 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3683205008 0 0) 0x7febf40c5270 con 0x7febf40c89c0 2026-02-17T21:25:35.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 1 -- 10.20.193.5:0/3899809777 >> v1:10.20.193.135:6789/0 conn(0x7febf40c7170 legacy=0x7febf40c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:35.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 1 -- 10.20.193.5:0/3899809777 >> v1:10.20.193.5:6789/0 conn(0x7febf40c7550 legacy=0x7febf40749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:35.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 10 monclient: _finish_hunting 0 2026-02-17T21:25:35.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 1 monclient: found mon.noname-b-legacy 2026-02-17T21:25:35.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:35.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.119:6789/0 2026-02-17T21:25:35.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 1 -- 10.20.193.5:0/3899809777 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febf40c5550 con 0x7febf40c89c0 2026-02-17T21:25:35.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 10 monclient: _finish_auth 0 2026-02-17T21:25:35.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 10 monclient: _check_auth_tickets 2026-02-17T21:25:35.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:35.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 1 -- 10.20.193.5:0/3899809777 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3880376286 0 0) 0x7febe40031a0 con 0x7febf40c89c0 2026-02-17T21:25:35.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:35.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T21:25:35.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 10 monclient: dump: 2026-02-17T21:25:35.863 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:35.863 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:35.863 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.864 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.864 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:35.864 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:35.864 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:35.864 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:35.864 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:35.864 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:35.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] but i'm connected to v1:10.20.193.119:6789/0, reconnecting 2026-02-17T21:25:35.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:35.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 1 -- 10.20.193.5:0/3899809777 >> v1:10.20.193.119:6789/0 conn(0x7febf40c89c0 legacy=0x7febf41646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:35.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:25:35.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 1 --2- 10.20.193.5:0/3899809777 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7febe0004030 0x7febe0004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:35.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 10 monclient(hunting): picked mon.b con 0x7febe0004030 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:35.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 1 --2- 10.20.193.5:0/3899809777 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7febe0004e40 0x7febe00052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:35.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 10 monclient(hunting): picked mon.a con 0x7febe0004e40 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:35.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 1 --2- 10.20.193.5:0/3899809777 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7febe0009ab0 0x7febe000bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:35.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 10 monclient(hunting): picked mon.c con 0x7febe0009ab0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:35.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:35.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 1 -- 10.20.193.5:0/3899809777 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7febe000c570 con 0x7febe0004e40 2026-02-17T21:25:35.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:35.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 1 -- 10.20.193.5:0/3899809777 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7febe000c720 con 0x7febe0004030 2026-02-17T21:25:35.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:35.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 1 -- 10.20.193.5:0/3899809777 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7febe000c920 con 0x7febe0009ab0 2026-02-17T21:25:35.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:35.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf1573640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:25:35.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.850+0000 7febf2d76640 1 --2- 10.20.193.5:0/3899809777 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7febe0009ab0 0x7febe000bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:35.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.851+0000 7febf2d76640 10 monclient(hunting): get_auth_request con 0x7febe0009ab0 auth_method 0 2026-02-17T21:25:35.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.851+0000 7febf2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:35.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.851+0000 7febf2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:35.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.851+0000 7febf2d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:25:35.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.851+0000 7febf1d74640 1 --2- 10.20.193.5:0/3899809777 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7febe0004e40 0x7febe00052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:35.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.851+0000 7febf2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:35.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.851+0000 7febf2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:35.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.851+0000 7febf2d76640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:25:35.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.851+0000 7febf1d74640 10 monclient(hunting): get_auth_request con 0x7febe0004e40 auth_method 0 2026-02-17T21:25:35.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.851+0000 7febf1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:35.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.851+0000 7febf1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:35.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.851+0000 7febf1d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:25:35.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.851+0000 7febf2575640 1 --2- 10.20.193.5:0/3899809777 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7febe0004030 0x7febe0004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:35.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.851+0000 7febf1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:35.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.851+0000 7febf1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:35.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.851+0000 7febf1d74640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:25:35.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.851+0000 7febf2575640 10 monclient(hunting): get_auth_request con 0x7febe0004030 auth_method 0 2026-02-17T21:25:35.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.851+0000 7febf2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:35.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.851+0000 7febf2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:35.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.851+0000 7febf2575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:25:35.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.852+0000 7febf2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:35.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.852+0000 7febf2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:35.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.852+0000 7febf2575640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:25:35.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.852+0000 7febf2d76640 10 monclient(hunting): handle_auth_done global_id 4420 payload 293 2026-02-17T21:25:35.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.852+0000 7febf2d76640 1 -- 10.20.193.5:0/3899809777 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7febe0004030 msgr2=0x7febe0004900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:35.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.852+0000 7febf2d76640 1 --2- 10.20.193.5:0/3899809777 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7febe0004030 0x7febe0004900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.852+0000 7febf2d76640 1 -- 10.20.193.5:0/3899809777 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7febe0004e40 msgr2=0x7febe00052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:35.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.852+0000 7febf2d76640 1 --2- 10.20.193.5:0/3899809777 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7febe0004e40 0x7febe00052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.852+0000 7febf2d76640 10 monclient: _finish_hunting 0 2026-02-17T21:25:35.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.852+0000 7febf2d76640 1 monclient: found mon.c 2026-02-17T21:25:35.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.852+0000 7febf2d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:35.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.852+0000 7febf2d76640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:35.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.852+0000 7febf2d76640 1 -- 10.20.193.5:0/3899809777 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febf40c5270 con 0x7febe0009ab0 2026-02-17T21:25:35.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.852+0000 7febf2d76640 10 monclient: _finish_auth 0 2026-02-17T21:25:35.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.852+0000 7febf2d76640 10 monclient: _check_auth_tickets 2026-02-17T21:25:35.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.852+0000 7febf2d76640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:35.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.852+0000 7febf8d86640 5 monclient: authenticate success, global_id 4420 2026-02-17T21:25:35.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.852+0000 7febf8d86640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:35.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.852+0000 7febf2d76640 1 -- 10.20.193.5:0/3899809777 reap_dead start 2026-02-17T21:25:35.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.853+0000 7febf2d76640 1 --2- 10.20.193.5:0/3899809777 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7febe0009ab0 0x7febe000bea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7febe400a680 tx=0x7febe402faa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56595663ad098414 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:35.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.854+0000 7febf1573640 1 -- 10.20.193.5:0/3899809777 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe400a2a0 con 0x7febe0009ab0 2026-02-17T21:25:35.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.854+0000 7febf1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:35.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.854+0000 7febf1573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:35.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.854+0000 7febf1573640 10 monclient: dump: 2026-02-17T21:25:35.869 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:35.869 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:35.870 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.870 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.870 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:35.870 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:35.870 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:35.870 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:35.870 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:35.870 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:35.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.854+0000 7febf8d86640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:35.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.855+0000 7febf1573640 1 -- 10.20.193.5:0/3899809777 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febe4035670 con 0x7febe0009ab0 2026-02-17T21:25:35.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.855+0000 7febf1573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:35.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.855+0000 7febf1573640 1 -- 10.20.193.5:0/3899809777 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe4035a60 con 0x7febe0009ab0 2026-02-17T21:25:35.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.855+0000 7febf1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:35.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.855+0000 7febf1573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:35.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.855+0000 7febf1573640 10 monclient: dump: 2026-02-17T21:25:35.871 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:35.871 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:35.871 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.871 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.871 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:35.871 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:35.871 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:35.871 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:35.871 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:35.871 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:35.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.855+0000 7febf8d86640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:35.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.855+0000 7febf8d86640 4 set_mon_vals no callback set 2026-02-17T21:25:35.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.855+0000 7febf8d86640 10 monclient: shutdown 2026-02-17T21:25:35.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.855+0000 7febf8d86640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:35.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.855+0000 7febf8d86640 1 -- 10.20.193.5:0/3899809777 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7febe0009ab0 msgr2=0x7febe000bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:35.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.855+0000 7febf8d86640 1 --2- 10.20.193.5:0/3899809777 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7febe0009ab0 0x7febe000bea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7febe400a680 tx=0x7febe402faa0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.855+0000 7febf8d86640 1 -- 10.20.193.5:0/3899809777 shutdown_connections 2026-02-17T21:25:35.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.855+0000 7febf8d86640 1 --2- 10.20.193.5:0/3899809777 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7febe0009ab0 0x7febe000bea0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.855+0000 7febf8d86640 1 -- 10.20.193.5:0/3899809777 >> 10.20.193.5:0/3899809777 conn(0x7febf40c9f40 msgr2=0x7febf40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:35.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.855+0000 7febf8d86640 1 -- 10.20.193.5:0/3899809777 shutdown_connections 2026-02-17T21:25:35.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.855+0000 7febf8d86640 1 -- 10.20.193.5:0/3899809777 wait complete. 2026-02-17T21:25:35.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.856+0000 7febf8d86640 10 monclient: build_initial_monmap 2026-02-17T21:25:35.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.856+0000 7febf8d86640 10 monclient: monmap: 2026-02-17T21:25:35.873 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:35.873 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:35.873 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:35.873 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:35.873 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:35.873 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:35.873 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:35.873 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:35.873 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:35.873 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:35.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.856+0000 7febf8d86640 1 librados: starting msgr at 2026-02-17T21:25:35.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.856+0000 7febf8d86640 1 librados: starting objecter 2026-02-17T21:25:35.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.856+0000 7febf8d86640 1 Processor -- start 2026-02-17T21:25:35.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.856+0000 7febf8d86640 1 -- start start 2026-02-17T21:25:35.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.856+0000 7febf8d86640 1 librados: setting wanted keys 2026-02-17T21:25:35.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.856+0000 7febf8d86640 1 librados: calling monclient init 2026-02-17T21:25:35.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.856+0000 7febf8d86640 10 monclient: init 2026-02-17T21:25:35.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf8d86640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:35.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf8d86640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:25:35.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf8d86640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7febe0009ab0 0x7febf41f4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:35.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf8d86640 10 monclient(hunting): picked mon.noname-b con 0x7febe0009ab0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:35.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf8d86640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7febf41543c0 0x7febf406ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:35.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf8d86640 10 monclient(hunting): picked mon.noname-c con 0x7febf41543c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:35.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf8d86640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7febf41f6c00 0x7febf41552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:35.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf8d86640 10 monclient(hunting): picked mon.noname-a con 0x7febf41f6c00 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:35.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf8d86640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:35.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf8d86640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7febf40c7ee0 con 0x7febf41f6c00 2026-02-17T21:25:35.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf8d86640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:35.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf8d86640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7febf40c8530 con 0x7febe0009ab0 2026-02-17T21:25:35.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf8d86640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:35.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf8d86640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7febf40c81c0 con 0x7febf41543c0 2026-02-17T21:25:35.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf8d86640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:35.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf8d86640 10 monclient(hunting): authenticate will time out at 1041.422063s 2026-02-17T21:25:35.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf2d76640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7febf41f6c00 0x7febf41552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:35.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf1d74640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7febf41543c0 0x7febf406ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:35.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf2575640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7febe0009ab0 0x7febf41f4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:35.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf1d74640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7febf41543c0 0x7febf406ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:47588/0 (socket says 10.20.193.5:47588) 2026-02-17T21:25:35.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf1d74640 1 -- 10.20.193.5:0/3779975874 learned_addr learned my addr 10.20.193.5:0/3779975874 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:35.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf1d74640 10 monclient(hunting): get_auth_request con 0x7febf41543c0 auth_method 0 2026-02-17T21:25:35.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:35.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:35.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:35.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf2d76640 10 monclient(hunting): get_auth_request con 0x7febf41f6c00 auth_method 0 2026-02-17T21:25:35.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:35.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:35.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:35.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf2575640 10 monclient(hunting): get_auth_request con 0x7febe0009ab0 auth_method 0 2026-02-17T21:25:35.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:35.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:35.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:35.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:35.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:35.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:35.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:35.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:35.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:35.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:35.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:35.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.857+0000 7febf2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:35.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.859+0000 7febf1d74640 10 monclient(hunting): handle_auth_done global_id 4424 payload 824 2026-02-17T21:25:35.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.859+0000 7febf1d74640 1 -- 10.20.193.5:0/3779975874 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7febe0009ab0 msgr2=0x7febf41f4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:35.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.859+0000 7febf1d74640 1 --2- 10.20.193.5:0/3779975874 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7febe0009ab0 0x7febf41f4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.859+0000 7febf1d74640 1 -- 10.20.193.5:0/3779975874 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7febf41f6c00 msgr2=0x7febf41552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:35.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.859+0000 7febf1d74640 1 --2- 10.20.193.5:0/3779975874 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7febf41f6c00 0x7febf41552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:35.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.859+0000 7febf1d74640 10 monclient: _finish_hunting 0 2026-02-17T21:25:35.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.859+0000 7febf1d74640 1 monclient: found mon.noname-c 2026-02-17T21:25:35.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.859+0000 7febf1d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:35.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.859+0000 7febf1d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:35.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.859+0000 7febf1d74640 1 -- 10.20.193.5:0/3779975874 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febf406da00 con 0x7febf41543c0 2026-02-17T21:25:35.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.860+0000 7febf1d74640 1 --2- 10.20.193.5:0/3779975874 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7febf41543c0 0x7febf406ed80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7febdc00eb00 tx=0x7febdc005630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:35.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.860+0000 7febdaffd640 10 client.?.objecter ms_handle_connect 0x7febf41543c0 2026-02-17T21:25:35.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.860+0000 7febdaffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:35.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.861+0000 7febdaffd640 1 -- 10.20.193.5:0/3779975874 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febdc019070 con 0x7febf41543c0 2026-02-17T21:25:35.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.861+0000 7febdaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:35.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.861+0000 7febdaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:35.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.861+0000 7febdaffd640 10 monclient: dump: 2026-02-17T21:25:35.881 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:35.881 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:35.881 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.881 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.881 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:35.881 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:35.881 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:35.882 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:35.882 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:35.882 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:35.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.861+0000 7febdaffd640 10 monclient: _finish_auth 0 2026-02-17T21:25:35.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.861+0000 7febdaffd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:35.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.861+0000 7febdaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:35.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.861+0000 7febf8d86640 5 monclient: authenticate success, global_id 4424 2026-02-17T21:25:35.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.861+0000 7febf8d86640 10 monclient: _renew_subs 2026-02-17T21:25:35.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.861+0000 7febf8d86640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:35.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.861+0000 7febf8d86640 1 -- 10.20.193.5:0/3779975874 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febf406dce0 con 0x7febf41543c0 2026-02-17T21:25:35.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.861+0000 7febf8d86640 10 client.4424.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:35.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.861+0000 7febf8d86640 10 monclient: _renew_subs 2026-02-17T21:25:35.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.861+0000 7febf8d86640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:35.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.861+0000 7febf8d86640 1 -- 10.20.193.5:0/3779975874 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febf406e2a0 con 0x7febf41543c0 2026-02-17T21:25:35.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.861+0000 7febf8d86640 1 librados: init done 2026-02-17T21:25:35.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.861+0000 7febdaffd640 1 -- 10.20.193.5:0/3779975874 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febdc00c970 con 0x7febf41543c0 2026-02-17T21:25:35.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.861+0000 7febdaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:35.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.861+0000 7febdaffd640 1 -- 10.20.193.5:0/3779975874 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febdc00cd20 con 0x7febf41543c0 2026-02-17T21:25:35.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.861+0000 7febdaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:35.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.861+0000 7febf0d72640 4 set_mon_vals no callback set 2026-02-17T21:25:35.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.861+0000 7febdaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:35.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.861+0000 7febdaffd640 10 monclient: dump: 2026-02-17T21:25:35.883 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:35.883 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:35.883 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.883 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:35.883 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:35.884 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:35.884 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:35.884 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:35.884 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:35.884 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:35.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.861+0000 7febf8d86640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:35.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.862+0000 7febf8d86640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:35.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.862+0000 7febf8d86640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:35.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.862+0000 7febf8d86640 1 -- 10.20.193.5:0/3779975874 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febf406e8b0 con 0x7febf41543c0 2026-02-17T21:25:35.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.873+0000 7febdaffd640 1 -- 10.20.193.5:0/3779975874 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7febdc0068d0 con 0x7febf41543c0 2026-02-17T21:25:35.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.873+0000 7febdaffd640 1 --2- 10.20.193.5:0/3779975874 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7febc00792b0 0x7febc007b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:35.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.874+0000 7febf2575640 1 --2- 10.20.193.5:0/3779975874 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7febc00792b0 0x7febc007b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:35.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.874+0000 7febf2575640 10 monclient: get_auth_request con 0x7febc00792b0 auth_method 0 2026-02-17T21:25:35.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.874+0000 7febf2575640 1 --2- 10.20.193.5:0/3779975874 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7febc00792b0 0x7febc007b770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7febe8002910 tx=0x7febe8007dc0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:35.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.874+0000 7febdaffd640 10 client.4424.objecter ms_handle_connect 0x7febc00792b0 2026-02-17T21:25:35.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.876+0000 7febdaffd640 1 -- 10.20.193.5:0/3779975874 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7febdc05dff0 con 0x7febf41543c0 2026-02-17T21:25:35.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.876+0000 7febdaffd640 10 client.4424.objecter ms_dispatch2 0x7febf4000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:35.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.876+0000 7febdaffd640 3 client.4424.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:35.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.876+0000 7febdaffd640 3 client.4424.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:35.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.876+0000 7febdaffd640 20 client.4424.objecter dump_active .. 0 homeless 2026-02-17T21:25:35.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.977+0000 7febdaffd640 1 -- 10.20.193.5:0/3779975874 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7febdc023070 con 0x7febf41543c0 2026-02-17T21:25:35.979 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.977+0000 7febdaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:35.979 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:35.977+0000 7febdaffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:36.061 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.060+0000 7febf8d86640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:25:36.062 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.060+0000 7febf8d86640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:25:36.062 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.060+0000 7febf8d86640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.062 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.060+0000 7febf8d86640 1 -- 10.20.193.5:0/3779975874 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7febf40c8e70 con 0x7febf41543c0 2026-02-17T21:25:36.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.078+0000 7febdaffd640 1 -- 10.20.193.5:0/3779975874 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+24719 (secure 0 0 0) 0x7febdc061fb0 con 0x7febf41543c0 2026-02-17T21:25:36.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.078+0000 7febdaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:25:36.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.078+0000 7febdaffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:36.080 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:25:36.081 INFO:teuthology.orchestra.run.trial005.stdout:{"epoch":34,"fsid":"b1be373b-56c5-4b5b-a965-9bcc20042691","created":"2026-02-17T21:23:38.622021+0000","modified":"2026-02-17T21:25:33.947844+0000","last_up_change":"2026-02-17T21:25:25.434771+0000","last_in_change":"2026-02-17T21:23:44.366223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T21:25:19.677742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T21:25:30.292349+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":34,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.0199999809265137,"score_stable":4.0199999809265137,"optimal_score":0.56000000238418579,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8bffc5e9-1f92-4603-bf29-ce19225edc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6808","nonce":3662168592},{"type":"v1","addr":"10.20.193.5:6809","nonce":3662168592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6810","nonce":3662168592},{"type":"v1","addr":"10.20.193.5:6811","nonce":3662168592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6814","nonce":3662168592},{"type":"v1","addr":"10.20.193.5:6815","nonce":3662168592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6812","nonce":3662168592},{"type":"v1","addr":"10.20.193.5:6813","nonce":3662168592}]},"public_addr":"10.20.193.5:6809/3662168592","cluster_addr":"10.20.193.5:6811/3662168592","heartbeat_back_addr":"10.20.193.5:6815/3662168592","heartbeat_front_addr":"10.20.193.5:6813/3662168592","state":["exists","up"]},{"osd":1,"uuid":"8ffdf919-2ec4-4c1f-a69f-aee5cea211e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6800","nonce":267553149},{"type":"v1","addr":"10.20.193.119:6801","nonce":267553149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6802","nonce":267553149},{"type":"v1","addr":"10.20.193.119:6803","nonce":267553149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6806","nonce":267553149},{"type":"v1","addr":"10.20.193.119:6807","nonce":267553149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6804","nonce":267553149},{"type":"v1","addr":"10.20.193.119:6805","nonce":267553149}]},"public_addr":"10.20.193.119:6801/267553149","cluster_addr":"10.20.193.119:6803/267553149","heartbeat_back_addr":"10.20.193.119:6807/267553149","heartbeat_front_addr":"10.20.193.119:6805/267553149","state":["exists","up"]},{"osd":2,"uuid":"d186244a-4bf7-416d-b6a0-0e0f5af50eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6824","nonce":692096764},{"type":"v1","addr":"10.20.193.135:6825","nonce":692096764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6826","nonce":692096764},{"type":"v1","addr":"10.20.193.135:6827","nonce":692096764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6830","nonce":692096764},{"type":"v1","addr":"10.20.193.135:6831","nonce":692096764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6828","nonce":692096764},{"type":"v1","addr":"10.20.193.135:6829","nonce":692096764}]},"public_addr":"10.20.193.135:6825/692096764","cluster_addr":"10.20.193.135:6827/692096764","heartbeat_back_addr":"10.20.193.135:6831/692096764","heartbeat_front_addr":"10.20.193.135:6829/692096764","state":["exists","up"]},{"osd":3,"uuid":"093b417e-53bf-4b60-a937-7c5ffee43e1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6818","nonce":1862950168},{"type":"v1","addr":"10.20.193.176:6819","nonce":1862950168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6820","nonce":1862950168},{"type":"v1","addr":"10.20.193.176:6821","nonce":1862950168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6824","nonce":1862950168},{"type":"v1","addr":"10.20.193.176:6825","nonce":1862950168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6822","nonce":1862950168},{"type":"v1","addr":"10.20.193.176:6823","nonce":1862950168}]},"public_addr":"10.20.193.176:6819/1862950168","cluster_addr":"10.20.193.176:6821/1862950168","heartbeat_back_addr":"10.20.193.176:6825/1862950168","heartbeat_front_addr":"10.20.193.176:6823/1862950168","state":["exists","up"]},{"osd":4,"uuid":"0a48e684-05b0-41b1-a553-022424011225","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6800","nonce":234574736},{"type":"v1","addr":"10.20.193.5:6801","nonce":234574736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6802","nonce":234574736},{"type":"v1","addr":"10.20.193.5:6803","nonce":234574736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6806","nonce":234574736},{"type":"v1","addr":"10.20.193.5:6807","nonce":234574736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6804","nonce":234574736},{"type":"v1","addr":"10.20.193.5:6805","nonce":234574736}]},"public_addr":"10.20.193.5:6801/234574736","cluster_addr":"10.20.193.5:6803/234574736","heartbeat_back_addr":"10.20.193.5:6807/234574736","heartbeat_front_addr":"10.20.193.5:6805/234574736","state":["exists","up"]},{"osd":5,"uuid":"d73b7c38-cef9-4993-b353-908c1d87603c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6818","nonce":4010664603},{"type":"v1","addr":"10.20.193.119:6820","nonce":4010664603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6824","nonce":4010664603},{"type":"v1","addr":"10.20.193.119:6825","nonce":4010664603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6830","nonce":4010664603},{"type":"v1","addr":"10.20.193.119:6831","nonce":4010664603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6828","nonce":4010664603},{"type":"v1","addr":"10.20.193.119:6829","nonce":4010664603}]},"public_addr":"10.20.193.119:6820/4010664603","cluster_addr":"10.20.193.119:6825/4010664603","heartbeat_back_addr":"10.20.193.119:6831/4010664603","heartbeat_front_addr":"10.20.193.119:6829/4010664603","state":["exists","up"]},{"osd":6,"uuid":"f7774c25-72e8-41b2-8634-517af7a213b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6808","nonce":1853988335},{"type":"v1","addr":"10.20.193.135:6809","nonce":1853988335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6810","nonce":1853988335},{"type":"v1","addr":"10.20.193.135:6811","nonce":1853988335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6814","nonce":1853988335},{"type":"v1","addr":"10.20.193.135:6815","nonce":1853988335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6812","nonce":1853988335},{"type":"v1","addr":"10.20.193.135:6813","nonce":1853988335}]},"public_addr":"10.20.193.135:6809/1853988335","cluster_addr":"10.20.193.135:6811/1853988335","heartbeat_back_addr":"10.20.193.135:6815/1853988335","heartbeat_front_addr":"10.20.193.135:6813/1853988335","state":["exists","up"]},{"osd":7,"uuid":"30a68802-afce-499b-90ce-bd568bc69406","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6826","nonce":1604873931},{"type":"v1","addr":"10.20.193.176:6827","nonce":1604873931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6828","nonce":1604873931},{"type":"v1","addr":"10.20.193.176:6829","nonce":1604873931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6832","nonce":1604873931},{"type":"v1","addr":"10.20.193.176:6833","nonce":1604873931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6830","nonce":1604873931},{"type":"v1","addr":"10.20.193.176:6831","nonce":1604873931}]},"public_addr":"10.20.193.176:6827/1604873931","cluster_addr":"10.20.193.176:6829/1604873931","heartbeat_back_addr":"10.20.193.176:6833/1604873931","heartbeat_front_addr":"10.20.193.176:6831/1604873931","state":["exists","up"]},{"osd":8,"uuid":"8b4a2001-3ac8-4756-9dcf-af38c6d12d44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6816","nonce":1609723815},{"type":"v1","addr":"10.20.193.5:6817","nonce":1609723815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6820","nonce":1609723815},{"type":"v1","addr":"10.20.193.5:6821","nonce":1609723815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6826","nonce":1609723815},{"type":"v1","addr":"10.20.193.5:6828","nonce":1609723815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6822","nonce":1609723815},{"type":"v1","addr":"10.20.193.5:6824","nonce":1609723815}]},"public_addr":"10.20.193.5:6817/1609723815","cluster_addr":"10.20.193.5:6821/1609723815","heartbeat_back_addr":"10.20.193.5:6828/1609723815","heartbeat_front_addr":"10.20.193.5:6824/1609723815","state":["exists","up"]},{"osd":9,"uuid":"dfdfee67-eff6-4413-bd7a-adc0a019bfbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6816","nonce":576833933},{"type":"v1","addr":"10.20.193.119:6817","nonce":576833933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6819","nonce":576833933},{"type":"v1","addr":"10.20.193.119:6821","nonce":576833933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6826","nonce":576833933},{"type":"v1","addr":"10.20.193.119:6827","nonce":576833933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6822","nonce":576833933},{"type":"v1","addr":"10.20.193.119:6823","nonce":576833933}]},"public_addr":"10.20.193.119:6817/576833933","cluster_addr":"10.20.193.119:6821/576833933","heartbeat_back_addr":"10.20.193.119:6827/576833933","heartbeat_front_addr":"10.20.193.119:6823/576833933","state":["exists","up"]},{"osd":10,"uuid":"fc24ee77-5a0d-41d4-88f5-8d03a77c7608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6800","nonce":3469915965},{"type":"v1","addr":"10.20.193.135:6801","nonce":3469915965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6802","nonce":3469915965},{"type":"v1","addr":"10.20.193.135:6803","nonce":3469915965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6806","nonce":3469915965},{"type":"v1","addr":"10.20.193.135:6807","nonce":3469915965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6804","nonce":3469915965},{"type":"v1","addr":"10.20.193.135:6805","nonce":3469915965}]},"public_addr":"10.20.193.135:6801/3469915965","cluster_addr":"10.20.193.135:6803/3469915965","heartbeat_back_addr":"10.20.193.135:6807/3469915965","heartbeat_front_addr":"10.20.193.135:6805/3469915965","state":["exists","up"]},{"osd":11,"uuid":"1d737681-1923-453a-82f8-516eeb875559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6802","nonce":3067818664},{"type":"v1","addr":"10.20.193.176:6803","nonce":3067818664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6804","nonce":3067818664},{"type":"v1","addr":"10.20.193.176:6805","nonce":3067818664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6808","nonce":3067818664},{"type":"v1","addr":"10.20.193.176:6809","nonce":3067818664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6806","nonce":3067818664},{"type":"v1","addr":"10.20.193.176:6807","nonce":3067818664}]},"public_addr":"10.20.193.176:6803/3067818664","cluster_addr":"10.20.193.176:6805/3067818664","heartbeat_back_addr":"10.20.193.176:6809/3067818664","heartbeat_front_addr":"10.20.193.176:6807/3067818664","state":["exists","up"]},{"osd":12,"uuid":"c4f0322e-a862-4c5e-967e-4551087ede8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6818","nonce":2028057944},{"type":"v1","addr":"10.20.193.5:6819","nonce":2028057944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6823","nonce":2028057944},{"type":"v1","addr":"10.20.193.5:6825","nonce":2028057944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6830","nonce":2028057944},{"type":"v1","addr":"10.20.193.5:6831","nonce":2028057944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6827","nonce":2028057944},{"type":"v1","addr":"10.20.193.5:6829","nonce":2028057944}]},"public_addr":"10.20.193.5:6819/2028057944","cluster_addr":"10.20.193.5:6825/2028057944","heartbeat_back_addr":"10.20.193.5:6831/2028057944","heartbeat_front_addr":"10.20.193.5:6829/2028057944","state":["exists","up"]},{"osd":13,"uuid":"0b5e9861-a194-4f11-a849-d8bb94ce95a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6808","nonce":1303925174},{"type":"v1","addr":"10.20.193.119:6809","nonce":1303925174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6810","nonce":1303925174},{"type":"v1","addr":"10.20.193.119:6811","nonce":1303925174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6814","nonce":1303925174},{"type":"v1","addr":"10.20.193.119:6815","nonce":1303925174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6812","nonce":1303925174},{"type":"v1","addr":"10.20.193.119:6813","nonce":1303925174}]},"public_addr":"10.20.193.119:6809/1303925174","cluster_addr":"10.20.193.119:6811/1303925174","heartbeat_back_addr":"10.20.193.119:6815/1303925174","heartbeat_front_addr":"10.20.193.119:6813/1303925174","state":["exists","up"]},{"osd":14,"uuid":"6f182077-0c0d-481c-97b4-43ef48aa5aea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6816","nonce":1552304264},{"type":"v1","addr":"10.20.193.135:6817","nonce":1552304264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6818","nonce":1552304264},{"type":"v1","addr":"10.20.193.135:6819","nonce":1552304264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6822","nonce":1552304264},{"type":"v1","addr":"10.20.193.135:6823","nonce":1552304264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6820","nonce":1552304264},{"type":"v1","addr":"10.20.193.135:6821","nonce":1552304264}]},"public_addr":"10.20.193.135:6817/1552304264","cluster_addr":"10.20.193.135:6819/1552304264","heartbeat_back_addr":"10.20.193.135:6823/1552304264","heartbeat_front_addr":"10.20.193.135:6821/1552304264","state":["exists","up"]},{"osd":15,"uuid":"537605ff-bedd-4f2b-922f-e2eaa8c17f48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6810","nonce":1976318959},{"type":"v1","addr":"10.20.193.176:6811","nonce":1976318959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6812","nonce":1976318959},{"type":"v1","addr":"10.20.193.176:6813","nonce":1976318959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6816","nonce":1976318959},{"type":"v1","addr":"10.20.193.176:6817","nonce":1976318959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6814","nonce":1976318959},{"type":"v1","addr":"10.20.193.176:6815","nonce":1976318959}]},"public_addr":"10.20.193.176:6811/1976318959","cluster_addr":"10.20.193.176:6813/1976318959","heartbeat_back_addr":"10.20.193.176:6817/1976318959","heartbeat_front_addr":"10.20.193.176:6815/1976318959","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.964722+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:16.831330+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:19.360415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.257999+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:19.239391+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:16.741791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.466814+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.473911+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:19.537915+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:17.261755+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:19.188280+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.075749+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:19.610371+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:16.923597+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:19.117422+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.626513+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:25:36.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.079+0000 7febf8d86640 10 librados: watch_flush enter 2026-02-17T21:25:36.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.079+0000 7febf8d86640 10 librados: watch_flush exit 2026-02-17T21:25:36.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.079+0000 7febf8d86640 20 client.4424.objecter shutdown clearing up homeless session... 2026-02-17T21:25:36.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.079+0000 7febf8d86640 10 client.4424.objecter successfully canceled tick 2026-02-17T21:25:36.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.079+0000 7febf8d86640 1 -- 10.20.193.5:0/3779975874 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7febc00792b0 msgr2=0x7febc007b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.079+0000 7febf8d86640 1 --2- 10.20.193.5:0/3779975874 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7febc00792b0 0x7febc007b770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7febe8002910 tx=0x7febe8007dc0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.079+0000 7febf8d86640 10 monclient: shutdown 2026-02-17T21:25:36.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.079+0000 7febf8d86640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.079+0000 7febf8d86640 1 -- 10.20.193.5:0/3779975874 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7febf41543c0 msgr2=0x7febf406ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.079+0000 7febf8d86640 1 --2- 10.20.193.5:0/3779975874 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7febf41543c0 0x7febf406ed80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7febdc00eb00 tx=0x7febdc005630 comp rx=0 tx=0).stop 2026-02-17T21:25:36.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.079+0000 7febf8d86640 1 -- 10.20.193.5:0/3779975874 shutdown_connections 2026-02-17T21:25:36.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.079+0000 7febf8d86640 1 --2- 10.20.193.5:0/3779975874 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7febc00792b0 0x7febc007b770 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.079+0000 7febf8d86640 1 --2- 10.20.193.5:0/3779975874 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7febf41f6c00 0x7febf41552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.079+0000 7febf8d86640 1 --2- 10.20.193.5:0/3779975874 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7febf41543c0 0x7febf406ed80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.079+0000 7febf8d86640 1 --2- 10.20.193.5:0/3779975874 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7febe0009ab0 0x7febf41f4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.084 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.079+0000 7febf8d86640 1 -- 10.20.193.5:0/3779975874 >> 10.20.193.5:0/3779975874 conn(0x7febf40c9f40 msgr2=0x7febf40cbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.084 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.079+0000 7febf8d86640 1 -- 10.20.193.5:0/3779975874 shutdown_connections 2026-02-17T21:25:36.084 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.080+0000 7febf8d86640 1 -- 10.20.193.5:0/3779975874 wait complete. 2026-02-17T21:25:36.084 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.080+0000 7febf8d86640 1 librados: shutdown 2026-02-17T21:25:36.091 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T21:25:36.092 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T21:25:36.092 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T21:25:36.093 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T21:25:36.093 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-17T21:25:36.093 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-17T21:25:36.094 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2026-02-17T21:25:36.094 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2026-02-17T21:25:36.095 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2026-02-17T21:25:36.095 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2026-02-17T21:25:36.096 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2026-02-17T21:25:36.096 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2026-02-17T21:25:36.097 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 flush_pg_stats 2026-02-17T21:25:36.097 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 flush_pg_stats 2026-02-17T21:25:36.098 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 flush_pg_stats 2026-02-17T21:25:36.098 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 flush_pg_stats 2026-02-17T21:25:36.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.181+0000 7f81158ea640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.181+0000 7f81158ea640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.181+0000 7f81158ea640 10 monclient: monmap: 2026-02-17T21:25:36.183 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.183 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.183 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.182202+0000 2026-02-17T21:25:36.183 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.182202+0000 2026-02-17T21:25:36.184 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.184 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.184 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.184 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.184 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.184 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.184 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.184 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.184 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.182+0000 7f81158ea640 1 Processor -- start 2026-02-17T21:25:36.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.182+0000 7f81158ea640 1 -- start start 2026-02-17T21:25:36.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.182+0000 7f81158ea640 10 monclient: init 2026-02-17T21:25:36.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.182+0000 7f6315c43640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.182+0000 7f6315c43640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.182+0000 7f6315c43640 10 monclient: monmap: 2026-02-17T21:25:36.186 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.186 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.186 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.183011+0000 2026-02-17T21:25:36.186 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.183011+0000 2026-02-17T21:25:36.186 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.186 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.187 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.187 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.187 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.187 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.187 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.187 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.187 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.182+0000 7f81158ea640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.182+0000 7f81158ea640 10 monclient: _add_conns ranks=[3,2,5,4,1,0] 2026-02-17T21:25:36.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.182+0000 7f81158ea640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f811014f280 0x7f81100c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.182+0000 7f81158ea640 10 monclient(hunting): picked mon.noname-a con 0x7f811014f280 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:36.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.182+0000 7f81158ea640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f811014f660 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:36.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.182+0000 7f81158ea640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f811015abc0 0x7f811015afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.182+0000 7f81158ea640 10 monclient(hunting): picked mon.noname-c con 0x7f811015abc0 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:36.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.182+0000 7f81158ea640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81100c7110 con 0x7f811014f660 2026-02-17T21:25:36.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.182+0000 7f81158ea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.182+0000 7f81158ea640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f81100c7950 con 0x7f811014f280 2026-02-17T21:25:36.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.182+0000 7f81158ea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.182+0000 7f81158ea640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f811015a730 con 0x7f811015abc0 2026-02-17T21:25:36.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.182+0000 7f81158ea640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.182+0000 7f81158ea640 10 monclient(hunting): authenticate will time out at 1041.747809s 2026-02-17T21:25:36.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.182+0000 7f6315c43640 1 Processor -- start 2026-02-17T21:25:36.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f6315c43640 1 -- start start 2026-02-17T21:25:36.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f6315c43640 10 monclient: init 2026-02-17T21:25:36.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f810effd640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f811014f280 0x7f81100c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f810e7fc640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f811014f660 0x7f81100c6a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:45224/0 (socket says 10.20.193.5:45224) 2026-02-17T21:25:36.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f810e7fc640 1 -- 10.20.193.5:0/2615823569 learned_addr learned my addr 10.20.193.5:0/2615823569 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:36.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f810f7fe640 1 --2- 10.20.193.5:0/2615823569 >> v2:10.20.193.135:3300/0 conn(0x7f811015abc0 0x7f811015afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f6315c43640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f6315c43640 10 monclient: _add_conns ranks=[2,5,1,0,4,3] 2026-02-17T21:25:36.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f6315c43640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6310152700 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:36.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f6315c43640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f631015ef80 0x7f63100c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f810effd640 10 monclient(hunting): get_auth_request con 0x7f811014f280 auth_method 0 2026-02-17T21:25:36.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f810effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f810effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f810effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.194 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f6315c43640 10 monclient(hunting): picked mon.noname-c con 0x7f631015ef80 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:36.194 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f6315c43640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f6310152ae0 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:36.194 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f6315c43640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f631015d4f0 con 0x7f6310152ae0 2026-02-17T21:25:36.194 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f810f7fe640 10 monclient(hunting): get_auth_request con 0x7f811015abc0 auth_method 0 2026-02-17T21:25:36.194 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f810f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f810f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f810f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f6315c43640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f631015d7d0 con 0x7f6310152700 2026-02-17T21:25:36.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f6315c43640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f6315c43640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f631015dab0 con 0x7f631015ef80 2026-02-17T21:25:36.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f6315c43640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.183+0000 7f6315c43640 10 monclient(hunting): authenticate will time out at 1041.748849s 2026-02-17T21:25:36.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.184+0000 7f810effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.184+0000 7f810effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.184+0000 7f810effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.184+0000 7f630ffff640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f6310152ae0 0x7f63100c9c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:57596/0 (socket says 10.20.193.5:57596) 2026-02-17T21:25:36.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.184+0000 7f630ffff640 1 -- 10.20.193.5:0/3219155852 learned_addr learned my addr 10.20.193.5:0/3219155852 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:36.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f810f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f810f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f810f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f6ced9a1640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f6ced9a1640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f6ced9a1640 10 monclient: monmap: 2026-02-17T21:25:36.199 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.199 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.199 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.185908+0000 2026-02-17T21:25:36.199 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.185908+0000 2026-02-17T21:25:36.199 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.199 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.199 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.200 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.200 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.200 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.200 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.200 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.200 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f2d62134640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f2d62134640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f2d62134640 10 monclient: monmap: 2026-02-17T21:25:36.201 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.201 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.201 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.185987+0000 2026-02-17T21:25:36.201 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.185987+0000 2026-02-17T21:25:36.201 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.201 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.201 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.201 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.201 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.202 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.202 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.202 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.202 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f630e7fc640 1 -- 10.20.193.5:0/3219155852 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 213513035 0 0) 0x7f631015d4f0 con 0x7f6310152ae0 2026-02-17T21:25:36.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f630e7fc640 10 monclient(hunting): _negotiate 2026-02-17T21:25:36.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f630e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f630e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f630e7fc640 10 monclient(hunting): my global_id is 4426 2026-02-17T21:25:36.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f630e7fc640 1 -- 10.20.193.5:0/3219155852 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62f4003620 con 0x7f6310152ae0 2026-02-17T21:25:36.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f810effd640 10 monclient(hunting): handle_auth_done global_id 4398 payload 274 2026-02-17T21:25:36.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f810effd640 1 -- 10.20.193.5:0/2615823569 >> v2:10.20.193.135:3300/0 conn(0x7f811015abc0 msgr2=0x7f811015afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f810effd640 1 --2- 10.20.193.5:0/2615823569 >> v2:10.20.193.135:3300/0 conn(0x7f811015abc0 0x7f811015afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f810effd640 1 -- 10.20.193.5:0/2615823569 >> v1:10.20.193.135:6789/0 conn(0x7f811014f660 legacy=0x7f81100c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f810effd640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f810effd640 1 monclient: found mon.noname-a 2026-02-17T21:25:36.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f810effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f810effd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f810effd640 1 -- 10.20.193.5:0/2615823569 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81100c7390 con 0x7f811014f280 2026-02-17T21:25:36.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f2d62134640 1 Processor -- start 2026-02-17T21:25:36.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f2d62134640 1 -- start start 2026-02-17T21:25:36.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f2d62134640 10 monclient: init 2026-02-17T21:25:36.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.185+0000 7f6ced9a1640 1 Processor -- start 2026-02-17T21:25:36.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f6ced9a1640 1 -- start start 2026-02-17T21:25:36.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f6ced9a1640 10 monclient: init 2026-02-17T21:25:36.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f630effd640 1 --2- 10.20.193.5:0/3219155852 >> v2:10.20.193.135:3300/0 conn(0x7f631015ef80 0x7f63100c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f2d62134640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f2d62134640 10 monclient: _add_conns ranks=[4,1,0,5,3,2] 2026-02-17T21:25:36.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f630effd640 10 monclient(hunting): get_auth_request con 0x7f631015ef80 auth_method 0 2026-02-17T21:25:36.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f630effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f630effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f630effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f6ced9a1640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f6ced9a1640 10 monclient: _add_conns ranks=[2,3,4,5,0,1] 2026-02-17T21:25:36.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f6ced9a1640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6ce8152700 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:36.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f6ced9a1640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f6ce815ef80 0x7f6ce80c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f6ced9a1640 10 monclient(hunting): picked mon.noname-a con 0x7f6ce815ef80 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:36.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f6ced9a1640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f6ce8152ae0 0x7f6ce80c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f6ced9a1640 10 monclient(hunting): picked mon.noname-b con 0x7f6ce8152ae0 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:36.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f6ced9a1640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ce815d4f0 con 0x7f6ce8152700 2026-02-17T21:25:36.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f6ced9a1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f6ced9a1640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6ce815d7d0 con 0x7f6ce815ef80 2026-02-17T21:25:36.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f6ced9a1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f6ced9a1640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f6ce815dab0 con 0x7f6ce8152ae0 2026-02-17T21:25:36.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f6ced9a1640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f6ced9a1640 10 monclient(hunting): authenticate will time out at 1041.751877s 2026-02-17T21:25:36.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f2d62134640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f2d5c15f570 0x7f2d5c15f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f2d62134640 10 monclient(hunting): picked mon.noname-b con 0x7f2d5c15f570 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:36.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f2d62134640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f2d5c0be810 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:36.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f2d62134640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2d5c155770 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:36.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f2d62134640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d5c0bee70 con 0x7f2d5c155770 2026-02-17T21:25:36.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f2d62134640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d5c0bf150 con 0x7f2d5c0be810 2026-02-17T21:25:36.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f2d62134640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f2d62134640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f2d5c0bec50 con 0x7f2d5c15f570 2026-02-17T21:25:36.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f2d62134640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7f2d62134640 10 monclient(hunting): authenticate will time out at 1041.751627s 2026-02-17T21:25:36.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7ff91862f640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.186+0000 7ff91862f640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7ff91862f640 10 monclient: monmap: 2026-02-17T21:25:36.210 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.211 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.211 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.187686+0000 2026-02-17T21:25:36.211 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.187686+0000 2026-02-17T21:25:36.211 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.211 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.211 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.211 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.211 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.211 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.212 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.212 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.212 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f630effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f630effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f630effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f2d5b7fe640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f2d5c15f570 0x7f2d5c15f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f2d5b7fe640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f2d5c15f570 0x7f2d5c15f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:37632/0 (socket says 10.20.193.5:37632) 2026-02-17T21:25:36.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f2d5b7fe640 1 -- 10.20.193.5:0/151160618 learned_addr learned my addr 10.20.193.5:0/151160618 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f2d5b7fe640 10 monclient(hunting): get_auth_request con 0x7f2d5c15f570 auth_method 0 2026-02-17T21:25:36.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f2d5b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f2d5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f2d5b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7ff91862f640 1 Processor -- start 2026-02-17T21:25:36.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f6ce67fc640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f6ce815ef80 0x7f6ce80c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f6ce77fe640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f6ce8152ae0 0x7f6ce80c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7faae8022640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7faae8022640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7faae8022640 10 monclient: monmap: 2026-02-17T21:25:36.215 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.215 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.215 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.188305+0000 2026-02-17T21:25:36.215 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.188305+0000 2026-02-17T21:25:36.216 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.216 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.216 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.216 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.216 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.216 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.216 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.216 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.216 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.217 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f6ce67fc640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f6ce815ef80 0x7f6ce80c9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:50012/0 (socket says 10.20.193.5:50012) 2026-02-17T21:25:36.217 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f6ce67fc640 1 -- 10.20.193.5:0/801167734 learned_addr learned my addr 10.20.193.5:0/801167734 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.217 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f6ce67fc640 10 monclient(hunting): get_auth_request con 0x7f6ce815ef80 auth_method 0 2026-02-17T21:25:36.217 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f6ce67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.217 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f6ce67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.217 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f6ce67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.217 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f630e7fc640 1 -- 10.20.193.5:0/3219155852 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1930154922 0 0) 0x7f62f4003620 con 0x7f6310152ae0 2026-02-17T21:25:36.217 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f630e7fc640 1 -- 10.20.193.5:0/3219155852 >> v2:10.20.193.135:3300/0 conn(0x7f631015ef80 msgr2=0x7f63100c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.218 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f630e7fc640 1 --2- 10.20.193.5:0/3219155852 >> v2:10.20.193.135:3300/0 conn(0x7f631015ef80 0x7f63100c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.218 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f630e7fc640 1 -- 10.20.193.5:0/3219155852 >> v1:10.20.193.135:6789/0 conn(0x7f6310152700 legacy=0x7f631015e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.218 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f630e7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.218 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f630e7fc640 1 monclient: found mon.noname-b-legacy 2026-02-17T21:25:36.218 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f630e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.218 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f630e7fc640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.119:6789/0 2026-02-17T21:25:36.218 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f630e7fc640 1 -- 10.20.193.5:0/3219155852 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f631015dd90 con 0x7f6310152ae0 2026-02-17T21:25:36.218 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f630e7fc640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.218 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f630e7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.218 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f630e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.218 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f630e7fc640 1 -- 10.20.193.5:0/3219155852 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3880376286 0 0) 0x7f6304003280 con 0x7f6310152ae0 2026-02-17T21:25:36.218 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7f630e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.219 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f630e7fc640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T21:25:36.219 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f630e7fc640 10 monclient: dump: 2026-02-17T21:25:36.219 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.219 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.219 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.219 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.219 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.219 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.219 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.219 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.219 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.219 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7ff91862f640 1 -- start start 2026-02-17T21:25:36.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.187+0000 7ff91862f640 10 monclient: init 2026-02-17T21:25:36.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f630e7fc640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] but i'm connected to v1:10.20.193.119:6789/0, reconnecting 2026-02-17T21:25:36.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f630e7fc640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f630e7fc640 1 -- 10.20.193.5:0/3219155852 >> v1:10.20.193.119:6789/0 conn(0x7f6310152ae0 legacy=0x7f63100c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f630e7fc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:25:36.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f630e7fc640 1 --2- 10.20.193.5:0/3219155852 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f62f4003ba0 0x7f62f4003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f630e7fc640 10 monclient(hunting): picked mon.c con 0x7f62f4003ba0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f630e7fc640 1 --2- 10.20.193.5:0/3219155852 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f62f4004900 0x7f62f4004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f630e7fc640 10 monclient(hunting): picked mon.b con 0x7f62f4004900 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f630e7fc640 1 --2- 10.20.193.5:0/3219155852 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f62f40053e0 0x7f62f400bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f630e7fc640 10 monclient(hunting): picked mon.a con 0x7f62f40053e0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f630e7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f630e7fc640 1 -- 10.20.193.5:0/3219155852 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f631015dab0 con 0x7f62f40053e0 2026-02-17T21:25:36.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f630e7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f630e7fc640 1 -- 10.20.193.5:0/3219155852 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f62f400c2b0 con 0x7f62f4004900 2026-02-17T21:25:36.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f630e7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f630e7fc640 1 -- 10.20.193.5:0/3219155852 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f62f400c4b0 con 0x7f62f4003ba0 2026-02-17T21:25:36.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f630e7fc640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f630e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:25:36.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7faae8022640 1 Processor -- start 2026-02-17T21:25:36.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7faae8022640 1 -- start start 2026-02-17T21:25:36.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7faae8022640 10 monclient: init 2026-02-17T21:25:36.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f810effd640 1 --2- 10.20.193.5:0/2615823569 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f811014f280 0x7f81100c7e20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f81100c4740 tx=0x7f810402eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9c45a85cd41a74 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f2d5b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f2d5b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7ff91862f640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f2d5b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7ff91862f640 10 monclient: _add_conns ranks=[3,4,0,2,5,1] 2026-02-17T21:25:36.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7ff91862f640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7ff910152700 0x7ff91015e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7ff91862f640 10 monclient(hunting): picked mon.noname-a con 0x7ff910152700 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:36.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7ff91862f640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7ff910152ae0 0x7ff91015edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f6ce77fe640 10 monclient(hunting): get_auth_request con 0x7f6ce8152ae0 auth_method 0 2026-02-17T21:25:36.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f6ce77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f6ce77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7f6ce77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7ff91862f640 10 monclient(hunting): picked mon.noname-b con 0x7ff910152ae0 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:36.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7ff91862f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff9100c9730 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:36.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7ff91862f640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff91015d4f0 con 0x7ff9100c9730 2026-02-17T21:25:36.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7fed0b8da640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.226 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7fed0b8da640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.226 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7fed0b8da640 10 monclient: monmap: 2026-02-17T21:25:36.226 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.226 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.226 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.189158+0000 2026-02-17T21:25:36.226 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.189158+0000 2026-02-17T21:25:36.226 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.226 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.226 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.226 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.226 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.226 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.226 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.226 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.226 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7ff91862f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7ff91862f640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff91015d7d0 con 0x7ff910152700 2026-02-17T21:25:36.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7ff91862f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7ff91862f640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7ff91015dab0 con 0x7ff910152ae0 2026-02-17T21:25:36.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7ff91862f640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7ff91862f640 10 monclient(hunting): authenticate will time out at 1041.753568s 2026-02-17T21:25:36.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7faae8022640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7faae8022640 10 monclient: _add_conns ranks=[3,1,4,5,2,0] 2026-02-17T21:25:36.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7faae8022640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7faae0152700 0x7faae015e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7faae8022640 10 monclient(hunting): picked mon.noname-a con 0x7faae0152700 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:36.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7faae8022640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7faae0152ae0 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:36.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7faae8022640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7faae015edb0 0x7faae00c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7faae8022640 10 monclient(hunting): picked mon.noname-b con 0x7faae015edb0 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:36.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7faae8022640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faae015f1e0 con 0x7faae0152ae0 2026-02-17T21:25:36.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7faae8022640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7faae8022640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7faae015d4f0 con 0x7faae0152700 2026-02-17T21:25:36.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7faae8022640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7faae8022640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7faae015d7d0 con 0x7faae015edb0 2026-02-17T21:25:36.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7faae8022640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7faae8022640 10 monclient(hunting): authenticate will time out at 1041.753882s 2026-02-17T21:25:36.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.188+0000 7fed0b8da640 1 Processor -- start 2026-02-17T21:25:36.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7fed0b8da640 1 -- start start 2026-02-17T21:25:36.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7fed0b8da640 10 monclient: init 2026-02-17T21:25:36.229 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7f6ce67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.229 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7f6ce67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.229 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7f6ce67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.229 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7fed0b8da640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.229 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7fed0b8da640 10 monclient: _add_conns ranks=[4,2,1,0,5,3] 2026-02-17T21:25:36.229 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7fed0b8da640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fed040d1b60 0x7fed040d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.229 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7fed0b8da640 10 monclient(hunting): picked mon.noname-b con 0x7fed040d1b60 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:36.229 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7fed0b8da640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fed0415c840 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:36.229 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7fed0b8da640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fed0415d950 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:36.229 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7fed0b8da640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed040c98e0 con 0x7fed0415d950 2026-02-17T21:25:36.229 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7fed0b8da640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed040c9bc0 con 0x7fed0415c840 2026-02-17T21:25:36.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7fed0b8da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7fed0b8da640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fed040ca460 con 0x7fed040d1b60 2026-02-17T21:25:36.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7fed0b8da640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7fed0b8da640 10 monclient(hunting): authenticate will time out at 1041.754605s 2026-02-17T21:25:36.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7f2d5b7fe640 10 monclient(hunting): handle_auth_done global_id 4429 payload 274 2026-02-17T21:25:36.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7f2d5b7fe640 1 -- 10.20.193.5:0/151160618 >> v1:10.20.193.119:6789/0 conn(0x7f2d5c0be810 legacy=0x7f2d5c15d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7f2d5b7fe640 1 -- 10.20.193.5:0/151160618 >> v1:10.20.193.5:6789/0 conn(0x7f2d5c155770 legacy=0x7f2d5c155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7f2d5b7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7f2d5b7fe640 1 monclient: found mon.noname-b 2026-02-17T21:25:36.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7f2d5b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7f2d5b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7f2d5b7fe640 1 -- 10.20.193.5:0/151160618 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d5c0bf430 con 0x7f2d5c15f570 2026-02-17T21:25:36.231 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7f6ce77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.231 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7f6ce77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.231 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.189+0000 7f6ce77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.231 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.190+0000 7f810dffb640 1 -- 10.20.193.5:0/2615823569 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810403c070 con 0x7f811014f280 2026-02-17T21:25:36.231 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.190+0000 7f810dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.231 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.190+0000 7f810dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:36.231 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.190+0000 7f810dffb640 10 monclient: dump: 2026-02-17T21:25:36.231 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.231 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.231 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.231 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.231 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.231 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.231 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.232 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.232 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.232 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.232 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.190+0000 7f810dffb640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.232 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.190+0000 7f810dffb640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.232 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.190+0000 7f810dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.232 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.190+0000 7f81158ea640 5 monclient: authenticate success, global_id 4398 2026-02-17T21:25:36.232 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.190+0000 7f81158ea640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:36.232 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.191+0000 7ff916ba5640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7ff9100c9730 0x7ff9100c9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:42844/0 (socket says 10.20.193.5:42844) 2026-02-17T21:25:36.232 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.191+0000 7ff916ba5640 1 -- 10.20.193.5:0/4240688854 learned_addr learned my addr 10.20.193.5:0/4240688854 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:36.232 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.191+0000 7f6ce77fe640 10 monclient(hunting): handle_auth_done global_id 4432 payload 274 2026-02-17T21:25:36.232 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.191+0000 7f6ce77fe640 1 -- 10.20.193.5:0/801167734 >> v2:10.20.193.5:3300/0 conn(0x7f6ce815ef80 msgr2=0x7f6ce80c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.232 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.191+0000 7f6ce77fe640 1 --2- 10.20.193.5:0/801167734 >> v2:10.20.193.5:3300/0 conn(0x7f6ce815ef80 0x7f6ce80c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.233 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.191+0000 7f6ce77fe640 1 -- 10.20.193.5:0/801167734 >> v1:10.20.193.135:6789/0 conn(0x7f6ce8152700 legacy=0x7f6ce815e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.233 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.191+0000 7f6ce77fe640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.233 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.191+0000 7f6ce77fe640 1 monclient: found mon.noname-b 2026-02-17T21:25:36.233 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.191+0000 7f6ce77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.233 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.191+0000 7f6ce77fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.233 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.191+0000 7f6ce77fe640 1 -- 10.20.193.5:0/801167734 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce815dd90 con 0x7f6ce8152ae0 2026-02-17T21:25:36.233 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.191+0000 7f630f7fe640 1 --2- 10.20.193.5:0/3219155852 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f62f4003ba0 0x7f62f4003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.233 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.192+0000 7f630f7fe640 10 monclient(hunting): get_auth_request con 0x7f62f4003ba0 auth_method 0 2026-02-17T21:25:36.233 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.192+0000 7f630f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.233 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.192+0000 7f630f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.233 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.192+0000 7f630f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:25:36.234 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.192+0000 7fd576511640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.234 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.192+0000 7fd576511640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.234 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.192+0000 7fd576511640 10 monclient: monmap: 2026-02-17T21:25:36.234 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.234 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.234 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.192757+0000 2026-02-17T21:25:36.234 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.192757+0000 2026-02-17T21:25:36.234 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.234 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.234 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.234 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.234 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.234 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.234 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.234 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.235 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.235 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.192+0000 7fd576511640 1 Processor -- start 2026-02-17T21:25:36.235 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.192+0000 7fd576511640 1 -- start start 2026-02-17T21:25:36.235 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.192+0000 7fd576511640 10 monclient: init 2026-02-17T21:25:36.235 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.192+0000 7f2d5b7fe640 1 --2- 10.20.193.5:0/151160618 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2d5c15f570 0x7f2d5c15f950 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2d48009970 tx=0x7f2d4802eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2287412b319c8c8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.235 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.192+0000 7f630f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.235 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.192+0000 7f630f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.235 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.192+0000 7f630f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:25:36.235 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7fb1f005f640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.235 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7fb1f005f640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.235 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7fb1f005f640 10 monclient: monmap: 2026-02-17T21:25:36.235 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.236 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.236 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.193731+0000 2026-02-17T21:25:36.236 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.193731+0000 2026-02-17T21:25:36.236 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.236 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.236 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.236 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.236 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.236 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.236 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.236 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.236 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7fd576511640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7fd576511640 10 monclient: _add_conns ranks=[1,5,2,0,3,4] 2026-02-17T21:25:36.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7fd576511640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fd570152700 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:36.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7fd576511640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fd57015ef80 0x7fd5700c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7fd576511640 10 monclient(hunting): picked mon.noname-c con 0x7fd57015ef80 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:36.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7fd576511640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd570152ae0 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:36.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7fd576511640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd57015d4f0 con 0x7fd570152700 2026-02-17T21:25:36.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7fd576511640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd57015d7d0 con 0x7fd570152ae0 2026-02-17T21:25:36.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7fd576511640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7fd576511640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd57015dab0 con 0x7fd57015ef80 2026-02-17T21:25:36.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7fd576511640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7fd576511640 10 monclient(hunting): authenticate will time out at 1041.758465s 2026-02-17T21:25:36.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7fb1f005f640 1 Processor -- start 2026-02-17T21:25:36.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7fb1f005f640 1 -- start start 2026-02-17T21:25:36.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7fb1f005f640 10 monclient: init 2026-02-17T21:25:36.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7f08590d3640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7f08590d3640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7f08590d3640 10 monclient: monmap: 2026-02-17T21:25:36.238 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.238 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.238 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.194248+0000 2026-02-17T21:25:36.238 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.194248+0000 2026-02-17T21:25:36.238 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.238 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.238 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.238 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.238 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.238 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.239 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.239 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.239 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7faea6d87640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7faea6d87640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7faea6d87640 10 monclient: monmap: 2026-02-17T21:25:36.239 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.239 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.239 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.194282+0000 2026-02-17T21:25:36.239 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.194282+0000 2026-02-17T21:25:36.239 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.239 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.239 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.239 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.239 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.239 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.239 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.239 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.239 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7fed08e4e640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7fed0415c840 0x7fed040c8d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:45246/0 (socket says 10.20.193.5:45246) 2026-02-17T21:25:36.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.193+0000 7fed08e4e640 1 -- 10.20.193.5:0/1878131111 learned_addr learned my addr 10.20.193.5:0/1878131111 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:36.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7ff915ba3640 1 --2- 10.20.193.5:0/4240688854 >> v2:10.20.193.119:3300/0 conn(0x7ff910152ae0 0x7ff91015edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7faea6d87640 1 Processor -- start 2026-02-17T21:25:36.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f08590d3640 1 Processor -- start 2026-02-17T21:25:36.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7faea6d87640 1 -- start start 2026-02-17T21:25:36.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7faea6d87640 10 monclient: init 2026-02-17T21:25:36.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7fb1f005f640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.241 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f6ce77fe640 1 --2- 10.20.193.5:0/801167734 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6ce8152ae0 0x7f6ce80c9c70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6ce80cbf60 tx=0x7f6cd802f1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2af53b6be8a1c8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.241 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f08590d3640 1 -- start start 2026-02-17T21:25:36.241 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f08590d3640 10 monclient: init 2026-02-17T21:25:36.241 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7fb1f005f640 10 monclient: _add_conns ranks=[0,1,4,2,3,5] 2026-02-17T21:25:36.241 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7fb1f005f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb1e8152700 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:36.242 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7fb1f005f640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fb1e815ef80 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:36.242 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7fb1f005f640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fb1e8152ae0 0x7fb1e80c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.242 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7fb1f005f640 10 monclient(hunting): picked mon.noname-b con 0x7fb1e8152ae0 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:36.242 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7fb1f005f640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1e815d4f0 con 0x7fb1e8152700 2026-02-17T21:25:36.242 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7fb1f005f640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1e815d7d0 con 0x7fb1e815ef80 2026-02-17T21:25:36.242 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7fb1f005f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.242 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7fb1f005f640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fb1e815dab0 con 0x7fb1e8152ae0 2026-02-17T21:25:36.242 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7fb1f005f640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.242 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7fb1f005f640 10 monclient(hunting): authenticate will time out at 1041.759487s 2026-02-17T21:25:36.242 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f7bc61c3640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.242 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f7bc61c3640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.242 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f7bc61c3640 10 monclient: monmap: 2026-02-17T21:25:36.242 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.242 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.242 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.195287+0000 2026-02-17T21:25:36.242 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.195287+0000 2026-02-17T21:25:36.242 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.243 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.243 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.243 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.243 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.243 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.243 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.243 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.243 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7faea6d87640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7faea6d87640 10 monclient: _add_conns ranks=[3,1,4,0,2,5] 2026-02-17T21:25:36.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7faea6d87640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7faea0152700 0x7faea015e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7faea6d87640 10 monclient(hunting): picked mon.noname-a con 0x7faea0152700 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:36.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7faea6d87640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7faea0152ae0 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:36.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7faea6d87640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7faea015edb0 0x7faea00c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7faea6d87640 10 monclient(hunting): picked mon.noname-b con 0x7faea015edb0 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:36.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7faea6d87640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faea015f1e0 con 0x7faea0152ae0 2026-02-17T21:25:36.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7faea6d87640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7faea6d87640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7faea015d4f0 con 0x7faea0152700 2026-02-17T21:25:36.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7faea6d87640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7faea6d87640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7faea015d7d0 con 0x7faea015edb0 2026-02-17T21:25:36.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7faea6d87640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7faea6d87640 10 monclient(hunting): authenticate will time out at 1041.759683s 2026-02-17T21:25:36.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f08590d3640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f08590d3640 10 monclient: _add_conns ranks=[4,1,0,5,2,3] 2026-02-17T21:25:36.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f08590d3640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0854153ef0 0x7f08540c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f08590d3640 10 monclient(hunting): picked mon.noname-b con 0x7f0854153ef0 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:36.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f08590d3640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f08540cccf0 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:36.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f08590d3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f08540c7990 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:36.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f630f7fe640 10 monclient(hunting): handle_auth_done global_id 4426 payload 293 2026-02-17T21:25:36.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f630f7fe640 1 -- 10.20.193.5:0/3219155852 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f62f4004900 msgr2=0x7f62f4004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f630f7fe640 1 --2- 10.20.193.5:0/3219155852 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f62f4004900 0x7f62f4004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f630f7fe640 1 -- 10.20.193.5:0/3219155852 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f62f40053e0 msgr2=0x7f62f400bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f630f7fe640 1 --2- 10.20.193.5:0/3219155852 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f62f40053e0 0x7f62f400bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f630ffff640 1 -- 10.20.193.5:0/3219155852 reap_dead start 2026-02-17T21:25:36.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f630f7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f630f7fe640 1 monclient: found mon.c 2026-02-17T21:25:36.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f630f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f630f7fe640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f630f7fe640 1 -- 10.20.193.5:0/3219155852 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f631015dd90 con 0x7f62f4003ba0 2026-02-17T21:25:36.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f630f7fe640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f630f7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f630f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f6315c43640 5 monclient: authenticate success, global_id 4426 2026-02-17T21:25:36.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f6315c43640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:36.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f08590d3640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0854074b20 con 0x7f08540c7990 2026-02-17T21:25:36.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f08590d3640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f085415ac20 con 0x7f08540cccf0 2026-02-17T21:25:36.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f08590d3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f08590d3640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f08540cd140 con 0x7f0854153ef0 2026-02-17T21:25:36.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f810dffb640 1 -- 10.20.193.5:0/2615823569 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f810402fb80 con 0x7f811014f280 2026-02-17T21:25:36.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f810dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f810dffb640 1 -- 10.20.193.5:0/2615823569 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8104037440 con 0x7f811014f280 2026-02-17T21:25:36.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f81158ea640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f81158ea640 4 set_mon_vals no callback set 2026-02-17T21:25:36.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f810dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f08590d3640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.194+0000 7f08590d3640 10 monclient(hunting): authenticate will time out at 1041.759964s 2026-02-17T21:25:36.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7f810dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:36.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7f810dffb640 10 monclient: dump: 2026-02-17T21:25:36.246 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.246 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.246 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.246 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.246 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.246 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.246 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.246 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.246 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.246 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7f7bc61c3640 1 Processor -- start 2026-02-17T21:25:36.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7ff915ba3640 10 monclient(hunting): get_auth_request con 0x7ff910152ae0 auth_method 0 2026-02-17T21:25:36.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7ff915ba3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7ff915ba3640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7ff915ba3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7f7bc61c3640 1 -- start start 2026-02-17T21:25:36.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7f7bc61c3640 10 monclient: init 2026-02-17T21:25:36.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7f81158ea640 10 monclient: shutdown 2026-02-17T21:25:36.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7f81158ea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7f81158ea640 1 -- 10.20.193.5:0/2615823569 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f811014f280 msgr2=0x7f81100c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7f81158ea640 1 --2- 10.20.193.5:0/2615823569 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f811014f280 0x7f81100c7e20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f81100c4740 tx=0x7f810402eeb0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7ff9153a2640 1 -- 10.20.193.5:0/4240688854 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1038123253 0 0) 0x7ff91015d4f0 con 0x7ff9100c9730 2026-02-17T21:25:36.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7ff9153a2640 10 monclient(hunting): _negotiate 2026-02-17T21:25:36.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7ff9153a2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7ff9153a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7ff9153a2640 10 monclient(hunting): my global_id is 4404 2026-02-17T21:25:36.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7ff9153a2640 1 -- 10.20.193.5:0/4240688854 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8f8003620 con 0x7ff9100c9730 2026-02-17T21:25:36.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7f81158ea640 1 -- 10.20.193.5:0/2615823569 shutdown_connections 2026-02-17T21:25:36.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7f81158ea640 1 --2- 10.20.193.5:0/2615823569 >> v2:10.20.193.135:3300/0 conn(0x7f811015abc0 0x7f811015afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7f81158ea640 1 --2- 10.20.193.5:0/2615823569 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f811014f280 0x7f81100c7e20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7f81158ea640 1 -- 10.20.193.5:0/2615823569 >> 10.20.193.5:0/2615823569 conn(0x7f81100c9f20 msgr2=0x7f81100ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7f81158ea640 1 -- 10.20.193.5:0/2615823569 shutdown_connections 2026-02-17T21:25:36.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7f7bc61c3640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7f7bc61c3640 10 monclient: _add_conns ranks=[3,4,2,1,0,5] 2026-02-17T21:25:36.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7f7bc61c3640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f7bc00ce5d0 0x7f7bc00d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7f7bc61c3640 10 monclient(hunting): picked mon.noname-a con 0x7f7bc00ce5d0 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:36.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7f7bc61c3640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f7bc015bf30 0x7f7bc00ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7f7bc61c3640 10 monclient(hunting): picked mon.noname-b con 0x7f7bc015bf30 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:36.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.195+0000 7f7bc61c3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7bc00ceef0 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:36.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.196+0000 7f7bc61c3640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bc00d1e00 con 0x7f7bc00ceef0 2026-02-17T21:25:36.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.196+0000 7f7bc61c3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.196+0000 7f7bc61c3640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7bc00d20d0 con 0x7f7bc00ce5d0 2026-02-17T21:25:36.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.196+0000 7f7bc61c3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.196+0000 7f7bc61c3640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f7bc00d23b0 con 0x7f7bc015bf30 2026-02-17T21:25:36.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.196+0000 7f7bc61c3640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.196+0000 7f7bc61c3640 10 monclient(hunting): authenticate will time out at 1041.761028s 2026-02-17T21:25:36.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.196+0000 7f81158ea640 1 -- 10.20.193.5:0/2615823569 wait complete. 2026-02-17T21:25:36.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.196+0000 7ff915ba3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.196+0000 7ff915ba3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.196+0000 7ff915ba3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.196+0000 7faae6598640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7faae015edb0 0x7faae00c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.196+0000 7f81158ea640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.196+0000 7f81158ea640 10 monclient: monmap: 2026-02-17T21:25:36.250 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.250 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.250 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.250 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.250 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.250 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.250 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.250 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.250 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.250 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.196+0000 7f630f7fe640 1 --2- 10.20.193.5:0/3219155852 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f62f4003ba0 0x7f62f4003fc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f62f40058b0 tx=0x7f62fc02ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c7c60c20177ef02 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.196+0000 7f81158ea640 1 librados: starting msgr at 2026-02-17T21:25:36.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.196+0000 7f81158ea640 1 librados: starting objecter 2026-02-17T21:25:36.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.196+0000 7f81158ea640 1 Processor -- start 2026-02-17T21:25:36.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.196+0000 7f81158ea640 1 -- start start 2026-02-17T21:25:36.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.196+0000 7f81158ea640 1 librados: setting wanted keys 2026-02-17T21:25:36.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.196+0000 7f81158ea640 1 librados: calling monclient init 2026-02-17T21:25:36.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.196+0000 7f81158ea640 10 monclient: init 2026-02-17T21:25:36.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.196+0000 7facfa1a1640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.196+0000 7facfa1a1640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7facfa1a1640 10 monclient: monmap: 2026-02-17T21:25:36.251 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.251 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.251 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.197657+0000 2026-02-17T21:25:36.251 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.197657+0000 2026-02-17T21:25:36.251 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.251 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.251 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.251 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.251 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.251 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.251 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.251 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.251 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7f81158ea640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7f81158ea640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:25:36.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7f81158ea640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f811014f280 0x7f81101f2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7f81158ea640 10 monclient(hunting): picked mon.noname-b con 0x7f811014f280 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7f81158ea640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f811014f660 0x7f811013e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7f81158ea640 10 monclient(hunting): picked mon.noname-c con 0x7f811014f660 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7f81158ea640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f811015abc0 0x7f811006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7f81158ea640 10 monclient(hunting): picked mon.noname-a con 0x7f811015abc0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7f81158ea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7f81158ea640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f811015a3c0 con 0x7f811015abc0 2026-02-17T21:25:36.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7f81158ea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7f81158ea640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f811015a0e0 con 0x7f811014f280 2026-02-17T21:25:36.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7f81158ea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7f81158ea640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f811015b520 con 0x7f811014f660 2026-02-17T21:25:36.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7fd56f7fe640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fd57015ef80 0x7fd5700c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7f81158ea640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7f81158ea640 10 monclient(hunting): authenticate will time out at 1041.762434s 2026-02-17T21:25:36.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7facfa1a1640 1 Processor -- start 2026-02-17T21:25:36.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7facfa1a1640 1 -- start start 2026-02-17T21:25:36.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7facfa1a1640 10 monclient: init 2026-02-17T21:25:36.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7f7bbffff640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f7bc00ceef0 0x7f7bc00c9780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:45268/0 (socket says 10.20.193.5:45268) 2026-02-17T21:25:36.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7f7bbffff640 1 -- 10.20.193.5:0/2797569799 learned_addr learned my addr 10.20.193.5:0/2797569799 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:36.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7f7bbf7fe640 1 --2- 10.20.193.5:0/2797569799 >> v2:10.20.193.5:3300/0 conn(0x7f7bc00ce5d0 0x7f7bc00d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7ff915ba3640 10 monclient(hunting): handle_auth_done global_id 4435 payload 274 2026-02-17T21:25:36.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7ff915ba3640 1 -- 10.20.193.5:0/4240688854 >> v2:10.20.193.5:3300/0 conn(0x7ff910152700 msgr2=0x7ff91015e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7ff915ba3640 1 --2- 10.20.193.5:0/4240688854 >> v2:10.20.193.5:3300/0 conn(0x7ff910152700 0x7ff91015e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7ff915ba3640 1 -- 10.20.193.5:0/4240688854 >> v1:10.20.193.5:6789/0 conn(0x7ff9100c9730 legacy=0x7ff9100c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7ff915ba3640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7ff915ba3640 1 monclient: found mon.noname-b 2026-02-17T21:25:36.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7ff915ba3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7ff915ba3640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.197+0000 7ff915ba3640 1 -- 10.20.193.5:0/4240688854 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff91015dd90 con 0x7ff910152ae0 2026-02-17T21:25:36.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7faae6598640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7faae015edb0 0x7faae00c9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:37662/0 (socket says 10.20.193.5:37662) 2026-02-17T21:25:36.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7faae6598640 1 -- 10.20.193.5:0/1392796368 learned_addr learned my addr 10.20.193.5:0/1392796368 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7faae6598640 10 monclient(hunting): get_auth_request con 0x7faae015edb0 auth_method 0 2026-02-17T21:25:36.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7faae6598640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7faae6598640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7faae6598640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7facfa1a1640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7facfa1a1640 10 monclient: _add_conns ranks=[1,5,3,2,0,4] 2026-02-17T21:25:36.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7facfa1a1640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7facf40d1b60 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:36.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7facfa1a1640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7facf40d1f40 0x7facf415c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7facfa1a1640 10 monclient(hunting): picked mon.noname-c con 0x7facf40d1f40 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:36.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7facfa1a1640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7facf415d950 0x7facf415dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7facfa1a1640 10 monclient(hunting): picked mon.noname-a con 0x7facf415d950 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:36.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7facfa1a1640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facf415e2d0 con 0x7facf40d1b60 2026-02-17T21:25:36.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7facfa1a1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7facfa1a1640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7facf415cd80 con 0x7facf415d950 2026-02-17T21:25:36.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7facfa1a1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7facfa1a1640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7facf40ca460 con 0x7facf40d1f40 2026-02-17T21:25:36.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7facfa1a1640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7facfa1a1640 10 monclient(hunting): authenticate will time out at 1041.763161s 2026-02-17T21:25:36.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7faae5d97640 1 --2- 10.20.193.5:0/1392796368 >> v2:10.20.193.5:3300/0 conn(0x7faae0152700 0x7faae015e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7fd56f7fe640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fd57015ef80 0x7fd5700c9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:47634/0 (socket says 10.20.193.5:47634) 2026-02-17T21:25:36.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7fd56f7fe640 1 -- 10.20.193.5:0/3661851273 learned_addr learned my addr 10.20.193.5:0/3661851273 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7fd56f7fe640 10 monclient(hunting): get_auth_request con 0x7fd57015ef80 auth_method 0 2026-02-17T21:25:36.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7fd56f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7fd56f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7fd56f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7faae6598640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7faae6598640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.198+0000 7faae6598640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.199+0000 7fd56f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.199+0000 7fd56f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.199+0000 7fd56f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.199+0000 7fec3133b640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.199+0000 7fec3133b640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.199+0000 7fec3133b640 10 monclient: monmap: 2026-02-17T21:25:36.255 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.256 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.256 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.200233+0000 2026-02-17T21:25:36.256 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.200233+0000 2026-02-17T21:25:36.256 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.256 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.256 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.256 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.256 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.256 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.256 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.256 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.256 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.199+0000 7fecf3fff640 1 -- 10.20.193.5:0/1878131111 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3104480324 0 0) 0x7fed040c9bc0 con 0x7fed0415c840 2026-02-17T21:25:36.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.199+0000 7fecf3fff640 10 monclient(hunting): _negotiate 2026-02-17T21:25:36.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.199+0000 7fecf3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.199+0000 7fecf3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.199+0000 7fecf3fff640 10 monclient(hunting): my global_id is 4439 2026-02-17T21:25:36.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.199+0000 7fecf3fff640 1 -- 10.20.193.5:0/1878131111 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecec003620 con 0x7fed0415c840 2026-02-17T21:25:36.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.199+0000 7fec3133b640 1 Processor -- start 2026-02-17T21:25:36.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7fec3133b640 1 -- start start 2026-02-17T21:25:36.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7fec3133b640 10 monclient: init 2026-02-17T21:25:36.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7faae6598640 10 monclient(hunting): handle_auth_done global_id 4438 payload 274 2026-02-17T21:25:36.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7faae6598640 1 -- 10.20.193.5:0/1392796368 >> v2:10.20.193.5:3300/0 conn(0x7faae0152700 msgr2=0x7faae015e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7faae6598640 1 --2- 10.20.193.5:0/1392796368 >> v2:10.20.193.5:3300/0 conn(0x7faae0152700 0x7faae015e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7faae6598640 1 -- 10.20.193.5:0/1392796368 >> v1:10.20.193.119:6789/0 conn(0x7faae0152ae0 legacy=0x7faae00c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7faae6598640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7faae6598640 1 monclient: found mon.noname-b 2026-02-17T21:25:36.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7faae6598640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7faae6598640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7faae6598640 1 -- 10.20.193.5:0/1392796368 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae015dab0 con 0x7faae015edb0 2026-02-17T21:25:36.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7ff915ba3640 1 --2- 10.20.193.5:0/4240688854 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff910152ae0 0x7ff91015edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff91008e820 tx=0x7ff90402edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ea5eedac5317d65 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7f78bef34640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7f78bef34640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7f78bef34640 10 monclient: monmap: 2026-02-17T21:25:36.257 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.257 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.258 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.200994+0000 2026-02-17T21:25:36.258 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.200994+0000 2026-02-17T21:25:36.258 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.258 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.258 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.258 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.258 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.258 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.258 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.258 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.258 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7fec3133b640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7f7bbf7fe640 10 monclient(hunting): get_auth_request con 0x7f7bc00ce5d0 auth_method 0 2026-02-17T21:25:36.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7f7bbf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7f7bbf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7f7bbf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7fec3133b640 10 monclient: _add_conns ranks=[2,5,1,3,0,4] 2026-02-17T21:25:36.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7fec3133b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fec2c1525f0 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:36.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7fec3133b640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fec2c1529d0 0x7fec2c0c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7fec3133b640 10 monclient(hunting): picked mon.noname-c con 0x7fec2c1529d0 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:36.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7fec3133b640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fec2c0d2470 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:36.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7fec3133b640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec2c0c94e0 con 0x7fec2c0d2470 2026-02-17T21:25:36.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7fec3133b640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec2c0c97c0 con 0x7fec2c1525f0 2026-02-17T21:25:36.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7fec3133b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7fec3133b640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fec2c0c9aa0 con 0x7fec2c1529d0 2026-02-17T21:25:36.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7fec3133b640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7fec3133b640 10 monclient(hunting): authenticate will time out at 1041.765660s 2026-02-17T21:25:36.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7f78bef34640 1 Processor -- start 2026-02-17T21:25:36.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7fd56f7fe640 10 monclient(hunting): handle_auth_done global_id 4442 payload 274 2026-02-17T21:25:36.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7fd56f7fe640 1 -- 10.20.193.5:0/3661851273 >> v1:10.20.193.135:6789/0 conn(0x7fd570152ae0 legacy=0x7fd5700c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7fd56f7fe640 1 -- 10.20.193.5:0/3661851273 >> v1:10.20.193.119:6789/0 conn(0x7fd570152700 legacy=0x7fd57015e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7fd56f7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7f78bef34640 1 -- start start 2026-02-17T21:25:36.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7fd56f7fe640 1 monclient: found mon.noname-c 2026-02-17T21:25:36.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7fd56f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7fd56f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7fd56f7fe640 1 -- 10.20.193.5:0/3661851273 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd57015dd90 con 0x7fd57015ef80 2026-02-17T21:25:36.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7f58e4b01640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7f58e4b01640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7f58e4b01640 10 monclient: monmap: 2026-02-17T21:25:36.259 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.260 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.260 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.201464+0000 2026-02-17T21:25:36.260 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.201464+0000 2026-02-17T21:25:36.260 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.260 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.260 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.260 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.260 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.260 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.260 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.260 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.260 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.200+0000 7f78bef34640 10 monclient: init 2026-02-17T21:25:36.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.201+0000 7f78bef34640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.201+0000 7f78bef34640 10 monclient: _add_conns ranks=[1,4,0,5,2,3] 2026-02-17T21:25:36.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.201+0000 7faea4afc640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7faea0152700 0x7faea015e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.201+0000 7f78bef34640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f78b80d1b60 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:36.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.201+0000 7f78bef34640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f78b80d1f40 0x7f78b815c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.201+0000 7f78bef34640 10 monclient(hunting): picked mon.noname-b con 0x7f78b80d1f40 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:36.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.201+0000 7f78bef34640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f78b815d950 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:36.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.201+0000 7f78bef34640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b80c98e0 con 0x7f78b815d950 2026-02-17T21:25:36.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.201+0000 7f78bef34640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b80c9bc0 con 0x7f78b80d1b60 2026-02-17T21:25:36.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.201+0000 7f78bef34640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.201+0000 7f58e4b01640 1 Processor -- start 2026-02-17T21:25:36.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.201+0000 7f78bef34640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f78b815cd80 con 0x7f78b80d1f40 2026-02-17T21:25:36.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.201+0000 7f78bef34640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.201+0000 7f78bef34640 10 monclient(hunting): authenticate will time out at 1041.766615s 2026-02-17T21:25:36.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.201+0000 7faea4afc640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7faea0152700 0x7faea015e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:50058/0 (socket says 10.20.193.5:50058) 2026-02-17T21:25:36.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.201+0000 7faea4afc640 1 -- 10.20.193.5:0/1232423512 learned_addr learned my addr 10.20.193.5:0/1232423512 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.201+0000 7faea4afc640 10 monclient(hunting): get_auth_request con 0x7faea0152700 auth_method 0 2026-02-17T21:25:36.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.201+0000 7faea4afc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.201+0000 7faea4afc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.201+0000 7faea4afc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.201+0000 7f58e4b01640 1 -- start start 2026-02-17T21:25:36.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.201+0000 7f58e4b01640 10 monclient: init 2026-02-17T21:25:36.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.201+0000 7f7bbf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.201+0000 7f7bbf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.201+0000 7f7bbf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f630e7fc640 1 -- 10.20.193.5:0/3219155852 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62fc002cc0 con 0x7f62f4003ba0 2026-02-17T21:25:36.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f630e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f630e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:36.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f630e7fc640 10 monclient: dump: 2026-02-17T21:25:36.262 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.262 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.262 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.262 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.262 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.262 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.262 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.262 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.262 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.262 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f630e7fc640 1 -- 10.20.193.5:0/3219155852 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62fc0052d0 con 0x7f62f4003ba0 2026-02-17T21:25:36.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f6315c43640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:36.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f58e4b01640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.263 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7faea4afc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.263 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f630e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.263 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f630e7fc640 1 -- 10.20.193.5:0/3219155852 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62fc0036f0 con 0x7f62f4003ba0 2026-02-17T21:25:36.263 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f6315c43640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.263 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f58e4b01640 10 monclient: _add_conns ranks=[2,5,1,0,3,4] 2026-02-17T21:25:36.263 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7faea4afc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.263 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f6315c43640 4 set_mon_vals no callback set 2026-02-17T21:25:36.263 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f58e4b01640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f58e0152700 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:36.263 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f58e4b01640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f58e015ef80 0x7f58e00c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.263 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7faea4afc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f58e4b01640 10 monclient(hunting): picked mon.noname-c con 0x7f58e015ef80 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:36.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f58e4b01640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f58e0152ae0 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:36.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f58e4b01640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e015d4f0 con 0x7f58e0152ae0 2026-02-17T21:25:36.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f58e4b01640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e015d7d0 con 0x7f58e0152700 2026-02-17T21:25:36.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f58e4b01640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f58e4b01640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f58e015dab0 con 0x7f58e015ef80 2026-02-17T21:25:36.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f630e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f58e4b01640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f58e4b01640 10 monclient(hunting): authenticate will time out at 1041.767239s 2026-02-17T21:25:36.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f630e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:36.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f630e7fc640 10 monclient: dump: 2026-02-17T21:25:36.264 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.264 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.264 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.264 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.264 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.264 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.264 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.264 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.264 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.264 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7faae6598640 1 --2- 10.20.193.5:0/1392796368 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faae015edb0 0x7faae00c9e40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faae00cbf90 tx=0x7faadc02f270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3cf2337b8e93ff1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f0853577640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f08540c7990 0x7f085415d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:42870/0 (socket says 10.20.193.5:42870) 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f0853577640 1 -- 10.20.193.5:0/2503829673 learned_addr learned my addr 10.20.193.5:0/2503829673 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f2d5a7fc640 1 -- 10.20.193.5:0/151160618 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4803c070 con 0x7f2d5c15f570 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f2d5a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f2d5a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f2d5a7fc640 10 monclient: dump: 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f2d5a7fc640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f2d5a7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f2d5a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f2d62134640 5 monclient: authenticate success, global_id 4429 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f2d62134640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f2d5a7fc640 1 -- 10.20.193.5:0/151160618 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d4802fb60 con 0x7f2d5c15f570 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f2d5a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f2d62134640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f2d5a7fc640 1 -- 10.20.193.5:0/151160618 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d48037440 con 0x7f2d5c15f570 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f2d5a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f2d62134640 4 set_mon_vals no callback set 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f2d5a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f2d5a7fc640 10 monclient: dump: 2026-02-17T21:25:36.265 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.266 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.266 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.266 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.266 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.266 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.266 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.266 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.266 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.266 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f6315c43640 10 monclient: shutdown 2026-02-17T21:25:36.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f6315c43640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f6315c43640 1 -- 10.20.193.5:0/3219155852 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f62f4003ba0 msgr2=0x7f62f4003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f6315c43640 1 --2- 10.20.193.5:0/3219155852 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f62f4003ba0 0x7f62f4003fc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f62f40058b0 tx=0x7f62fc02ecf0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f7bbe7fc640 1 -- 10.20.193.5:0/2797569799 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 321310653 0 0) 0x7f7bc00d1e00 con 0x7f7bc00ceef0 2026-02-17T21:25:36.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f7bbe7fc640 10 monclient(hunting): _negotiate 2026-02-17T21:25:36.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f7bbe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f7bbe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f7bbe7fc640 10 monclient(hunting): my global_id is 4445 2026-02-17T21:25:36.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f7bbe7fc640 1 -- 10.20.193.5:0/2797569799 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ba4003620 con 0x7f7bc00ceef0 2026-02-17T21:25:36.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f6315c43640 1 -- 10.20.193.5:0/3219155852 shutdown_connections 2026-02-17T21:25:36.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f6315c43640 1 --2- 10.20.193.5:0/3219155852 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f62f4003ba0 0x7f62f4003fc0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f6315c43640 1 -- 10.20.193.5:0/3219155852 >> 10.20.193.5:0/3219155852 conn(0x7f6310073030 msgr2=0x7f6310073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f6315c43640 1 -- 10.20.193.5:0/3219155852 shutdown_connections 2026-02-17T21:25:36.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f6315c43640 1 -- 10.20.193.5:0/3219155852 wait complete. 2026-02-17T21:25:36.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7facf2ffd640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7facf40d1f40 0x7facf415c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.202+0000 7f810e7fc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f811014f660 0x7f811013e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f2d62134640 10 monclient: shutdown 2026-02-17T21:25:36.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f2d62134640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f2d62134640 1 -- 10.20.193.5:0/151160618 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2d5c15f570 msgr2=0x7f2d5c15f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f2d62134640 1 --2- 10.20.193.5:0/151160618 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2d5c15f570 0x7f2d5c15f950 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2d48009970 tx=0x7f2d4802eef0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7facf2ffd640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7facf40d1f40 0x7facf415c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:47650/0 (socket says 10.20.193.5:47650) 2026-02-17T21:25:36.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7facf2ffd640 1 -- 10.20.193.5:0/1040105092 learned_addr learned my addr 10.20.193.5:0/1040105092 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7facf2ffd640 10 monclient(hunting): get_auth_request con 0x7facf40d1f40 auth_method 0 2026-02-17T21:25:36.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7facf2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7facf2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7facf2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f810e7fc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f811014f660 0x7f811013e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:47642/0 (socket says 10.20.193.5:47642) 2026-02-17T21:25:36.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f810e7fc640 1 -- 10.20.193.5:0/2466161818 learned_addr learned my addr 10.20.193.5:0/2466161818 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f810e7fc640 10 monclient(hunting): get_auth_request con 0x7f811014f660 auth_method 0 2026-02-17T21:25:36.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f810e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f810e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f810e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f7bbf7fe640 10 monclient(hunting): handle_auth_done global_id 4407 payload 274 2026-02-17T21:25:36.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f7bbf7fe640 1 -- 10.20.193.5:0/2797569799 >> v2:10.20.193.119:3300/0 conn(0x7f7bc015bf30 msgr2=0x7f7bc00ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f7bbf7fe640 1 --2- 10.20.193.5:0/2797569799 >> v2:10.20.193.119:3300/0 conn(0x7f7bc015bf30 0x7f7bc00ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f7bbf7fe640 1 -- 10.20.193.5:0/2797569799 >> v1:10.20.193.135:6789/0 conn(0x7f7bc00ceef0 legacy=0x7f7bc00c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f7bbf7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f7bbf7fe640 1 monclient: found mon.noname-a 2026-02-17T21:25:36.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f7bbf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f7bbf7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f7bbf7fe640 1 -- 10.20.193.5:0/2797569799 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bc00d2690 con 0x7f7bc00ce5d0 2026-02-17T21:25:36.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f6315c43640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f6315c43640 10 monclient: monmap: 2026-02-17T21:25:36.268 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.268 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.268 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.268 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.268 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.268 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.268 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.268 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.268 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.268 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7facf2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7facf2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7fb1ee5d5640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fb1e8152ae0 0x7fb1e80c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7facf2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f6315c43640 1 librados: starting msgr at 2026-02-17T21:25:36.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f6315c43640 1 librados: starting objecter 2026-02-17T21:25:36.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f6315c43640 1 Processor -- start 2026-02-17T21:25:36.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f2d62134640 1 -- 10.20.193.5:0/151160618 shutdown_connections 2026-02-17T21:25:36.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f2d62134640 1 --2- 10.20.193.5:0/151160618 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2d5c15f570 0x7f2d5c15f950 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f2d62134640 1 -- 10.20.193.5:0/151160618 >> 10.20.193.5:0/151160618 conn(0x7f2d5c0c9f40 msgr2=0x7f2d5c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f810e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f810e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f810e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f2d62134640 1 -- 10.20.193.5:0/151160618 shutdown_connections 2026-02-17T21:25:36.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.203+0000 7f2d62134640 1 -- 10.20.193.5:0/151160618 wait complete. 2026-02-17T21:25:36.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.204+0000 7fb1ee5d5640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fb1e8152ae0 0x7fb1e80c9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:37676/0 (socket says 10.20.193.5:37676) 2026-02-17T21:25:36.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.204+0000 7fb1ee5d5640 1 -- 10.20.193.5:0/3271407630 learned_addr learned my addr 10.20.193.5:0/3271407630 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.204+0000 7fb1ee5d5640 10 monclient(hunting): get_auth_request con 0x7fb1e8152ae0 auth_method 0 2026-02-17T21:25:36.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.204+0000 7fb1ee5d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.204+0000 7fb1ee5d5640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.204+0000 7fb1ee5d5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.204+0000 7f2d62134640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.204+0000 7f2d62134640 10 monclient: monmap: 2026-02-17T21:25:36.270 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.270 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.270 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.270 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.270 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.270 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.270 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.270 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.270 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.270 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.204+0000 7f2d62134640 1 librados: starting msgr at 2026-02-17T21:25:36.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.204+0000 7f2d62134640 1 librados: starting objecter 2026-02-17T21:25:36.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.204+0000 7f2d62134640 1 Processor -- start 2026-02-17T21:25:36.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.204+0000 7f6315c43640 1 -- start start 2026-02-17T21:25:36.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.204+0000 7f6315c43640 1 librados: setting wanted keys 2026-02-17T21:25:36.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.204+0000 7f6315c43640 1 librados: calling monclient init 2026-02-17T21:25:36.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.204+0000 7f6315c43640 10 monclient: init 2026-02-17T21:25:36.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.204+0000 7faea52fd640 1 --2- 10.20.193.5:0/1232423512 >> v2:10.20.193.119:3300/0 conn(0x7faea015edb0 0x7faea00c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f2d62134640 1 -- start start 2026-02-17T21:25:36.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f2d62134640 1 librados: setting wanted keys 2026-02-17T21:25:36.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f2d62134640 1 librados: calling monclient init 2026-02-17T21:25:36.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f2d62134640 10 monclient: init 2026-02-17T21:25:36.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f6315c43640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f6315c43640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:25:36.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f6315c43640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f62f4003ba0 0x7f63101f4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f6315c43640 10 monclient(hunting): picked mon.noname-c con 0x7f62f4003ba0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f6315c43640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6310144960 0x7f6310141150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f6315c43640 10 monclient(hunting): picked mon.noname-a con 0x7f6310144960 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f6315c43640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6310141690 0x7f63100d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f6315c43640 10 monclient(hunting): picked mon.noname-b con 0x7f6310141690 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f6315c43640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f6315c43640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f631015e870 con 0x7f6310144960 2026-02-17T21:25:36.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f6315c43640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f6315c43640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f631015e350 con 0x7f6310141690 2026-02-17T21:25:36.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f6315c43640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f6315c43640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f631015e9f0 con 0x7f62f4003ba0 2026-02-17T21:25:36.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f6315c43640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f6315c43640 10 monclient(hunting): authenticate will time out at 1041.770159s 2026-02-17T21:25:36.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7fed0964f640 1 --2- 10.20.193.5:0/1878131111 >> v2:10.20.193.119:3300/0 conn(0x7fed040d1b60 0x7fed040d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f2d62134640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f2d62134640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:25:36.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f2d62134640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2d5c0be810 0x7f2d5c1f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f2d62134640 10 monclient(hunting): picked mon.noname-c con 0x7f2d5c0be810 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f2d62134640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2d5c155770 0x7f2d5c0c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f2d62134640 10 monclient(hunting): picked mon.noname-a con 0x7f2d5c155770 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f2d62134640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2d5c15f570 0x7f2d5c0c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f2d62134640 10 monclient(hunting): picked mon.noname-b con 0x7f2d5c15f570 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f2d62134640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f2d62134640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c0bf9f0 con 0x7f2d5c155770 2026-02-17T21:25:36.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f2d62134640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f2d62134640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c0bfd60 con 0x7f2d5c15f570 2026-02-17T21:25:36.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f2d62134640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f2d62134640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c15d910 con 0x7f2d5c0be810 2026-02-17T21:25:36.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f2d62134640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f2d62134640 10 monclient(hunting): authenticate will time out at 1041.770453s 2026-02-17T21:25:36.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7faea4afc640 10 monclient(hunting): handle_auth_done global_id 4410 payload 274 2026-02-17T21:25:36.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7faea4afc640 1 -- 10.20.193.5:0/1232423512 >> v2:10.20.193.119:3300/0 conn(0x7faea015edb0 msgr2=0x7faea00c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7faea4afc640 1 --2- 10.20.193.5:0/1232423512 >> v2:10.20.193.119:3300/0 conn(0x7faea015edb0 0x7faea00c9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7fed0964f640 10 monclient(hunting): get_auth_request con 0x7fed040d1b60 auth_method 0 2026-02-17T21:25:36.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7fed0964f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7fed0964f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7faea4afc640 1 -- 10.20.193.5:0/1232423512 >> v1:10.20.193.119:6789/0 conn(0x7faea0152ae0 legacy=0x7faea00c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7faea4afc640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7fed0964f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7faea4afc640 1 monclient: found mon.noname-a 2026-02-17T21:25:36.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7faea4afc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7faea4afc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7faea4afc640 1 -- 10.20.193.5:0/1232423512 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea015dab0 con 0x7faea0152700 2026-02-17T21:25:36.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7fb1ee5d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7fb1ee5d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7fb1ee5d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.205+0000 7f7bbf7fe640 1 --2- 10.20.193.5:0/2797569799 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7bc00ce5d0 0x7f7bc00d18c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7bc015d030 tx=0x7f7bac02ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a10381d75690611 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.206+0000 7facf2ffd640 10 monclient(hunting): handle_auth_done global_id 4448 payload 274 2026-02-17T21:25:36.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.206+0000 7facf2ffd640 1 -- 10.20.193.5:0/1040105092 >> v2:10.20.193.5:3300/0 conn(0x7facf415d950 msgr2=0x7facf415dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.206+0000 7facf2ffd640 1 --2- 10.20.193.5:0/1040105092 >> v2:10.20.193.5:3300/0 conn(0x7facf415d950 0x7facf415dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.206+0000 7facf2ffd640 1 -- 10.20.193.5:0/1040105092 >> v1:10.20.193.119:6789/0 conn(0x7facf40d1b60 legacy=0x7facf40c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.206+0000 7facf2ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.206+0000 7facf2ffd640 1 monclient: found mon.noname-c 2026-02-17T21:25:36.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.206+0000 7facf2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.206+0000 7facf2ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.206+0000 7facf2ffd640 1 -- 10.20.193.5:0/1040105092 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf40c98e0 con 0x7facf40d1f40 2026-02-17T21:25:36.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.206+0000 7fed0964f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.206+0000 7fed0964f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.206+0000 7fed0964f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.206+0000 7faea4afc640 1 --2- 10.20.193.5:0/1232423512 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7faea0152700 0x7faea015e870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faea00cbf90 tx=0x7fae9002eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b2c311178076e8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.207+0000 7fed0964f640 10 monclient(hunting): handle_auth_done global_id 4444 payload 274 2026-02-17T21:25:36.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.207+0000 7fed0964f640 1 -- 10.20.193.5:0/1878131111 >> v1:10.20.193.135:6789/0 conn(0x7fed0415c840 legacy=0x7fed040c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.207+0000 7fed0964f640 1 -- 10.20.193.5:0/1878131111 >> v1:10.20.193.119:6789/0 conn(0x7fed0415d950 legacy=0x7fed0415dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.207+0000 7fed0964f640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.207+0000 7fed0964f640 1 monclient: found mon.noname-b 2026-02-17T21:25:36.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.207+0000 7fed0964f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.207+0000 7fed0964f640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.207+0000 7fed0964f640 1 -- 10.20.193.5:0/1878131111 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed040c9ea0 con 0x7fed040d1b60 2026-02-17T21:25:36.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.207+0000 7f810e7fc640 10 monclient(hunting): handle_auth_done global_id 4451 payload 824 2026-02-17T21:25:36.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.207+0000 7f810e7fc640 1 -- 10.20.193.5:0/2466161818 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f811014f280 msgr2=0x7f81101f2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.207+0000 7f810e7fc640 1 --2- 10.20.193.5:0/2466161818 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f811014f280 0x7f81101f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.207+0000 7f810e7fc640 1 -- 10.20.193.5:0/2466161818 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f811015abc0 msgr2=0x7f811006eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.207+0000 7f810e7fc640 1 --2- 10.20.193.5:0/2466161818 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f811015abc0 0x7f811006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.207+0000 7f810e7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.207+0000 7f810e7fc640 1 monclient: found mon.noname-c 2026-02-17T21:25:36.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.207+0000 7f810e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.207+0000 7f810e7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.207+0000 7f810e7fc640 1 -- 10.20.193.5:0/2466161818 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81101f58f0 con 0x7f811014f660 2026-02-17T21:25:36.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.208+0000 7f0852d76640 1 --2- 10.20.193.5:0/2503829673 >> v2:10.20.193.119:3300/0 conn(0x7f0854153ef0 0x7f08540c2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.208+0000 7f0852d76640 10 monclient(hunting): get_auth_request con 0x7f0854153ef0 auth_method 0 2026-02-17T21:25:36.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.208+0000 7f0852d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.208+0000 7f0852d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.208+0000 7f0852d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f6ce5ffb640 1 -- 10.20.193.5:0/801167734 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd803c070 con 0x7f6ce8152ae0 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f6ce5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f6ce5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f6ce5ffb640 10 monclient: dump: 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f6ce5ffb640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f6ce5ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f6ce5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f6ce5ffb640 1 -- 10.20.193.5:0/801167734 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cd802fe30 con 0x7f6ce8152ae0 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f6ce5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f6ce5ffb640 1 -- 10.20.193.5:0/801167734 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8037640 con 0x7f6ce8152ae0 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f6ced9a1640 5 monclient: authenticate success, global_id 4432 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f6ced9a1640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f6ced9a1640 4 set_mon_vals no callback set 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f6ce5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f6ce5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f6ce5ffb640 10 monclient: dump: 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f0852d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f0852d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f0852d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f0851d74640 1 -- 10.20.193.5:0/2503829673 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2997372622 0 0) 0x7f0854074b20 con 0x7f08540c7990 2026-02-17T21:25:36.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f0851d74640 10 monclient(hunting): _negotiate 2026-02-17T21:25:36.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f0851d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f0851d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f0851d74640 10 monclient(hunting): my global_id is 4413 2026-02-17T21:25:36.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f0851d74640 1 -- 10.20.193.5:0/2503829673 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0840003620 con 0x7f08540c7990 2026-02-17T21:25:36.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7facf2ffd640 1 --2- 10.20.193.5:0/1040105092 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7facf40d1f40 0x7facf415c840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7facf408fc80 tx=0x7face402eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b984568058878e21 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f6ced9a1640 10 monclient: shutdown 2026-02-17T21:25:36.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f6ced9a1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f6ced9a1640 1 -- 10.20.193.5:0/801167734 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6ce8152ae0 msgr2=0x7f6ce80c9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.209+0000 7f6ced9a1640 1 --2- 10.20.193.5:0/801167734 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6ce8152ae0 0x7f6ce80c9c70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6ce80cbf60 tx=0x7f6cd802f1c0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f6ced9a1640 1 -- 10.20.193.5:0/801167734 shutdown_connections 2026-02-17T21:25:36.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f6ced9a1640 1 --2- 10.20.193.5:0/801167734 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6ce8152ae0 0x7f6ce80c9c70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f6ced9a1640 1 --2- 10.20.193.5:0/801167734 >> v2:10.20.193.5:3300/0 conn(0x7f6ce815ef80 0x7f6ce80c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f6ced9a1640 1 -- 10.20.193.5:0/801167734 >> 10.20.193.5:0/801167734 conn(0x7f6ce8073030 msgr2=0x7f6ce8073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f6ced9a1640 1 -- 10.20.193.5:0/801167734 shutdown_connections 2026-02-17T21:25:36.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f6ced9a1640 1 -- 10.20.193.5:0/801167734 wait complete. 2026-02-17T21:25:36.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f810e7fc640 1 --2- 10.20.193.5:0/2466161818 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f811014f660 0x7f811013e5b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f80f800c730 tx=0x7f80f800cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f80e7fff640 10 client.?.objecter ms_handle_connect 0x7f811014f660 2026-02-17T21:25:36.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f80e7fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f6ced9a1640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f6ced9a1640 10 monclient: monmap: 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f0852d76640 10 monclient(hunting): handle_auth_done global_id 4447 payload 274 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f0852d76640 1 -- 10.20.193.5:0/2503829673 >> v1:10.20.193.119:6789/0 conn(0x7f08540cccf0 legacy=0x7f08540c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f0852d76640 1 -- 10.20.193.5:0/2503829673 >> v1:10.20.193.5:6789/0 conn(0x7f08540c7990 legacy=0x7f085415d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f0852d76640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f0852d76640 1 monclient: found mon.noname-b 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f0852d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f0852d76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f0852d76640 1 -- 10.20.193.5:0/2503829673 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08540c93e0 con 0x7f0854153ef0 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f6ced9a1640 1 librados: starting msgr at 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f6ced9a1640 1 librados: starting objecter 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f6ced9a1640 1 Processor -- start 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f6ced9a1640 1 -- start start 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f6ced9a1640 1 librados: setting wanted keys 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f6ced9a1640 1 librados: calling monclient init 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.210+0000 7f6ced9a1640 10 monclient: init 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bbe7fc640 1 -- 10.20.193.5:0/2797569799 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bac03c070 con 0x7f7bc00ce5d0 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bbe7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bbe7fc640 10 monclient: dump: 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bbe7fc640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bbe7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bbe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bbe7fc640 1 -- 10.20.193.5:0/2797569799 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bac02faf0 con 0x7f7bc00ce5d0 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bbe7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bbe7fc640 1 -- 10.20.193.5:0/2797569799 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bac037440 con 0x7f7bc00ce5d0 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bc61c3640 5 monclient: authenticate success, global_id 4407 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bc61c3640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bc61c3640 4 set_mon_vals no callback set 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bbe7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bbe7fc640 10 monclient: dump: 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f6ced9a1640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f6ced9a1640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:25:36.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f6ced9a1640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6ce8152700 0x7f6ce80d23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f6ced9a1640 10 monclient(hunting): picked mon.noname-b con 0x7f6ce8152700 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f6ced9a1640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6ce8152ae0 0x7f6ce81fb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f6ced9a1640 10 monclient(hunting): picked mon.noname-c con 0x7f6ce8152ae0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f6ced9a1640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6ce815ef80 0x7f6ce8155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f6ced9a1640 10 monclient(hunting): picked mon.noname-a con 0x7f6ce815ef80 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f6ced9a1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f6ced9a1640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce80ca1b0 con 0x7f6ce815ef80 2026-02-17T21:25:36.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f6ced9a1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f6ced9a1640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce815e350 con 0x7f6ce8152700 2026-02-17T21:25:36.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f6ced9a1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f6ced9a1640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce80ca330 con 0x7f6ce8152ae0 2026-02-17T21:25:36.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f6ced9a1640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f6ced9a1640 10 monclient(hunting): authenticate will time out at 1041.776491s 2026-02-17T21:25:36.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bc61c3640 10 monclient: shutdown 2026-02-17T21:25:36.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bc61c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bc61c3640 1 -- 10.20.193.5:0/2797569799 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7bc00ce5d0 msgr2=0x7f7bc00d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bc61c3640 1 --2- 10.20.193.5:0/2797569799 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7bc00ce5d0 0x7f7bc00d18c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7bc015d030 tx=0x7f7bac02ede0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bc61c3640 1 -- 10.20.193.5:0/2797569799 shutdown_connections 2026-02-17T21:25:36.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bc61c3640 1 --2- 10.20.193.5:0/2797569799 >> v2:10.20.193.119:3300/0 conn(0x7f7bc015bf30 0x7f7bc00ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bc61c3640 1 --2- 10.20.193.5:0/2797569799 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7bc00ce5d0 0x7f7bc00d18c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bc61c3640 1 -- 10.20.193.5:0/2797569799 >> 10.20.193.5:0/2797569799 conn(0x7f7bc0073030 msgr2=0x7f7bc0073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bc61c3640 1 -- 10.20.193.5:0/2797569799 shutdown_connections 2026-02-17T21:25:36.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f630effd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6310144960 0x7f6310141150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.211+0000 7f7bc61c3640 1 -- 10.20.193.5:0/2797569799 wait complete. 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.212+0000 7f7bc61c3640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.212+0000 7f7bc61c3640 10 monclient: monmap: 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.212+0000 7f7bc61c3640 1 librados: starting msgr at 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.212+0000 7f7bc61c3640 1 librados: starting objecter 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.212+0000 7f7bc61c3640 1 Processor -- start 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.212+0000 7f7bc61c3640 1 -- start start 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.212+0000 7f7bc61c3640 1 librados: setting wanted keys 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.212+0000 7f7bc61c3640 1 librados: calling monclient init 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.212+0000 7f7bc61c3640 10 monclient: init 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.212+0000 7f630effd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6310144960 0x7f6310141150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:50078/0 (socket says 10.20.193.5:50078) 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.212+0000 7f630effd640 1 -- 10.20.193.5:0/3081270013 learned_addr learned my addr 10.20.193.5:0/3081270013 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.212+0000 7f630effd640 10 monclient(hunting): get_auth_request con 0x7f6310144960 auth_method 0 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.212+0000 7f630effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.212+0000 7f630effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.212+0000 7f630effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7f7bc61c3640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7f7bc61c3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:25:36.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7fd56f7fe640 1 --2- 10.20.193.5:0/3661851273 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd57015ef80 0x7fd5700c9730 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd560009970 tx=0x7fd56002eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7db664062bea0693 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7f7bc61c3640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7bc00ce5d0 0x7f7bc0147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7f7bc61c3640 10 monclient(hunting): picked mon.noname-b con 0x7f7bc00ce5d0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7f7bc61c3640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7bc00ceef0 0x7f7bc014ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7f7bc61c3640 10 monclient(hunting): picked mon.noname-c con 0x7f7bc00ceef0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7f7bc61c3640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7bc015bf30 0x7f7bc014b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7f7bc61c3640 10 monclient(hunting): picked mon.noname-a con 0x7f7bc015bf30 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7f7bc61c3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7fb1ee5d5640 10 monclient(hunting): handle_auth_done global_id 4441 payload 274 2026-02-17T21:25:36.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7fb1ee5d5640 1 -- 10.20.193.5:0/3271407630 >> v1:10.20.193.119:6789/0 conn(0x7fb1e815ef80 legacy=0x7fb1e80c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7fb1ee5d5640 1 -- 10.20.193.5:0/3271407630 >> v1:10.20.193.5:6789/0 conn(0x7fb1e8152700 legacy=0x7fb1e815e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7fb1ee5d5640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7fb1ee5d5640 1 monclient: found mon.noname-b 2026-02-17T21:25:36.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7fb1ee5d5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7fb1ee5d5640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7fb1ee5d5640 1 -- 10.20.193.5:0/3271407630 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e815dd90 con 0x7fb1e8152ae0 2026-02-17T21:25:36.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7f7bc61c3640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc00cbc30 con 0x7f7bc015bf30 2026-02-17T21:25:36.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7f7bc61c3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7f7bc61c3640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc00c9260 con 0x7f7bc00ce5d0 2026-02-17T21:25:36.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7f7bc61c3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7f7bc61c3640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc01496c0 con 0x7f7bc00ceef0 2026-02-17T21:25:36.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7f7bc61c3640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7f7bc61c3640 10 monclient(hunting): authenticate will time out at 1041.778263s 2026-02-17T21:25:36.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7fec2a7fc640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fec2c1529d0 0x7fec2c0c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7fec2a7fc640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fec2c1529d0 0x7fec2c0c8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:47666/0 (socket says 10.20.193.5:47666) 2026-02-17T21:25:36.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7fec2a7fc640 1 -- 10.20.193.5:0/2405860360 learned_addr learned my addr 10.20.193.5:0/2405860360 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7fec2a7fc640 10 monclient(hunting): get_auth_request con 0x7fec2c1529d0 auth_method 0 2026-02-17T21:25:36.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7fec2a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7fec2a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7fec2a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7f630effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7f630effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7f630effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.213+0000 7fae977fe640 1 -- 10.20.193.5:0/1232423512 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9003c070 con 0x7faea0152700 2026-02-17T21:25:36.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7fae977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7fae977fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7fae977fe640 10 monclient: dump: 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7fae977fe640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7fae977fe640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7fae977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7fae977fe640 1 -- 10.20.193.5:0/1232423512 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae9002fb40 con 0x7faea0152700 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7fae977fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7fae977fe640 1 -- 10.20.193.5:0/1232423512 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae90037440 con 0x7faea0152700 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7fae977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7fae977fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7fae977fe640 10 monclient: dump: 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7faea6d87640 5 monclient: authenticate success, global_id 4410 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7faea6d87640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7faea6d87640 4 set_mon_vals no callback set 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7f0852d76640 1 --2- 10.20.193.5:0/2503829673 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0854153ef0 0x7f08540c2d20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f08480098a0 tx=0x7f084802ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39cadf0e84c9a445 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7faea6d87640 10 monclient: shutdown 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7faea6d87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7faea6d87640 1 -- 10.20.193.5:0/1232423512 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7faea0152700 msgr2=0x7faea015e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7faea6d87640 1 --2- 10.20.193.5:0/1232423512 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7faea0152700 0x7faea015e870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faea00cbf90 tx=0x7fae9002eed0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7faea6d87640 1 -- 10.20.193.5:0/1232423512 shutdown_connections 2026-02-17T21:25:36.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7fec2a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7fec2a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7faea6d87640 1 --2- 10.20.193.5:0/1232423512 >> v2:10.20.193.119:3300/0 conn(0x7faea015edb0 0x7faea00c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7faea6d87640 1 --2- 10.20.193.5:0/1232423512 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7faea0152700 0x7faea015e870 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7faea6d87640 1 -- 10.20.193.5:0/1232423512 >> 10.20.193.5:0/1232423512 conn(0x7faea0073030 msgr2=0x7faea0073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7fec2a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7faea6d87640 1 -- 10.20.193.5:0/1232423512 shutdown_connections 2026-02-17T21:25:36.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.214+0000 7faea6d87640 1 -- 10.20.193.5:0/1232423512 wait complete. 2026-02-17T21:25:36.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7fb1ee5d5640 1 --2- 10.20.193.5:0/3271407630 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb1e8152ae0 0x7fb1e80c9e40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4009e50 tx=0x7fb1e402f2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb031226a13107e3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7faea6d87640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7faea6d87640 10 monclient: monmap: 2026-02-17T21:25:36.284 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.284 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.284 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.284 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.284 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.284 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.284 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.284 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7f80e7fff640 1 -- 10.20.193.5:0/2466161818 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f8017070 con 0x7f811014f660 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7f80e7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7f80e7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7f80e7fff640 10 monclient: dump: 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7f80e7fff640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7f80e7fff640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7f80e7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7f80e7fff640 1 -- 10.20.193.5:0/2466161818 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f8005bb0 con 0x7f811014f660 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7f80e7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7f80e7fff640 1 -- 10.20.193.5:0/2466161818 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f8007070 con 0x7f811014f660 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7f81158ea640 5 monclient: authenticate success, global_id 4451 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7f81158ea640 10 monclient: _renew_subs 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7f810d7fa640 4 set_mon_vals no callback set 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7f81158ea640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7f81158ea640 1 -- 10.20.193.5:0/2466161818 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81101f5bd0 con 0x7f811014f660 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7f78bd4aa640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f78b815d950 0x7f78b815dd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:42886/0 (socket says 10.20.193.5:42886) 2026-02-17T21:25:36.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7f78bd4aa640 1 -- 10.20.193.5:0/2086911859 learned_addr learned my addr 10.20.193.5:0/2086911859 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:36.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7f80e7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7f81158ea640 10 client.4451.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7faea6d87640 1 librados: starting msgr at 2026-02-17T21:25:36.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7faea6d87640 1 librados: starting objecter 2026-02-17T21:25:36.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7faea6d87640 1 Processor -- start 2026-02-17T21:25:36.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7f80e7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:36.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7f80e7fff640 10 monclient: dump: 2026-02-17T21:25:36.286 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.286 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.286 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.286 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.286 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.286 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.286 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.286 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.286 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.286 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7f81158ea640 10 monclient: _renew_subs 2026-02-17T21:25:36.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7f81158ea640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7f81158ea640 1 -- 10.20.193.5:0/2466161818 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f811013ddb0 con 0x7f811014f660 2026-02-17T21:25:36.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7f81158ea640 1 librados: init done 2026-02-17T21:25:36.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7faea6d87640 1 -- start start 2026-02-17T21:25:36.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7faea6d87640 1 librados: setting wanted keys 2026-02-17T21:25:36.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7faea6d87640 1 librados: calling monclient init 2026-02-17T21:25:36.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.215+0000 7faea6d87640 10 monclient: init 2026-02-17T21:25:36.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7fec2a7fc640 10 monclient(hunting): handle_auth_done global_id 4454 payload 274 2026-02-17T21:25:36.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7faea6d87640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7faea6d87640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:25:36.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7faea6d87640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faea0152700 0x7faea015b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7faea6d87640 10 monclient(hunting): picked mon.noname-b con 0x7faea0152700 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7faea6d87640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7faea0152ae0 0x7faea01f61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7faea6d87640 10 monclient(hunting): picked mon.noname-a con 0x7faea0152ae0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7fec2a7fc640 1 -- 10.20.193.5:0/2405860360 >> v1:10.20.193.135:6789/0 conn(0x7fec2c1525f0 legacy=0x7fec2c0cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7fec2a7fc640 1 -- 10.20.193.5:0/2405860360 >> v1:10.20.193.119:6789/0 conn(0x7fec2c0d2470 legacy=0x7fec2c15d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7faea6d87640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7faea015edb0 0x7faea01f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7faea6d87640 10 monclient(hunting): picked mon.noname-c con 0x7faea015edb0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7faea6d87640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7faea6d87640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7faea015e350 con 0x7faea0152ae0 2026-02-17T21:25:36.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7faea6d87640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7faea6d87640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7faea015e070 con 0x7faea0152700 2026-02-17T21:25:36.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7faea6d87640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7faea6d87640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7faea00ca380 con 0x7faea015edb0 2026-02-17T21:25:36.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7faea6d87640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7faea6d87640 10 monclient(hunting): authenticate will time out at 1041.781174s 2026-02-17T21:25:36.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7fec2a7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7fec2a7fc640 1 monclient: found mon.noname-c 2026-02-17T21:25:36.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7fec2a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7fec2a7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7fec2a7fc640 1 -- 10.20.193.5:0/2405860360 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec2c0c9d80 con 0x7fec2c1529d0 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7f81158ea640 10 client.4451.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7f81158ea640 15 client.4451.objecter _session_command_op_assign -1 1 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7f81158ea640 20 client.4451.objecter _get_session osd=-1 returning homeless 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7f81158ea640 10 client.4451.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7f81158ea640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7f81158ea640 1 -- 10.20.193.5:0/2466161818 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f81100765a0 con 0x7f811014f660 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7ff9153a2640 1 -- 10.20.193.5:0/4240688854 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90403c070 con 0x7ff910152ae0 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7ff9153a2640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7ff9153a2640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7ff9153a2640 10 monclient: dump: 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7ff9153a2640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7ff9153a2640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7ff9153a2640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7ff9153a2640 1 -- 10.20.193.5:0/4240688854 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff90402fb00 con 0x7ff910152ae0 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7ff9153a2640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7ff9153a2640 1 -- 10.20.193.5:0/4240688854 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904037440 con 0x7ff910152ae0 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7f630effd640 10 monclient(hunting): handle_auth_done global_id 4419 payload 824 2026-02-17T21:25:36.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7ff9153a2640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7ff9153a2640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:36.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7ff9153a2640 10 monclient: dump: 2026-02-17T21:25:36.289 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.289 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.289 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.289 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.289 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.289 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.289 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.289 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.289 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.289 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7ff91862f640 5 monclient: authenticate success, global_id 4435 2026-02-17T21:25:36.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7f630effd640 1 -- 10.20.193.5:0/3081270013 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f62f4003ba0 msgr2=0x7f63101f4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7f630effd640 1 --2- 10.20.193.5:0/3081270013 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f62f4003ba0 0x7f63101f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7f630effd640 1 -- 10.20.193.5:0/3081270013 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6310141690 msgr2=0x7f63100d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7f630effd640 1 --2- 10.20.193.5:0/3081270013 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6310141690 0x7f63100d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7ff91862f640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7ff91862f640 4 set_mon_vals no callback set 2026-02-17T21:25:36.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7f630effd640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7f630effd640 1 monclient: found mon.noname-a 2026-02-17T21:25:36.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7f630effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7f630effd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7f630effd640 1 -- 10.20.193.5:0/3081270013 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63101f5340 con 0x7f6310144960 2026-02-17T21:25:36.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.216+0000 7f2d5affd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2d5c155770 0x7f2d5c0c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7ff91862f640 10 monclient: shutdown 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7ff91862f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7ff91862f640 1 -- 10.20.193.5:0/4240688854 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff910152ae0 msgr2=0x7ff91015edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7ff91862f640 1 --2- 10.20.193.5:0/4240688854 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff910152ae0 0x7ff91015edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff91008e820 tx=0x7ff90402edf0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7ff91862f640 1 -- 10.20.193.5:0/4240688854 shutdown_connections 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7ff91862f640 1 --2- 10.20.193.5:0/4240688854 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff910152ae0 0x7ff91015edb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7ff91862f640 1 --2- 10.20.193.5:0/4240688854 >> v2:10.20.193.5:3300/0 conn(0x7ff910152700 0x7ff91015e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7ff91862f640 1 -- 10.20.193.5:0/4240688854 >> 10.20.193.5:0/4240688854 conn(0x7ff910073030 msgr2=0x7ff910073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7ff91862f640 1 -- 10.20.193.5:0/4240688854 shutdown_connections 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7ff91862f640 1 -- 10.20.193.5:0/4240688854 wait complete. 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7fd56effd640 1 -- 10.20.193.5:0/3661851273 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56003c070 con 0x7fd57015ef80 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7fd56effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7fd56effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7fd56effd640 10 monclient: dump: 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7fd56effd640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7fd56effd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7fd56effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7fd56effd640 1 -- 10.20.193.5:0/3661851273 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd56002fb60 con 0x7fd57015ef80 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7fd56effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7fd56effd640 1 -- 10.20.193.5:0/3661851273 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd560037440 con 0x7fd57015ef80 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7fd576511640 5 monclient: authenticate success, global_id 4442 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7fd576511640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7fd576511640 4 set_mon_vals no callback set 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7fd56effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7fd56effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7fd56effd640 10 monclient: dump: 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7fd576511640 10 monclient: shutdown 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7fd576511640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7fd576511640 1 -- 10.20.193.5:0/3661851273 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd57015ef80 msgr2=0x7fd5700c9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7fd576511640 1 --2- 10.20.193.5:0/3661851273 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd57015ef80 0x7fd5700c9730 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd560009970 tx=0x7fd56002eef0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7fd576511640 1 -- 10.20.193.5:0/3661851273 shutdown_connections 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7fd576511640 1 --2- 10.20.193.5:0/3661851273 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd57015ef80 0x7fd5700c9730 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7fd576511640 1 -- 10.20.193.5:0/3661851273 >> 10.20.193.5:0/3661851273 conn(0x7fd570073030 msgr2=0x7fd570073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7fd576511640 1 -- 10.20.193.5:0/3661851273 shutdown_connections 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7ff91862f640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7ff91862f640 10 monclient: monmap: 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.217+0000 7fd576511640 1 -- 10.20.193.5:0/3661851273 wait complete. 2026-02-17T21:25:36.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.218+0000 7f2d5affd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2d5c155770 0x7f2d5c0c72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:50090/0 (socket says 10.20.193.5:50090) 2026-02-17T21:25:36.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.218+0000 7f2d5affd640 1 -- 10.20.193.5:0/4147654514 learned_addr learned my addr 10.20.193.5:0/4147654514 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.218+0000 7f2d5affd640 10 monclient(hunting): get_auth_request con 0x7f2d5c155770 auth_method 0 2026-02-17T21:25:36.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.218+0000 7f2d5affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.218+0000 7f2d5affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.218+0000 7f2d5affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.218+0000 7f630effd640 1 --2- 10.20.193.5:0/3081270013 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6310144960 0x7f6310141150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f630000e930 tx=0x7f630000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.218+0000 7f62ebfff640 10 client.?.objecter ms_handle_connect 0x7f6310144960 2026-02-17T21:25:36.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.218+0000 7f62ebfff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.218+0000 7ff91862f640 1 librados: starting msgr at 2026-02-17T21:25:36.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.218+0000 7ff91862f640 1 librados: starting objecter 2026-02-17T21:25:36.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.218+0000 7ff91862f640 1 Processor -- start 2026-02-17T21:25:36.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.218+0000 7ff91862f640 1 -- start start 2026-02-17T21:25:36.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.218+0000 7ff91862f640 1 librados: setting wanted keys 2026-02-17T21:25:36.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.218+0000 7ff91862f640 1 librados: calling monclient init 2026-02-17T21:25:36.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.218+0000 7ff91862f640 10 monclient: init 2026-02-17T21:25:36.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.218+0000 7fd576511640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.218+0000 7fec2a7fc640 1 --2- 10.20.193.5:0/2405860360 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fec2c1529d0 0x7fec2c0c8df0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fec14009970 tx=0x7fec1402efb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be4db440c5b62e2f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.218+0000 7fd576511640 10 monclient: monmap: 2026-02-17T21:25:36.293 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.293 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.293 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.293 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.293 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.293 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.293 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.293 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.293 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.293 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.218+0000 7fd576511640 1 librados: starting msgr at 2026-02-17T21:25:36.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.218+0000 7fd576511640 1 librados: starting objecter 2026-02-17T21:25:36.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.218+0000 7fd576511640 1 Processor -- start 2026-02-17T21:25:36.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.218+0000 7ff91862f640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7ff91862f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:25:36.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.218+0000 7faae4d95640 1 -- 10.20.193.5:0/1392796368 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faadc02fcd0 con 0x7faae015edb0 2026-02-17T21:25:36.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae4d95640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7ff91862f640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff9100c9730 0x7ff91014be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae4d95640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:36.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7fd576511640 1 -- start start 2026-02-17T21:25:36.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7fd576511640 1 librados: setting wanted keys 2026-02-17T21:25:36.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7ff91862f640 10 monclient(hunting): picked mon.noname-a con 0x7ff9100c9730 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae4d95640 10 monclient: dump: 2026-02-17T21:25:36.294 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.294 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.294 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.294 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.294 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.294 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.294 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.294 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.294 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.294 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae4d95640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae4d95640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7fd576511640 1 librados: calling monclient init 2026-02-17T21:25:36.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7fd576511640 10 monclient: init 2026-02-17T21:25:36.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae4d95640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae4d95640 1 -- 10.20.193.5:0/1392796368 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faadc0373f0 con 0x7faae015edb0 2026-02-17T21:25:36.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7ff91862f640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff910152700 0x7ff91015eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae8022640 5 monclient: authenticate success, global_id 4438 2026-02-17T21:25:36.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae8022640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:36.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae4d95640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae4d95640 1 -- 10.20.193.5:0/1392796368 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faadc0377c0 con 0x7faae015edb0 2026-02-17T21:25:36.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae4d95640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae4d95640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:36.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae4d95640 10 monclient: dump: 2026-02-17T21:25:36.295 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.295 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.295 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.295 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.295 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.295 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.295 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.295 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.295 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.295 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae8022640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae8022640 4 set_mon_vals no callback set 2026-02-17T21:25:36.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7ff91862f640 10 monclient(hunting): picked mon.noname-c con 0x7ff910152700 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7ff91862f640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff910152ae0 0x7ff9100d1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7ff91862f640 10 monclient(hunting): picked mon.noname-b con 0x7ff910152ae0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7ff91862f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7ff91862f640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff9100ca270 con 0x7ff9100c9730 2026-02-17T21:25:36.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7ff91862f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7ff91862f640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff91015e350 con 0x7ff910152ae0 2026-02-17T21:25:36.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7ff91862f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7ff91862f640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff9100ca3f0 con 0x7ff910152700 2026-02-17T21:25:36.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7ff91862f640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7ff91862f640 10 monclient(hunting): authenticate will time out at 1041.784254s 2026-02-17T21:25:36.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7f2d5affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7f2d5affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7fd576511640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7fd576511640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:25:36.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7fd576511640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd570152700 0x7fd5701f4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7fd576511640 10 monclient(hunting): picked mon.noname-c con 0x7fd570152700 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7fd576511640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd570152ae0 0x7fd57014a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae8022640 10 monclient: shutdown 2026-02-17T21:25:36.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae8022640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae8022640 1 -- 10.20.193.5:0/1392796368 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faae015edb0 msgr2=0x7faae00c9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae8022640 1 --2- 10.20.193.5:0/1392796368 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faae015edb0 0x7faae00c9e40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faae00cbf90 tx=0x7faadc02f270 comp rx=0 tx=0).stop 2026-02-17T21:25:36.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7fd576511640 10 monclient(hunting): picked mon.noname-a con 0x7fd570152ae0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7f2d5affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7fd576511640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd57015ef80 0x7fd5700cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7fd576511640 10 monclient(hunting): picked mon.noname-b con 0x7fd57015ef80 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7fd576511640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7fd576511640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd5700ca380 con 0x7fd570152ae0 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7fd576511640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7fd576511640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd57015e350 con 0x7fd57015ef80 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7fd576511640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7fd576511640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd570166850 con 0x7fd570152700 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7fd576511640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7fd576511640 10 monclient(hunting): authenticate will time out at 1041.784621s 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae8022640 1 -- 10.20.193.5:0/1392796368 shutdown_connections 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae8022640 1 --2- 10.20.193.5:0/1392796368 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faae015edb0 0x7faae00c9e40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae8022640 1 --2- 10.20.193.5:0/1392796368 >> v2:10.20.193.5:3300/0 conn(0x7faae0152700 0x7faae015e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae8022640 1 -- 10.20.193.5:0/1392796368 >> 10.20.193.5:0/1392796368 conn(0x7faae0073030 msgr2=0x7faae0073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae8022640 1 -- 10.20.193.5:0/1392796368 shutdown_connections 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.219+0000 7faae8022640 1 -- 10.20.193.5:0/1392796368 wait complete. 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7faae8022640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7faae8022640 10 monclient: monmap: 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.297 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7f6ce77fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6ce815ef80 0x7f6ce8155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7faae8022640 1 librados: starting msgr at 2026-02-17T21:25:36.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7faae8022640 1 librados: starting objecter 2026-02-17T21:25:36.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7faae8022640 1 Processor -- start 2026-02-17T21:25:36.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7faae8022640 1 -- start start 2026-02-17T21:25:36.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7faae8022640 1 librados: setting wanted keys 2026-02-17T21:25:36.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7faae8022640 1 librados: calling monclient init 2026-02-17T21:25:36.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7faae8022640 10 monclient: init 2026-02-17T21:25:36.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7faae8022640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7faae8022640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:25:36.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7faae8022640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faae0152700 0x7faae015c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7faae8022640 10 monclient(hunting): picked mon.noname-b con 0x7faae0152700 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7faae8022640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7faae0152ae0 0x7faae01493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7faae8022640 10 monclient(hunting): picked mon.noname-a con 0x7faae0152ae0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7faae8022640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7faae015edb0 0x7faae01f4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7faae8022640 10 monclient(hunting): picked mon.noname-c con 0x7faae015edb0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7faae8022640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7faae8022640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7faae015e350 con 0x7faae0152ae0 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7faae8022640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7faae8022640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7faae015e070 con 0x7faae0152700 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7faae8022640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7faae8022640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7faae00ca380 con 0x7faae015edb0 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7faae8022640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.220+0000 7faae8022640 10 monclient(hunting): authenticate will time out at 1041.785923s 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.221+0000 7f6ce77fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6ce815ef80 0x7f6ce8155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:50100/0 (socket says 10.20.193.5:50100) 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.221+0000 7f6ce77fe640 1 -- 10.20.193.5:0/580086956 learned_addr learned my addr 10.20.193.5:0/580086956 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.221+0000 7f6ce77fe640 10 monclient(hunting): get_auth_request con 0x7f6ce815ef80 auth_method 0 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.221+0000 7f6ce77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.221+0000 7f6ce77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.221+0000 7f6ce77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f62ebfff640 1 -- 10.20.193.5:0/3081270013 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6300017070 con 0x7f6310144960 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f62ebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f62ebfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f62ebfff640 10 monclient: dump: 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f62ebfff640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f62ebfff640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f62ebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f62ebfff640 1 -- 10.20.193.5:0/3081270013 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f630000ca00 con 0x7f6310144960 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f62ebfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f62ebfff640 1 -- 10.20.193.5:0/3081270013 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630000cdd0 con 0x7f6310144960 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f6315c43640 5 monclient: authenticate success, global_id 4419 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f6315c43640 10 monclient: _renew_subs 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f630dffb640 4 set_mon_vals no callback set 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7fb1ecdd2640 1 -- 10.20.193.5:0/3271407630 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e402fd50 con 0x7fb1e8152ae0 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7fb1ecdd2640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7fb1ecdd2640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7fb1ecdd2640 10 monclient: dump: 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7fb1ecdd2640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7fb1ecdd2640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7fb1ecdd2640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7fb1ecdd2640 1 -- 10.20.193.5:0/3271407630 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e40373f0 con 0x7fb1e8152ae0 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7fb1f005f640 5 monclient: authenticate success, global_id 4441 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7fb1f005f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7fb1ecdd2640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7fb1ecdd2640 1 -- 10.20.193.5:0/3271407630 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e40377c0 con 0x7fb1e8152ae0 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7fb1ecdd2640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7fb1ecdd2640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7fb1ecdd2640 10 monclient: dump: 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.300 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f6315c43640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f6315c43640 1 -- 10.20.193.5:0/3081270013 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63101435e0 con 0x7f6310144960 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f62ebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f62ebfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f62ebfff640 10 monclient: dump: 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7fb1f005f640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7fb1f005f640 4 set_mon_vals no callback set 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f6315c43640 10 client.4419.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f6315c43640 10 monclient: _renew_subs 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f6315c43640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f6315c43640 1 -- 10.20.193.5:0/3081270013 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6310143ba0 con 0x7f6310144960 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f6315c43640 1 librados: init done 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f6ce77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f6ce77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7f6ce77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.222+0000 7fae97fff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7faea0152ae0 0x7faea01f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.223+0000 7fb1f005f640 10 monclient: shutdown 2026-02-17T21:25:36.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.223+0000 7fb1f005f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.223+0000 7fb1f005f640 1 -- 10.20.193.5:0/3271407630 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb1e8152ae0 msgr2=0x7fb1e80c9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.223+0000 7fb1f005f640 1 --2- 10.20.193.5:0/3271407630 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb1e8152ae0 0x7fb1e80c9e40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4009e50 tx=0x7fb1e402f2a0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.223+0000 7f6315c43640 10 client.4419.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.223+0000 7f6315c43640 15 client.4419.objecter _session_command_op_assign -1 1 2026-02-17T21:25:36.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.223+0000 7f6315c43640 20 client.4419.objecter _get_session osd=-1 returning homeless 2026-02-17T21:25:36.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.223+0000 7f6315c43640 10 client.4419.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.223+0000 7f6315c43640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.223+0000 7f6315c43640 1 -- 10.20.193.5:0/3081270013 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f63101f4930 con 0x7f6310144960 2026-02-17T21:25:36.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.223+0000 7fb1f005f640 1 -- 10.20.193.5:0/3271407630 shutdown_connections 2026-02-17T21:25:36.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.223+0000 7fb1f005f640 1 --2- 10.20.193.5:0/3271407630 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb1e8152ae0 0x7fb1e80c9e40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.223+0000 7fb1f005f640 1 -- 10.20.193.5:0/3271407630 >> 10.20.193.5:0/3271407630 conn(0x7fb1e8073030 msgr2=0x7fb1e8073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.223+0000 7fb1f005f640 1 -- 10.20.193.5:0/3271407630 shutdown_connections 2026-02-17T21:25:36.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.223+0000 7fb1f005f640 1 -- 10.20.193.5:0/3271407630 wait complete. 2026-02-17T21:25:36.303 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.223+0000 7f6ce67fc640 1 --2- 10.20.193.5:0/580086956 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6ce8152ae0 0x7f6ce81fb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.303 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.223+0000 7fae97fff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7faea0152ae0 0x7faea01f61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:50122/0 (socket says 10.20.193.5:50122) 2026-02-17T21:25:36.303 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.223+0000 7fae97fff640 1 -- 10.20.193.5:0/2908302220 learned_addr learned my addr 10.20.193.5:0/2908302220 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.303 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.223+0000 7fae97fff640 10 monclient(hunting): get_auth_request con 0x7faea0152ae0 auth_method 0 2026-02-17T21:25:36.303 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.223+0000 7fae97fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.303 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.223+0000 7fae97fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.303 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.223+0000 7f78affff640 1 --2- 10.20.193.5:0/2086911859 >> v2:10.20.193.119:3300/0 conn(0x7f78b80d1f40 0x7f78b815c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.303 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.223+0000 7fae97fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.303 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.223+0000 7fb1f005f640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.303 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.223+0000 7fb1f005f640 10 monclient: monmap: 2026-02-17T21:25:36.303 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.303 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.303 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.303 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.303 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.303 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.303 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.303 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.303 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.303 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7f78affff640 10 monclient(hunting): get_auth_request con 0x7f78b80d1f40 auth_method 0 2026-02-17T21:25:36.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7fb1f005f640 1 librados: starting msgr at 2026-02-17T21:25:36.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7fb1f005f640 1 librados: starting objecter 2026-02-17T21:25:36.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7f78affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7fb1f005f640 1 Processor -- start 2026-02-17T21:25:36.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7f78affff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7f78affff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7fb1f005f640 1 -- start start 2026-02-17T21:25:36.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7fb1f005f640 1 librados: setting wanted keys 2026-02-17T21:25:36.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7fb1f005f640 1 librados: calling monclient init 2026-02-17T21:25:36.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7fb1f005f640 10 monclient: init 2026-02-17T21:25:36.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7f78affff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7f6ce67fc640 10 monclient(hunting): get_auth_request con 0x7f6ce8152ae0 auth_method 0 2026-02-17T21:25:36.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7f78affff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7f6ce67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7f6ce67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7f6ce67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7fb1f005f640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7f78affff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7fb1f005f640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:25:36.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7fb1f005f640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb1e8152700 0x7fb1e81f6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7fb1f005f640 10 monclient(hunting): picked mon.noname-a con 0x7fb1e8152700 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7fb1f005f640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb1e8152ae0 0x7fb1e8145f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7fb1f005f640 10 monclient(hunting): picked mon.noname-b con 0x7fb1e8152ae0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7fb1f005f640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb1e815ef80 0x7fb1e81f6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7fb1f005f640 10 monclient(hunting): picked mon.noname-c con 0x7fb1e815ef80 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7fb1f005f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7fb1f005f640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e80ca380 con 0x7fb1e8152700 2026-02-17T21:25:36.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7fb1f005f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7fb1f005f640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e815e350 con 0x7fb1e8152ae0 2026-02-17T21:25:36.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7fb1f005f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7fb1f005f640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e8166850 con 0x7fb1e815ef80 2026-02-17T21:25:36.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7fb1f005f640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7fb1f005f640 10 monclient(hunting): authenticate will time out at 1041.789577s 2026-02-17T21:25:36.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.224+0000 7f58ddd74640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f58e015ef80 0x7f58e00c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.225+0000 7f6ce67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.225+0000 7f6ce67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.225+0000 7f6ce67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.225+0000 7f78affff640 10 monclient(hunting): handle_auth_done global_id 4453 payload 274 2026-02-17T21:25:36.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.225+0000 7f78affff640 1 -- 10.20.193.5:0/2086911859 >> v1:10.20.193.119:6789/0 conn(0x7f78b80d1b60 legacy=0x7f78b80c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.225+0000 7f58ddd74640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f58e015ef80 0x7f58e00c9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:47670/0 (socket says 10.20.193.5:47670) 2026-02-17T21:25:36.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.225+0000 7f58ddd74640 1 -- 10.20.193.5:0/1444055918 learned_addr learned my addr 10.20.193.5:0/1444055918 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.225+0000 7f58ddd74640 10 monclient(hunting): get_auth_request con 0x7f58e015ef80 auth_method 0 2026-02-17T21:25:36.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.225+0000 7f58ddd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.225+0000 7f58ddd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.225+0000 7f58ddd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.225+0000 7f78affff640 1 -- 10.20.193.5:0/2086911859 >> v1:10.20.193.5:6789/0 conn(0x7f78b815d950 legacy=0x7f78b815dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.225+0000 7f78affff640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.225+0000 7f78affff640 1 monclient: found mon.noname-b 2026-02-17T21:25:36.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.225+0000 7f78affff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.225+0000 7f78affff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.225+0000 7f78affff640 1 -- 10.20.193.5:0/2086911859 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b80c9ea0 con 0x7f78b80d1f40 2026-02-17T21:25:36.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.226+0000 7f6ce77fe640 10 monclient(hunting): handle_auth_done global_id 4428 payload 824 2026-02-17T21:25:36.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.226+0000 7f6ce77fe640 1 -- 10.20.193.5:0/580086956 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6ce8152ae0 msgr2=0x7f6ce81fb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.226+0000 7f6ce77fe640 1 --2- 10.20.193.5:0/580086956 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6ce8152ae0 0x7f6ce81fb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.226+0000 7f6ce77fe640 1 -- 10.20.193.5:0/580086956 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6ce8152700 msgr2=0x7f6ce80d23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.226+0000 7f6ce77fe640 1 --2- 10.20.193.5:0/580086956 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6ce8152700 0x7f6ce80d23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.226+0000 7f6ce77fe640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.226+0000 7f6ce77fe640 1 monclient: found mon.noname-a 2026-02-17T21:25:36.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.226+0000 7f6ce77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.226+0000 7f6ce77fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.226+0000 7f6ce77fe640 1 -- 10.20.193.5:0/580086956 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce81fbdf0 con 0x7f6ce815ef80 2026-02-17T21:25:36.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.226+0000 7f2d5bfff640 1 --2- 10.20.193.5:0/4147654514 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2d5c15f570 0x7f2d5c0c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.226+0000 7f2d5bfff640 10 monclient(hunting): get_auth_request con 0x7f2d5c15f570 auth_method 0 2026-02-17T21:25:36.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.226+0000 7f2d5bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.226+0000 7f2d5bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.226+0000 7f2d5bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.227+0000 7f58ddd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.227+0000 7f58ddd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.227+0000 7f58ddd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.227+0000 7f78affff640 1 --2- 10.20.193.5:0/2086911859 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f78b80d1f40 0x7f78b815c840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f78a00098a0 tx=0x7f78a002ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6465c2b91810a3b4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.227+0000 7f2d5bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.227+0000 7f2d5bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.227+0000 7f2d5bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.227+0000 7f2d5affd640 10 monclient(hunting): handle_auth_done global_id 4422 payload 824 2026-02-17T21:25:36.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.227+0000 7f2d5affd640 1 -- 10.20.193.5:0/4147654514 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2d5c0be810 msgr2=0x7f2d5c1f3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.227+0000 7f2d5affd640 1 --2- 10.20.193.5:0/4147654514 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2d5c0be810 0x7f2d5c1f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.227+0000 7f2d5affd640 1 -- 10.20.193.5:0/4147654514 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2d5c15f570 msgr2=0x7f2d5c0c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.227+0000 7f2d5affd640 1 --2- 10.20.193.5:0/4147654514 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2d5c15f570 0x7f2d5c0c65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.227+0000 7f2d5affd640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.227+0000 7f2d5affd640 1 monclient: found mon.noname-a 2026-02-17T21:25:36.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.227+0000 7f2d5affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.227+0000 7f2d5affd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.227+0000 7f2d5affd640 1 -- 10.20.193.5:0/4147654514 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d5c1f4160 con 0x7f2d5c155770 2026-02-17T21:25:36.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.228+0000 7fae97fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.228+0000 7fae97fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.228+0000 7fae97fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.229+0000 7f58ddd74640 10 monclient(hunting): handle_auth_done global_id 4460 payload 274 2026-02-17T21:25:36.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.229+0000 7f58ddd74640 1 -- 10.20.193.5:0/1444055918 >> v1:10.20.193.135:6789/0 conn(0x7f58e0152700 legacy=0x7f58e015e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.229+0000 7f58ddd74640 1 -- 10.20.193.5:0/1444055918 >> v1:10.20.193.119:6789/0 conn(0x7f58e0152ae0 legacy=0x7f58e00c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.229+0000 7f58ddd74640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.229+0000 7f58ddd74640 1 monclient: found mon.noname-c 2026-02-17T21:25:36.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.229+0000 7f58ddd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.229+0000 7f58ddd74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.229+0000 7f58ddd74640 1 -- 10.20.193.5:0/1444055918 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e015dd90 con 0x7f58e015ef80 2026-02-17T21:25:36.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.230+0000 7fae97fff640 10 monclient(hunting): handle_auth_done global_id 4431 payload 824 2026-02-17T21:25:36.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.230+0000 7fae97fff640 1 -- 10.20.193.5:0/2908302220 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7faea015edb0 msgr2=0x7faea01f6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.230+0000 7fae97fff640 1 --2- 10.20.193.5:0/2908302220 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7faea015edb0 0x7faea01f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.230+0000 7fae97fff640 1 -- 10.20.193.5:0/2908302220 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faea0152700 msgr2=0x7faea015b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.230+0000 7fae97fff640 1 --2- 10.20.193.5:0/2908302220 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faea0152700 0x7faea015b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.230+0000 7fae97fff640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.230+0000 7fae97fff640 1 monclient: found mon.noname-a 2026-02-17T21:25:36.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.230+0000 7fae97fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.230+0000 7fae97fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.230+0000 7fae97fff640 1 -- 10.20.193.5:0/2908302220 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea0159d40 con 0x7faea0152ae0 2026-02-17T21:25:36.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.231+0000 7fed0964f640 1 --2- 10.20.193.5:0/1878131111 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fed040d1b60 0x7fed040d1f40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fecf40098a0 tx=0x7fecf402ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d668d1859d9a893 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.231+0000 7f6ce77fe640 1 --2- 10.20.193.5:0/580086956 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6ce815ef80 0x7f6ce8155300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6cd802f6d0 tx=0x7f6cd8004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.231+0000 7f6cbffff640 10 client.?.objecter ms_handle_connect 0x7f6ce815ef80 2026-02-17T21:25:36.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.231+0000 7f6cbffff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.232+0000 7fae97fff640 1 --2- 10.20.193.5:0/2908302220 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7faea0152ae0 0x7faea01f61a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fae8800b4d0 tx=0x7fae8800b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.232+0000 7fae957fa640 10 client.?.objecter ms_handle_connect 0x7faea0152ae0 2026-02-17T21:25:36.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.232+0000 7fae957fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.232+0000 7f2d5affd640 1 --2- 10.20.193.5:0/4147654514 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2d5c155770 0x7f2d5c0c72f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c00b580 tx=0x7f2d4c00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.232+0000 7f2d37fff640 10 client.?.objecter ms_handle_connect 0x7f2d5c155770 2026-02-17T21:25:36.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.232+0000 7f2d37fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.234+0000 7ff9163a4640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff9100c9730 0x7ff91014be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.234+0000 7fd574a87640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd57015ef80 0x7fd5700cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.234+0000 7ff9163a4640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff9100c9730 0x7ff91014be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:50124/0 (socket says 10.20.193.5:50124) 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.234+0000 7ff9163a4640 1 -- 10.20.193.5:0/3888477941 learned_addr learned my addr 10.20.193.5:0/3888477941 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.234+0000 7ff9163a4640 10 monclient(hunting): get_auth_request con 0x7ff9100c9730 auth_method 0 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.234+0000 7ff9163a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.234+0000 7ff9163a4640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.234+0000 7ff9163a4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f0851d74640 1 -- 10.20.193.5:0/2503829673 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084803c070 con 0x7f0854153ef0 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f0851d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f0851d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f0851d74640 10 monclient: dump: 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f0851d74640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f0851d74640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f0851d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f0851d74640 1 -- 10.20.193.5:0/2503829673 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f084802fca0 con 0x7f0854153ef0 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f0851d74640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7ff916ba5640 1 --2- 10.20.193.5:0/3888477941 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff910152ae0 0x7ff9100d1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f0851d74640 1 -- 10.20.193.5:0/2503829673 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0848037660 con 0x7f0854153ef0 2026-02-17T21:25:36.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f08590d3640 5 monclient: authenticate success, global_id 4447 2026-02-17T21:25:36.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f08590d3640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f08590d3640 4 set_mon_vals no callback set 2026-02-17T21:25:36.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f0851d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f0851d74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:36.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f0851d74640 10 monclient: dump: 2026-02-17T21:25:36.312 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.312 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.312 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.312 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.312 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.312 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.312 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.312 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.312 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.312 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7fd574a87640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd57015ef80 0x7fd5700cbe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:37764/0 (socket says 10.20.193.5:37764) 2026-02-17T21:25:36.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7fd574a87640 1 -- 10.20.193.5:0/1452172089 learned_addr learned my addr 10.20.193.5:0/1452172089 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7fd574a87640 10 monclient(hunting): get_auth_request con 0x7fd57015ef80 auth_method 0 2026-02-17T21:25:36.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7fd574a87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7fd574a87640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7fd574a87640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f08590d3640 10 monclient: shutdown 2026-02-17T21:25:36.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f08590d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f08590d3640 1 -- 10.20.193.5:0/2503829673 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0854153ef0 msgr2=0x7f08540c2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f08590d3640 1 --2- 10.20.193.5:0/2503829673 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0854153ef0 0x7f08540c2d20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f08480098a0 tx=0x7f084802ef90 comp rx=0 tx=0).stop 2026-02-17T21:25:36.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f08590d3640 1 -- 10.20.193.5:0/2503829673 shutdown_connections 2026-02-17T21:25:36.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f08590d3640 1 --2- 10.20.193.5:0/2503829673 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0854153ef0 0x7f08540c2d20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f08590d3640 1 -- 10.20.193.5:0/2503829673 >> 10.20.193.5:0/2503829673 conn(0x7f08540cc1d0 msgr2=0x7f08540cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f08590d3640 1 -- 10.20.193.5:0/2503829673 shutdown_connections 2026-02-17T21:25:36.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7ff916ba5640 10 monclient(hunting): get_auth_request con 0x7ff910152ae0 auth_method 0 2026-02-17T21:25:36.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7ff916ba5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7ff916ba5640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7ff916ba5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f08590d3640 1 -- 10.20.193.5:0/2503829673 wait complete. 2026-02-17T21:25:36.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7fd56f7fe640 1 --2- 10.20.193.5:0/1452172089 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd570152ae0 0x7fd57014a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.314 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7fd574a87640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.314 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7fd574a87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.314 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7fd574a87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.314 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.235+0000 7f7bbffff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7bc015bf30 0x7f7bc014b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.314 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.236+0000 7f08590d3640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.314 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.236+0000 7f08590d3640 10 monclient: monmap: 2026-02-17T21:25:36.314 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.314 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.314 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.314 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.314 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.314 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.314 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.314 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.314 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.314 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.314 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.236+0000 7ff916ba5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.314 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.236+0000 7ff916ba5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.314 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.236+0000 7ff916ba5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.314 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.236+0000 7f08590d3640 1 librados: starting msgr at 2026-02-17T21:25:36.314 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.236+0000 7f08590d3640 1 librados: starting objecter 2026-02-17T21:25:36.314 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.236+0000 7f08590d3640 1 Processor -- start 2026-02-17T21:25:36.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.236+0000 7f08590d3640 1 -- start start 2026-02-17T21:25:36.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.236+0000 7f08590d3640 1 librados: setting wanted keys 2026-02-17T21:25:36.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.236+0000 7f08590d3640 1 librados: calling monclient init 2026-02-17T21:25:36.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.236+0000 7f08590d3640 10 monclient: init 2026-02-17T21:25:36.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.236+0000 7ff9163a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.236+0000 7ff9163a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.236+0000 7ff9163a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.236+0000 7f08590d3640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.236+0000 7f08590d3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:25:36.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.236+0000 7f08590d3640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f08540c7990 0x7f08541f4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.236+0000 7f08590d3640 10 monclient(hunting): picked mon.noname-a con 0x7f08540c7990 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7f08590d3640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f08540cccf0 0x7f0854147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7f08590d3640 10 monclient(hunting): picked mon.noname-b con 0x7f08540cccf0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.236+0000 7fd56f7fe640 10 monclient(hunting): get_auth_request con 0x7fd570152ae0 auth_method 0 2026-02-17T21:25:36.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.236+0000 7fd56f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7f08590d3640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0854153ef0 0x7f08540712a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7f08590d3640 10 monclient(hunting): picked mon.noname-c con 0x7f0854153ef0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7f08590d3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7f08590d3640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f08540c6d60 con 0x7f08540c7990 2026-02-17T21:25:36.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7fd56f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7fd56f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7f08590d3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7f08590d3640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f08540c99a0 con 0x7f08540cccf0 2026-02-17T21:25:36.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7f08590d3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7f08590d3640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f08541542d0 con 0x7f0854153ef0 2026-02-17T21:25:36.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7f08590d3640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7f08590d3640 10 monclient(hunting): authenticate will time out at 1041.802027s 2026-02-17T21:25:36.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7fd574a87640 10 monclient(hunting): handle_auth_done global_id 4459 payload 824 2026-02-17T21:25:36.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7fd574a87640 1 -- 10.20.193.5:0/1452172089 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd570152700 msgr2=0x7fd5701f4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7fd574a87640 1 --2- 10.20.193.5:0/1452172089 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd570152700 0x7fd5701f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7fd574a87640 1 -- 10.20.193.5:0/1452172089 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd570152ae0 msgr2=0x7fd57014a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7fd574a87640 1 --2- 10.20.193.5:0/1452172089 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd570152ae0 0x7fd57014a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7fd574a87640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7fd574a87640 1 monclient: found mon.noname-b 2026-02-17T21:25:36.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7fd574a87640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7fd574a87640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7fd574a87640 1 -- 10.20.193.5:0/1452172089 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5700d2790 con 0x7fd57015ef80 2026-02-17T21:25:36.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7f7bbffff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7bc015bf30 0x7f7bc014b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:50116/0 (socket says 10.20.193.5:50116) 2026-02-17T21:25:36.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7f7bbffff640 1 -- 10.20.193.5:0/3871606820 learned_addr learned my addr 10.20.193.5:0/3871606820 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7f7bbffff640 10 monclient(hunting): get_auth_request con 0x7f7bc015bf30 auth_method 0 2026-02-17T21:25:36.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7f7bbffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7f7bbffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7f7bbffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.237+0000 7f7bbf7fe640 1 --2- 10.20.193.5:0/3871606820 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7bc00ce5d0 0x7f7bc0147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.238+0000 7f80e7fff640 1 -- 10.20.193.5:0/2466161818 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f80f8007210 con 0x7f811014f660 2026-02-17T21:25:36.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.238+0000 7f80e7fff640 1 --2- 10.20.193.5:0/2466161818 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f80e0079300 0x7f80e007b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.239+0000 7f810effd640 1 --2- 10.20.193.5:0/2466161818 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f80e0079300 0x7f80e007b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.239+0000 7f810effd640 10 monclient: get_auth_request con 0x7f80e0079300 auth_method 0 2026-02-17T21:25:36.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.239+0000 7ff916ba5640 10 monclient(hunting): handle_auth_done global_id 4462 payload 824 2026-02-17T21:25:36.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.239+0000 7ff916ba5640 1 -- 10.20.193.5:0/3888477941 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff910152700 msgr2=0x7ff91015eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.239+0000 7ff916ba5640 1 --2- 10.20.193.5:0/3888477941 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff910152700 0x7ff91015eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.239+0000 7ff916ba5640 1 -- 10.20.193.5:0/3888477941 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff9100c9730 msgr2=0x7ff91014be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.239+0000 7ff916ba5640 1 --2- 10.20.193.5:0/3888477941 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff9100c9730 0x7ff91014be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.239+0000 7ff916ba5640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.239+0000 7ff916ba5640 1 monclient: found mon.noname-b 2026-02-17T21:25:36.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.239+0000 7ff916ba5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.239+0000 7ff916ba5640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.239+0000 7ff916ba5640 1 -- 10.20.193.5:0/3888477941 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff91014c3d0 con 0x7ff910152ae0 2026-02-17T21:25:36.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.239+0000 7f810effd640 1 --2- 10.20.193.5:0/2466161818 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f80e0079300 0x7f80e007b7c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8104039000 tx=0x7f8104031000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.239+0000 7f80e7fff640 10 client.4451.objecter ms_handle_connect 0x7f80e0079300 2026-02-17T21:25:36.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.240+0000 7f7bbffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.240+0000 7f7bbffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.240+0000 7f7bbffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.240+0000 7f7bbf7fe640 10 monclient(hunting): get_auth_request con 0x7f7bc00ce5d0 auth_method 0 2026-02-17T21:25:36.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.240+0000 7f7bbf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.240+0000 7f7bbf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.240+0000 7f7bbf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7f80e7fff640 1 -- 10.20.193.5:0/2466161818 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f80f805da20 con 0x7f811014f660 2026-02-17T21:25:36.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7f80e7fff640 10 client.4451.objecter ms_dispatch2 0x7f8110000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:36.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7f80e7fff640 3 client.4451.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:36.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7f80e7fff640 3 client.4451.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:36.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7f80e7fff640 10 client.4451.objecter checking command 1 2026-02-17T21:25:36.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7f80e7fff640 1 --2- 10.20.193.5:0/2466161818 >> [v2:10.20.193.5:6808/3662168592,v1:10.20.193.5:6809/3662168592] conn(0x7f80e0081840 0x7f80e0083c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7f80e7fff640 20 client.4451.objecter _get_session s=0x7f80e0081170 osd=0 3 2026-02-17T21:25:36.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7f80e7fff640 20 client.4451.objecter put_session s=0x7f80e0081170 osd=0 3 2026-02-17T21:25:36.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7f80e7fff640 15 client.4451.objecter _session_command_op_remove -1 1 2026-02-17T21:25:36.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7f80e7fff640 20 client.4451.objecter _get_session s=0x7f80e0081170 osd=0 3 2026-02-17T21:25:36.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7f80e7fff640 20 client.4451.objecter get_session s=0x7f80e0081170 osd=0 3 2026-02-17T21:25:36.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7facf27fc640 1 -- 10.20.193.5:0/1040105092 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face403c070 con 0x7facf40d1f40 2026-02-17T21:25:36.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7f80e7fff640 15 client.4451.objecter _session_command_op_assign 0 1 2026-02-17T21:25:36.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7facf27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7facf27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:36.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7facf27fc640 10 monclient: dump: 2026-02-17T21:25:36.318 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.318 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7facf27fc640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7facf27fc640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7facf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7facf27fc640 1 -- 10.20.193.5:0/1040105092 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face402fb40 con 0x7facf40d1f40 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7f80e7fff640 20 client.4451.objecter put_session s=0x7f80e0081170 osd=0 4 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7f80e7fff640 10 client.4451.objecter _send_command 1 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7f80e7fff640 1 -- 10.20.193.5:0/2466161818 --> [v2:10.20.193.5:6808/3662168592,v1:10.20.193.5:6809/3662168592] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f80e0084350 con 0x7f80e0081840 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7f80e7fff640 20 client.4451.objecter dump_active .. 0 homeless 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7facf27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7facf27fc640 1 -- 10.20.193.5:0/1040105092 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4037440 con 0x7facf40d1f40 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7facfa1a1640 5 monclient: authenticate success, global_id 4448 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7facfa1a1640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7facf27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7facf27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7facf27fc640 10 monclient: dump: 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.319 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7facfa1a1640 4 set_mon_vals no callback set 2026-02-17T21:25:36.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7f80e7fff640 1 -- 10.20.193.5:0/2466161818 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f80f805dde0 con 0x7f811014f660 2026-02-17T21:25:36.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7f80e7fff640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T21:25:36.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7f7bbf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7f7bbf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7f7bbf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7fd574a87640 1 --2- 10.20.193.5:0/1452172089 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd57015ef80 0x7fd5700cbe40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd56400b990 tx=0x7fd56400be60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7fd56cff9640 10 client.?.objecter ms_handle_connect 0x7fd57015ef80 2026-02-17T21:25:36.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7fd56cff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7facfa1a1640 10 monclient: shutdown 2026-02-17T21:25:36.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7facfa1a1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7facfa1a1640 1 -- 10.20.193.5:0/1040105092 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7facf40d1f40 msgr2=0x7facf415c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7facfa1a1640 1 --2- 10.20.193.5:0/1040105092 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7facf40d1f40 0x7facf415c840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7facf408fc80 tx=0x7face402eed0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7f810f7fe640 1 --2- 10.20.193.5:0/2466161818 >> [v2:10.20.193.5:6808/3662168592,v1:10.20.193.5:6809/3662168592] conn(0x7f80e0081840 0x7f80e0083c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7f58ddd74640 1 --2- 10.20.193.5:0/1444055918 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f58e015ef80 0x7f58e00c9730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f58c8009970 tx=0x7f58c802eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a3eaa77c7591bac server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.241+0000 7facfa1a1640 1 -- 10.20.193.5:0/1040105092 shutdown_connections 2026-02-17T21:25:36.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.242+0000 7facfa1a1640 1 --2- 10.20.193.5:0/1040105092 >> v2:10.20.193.5:3300/0 conn(0x7facf415d950 0x7facf415dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.242+0000 7facfa1a1640 1 --2- 10.20.193.5:0/1040105092 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7facf40d1f40 0x7facf415c840 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.242+0000 7facfa1a1640 1 -- 10.20.193.5:0/1040105092 >> 10.20.193.5:0/1040105092 conn(0x7facf406d9b0 msgr2=0x7facf406ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.242+0000 7ff916ba5640 1 --2- 10.20.193.5:0/3888477941 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff910152ae0 0x7ff9100d1750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff90c00caa0 tx=0x7ff90c00cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.242+0000 7ff8f6ffd640 10 client.?.objecter ms_handle_connect 0x7ff910152ae0 2026-02-17T21:25:36.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.242+0000 7ff8f6ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.242+0000 7facfa1a1640 1 -- 10.20.193.5:0/1040105092 shutdown_connections 2026-02-17T21:25:36.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.242+0000 7facfa1a1640 1 -- 10.20.193.5:0/1040105092 wait complete. 2026-02-17T21:25:36.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.242+0000 7f810f7fe640 10 monclient: get_auth_request con 0x7f80e0081840 auth_method 0 2026-02-17T21:25:36.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.242+0000 7f7bbffff640 10 monclient(hunting): handle_auth_done global_id 4440 payload 824 2026-02-17T21:25:36.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.242+0000 7f7bbffff640 1 -- 10.20.193.5:0/3871606820 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7bc00ceef0 msgr2=0x7f7bc014ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.242+0000 7f7bbffff640 1 --2- 10.20.193.5:0/3871606820 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7bc00ceef0 0x7f7bc014ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.242+0000 7f7bbffff640 1 -- 10.20.193.5:0/3871606820 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7bc00ce5d0 msgr2=0x7f7bc0147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.242+0000 7f7bbffff640 1 --2- 10.20.193.5:0/3871606820 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7bc00ce5d0 0x7f7bc0147d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.242+0000 7f7bbffff640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.242+0000 7f7bbffff640 1 monclient: found mon.noname-a 2026-02-17T21:25:36.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.242+0000 7f7bbffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.242+0000 7f7bbffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.242+0000 7f7bbffff640 1 -- 10.20.193.5:0/3871606820 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bc01487d0 con 0x7f7bc015bf30 2026-02-17T21:25:36.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.242+0000 7facfa1a1640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.242+0000 7facfa1a1640 10 monclient: monmap: 2026-02-17T21:25:36.324 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.324 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.324 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.324 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.324 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.324 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.324 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.324 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.324 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.324 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.242+0000 7facfa1a1640 1 librados: starting msgr at 2026-02-17T21:25:36.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.242+0000 7facfa1a1640 1 librados: starting objecter 2026-02-17T21:25:36.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.243+0000 7facfa1a1640 1 Processor -- start 2026-02-17T21:25:36.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.243+0000 7facfa1a1640 1 -- start start 2026-02-17T21:25:36.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.243+0000 7facfa1a1640 1 librados: setting wanted keys 2026-02-17T21:25:36.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.243+0000 7facfa1a1640 1 librados: calling monclient init 2026-02-17T21:25:36.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.243+0000 7facfa1a1640 10 monclient: init 2026-02-17T21:25:36.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.243+0000 7facfa1a1640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.243+0000 7facfa1a1640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:25:36.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.243+0000 7facfa1a1640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7facf40d1b60 0x7facf413e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.243+0000 7facfa1a1640 10 monclient(hunting): picked mon.noname-c con 0x7facf40d1b60 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.243+0000 7facfa1a1640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7facf40d1f40 0x7facf413ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.243+0000 7facfa1a1640 10 monclient(hunting): picked mon.noname-a con 0x7facf40d1f40 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.243+0000 7facfa1a1640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7facf415d950 0x7facf40cf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.243+0000 7facfa1a1640 10 monclient(hunting): picked mon.noname-b con 0x7facf415d950 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.243+0000 7facfa1a1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.243+0000 7facfa1a1640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7facf40c9ea0 con 0x7facf40d1f40 2026-02-17T21:25:36.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.243+0000 7facfa1a1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.243+0000 7facfa1a1640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7facf415d4c0 con 0x7facf415d950 2026-02-17T21:25:36.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.243+0000 7facfa1a1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.243+0000 7facfa1a1640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7facf40ca180 con 0x7facf40d1b60 2026-02-17T21:25:36.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.243+0000 7facfa1a1640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.243+0000 7facfa1a1640 10 monclient(hunting): authenticate will time out at 1041.808990s 2026-02-17T21:25:36.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.244+0000 7f810f7fe640 1 --2- 10.20.193.5:0/2466161818 >> [v2:10.20.193.5:6808/3662168592,v1:10.20.193.5:6809/3662168592] conn(0x7f80e0081840 0x7f80e0083c80 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.244+0000 7f80e7fff640 10 client.4451.objecter ms_handle_connect 0x7f80e0081840 2026-02-17T21:25:36.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.244+0000 7faae5d97640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faae0152700 0x7faae015c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.245+0000 7fb1ed5d3640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb1e8152ae0 0x7fb1e8145f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.246+0000 7faae6598640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7faae015edb0 0x7faae01f4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.246+0000 7faae6598640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7faae015edb0 0x7faae01f4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:47752/0 (socket says 10.20.193.5:47752) 2026-02-17T21:25:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.246+0000 7faae6598640 1 -- 10.20.193.5:0/2420308612 learned_addr learned my addr 10.20.193.5:0/2420308612 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.246+0000 7faae6598640 10 monclient(hunting): get_auth_request con 0x7faae015edb0 auth_method 0 2026-02-17T21:25:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.246+0000 7faae6598640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.246+0000 7faae6598640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.246+0000 7faae6598640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.247+0000 7faae5d97640 10 monclient(hunting): get_auth_request con 0x7faae0152700 auth_method 0 2026-02-17T21:25:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.247+0000 7faae5d97640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.247+0000 7faae5d97640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.247+0000 7faae5d97640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.247+0000 7fb1ed5d3640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb1e8152ae0 0x7fb1e8145f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:37790/0 (socket says 10.20.193.5:37790) 2026-02-17T21:25:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.247+0000 7fb1ed5d3640 1 -- 10.20.193.5:0/4264433308 learned_addr learned my addr 10.20.193.5:0/4264433308 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.247+0000 7faae6598640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.247+0000 7faae6598640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.247+0000 7faae6598640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.247+0000 7fb1ed5d3640 10 monclient(hunting): get_auth_request con 0x7fb1e8152ae0 auth_method 0 2026-02-17T21:25:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.247+0000 7fb1ed5d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.247+0000 7fb1ed5d3640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.247+0000 7fb1ed5d3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.247+0000 7fec29ffb640 1 -- 10.20.193.5:0/2405860360 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1403c070 con 0x7fec2c1529d0 2026-02-17T21:25:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7fec29ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7faae5d97640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7faae5d97640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7fec29ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7fec29ffb640 10 monclient: dump: 2026-02-17T21:25:36.328 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.328 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.328 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.328 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.328 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.328 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.328 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.328 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.328 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7fec29ffb640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7faae5d97640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7fec29ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7fec29ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7fec29ffb640 1 -- 10.20.193.5:0/2405860360 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec1402fbe0 con 0x7fec2c1529d0 2026-02-17T21:25:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7fec29ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7fec29ffb640 1 -- 10.20.193.5:0/2405860360 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14037440 con 0x7fec2c1529d0 2026-02-17T21:25:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7fec3133b640 5 monclient: authenticate success, global_id 4454 2026-02-17T21:25:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7fec3133b640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7fec3133b640 4 set_mon_vals no callback set 2026-02-17T21:25:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7fec29ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7fec29ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7fec29ffb640 10 monclient: dump: 2026-02-17T21:25:36.329 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.329 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.329 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.329 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.329 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.329 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.329 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.329 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.330 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7fb1ed5d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7fb1ed5d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7fec3133b640 10 monclient: shutdown 2026-02-17T21:25:36.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7fec3133b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7fec3133b640 1 -- 10.20.193.5:0/2405860360 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fec2c1529d0 msgr2=0x7fec2c0c8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7fec3133b640 1 --2- 10.20.193.5:0/2405860360 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fec2c1529d0 0x7fec2c0c8df0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fec14009970 tx=0x7fec1402efb0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7fb1ed5d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7f78af7fe640 1 -- 10.20.193.5:0/2086911859 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a003c070 con 0x7f78b80d1f40 2026-02-17T21:25:36.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.248+0000 7f78af7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7f78af7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:36.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7f78af7fe640 10 monclient: dump: 2026-02-17T21:25:36.330 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.330 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.330 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.330 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.330 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.330 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.330 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.330 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.330 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7f78af7fe640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7f78af7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7f78af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7fec3133b640 1 -- 10.20.193.5:0/2405860360 shutdown_connections 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7fec3133b640 1 --2- 10.20.193.5:0/2405860360 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fec2c1529d0 0x7fec2c0c8df0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7fec3133b640 1 -- 10.20.193.5:0/2405860360 >> 10.20.193.5:0/2405860360 conn(0x7fec2c073030 msgr2=0x7fec2c073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7fec3133b640 1 -- 10.20.193.5:0/2405860360 shutdown_connections 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7fec3133b640 1 -- 10.20.193.5:0/2405860360 wait complete. 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7f78af7fe640 1 -- 10.20.193.5:0/2086911859 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78a002fad0 con 0x7f78b80d1f40 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7f78bef34640 5 monclient: authenticate success, global_id 4453 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7f78bef34640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7f78af7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7f78bef34640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7f78bef34640 4 set_mon_vals no callback set 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7f78af7fe640 1 -- 10.20.193.5:0/2086911859 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0037440 con 0x7f78b80d1f40 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7f78af7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7f78af7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7f78af7fe640 10 monclient: dump: 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.331 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7faae6598640 10 monclient(hunting): handle_auth_done global_id 4463 payload 824 2026-02-17T21:25:36.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7faae6598640 1 -- 10.20.193.5:0/2420308612 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faae0152700 msgr2=0x7faae015c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7faae6598640 1 --2- 10.20.193.5:0/2420308612 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faae0152700 0x7faae015c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7faae6598640 1 -- 10.20.193.5:0/2420308612 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7faae0152ae0 msgr2=0x7faae01493d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7faae6598640 1 --2- 10.20.193.5:0/2420308612 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7faae0152ae0 0x7faae01493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7faae6598640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7faae6598640 1 monclient: found mon.noname-c 2026-02-17T21:25:36.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7faae6598640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7faae6598640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7faae6598640 1 -- 10.20.193.5:0/2420308612 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae0149af0 con 0x7faae015edb0 2026-02-17T21:25:36.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7f78bef34640 10 monclient: shutdown 2026-02-17T21:25:36.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7f78bef34640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7f78bef34640 1 -- 10.20.193.5:0/2086911859 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f78b80d1f40 msgr2=0x7f78b815c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7f78bef34640 1 --2- 10.20.193.5:0/2086911859 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f78b80d1f40 0x7f78b815c840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f78a00098a0 tx=0x7f78a002ee10 comp rx=0 tx=0).stop 2026-02-17T21:25:36.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7f78bef34640 1 -- 10.20.193.5:0/2086911859 shutdown_connections 2026-02-17T21:25:36.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7f78bef34640 1 --2- 10.20.193.5:0/2086911859 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f78b80d1f40 0x7f78b815c840 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7f78bef34640 1 -- 10.20.193.5:0/2086911859 >> 10.20.193.5:0/2086911859 conn(0x7f78b806d9b0 msgr2=0x7f78b806ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7f78bef34640 1 -- 10.20.193.5:0/2086911859 shutdown_connections 2026-02-17T21:25:36.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7f78bef34640 1 -- 10.20.193.5:0/2086911859 wait complete. 2026-02-17T21:25:36.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7fec3133b640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7fec3133b640 10 monclient: monmap: 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7fec3133b640 1 librados: starting msgr at 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.249+0000 7fec3133b640 1 librados: starting objecter 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7fec3133b640 1 Processor -- start 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7fec3133b640 1 -- start start 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7fec3133b640 1 librados: setting wanted keys 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7fec3133b640 1 librados: calling monclient init 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7fec3133b640 10 monclient: init 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7f78bef34640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7f78bef34640 10 monclient: monmap: 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7f78bef34640 1 librados: starting msgr at 2026-02-17T21:25:36.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7f78bef34640 1 librados: starting objecter 2026-02-17T21:25:36.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7fec3133b640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7fec3133b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:25:36.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7fec3133b640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fec2c0d2470 0x7fec2c15c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7fec3133b640 10 monclient(hunting): picked mon.noname-b con 0x7fec2c0d2470 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7fec3133b640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fec2c1525f0 0x7fec2c15acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7fec3133b640 10 monclient(hunting): picked mon.noname-c con 0x7fec2c1525f0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7fec3133b640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fec2c1529d0 0x7fec2c0cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7fec3133b640 10 monclient(hunting): picked mon.noname-a con 0x7fec2c1529d0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7fec3133b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7fec3133b640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c15ddc0 con 0x7fec2c1529d0 2026-02-17T21:25:36.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7fec3133b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7fec3133b640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c0d28b0 con 0x7fec2c0d2470 2026-02-17T21:25:36.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7fec3133b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7fec3133b640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c15df40 con 0x7fec2c1525f0 2026-02-17T21:25:36.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7fec3133b640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7fec3133b640 10 monclient(hunting): authenticate will time out at 1041.815708s 2026-02-17T21:25:36.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7f78bef34640 1 Processor -- start 2026-02-17T21:25:36.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7f7bbffff640 1 --2- 10.20.193.5:0/3871606820 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7bc015bf30 0x7f7bc014b060 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400cb40 tx=0x7f7bb400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7f7b9bfff640 10 client.?.objecter ms_handle_connect 0x7f7bc015bf30 2026-02-17T21:25:36.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7f7b9bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7f78bef34640 1 -- start start 2026-02-17T21:25:36.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7f78bef34640 1 librados: setting wanted keys 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7f78bef34640 1 librados: calling monclient init 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.250+0000 7f78bef34640 10 monclient: init 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fae957fa640 1 -- 10.20.193.5:0/2908302220 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae88004280 con 0x7faea0152ae0 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fae957fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fae957fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fae957fa640 10 monclient: dump: 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fae957fa640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fae957fa640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fae957fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fae957fa640 1 -- 10.20.193.5:0/2908302220 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae88015070 con 0x7faea0152ae0 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fae957fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fae957fa640 1 -- 10.20.193.5:0/2908302220 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae880026e0 con 0x7faea0152ae0 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7faea6d87640 5 monclient: authenticate success, global_id 4431 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fae96ffd640 4 set_mon_vals no callback set 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7faea6d87640 10 monclient: _renew_subs 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7faea6d87640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7faea6d87640 1 -- 10.20.193.5:0/2908302220 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea015cd50 con 0x7faea0152ae0 2026-02-17T21:25:36.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f78bef34640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f78bef34640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:25:36.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f78bef34640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f78b80d1b60 0x7f78b81f45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f78bef34640 10 monclient(hunting): picked mon.noname-a con 0x7f78b80d1b60 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fae957fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7faea6d87640 10 client.4431.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f78bef34640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f78b80d1f40 0x7f78b815aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f78bef34640 10 monclient(hunting): picked mon.noname-c con 0x7f78b80d1f40 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fae957fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:36.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fae957fa640 10 monclient: dump: 2026-02-17T21:25:36.336 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.336 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.336 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.336 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.336 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.336 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.336 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.336 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.336 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.336 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7faea6d87640 10 monclient: _renew_subs 2026-02-17T21:25:36.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f78bef34640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f78b815d950 0x7f78b81f1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7faea6d87640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7faea6d87640 1 -- 10.20.193.5:0/2908302220 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea015a2c0 con 0x7faea0152ae0 2026-02-17T21:25:36.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7faea6d87640 1 librados: init done 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fb1ee5d5640 1 --2- 10.20.193.5:0/4264433308 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb1e815ef80 0x7fb1e81f6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f0853577640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0854153ef0 0x7f08540712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f78bef34640 10 monclient(hunting): picked mon.noname-b con 0x7f78b815d950 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f78bef34640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f78bef34640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f78b815d4c0 con 0x7f78b80d1b60 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f78bef34640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f78bef34640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f78b80ca460 con 0x7f78b815d950 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f78bef34640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f78bef34640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f78b806e7b0 con 0x7f78b80d1f40 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f78bef34640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f78bef34640 10 monclient(hunting): authenticate will time out at 1041.816327s 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fb1ee5d5640 10 monclient(hunting): get_auth_request con 0x7fb1e815ef80 auth_method 0 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fb1ee5d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fb1ee5d5640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fb1ee5d5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f2d37fff640 1 -- 10.20.193.5:0/4147654514 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c004480 con 0x7f2d5c155770 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f2d37fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f2d37fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f2d37fff640 10 monclient: dump: 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.337 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f2d37fff640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f2d37fff640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f2d37fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f2d37fff640 1 -- 10.20.193.5:0/4147654514 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d4c014070 con 0x7f2d5c155770 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f2d62134640 5 monclient: authenticate success, global_id 4422 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f2d62134640 10 monclient: _renew_subs 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f2d62134640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f2d62134640 1 -- 10.20.193.5:0/4147654514 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d5c06d6b0 con 0x7f2d5c155770 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f0853577640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0854153ef0 0x7f08540712a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:47772/0 (socket says 10.20.193.5:47772) 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f0853577640 1 -- 10.20.193.5:0/547646467 learned_addr learned my addr 10.20.193.5:0/547646467 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f0853577640 10 monclient(hunting): get_auth_request con 0x7f0854153ef0 auth_method 0 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f0853577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f0853577640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f0853577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f2d37fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f2d37fff640 1 -- 10.20.193.5:0/4147654514 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c002920 con 0x7f2d5c155770 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f2d37fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f2d37fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f2d37fff640 10 monclient: dump: 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f2d59ffb640 4 set_mon_vals no callback set 2026-02-17T21:25:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f0852d76640 1 --2- 10.20.193.5:0/547646467 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f08540c7990 0x7f08541f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f2d62134640 10 client.4422.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f2d62134640 10 monclient: _renew_subs 2026-02-17T21:25:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f2d62134640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f2d62134640 1 -- 10.20.193.5:0/4147654514 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d5c06dc70 con 0x7f2d5c155770 2026-02-17T21:25:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7f2d62134640 1 librados: init done 2026-02-17T21:25:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7faea6d87640 10 client.4431.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7faea6d87640 15 client.4431.objecter _session_command_op_assign -1 1 2026-02-17T21:25:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7faea6d87640 20 client.4431.objecter _get_session osd=-1 returning homeless 2026-02-17T21:25:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7faea6d87640 10 client.4431.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7faea6d87640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7faea6d87640 1 -- 10.20.193.5:0/2908302220 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faea00d00f0 con 0x7faea0152ae0 2026-02-17T21:25:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fb1ed5d3640 10 monclient(hunting): handle_auth_done global_id 4471 payload 824 2026-02-17T21:25:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fb1ed5d3640 1 -- 10.20.193.5:0/4264433308 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb1e815ef80 msgr2=0x7fb1e81f6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fb1ed5d3640 1 --2- 10.20.193.5:0/4264433308 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb1e815ef80 0x7fb1e81f6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fb1ed5d3640 1 -- 10.20.193.5:0/4264433308 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb1e8152700 msgr2=0x7fb1e81f6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fb1ed5d3640 1 --2- 10.20.193.5:0/4264433308 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb1e8152700 0x7fb1e81f6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fb1ed5d3640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fb1ed5d3640 1 monclient: found mon.noname-b 2026-02-17T21:25:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fb1ed5d3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fb1ed5d3640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.251+0000 7fb1ed5d3640 1 -- 10.20.193.5:0/4264433308 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e81f6b80 con 0x7fb1e8152ae0 2026-02-17T21:25:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.252+0000 7f0853577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.252+0000 7f0853577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.252+0000 7f0853577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.252+0000 7f2d62134640 10 client.4422.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.252+0000 7f2d62134640 15 client.4422.objecter _session_command_op_assign -1 1 2026-02-17T21:25:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.252+0000 7f2d62134640 20 client.4422.objecter _get_session osd=-1 returning homeless 2026-02-17T21:25:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.252+0000 7f2d62134640 10 client.4422.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.252+0000 7f2d62134640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.252+0000 7f2d62134640 1 -- 10.20.193.5:0/4147654514 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2d5c0c01d0 con 0x7f2d5c155770 2026-02-17T21:25:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.253+0000 7facf2ffd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7facf40d1f40 0x7facf413ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.253+0000 7facf2ffd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7facf40d1f40 0x7facf413ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:50170/0 (socket says 10.20.193.5:50170) 2026-02-17T21:25:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.253+0000 7facf2ffd640 1 -- 10.20.193.5:0/862750175 learned_addr learned my addr 10.20.193.5:0/862750175 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.253+0000 7facf2ffd640 10 monclient(hunting): get_auth_request con 0x7facf40d1f40 auth_method 0 2026-02-17T21:25:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.253+0000 7facf2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.253+0000 7facf2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.253+0000 7facf2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.253+0000 7f0853577640 10 monclient(hunting): handle_auth_done global_id 4466 payload 824 2026-02-17T21:25:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.253+0000 7f0853577640 1 -- 10.20.193.5:0/547646467 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f08540cccf0 msgr2=0x7f0854147be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.253+0000 7f0853577640 1 --2- 10.20.193.5:0/547646467 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f08540cccf0 0x7f0854147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.253+0000 7f0853577640 1 -- 10.20.193.5:0/547646467 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f08540c7990 msgr2=0x7f08541f4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.253+0000 7f0853577640 1 --2- 10.20.193.5:0/547646467 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f08540c7990 0x7f08541f4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.253+0000 7f0853577640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.253+0000 7f0853577640 1 monclient: found mon.noname-c 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.253+0000 7f0853577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.253+0000 7f0853577640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.253+0000 7f0853577640 1 -- 10.20.193.5:0/547646467 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f085406f6b0 con 0x7f0854153ef0 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.254+0000 7facf2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.254+0000 7facf2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.254+0000 7facf2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff8f6ffd640 1 -- 10.20.193.5:0/3888477941 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c00abe0 con 0x7ff910152ae0 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff8f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff8f6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff8f6ffd640 10 monclient: dump: 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff8f6ffd640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff8f6ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff8f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff8f6ffd640 1 -- 10.20.193.5:0/3888477941 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff90c00ad80 con 0x7ff910152ae0 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff8f6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff8f6ffd640 1 -- 10.20.193.5:0/3888477941 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c012620 con 0x7ff910152ae0 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff91862f640 5 monclient: authenticate success, global_id 4462 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff914ba1640 4 set_mon_vals no callback set 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff8f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff8f6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff8f6ffd640 10 monclient: dump: 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff91862f640 10 monclient: _renew_subs 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff91862f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff91862f640 1 -- 10.20.193.5:0/3888477941 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9101f6d70 con 0x7ff910152ae0 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7fb1d67fc640 10 client.?.objecter ms_handle_connect 0x7fb1e8152ae0 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7fb1d67fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7fb1ed5d3640 1 --2- 10.20.193.5:0/4264433308 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb1e8152ae0 0x7fb1e8145f70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00c600 tx=0x7fb1dc00cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff91862f640 10 client.4462.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff91862f640 10 monclient: _renew_subs 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff91862f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff91862f640 1 -- 10.20.193.5:0/3888477941 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9101f7330 con 0x7ff910152ae0 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff91862f640 1 librados: init done 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff91862f640 10 client.4462.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff91862f640 15 client.4462.objecter _session_command_op_assign -1 1 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff91862f640 20 client.4462.objecter _get_session osd=-1 returning homeless 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff91862f640 10 client.4462.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff91862f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7ff91862f640 1 -- 10.20.193.5:0/3888477941 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff9100c9b60 con 0x7ff910152ae0 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7f58dd573640 1 -- 10.20.193.5:0/1444055918 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c803c070 con 0x7f58e015ef80 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7f58dd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7f58dd573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7f58dd573640 10 monclient: dump: 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7f58dd573640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7f58dd573640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7f58dd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7f58dd573640 1 -- 10.20.193.5:0/1444055918 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c802fb60 con 0x7f58e015ef80 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7f58dd573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7f58dd573640 1 -- 10.20.193.5:0/1444055918 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c8037440 con 0x7f58e015ef80 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7f58dd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7f58dd573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7f58dd573640 10 monclient: dump: 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.343 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7facf2ffd640 10 monclient(hunting): handle_auth_done global_id 4443 payload 824 2026-02-17T21:25:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7facf2ffd640 1 -- 10.20.193.5:0/862750175 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7facf40d1b60 msgr2=0x7facf413e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7facf2ffd640 1 --2- 10.20.193.5:0/862750175 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7facf40d1b60 0x7facf413e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7facf2ffd640 1 -- 10.20.193.5:0/862750175 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7facf415d950 msgr2=0x7facf40cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7facf2ffd640 1 --2- 10.20.193.5:0/862750175 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7facf415d950 0x7facf40cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7facf2ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7facf2ffd640 1 monclient: found mon.noname-a 2026-02-17T21:25:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7facf2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7facf2ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7facf2ffd640 1 -- 10.20.193.5:0/862750175 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf4159580 con 0x7facf40d1f40 2026-02-17T21:25:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7f58e4b01640 5 monclient: authenticate success, global_id 4460 2026-02-17T21:25:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7f58e4b01640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.255+0000 7f58e4b01640 4 set_mon_vals no callback set 2026-02-17T21:25:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.256+0000 7f58e4b01640 10 monclient: shutdown 2026-02-17T21:25:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.256+0000 7f58e4b01640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.256+0000 7f58e4b01640 1 -- 10.20.193.5:0/1444055918 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f58e015ef80 msgr2=0x7f58e00c9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.256+0000 7f58e4b01640 1 --2- 10.20.193.5:0/1444055918 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f58e015ef80 0x7f58e00c9730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f58c8009970 tx=0x7f58c802eef0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.256+0000 7f0853577640 1 --2- 10.20.193.5:0/547646467 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0854153ef0 0x7f08540712a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f084400cbe0 tx=0x7f084400a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.256+0000 7f08337fe640 10 client.?.objecter ms_handle_connect 0x7f0854153ef0 2026-02-17T21:25:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.256+0000 7f08337fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.256+0000 7f58e4b01640 1 -- 10.20.193.5:0/1444055918 shutdown_connections 2026-02-17T21:25:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.256+0000 7f58e4b01640 1 --2- 10.20.193.5:0/1444055918 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f58e015ef80 0x7f58e00c9730 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.256+0000 7f58e4b01640 1 -- 10.20.193.5:0/1444055918 >> 10.20.193.5:0/1444055918 conn(0x7f58e0073030 msgr2=0x7f58e0073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.256+0000 7f58e4b01640 1 -- 10.20.193.5:0/1444055918 shutdown_connections 2026-02-17T21:25:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.256+0000 7f58e4b01640 1 -- 10.20.193.5:0/1444055918 wait complete. 2026-02-17T21:25:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.256+0000 7faae6598640 1 --2- 10.20.193.5:0/2420308612 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7faae015edb0 0x7faae01f4230 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faadc009f50 tx=0x7faadc004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.256+0000 7faace7fc640 10 client.?.objecter ms_handle_connect 0x7faae015edb0 2026-02-17T21:25:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.256+0000 7faace7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.256+0000 7f58e4b01640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.256+0000 7f58e4b01640 10 monclient: monmap: 2026-02-17T21:25:36.345 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.345 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.345 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.345 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.345 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.345 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.345 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.345 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.345 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.256+0000 7f58e4b01640 1 librados: starting msgr at 2026-02-17T21:25:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.256+0000 7f58e4b01640 1 librados: starting objecter 2026-02-17T21:25:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.256+0000 7f58e4b01640 1 Processor -- start 2026-02-17T21:25:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.257+0000 7f58e4b01640 1 -- start start 2026-02-17T21:25:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.257+0000 7f58e4b01640 1 librados: setting wanted keys 2026-02-17T21:25:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.257+0000 7f58e4b01640 1 librados: calling monclient init 2026-02-17T21:25:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.257+0000 7f58e4b01640 10 monclient: init 2026-02-17T21:25:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.257+0000 7f58e4b01640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.257+0000 7f58e4b01640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.257+0000 7f58e4b01640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f58e0152700 0x7f58e014db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.257+0000 7f58e4b01640 10 monclient(hunting): picked mon.noname-a con 0x7f58e0152700 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.257+0000 7f58e4b01640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f58e0152ae0 0x7f58e01f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.257+0000 7f58e4b01640 10 monclient(hunting): picked mon.noname-b con 0x7f58e0152ae0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.257+0000 7f58e4b01640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f58e015ef80 0x7f58e00cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.257+0000 7f58e4b01640 10 monclient(hunting): picked mon.noname-c con 0x7f58e015ef80 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.257+0000 7f58e4b01640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.257+0000 7f58e4b01640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f58e00ca380 con 0x7f58e0152700 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.257+0000 7f58e4b01640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.257+0000 7f58e4b01640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f58e015e350 con 0x7f58e0152ae0 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.257+0000 7f58e4b01640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.257+0000 7f58e4b01640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f58e0166850 con 0x7f58e015ef80 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.257+0000 7f58e4b01640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.257+0000 7f58e4b01640 10 monclient(hunting): authenticate will time out at 1041.822434s 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.259+0000 7fec2a7fc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fec2c1525f0 0x7fec2c15acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.259+0000 7f78affff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f78b80d1f40 0x7f78b815aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.259+0000 7fec2a7fc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fec2c1525f0 0x7fec2c15acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:47790/0 (socket says 10.20.193.5:47790) 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.259+0000 7fec2a7fc640 1 -- 10.20.193.5:0/2448085832 learned_addr learned my addr 10.20.193.5:0/2448085832 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.259+0000 7fec2a7fc640 10 monclient(hunting): get_auth_request con 0x7fec2c1525f0 auth_method 0 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.259+0000 7fec2a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.259+0000 7fec2a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.259+0000 7fec2a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.260+0000 7f78affff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f78b80d1f40 0x7f78b815aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:47802/0 (socket says 10.20.193.5:47802) 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.260+0000 7f78affff640 1 -- 10.20.193.5:0/741987363 learned_addr learned my addr 10.20.193.5:0/741987363 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.260+0000 7f78affff640 10 monclient(hunting): get_auth_request con 0x7f78b80d1f40 auth_method 0 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.260+0000 7f78affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.260+0000 7f78affff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.260+0000 7f78affff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.260+0000 7fec2a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.260+0000 7fec2a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.260+0000 7fec2a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.260+0000 7f78affff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.260+0000 7f78affff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.260+0000 7f78affff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.261+0000 7fd56cff9640 1 -- 10.20.193.5:0/1452172089 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd564006e60 con 0x7fd57015ef80 2026-02-17T21:25:36.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.261+0000 7fd56cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.261+0000 7fd56cff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:36.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.261+0000 7fd56cff9640 10 monclient: dump: 2026-02-17T21:25:36.347 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.347 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.347 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.347 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.347 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.347 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.347 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.347 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.347 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.347 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.261+0000 7fd56cff9640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.261+0000 7fd56cff9640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.261+0000 7fd56cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.261+0000 7fd56cff9640 1 -- 10.20.193.5:0/1452172089 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd564010070 con 0x7fd57015ef80 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.261+0000 7fd56cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.261+0000 7fd56cff9640 1 -- 10.20.193.5:0/1452172089 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56400c9d0 con 0x7fd57015ef80 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.261+0000 7fd576511640 5 monclient: authenticate success, global_id 4459 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.261+0000 7fd56e7fc640 4 set_mon_vals no callback set 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.261+0000 7fd56cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.261+0000 7fd56cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.261+0000 7fd56cff9640 10 monclient: dump: 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.261+0000 7fd576511640 10 monclient: _renew_subs 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.261+0000 7fd576511640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.261+0000 7fd576511640 1 -- 10.20.193.5:0/1452172089 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd57014abe0 con 0x7fd57015ef80 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.261+0000 7fd576511640 10 client.4459.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.261+0000 7fd576511640 10 monclient: _renew_subs 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.261+0000 7fd576511640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.261+0000 7fd576511640 1 -- 10.20.193.5:0/1452172089 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5700ce080 con 0x7fd57015ef80 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.261+0000 7fd576511640 1 librados: init done 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.261+0000 7fd576511640 10 client.4459.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.262+0000 7fd576511640 15 client.4459.objecter _session_command_op_assign -1 1 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.262+0000 7fd576511640 20 client.4459.objecter _get_session osd=-1 returning homeless 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.262+0000 7fd576511640 10 client.4459.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.262+0000 7fd576511640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.262+0000 7fd576511640 1 -- 10.20.193.5:0/1452172089 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd57015e870 con 0x7fd57015ef80 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.262+0000 7fec2a7fc640 10 monclient(hunting): handle_auth_done global_id 4472 payload 824 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.262+0000 7fec2a7fc640 1 -- 10.20.193.5:0/2448085832 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fec2c0d2470 msgr2=0x7fec2c15c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.262+0000 7fec2a7fc640 1 --2- 10.20.193.5:0/2448085832 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fec2c0d2470 0x7fec2c15c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.262+0000 7fec2a7fc640 1 -- 10.20.193.5:0/2448085832 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fec2c1529d0 msgr2=0x7fec2c0cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.262+0000 7fec2a7fc640 1 --2- 10.20.193.5:0/2448085832 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fec2c1529d0 0x7fec2c0cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.262+0000 7fec2a7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.262+0000 7fec2a7fc640 1 monclient: found mon.noname-c 2026-02-17T21:25:36.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.262+0000 7fec2a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.262+0000 7fec2a7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.262+0000 7fec2a7fc640 1 -- 10.20.193.5:0/2448085832 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec2c15b770 con 0x7fec2c1525f0 2026-02-17T21:25:36.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.264+0000 7f78affff640 10 monclient(hunting): handle_auth_done global_id 4475 payload 824 2026-02-17T21:25:36.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.264+0000 7f78affff640 1 -- 10.20.193.5:0/741987363 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f78b815d950 msgr2=0x7f78b81f1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.264+0000 7f78affff640 1 --2- 10.20.193.5:0/741987363 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f78b815d950 0x7f78b81f1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.264+0000 7f78affff640 1 -- 10.20.193.5:0/741987363 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f78b80d1b60 msgr2=0x7f78b81f45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.264+0000 7f78affff640 1 --2- 10.20.193.5:0/741987363 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f78b80d1b60 0x7f78b81f45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.264+0000 7f78affff640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.264+0000 7f78affff640 1 monclient: found mon.noname-c 2026-02-17T21:25:36.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.264+0000 7f78affff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.264+0000 7f78affff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.264+0000 7f78affff640 1 -- 10.20.193.5:0/741987363 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b81f5ea0 con 0x7f78b80d1f40 2026-02-17T21:25:36.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f80e7fff640 1 -- 10.20.193.5:0/2466161818 <== osd.0 v2:10.20.193.5:6808/3662168592 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f80e0084350 con 0x7f80e0081840 2026-02-17T21:25:36.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f80e7fff640 10 client.4451.objecter ms_dispatch2 0x7f8110000b90 command_reply(tid 1: 0 ) 2026-02-17T21:25:36.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f80e7fff640 10 client.4451.objecter _finish_command 1 = system:0 2026-02-17T21:25:36.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f80e7fff640 20 client.4451.objecter put_session s=0x7f80e0081170 osd=0 4 2026-02-17T21:25:36.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f80e7fff640 15 client.4451.objecter _session_command_op_remove 0 1 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f6cbffff640 1 -- 10.20.193.5:0/580086956 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8046070 con 0x7f6ce815ef80 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f6cbffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f6cbffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f6cbffff640 10 monclient: dump: 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f6cbffff640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f6cbffff640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f6cbffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f6cbffff640 1 -- 10.20.193.5:0/580086956 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cd8041670 con 0x7f6ce815ef80 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f6cbffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f6cbffff640 1 -- 10.20.193.5:0/580086956 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd803c040 con 0x7f6ce815ef80 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f6cbffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f6cbffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f6cbffff640 10 monclient: dump: 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f6ce57fa640 4 set_mon_vals no callback set 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f6ced9a1640 5 monclient: authenticate success, global_id 4428 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f6ced9a1640 10 monclient: _renew_subs 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f6ced9a1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f6ced9a1640 1 -- 10.20.193.5:0/580086956 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ce814c2e0 con 0x7f6ce815ef80 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f6ced9a1640 10 client.4428.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f6ced9a1640 10 monclient: _renew_subs 2026-02-17T21:25:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f6ced9a1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f6ced9a1640 1 -- 10.20.193.5:0/580086956 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ce814f730 con 0x7f6ce815ef80 2026-02-17T21:25:36.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f6ced9a1640 1 librados: init done 2026-02-17T21:25:36.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.265+0000 7f62ebfff640 1 -- 10.20.193.5:0/3081270013 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f6300024060 con 0x7f6310144960 2026-02-17T21:25:36.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.266+0000 7facf2ffd640 1 --2- 10.20.193.5:0/862750175 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7facf40d1f40 0x7facf413ead0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7face4002410 tx=0x7face40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.266+0000 7faccffff640 10 client.?.objecter ms_handle_connect 0x7facf40d1f40 2026-02-17T21:25:36.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.266+0000 7faccffff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.266+0000 7f62ebfff640 1 --2- 10.20.193.5:0/3081270013 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f62e0079280 0x7f62e007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.266+0000 7f6ced9a1640 10 client.4428.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.266+0000 7f6ced9a1640 15 client.4428.objecter _session_command_op_assign -1 1 2026-02-17T21:25:36.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.266+0000 7f6ced9a1640 20 client.4428.objecter _get_session osd=-1 returning homeless 2026-02-17T21:25:36.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.266+0000 7f6ced9a1640 10 client.4428.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.266+0000 7f6ced9a1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.266+0000 7f6ced9a1640 1 -- 10.20.193.5:0/580086956 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ce80cb680 con 0x7f6ce815ef80 2026-02-17T21:25:36.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.266+0000 7f630f7fe640 1 --2- 10.20.193.5:0/3081270013 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f62e0079280 0x7f62e007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.266+0000 7f630f7fe640 10 monclient: get_auth_request con 0x7f62e0079280 auth_method 0 2026-02-17T21:25:36.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.266+0000 7fec2a7fc640 1 --2- 10.20.193.5:0/2448085832 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fec2c1525f0 0x7fec2c15acc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fec14002410 tx=0x7fec140047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.266+0000 7fec0b7fe640 10 client.?.objecter ms_handle_connect 0x7fec2c1525f0 2026-02-17T21:25:36.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.266+0000 7fec0b7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.266+0000 7f630f7fe640 1 --2- 10.20.193.5:0/3081270013 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f62e0079280 0x7f62e007b740 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f62fc037000 tx=0x7f62fc031000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.267+0000 7f62ebfff640 10 client.4419.objecter ms_handle_connect 0x7f62e0079280 2026-02-17T21:25:36.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.267+0000 7f08337fe640 1 -- 10.20.193.5:0/547646467 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0844017070 con 0x7f0854153ef0 2026-02-17T21:25:36.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.267+0000 7f08337fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.267+0000 7f08337fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:36.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.267+0000 7f08337fe640 10 monclient: dump: 2026-02-17T21:25:36.352 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.352 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.352 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.352 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.352 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.352 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.352 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.352 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.352 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.352 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.267+0000 7f08337fe640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.267+0000 7f08337fe640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.267+0000 7f08337fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.267+0000 7f08337fe640 1 -- 10.20.193.5:0/547646467 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f084400ad70 con 0x7f0854153ef0 2026-02-17T21:25:36.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.267+0000 7f08337fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.267+0000 7f08337fe640 1 -- 10.20.193.5:0/547646467 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0844012640 con 0x7f0854153ef0 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.267+0000 7f08590d3640 5 monclient: authenticate success, global_id 4466 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.267+0000 7f08590d3640 10 monclient: _renew_subs 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.267+0000 7f0851573640 4 set_mon_vals no callback set 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.267+0000 7f08590d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.267+0000 7f08590d3640 1 -- 10.20.193.5:0/547646467 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f085406f950 con 0x7f0854153ef0 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.267+0000 7f08337fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.267+0000 7f08337fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.267+0000 7f08337fe640 10 monclient: dump: 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.267+0000 7f08590d3640 10 client.4466.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.267+0000 7f08590d3640 10 monclient: _renew_subs 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.267+0000 7f08590d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.267+0000 7f08590d3640 1 -- 10.20.193.5:0/547646467 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f085406ff10 con 0x7f0854153ef0 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.267+0000 7f08590d3640 1 librados: init done 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.268+0000 7f08590d3640 10 client.4466.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.268+0000 7f08590d3640 15 client.4466.objecter _session_command_op_assign -1 1 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.268+0000 7f08590d3640 20 client.4466.objecter _get_session osd=-1 returning homeless 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.268+0000 7f08590d3640 10 client.4466.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.268+0000 7f08590d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.268+0000 7f08590d3640 1 -- 10.20.193.5:0/547646467 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0854074b20 con 0x7f0854153ef0 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.268+0000 7f78affff640 1 --2- 10.20.193.5:0/741987363 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f78b80d1f40 0x7f78b815aef0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f78a00099d0 tx=0x7f78a00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.268+0000 7f78ad7fa640 10 client.?.objecter ms_handle_connect 0x7f78b80d1f40 2026-02-17T21:25:36.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.268+0000 7f78ad7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec0b7fe640 1 -- 10.20.193.5:0/2448085832 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14045020 con 0x7fec2c1525f0 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec0b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec0b7fe640 10 monclient: dump: 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec0b7fe640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec0b7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec0b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec0b7fe640 1 -- 10.20.193.5:0/2448085832 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec1403d040 con 0x7fec2c1525f0 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec3133b640 5 monclient: authenticate success, global_id 4472 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec3133b640 10 monclient: _renew_subs 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec3133b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec3133b640 1 -- 10.20.193.5:0/2448085832 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec2c15ba50 con 0x7fec2c1525f0 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec0b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec297fa640 4 set_mon_vals no callback set 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec3133b640 10 client.4472.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec3133b640 10 monclient: _renew_subs 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec3133b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec3133b640 1 -- 10.20.193.5:0/2448085832 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec2c15c010 con 0x7fec2c1525f0 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fb1d67fc640 1 -- 10.20.193.5:0/4264433308 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc012830 con 0x7fb1e8152ae0 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fb1d67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec3133b640 1 librados: init done 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fb1d67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fb1d67fc640 10 monclient: dump: 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fb1d67fc640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fb1d67fc640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fb1d67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fb1d67fc640 1 -- 10.20.193.5:0/4264433308 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1dc017070 con 0x7fb1e8152ae0 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fb1d67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fb1d67fc640 1 -- 10.20.193.5:0/4264433308 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc012c10 con 0x7fb1e8152ae0 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fb1d67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fb1d7fff640 4 set_mon_vals no callback set 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fb1d67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fb1d67fc640 10 monclient: dump: 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fb1f005f640 5 monclient: authenticate success, global_id 4471 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fb1f005f640 10 monclient: _renew_subs 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fb1f005f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fb1f005f640 1 -- 10.20.193.5:0/4264433308 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e81f52c0 con 0x7fb1e8152ae0 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fb1f005f640 10 client.4471.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fb1f005f640 10 monclient: _renew_subs 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fb1f005f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fb1f005f640 1 -- 10.20.193.5:0/4264433308 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e81f5880 con 0x7fb1e8152ae0 2026-02-17T21:25:36.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fb1f005f640 1 librados: init done 2026-02-17T21:25:36.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec0b7fe640 1 -- 10.20.193.5:0/2448085832 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1403c070 con 0x7fec2c1525f0 2026-02-17T21:25:36.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec0b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:36.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec0b7fe640 10 monclient: dump: 2026-02-17T21:25:36.356 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.356 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.356 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.356 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.356 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.356 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.356 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.356 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.356 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.356 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7f62ebfff640 1 -- 10.20.193.5:0/3081270013 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f6300097b80 con 0x7f6310144960 2026-02-17T21:25:36.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7f62ebfff640 10 client.4419.objecter ms_dispatch2 0x7f6310000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:36.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7f62ebfff640 3 client.4419.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:36.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7f62ebfff640 3 client.4419.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:36.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec3133b640 10 client.4472.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec3133b640 15 client.4472.objecter _session_command_op_assign -1 1 2026-02-17T21:25:36.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec3133b640 20 client.4472.objecter _get_session osd=-1 returning homeless 2026-02-17T21:25:36.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec3133b640 10 client.4472.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec3133b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7fec3133b640 1 -- 10.20.193.5:0/2448085832 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fec2c0c8df0 con 0x7fec2c1525f0 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7f62ebfff640 10 client.4419.objecter checking command 1 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7f62ebfff640 1 --2- 10.20.193.5:0/3081270013 >> [v2:10.20.193.119:6800/267553149,v1:10.20.193.119:6801/267553149] conn(0x7f62e00817c0 0x7f62e0083c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7f62ebfff640 20 client.4419.objecter _get_session s=0x7f62e00810f0 osd=1 3 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7f62ebfff640 20 client.4419.objecter put_session s=0x7f62e00810f0 osd=1 3 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7f62ebfff640 15 client.4419.objecter _session_command_op_remove -1 1 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7faace7fc640 1 -- 10.20.193.5:0/2420308612 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faadc046020 con 0x7faae015edb0 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7faace7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7f62ebfff640 20 client.4419.objecter _get_session s=0x7f62e00810f0 osd=1 3 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7f62ebfff640 20 client.4419.objecter get_session s=0x7f62e00810f0 osd=1 3 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7f62ebfff640 15 client.4419.objecter _session_command_op_assign 1 1 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7f62ebfff640 20 client.4419.objecter put_session s=0x7f62e00810f0 osd=1 4 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7f62ebfff640 10 client.4419.objecter _send_command 1 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7f62ebfff640 1 -- 10.20.193.5:0/3081270013 --> [v2:10.20.193.119:6800/267553149,v1:10.20.193.119:6801/267553149] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6300016ec0 con 0x7f62e00817c0 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7f62ebfff640 20 client.4419.objecter dump_active .. 0 homeless 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7f62ebfff640 1 -- 10.20.193.5:0/3081270013 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f630005e350 con 0x7f6310144960 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7faace7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7faace7fc640 10 monclient: dump: 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.357 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7f62ebfff640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7faace7fc640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7faace7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7faace7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7faace7fc640 1 -- 10.20.193.5:0/2420308612 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faadc041450 con 0x7faae015edb0 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7faace7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7faace7fc640 1 -- 10.20.193.5:0/2420308612 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faadc037e60 con 0x7faae015edb0 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7faace7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7faace7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7faace7fc640 10 monclient: dump: 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7faacffff640 4 set_mon_vals no callback set 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7faae8022640 5 monclient: authenticate success, global_id 4463 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7faae8022640 10 monclient: _renew_subs 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7faae8022640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.269+0000 7faae8022640 1 -- 10.20.193.5:0/2420308612 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faae0149dd0 con 0x7faae015edb0 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7fb1f005f640 10 client.4471.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7fb1f005f640 15 client.4471.objecter _session_command_op_assign -1 1 2026-02-17T21:25:36.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7fb1f005f640 20 client.4471.objecter _get_session osd=-1 returning homeless 2026-02-17T21:25:36.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7fb1f005f640 10 client.4471.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7faae8022640 10 client.4463.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7faae8022640 10 monclient: _renew_subs 2026-02-17T21:25:36.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7faae8022640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7faae8022640 1 -- 10.20.193.5:0/2420308612 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faae014a390 con 0x7faae015edb0 2026-02-17T21:25:36.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7faae8022640 1 librados: init done 2026-02-17T21:25:36.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7fb1f005f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7fb1f005f640 1 -- 10.20.193.5:0/4264433308 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb1e815e870 con 0x7fb1e8152ae0 2026-02-17T21:25:36.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7ff8f6ffd640 1 -- 10.20.193.5:0/3888477941 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7ff90c0127c0 con 0x7ff910152ae0 2026-02-17T21:25:36.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7b9bfff640 1 -- 10.20.193.5:0/3871606820 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb400ad50 con 0x7f7bc015bf30 2026-02-17T21:25:36.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7b9bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7b9bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:36.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7b9bfff640 10 monclient: dump: 2026-02-17T21:25:36.359 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.359 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.359 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.359 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.359 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.359 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.359 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.359 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.359 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.359 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7b9bfff640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7b9bfff640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7b9bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7b9bfff640 1 -- 10.20.193.5:0/3871606820 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bb4012400 con 0x7f7bc015bf30 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7b9bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7b9bfff640 1 -- 10.20.193.5:0/3871606820 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb40127b0 con 0x7f7bc015bf30 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7b9bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7b9bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7b9bfff640 10 monclient: dump: 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7bbdffb640 4 set_mon_vals no callback set 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7bc61c3640 5 monclient: authenticate success, global_id 4440 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7bc61c3640 10 monclient: _renew_subs 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7bc61c3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7bc61c3640 1 -- 10.20.193.5:0/3871606820 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bc0148ab0 con 0x7f7bc015bf30 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7bc61c3640 10 client.4440.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7bc61c3640 10 monclient: _renew_subs 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7bc61c3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7bc61c3640 1 -- 10.20.193.5:0/3871606820 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bc0149070 con 0x7f7bc015bf30 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f58ded76640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f58e015ef80 0x7f58e00cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7bc61c3640 1 librados: init done 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7ff8f6ffd640 1 --2- 10.20.193.5:0/3888477941 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff8e00792d0 0x7ff8e007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f630ffff640 1 --2- 10.20.193.5:0/3081270013 >> [v2:10.20.193.119:6800/267553149,v1:10.20.193.119:6801/267553149] conn(0x7f62e00817c0 0x7f62e0083c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7faae8022640 10 client.4463.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7faae8022640 15 client.4463.objecter _session_command_op_assign -1 1 2026-02-17T21:25:36.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7faae8022640 20 client.4463.objecter _get_session osd=-1 returning homeless 2026-02-17T21:25:36.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7faae8022640 10 client.4463.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7faae8022640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7faae8022640 1 -- 10.20.193.5:0/2420308612 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faae015e870 con 0x7faae015edb0 2026-02-17T21:25:36.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7ff9163a4640 1 --2- 10.20.193.5:0/3888477941 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff8e00792d0 0x7ff8e007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7ff9163a4640 10 monclient: get_auth_request con 0x7ff8e00792d0 auth_method 0 2026-02-17T21:25:36.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f630ffff640 10 monclient: get_auth_request con 0x7f62e00817c0 auth_method 0 2026-02-17T21:25:36.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7bc61c3640 10 client.4440.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7bc61c3640 15 client.4440.objecter _session_command_op_assign -1 1 2026-02-17T21:25:36.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7bc61c3640 20 client.4440.objecter _get_session osd=-1 returning homeless 2026-02-17T21:25:36.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7bc61c3640 10 client.4440.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7bc61c3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.270+0000 7f7bc61c3640 1 -- 10.20.193.5:0/3871606820 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7bc00ce9b0 con 0x7f7bc015bf30 2026-02-17T21:25:36.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.271+0000 7f58ded76640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f58e015ef80 0x7f58e00cfb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:47818/0 (socket says 10.20.193.5:47818) 2026-02-17T21:25:36.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.271+0000 7f58ded76640 1 -- 10.20.193.5:0/3456503733 learned_addr learned my addr 10.20.193.5:0/3456503733 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.271+0000 7f58ded76640 10 monclient(hunting): get_auth_request con 0x7f58e015ef80 auth_method 0 2026-02-17T21:25:36.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.271+0000 7f58ded76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.271+0000 7f58ded76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.271+0000 7f58ded76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.271+0000 7ff8f6ffd640 10 client.4462.objecter ms_handle_connect 0x7ff8e00792d0 2026-02-17T21:25:36.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.271+0000 7ff9163a4640 1 --2- 10.20.193.5:0/3888477941 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff8e00792d0 0x7ff8e007b790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff900004640 tx=0x7ff900009240 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7f81158ea640 10 client.4451.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:25:36.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7f81158ea640 15 client.4451.objecter _session_command_op_assign -1 2 2026-02-17T21:25:36.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7f81158ea640 20 client.4451.objecter _get_session s=0x7f80e0081170 osd=0 3 2026-02-17T21:25:36.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7f81158ea640 20 client.4451.objecter put_session s=0x7f80e0081170 osd=0 3 2026-02-17T21:25:36.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7f81158ea640 20 client.4451.objecter _get_session s=0x7f80e0081170 osd=0 3 2026-02-17T21:25:36.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7f81158ea640 15 client.4451.objecter _session_command_op_remove -1 2 2026-02-17T21:25:36.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7f81158ea640 20 client.4451.objecter get_session s=0x7f80e0081170 osd=0 3 2026-02-17T21:25:36.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7f81158ea640 15 client.4451.objecter _session_command_op_assign 0 2 2026-02-17T21:25:36.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7f81158ea640 20 client.4451.objecter put_session s=0x7f80e0081170 osd=0 4 2026-02-17T21:25:36.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7f81158ea640 10 client.4451.objecter _send_command 2 2026-02-17T21:25:36.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7f81158ea640 1 -- 10.20.193.5:0/2466161818 --> [v2:10.20.193.5:6808/3662168592,v1:10.20.193.5:6809/3662168592] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f81100c9b70 con 0x7f80e0081840 2026-02-17T21:25:36.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7ff8f6ffd640 1 -- 10.20.193.5:0/3888477941 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7ff90c05ea80 con 0x7ff910152ae0 2026-02-17T21:25:36.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7ff8f6ffd640 10 client.4462.objecter ms_dispatch2 0x7ff910000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:36.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7ff8f6ffd640 3 client.4462.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:36.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7ff8f6ffd640 3 client.4462.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:36.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7ff8f6ffd640 10 client.4462.objecter checking command 1 2026-02-17T21:25:36.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7ff8f6ffd640 1 --2- 10.20.193.5:0/3888477941 >> [v2:10.20.193.176:6826/1604873931,v1:10.20.193.176:6827/1604873931] conn(0x7ff8e0081810 0x7ff8e0083c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7ff8f6ffd640 20 client.4462.objecter _get_session s=0x7ff8e0081140 osd=7 3 2026-02-17T21:25:36.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7ff8f6ffd640 20 client.4462.objecter put_session s=0x7ff8e0081140 osd=7 3 2026-02-17T21:25:36.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7ff8f6ffd640 15 client.4462.objecter _session_command_op_remove -1 1 2026-02-17T21:25:36.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7ff8f6ffd640 20 client.4462.objecter _get_session s=0x7ff8e0081140 osd=7 3 2026-02-17T21:25:36.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7ff8f6ffd640 20 client.4462.objecter get_session s=0x7ff8e0081140 osd=7 3 2026-02-17T21:25:36.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7ff8f6ffd640 15 client.4462.objecter _session_command_op_assign 7 1 2026-02-17T21:25:36.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7ff8f6ffd640 20 client.4462.objecter put_session s=0x7ff8e0081140 osd=7 4 2026-02-17T21:25:36.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7ff8f6ffd640 10 client.4462.objecter _send_command 1 2026-02-17T21:25:36.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7ff8f6ffd640 1 -- 10.20.193.5:0/3888477941 --> [v2:10.20.193.176:6826/1604873931,v1:10.20.193.176:6827/1604873931] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff8e0084320 con 0x7ff8e0081810 2026-02-17T21:25:36.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7ff8f6ffd640 20 client.4462.objecter dump_active .. 0 homeless 2026-02-17T21:25:36.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7ff8f6ffd640 1 -- 10.20.193.5:0/3888477941 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff90c05ee40 con 0x7ff910152ae0 2026-02-17T21:25:36.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7ff8f6ffd640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T21:25:36.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7f62ebfff640 10 client.4419.objecter ms_handle_connect 0x7f62e00817c0 2026-02-17T21:25:36.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.272+0000 7f630ffff640 1 --2- 10.20.193.5:0/3081270013 >> [v2:10.20.193.119:6800/267553149,v1:10.20.193.119:6801/267553149] conn(0x7f62e00817c0 0x7f62e0083c00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.273+0000 7ff915ba3640 1 --2- 10.20.193.5:0/3888477941 >> [v2:10.20.193.176:6826/1604873931,v1:10.20.193.176:6827/1604873931] conn(0x7ff8e0081810 0x7ff8e0083c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.273+0000 7ff915ba3640 10 monclient: get_auth_request con 0x7ff8e0081810 auth_method 0 2026-02-17T21:25:36.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.275+0000 7ff915ba3640 1 --2- 10.20.193.5:0/3888477941 >> [v2:10.20.193.176:6826/1604873931,v1:10.20.193.176:6827/1604873931] conn(0x7ff8e0081810 0x7ff8e0083c50 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.275+0000 7ff8f6ffd640 10 client.4462.objecter ms_handle_connect 0x7ff8e0081810 2026-02-17T21:25:36.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.277+0000 7f80e7fff640 1 -- 10.20.193.5:0/2466161818 <== osd.0 v2:10.20.193.5:6808/3662168592 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f81100c9b70 con 0x7f80e0081840 2026-02-17T21:25:36.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.277+0000 7f80e7fff640 10 client.4451.objecter ms_dispatch2 0x7f8110000b90 command_reply(tid 2: 0 ) 2026-02-17T21:25:36.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.277+0000 7f80e7fff640 10 client.4451.objecter _finish_command 2 = system:0 2026-02-17T21:25:36.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.277+0000 7f80e7fff640 20 client.4451.objecter put_session s=0x7f80e0081170 osd=0 4 2026-02-17T21:25:36.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.277+0000 7f80e7fff640 15 client.4451.objecter _session_command_op_remove 0 2 2026-02-17T21:25:36.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.277+0000 7f81158ea640 10 librados: watch_flush enter 2026-02-17T21:25:36.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.277+0000 7f81158ea640 10 librados: watch_flush exit 2026-02-17T21:25:36.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.277+0000 7f81158ea640 10 client.4451.objecter close_session for osd.0 2026-02-17T21:25:36.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.277+0000 7f81158ea640 1 -- 10.20.193.5:0/2466161818 >> [v2:10.20.193.5:6808/3662168592,v1:10.20.193.5:6809/3662168592] conn(0x7f80e0081840 msgr2=0x7f80e0083c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.277+0000 7f81158ea640 1 --2- 10.20.193.5:0/2466161818 >> [v2:10.20.193.5:6808/3662168592,v1:10.20.193.5:6809/3662168592] conn(0x7f80e0081840 0x7f80e0083c80 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.277+0000 7f81158ea640 20 client.4451.objecter put_session s=0x7f80e0081170 osd=0 1 2026-02-17T21:25:36.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.277+0000 7f81158ea640 20 client.4451.objecter shutdown clearing up homeless session... 2026-02-17T21:25:36.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.277+0000 7f81158ea640 10 client.4451.objecter successfully canceled tick 2026-02-17T21:25:36.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.277+0000 7f81158ea640 1 -- 10.20.193.5:0/2466161818 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f80e0079300 msgr2=0x7f80e007b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.277+0000 7f81158ea640 1 --2- 10.20.193.5:0/2466161818 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f80e0079300 0x7f80e007b7c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8104039000 tx=0x7f8104031000 comp rx=0 tx=0).stop 2026-02-17T21:25:36.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.277+0000 7f81158ea640 10 monclient: shutdown 2026-02-17T21:25:36.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.277+0000 7f81158ea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.277+0000 7f81158ea640 1 -- 10.20.193.5:0/2466161818 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f811014f660 msgr2=0x7f811013e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.277+0000 7f81158ea640 1 --2- 10.20.193.5:0/2466161818 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f811014f660 0x7f811013e5b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f80f800c730 tx=0x7f80f800cc00 comp rx=0 tx=0).stop 2026-02-17T21:25:36.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.277+0000 7f810f7fe640 1 -- 10.20.193.5:0/2466161818 reap_dead start 2026-02-17T21:25:36.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.277+0000 7f81158ea640 1 -- 10.20.193.5:0/2466161818 shutdown_connections 2026-02-17T21:25:36.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.277+0000 7f81158ea640 1 -- 10.20.193.5:0/2466161818 >> 10.20.193.5:0/2466161818 conn(0x7f81100c9f20 msgr2=0x7f8110143930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.277+0000 7f81158ea640 1 -- 10.20.193.5:0/2466161818 shutdown_connections 2026-02-17T21:25:36.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.277+0000 7f81158ea640 1 -- 10.20.193.5:0/2466161818 wait complete. 2026-02-17T21:25:36.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.277+0000 7f81158ea640 1 librados: shutdown 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78ad7fa640 1 -- 10.20.193.5:0/741987363 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0046020 con 0x7f78b80d1f40 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78ad7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78ad7fa640 10 monclient: dump: 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78ad7fa640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78ad7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78ad7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78ad7fa640 1 -- 10.20.193.5:0/741987363 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78a0042700 con 0x7f78b80d1f40 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78ad7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78ad7fa640 1 -- 10.20.193.5:0/741987363 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a003c040 con 0x7f78b80d1f40 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78bef34640 5 monclient: authenticate success, global_id 4475 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78aeffd640 4 set_mon_vals no callback set 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78ad7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78ad7fa640 10 monclient: dump: 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.365 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.366 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.366 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.366 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.366 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78bef34640 10 monclient: _renew_subs 2026-02-17T21:25:36.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78bef34640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78bef34640 1 -- 10.20.193.5:0/741987363 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b81f6180 con 0x7f78b80d1f40 2026-02-17T21:25:36.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78bef34640 10 client.4475.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78bef34640 10 monclient: _renew_subs 2026-02-17T21:25:36.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78bef34640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78bef34640 1 -- 10.20.193.5:0/741987363 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b81f6740 con 0x7f78b80d1f40 2026-02-17T21:25:36.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78bef34640 1 librados: init done 2026-02-17T21:25:36.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78bef34640 10 client.4475.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78bef34640 15 client.4475.objecter _session_command_op_assign -1 1 2026-02-17T21:25:36.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78bef34640 20 client.4475.objecter _get_session osd=-1 returning homeless 2026-02-17T21:25:36.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78bef34640 10 client.4475.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78bef34640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.279+0000 7f78bef34640 1 -- 10.20.193.5:0/741987363 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f78b80ca8a0 con 0x7f78b80d1f40 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.283+0000 7fecf3fff640 1 -- 10.20.193.5:0/1878131111 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf403c070 con 0x7fed040d1b60 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.283+0000 7fecf3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.283+0000 7fecf3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.283+0000 7fecf3fff640 10 monclient: dump: 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.283+0000 7fecf3fff640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.283+0000 7fecf3fff640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.283+0000 7fecf3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.283+0000 7fecf3fff640 1 -- 10.20.193.5:0/1878131111 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf402fad0 con 0x7fed040d1b60 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.283+0000 7fecf3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.283+0000 7fecf3fff640 1 -- 10.20.193.5:0/1878131111 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf4037440 con 0x7fed040d1b60 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.283+0000 7fed0b8da640 5 monclient: authenticate success, global_id 4444 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.283+0000 7fed0b8da640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.283+0000 7fed0b8da640 4 set_mon_vals no callback set 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.283+0000 7fecf3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.283+0000 7fecf3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.283+0000 7fecf3fff640 10 monclient: dump: 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.283+0000 7fed0b8da640 10 monclient: shutdown 2026-02-17T21:25:36.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.283+0000 7fed0b8da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.283+0000 7fed0b8da640 1 -- 10.20.193.5:0/1878131111 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fed040d1b60 msgr2=0x7fed040d1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.283+0000 7fed0b8da640 1 --2- 10.20.193.5:0/1878131111 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fed040d1b60 0x7fed040d1f40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fecf40098a0 tx=0x7fecf402ee10 comp rx=0 tx=0).stop 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.284+0000 7fed0b8da640 1 -- 10.20.193.5:0/1878131111 shutdown_connections 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.284+0000 7fed0b8da640 1 --2- 10.20.193.5:0/1878131111 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fed040d1b60 0x7fed040d1f40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.284+0000 7fed0b8da640 1 -- 10.20.193.5:0/1878131111 >> 10.20.193.5:0/1878131111 conn(0x7fed0406d9b0 msgr2=0x7fed0406ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.284+0000 7fed0b8da640 1 -- 10.20.193.5:0/1878131111 shutdown_connections 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.284+0000 7fed0b8da640 1 -- 10.20.193.5:0/1878131111 wait complete. 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.284+0000 7fed0b8da640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.284+0000 7fed0b8da640 10 monclient: monmap: 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.284+0000 7fed0b8da640 1 librados: starting msgr at 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.284+0000 7fed0b8da640 1 librados: starting objecter 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.284+0000 7fed0b8da640 1 Processor -- start 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.284+0000 7fed0b8da640 1 -- start start 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.284+0000 7fed0b8da640 1 librados: setting wanted keys 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.284+0000 7fed0b8da640 1 librados: calling monclient init 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.284+0000 7fed0b8da640 10 monclient: init 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.285+0000 7fed0b8da640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.285+0000 7fed0b8da640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.285+0000 7fed0b8da640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fed040d1b60 0x7fed041eae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.285+0000 7fed0b8da640 10 monclient(hunting): picked mon.noname-b con 0x7fed040d1b60 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.285+0000 7fed0b8da640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fed0415c840 0x7fed04158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.285+0000 7fed0b8da640 10 monclient(hunting): picked mon.noname-a con 0x7fed0415c840 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.285+0000 7fed0b8da640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fed0415d950 0x7fed041588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.285+0000 7fed0b8da640 10 monclient(hunting): picked mon.noname-c con 0x7fed0415d950 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.285+0000 7fed0b8da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.285+0000 7fed0b8da640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fed0415cc90 con 0x7fed0415c840 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.285+0000 7fed0b8da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.285+0000 7fed0b8da640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fed0415d4c0 con 0x7fed040d1b60 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.285+0000 7fed0b8da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.285+0000 7fed0b8da640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fed0406e7b0 con 0x7fed0415d950 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.285+0000 7fed0b8da640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.285+0000 7fed0b8da640 10 monclient(hunting): authenticate will time out at 1041.850216s 2026-02-17T21:25:36.369 INFO:teuthology.orchestra.run.trial005.stdout:103079215108 2026-02-17T21:25:36.369 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T21:25:36.369 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.286+0000 7f58ded76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.369 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.286+0000 7f58ded76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.369 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.286+0000 7f58ded76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.369 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.287+0000 7fec0b7fe640 1 -- 10.20.193.5:0/2448085832 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fec14041a30 con 0x7fec2c1525f0 2026-02-17T21:25:36.369 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.287+0000 7fec0b7fe640 1 --2- 10.20.193.5:0/2448085832 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7febf8079280 0x7febf807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.369 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.288+0000 7fec2affd640 1 --2- 10.20.193.5:0/2448085832 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7febf8079280 0x7febf807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.369 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.288+0000 7fec2affd640 10 monclient: get_auth_request con 0x7febf8079280 auth_method 0 2026-02-17T21:25:36.369 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.288+0000 7fec0b7fe640 10 client.4472.objecter ms_handle_connect 0x7febf8079280 2026-02-17T21:25:36.369 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.288+0000 7fec2affd640 1 --2- 10.20.193.5:0/2448085832 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7febf8079280 0x7febf807b740 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fec20006fd0 tx=0x7fec20006d40 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.291+0000 7fae957fa640 1 -- 10.20.193.5:0/2908302220 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fae8801a460 con 0x7faea0152ae0 2026-02-17T21:25:36.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.291+0000 7fae957fa640 1 --2- 10.20.193.5:0/2908302220 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fae780792d0 0x7fae7807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.291+0000 7fec0b7fe640 1 -- 10.20.193.5:0/2448085832 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fec140bd630 con 0x7fec2c1525f0 2026-02-17T21:25:36.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.291+0000 7fec0b7fe640 10 client.4472.objecter ms_dispatch2 0x7fec2c000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:36.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.291+0000 7fec0b7fe640 3 client.4472.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:36.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.291+0000 7fec0b7fe640 3 client.4472.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:36.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.291+0000 7fec0b7fe640 10 client.4472.objecter checking command 1 2026-02-17T21:25:36.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.291+0000 7fec0b7fe640 1 --2- 10.20.193.5:0/2448085832 >> [v2:10.20.193.135:6800/3469915965,v1:10.20.193.135:6801/3469915965] conn(0x7febf8081820 0x7febf8083c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.291+0000 7fec0b7fe640 20 client.4472.objecter _get_session s=0x7febf8081150 osd=10 3 2026-02-17T21:25:36.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.291+0000 7fec0b7fe640 20 client.4472.objecter put_session s=0x7febf8081150 osd=10 3 2026-02-17T21:25:36.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.291+0000 7fec0b7fe640 15 client.4472.objecter _session_command_op_remove -1 1 2026-02-17T21:25:36.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.291+0000 7fec0b7fe640 20 client.4472.objecter _get_session s=0x7febf8081150 osd=10 3 2026-02-17T21:25:36.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.291+0000 7fec0b7fe640 20 client.4472.objecter get_session s=0x7febf8081150 osd=10 3 2026-02-17T21:25:36.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.291+0000 7fec0b7fe640 15 client.4472.objecter _session_command_op_assign 10 1 2026-02-17T21:25:36.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.291+0000 7fec0b7fe640 20 client.4472.objecter put_session s=0x7febf8081150 osd=10 4 2026-02-17T21:25:36.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.291+0000 7fec0b7fe640 10 client.4472.objecter _send_command 1 2026-02-17T21:25:36.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.291+0000 7fec0b7fe640 1 -- 10.20.193.5:0/2448085832 --> [v2:10.20.193.135:6800/3469915965,v1:10.20.193.135:6801/3469915965] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7febf8084330 con 0x7febf8081820 2026-02-17T21:25:36.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.291+0000 7fec0b7fe640 20 client.4472.objecter dump_active .. 0 homeless 2026-02-17T21:25:36.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.291+0000 7faea4afc640 1 --2- 10.20.193.5:0/2908302220 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fae780792d0 0x7fae7807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.291+0000 7faea4afc640 10 monclient: get_auth_request con 0x7fae780792d0 auth_method 0 2026-02-17T21:25:36.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.292+0000 7fd56cff9640 1 -- 10.20.193.5:0/1452172089 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fd56400cb70 con 0x7fd57015ef80 2026-02-17T21:25:36.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.292+0000 7fec2b7fe640 1 --2- 10.20.193.5:0/2448085832 >> [v2:10.20.193.135:6800/3469915965,v1:10.20.193.135:6801/3469915965] conn(0x7febf8081820 0x7febf8083c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.292+0000 7fd56cff9640 1 --2- 10.20.193.5:0/1452172089 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd5400792d0 0x7fd54007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.292+0000 7faea4afc640 1 --2- 10.20.193.5:0/2908302220 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fae780792d0 0x7fae7807b790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faea008e820 tx=0x7fae90031000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.292+0000 7fae957fa640 10 client.4431.objecter ms_handle_connect 0x7fae780792d0 2026-02-17T21:25:36.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.292+0000 7fec2b7fe640 10 monclient: get_auth_request con 0x7febf8081820 auth_method 0 2026-02-17T21:25:36.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.292+0000 7fd56ffff640 1 --2- 10.20.193.5:0/1452172089 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd5400792d0 0x7fd54007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.292+0000 7fd56ffff640 10 monclient: get_auth_request con 0x7fd5400792d0 auth_method 0 2026-02-17T21:25:36.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.293+0000 7fd56ffff640 1 --2- 10.20.193.5:0/1452172089 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd5400792d0 0x7fd54007b790 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd55c009750 tx=0x7fd55c006ca0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.293+0000 7fd56cff9640 10 client.4459.objecter ms_handle_connect 0x7fd5400792d0 2026-02-17T21:25:36.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.294+0000 7fd56cff9640 1 -- 10.20.193.5:0/1452172089 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fd564012e00 con 0x7fd57015ef80 2026-02-17T21:25:36.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.294+0000 7fd56cff9640 10 client.4459.objecter ms_dispatch2 0x7fd570000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:36.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.294+0000 7fd56cff9640 3 client.4459.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:36.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.294+0000 7fd56cff9640 3 client.4459.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.294+0000 7fd56cff9640 10 client.4459.objecter checking command 1 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.294+0000 7fd56cff9640 1 --2- 10.20.193.5:0/1452172089 >> [v2:10.20.193.5:6800/234574736,v1:10.20.193.5:6801/234574736] conn(0x7fd540081870 0x7fd540083cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.294+0000 7fd56cff9640 20 client.4459.objecter _get_session s=0x7fd5400811a0 osd=4 3 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.294+0000 7fd56cff9640 20 client.4459.objecter put_session s=0x7fd5400811a0 osd=4 3 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.294+0000 7fd56cff9640 15 client.4459.objecter _session_command_op_remove -1 1 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.294+0000 7fd56cff9640 20 client.4459.objecter _get_session s=0x7fd5400811a0 osd=4 3 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.294+0000 7fd56cff9640 20 client.4459.objecter get_session s=0x7fd5400811a0 osd=4 3 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.294+0000 7fd56cff9640 15 client.4459.objecter _session_command_op_assign 4 1 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.294+0000 7fd56cff9640 20 client.4459.objecter put_session s=0x7fd5400811a0 osd=4 4 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.294+0000 7fd56cff9640 10 client.4459.objecter _send_command 1 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.294+0000 7fd56cff9640 1 -- 10.20.193.5:0/1452172089 --> [v2:10.20.193.5:6800/234574736,v1:10.20.193.5:6801/234574736] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd540084380 con 0x7fd540081870 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.294+0000 7fd56cff9640 20 client.4459.objecter dump_active .. 0 homeless 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.294+0000 7fd56cff9640 1 -- 10.20.193.5:0/1452172089 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd56405e340 con 0x7fd57015ef80 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.294+0000 7fd56cff9640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.294+0000 7fd56f7fe640 1 --2- 10.20.193.5:0/1452172089 >> [v2:10.20.193.5:6800/234574736,v1:10.20.193.5:6801/234574736] conn(0x7fd540081870 0x7fd540083cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.294+0000 7fd56f7fe640 10 monclient: get_auth_request con 0x7fd540081870 auth_method 0 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.295+0000 7fec0b7fe640 10 client.4472.objecter ms_handle_connect 0x7febf8081820 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.295+0000 7fec2b7fe640 1 --2- 10.20.193.5:0/2448085832 >> [v2:10.20.193.135:6800/3469915965,v1:10.20.193.135:6801/3469915965] conn(0x7febf8081820 0x7febf8083c60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.295+0000 7f62ebfff640 1 -- 10.20.193.5:0/3081270013 <== osd.1 v2:10.20.193.119:6800/267553149 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f6300016ec0 con 0x7f62e00817c0 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.295+0000 7f62ebfff640 10 client.4419.objecter ms_dispatch2 0x7f6310000b90 command_reply(tid 1: 0 ) 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.295+0000 7f62ebfff640 10 client.4419.objecter _finish_command 1 = system:0 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.295+0000 7f62ebfff640 20 client.4419.objecter put_session s=0x7f62e00810f0 osd=1 4 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.295+0000 7f62ebfff640 15 client.4419.objecter _session_command_op_remove 1 1 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.296+0000 7fd56f7fe640 1 --2- 10.20.193.5:0/1452172089 >> [v2:10.20.193.5:6800/234574736,v1:10.20.193.5:6801/234574736] conn(0x7fd540081870 0x7fd540083cb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.296+0000 7fd56cff9640 10 client.4459.objecter ms_handle_connect 0x7fd540081870 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.297+0000 7fec0b7fe640 1 -- 10.20.193.5:0/2448085832 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fec14083fa0 con 0x7fec2c1525f0 2026-02-17T21:25:36.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.297+0000 7fec0b7fe640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T21:25:36.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.298+0000 7f08337fe640 1 -- 10.20.193.5:0/547646467 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f084401b3b0 con 0x7f0854153ef0 2026-02-17T21:25:36.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.298+0000 7ff8f6ffd640 1 -- 10.20.193.5:0/3888477941 <== osd.7 v2:10.20.193.176:6826/1604873931 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7ff8e0084320 con 0x7ff8e0081810 2026-02-17T21:25:36.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.298+0000 7ff8f6ffd640 10 client.4462.objecter ms_dispatch2 0x7ff910000b90 command_reply(tid 1: 0 ) 2026-02-17T21:25:36.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.298+0000 7ff8f6ffd640 10 client.4462.objecter _finish_command 1 = system:0 2026-02-17T21:25:36.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.298+0000 7ff8f6ffd640 20 client.4462.objecter put_session s=0x7ff8e0081140 osd=7 4 2026-02-17T21:25:36.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.298+0000 7ff8f6ffd640 15 client.4462.objecter _session_command_op_remove 7 1 2026-02-17T21:25:36.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.298+0000 7f08337fe640 1 --2- 10.20.193.5:0/547646467 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f08200792d0 0x7f082007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.299+0000 7f0852d76640 1 --2- 10.20.193.5:0/547646467 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f08200792d0 0x7f082007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.299+0000 7f0852d76640 10 monclient: get_auth_request con 0x7f08200792d0 auth_method 0 2026-02-17T21:25:36.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.299+0000 7f08337fe640 10 client.4466.objecter ms_handle_connect 0x7f08200792d0 2026-02-17T21:25:36.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.299+0000 7f0852d76640 1 --2- 10.20.193.5:0/547646467 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f08200792d0 0x7f082007b790 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0848039000 tx=0x7f0848033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.301+0000 7f08337fe640 1 -- 10.20.193.5:0/547646467 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f084405e340 con 0x7f0854153ef0 2026-02-17T21:25:36.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.301+0000 7f08337fe640 10 client.4466.objecter ms_dispatch2 0x7f0854000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:36.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.301+0000 7f08337fe640 3 client.4466.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:36.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.301+0000 7f08337fe640 3 client.4466.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:36.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.301+0000 7f08337fe640 10 client.4466.objecter checking command 1 2026-02-17T21:25:36.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.301+0000 7f08337fe640 1 --2- 10.20.193.5:0/547646467 >> [v2:10.20.193.5:6818/2028057944,v1:10.20.193.5:6819/2028057944] conn(0x7f0820081870 0x7f0820083cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.301+0000 7f08337fe640 20 client.4466.objecter _get_session s=0x7f08200811a0 osd=12 3 2026-02-17T21:25:36.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.301+0000 7f08337fe640 20 client.4466.objecter put_session s=0x7f08200811a0 osd=12 3 2026-02-17T21:25:36.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.301+0000 7f08337fe640 15 client.4466.objecter _session_command_op_remove -1 1 2026-02-17T21:25:36.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.301+0000 7f08337fe640 20 client.4466.objecter _get_session s=0x7f08200811a0 osd=12 3 2026-02-17T21:25:36.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.301+0000 7f08337fe640 20 client.4466.objecter get_session s=0x7f08200811a0 osd=12 3 2026-02-17T21:25:36.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.301+0000 7f08337fe640 15 client.4466.objecter _session_command_op_assign 12 1 2026-02-17T21:25:36.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.301+0000 7f08337fe640 20 client.4466.objecter put_session s=0x7f08200811a0 osd=12 4 2026-02-17T21:25:36.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.301+0000 7f08337fe640 10 client.4466.objecter _send_command 1 2026-02-17T21:25:36.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.301+0000 7f08337fe640 1 -- 10.20.193.5:0/547646467 --> [v2:10.20.193.5:6818/2028057944,v1:10.20.193.5:6819/2028057944] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0820084380 con 0x7f0820081870 2026-02-17T21:25:36.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.301+0000 7f08337fe640 20 client.4466.objecter dump_active .. 0 homeless 2026-02-17T21:25:36.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.301+0000 7fb1d67fc640 1 -- 10.20.193.5:0/4264433308 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fb1dc01c460 con 0x7fb1e8152ae0 2026-02-17T21:25:36.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f0852575640 1 --2- 10.20.193.5:0/547646467 >> [v2:10.20.193.5:6818/2028057944,v1:10.20.193.5:6819/2028057944] conn(0x7f0820081870 0x7f0820083cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f0852575640 10 monclient: get_auth_request con 0x7f0820081870 auth_method 0 2026-02-17T21:25:36.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7fae957fa640 1 -- 10.20.193.5:0/2908302220 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fae8805e1e0 con 0x7faea0152ae0 2026-02-17T21:25:36.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7fae957fa640 10 client.4431.objecter ms_dispatch2 0x7faea0000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:36.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7fae957fa640 3 client.4431.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:36.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7fae957fa640 3 client.4431.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:36.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f6315c43640 10 client.4419.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:25:36.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f6315c43640 15 client.4419.objecter _session_command_op_assign -1 2 2026-02-17T21:25:36.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f6315c43640 20 client.4419.objecter _get_session s=0x7f62e00810f0 osd=1 3 2026-02-17T21:25:36.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f6315c43640 20 client.4419.objecter put_session s=0x7f62e00810f0 osd=1 3 2026-02-17T21:25:36.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f6315c43640 20 client.4419.objecter _get_session s=0x7f62e00810f0 osd=1 3 2026-02-17T21:25:36.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f6315c43640 15 client.4419.objecter _session_command_op_remove -1 2 2026-02-17T21:25:36.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f6315c43640 20 client.4419.objecter get_session s=0x7f62e00810f0 osd=1 3 2026-02-17T21:25:36.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f6315c43640 15 client.4419.objecter _session_command_op_assign 1 2 2026-02-17T21:25:36.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f6315c43640 20 client.4419.objecter put_session s=0x7f62e00810f0 osd=1 4 2026-02-17T21:25:36.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f6315c43640 10 client.4419.objecter _send_command 2 2026-02-17T21:25:36.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f6315c43640 1 -- 10.20.193.5:0/3081270013 --> [v2:10.20.193.119:6800/267553149,v1:10.20.193.119:6801/267553149] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f63100c9730 con 0x7f62e00817c0 2026-02-17T21:25:36.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7fae957fa640 10 client.4431.objecter checking command 1 2026-02-17T21:25:36.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7fb1d67fc640 1 --2- 10.20.193.5:0/4264433308 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb1b8079280 0x7fb1b807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7fae957fa640 1 --2- 10.20.193.5:0/2908302220 >> [v2:10.20.193.135:6816/1552304264,v1:10.20.193.135:6817/1552304264] conn(0x7fae78081870 0x7fae78083cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7fae957fa640 20 client.4431.objecter _get_session s=0x7fae780811a0 osd=14 3 2026-02-17T21:25:36.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7fae957fa640 20 client.4431.objecter put_session s=0x7fae780811a0 osd=14 3 2026-02-17T21:25:36.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7fae957fa640 15 client.4431.objecter _session_command_op_remove -1 1 2026-02-17T21:25:36.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7fae957fa640 20 client.4431.objecter _get_session s=0x7fae780811a0 osd=14 3 2026-02-17T21:25:36.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7fae957fa640 20 client.4431.objecter get_session s=0x7fae780811a0 osd=14 3 2026-02-17T21:25:36.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7fae957fa640 15 client.4431.objecter _session_command_op_assign 14 1 2026-02-17T21:25:36.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7fae957fa640 20 client.4431.objecter put_session s=0x7fae780811a0 osd=14 4 2026-02-17T21:25:36.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7fae957fa640 10 client.4431.objecter _send_command 1 2026-02-17T21:25:36.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7fae957fa640 1 -- 10.20.193.5:0/2908302220 --> [v2:10.20.193.135:6816/1552304264,v1:10.20.193.135:6817/1552304264] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae88013e50 con 0x7fae78081870 2026-02-17T21:25:36.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7fae957fa640 20 client.4431.objecter dump_active .. 0 homeless 2026-02-17T21:25:36.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7fae957fa640 1 -- 10.20.193.5:0/2908302220 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fae8805e5a0 con 0x7faea0152ae0 2026-02-17T21:25:36.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7fae957fa640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T21:25:36.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f58ded76640 10 monclient(hunting): handle_auth_done global_id 4478 payload 824 2026-02-17T21:25:36.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7fb1eddd4640 1 --2- 10.20.193.5:0/4264433308 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb1b8079280 0x7fb1b807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7fb1eddd4640 10 monclient: get_auth_request con 0x7fb1b8079280 auth_method 0 2026-02-17T21:25:36.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f58ded76640 1 -- 10.20.193.5:0/3456503733 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f58e0152ae0 msgr2=0x7f58e01f67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f58ded76640 1 --2- 10.20.193.5:0/3456503733 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f58e0152ae0 0x7f58e01f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f58ded76640 1 -- 10.20.193.5:0/3456503733 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f58e0152700 msgr2=0x7f58e014db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f58ded76640 1 --2- 10.20.193.5:0/3456503733 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f58e0152700 0x7f58e014db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f58ded76640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f58ded76640 1 monclient: found mon.noname-c 2026-02-17T21:25:36.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f58ded76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f58ded76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f58ded76640 1 -- 10.20.193.5:0/3456503733 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e014e050 con 0x7f58e015ef80 2026-02-17T21:25:36.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f6cbffff640 1 -- 10.20.193.5:0/580086956 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f6cd8041a60 con 0x7f6ce815ef80 2026-02-17T21:25:36.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f08337fe640 1 -- 10.20.193.5:0/547646467 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f084405e700 con 0x7f0854153ef0 2026-02-17T21:25:36.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7f08337fe640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T21:25:36.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7fb1d67fc640 10 client.4471.objecter ms_handle_connect 0x7fb1b8079280 2026-02-17T21:25:36.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7fb1eddd4640 1 --2- 10.20.193.5:0/4264433308 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb1b8079280 0x7fb1b807b740 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8002e60 tx=0x7fb1d8007a70 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.302+0000 7faea52fd640 1 --2- 10.20.193.5:0/2908302220 >> [v2:10.20.193.135:6816/1552304264,v1:10.20.193.135:6817/1552304264] conn(0x7fae78081870 0x7fae78083cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.303+0000 7f6cbffff640 1 --2- 10.20.193.5:0/580086956 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6cb8079280 0x7f6cb807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.303+0000 7faea52fd640 10 monclient: get_auth_request con 0x7fae78081870 auth_method 0 2026-02-17T21:25:36.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.303+0000 7f6ce6ffd640 1 --2- 10.20.193.5:0/580086956 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6cb8079280 0x7f6cb807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.303+0000 7f6ce6ffd640 10 monclient: get_auth_request con 0x7f6cb8079280 auth_method 0 2026-02-17T21:25:36.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.303+0000 7f6cbffff640 10 client.4428.objecter ms_handle_connect 0x7f6cb8079280 2026-02-17T21:25:36.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.303+0000 7f6ce6ffd640 1 --2- 10.20.193.5:0/580086956 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6cb8079280 0x7f6cb807b740 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6ce814fea0 tx=0x7f6cdc006ca0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.304+0000 7f08337fe640 10 client.4466.objecter ms_handle_connect 0x7f0820081870 2026-02-17T21:25:36.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.304+0000 7f0852575640 1 --2- 10.20.193.5:0/547646467 >> [v2:10.20.193.5:6818/2028057944,v1:10.20.193.5:6819/2028057944] conn(0x7f0820081870 0x7f0820083cb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.12 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.304+0000 7fb1d67fc640 1 -- 10.20.193.5:0/4264433308 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fb1dc00ade0 con 0x7fb1e8152ae0 2026-02-17T21:25:36.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.304+0000 7fb1d67fc640 10 client.4471.objecter ms_dispatch2 0x7fb1e8000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:36.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.304+0000 7fb1d67fc640 3 client.4471.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:36.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.304+0000 7fb1d67fc640 3 client.4471.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:36.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.304+0000 7fb1d67fc640 10 client.4471.objecter checking command 1 2026-02-17T21:25:36.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.304+0000 7fb1d67fc640 1 --2- 10.20.193.5:0/4264433308 >> [v2:10.20.193.135:6824/692096764,v1:10.20.193.135:6825/692096764] conn(0x7fb1b8081820 0x7fb1b8083c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.304+0000 7fb1d67fc640 20 client.4471.objecter _get_session s=0x7fb1b8081150 osd=2 3 2026-02-17T21:25:36.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.304+0000 7fb1d67fc640 20 client.4471.objecter put_session s=0x7fb1b8081150 osd=2 3 2026-02-17T21:25:36.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.304+0000 7fb1d67fc640 15 client.4471.objecter _session_command_op_remove -1 1 2026-02-17T21:25:36.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.304+0000 7fb1d67fc640 20 client.4471.objecter _get_session s=0x7fb1b8081150 osd=2 3 2026-02-17T21:25:36.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.304+0000 7fb1d67fc640 20 client.4471.objecter get_session s=0x7fb1b8081150 osd=2 3 2026-02-17T21:25:36.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.304+0000 7fb1d67fc640 15 client.4471.objecter _session_command_op_assign 2 1 2026-02-17T21:25:36.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.304+0000 7fb1d67fc640 20 client.4471.objecter put_session s=0x7fb1b8081150 osd=2 4 2026-02-17T21:25:36.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.304+0000 7fb1d67fc640 10 client.4471.objecter _send_command 1 2026-02-17T21:25:36.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.304+0000 7fb1d67fc640 1 -- 10.20.193.5:0/4264433308 --> [v2:10.20.193.135:6824/692096764,v1:10.20.193.135:6825/692096764] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb1b8084330 con 0x7fb1b8081820 2026-02-17T21:25:36.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.304+0000 7fb1d67fc640 20 client.4471.objecter dump_active .. 0 homeless 2026-02-17T21:25:36.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.304+0000 7fb1d67fc640 1 -- 10.20.193.5:0/4264433308 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb1dc05e960 con 0x7fb1e8152ae0 2026-02-17T21:25:36.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.304+0000 7fb1d67fc640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T21:25:36.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.304+0000 7fb1ee5d5640 1 --2- 10.20.193.5:0/4264433308 >> [v2:10.20.193.135:6824/692096764,v1:10.20.193.135:6825/692096764] conn(0x7fb1b8081820 0x7fb1b8083c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.305+0000 7fb1ee5d5640 10 monclient: get_auth_request con 0x7fb1b8081820 auth_method 0 2026-02-17T21:25:36.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.305+0000 7faea52fd640 1 --2- 10.20.193.5:0/2908302220 >> [v2:10.20.193.135:6816/1552304264,v1:10.20.193.135:6817/1552304264] conn(0x7fae78081870 0x7fae78083cb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.14 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.305+0000 7fae957fa640 10 client.4431.objecter ms_handle_connect 0x7fae78081870 2026-02-17T21:25:36.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7f62ebfff640 1 -- 10.20.193.5:0/3081270013 <== osd.1 v2:10.20.193.119:6800/267553149 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f63100c9730 con 0x7f62e00817c0 2026-02-17T21:25:36.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7f62ebfff640 10 client.4419.objecter ms_dispatch2 0x7f6310000b90 command_reply(tid 2: 0 ) 2026-02-17T21:25:36.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7f62ebfff640 10 client.4419.objecter _finish_command 2 = system:0 2026-02-17T21:25:36.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7f62ebfff640 20 client.4419.objecter put_session s=0x7f62e00810f0 osd=1 4 2026-02-17T21:25:36.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7f62ebfff640 15 client.4419.objecter _session_command_op_remove 1 2 2026-02-17T21:25:36.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7ff91862f640 10 client.4462.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:25:36.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7ff91862f640 15 client.4462.objecter _session_command_op_assign -1 2 2026-02-17T21:25:36.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7ff91862f640 20 client.4462.objecter _get_session s=0x7ff8e0081140 osd=7 3 2026-02-17T21:25:36.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7ff91862f640 20 client.4462.objecter put_session s=0x7ff8e0081140 osd=7 3 2026-02-17T21:25:36.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7ff91862f640 20 client.4462.objecter _get_session s=0x7ff8e0081140 osd=7 3 2026-02-17T21:25:36.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7ff91862f640 15 client.4462.objecter _session_command_op_remove -1 2 2026-02-17T21:25:36.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7ff91862f640 20 client.4462.objecter get_session s=0x7ff8e0081140 osd=7 3 2026-02-17T21:25:36.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7ff91862f640 15 client.4462.objecter _session_command_op_assign 7 2 2026-02-17T21:25:36.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7ff91862f640 20 client.4462.objecter put_session s=0x7ff8e0081140 osd=7 4 2026-02-17T21:25:36.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7ff91862f640 10 client.4462.objecter _send_command 2 2026-02-17T21:25:36.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7ff91862f640 1 -- 10.20.193.5:0/3888477941 --> [v2:10.20.193.176:6826/1604873931,v1:10.20.193.176:6827/1604873931] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff910150150 con 0x7ff8e0081810 2026-02-17T21:25:36.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7f6315c43640 10 librados: watch_flush enter 2026-02-17T21:25:36.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7f6315c43640 10 librados: watch_flush exit 2026-02-17T21:25:36.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7f6315c43640 10 client.4419.objecter close_session for osd.1 2026-02-17T21:25:36.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7f6315c43640 1 -- 10.20.193.5:0/3081270013 >> [v2:10.20.193.119:6800/267553149,v1:10.20.193.119:6801/267553149] conn(0x7f62e00817c0 msgr2=0x7f62e0083c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7f6315c43640 1 --2- 10.20.193.5:0/3081270013 >> [v2:10.20.193.119:6800/267553149,v1:10.20.193.119:6801/267553149] conn(0x7f62e00817c0 0x7f62e0083c00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7f6315c43640 20 client.4419.objecter put_session s=0x7f62e00810f0 osd=1 1 2026-02-17T21:25:36.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7f6315c43640 20 client.4419.objecter shutdown clearing up homeless session... 2026-02-17T21:25:36.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7f6315c43640 10 client.4419.objecter successfully canceled tick 2026-02-17T21:25:36.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7f6315c43640 1 -- 10.20.193.5:0/3081270013 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f62e0079280 msgr2=0x7f62e007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7f6315c43640 1 --2- 10.20.193.5:0/3081270013 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f62e0079280 0x7f62e007b740 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f62fc037000 tx=0x7f62fc031000 comp rx=0 tx=0).stop 2026-02-17T21:25:36.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7f6315c43640 10 monclient: shutdown 2026-02-17T21:25:36.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7f6315c43640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7f6315c43640 1 -- 10.20.193.5:0/3081270013 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6310144960 msgr2=0x7f6310141150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7f6315c43640 1 --2- 10.20.193.5:0/3081270013 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6310144960 0x7f6310141150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f630000e930 tx=0x7f630000ee00 comp rx=0 tx=0).stop 2026-02-17T21:25:36.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7f630ffff640 1 -- 10.20.193.5:0/3081270013 reap_dead start 2026-02-17T21:25:36.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7f6315c43640 1 -- 10.20.193.5:0/3081270013 shutdown_connections 2026-02-17T21:25:36.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7f6315c43640 1 -- 10.20.193.5:0/3081270013 >> 10.20.193.5:0/3081270013 conn(0x7f6310073030 msgr2=0x7f631014cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7f6315c43640 1 -- 10.20.193.5:0/3081270013 shutdown_connections 2026-02-17T21:25:36.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7f6315c43640 1 -- 10.20.193.5:0/3081270013 wait complete. 2026-02-17T21:25:36.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7f6315c43640 1 librados: shutdown 2026-02-17T21:25:36.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7fed0964f640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fed040d1b60 0x7fed041eae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7fed0964f640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fed040d1b60 0x7fed041eae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:37836/0 (socket says 10.20.193.5:37836) 2026-02-17T21:25:36.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7fed0964f640 1 -- 10.20.193.5:0/1445677847 learned_addr learned my addr 10.20.193.5:0/1445677847 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7fed0964f640 10 monclient(hunting): get_auth_request con 0x7fed040d1b60 auth_method 0 2026-02-17T21:25:36.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7fed0964f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7fed0964f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.306+0000 7fed0964f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.307+0000 7fed0964f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.307+0000 7fed0964f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.307+0000 7fed0964f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.307+0000 7fb1ee5d5640 1 --2- 10.20.193.5:0/4264433308 >> [v2:10.20.193.135:6824/692096764,v1:10.20.193.135:6825/692096764] conn(0x7fb1b8081820 0x7fb1b8083c60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.307+0000 7fb1d67fc640 10 client.4471.objecter ms_handle_connect 0x7fb1b8081820 2026-02-17T21:25:36.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.308+0000 7fed0964f640 10 monclient(hunting): handle_auth_done global_id 4474 payload 824 2026-02-17T21:25:36.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.308+0000 7fed0964f640 1 -- 10.20.193.5:0/1445677847 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fed0415d950 msgr2=0x7fed041588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.308+0000 7fed0964f640 1 --2- 10.20.193.5:0/1445677847 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fed0415d950 0x7fed041588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.308+0000 7fed0964f640 1 -- 10.20.193.5:0/1445677847 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fed0415c840 msgr2=0x7fed04158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.308+0000 7fed0964f640 1 --2- 10.20.193.5:0/1445677847 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fed0415c840 0x7fed04158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.308+0000 7fed0964f640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.308+0000 7fed0964f640 1 monclient: found mon.noname-b 2026-02-17T21:25:36.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.308+0000 7fed0964f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.308+0000 7fed0964f640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.308+0000 7fed0964f640 1 -- 10.20.193.5:0/1445677847 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed041f38b0 con 0x7fed040d1b60 2026-02-17T21:25:36.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.308+0000 7f58ded76640 1 --2- 10.20.193.5:0/3456503733 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f58e015ef80 0x7f58e00cfb50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f58d000b9c0 tx=0x7f58d000be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.308+0000 7f58c6ffd640 10 client.?.objecter ms_handle_connect 0x7f58e015ef80 2026-02-17T21:25:36.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.308+0000 7f58c6ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.308+0000 7ff8f6ffd640 1 -- 10.20.193.5:0/3888477941 <== osd.7 v2:10.20.193.176:6826/1604873931 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff910150150 con 0x7ff8e0081810 2026-02-17T21:25:36.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.308+0000 7ff8f6ffd640 10 client.4462.objecter ms_dispatch2 0x7ff910000b90 command_reply(tid 2: 0 ) 2026-02-17T21:25:36.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.308+0000 7ff8f6ffd640 10 client.4462.objecter _finish_command 2 = system:0 2026-02-17T21:25:36.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.308+0000 7ff8f6ffd640 20 client.4462.objecter put_session s=0x7ff8e0081140 osd=7 4 2026-02-17T21:25:36.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.308+0000 7ff8f6ffd640 15 client.4462.objecter _session_command_op_remove 7 2 2026-02-17T21:25:36.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.309+0000 7ff91862f640 10 librados: watch_flush enter 2026-02-17T21:25:36.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.309+0000 7ff91862f640 10 librados: watch_flush exit 2026-02-17T21:25:36.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.309+0000 7ff91862f640 10 client.4462.objecter close_session for osd.7 2026-02-17T21:25:36.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.309+0000 7ff91862f640 1 -- 10.20.193.5:0/3888477941 >> [v2:10.20.193.176:6826/1604873931,v1:10.20.193.176:6827/1604873931] conn(0x7ff8e0081810 msgr2=0x7ff8e0083c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.309+0000 7ff91862f640 1 --2- 10.20.193.5:0/3888477941 >> [v2:10.20.193.176:6826/1604873931,v1:10.20.193.176:6827/1604873931] conn(0x7ff8e0081810 0x7ff8e0083c50 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.309+0000 7ff91862f640 20 client.4462.objecter put_session s=0x7ff8e0081140 osd=7 1 2026-02-17T21:25:36.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.309+0000 7ff91862f640 20 client.4462.objecter shutdown clearing up homeless session... 2026-02-17T21:25:36.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.309+0000 7ff91862f640 10 client.4462.objecter successfully canceled tick 2026-02-17T21:25:36.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.309+0000 7ff91862f640 1 -- 10.20.193.5:0/3888477941 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff8e00792d0 msgr2=0x7ff8e007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.309+0000 7ff91862f640 1 --2- 10.20.193.5:0/3888477941 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff8e00792d0 0x7ff8e007b790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff900004640 tx=0x7ff900009240 comp rx=0 tx=0).stop 2026-02-17T21:25:36.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.309+0000 7ff91862f640 10 monclient: shutdown 2026-02-17T21:25:36.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.309+0000 7ff91862f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.309+0000 7ff91862f640 1 -- 10.20.193.5:0/3888477941 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff910152ae0 msgr2=0x7ff9100d1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.309+0000 7ff91862f640 1 --2- 10.20.193.5:0/3888477941 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff910152ae0 0x7ff9100d1750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff90c00caa0 tx=0x7ff90c00cf70 comp rx=0 tx=0).stop 2026-02-17T21:25:36.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.309+0000 7ff916ba5640 1 -- 10.20.193.5:0/3888477941 reap_dead start 2026-02-17T21:25:36.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.309+0000 7ff91862f640 1 -- 10.20.193.5:0/3888477941 shutdown_connections 2026-02-17T21:25:36.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.309+0000 7ff91862f640 1 -- 10.20.193.5:0/3888477941 >> 10.20.193.5:0/3888477941 conn(0x7ff910073030 msgr2=0x7ff91014e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.309+0000 7ff91862f640 1 -- 10.20.193.5:0/3888477941 shutdown_connections 2026-02-17T21:25:36.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.309+0000 7ff91862f640 1 -- 10.20.193.5:0/3888477941 wait complete. 2026-02-17T21:25:36.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.309+0000 7ff91862f640 1 librados: shutdown 2026-02-17T21:25:36.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.309+0000 7fed0964f640 1 --2- 10.20.193.5:0/1445677847 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fed040d1b60 0x7fed041eae40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fecf4009130 tx=0x7fecf40047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.309+0000 7fecf1ffb640 10 client.?.objecter ms_handle_connect 0x7fed040d1b60 2026-02-17T21:25:36.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.310+0000 7fecf1ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.310+0000 7f6cbffff640 1 -- 10.20.193.5:0/580086956 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f6cd80027c0 con 0x7f6ce815ef80 2026-02-17T21:25:36.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.310+0000 7f6cbffff640 10 client.4428.objecter ms_dispatch2 0x7f6ce8000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:36.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.310+0000 7f6cbffff640 3 client.4428.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:36.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.310+0000 7f6cbffff640 3 client.4428.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:36.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.310+0000 7f6cbffff640 10 client.4428.objecter checking command 1 2026-02-17T21:25:36.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.310+0000 7f6cbffff640 1 --2- 10.20.193.5:0/580086956 >> [v2:10.20.193.135:6808/1853988335,v1:10.20.193.135:6809/1853988335] conn(0x7f6cb80817c0 0x7f6cb8083c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.310+0000 7f6cbffff640 20 client.4428.objecter _get_session s=0x7f6cb80810f0 osd=6 3 2026-02-17T21:25:36.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.310+0000 7f6cbffff640 20 client.4428.objecter put_session s=0x7f6cb80810f0 osd=6 3 2026-02-17T21:25:36.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.310+0000 7f6cbffff640 15 client.4428.objecter _session_command_op_remove -1 1 2026-02-17T21:25:36.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.310+0000 7f6cbffff640 20 client.4428.objecter _get_session s=0x7f6cb80810f0 osd=6 3 2026-02-17T21:25:36.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.310+0000 7f6cbffff640 20 client.4428.objecter get_session s=0x7f6cb80810f0 osd=6 3 2026-02-17T21:25:36.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.310+0000 7f6cbffff640 15 client.4428.objecter _session_command_op_assign 6 1 2026-02-17T21:25:36.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.310+0000 7f6cbffff640 20 client.4428.objecter put_session s=0x7f6cb80810f0 osd=6 4 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.310+0000 7f6cbffff640 10 client.4428.objecter _send_command 1 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.310+0000 7f6cbffff640 1 -- 10.20.193.5:0/580086956 --> [v2:10.20.193.135:6808/1853988335,v1:10.20.193.135:6809/1853988335] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6cd804ee50 con 0x7f6cb80817c0 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.310+0000 7f6cbffff640 20 client.4428.objecter dump_active .. 0 homeless 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.310+0000 7f6cbffff640 1 -- 10.20.193.5:0/580086956 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6cd80842b0 con 0x7f6ce815ef80 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.310+0000 7f6cbffff640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.311+0000 7f6ce67fc640 1 --2- 10.20.193.5:0/580086956 >> [v2:10.20.193.135:6808/1853988335,v1:10.20.193.135:6809/1853988335] conn(0x7f6cb80817c0 0x7f6cb8083c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.311+0000 7f6ce67fc640 10 monclient: get_auth_request con 0x7f6cb80817c0 auth_method 0 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.311+0000 7fecf1ffb640 1 -- 10.20.193.5:0/1445677847 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf4046020 con 0x7fed040d1b60 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.311+0000 7fecf1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.311+0000 7fecf1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.311+0000 7fecf1ffb640 10 monclient: dump: 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.311+0000 7fecf1ffb640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.311+0000 7fecf1ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.311+0000 7fecf1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.311+0000 7fecf1ffb640 1 -- 10.20.193.5:0/1445677847 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf4042620 con 0x7fed040d1b60 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.311+0000 7fed0b8da640 5 monclient: authenticate success, global_id 4474 2026-02-17T21:25:36.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.311+0000 7fed0b8da640 10 monclient: _renew_subs 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.311+0000 7fed0b8da640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.311+0000 7fed0b8da640 1 -- 10.20.193.5:0/1445677847 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed041f3b90 con 0x7fed040d1b60 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.311+0000 7fecf1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.311+0000 7fecf1ffb640 1 -- 10.20.193.5:0/1445677847 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf403c040 con 0x7fed040d1b60 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.311+0000 7fecf1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.311+0000 7fecf1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.311+0000 7fecf1ffb640 10 monclient: dump: 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.311+0000 7fecf37fe640 4 set_mon_vals no callback set 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.312+0000 7fed0b8da640 10 client.4474.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.312+0000 7fed0b8da640 10 monclient: _renew_subs 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.312+0000 7fed0b8da640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.312+0000 7fed0b8da640 1 -- 10.20.193.5:0/1445677847 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed041f4150 con 0x7fed040d1b60 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.312+0000 7fed0b8da640 1 librados: init done 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.312+0000 7fed0b8da640 10 client.4474.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.312+0000 7fed0b8da640 15 client.4474.objecter _session_command_op_assign -1 1 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.312+0000 7fed0b8da640 20 client.4474.objecter _get_session osd=-1 returning homeless 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.312+0000 7fed0b8da640 10 client.4474.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.312+0000 7fed0b8da640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.312+0000 7fed0b8da640 1 -- 10.20.193.5:0/1445677847 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fed0406a240 con 0x7fed040d1b60 2026-02-17T21:25:36.384 INFO:teuthology.orchestra.run.trial005.stdout:94489280517 2026-02-17T21:25:36.385 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T21:25:36.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.314+0000 7f6ce67fc640 1 --2- 10.20.193.5:0/580086956 >> [v2:10.20.193.135:6808/1853988335,v1:10.20.193.135:6809/1853988335] conn(0x7f6cb80817c0 0x7f6cb8083c00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.314+0000 7f6cbffff640 10 client.4428.objecter ms_handle_connect 0x7f6cb80817c0 2026-02-17T21:25:36.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.315+0000 7faccffff640 1 -- 10.20.193.5:0/862750175 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4044070 con 0x7facf40d1f40 2026-02-17T21:25:36.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.315+0000 7faccffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.315+0000 7faccffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:36.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.315+0000 7faccffff640 10 monclient: dump: 2026-02-17T21:25:36.385 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.385 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.385 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.385 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.385 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.385 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.385 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.385 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.385 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.315+0000 7faccffff640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.315+0000 7faccffff640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.315+0000 7faccffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.315+0000 7faccffff640 1 -- 10.20.193.5:0/862750175 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face4040630 con 0x7facf40d1f40 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.315+0000 7faccffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.315+0000 7faccffff640 1 -- 10.20.193.5:0/862750175 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face403c040 con 0x7facf40d1f40 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.315+0000 7faccffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.315+0000 7faccffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.315+0000 7faccffff640 10 monclient: dump: 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.315+0000 7facf1ffb640 4 set_mon_vals no callback set 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.315+0000 7facfa1a1640 5 monclient: authenticate success, global_id 4443 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.315+0000 7facfa1a1640 10 monclient: _renew_subs 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.315+0000 7facfa1a1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.315+0000 7facfa1a1640 1 -- 10.20.193.5:0/862750175 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facf4159860 con 0x7facf40d1f40 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.315+0000 7facfa1a1640 10 client.4443.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.315+0000 7facfa1a1640 10 monclient: _renew_subs 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.315+0000 7facfa1a1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.315+0000 7facfa1a1640 1 -- 10.20.193.5:0/862750175 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facf413dd90 con 0x7facf40d1f40 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.315+0000 7facfa1a1640 1 librados: init done 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.315+0000 7facfa1a1640 10 client.4443.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.316+0000 7facfa1a1640 15 client.4443.objecter _session_command_op_assign -1 1 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.316+0000 7facfa1a1640 20 client.4443.objecter _get_session osd=-1 returning homeless 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.316+0000 7facfa1a1640 10 client.4443.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.316+0000 7facfa1a1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.316+0000 7facfa1a1640 1 -- 10.20.193.5:0/862750175 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7facf413d8a0 con 0x7facf40d1f40 2026-02-17T21:25:36.387 INFO:teuthology.orchestra.run.trial005.stdout:98784247813 2026-02-17T21:25:36.387 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-17T21:25:36.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.317+0000 7fec0b7fe640 1 -- 10.20.193.5:0/2448085832 <== osd.10 v2:10.20.193.135:6800/3469915965 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7febf8084330 con 0x7febf8081820 2026-02-17T21:25:36.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.317+0000 7fec0b7fe640 10 client.4472.objecter ms_dispatch2 0x7fec2c000b90 command_reply(tid 1: 0 ) 2026-02-17T21:25:36.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.317+0000 7fec0b7fe640 10 client.4472.objecter _finish_command 1 = system:0 2026-02-17T21:25:36.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.317+0000 7fec0b7fe640 20 client.4472.objecter put_session s=0x7febf8081150 osd=10 4 2026-02-17T21:25:36.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.317+0000 7fec0b7fe640 15 client.4472.objecter _session_command_op_remove 10 1 2026-02-17T21:25:36.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.317+0000 7f78ad7fa640 1 -- 10.20.193.5:0/741987363 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f78a003f030 con 0x7f78b80d1f40 2026-02-17T21:25:36.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.318+0000 7f78ad7fa640 1 --2- 10.20.193.5:0/741987363 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f78880792d0 0x7f788807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.318+0000 7fd56cff9640 1 -- 10.20.193.5:0/1452172089 <== osd.4 v2:10.20.193.5:6800/234574736 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fd540084380 con 0x7fd540081870 2026-02-17T21:25:36.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.318+0000 7fd56cff9640 10 client.4459.objecter ms_dispatch2 0x7fd570000b90 command_reply(tid 1: 0 ) 2026-02-17T21:25:36.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.318+0000 7fd56cff9640 10 client.4459.objecter _finish_command 1 = system:0 2026-02-17T21:25:36.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.318+0000 7fd56cff9640 20 client.4459.objecter put_session s=0x7fd5400811a0 osd=4 4 2026-02-17T21:25:36.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.318+0000 7fd56cff9640 15 client.4459.objecter _session_command_op_remove 4 1 2026-02-17T21:25:36.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.318+0000 7f78bcca9640 1 --2- 10.20.193.5:0/741987363 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f78880792d0 0x7f788807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.318+0000 7f78bcca9640 10 monclient: get_auth_request con 0x7f78880792d0 auth_method 0 2026-02-17T21:25:36.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.319+0000 7f78bcca9640 1 --2- 10.20.193.5:0/741987363 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f78880792d0 0x7f788807b790 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009750 tx=0x7f78a8006ca0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.319+0000 7f78ad7fa640 10 client.4475.objecter ms_handle_connect 0x7f78880792d0 2026-02-17T21:25:36.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.323+0000 7fecf1ffb640 1 -- 10.20.193.5:0/1445677847 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fecf403f030 con 0x7fed040d1b60 2026-02-17T21:25:36.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.324+0000 7fecf1ffb640 1 --2- 10.20.193.5:0/1445677847 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fecd4079300 0x7fecd407b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.324+0000 7fed08e4e640 1 --2- 10.20.193.5:0/1445677847 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fecd4079300 0x7fecd407b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.324+0000 7fed08e4e640 10 monclient: get_auth_request con 0x7fecd4079300 auth_method 0 2026-02-17T21:25:36.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.324+0000 7fec3133b640 10 client.4472.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:25:36.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.324+0000 7fec3133b640 15 client.4472.objecter _session_command_op_assign -1 2 2026-02-17T21:25:36.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.324+0000 7fec3133b640 20 client.4472.objecter _get_session s=0x7febf8081150 osd=10 3 2026-02-17T21:25:36.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.324+0000 7fec3133b640 20 client.4472.objecter put_session s=0x7febf8081150 osd=10 3 2026-02-17T21:25:36.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.324+0000 7fec3133b640 20 client.4472.objecter _get_session s=0x7febf8081150 osd=10 3 2026-02-17T21:25:36.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.324+0000 7fec3133b640 15 client.4472.objecter _session_command_op_remove -1 2 2026-02-17T21:25:36.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.324+0000 7fec3133b640 20 client.4472.objecter get_session s=0x7febf8081150 osd=10 3 2026-02-17T21:25:36.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.324+0000 7fec3133b640 15 client.4472.objecter _session_command_op_assign 10 2 2026-02-17T21:25:36.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.324+0000 7fec3133b640 20 client.4472.objecter put_session s=0x7febf8081150 osd=10 4 2026-02-17T21:25:36.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.324+0000 7fec3133b640 10 client.4472.objecter _send_command 2 2026-02-17T21:25:36.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.324+0000 7fec3133b640 1 -- 10.20.193.5:0/2448085832 --> [v2:10.20.193.135:6800/3469915965,v1:10.20.193.135:6801/3469915965] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fec2c14e060 con 0x7febf8081820 2026-02-17T21:25:36.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.324+0000 7fecf1ffb640 10 client.4474.objecter ms_handle_connect 0x7fecd4079300 2026-02-17T21:25:36.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.324+0000 7fed08e4e640 1 --2- 10.20.193.5:0/1445677847 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fecd4079300 0x7fecd407b7c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fecf8002a30 tx=0x7fecf80079f0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7f78ad7fa640 1 -- 10.20.193.5:0/741987363 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f78a00838e0 con 0x7f78b80d1f40 2026-02-17T21:25:36.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7f78ad7fa640 10 client.4475.objecter ms_dispatch2 0x7f78b8000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:36.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7f78ad7fa640 3 client.4475.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:36.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7f78ad7fa640 3 client.4475.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:36.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fd576511640 10 client.4459.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:25:36.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fd576511640 15 client.4459.objecter _session_command_op_assign -1 2 2026-02-17T21:25:36.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fd576511640 20 client.4459.objecter _get_session s=0x7fd5400811a0 osd=4 3 2026-02-17T21:25:36.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fd576511640 20 client.4459.objecter put_session s=0x7fd5400811a0 osd=4 3 2026-02-17T21:25:36.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fd576511640 20 client.4459.objecter _get_session s=0x7fd5400811a0 osd=4 3 2026-02-17T21:25:36.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fd576511640 15 client.4459.objecter _session_command_op_remove -1 2 2026-02-17T21:25:36.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fd576511640 20 client.4459.objecter get_session s=0x7fd5400811a0 osd=4 3 2026-02-17T21:25:36.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fd576511640 15 client.4459.objecter _session_command_op_assign 4 2 2026-02-17T21:25:36.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fd576511640 20 client.4459.objecter put_session s=0x7fd5400811a0 osd=4 4 2026-02-17T21:25:36.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fd576511640 10 client.4459.objecter _send_command 2 2026-02-17T21:25:36.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fd576511640 1 -- 10.20.193.5:0/1452172089 --> [v2:10.20.193.5:6800/234574736,v1:10.20.193.5:6801/234574736] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd57014dc80 con 0x7fd540081870 2026-02-17T21:25:36.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7f78ad7fa640 10 client.4475.objecter checking command 1 2026-02-17T21:25:36.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7f78ad7fa640 1 --2- 10.20.193.5:0/741987363 >> [v2:10.20.193.119:6808/1303925174,v1:10.20.193.119:6809/1303925174] conn(0x7f7888081870 0x7f7888083cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7f78ad7fa640 20 client.4475.objecter _get_session s=0x7f78880811a0 osd=13 3 2026-02-17T21:25:36.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7f78ad7fa640 20 client.4475.objecter put_session s=0x7f78880811a0 osd=13 3 2026-02-17T21:25:36.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7f78ad7fa640 15 client.4475.objecter _session_command_op_remove -1 1 2026-02-17T21:25:36.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7f78ad7fa640 20 client.4475.objecter _get_session s=0x7f78880811a0 osd=13 3 2026-02-17T21:25:36.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7f78ad7fa640 20 client.4475.objecter get_session s=0x7f78880811a0 osd=13 3 2026-02-17T21:25:36.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7f78ad7fa640 15 client.4475.objecter _session_command_op_assign 13 1 2026-02-17T21:25:36.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7f78ad7fa640 20 client.4475.objecter put_session s=0x7f78880811a0 osd=13 4 2026-02-17T21:25:36.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7f78ad7fa640 10 client.4475.objecter _send_command 1 2026-02-17T21:25:36.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7f78ad7fa640 1 -- 10.20.193.5:0/741987363 --> [v2:10.20.193.119:6808/1303925174,v1:10.20.193.119:6809/1303925174] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f78a002fad0 con 0x7f7888081870 2026-02-17T21:25:36.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7f78ad7fa640 20 client.4475.objecter dump_active .. 0 homeless 2026-02-17T21:25:36.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fecf1ffb640 1 -- 10.20.193.5:0/1445677847 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fecf402f990 con 0x7fed040d1b60 2026-02-17T21:25:36.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fecf1ffb640 10 client.4474.objecter ms_dispatch2 0x7fed04000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:36.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fecf1ffb640 3 client.4474.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:36.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fecf1ffb640 3 client.4474.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:36.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fecf1ffb640 10 client.4474.objecter checking command 1 2026-02-17T21:25:36.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fecf1ffb640 1 --2- 10.20.193.5:0/1445677847 >> [v2:10.20.193.176:6818/1862950168,v1:10.20.193.176:6819/1862950168] conn(0x7fecd4081840 0x7fecd4083c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fecf1ffb640 20 client.4474.objecter _get_session s=0x7fecd4081170 osd=3 3 2026-02-17T21:25:36.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fecf1ffb640 20 client.4474.objecter put_session s=0x7fecd4081170 osd=3 3 2026-02-17T21:25:36.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fecf1ffb640 15 client.4474.objecter _session_command_op_remove -1 1 2026-02-17T21:25:36.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fecf1ffb640 20 client.4474.objecter _get_session s=0x7fecd4081170 osd=3 3 2026-02-17T21:25:36.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fecf1ffb640 20 client.4474.objecter get_session s=0x7fecd4081170 osd=3 3 2026-02-17T21:25:36.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fecf1ffb640 15 client.4474.objecter _session_command_op_assign 3 1 2026-02-17T21:25:36.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fecf1ffb640 20 client.4474.objecter put_session s=0x7fecd4081170 osd=3 4 2026-02-17T21:25:36.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fecf1ffb640 10 client.4474.objecter _send_command 1 2026-02-17T21:25:36.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fecf1ffb640 1 -- 10.20.193.5:0/1445677847 --> [v2:10.20.193.176:6818/1862950168,v1:10.20.193.176:6819/1862950168] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fecf4053e80 con 0x7fecd4081840 2026-02-17T21:25:36.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7fecf1ffb640 20 client.4474.objecter dump_active .. 0 homeless 2026-02-17T21:25:36.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7f78bd4aa640 1 --2- 10.20.193.5:0/741987363 >> [v2:10.20.193.119:6808/1303925174,v1:10.20.193.119:6809/1303925174] conn(0x7f7888081870 0x7f7888083cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.325+0000 7f78bd4aa640 10 monclient: get_auth_request con 0x7f7888081870 auth_method 0 2026-02-17T21:25:36.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.326+0000 7fed09e50640 1 --2- 10.20.193.5:0/1445677847 >> [v2:10.20.193.176:6818/1862950168,v1:10.20.193.176:6819/1862950168] conn(0x7fecd4081840 0x7fecd4083c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.326+0000 7fed09e50640 10 monclient: get_auth_request con 0x7fecd4081840 auth_method 0 2026-02-17T21:25:36.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fec0b7fe640 1 -- 10.20.193.5:0/2448085832 <== osd.10 v2:10.20.193.135:6800/3469915965 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fec2c14e060 con 0x7febf8081820 2026-02-17T21:25:36.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fec0b7fe640 10 client.4472.objecter ms_dispatch2 0x7fec2c000b90 command_reply(tid 2: 0 ) 2026-02-17T21:25:36.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fecf1ffb640 10 client.4474.objecter ms_handle_connect 0x7fecd4081840 2026-02-17T21:25:36.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fed09e50640 1 --2- 10.20.193.5:0/1445677847 >> [v2:10.20.193.176:6818/1862950168,v1:10.20.193.176:6819/1862950168] conn(0x7fecd4081840 0x7fecd4083c80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fec0b7fe640 10 client.4472.objecter _finish_command 2 = system:0 2026-02-17T21:25:36.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fec0b7fe640 20 client.4472.objecter put_session s=0x7febf8081150 osd=10 4 2026-02-17T21:25:36.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fec0b7fe640 15 client.4472.objecter _session_command_op_remove 10 2 2026-02-17T21:25:36.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fec3133b640 10 librados: watch_flush enter 2026-02-17T21:25:36.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fec3133b640 10 librados: watch_flush exit 2026-02-17T21:25:36.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fec3133b640 10 client.4472.objecter close_session for osd.10 2026-02-17T21:25:36.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7f78ad7fa640 10 client.4475.objecter ms_handle_connect 0x7f7888081870 2026-02-17T21:25:36.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7f78bd4aa640 1 --2- 10.20.193.5:0/741987363 >> [v2:10.20.193.119:6808/1303925174,v1:10.20.193.119:6809/1303925174] conn(0x7f7888081870 0x7f7888083cb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.13 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fec3133b640 1 -- 10.20.193.5:0/2448085832 >> [v2:10.20.193.135:6800/3469915965,v1:10.20.193.135:6801/3469915965] conn(0x7febf8081820 msgr2=0x7febf8083c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fec3133b640 1 --2- 10.20.193.5:0/2448085832 >> [v2:10.20.193.135:6800/3469915965,v1:10.20.193.135:6801/3469915965] conn(0x7febf8081820 0x7febf8083c60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fec3133b640 20 client.4472.objecter put_session s=0x7febf8081150 osd=10 1 2026-02-17T21:25:36.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fec3133b640 20 client.4472.objecter shutdown clearing up homeless session... 2026-02-17T21:25:36.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fec3133b640 10 client.4472.objecter successfully canceled tick 2026-02-17T21:25:36.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fec3133b640 1 -- 10.20.193.5:0/2448085832 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7febf8079280 msgr2=0x7febf807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fec3133b640 1 --2- 10.20.193.5:0/2448085832 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7febf8079280 0x7febf807b740 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fec20006fd0 tx=0x7fec20006d40 comp rx=0 tx=0).stop 2026-02-17T21:25:36.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fec3133b640 10 monclient: shutdown 2026-02-17T21:25:36.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fec3133b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fec3133b640 1 -- 10.20.193.5:0/2448085832 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fec2c1525f0 msgr2=0x7fec2c15acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fec3133b640 1 --2- 10.20.193.5:0/2448085832 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fec2c1525f0 0x7fec2c15acc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fec14002410 tx=0x7fec140047c0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fec2b7fe640 1 -- 10.20.193.5:0/2448085832 reap_dead start 2026-02-17T21:25:36.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fb1d67fc640 1 -- 10.20.193.5:0/4264433308 <== osd.2 v2:10.20.193.135:6824/692096764 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fb1b8084330 con 0x7fb1b8081820 2026-02-17T21:25:36.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fb1d67fc640 10 client.4471.objecter ms_dispatch2 0x7fb1e8000b90 command_reply(tid 1: 0 ) 2026-02-17T21:25:36.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fb1d67fc640 10 client.4471.objecter _finish_command 1 = system:0 2026-02-17T21:25:36.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fb1d67fc640 20 client.4471.objecter put_session s=0x7fb1b8081150 osd=2 4 2026-02-17T21:25:36.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fb1d67fc640 15 client.4471.objecter _session_command_op_remove 2 1 2026-02-17T21:25:36.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fec3133b640 1 -- 10.20.193.5:0/2448085832 shutdown_connections 2026-02-17T21:25:36.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fec3133b640 1 -- 10.20.193.5:0/2448085832 >> 10.20.193.5:0/2448085832 conn(0x7fec2c073030 msgr2=0x7fec2c06d940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7f08337fe640 1 -- 10.20.193.5:0/547646467 <== osd.12 v2:10.20.193.5:6818/2028057944 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f0820084380 con 0x7f0820081870 2026-02-17T21:25:36.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7f08337fe640 10 client.4466.objecter ms_dispatch2 0x7f0854000b90 command_reply(tid 1: 0 ) 2026-02-17T21:25:36.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7f08337fe640 10 client.4466.objecter _finish_command 1 = system:0 2026-02-17T21:25:36.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7f08337fe640 20 client.4466.objecter put_session s=0x7f08200811a0 osd=12 4 2026-02-17T21:25:36.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7f08337fe640 15 client.4466.objecter _session_command_op_remove 12 1 2026-02-17T21:25:36.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fec3133b640 1 -- 10.20.193.5:0/2448085832 shutdown_connections 2026-02-17T21:25:36.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fec3133b640 1 -- 10.20.193.5:0/2448085832 wait complete. 2026-02-17T21:25:36.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fec3133b640 1 librados: shutdown 2026-02-17T21:25:36.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fd56cff9640 1 -- 10.20.193.5:0/1452172089 <== osd.4 v2:10.20.193.5:6800/234574736 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd57014dc80 con 0x7fd540081870 2026-02-17T21:25:36.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fd56cff9640 10 client.4459.objecter ms_dispatch2 0x7fd570000b90 command_reply(tid 2: 0 ) 2026-02-17T21:25:36.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fd56cff9640 10 client.4459.objecter _finish_command 2 = system:0 2026-02-17T21:25:36.394 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fd56cff9640 20 client.4459.objecter put_session s=0x7fd5400811a0 osd=4 4 2026-02-17T21:25:36.394 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fd56cff9640 15 client.4459.objecter _session_command_op_remove 4 2 2026-02-17T21:25:36.394 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fae957fa640 1 -- 10.20.193.5:0/2908302220 <== osd.14 v2:10.20.193.135:6816/1552304264 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fae88013e50 con 0x7fae78081870 2026-02-17T21:25:36.394 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fae957fa640 10 client.4431.objecter ms_dispatch2 0x7faea0000b90 command_reply(tid 1: 0 ) 2026-02-17T21:25:36.394 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fae957fa640 10 client.4431.objecter _finish_command 1 = system:0 2026-02-17T21:25:36.394 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fae957fa640 20 client.4431.objecter put_session s=0x7fae780811a0 osd=14 4 2026-02-17T21:25:36.394 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fae957fa640 15 client.4431.objecter _session_command_op_remove 14 1 2026-02-17T21:25:36.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fd576511640 10 librados: watch_flush enter 2026-02-17T21:25:36.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fd576511640 10 librados: watch_flush exit 2026-02-17T21:25:36.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fd576511640 10 client.4459.objecter close_session for osd.4 2026-02-17T21:25:36.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fd576511640 1 -- 10.20.193.5:0/1452172089 >> [v2:10.20.193.5:6800/234574736,v1:10.20.193.5:6801/234574736] conn(0x7fd540081870 msgr2=0x7fd540083cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fd576511640 1 --2- 10.20.193.5:0/1452172089 >> [v2:10.20.193.5:6800/234574736,v1:10.20.193.5:6801/234574736] conn(0x7fd540081870 0x7fd540083cb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fd576511640 20 client.4459.objecter put_session s=0x7fd5400811a0 osd=4 1 2026-02-17T21:25:36.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fd576511640 20 client.4459.objecter shutdown clearing up homeless session... 2026-02-17T21:25:36.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fd576511640 10 client.4459.objecter successfully canceled tick 2026-02-17T21:25:36.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fd576511640 1 -- 10.20.193.5:0/1452172089 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd5400792d0 msgr2=0x7fd54007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fd576511640 1 --2- 10.20.193.5:0/1452172089 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd5400792d0 0x7fd54007b790 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd55c009750 tx=0x7fd55c006ca0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fd576511640 10 monclient: shutdown 2026-02-17T21:25:36.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fd576511640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fd576511640 1 -- 10.20.193.5:0/1452172089 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd57015ef80 msgr2=0x7fd5700cbe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7fd576511640 1 --2- 10.20.193.5:0/1452172089 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd57015ef80 0x7fd5700cbe40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd56400b990 tx=0x7fd56400be60 comp rx=0 tx=0).stop 2026-02-17T21:25:36.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.328+0000 7f7b9bfff640 1 -- 10.20.193.5:0/3871606820 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f7bb4012950 con 0x7f7bc015bf30 2026-02-17T21:25:36.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.329+0000 7fd574a87640 1 -- 10.20.193.5:0/1452172089 reap_dead start 2026-02-17T21:25:36.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.329+0000 7fd576511640 1 -- 10.20.193.5:0/1452172089 shutdown_connections 2026-02-17T21:25:36.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.329+0000 7fd576511640 1 -- 10.20.193.5:0/1452172089 >> 10.20.193.5:0/1452172089 conn(0x7fd570073030 msgr2=0x7fd57014d140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.329+0000 7f78ad7fa640 1 -- 10.20.193.5:0/741987363 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f78a0083ca0 con 0x7f78b80d1f40 2026-02-17T21:25:36.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.329+0000 7f78ad7fa640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T21:25:36.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.329+0000 7fd576511640 1 -- 10.20.193.5:0/1452172089 shutdown_connections 2026-02-17T21:25:36.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.329+0000 7fd576511640 1 -- 10.20.193.5:0/1452172089 wait complete. 2026-02-17T21:25:36.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.329+0000 7fd576511640 1 librados: shutdown 2026-02-17T21:25:36.397 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.329+0000 7f7b9bfff640 1 --2- 10.20.193.5:0/3871606820 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7b90079280 0x7f7b9007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.397 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.329+0000 7f7bbf7fe640 1 --2- 10.20.193.5:0/3871606820 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7b90079280 0x7f7b9007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.329+0000 7f7bbf7fe640 10 monclient: get_auth_request con 0x7f7b90079280 auth_method 0 2026-02-17T21:25:36.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.330+0000 7f7b9bfff640 10 client.4440.objecter ms_handle_connect 0x7f7b90079280 2026-02-17T21:25:36.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.330+0000 7f7bbf7fe640 1 --2- 10.20.193.5:0/3871606820 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7b90079280 0x7f7b9007b740 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7bac039000 tx=0x7f7bac033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.332+0000 7f7b9bfff640 1 -- 10.20.193.5:0/3871606820 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f7bb4098610 con 0x7f7bc015bf30 2026-02-17T21:25:36.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.332+0000 7f7b9bfff640 10 client.4440.objecter ms_dispatch2 0x7f7bc0000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:36.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.332+0000 7f7b9bfff640 3 client.4440.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:36.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.332+0000 7f7b9bfff640 3 client.4440.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:36.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.332+0000 7f7b9bfff640 10 client.4440.objecter checking command 1 2026-02-17T21:25:36.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.332+0000 7f7b9bfff640 1 --2- 10.20.193.5:0/3871606820 >> [v2:10.20.193.119:6818/4010664603,v1:10.20.193.119:6820/4010664603] conn(0x7f7b900817c0 0x7f7b90083c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.332+0000 7f7b9bfff640 20 client.4440.objecter _get_session s=0x7f7b900810f0 osd=5 3 2026-02-17T21:25:36.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.332+0000 7f7b9bfff640 20 client.4440.objecter put_session s=0x7f7b900810f0 osd=5 3 2026-02-17T21:25:36.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.332+0000 7f7b9bfff640 15 client.4440.objecter _session_command_op_remove -1 1 2026-02-17T21:25:36.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.332+0000 7f7b9bfff640 20 client.4440.objecter _get_session s=0x7f7b900810f0 osd=5 3 2026-02-17T21:25:36.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.332+0000 7f7b9bfff640 20 client.4440.objecter get_session s=0x7f7b900810f0 osd=5 3 2026-02-17T21:25:36.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.332+0000 7f7b9bfff640 15 client.4440.objecter _session_command_op_assign 5 1 2026-02-17T21:25:36.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.332+0000 7f7b9bfff640 20 client.4440.objecter put_session s=0x7f7b900810f0 osd=5 4 2026-02-17T21:25:36.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.332+0000 7f7b9bfff640 10 client.4440.objecter _send_command 1 2026-02-17T21:25:36.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.332+0000 7f7b9bfff640 1 -- 10.20.193.5:0/3871606820 --> [v2:10.20.193.119:6818/4010664603,v1:10.20.193.119:6820/4010664603] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7bb4013e70 con 0x7f7b900817c0 2026-02-17T21:25:36.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.332+0000 7f7b9bfff640 20 client.4440.objecter dump_active .. 0 homeless 2026-02-17T21:25:36.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.332+0000 7f7b9bfff640 1 -- 10.20.193.5:0/3871606820 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7bb405eef0 con 0x7f7bc015bf30 2026-02-17T21:25:36.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.332+0000 7f7b9bfff640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T21:25:36.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.333+0000 7f7bbeffd640 1 --2- 10.20.193.5:0/3871606820 >> [v2:10.20.193.119:6818/4010664603,v1:10.20.193.119:6820/4010664603] conn(0x7f7b900817c0 0x7f7b90083c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.333+0000 7f7bbeffd640 10 monclient: get_auth_request con 0x7f7b900817c0 auth_method 0 2026-02-17T21:25:36.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7f6cbffff640 1 -- 10.20.193.5:0/580086956 <== osd.6 v2:10.20.193.135:6808/1853988335 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f6cd804ee50 con 0x7f6cb80817c0 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7f6cbffff640 10 client.4428.objecter ms_dispatch2 0x7f6ce8000b90 command_reply(tid 1: 0 ) 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7f6cbffff640 10 client.4428.objecter _finish_command 1 = system:0 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7f6cbffff640 20 client.4428.objecter put_session s=0x7f6cb80810f0 osd=6 4 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7f6cbffff640 15 client.4428.objecter _session_command_op_remove 6 1 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7faea6d87640 10 client.4431.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7faea6d87640 15 client.4431.objecter _session_command_op_assign -1 2 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7faea6d87640 20 client.4431.objecter _get_session s=0x7fae780811a0 osd=14 3 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7faea6d87640 20 client.4431.objecter put_session s=0x7fae780811a0 osd=14 3 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7faea6d87640 20 client.4431.objecter _get_session s=0x7fae780811a0 osd=14 3 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7faea6d87640 15 client.4431.objecter _session_command_op_remove -1 2 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7faea6d87640 20 client.4431.objecter get_session s=0x7fae780811a0 osd=14 3 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7faea6d87640 15 client.4431.objecter _session_command_op_assign 14 2 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7faea6d87640 20 client.4431.objecter put_session s=0x7fae780811a0 osd=14 4 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7faea6d87640 10 client.4431.objecter _send_command 2 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7faea6d87640 1 -- 10.20.193.5:0/2908302220 --> [v2:10.20.193.135:6816/1552304264,v1:10.20.193.135:6817/1552304264] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faea015ae40 con 0x7fae78081870 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7f7b9bfff640 10 client.4440.objecter ms_handle_connect 0x7f7b900817c0 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7f7bbeffd640 1 --2- 10.20.193.5:0/3871606820 >> [v2:10.20.193.119:6818/4010664603,v1:10.20.193.119:6820/4010664603] conn(0x7f7b900817c0 0x7f7b90083c00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7fb1f005f640 10 client.4471.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7fb1f005f640 15 client.4471.objecter _session_command_op_assign -1 2 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7fb1f005f640 20 client.4471.objecter _get_session s=0x7fb1b8081150 osd=2 3 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7fb1f005f640 20 client.4471.objecter put_session s=0x7fb1b8081150 osd=2 3 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7fb1f005f640 20 client.4471.objecter _get_session s=0x7fb1b8081150 osd=2 3 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7fb1f005f640 15 client.4471.objecter _session_command_op_remove -1 2 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7fb1f005f640 20 client.4471.objecter get_session s=0x7fb1b8081150 osd=2 3 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7fb1f005f640 15 client.4471.objecter _session_command_op_assign 2 2 2026-02-17T21:25:36.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7fb1f005f640 20 client.4471.objecter put_session s=0x7fb1b8081150 osd=2 4 2026-02-17T21:25:36.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7fb1f005f640 10 client.4471.objecter _send_command 2 2026-02-17T21:25:36.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.335+0000 7fb1f005f640 1 -- 10.20.193.5:0/4264433308 --> [v2:10.20.193.135:6824/692096764,v1:10.20.193.135:6825/692096764] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb1e806d580 con 0x7fb1b8081820 2026-02-17T21:25:36.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.336+0000 7faace7fc640 1 -- 10.20.193.5:0/2420308612 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7faadc041840 con 0x7faae015edb0 2026-02-17T21:25:36.400 INFO:teuthology.orchestra.run.trial005.stdout:120259084295 2026-02-17T21:25:36.400 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-17T21:25:36.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.336+0000 7faace7fc640 1 --2- 10.20.193.5:0/2420308612 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7faab00792d0 0x7faab007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.336+0000 7f08590d3640 10 client.4466.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:25:36.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.336+0000 7f08590d3640 15 client.4466.objecter _session_command_op_assign -1 2 2026-02-17T21:25:36.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.336+0000 7f08590d3640 20 client.4466.objecter _get_session s=0x7f08200811a0 osd=12 3 2026-02-17T21:25:36.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.336+0000 7f08590d3640 20 client.4466.objecter put_session s=0x7f08200811a0 osd=12 3 2026-02-17T21:25:36.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.336+0000 7f08590d3640 20 client.4466.objecter _get_session s=0x7f08200811a0 osd=12 3 2026-02-17T21:25:36.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.336+0000 7f08590d3640 15 client.4466.objecter _session_command_op_remove -1 2 2026-02-17T21:25:36.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.336+0000 7f08590d3640 20 client.4466.objecter get_session s=0x7f08200811a0 osd=12 3 2026-02-17T21:25:36.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.336+0000 7f08590d3640 15 client.4466.objecter _session_command_op_assign 12 2 2026-02-17T21:25:36.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.336+0000 7f08590d3640 20 client.4466.objecter put_session s=0x7f08200811a0 osd=12 4 2026-02-17T21:25:36.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.336+0000 7f08590d3640 10 client.4466.objecter _send_command 2 2026-02-17T21:25:36.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.336+0000 7f08590d3640 1 -- 10.20.193.5:0/547646467 --> [v2:10.20.193.5:6818/2028057944,v1:10.20.193.5:6819/2028057944] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0854072ac0 con 0x7f0820081870 2026-02-17T21:25:36.401 INFO:teuthology.orchestra.run.trial005.stdout:120259084295 2026-02-17T21:25:36.401 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-17T21:25:36.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.336+0000 7faae5d97640 1 --2- 10.20.193.5:0/2420308612 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7faab00792d0 0x7faab007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.336+0000 7faae5d97640 10 monclient: get_auth_request con 0x7faab00792d0 auth_method 0 2026-02-17T21:25:36.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.337+0000 7faace7fc640 10 client.4463.objecter ms_handle_connect 0x7faab00792d0 2026-02-17T21:25:36.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.337+0000 7faae5d97640 1 --2- 10.20.193.5:0/2420308612 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7faab00792d0 0x7faab007b790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faad000ab20 tx=0x7faad0008040 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.338+0000 7fb1d67fc640 1 -- 10.20.193.5:0/4264433308 <== osd.2 v2:10.20.193.135:6824/692096764 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb1e806d580 con 0x7fb1b8081820 2026-02-17T21:25:36.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.338+0000 7fb1d67fc640 10 client.4471.objecter ms_dispatch2 0x7fb1e8000b90 command_reply(tid 2: 0 ) 2026-02-17T21:25:36.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.338+0000 7fb1d67fc640 10 client.4471.objecter _finish_command 2 = system:0 2026-02-17T21:25:36.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.338+0000 7fb1d67fc640 20 client.4471.objecter put_session s=0x7fb1b8081150 osd=2 4 2026-02-17T21:25:36.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.338+0000 7fb1d67fc640 15 client.4471.objecter _session_command_op_remove 2 2 2026-02-17T21:25:36.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7fae957fa640 1 -- 10.20.193.5:0/2908302220 <== osd.14 v2:10.20.193.135:6816/1552304264 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7faea015ae40 con 0x7fae78081870 2026-02-17T21:25:36.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7fae957fa640 10 client.4431.objecter ms_dispatch2 0x7faea0000b90 command_reply(tid 2: 0 ) 2026-02-17T21:25:36.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7fae957fa640 10 client.4431.objecter _finish_command 2 = system:0 2026-02-17T21:25:36.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7fae957fa640 20 client.4431.objecter put_session s=0x7fae780811a0 osd=14 4 2026-02-17T21:25:36.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7fae957fa640 15 client.4431.objecter _session_command_op_remove 14 2 2026-02-17T21:25:36.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7fb1f005f640 10 librados: watch_flush enter 2026-02-17T21:25:36.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7fb1f005f640 10 librados: watch_flush exit 2026-02-17T21:25:36.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7fb1f005f640 10 client.4471.objecter close_session for osd.2 2026-02-17T21:25:36.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7fb1f005f640 1 -- 10.20.193.5:0/4264433308 >> [v2:10.20.193.135:6824/692096764,v1:10.20.193.135:6825/692096764] conn(0x7fb1b8081820 msgr2=0x7fb1b8083c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7fb1f005f640 1 --2- 10.20.193.5:0/4264433308 >> [v2:10.20.193.135:6824/692096764,v1:10.20.193.135:6825/692096764] conn(0x7fb1b8081820 0x7fb1b8083c60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7fb1f005f640 20 client.4471.objecter put_session s=0x7fb1b8081150 osd=2 1 2026-02-17T21:25:36.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7fb1f005f640 20 client.4471.objecter shutdown clearing up homeless session... 2026-02-17T21:25:36.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7fb1f005f640 10 client.4471.objecter successfully canceled tick 2026-02-17T21:25:36.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7fb1f005f640 1 -- 10.20.193.5:0/4264433308 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb1b8079280 msgr2=0x7fb1b807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7fb1f005f640 1 --2- 10.20.193.5:0/4264433308 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb1b8079280 0x7fb1b807b740 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8002e60 tx=0x7fb1d8007a70 comp rx=0 tx=0).stop 2026-02-17T21:25:36.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7fb1f005f640 10 monclient: shutdown 2026-02-17T21:25:36.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7fb1f005f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7fb1f005f640 1 -- 10.20.193.5:0/4264433308 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb1e8152ae0 msgr2=0x7fb1e8145f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7fb1f005f640 1 --2- 10.20.193.5:0/4264433308 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb1e8152ae0 0x7fb1e8145f70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00c600 tx=0x7fb1dc00cad0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7fb1ee5d5640 1 -- 10.20.193.5:0/4264433308 reap_dead start 2026-02-17T21:25:36.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faea6d87640 10 librados: watch_flush enter 2026-02-17T21:25:36.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faea6d87640 10 librados: watch_flush exit 2026-02-17T21:25:36.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faea6d87640 10 client.4431.objecter close_session for osd.14 2026-02-17T21:25:36.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faea6d87640 1 -- 10.20.193.5:0/2908302220 >> [v2:10.20.193.135:6816/1552304264,v1:10.20.193.135:6817/1552304264] conn(0x7fae78081870 msgr2=0x7fae78083cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faea6d87640 1 --2- 10.20.193.5:0/2908302220 >> [v2:10.20.193.135:6816/1552304264,v1:10.20.193.135:6817/1552304264] conn(0x7fae78081870 0x7fae78083cb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faea6d87640 20 client.4431.objecter put_session s=0x7fae780811a0 osd=14 1 2026-02-17T21:25:36.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faea6d87640 20 client.4431.objecter shutdown clearing up homeless session... 2026-02-17T21:25:36.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faea6d87640 10 client.4431.objecter successfully canceled tick 2026-02-17T21:25:36.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faace7fc640 1 -- 10.20.193.5:0/2420308612 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7faadc083ea0 con 0x7faae015edb0 2026-02-17T21:25:36.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faace7fc640 10 client.4463.objecter ms_dispatch2 0x7faae0000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:36.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faace7fc640 3 client.4463.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:36.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faace7fc640 3 client.4463.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:36.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7fb1f005f640 1 -- 10.20.193.5:0/4264433308 shutdown_connections 2026-02-17T21:25:36.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7fb1f005f640 1 -- 10.20.193.5:0/4264433308 >> 10.20.193.5:0/4264433308 conn(0x7fb1e8073030 msgr2=0x7fb1e8151830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7fb1f005f640 1 -- 10.20.193.5:0/4264433308 shutdown_connections 2026-02-17T21:25:36.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7fb1f005f640 1 -- 10.20.193.5:0/4264433308 wait complete. 2026-02-17T21:25:36.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faace7fc640 10 client.4463.objecter checking command 1 2026-02-17T21:25:36.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7fb1f005f640 1 librados: shutdown 2026-02-17T21:25:36.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faace7fc640 1 --2- 10.20.193.5:0/2420308612 >> [v2:10.20.193.119:6816/576833933,v1:10.20.193.119:6817/576833933] conn(0x7faab0081810 0x7faab0083c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faace7fc640 20 client.4463.objecter _get_session s=0x7faab0081140 osd=9 3 2026-02-17T21:25:36.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faace7fc640 20 client.4463.objecter put_session s=0x7faab0081140 osd=9 3 2026-02-17T21:25:36.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faace7fc640 15 client.4463.objecter _session_command_op_remove -1 1 2026-02-17T21:25:36.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faace7fc640 20 client.4463.objecter _get_session s=0x7faab0081140 osd=9 3 2026-02-17T21:25:36.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faace7fc640 20 client.4463.objecter get_session s=0x7faab0081140 osd=9 3 2026-02-17T21:25:36.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faace7fc640 15 client.4463.objecter _session_command_op_assign 9 1 2026-02-17T21:25:36.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faace7fc640 20 client.4463.objecter put_session s=0x7faab0081140 osd=9 4 2026-02-17T21:25:36.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faace7fc640 10 client.4463.objecter _send_command 1 2026-02-17T21:25:36.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faace7fc640 1 -- 10.20.193.5:0/2420308612 --> [v2:10.20.193.119:6816/576833933,v1:10.20.193.119:6817/576833933] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faadc056e50 con 0x7faab0081810 2026-02-17T21:25:36.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faace7fc640 20 client.4463.objecter dump_active .. 0 homeless 2026-02-17T21:25:36.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faace7fc640 1 -- 10.20.193.5:0/2420308612 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7faadc084260 con 0x7faae015edb0 2026-02-17T21:25:36.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faace7fc640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T21:25:36.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faea6d87640 1 -- 10.20.193.5:0/2908302220 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fae780792d0 msgr2=0x7fae7807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faea6d87640 1 --2- 10.20.193.5:0/2908302220 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fae780792d0 0x7fae7807b790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faea008e820 tx=0x7fae90031000 comp rx=0 tx=0).stop 2026-02-17T21:25:36.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faea6d87640 10 monclient: shutdown 2026-02-17T21:25:36.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faea6d87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faea6d87640 1 -- 10.20.193.5:0/2908302220 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7faea0152ae0 msgr2=0x7faea01f61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faea6d87640 1 --2- 10.20.193.5:0/2908302220 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7faea0152ae0 0x7faea01f61a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fae8800b4d0 tx=0x7fae8800b9a0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faea52fd640 1 -- 10.20.193.5:0/2908302220 reap_dead start 2026-02-17T21:25:36.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faea6d87640 1 -- 10.20.193.5:0/2908302220 shutdown_connections 2026-02-17T21:25:36.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faea6d87640 1 -- 10.20.193.5:0/2908302220 >> 10.20.193.5:0/2908302220 conn(0x7faea0073030 msgr2=0x7faea014f570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faea6d87640 1 -- 10.20.193.5:0/2908302220 shutdown_connections 2026-02-17T21:25:36.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faea6d87640 1 -- 10.20.193.5:0/2908302220 wait complete. 2026-02-17T21:25:36.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7faea6d87640 1 librados: shutdown 2026-02-17T21:25:36.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7f08337fe640 1 -- 10.20.193.5:0/547646467 <== osd.12 v2:10.20.193.5:6818/2028057944 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0854072ac0 con 0x7f0820081870 2026-02-17T21:25:36.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7f08337fe640 10 client.4466.objecter ms_dispatch2 0x7f0854000b90 command_reply(tid 2: 0 ) 2026-02-17T21:25:36.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7f08337fe640 10 client.4466.objecter _finish_command 2 = system:0 2026-02-17T21:25:36.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7f08337fe640 20 client.4466.objecter put_session s=0x7f08200811a0 osd=12 4 2026-02-17T21:25:36.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.339+0000 7f08337fe640 15 client.4466.objecter _session_command_op_remove 12 2 2026-02-17T21:25:36.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7faae5596640 1 --2- 10.20.193.5:0/2420308612 >> [v2:10.20.193.119:6816/576833933,v1:10.20.193.119:6817/576833933] conn(0x7faab0081810 0x7faab0083c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f08590d3640 10 librados: watch_flush enter 2026-02-17T21:25:36.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f08590d3640 10 librados: watch_flush exit 2026-02-17T21:25:36.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f08590d3640 10 client.4466.objecter close_session for osd.12 2026-02-17T21:25:36.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f08590d3640 1 -- 10.20.193.5:0/547646467 >> [v2:10.20.193.5:6818/2028057944,v1:10.20.193.5:6819/2028057944] conn(0x7f0820081870 msgr2=0x7f0820083cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f08590d3640 1 --2- 10.20.193.5:0/547646467 >> [v2:10.20.193.5:6818/2028057944,v1:10.20.193.5:6819/2028057944] conn(0x7f0820081870 0x7f0820083cb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f08590d3640 20 client.4466.objecter put_session s=0x7f08200811a0 osd=12 1 2026-02-17T21:25:36.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f08590d3640 20 client.4466.objecter shutdown clearing up homeless session... 2026-02-17T21:25:36.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f08590d3640 10 client.4466.objecter successfully canceled tick 2026-02-17T21:25:36.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f08590d3640 1 -- 10.20.193.5:0/547646467 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f08200792d0 msgr2=0x7f082007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f08590d3640 1 --2- 10.20.193.5:0/547646467 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f08200792d0 0x7f082007b790 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0848039000 tx=0x7f0848033000 comp rx=0 tx=0).stop 2026-02-17T21:25:36.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f08590d3640 10 monclient: shutdown 2026-02-17T21:25:36.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f08590d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f08590d3640 1 -- 10.20.193.5:0/547646467 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0854153ef0 msgr2=0x7f08540712a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f08590d3640 1 --2- 10.20.193.5:0/547646467 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0854153ef0 0x7f08540712a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f084400cbe0 tx=0x7f084400a430 comp rx=0 tx=0).stop 2026-02-17T21:25:36.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f0853577640 1 -- 10.20.193.5:0/547646467 reap_dead start 2026-02-17T21:25:36.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7faae5596640 10 monclient: get_auth_request con 0x7faab0081810 auth_method 0 2026-02-17T21:25:36.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f08590d3640 1 -- 10.20.193.5:0/547646467 shutdown_connections 2026-02-17T21:25:36.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f08590d3640 1 -- 10.20.193.5:0/547646467 >> 10.20.193.5:0/547646467 conn(0x7f08540cc1d0 msgr2=0x7f08540cd530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f08590d3640 1 -- 10.20.193.5:0/547646467 shutdown_connections 2026-02-17T21:25:36.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f08590d3640 1 -- 10.20.193.5:0/547646467 wait complete. 2026-02-17T21:25:36.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f58c6ffd640 1 -- 10.20.193.5:0/3456503733 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d0006e60 con 0x7f58e015ef80 2026-02-17T21:25:36.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f58c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f58c6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:36.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f58c6ffd640 10 monclient: dump: 2026-02-17T21:25:36.406 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.406 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.406 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.406 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.406 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.406 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.406 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.406 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f58c6ffd640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f58c6ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f58c6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f58c6ffd640 1 -- 10.20.193.5:0/3456503733 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58d0010070 con 0x7f58e015ef80 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f58c6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f58c6ffd640 1 -- 10.20.193.5:0/3456503733 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d000c9d0 con 0x7f58e015ef80 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f58e4b01640 5 monclient: authenticate success, global_id 4478 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f58c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f58c6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f58dcd72640 4 set_mon_vals no callback set 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f58c6ffd640 10 monclient: dump: 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f58e4b01640 10 monclient: _renew_subs 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f58e4b01640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f58e4b01640 1 -- 10.20.193.5:0/3456503733 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e00d0570 con 0x7f58e015ef80 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f58e4b01640 10 client.4478.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f58e4b01640 10 monclient: _renew_subs 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f58e4b01640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f58e4b01640 1 -- 10.20.193.5:0/3456503733 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e00d0b30 con 0x7f58e015ef80 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f58e4b01640 1 librados: init done 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.340+0000 7f08590d3640 1 librados: shutdown 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.341+0000 7f58e4b01640 10 client.4478.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.341+0000 7f58e4b01640 15 client.4478.objecter _session_command_op_assign -1 1 2026-02-17T21:25:36.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.341+0000 7f58e4b01640 20 client.4478.objecter _get_session osd=-1 returning homeless 2026-02-17T21:25:36.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.341+0000 7f58e4b01640 10 client.4478.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.341+0000 7f58e4b01640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.341+0000 7f58e4b01640 1 -- 10.20.193.5:0/3456503733 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f58e015e870 con 0x7f58e015ef80 2026-02-17T21:25:36.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.341+0000 7f6ced9a1640 10 client.4428.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:25:36.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.341+0000 7f6ced9a1640 15 client.4428.objecter _session_command_op_assign -1 2 2026-02-17T21:25:36.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.341+0000 7f6ced9a1640 20 client.4428.objecter _get_session s=0x7f6cb80810f0 osd=6 3 2026-02-17T21:25:36.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.341+0000 7f6ced9a1640 20 client.4428.objecter put_session s=0x7f6cb80810f0 osd=6 3 2026-02-17T21:25:36.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.341+0000 7f6ced9a1640 20 client.4428.objecter _get_session s=0x7f6cb80810f0 osd=6 3 2026-02-17T21:25:36.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.341+0000 7f6ced9a1640 15 client.4428.objecter _session_command_op_remove -1 2 2026-02-17T21:25:36.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.341+0000 7f6ced9a1640 20 client.4428.objecter get_session s=0x7f6cb80810f0 osd=6 3 2026-02-17T21:25:36.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.341+0000 7f6ced9a1640 15 client.4428.objecter _session_command_op_assign 6 2 2026-02-17T21:25:36.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.341+0000 7f6ced9a1640 20 client.4428.objecter put_session s=0x7f6cb80810f0 osd=6 4 2026-02-17T21:25:36.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.341+0000 7f6ced9a1640 10 client.4428.objecter _send_command 2 2026-02-17T21:25:36.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.341+0000 7f6ced9a1640 1 -- 10.20.193.5:0/580086956 --> [v2:10.20.193.135:6808/1853988335,v1:10.20.193.135:6809/1853988335] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6ce8073e00 con 0x7f6cb80817c0 2026-02-17T21:25:36.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.342+0000 7f2d37fff640 1 -- 10.20.193.5:0/4147654514 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f2d4c00f480 con 0x7f2d5c155770 2026-02-17T21:25:36.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.342+0000 7faace7fc640 10 client.4463.objecter ms_handle_connect 0x7faab0081810 2026-02-17T21:25:36.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.342+0000 7faae5596640 1 --2- 10.20.193.5:0/2420308612 >> [v2:10.20.193.119:6816/576833933,v1:10.20.193.119:6817/576833933] conn(0x7faab0081810 0x7faab0083c50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.342+0000 7f2d37fff640 1 --2- 10.20.193.5:0/4147654514 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2d2c079280 0x7f2d2c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.342+0000 7f2d5b7fe640 1 --2- 10.20.193.5:0/4147654514 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2d2c079280 0x7f2d2c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.342+0000 7f2d5b7fe640 10 monclient: get_auth_request con 0x7f2d2c079280 auth_method 0 2026-02-17T21:25:36.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.343+0000 7f2d5b7fe640 1 --2- 10.20.193.5:0/4147654514 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2d2c079280 0x7f2d2c07b740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c070ff0 tx=0x7f2d48031000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.343+0000 7f2d37fff640 10 client.4422.objecter ms_handle_connect 0x7f2d2c079280 2026-02-17T21:25:36.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.345+0000 7f6cbffff640 1 -- 10.20.193.5:0/580086956 <== osd.6 v2:10.20.193.135:6808/1853988335 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6ce8073e00 con 0x7f6cb80817c0 2026-02-17T21:25:36.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.345+0000 7f6cbffff640 10 client.4428.objecter ms_dispatch2 0x7f6ce8000b90 command_reply(tid 2: 0 ) 2026-02-17T21:25:36.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.345+0000 7f6cbffff640 10 client.4428.objecter _finish_command 2 = system:0 2026-02-17T21:25:36.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.345+0000 7f6cbffff640 20 client.4428.objecter put_session s=0x7f6cb80810f0 osd=6 4 2026-02-17T21:25:36.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.345+0000 7f6cbffff640 15 client.4428.objecter _session_command_op_remove 6 2 2026-02-17T21:25:36.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.346+0000 7f6ced9a1640 10 librados: watch_flush enter 2026-02-17T21:25:36.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.346+0000 7f6ced9a1640 10 librados: watch_flush exit 2026-02-17T21:25:36.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.346+0000 7f6ced9a1640 10 client.4428.objecter close_session for osd.6 2026-02-17T21:25:36.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.346+0000 7f6ced9a1640 1 -- 10.20.193.5:0/580086956 >> [v2:10.20.193.135:6808/1853988335,v1:10.20.193.135:6809/1853988335] conn(0x7f6cb80817c0 msgr2=0x7f6cb8083c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.346+0000 7f6ced9a1640 1 --2- 10.20.193.5:0/580086956 >> [v2:10.20.193.135:6808/1853988335,v1:10.20.193.135:6809/1853988335] conn(0x7f6cb80817c0 0x7f6cb8083c00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.346+0000 7f6ced9a1640 20 client.4428.objecter put_session s=0x7f6cb80810f0 osd=6 1 2026-02-17T21:25:36.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.346+0000 7f6ced9a1640 20 client.4428.objecter shutdown clearing up homeless session... 2026-02-17T21:25:36.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.346+0000 7f6ced9a1640 10 client.4428.objecter successfully canceled tick 2026-02-17T21:25:36.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.346+0000 7f6ced9a1640 1 -- 10.20.193.5:0/580086956 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6cb8079280 msgr2=0x7f6cb807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.346+0000 7f6ced9a1640 1 --2- 10.20.193.5:0/580086956 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6cb8079280 0x7f6cb807b740 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6ce814fea0 tx=0x7f6cdc006ca0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.346+0000 7f6ced9a1640 10 monclient: shutdown 2026-02-17T21:25:36.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.346+0000 7f6ced9a1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.346+0000 7f6ced9a1640 1 -- 10.20.193.5:0/580086956 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6ce815ef80 msgr2=0x7f6ce8155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.346+0000 7f6ced9a1640 1 --2- 10.20.193.5:0/580086956 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6ce815ef80 0x7f6ce8155300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6cd802f6d0 tx=0x7f6cd8004b40 comp rx=0 tx=0).stop 2026-02-17T21:25:36.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.346+0000 7f6ce77fe640 1 -- 10.20.193.5:0/580086956 reap_dead start 2026-02-17T21:25:36.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.346+0000 7f6ced9a1640 1 -- 10.20.193.5:0/580086956 shutdown_connections 2026-02-17T21:25:36.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.346+0000 7f6ced9a1640 1 -- 10.20.193.5:0/580086956 >> 10.20.193.5:0/580086956 conn(0x7f6ce8073030 msgr2=0x7f6ce806b600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.346+0000 7f6ced9a1640 1 -- 10.20.193.5:0/580086956 shutdown_connections 2026-02-17T21:25:36.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.346+0000 7f6ced9a1640 1 -- 10.20.193.5:0/580086956 wait complete. 2026-02-17T21:25:36.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.346+0000 7f6ced9a1640 1 librados: shutdown 2026-02-17T21:25:36.410 INFO:teuthology.orchestra.run.trial005.stdout:103079215109 2026-02-17T21:25:36.410 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2026-02-17T21:25:36.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.347+0000 7fecf1ffb640 1 -- 10.20.193.5:0/1445677847 <== osd.3 v2:10.20.193.176:6818/1862950168 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fecf4053e80 con 0x7fecd4081840 2026-02-17T21:25:36.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.347+0000 7fecf1ffb640 10 client.4474.objecter ms_dispatch2 0x7fed04000b90 command_reply(tid 1: 0 ) 2026-02-17T21:25:36.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.347+0000 7fecf1ffb640 10 client.4474.objecter _finish_command 1 = system:0 2026-02-17T21:25:36.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.347+0000 7fecf1ffb640 20 client.4474.objecter put_session s=0x7fecd4081170 osd=3 4 2026-02-17T21:25:36.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.347+0000 7fecf1ffb640 15 client.4474.objecter _session_command_op_remove 3 1 2026-02-17T21:25:36.411 INFO:teuthology.orchestra.run.trial005.stdout:120259084296 2026-02-17T21:25:36.411 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T21:25:36.411 INFO:teuthology.orchestra.run.trial005.stdout:103079215109 2026-02-17T21:25:36.411 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2026-02-17T21:25:36.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.351+0000 7f2d37fff640 1 -- 10.20.193.5:0/4147654514 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f2d4c097cc0 con 0x7f2d5c155770 2026-02-17T21:25:36.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.351+0000 7f2d37fff640 10 client.4422.objecter ms_dispatch2 0x7f2d5c000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:36.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.351+0000 7f2d37fff640 3 client.4422.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:36.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.351+0000 7f2d37fff640 3 client.4422.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:36.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.351+0000 7f2d37fff640 10 client.4422.objecter checking command 1 2026-02-17T21:25:36.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.351+0000 7f2d37fff640 1 --2- 10.20.193.5:0/4147654514 >> [v2:10.20.193.5:6816/1609723815,v1:10.20.193.5:6817/1609723815] conn(0x7f2d2c0817c0 0x7f2d2c083c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.351+0000 7f2d37fff640 20 client.4422.objecter _get_session s=0x7f2d2c0810f0 osd=8 3 2026-02-17T21:25:36.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.351+0000 7f2d37fff640 20 client.4422.objecter put_session s=0x7f2d2c0810f0 osd=8 3 2026-02-17T21:25:36.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.351+0000 7f2d37fff640 15 client.4422.objecter _session_command_op_remove -1 1 2026-02-17T21:25:36.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.351+0000 7f2d37fff640 20 client.4422.objecter _get_session s=0x7f2d2c0810f0 osd=8 3 2026-02-17T21:25:36.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.351+0000 7f2d37fff640 20 client.4422.objecter get_session s=0x7f2d2c0810f0 osd=8 3 2026-02-17T21:25:36.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.351+0000 7f2d37fff640 15 client.4422.objecter _session_command_op_assign 8 1 2026-02-17T21:25:36.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.351+0000 7f2d37fff640 20 client.4422.objecter put_session s=0x7f2d2c0810f0 osd=8 4 2026-02-17T21:25:36.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.351+0000 7f2d37fff640 10 client.4422.objecter _send_command 1 2026-02-17T21:25:36.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.351+0000 7f2d37fff640 1 -- 10.20.193.5:0/4147654514 --> [v2:10.20.193.5:6816/1609723815,v1:10.20.193.5:6817/1609723815] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2d4c00fc80 con 0x7f2d2c0817c0 2026-02-17T21:25:36.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.351+0000 7f2d37fff640 20 client.4422.objecter dump_active .. 0 homeless 2026-02-17T21:25:36.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.351+0000 7f2d37fff640 1 -- 10.20.193.5:0/4147654514 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2d4c05e5a0 con 0x7f2d5c155770 2026-02-17T21:25:36.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.351+0000 7f2d37fff640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T21:25:36.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.352+0000 7f2d5bfff640 1 --2- 10.20.193.5:0/4147654514 >> [v2:10.20.193.5:6816/1609723815,v1:10.20.193.5:6817/1609723815] conn(0x7f2d2c0817c0 0x7f2d2c083c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.352+0000 7f78ad7fa640 1 -- 10.20.193.5:0/741987363 <== osd.13 v2:10.20.193.119:6808/1303925174 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f78a002fad0 con 0x7f7888081870 2026-02-17T21:25:36.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.352+0000 7f78ad7fa640 10 client.4475.objecter ms_dispatch2 0x7f78b8000b90 command_reply(tid 1: 0 ) 2026-02-17T21:25:36.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.352+0000 7f78ad7fa640 10 client.4475.objecter _finish_command 1 = system:0 2026-02-17T21:25:36.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.352+0000 7f78ad7fa640 20 client.4475.objecter put_session s=0x7f78880811a0 osd=13 4 2026-02-17T21:25:36.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.352+0000 7f78ad7fa640 15 client.4475.objecter _session_command_op_remove 13 1 2026-02-17T21:25:36.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.352+0000 7f2d5bfff640 10 monclient: get_auth_request con 0x7f2d2c0817c0 auth_method 0 2026-02-17T21:25:36.412 INFO:teuthology.orchestra.run.trial005.stdout:115964117001 2026-02-17T21:25:36.413 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-17T21:25:36.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.354+0000 7fed0b8da640 10 client.4474.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:25:36.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.354+0000 7fed0b8da640 15 client.4474.objecter _session_command_op_assign -1 2 2026-02-17T21:25:36.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.354+0000 7fed0b8da640 20 client.4474.objecter _get_session s=0x7fecd4081170 osd=3 3 2026-02-17T21:25:36.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.354+0000 7fed0b8da640 20 client.4474.objecter put_session s=0x7fecd4081170 osd=3 3 2026-02-17T21:25:36.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.354+0000 7fed0b8da640 20 client.4474.objecter _get_session s=0x7fecd4081170 osd=3 3 2026-02-17T21:25:36.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.354+0000 7fed0b8da640 15 client.4474.objecter _session_command_op_remove -1 2 2026-02-17T21:25:36.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.354+0000 7fed0b8da640 20 client.4474.objecter get_session s=0x7fecd4081170 osd=3 3 2026-02-17T21:25:36.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.354+0000 7fed0b8da640 15 client.4474.objecter _session_command_op_assign 3 2 2026-02-17T21:25:36.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.354+0000 7fed0b8da640 20 client.4474.objecter put_session s=0x7fecd4081170 osd=3 4 2026-02-17T21:25:36.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.354+0000 7fed0b8da640 10 client.4474.objecter _send_command 2 2026-02-17T21:25:36.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.354+0000 7fed0b8da640 1 -- 10.20.193.5:0/1445677847 --> [v2:10.20.193.176:6818/1862950168,v1:10.20.193.176:6819/1862950168] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fed040d1f40 con 0x7fecd4081840 2026-02-17T21:25:36.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.354+0000 7f2d5bfff640 1 --2- 10.20.193.5:0/4147654514 >> [v2:10.20.193.5:6816/1609723815,v1:10.20.193.5:6817/1609723815] conn(0x7f2d2c0817c0 0x7f2d2c083c00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.354+0000 7f2d37fff640 10 client.4422.objecter ms_handle_connect 0x7f2d2c0817c0 2026-02-17T21:25:36.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.355+0000 7f58c6ffd640 1 -- 10.20.193.5:0/3456503733 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f58d001d030 con 0x7f58e015ef80 2026-02-17T21:25:36.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.356+0000 7f58c6ffd640 1 --2- 10.20.193.5:0/3456503733 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f58ac0792d0 0x7f58ac07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.356+0000 7f58de575640 1 --2- 10.20.193.5:0/3456503733 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f58ac0792d0 0x7f58ac07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.356+0000 7f58de575640 10 monclient: get_auth_request con 0x7f58ac0792d0 auth_method 0 2026-02-17T21:25:36.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.357+0000 7f58c6ffd640 10 client.4478.objecter ms_handle_connect 0x7f58ac0792d0 2026-02-17T21:25:36.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.357+0000 7f58de575640 1 --2- 10.20.193.5:0/3456503733 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f58ac0792d0 0x7f58ac07b790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f58d4009750 tx=0x7f58d4006ca0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.357+0000 7f58c6ffd640 1 -- 10.20.193.5:0/3456503733 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f58d005dba0 con 0x7f58e015ef80 2026-02-17T21:25:36.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.357+0000 7f58c6ffd640 10 client.4478.objecter ms_dispatch2 0x7f58e0000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:36.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.357+0000 7f58c6ffd640 3 client.4478.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:36.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.357+0000 7f58c6ffd640 3 client.4478.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:36.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fecf1ffb640 1 -- 10.20.193.5:0/1445677847 <== osd.3 v2:10.20.193.176:6818/1862950168 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fed040d1f40 con 0x7fecd4081840 2026-02-17T21:25:36.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fecf1ffb640 10 client.4474.objecter ms_dispatch2 0x7fed04000b90 command_reply(tid 2: 0 ) 2026-02-17T21:25:36.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fecf1ffb640 10 client.4474.objecter _finish_command 2 = system:0 2026-02-17T21:25:36.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fecf1ffb640 20 client.4474.objecter put_session s=0x7fecd4081170 osd=3 4 2026-02-17T21:25:36.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fecf1ffb640 15 client.4474.objecter _session_command_op_remove 3 2 2026-02-17T21:25:36.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7f58c6ffd640 10 client.4478.objecter checking command 1 2026-02-17T21:25:36.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7f58c6ffd640 1 --2- 10.20.193.5:0/3456503733 >> [v2:10.20.193.176:6802/3067818664,v1:10.20.193.176:6803/3067818664] conn(0x7f58ac081810 0x7f58ac083c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7f58c6ffd640 20 client.4478.objecter _get_session s=0x7f58ac081140 osd=11 3 2026-02-17T21:25:36.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7f58c6ffd640 20 client.4478.objecter put_session s=0x7f58ac081140 osd=11 3 2026-02-17T21:25:36.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7f58c6ffd640 15 client.4478.objecter _session_command_op_remove -1 1 2026-02-17T21:25:36.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7f58c6ffd640 20 client.4478.objecter _get_session s=0x7f58ac081140 osd=11 3 2026-02-17T21:25:36.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7f58c6ffd640 20 client.4478.objecter get_session s=0x7f58ac081140 osd=11 3 2026-02-17T21:25:36.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7f58c6ffd640 15 client.4478.objecter _session_command_op_assign 11 1 2026-02-17T21:25:36.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7f58c6ffd640 20 client.4478.objecter put_session s=0x7f58ac081140 osd=11 4 2026-02-17T21:25:36.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7f58c6ffd640 10 client.4478.objecter _send_command 1 2026-02-17T21:25:36.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7f58c6ffd640 1 -- 10.20.193.5:0/3456503733 --> [v2:10.20.193.176:6802/3067818664,v1:10.20.193.176:6803/3067818664] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f58d000ee50 con 0x7f58ac081810 2026-02-17T21:25:36.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7f58c6ffd640 20 client.4478.objecter dump_active .. 0 homeless 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fed0b8da640 10 librados: watch_flush enter 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fed0b8da640 10 librados: watch_flush exit 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fed0b8da640 10 client.4474.objecter close_session for osd.3 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fed0b8da640 1 -- 10.20.193.5:0/1445677847 >> [v2:10.20.193.176:6818/1862950168,v1:10.20.193.176:6819/1862950168] conn(0x7fecd4081840 msgr2=0x7fecd4083c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fed0b8da640 1 --2- 10.20.193.5:0/1445677847 >> [v2:10.20.193.176:6818/1862950168,v1:10.20.193.176:6819/1862950168] conn(0x7fecd4081840 0x7fecd4083c80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fed0b8da640 20 client.4474.objecter put_session s=0x7fecd4081170 osd=3 1 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fed0b8da640 20 client.4474.objecter shutdown clearing up homeless session... 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fed0b8da640 10 client.4474.objecter successfully canceled tick 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fed0b8da640 1 -- 10.20.193.5:0/1445677847 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fecd4079300 msgr2=0x7fecd407b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fed0b8da640 1 --2- 10.20.193.5:0/1445677847 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fecd4079300 0x7fecd407b7c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fecf8002a30 tx=0x7fecf80079f0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fed0b8da640 10 monclient: shutdown 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fed0b8da640 20 monclient: shutdown canceling and discarding version request 1 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fed0b8da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fed0b8da640 1 -- 10.20.193.5:0/1445677847 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fed040d1b60 msgr2=0x7fed041eae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fed0b8da640 1 --2- 10.20.193.5:0/1445677847 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fed040d1b60 0x7fed041eae40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fecf4009130 tx=0x7fecf40047c0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fed09e50640 1 -- 10.20.193.5:0/1445677847 reap_dead start 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fed0b8da640 1 -- 10.20.193.5:0/1445677847 shutdown_connections 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fed0b8da640 1 -- 10.20.193.5:0/1445677847 >> 10.20.193.5:0/1445677847 conn(0x7fed0406d9b0 msgr2=0x7fed041516e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fed0b8da640 1 -- 10.20.193.5:0/1445677847 shutdown_connections 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fed0b8da640 1 -- 10.20.193.5:0/1445677847 wait complete. 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7f58ddd74640 1 --2- 10.20.193.5:0/3456503733 >> [v2:10.20.193.176:6802/3067818664,v1:10.20.193.176:6803/3067818664] conn(0x7f58ac081810 0x7f58ac083c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7fed0b8da640 1 librados: shutdown 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.358+0000 7f58ddd74640 10 monclient: get_auth_request con 0x7f58ac081810 auth_method 0 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.359+0000 7f7b9bfff640 1 -- 10.20.193.5:0/3871606820 <== osd.5 v2:10.20.193.119:6818/4010664603 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f7bb4013e70 con 0x7f7b900817c0 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.359+0000 7f7b9bfff640 10 client.4440.objecter ms_dispatch2 0x7f7bc0000b90 command_reply(tid 1: 0 ) 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.359+0000 7f7b9bfff640 10 client.4440.objecter _finish_command 1 = system:0 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.359+0000 7f7b9bfff640 20 client.4440.objecter put_session s=0x7f7b900810f0 osd=5 4 2026-02-17T21:25:36.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.359+0000 7f7b9bfff640 15 client.4440.objecter _session_command_op_remove 5 1 2026-02-17T21:25:36.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.360+0000 7f78bef34640 10 client.4475.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:25:36.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.360+0000 7f78bef34640 15 client.4475.objecter _session_command_op_assign -1 2 2026-02-17T21:25:36.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.360+0000 7f78bef34640 20 client.4475.objecter _get_session s=0x7f78880811a0 osd=13 3 2026-02-17T21:25:36.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.360+0000 7f78bef34640 20 client.4475.objecter put_session s=0x7f78880811a0 osd=13 3 2026-02-17T21:25:36.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.360+0000 7f78bef34640 20 client.4475.objecter _get_session s=0x7f78880811a0 osd=13 3 2026-02-17T21:25:36.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.360+0000 7f78bef34640 15 client.4475.objecter _session_command_op_remove -1 2 2026-02-17T21:25:36.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.360+0000 7f78bef34640 20 client.4475.objecter get_session s=0x7f78880811a0 osd=13 3 2026-02-17T21:25:36.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.360+0000 7f78bef34640 15 client.4475.objecter _session_command_op_assign 13 2 2026-02-17T21:25:36.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.360+0000 7f78bef34640 20 client.4475.objecter put_session s=0x7f78880811a0 osd=13 4 2026-02-17T21:25:36.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.360+0000 7f78bef34640 10 client.4475.objecter _send_command 2 2026-02-17T21:25:36.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.360+0000 7f78bef34640 1 -- 10.20.193.5:0/741987363 --> [v2:10.20.193.119:6808/1303925174,v1:10.20.193.119:6809/1303925174] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f78b815b680 con 0x7f7888081870 2026-02-17T21:25:36.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.360+0000 7f58c6ffd640 10 client.4478.objecter ms_handle_connect 0x7f58ac081810 2026-02-17T21:25:36.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.360+0000 7f58ddd74640 1 --2- 10.20.193.5:0/3456503733 >> [v2:10.20.193.176:6802/3067818664,v1:10.20.193.176:6803/3067818664] conn(0x7f58ac081810 0x7f58ac083c50 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.362+0000 7faccffff640 1 -- 10.20.193.5:0/862750175 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7face403f050 con 0x7facf40d1f40 2026-02-17T21:25:36.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.362+0000 7faccffff640 1 --2- 10.20.193.5:0/862750175 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7facc4079300 0x7facc407b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.362+0000 7facf37fe640 1 --2- 10.20.193.5:0/862750175 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7facc4079300 0x7facc407b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.362+0000 7facf37fe640 10 monclient: get_auth_request con 0x7facc4079300 auth_method 0 2026-02-17T21:25:36.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.362+0000 7f78ad7fa640 1 -- 10.20.193.5:0/741987363 <== osd.13 v2:10.20.193.119:6808/1303925174 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f78b815b680 con 0x7f7888081870 2026-02-17T21:25:36.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.362+0000 7f78ad7fa640 10 client.4475.objecter ms_dispatch2 0x7f78b8000b90 command_reply(tid 2: 0 ) 2026-02-17T21:25:36.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.362+0000 7f78ad7fa640 10 client.4475.objecter _finish_command 2 = system:0 2026-02-17T21:25:36.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.362+0000 7f78ad7fa640 20 client.4475.objecter put_session s=0x7f78880811a0 osd=13 4 2026-02-17T21:25:36.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.362+0000 7f78ad7fa640 15 client.4475.objecter _session_command_op_remove 13 2 2026-02-17T21:25:36.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.363+0000 7f78bef34640 10 librados: watch_flush enter 2026-02-17T21:25:36.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.363+0000 7f78bef34640 10 librados: watch_flush exit 2026-02-17T21:25:36.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.363+0000 7f78bef34640 10 client.4475.objecter close_session for osd.13 2026-02-17T21:25:36.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.363+0000 7f78bef34640 1 -- 10.20.193.5:0/741987363 >> [v2:10.20.193.119:6808/1303925174,v1:10.20.193.119:6809/1303925174] conn(0x7f7888081870 msgr2=0x7f7888083cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.363+0000 7f78bef34640 1 --2- 10.20.193.5:0/741987363 >> [v2:10.20.193.119:6808/1303925174,v1:10.20.193.119:6809/1303925174] conn(0x7f7888081870 0x7f7888083cb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.363+0000 7f78bef34640 20 client.4475.objecter put_session s=0x7f78880811a0 osd=13 1 2026-02-17T21:25:36.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.363+0000 7f78bef34640 20 client.4475.objecter shutdown clearing up homeless session... 2026-02-17T21:25:36.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.363+0000 7f78bef34640 10 client.4475.objecter successfully canceled tick 2026-02-17T21:25:36.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.363+0000 7f78bef34640 1 -- 10.20.193.5:0/741987363 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f78880792d0 msgr2=0x7f788807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.363+0000 7f78bef34640 1 --2- 10.20.193.5:0/741987363 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f78880792d0 0x7f788807b790 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009750 tx=0x7f78a8006ca0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.363+0000 7f78bef34640 10 monclient: shutdown 2026-02-17T21:25:36.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.363+0000 7f78bef34640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.363+0000 7f78bef34640 1 -- 10.20.193.5:0/741987363 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f78b80d1f40 msgr2=0x7f78b815aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.363+0000 7f78bef34640 1 --2- 10.20.193.5:0/741987363 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f78b80d1f40 0x7f78b815aef0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f78a00099d0 tx=0x7f78a00047c0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.363+0000 7f78bd4aa640 1 -- 10.20.193.5:0/741987363 reap_dead start 2026-02-17T21:25:36.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.363+0000 7f78bef34640 1 -- 10.20.193.5:0/741987363 shutdown_connections 2026-02-17T21:25:36.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.363+0000 7f78bef34640 1 -- 10.20.193.5:0/741987363 >> 10.20.193.5:0/741987363 conn(0x7f78b806d9b0 msgr2=0x7f78b80d0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.363+0000 7f78bef34640 1 -- 10.20.193.5:0/741987363 shutdown_connections 2026-02-17T21:25:36.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.363+0000 7f78bef34640 1 -- 10.20.193.5:0/741987363 wait complete. 2026-02-17T21:25:36.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.363+0000 7f78bef34640 1 librados: shutdown 2026-02-17T21:25:36.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.363+0000 7faccffff640 10 client.4443.objecter ms_handle_connect 0x7facc4079300 2026-02-17T21:25:36.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.363+0000 7facf37fe640 1 --2- 10.20.193.5:0/862750175 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7facc4079300 0x7facc407b7c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7face0009750 tx=0x7face0006ca0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7f7bc61c3640 10 client.4440.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:25:36.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7f7bc61c3640 15 client.4440.objecter _session_command_op_assign -1 2 2026-02-17T21:25:36.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7f7bc61c3640 20 client.4440.objecter _get_session s=0x7f7b900810f0 osd=5 3 2026-02-17T21:25:36.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7f7bc61c3640 20 client.4440.objecter put_session s=0x7f7b900810f0 osd=5 3 2026-02-17T21:25:36.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7f7bc61c3640 20 client.4440.objecter _get_session s=0x7f7b900810f0 osd=5 3 2026-02-17T21:25:36.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7f7bc61c3640 15 client.4440.objecter _session_command_op_remove -1 2 2026-02-17T21:25:36.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7f7bc61c3640 20 client.4440.objecter get_session s=0x7f7b900810f0 osd=5 3 2026-02-17T21:25:36.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7f7bc61c3640 15 client.4440.objecter _session_command_op_assign 5 2 2026-02-17T21:25:36.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7f7bc61c3640 20 client.4440.objecter put_session s=0x7f7b900810f0 osd=5 4 2026-02-17T21:25:36.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7f7bc61c3640 10 client.4440.objecter _send_command 2 2026-02-17T21:25:36.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7f7bc61c3640 1 -- 10.20.193.5:0/3871606820 --> [v2:10.20.193.119:6818/4010664603,v1:10.20.193.119:6820/4010664603] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7bc00cbdb0 con 0x7f7b900817c0 2026-02-17T21:25:36.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7faccffff640 1 -- 10.20.193.5:0/862750175 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7face4083500 con 0x7facf40d1f40 2026-02-17T21:25:36.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7faccffff640 10 client.4443.objecter ms_dispatch2 0x7facf4000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:36.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7faccffff640 3 client.4443.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:36.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7faccffff640 3 client.4443.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:36.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7faccffff640 10 client.4443.objecter checking command 1 2026-02-17T21:25:36.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7faccffff640 1 --2- 10.20.193.5:0/862750175 >> [v2:10.20.193.176:6810/1976318959,v1:10.20.193.176:6811/1976318959] conn(0x7facc40818a0 0x7facc4083ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7faccffff640 20 client.4443.objecter _get_session s=0x7facc40811d0 osd=15 3 2026-02-17T21:25:36.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7faccffff640 20 client.4443.objecter put_session s=0x7facc40811d0 osd=15 3 2026-02-17T21:25:36.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7faccffff640 15 client.4443.objecter _session_command_op_remove -1 1 2026-02-17T21:25:36.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7faccffff640 20 client.4443.objecter _get_session s=0x7facc40811d0 osd=15 3 2026-02-17T21:25:36.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7faccffff640 20 client.4443.objecter get_session s=0x7facc40811d0 osd=15 3 2026-02-17T21:25:36.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7faace7fc640 1 -- 10.20.193.5:0/2420308612 <== osd.9 v2:10.20.193.119:6816/576833933 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7faadc056e50 con 0x7faab0081810 2026-02-17T21:25:36.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7faace7fc640 10 client.4463.objecter ms_dispatch2 0x7faae0000b90 command_reply(tid 1: 0 ) 2026-02-17T21:25:36.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7faccffff640 15 client.4443.objecter _session_command_op_assign 15 1 2026-02-17T21:25:36.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7faccffff640 20 client.4443.objecter put_session s=0x7facc40811d0 osd=15 4 2026-02-17T21:25:36.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7faccffff640 10 client.4443.objecter _send_command 1 2026-02-17T21:25:36.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7faccffff640 1 -- 10.20.193.5:0/862750175 --> [v2:10.20.193.176:6810/1976318959,v1:10.20.193.176:6811/1976318959] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7face404ee80 con 0x7facc40818a0 2026-02-17T21:25:36.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7faccffff640 20 client.4443.objecter dump_active .. 0 homeless 2026-02-17T21:25:36.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7faccffff640 1 -- 10.20.193.5:0/862750175 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7face40838c0 con 0x7facf40d1f40 2026-02-17T21:25:36.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7faccffff640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T21:25:36.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7faace7fc640 10 client.4463.objecter _finish_command 1 = system:0 2026-02-17T21:25:36.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7faace7fc640 20 client.4463.objecter put_session s=0x7faab0081140 osd=9 4 2026-02-17T21:25:36.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.366+0000 7faace7fc640 15 client.4463.objecter _session_command_op_remove 9 1 2026-02-17T21:25:36.419 INFO:teuthology.orchestra.run.trial005.stdout:115964117001 2026-02-17T21:25:36.419 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T21:25:36.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.367+0000 7facf3fff640 1 --2- 10.20.193.5:0/862750175 >> [v2:10.20.193.176:6810/1976318959,v1:10.20.193.176:6811/1976318959] conn(0x7facc40818a0 0x7facc4083ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.367+0000 7facf3fff640 10 monclient: get_auth_request con 0x7facc40818a0 auth_method 0 2026-02-17T21:25:36.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7f7b9bfff640 1 -- 10.20.193.5:0/3871606820 <== osd.5 v2:10.20.193.119:6818/4010664603 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7bc00cbdb0 con 0x7f7b900817c0 2026-02-17T21:25:36.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7f7b9bfff640 10 client.4440.objecter ms_dispatch2 0x7f7bc0000b90 command_reply(tid 2: 0 ) 2026-02-17T21:25:36.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7f7b9bfff640 10 client.4440.objecter _finish_command 2 = system:0 2026-02-17T21:25:36.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7f7b9bfff640 20 client.4440.objecter put_session s=0x7f7b900810f0 osd=5 4 2026-02-17T21:25:36.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7f7b9bfff640 15 client.4440.objecter _session_command_op_remove 5 2 2026-02-17T21:25:36.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7facf3fff640 1 --2- 10.20.193.5:0/862750175 >> [v2:10.20.193.176:6810/1976318959,v1:10.20.193.176:6811/1976318959] conn(0x7facc40818a0 0x7facc4083ce0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.15 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7faccffff640 10 client.4443.objecter ms_handle_connect 0x7facc40818a0 2026-02-17T21:25:36.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7f7bc61c3640 10 librados: watch_flush enter 2026-02-17T21:25:36.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7f7bc61c3640 10 librados: watch_flush exit 2026-02-17T21:25:36.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7f7bc61c3640 10 client.4440.objecter close_session for osd.5 2026-02-17T21:25:36.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7f7bc61c3640 1 -- 10.20.193.5:0/3871606820 >> [v2:10.20.193.119:6818/4010664603,v1:10.20.193.119:6820/4010664603] conn(0x7f7b900817c0 msgr2=0x7f7b90083c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7f7bc61c3640 1 --2- 10.20.193.5:0/3871606820 >> [v2:10.20.193.119:6818/4010664603,v1:10.20.193.119:6820/4010664603] conn(0x7f7b900817c0 0x7f7b90083c00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7f7bc61c3640 20 client.4440.objecter put_session s=0x7f7b900810f0 osd=5 1 2026-02-17T21:25:36.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7f7bc61c3640 20 client.4440.objecter shutdown clearing up homeless session... 2026-02-17T21:25:36.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7f7bc61c3640 10 client.4440.objecter successfully canceled tick 2026-02-17T21:25:36.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7f7bc61c3640 1 -- 10.20.193.5:0/3871606820 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7b90079280 msgr2=0x7f7b9007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7f7bc61c3640 1 --2- 10.20.193.5:0/3871606820 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7b90079280 0x7f7b9007b740 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7bac039000 tx=0x7f7bac033000 comp rx=0 tx=0).stop 2026-02-17T21:25:36.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7f7bc61c3640 10 monclient: shutdown 2026-02-17T21:25:36.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7f7bc61c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7f7bc61c3640 1 -- 10.20.193.5:0/3871606820 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7bc015bf30 msgr2=0x7f7bc014b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7f7bc61c3640 1 --2- 10.20.193.5:0/3871606820 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7bc015bf30 0x7f7bc014b060 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400cb40 tx=0x7f7bb400a430 comp rx=0 tx=0).stop 2026-02-17T21:25:36.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7f7bbffff640 1 -- 10.20.193.5:0/3871606820 reap_dead start 2026-02-17T21:25:36.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7f7bc61c3640 1 -- 10.20.193.5:0/3871606820 shutdown_connections 2026-02-17T21:25:36.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7f7bc61c3640 1 -- 10.20.193.5:0/3871606820 >> 10.20.193.5:0/3871606820 conn(0x7f7bc0073030 msgr2=0x7f7bc00ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7f7bc61c3640 1 -- 10.20.193.5:0/3871606820 shutdown_connections 2026-02-17T21:25:36.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.369+0000 7f7bc61c3640 1 -- 10.20.193.5:0/3871606820 wait complete. 2026-02-17T21:25:36.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.370+0000 7f7bc61c3640 1 librados: shutdown 2026-02-17T21:25:36.421 INFO:teuthology.orchestra.run.trial005.stdout:111669149702 2026-02-17T21:25:36.421 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-17T21:25:36.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.373+0000 7faae8022640 10 client.4463.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:25:36.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.373+0000 7faae8022640 15 client.4463.objecter _session_command_op_assign -1 2 2026-02-17T21:25:36.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.373+0000 7faae8022640 20 client.4463.objecter _get_session s=0x7faab0081140 osd=9 3 2026-02-17T21:25:36.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.373+0000 7faae8022640 20 client.4463.objecter put_session s=0x7faab0081140 osd=9 3 2026-02-17T21:25:36.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.373+0000 7faae8022640 20 client.4463.objecter _get_session s=0x7faab0081140 osd=9 3 2026-02-17T21:25:36.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.373+0000 7faae8022640 15 client.4463.objecter _session_command_op_remove -1 2 2026-02-17T21:25:36.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.373+0000 7faae8022640 20 client.4463.objecter get_session s=0x7faab0081140 osd=9 3 2026-02-17T21:25:36.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.373+0000 7faae8022640 15 client.4463.objecter _session_command_op_assign 9 2 2026-02-17T21:25:36.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.373+0000 7faae8022640 20 client.4463.objecter put_session s=0x7faab0081140 osd=9 4 2026-02-17T21:25:36.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.373+0000 7faae8022640 10 client.4463.objecter _send_command 2 2026-02-17T21:25:36.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.373+0000 7faae8022640 1 -- 10.20.193.5:0/2420308612 --> [v2:10.20.193.119:6816/576833933,v1:10.20.193.119:6817/576833933] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faae014d830 con 0x7faab0081810 2026-02-17T21:25:36.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.374+0000 7f2d37fff640 1 -- 10.20.193.5:0/4147654514 <== osd.8 v2:10.20.193.5:6816/1609723815 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f2d4c00fc80 con 0x7f2d2c0817c0 2026-02-17T21:25:36.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.374+0000 7f2d37fff640 10 client.4422.objecter ms_dispatch2 0x7f2d5c000b90 command_reply(tid 1: 0 ) 2026-02-17T21:25:36.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.374+0000 7f2d37fff640 10 client.4422.objecter _finish_command 1 = system:0 2026-02-17T21:25:36.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.374+0000 7f2d37fff640 20 client.4422.objecter put_session s=0x7f2d2c0810f0 osd=8 4 2026-02-17T21:25:36.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.374+0000 7f2d37fff640 15 client.4422.objecter _session_command_op_remove 8 1 2026-02-17T21:25:36.422 INFO:teuthology.orchestra.run.trial005.stdout:94489280518 2026-02-17T21:25:36.422 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-17T21:25:36.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.377+0000 7faace7fc640 1 -- 10.20.193.5:0/2420308612 <== osd.9 v2:10.20.193.119:6816/576833933 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7faae014d830 con 0x7faab0081810 2026-02-17T21:25:36.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.377+0000 7faace7fc640 10 client.4463.objecter ms_dispatch2 0x7faae0000b90 command_reply(tid 2: 0 ) 2026-02-17T21:25:36.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.377+0000 7faace7fc640 10 client.4463.objecter _finish_command 2 = system:0 2026-02-17T21:25:36.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.377+0000 7faace7fc640 20 client.4463.objecter put_session s=0x7faab0081140 osd=9 4 2026-02-17T21:25:36.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.377+0000 7faace7fc640 15 client.4463.objecter _session_command_op_remove 9 2 2026-02-17T21:25:36.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.377+0000 7faae8022640 10 librados: watch_flush enter 2026-02-17T21:25:36.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.377+0000 7faae8022640 10 librados: watch_flush exit 2026-02-17T21:25:36.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.377+0000 7faae8022640 10 client.4463.objecter close_session for osd.9 2026-02-17T21:25:36.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.377+0000 7faae8022640 1 -- 10.20.193.5:0/2420308612 >> [v2:10.20.193.119:6816/576833933,v1:10.20.193.119:6817/576833933] conn(0x7faab0081810 msgr2=0x7faab0083c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.377+0000 7faae8022640 1 --2- 10.20.193.5:0/2420308612 >> [v2:10.20.193.119:6816/576833933,v1:10.20.193.119:6817/576833933] conn(0x7faab0081810 0x7faab0083c50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.377+0000 7faae8022640 20 client.4463.objecter put_session s=0x7faab0081140 osd=9 1 2026-02-17T21:25:36.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.377+0000 7faae8022640 20 client.4463.objecter shutdown clearing up homeless session... 2026-02-17T21:25:36.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.377+0000 7faae8022640 10 client.4463.objecter successfully canceled tick 2026-02-17T21:25:36.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.377+0000 7faae8022640 1 -- 10.20.193.5:0/2420308612 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7faab00792d0 msgr2=0x7faab007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.377+0000 7faae8022640 1 --2- 10.20.193.5:0/2420308612 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7faab00792d0 0x7faab007b790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faad000ab20 tx=0x7faad0008040 comp rx=0 tx=0).stop 2026-02-17T21:25:36.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.377+0000 7faae8022640 10 monclient: shutdown 2026-02-17T21:25:36.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.377+0000 7faae8022640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.377+0000 7faae8022640 1 -- 10.20.193.5:0/2420308612 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7faae015edb0 msgr2=0x7faae01f4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.377+0000 7faae8022640 1 --2- 10.20.193.5:0/2420308612 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7faae015edb0 0x7faae01f4230 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faadc009f50 tx=0x7faadc004b40 comp rx=0 tx=0).stop 2026-02-17T21:25:36.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.377+0000 7faae6598640 1 -- 10.20.193.5:0/2420308612 reap_dead start 2026-02-17T21:25:36.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.377+0000 7faae8022640 1 -- 10.20.193.5:0/2420308612 shutdown_connections 2026-02-17T21:25:36.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.377+0000 7faae8022640 1 -- 10.20.193.5:0/2420308612 >> 10.20.193.5:0/2420308612 conn(0x7faae0073030 msgr2=0x7faae00735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.377+0000 7faae8022640 1 -- 10.20.193.5:0/2420308612 shutdown_connections 2026-02-17T21:25:36.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.377+0000 7faae8022640 1 -- 10.20.193.5:0/2420308612 wait complete. 2026-02-17T21:25:36.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.377+0000 7faae8022640 1 librados: shutdown 2026-02-17T21:25:36.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.381+0000 7f2d62134640 10 client.4422.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:25:36.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.381+0000 7f2d62134640 15 client.4422.objecter _session_command_op_assign -1 2 2026-02-17T21:25:36.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.381+0000 7f2d62134640 20 client.4422.objecter _get_session s=0x7f2d2c0810f0 osd=8 3 2026-02-17T21:25:36.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.381+0000 7f2d62134640 20 client.4422.objecter put_session s=0x7f2d2c0810f0 osd=8 3 2026-02-17T21:25:36.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.381+0000 7f2d62134640 20 client.4422.objecter _get_session s=0x7f2d2c0810f0 osd=8 3 2026-02-17T21:25:36.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.381+0000 7f2d62134640 15 client.4422.objecter _session_command_op_remove -1 2 2026-02-17T21:25:36.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.381+0000 7f2d62134640 20 client.4422.objecter get_session s=0x7f2d2c0810f0 osd=8 3 2026-02-17T21:25:36.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.381+0000 7f2d62134640 15 client.4422.objecter _session_command_op_assign 8 2 2026-02-17T21:25:36.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.381+0000 7f2d62134640 20 client.4422.objecter put_session s=0x7f2d2c0810f0 osd=8 4 2026-02-17T21:25:36.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.381+0000 7f2d62134640 10 client.4422.objecter _send_command 2 2026-02-17T21:25:36.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.381+0000 7f2d62134640 1 -- 10.20.193.5:0/4147654514 --> [v2:10.20.193.5:6816/1609723815,v1:10.20.193.5:6817/1609723815] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2d5c06f140 con 0x7f2d2c0817c0 2026-02-17T21:25:36.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.384+0000 7f58c6ffd640 1 -- 10.20.193.5:0/3456503733 <== osd.11 v2:10.20.193.176:6802/3067818664 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f58d000ee50 con 0x7f58ac081810 2026-02-17T21:25:36.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.384+0000 7f58c6ffd640 10 client.4478.objecter ms_dispatch2 0x7f58e0000b90 command_reply(tid 1: 0 ) 2026-02-17T21:25:36.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.384+0000 7f58c6ffd640 10 client.4478.objecter _finish_command 1 = system:0 2026-02-17T21:25:36.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.384+0000 7f58c6ffd640 20 client.4478.objecter put_session s=0x7f58ac081140 osd=11 4 2026-02-17T21:25:36.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.384+0000 7f58c6ffd640 15 client.4478.objecter _session_command_op_remove 11 1 2026-02-17T21:25:36.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.384+0000 7f2d37fff640 1 -- 10.20.193.5:0/4147654514 <== osd.8 v2:10.20.193.5:6816/1609723815 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2d5c06f140 con 0x7f2d2c0817c0 2026-02-17T21:25:36.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.385+0000 7f2d37fff640 10 client.4422.objecter ms_dispatch2 0x7f2d5c000b90 command_reply(tid 2: 0 ) 2026-02-17T21:25:36.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.385+0000 7f2d37fff640 10 client.4422.objecter _finish_command 2 = system:0 2026-02-17T21:25:36.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.385+0000 7f2d37fff640 20 client.4422.objecter put_session s=0x7f2d2c0810f0 osd=8 4 2026-02-17T21:25:36.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.385+0000 7f2d37fff640 15 client.4422.objecter _session_command_op_remove 8 2 2026-02-17T21:25:36.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.385+0000 7f2d62134640 10 librados: watch_flush enter 2026-02-17T21:25:36.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.385+0000 7f2d62134640 10 librados: watch_flush exit 2026-02-17T21:25:36.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.385+0000 7f2d62134640 10 client.4422.objecter close_session for osd.8 2026-02-17T21:25:36.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.385+0000 7f2d62134640 1 -- 10.20.193.5:0/4147654514 >> [v2:10.20.193.5:6816/1609723815,v1:10.20.193.5:6817/1609723815] conn(0x7f2d2c0817c0 msgr2=0x7f2d2c083c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.385+0000 7f2d62134640 1 --2- 10.20.193.5:0/4147654514 >> [v2:10.20.193.5:6816/1609723815,v1:10.20.193.5:6817/1609723815] conn(0x7f2d2c0817c0 0x7f2d2c083c00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.385+0000 7f2d62134640 20 client.4422.objecter put_session s=0x7f2d2c0810f0 osd=8 1 2026-02-17T21:25:36.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.385+0000 7f2d62134640 20 client.4422.objecter shutdown clearing up homeless session... 2026-02-17T21:25:36.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.385+0000 7f2d62134640 10 client.4422.objecter successfully canceled tick 2026-02-17T21:25:36.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.385+0000 7f2d62134640 1 -- 10.20.193.5:0/4147654514 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2d2c079280 msgr2=0x7f2d2c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.385+0000 7f2d62134640 1 --2- 10.20.193.5:0/4147654514 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2d2c079280 0x7f2d2c07b740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c070ff0 tx=0x7f2d48031000 comp rx=0 tx=0).stop 2026-02-17T21:25:36.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.385+0000 7f2d62134640 10 monclient: shutdown 2026-02-17T21:25:36.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.385+0000 7f2d62134640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.385+0000 7f2d62134640 1 -- 10.20.193.5:0/4147654514 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2d5c155770 msgr2=0x7f2d5c0c72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.385+0000 7f2d62134640 1 --2- 10.20.193.5:0/4147654514 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2d5c155770 0x7f2d5c0c72f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c00b580 tx=0x7f2d4c00ba50 comp rx=0 tx=0).stop 2026-02-17T21:25:36.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.385+0000 7f2d5bfff640 1 -- 10.20.193.5:0/4147654514 reap_dead start 2026-02-17T21:25:36.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.385+0000 7f2d62134640 1 -- 10.20.193.5:0/4147654514 shutdown_connections 2026-02-17T21:25:36.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.385+0000 7f2d62134640 1 -- 10.20.193.5:0/4147654514 >> 10.20.193.5:0/4147654514 conn(0x7f2d5c0c9f40 msgr2=0x7f2d5c153200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.385+0000 7f2d62134640 1 -- 10.20.193.5:0/4147654514 shutdown_connections 2026-02-17T21:25:36.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.385+0000 7f2d62134640 1 -- 10.20.193.5:0/4147654514 wait complete. 2026-02-17T21:25:36.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.385+0000 7f2d62134640 1 librados: shutdown 2026-02-17T21:25:36.426 INFO:teuthology.orchestra.run.trial005.stdout:111669149704 2026-02-17T21:25:36.426 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-17T21:25:36.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.390+0000 7faccffff640 1 -- 10.20.193.5:0/862750175 <== osd.15 v2:10.20.193.176:6810/1976318959 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7face404ee80 con 0x7facc40818a0 2026-02-17T21:25:36.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.390+0000 7faccffff640 10 client.4443.objecter ms_dispatch2 0x7facf4000b90 command_reply(tid 1: 0 ) 2026-02-17T21:25:36.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.390+0000 7faccffff640 10 client.4443.objecter _finish_command 1 = system:0 2026-02-17T21:25:36.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.390+0000 7faccffff640 20 client.4443.objecter put_session s=0x7facc40811d0 osd=15 4 2026-02-17T21:25:36.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.390+0000 7faccffff640 15 client.4443.objecter _session_command_op_remove 15 1 2026-02-17T21:25:36.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.390+0000 7f58e4b01640 10 client.4478.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:25:36.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.390+0000 7f58e4b01640 15 client.4478.objecter _session_command_op_assign -1 2 2026-02-17T21:25:36.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.390+0000 7f58e4b01640 20 client.4478.objecter _get_session s=0x7f58ac081140 osd=11 3 2026-02-17T21:25:36.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.390+0000 7f58e4b01640 20 client.4478.objecter put_session s=0x7f58ac081140 osd=11 3 2026-02-17T21:25:36.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.390+0000 7f58e4b01640 20 client.4478.objecter _get_session s=0x7f58ac081140 osd=11 3 2026-02-17T21:25:36.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.390+0000 7f58e4b01640 15 client.4478.objecter _session_command_op_remove -1 2 2026-02-17T21:25:36.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.390+0000 7f58e4b01640 20 client.4478.objecter get_session s=0x7f58ac081140 osd=11 3 2026-02-17T21:25:36.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.390+0000 7f58e4b01640 15 client.4478.objecter _session_command_op_assign 11 2 2026-02-17T21:25:36.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.390+0000 7f58e4b01640 20 client.4478.objecter put_session s=0x7f58ac081140 osd=11 4 2026-02-17T21:25:36.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.390+0000 7f58e4b01640 10 client.4478.objecter _send_command 2 2026-02-17T21:25:36.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.390+0000 7f58e4b01640 1 -- 10.20.193.5:0/3456503733 --> [v2:10.20.193.176:6802/3067818664,v1:10.20.193.176:6803/3067818664] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f58e0166630 con 0x7f58ac081810 2026-02-17T21:25:36.427 INFO:teuthology.orchestra.run.trial005.stdout:120259084295 2026-02-17T21:25:36.427 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-17T21:25:36.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58c6ffd640 1 -- 10.20.193.5:0/3456503733 <== osd.11 v2:10.20.193.176:6802/3067818664 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f58e0166630 con 0x7f58ac081810 2026-02-17T21:25:36.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58c6ffd640 10 client.4478.objecter ms_dispatch2 0x7f58e0000b90 command_reply(tid 2: 0 ) 2026-02-17T21:25:36.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58c6ffd640 10 client.4478.objecter _finish_command 2 = system:0 2026-02-17T21:25:36.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58c6ffd640 20 client.4478.objecter put_session s=0x7f58ac081140 osd=11 4 2026-02-17T21:25:36.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58c6ffd640 15 client.4478.objecter _session_command_op_remove 11 2 2026-02-17T21:25:36.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58e4b01640 10 librados: watch_flush enter 2026-02-17T21:25:36.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58e4b01640 10 librados: watch_flush exit 2026-02-17T21:25:36.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58e4b01640 10 client.4478.objecter close_session for osd.11 2026-02-17T21:25:36.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58e4b01640 1 -- 10.20.193.5:0/3456503733 >> [v2:10.20.193.176:6802/3067818664,v1:10.20.193.176:6803/3067818664] conn(0x7f58ac081810 msgr2=0x7f58ac083c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58e4b01640 1 --2- 10.20.193.5:0/3456503733 >> [v2:10.20.193.176:6802/3067818664,v1:10.20.193.176:6803/3067818664] conn(0x7f58ac081810 0x7f58ac083c50 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58e4b01640 20 client.4478.objecter put_session s=0x7f58ac081140 osd=11 1 2026-02-17T21:25:36.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58e4b01640 20 client.4478.objecter shutdown clearing up homeless session... 2026-02-17T21:25:36.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58e4b01640 10 client.4478.objecter successfully canceled tick 2026-02-17T21:25:36.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58e4b01640 1 -- 10.20.193.5:0/3456503733 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f58ac0792d0 msgr2=0x7f58ac07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58e4b01640 1 --2- 10.20.193.5:0/3456503733 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f58ac0792d0 0x7f58ac07b790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f58d4009750 tx=0x7f58d4006ca0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58e4b01640 10 monclient: shutdown 2026-02-17T21:25:36.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58e4b01640 20 monclient: shutdown canceling and discarding version request 1 2026-02-17T21:25:36.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58e4b01640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58e4b01640 1 -- 10.20.193.5:0/3456503733 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f58e015ef80 msgr2=0x7f58e00cfb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58e4b01640 1 --2- 10.20.193.5:0/3456503733 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f58e015ef80 0x7f58e00cfb50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f58d000b9c0 tx=0x7f58d000be90 comp rx=0 tx=0).stop 2026-02-17T21:25:36.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58ded76640 1 -- 10.20.193.5:0/3456503733 reap_dead start 2026-02-17T21:25:36.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58e4b01640 1 -- 10.20.193.5:0/3456503733 shutdown_connections 2026-02-17T21:25:36.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58e4b01640 1 -- 10.20.193.5:0/3456503733 >> 10.20.193.5:0/3456503733 conn(0x7f58e0073030 msgr2=0x7f58e0165a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58e4b01640 1 -- 10.20.193.5:0/3456503733 shutdown_connections 2026-02-17T21:25:36.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58e4b01640 1 -- 10.20.193.5:0/3456503733 wait complete. 2026-02-17T21:25:36.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.394+0000 7f58e4b01640 1 librados: shutdown 2026-02-17T21:25:36.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.397+0000 7facfa1a1640 10 client.4443.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:25:36.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.397+0000 7facfa1a1640 15 client.4443.objecter _session_command_op_assign -1 2 2026-02-17T21:25:36.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.397+0000 7facfa1a1640 20 client.4443.objecter _get_session s=0x7facc40811d0 osd=15 3 2026-02-17T21:25:36.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.397+0000 7facfa1a1640 20 client.4443.objecter put_session s=0x7facc40811d0 osd=15 3 2026-02-17T21:25:36.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.397+0000 7facfa1a1640 20 client.4443.objecter _get_session s=0x7facc40811d0 osd=15 3 2026-02-17T21:25:36.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.397+0000 7facfa1a1640 15 client.4443.objecter _session_command_op_remove -1 2 2026-02-17T21:25:36.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.397+0000 7facfa1a1640 20 client.4443.objecter get_session s=0x7facc40811d0 osd=15 3 2026-02-17T21:25:36.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.397+0000 7facfa1a1640 15 client.4443.objecter _session_command_op_assign 15 2 2026-02-17T21:25:36.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.397+0000 7facfa1a1640 20 client.4443.objecter put_session s=0x7facc40811d0 osd=15 4 2026-02-17T21:25:36.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.397+0000 7facfa1a1640 10 client.4443.objecter _send_command 2 2026-02-17T21:25:36.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.397+0000 7facfa1a1640 1 -- 10.20.193.5:0/862750175 --> [v2:10.20.193.176:6810/1976318959,v1:10.20.193.176:6811/1976318959] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7facf406e7b0 con 0x7facc40818a0 2026-02-17T21:25:36.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.401+0000 7faccffff640 1 -- 10.20.193.5:0/862750175 <== osd.15 v2:10.20.193.176:6810/1976318959 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7facf406e7b0 con 0x7facc40818a0 2026-02-17T21:25:36.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.401+0000 7faccffff640 10 client.4443.objecter ms_dispatch2 0x7facf4000b90 command_reply(tid 2: 0 ) 2026-02-17T21:25:36.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.401+0000 7faccffff640 10 client.4443.objecter _finish_command 2 = system:0 2026-02-17T21:25:36.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.401+0000 7faccffff640 20 client.4443.objecter put_session s=0x7facc40811d0 osd=15 4 2026-02-17T21:25:36.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.401+0000 7faccffff640 15 client.4443.objecter _session_command_op_remove 15 2 2026-02-17T21:25:36.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.401+0000 7facfa1a1640 10 librados: watch_flush enter 2026-02-17T21:25:36.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.401+0000 7facfa1a1640 10 librados: watch_flush exit 2026-02-17T21:25:36.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.401+0000 7facfa1a1640 10 client.4443.objecter close_session for osd.15 2026-02-17T21:25:36.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.401+0000 7facfa1a1640 1 -- 10.20.193.5:0/862750175 >> [v2:10.20.193.176:6810/1976318959,v1:10.20.193.176:6811/1976318959] conn(0x7facc40818a0 msgr2=0x7facc4083ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.401+0000 7facfa1a1640 1 --2- 10.20.193.5:0/862750175 >> [v2:10.20.193.176:6810/1976318959,v1:10.20.193.176:6811/1976318959] conn(0x7facc40818a0 0x7facc4083ce0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.401+0000 7facfa1a1640 20 client.4443.objecter put_session s=0x7facc40811d0 osd=15 1 2026-02-17T21:25:36.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.401+0000 7facfa1a1640 20 client.4443.objecter shutdown clearing up homeless session... 2026-02-17T21:25:36.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.401+0000 7facfa1a1640 10 client.4443.objecter successfully canceled tick 2026-02-17T21:25:36.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.401+0000 7facfa1a1640 1 -- 10.20.193.5:0/862750175 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7facc4079300 msgr2=0x7facc407b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.401+0000 7facfa1a1640 1 --2- 10.20.193.5:0/862750175 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7facc4079300 0x7facc407b7c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7face0009750 tx=0x7face0006ca0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.401+0000 7facfa1a1640 10 monclient: shutdown 2026-02-17T21:25:36.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.401+0000 7facfa1a1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.401+0000 7facfa1a1640 1 -- 10.20.193.5:0/862750175 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7facf40d1f40 msgr2=0x7facf413ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.401+0000 7facfa1a1640 1 --2- 10.20.193.5:0/862750175 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7facf40d1f40 0x7facf413ead0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7face4002410 tx=0x7face40047c0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.401+0000 7facf3fff640 1 -- 10.20.193.5:0/862750175 reap_dead start 2026-02-17T21:25:36.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.401+0000 7facfa1a1640 1 -- 10.20.193.5:0/862750175 shutdown_connections 2026-02-17T21:25:36.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.401+0000 7facfa1a1640 1 -- 10.20.193.5:0/862750175 >> 10.20.193.5:0/862750175 conn(0x7facf406d9b0 msgr2=0x7facf40d10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.401+0000 7facfa1a1640 1 -- 10.20.193.5:0/862750175 shutdown_connections 2026-02-17T21:25:36.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.401+0000 7facfa1a1640 1 -- 10.20.193.5:0/862750175 wait complete. 2026-02-17T21:25:36.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.401+0000 7facfa1a1640 1 librados: shutdown 2026-02-17T21:25:36.430 INFO:teuthology.orchestra.run.trial005.stdout:98784247814 2026-02-17T21:25:36.430 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-17T21:25:36.431 INFO:teuthology.orchestra.run.trial005.stdout:120259084295 2026-02-17T21:25:36.431 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2026-02-17T21:25:36.507 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.506+0000 7fbd93ada640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.507 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.506+0000 7fbd93ada640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.507 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.506+0000 7fbd93ada640 10 monclient: monmap: 2026-02-17T21:25:36.507 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.507 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.507 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.507117+0000 2026-02-17T21:25:36.507 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.507117+0000 2026-02-17T21:25:36.507 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.507 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.507 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.507 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.507 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.507 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.508 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.508 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.508 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.506+0000 7fbd93ada640 1 Processor -- start 2026-02-17T21:25:36.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.507+0000 7fbd93ada640 1 -- start start 2026-02-17T21:25:36.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.507+0000 7fbd93ada640 10 monclient: init 2026-02-17T21:25:36.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.507+0000 7f3c99596640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.507+0000 7f3c99596640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.507+0000 7f3c99596640 10 monclient: monmap: 2026-02-17T21:25:36.508 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.508 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.508 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.507717+0000 2026-02-17T21:25:36.508 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.507717+0000 2026-02-17T21:25:36.508 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.508 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.508 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.508 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.508 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.508 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.508 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.508 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.508 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.507+0000 7fbd93ada640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.507+0000 7fbd93ada640 10 monclient: _add_conns ranks=[4,0,1,2,3,5] 2026-02-17T21:25:36.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.507+0000 7fbd93ada640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fbd8c14e920 0x7fbd8c1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.507+0000 7f3c99596640 1 Processor -- start 2026-02-17T21:25:36.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.507+0000 7fbd93ada640 10 monclient(hunting): picked mon.noname-b con 0x7fbd8c14e920 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:36.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.507+0000 7fbd93ada640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbd8c15b290 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:36.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.507+0000 7fbd93ada640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fbd8c14ed00 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:36.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.507+0000 7fbd93ada640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd8c156600 con 0x7fbd8c15b290 2026-02-17T21:25:36.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.507+0000 7fbd93ada640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd8c0c9d20 con 0x7fbd8c14ed00 2026-02-17T21:25:36.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.507+0000 7fbd93ada640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.507+0000 7fbd93ada640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fbd8c159f10 con 0x7fbd8c14e920 2026-02-17T21:25:36.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.507+0000 7fbd93ada640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.507+0000 7fbd93ada640 10 monclient(hunting): authenticate will time out at 1042.072627s 2026-02-17T21:25:36.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.507+0000 7f3c99596640 1 -- start start 2026-02-17T21:25:36.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.507+0000 7f3c99596640 10 monclient: init 2026-02-17T21:25:36.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.508+0000 7fbd9104e640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7fbd8c15b290 0x7fbd8c159640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:42890/0 (socket says 10.20.193.5:42890) 2026-02-17T21:25:36.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.508+0000 7fbd9104e640 1 -- 10.20.193.5:0/3422762480 learned_addr learned my addr 10.20.193.5:0/3422762480 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:36.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.508+0000 7fbd9184f640 1 --2- 10.20.193.5:0/3422762480 >> v2:10.20.193.119:3300/0 conn(0x7fbd8c14e920 0x7fbd8c1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.508+0000 7f3c99596640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.508+0000 7f3c99596640 10 monclient: _add_conns ranks=[3,1,0,5,2,4] 2026-02-17T21:25:36.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.508+0000 7f3c99596640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f3c940c7240 0x7f3c940726d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.508+0000 7f3c99596640 10 monclient(hunting): picked mon.noname-a con 0x7f3c940c7240 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:36.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.508+0000 7f3c99596640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f3c940c7620 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:36.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.508+0000 7f3c99596640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3c94163810 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:36.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.508+0000 7f3c99596640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c94074140 con 0x7f3c94163810 2026-02-17T21:25:36.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.508+0000 7f3c99596640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c94072dc0 con 0x7f3c940c7620 2026-02-17T21:25:36.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.508+0000 7f3c99596640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.508+0000 7f3c99596640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f3c9415a720 con 0x7f3c940c7240 2026-02-17T21:25:36.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.508+0000 7f3c99596640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.508+0000 7f3c99596640 10 monclient(hunting): authenticate will time out at 1042.073357s 2026-02-17T21:25:36.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.508+0000 7fbd9184f640 10 monclient(hunting): get_auth_request con 0x7fbd8c14e920 auth_method 0 2026-02-17T21:25:36.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.508+0000 7fbd9184f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.508+0000 7fbd9184f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.508+0000 7fbd9184f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.509+0000 7f3c937fe640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f3c94163810 0x7f3c94163c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:42896/0 (socket says 10.20.193.5:42896) 2026-02-17T21:25:36.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.509+0000 7f3c937fe640 1 -- 10.20.193.5:0/1610035653 learned_addr learned my addr 10.20.193.5:0/1610035653 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:36.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.509+0000 7fbd9184f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.509+0000 7fbd9184f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.509+0000 7fbd9184f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.510+0000 7f3c92ffd640 1 --2- 10.20.193.5:0/1610035653 >> v2:10.20.193.5:3300/0 conn(0x7f3c940c7240 0x7f3c940726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.510+0000 7fbd9084d640 1 -- 10.20.193.5:0/3422762480 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1473095050 0 0) 0x7fbd8c156600 con 0x7fbd8c15b290 2026-02-17T21:25:36.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.510+0000 7fbd9084d640 10 monclient(hunting): _negotiate 2026-02-17T21:25:36.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.510+0000 7fbd9084d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.510+0000 7fbd9084d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.510+0000 7fbd9084d640 10 monclient(hunting): my global_id is 4446 2026-02-17T21:25:36.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.510+0000 7fbd9084d640 1 -- 10.20.193.5:0/3422762480 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd74003620 con 0x7fbd8c15b290 2026-02-17T21:25:36.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.510+0000 7fbd9184f640 10 monclient(hunting): handle_auth_done global_id 4477 payload 274 2026-02-17T21:25:36.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.510+0000 7fbd9184f640 1 -- 10.20.193.5:0/3422762480 >> v1:10.20.193.119:6789/0 conn(0x7fbd8c14ed00 legacy=0x7fbd8c0c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.510+0000 7fbd9184f640 1 -- 10.20.193.5:0/3422762480 >> v1:10.20.193.5:6789/0 conn(0x7fbd8c15b290 legacy=0x7fbd8c159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.510+0000 7fbd9184f640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.510+0000 7fbd9184f640 1 monclient: found mon.noname-b 2026-02-17T21:25:36.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.510+0000 7fbd9184f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.510+0000 7fbd9184f640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.510+0000 7fbd9184f640 1 -- 10.20.193.5:0/3422762480 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8c15a1f0 con 0x7fbd8c14e920 2026-02-17T21:25:36.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.510+0000 7fb0e55f5640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.510+0000 7fb0e55f5640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.510+0000 7fb0e55f5640 10 monclient: monmap: 2026-02-17T21:25:36.512 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.512 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.512 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.511573+0000 2026-02-17T21:25:36.512 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.511573+0000 2026-02-17T21:25:36.512 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.512 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.512 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.512 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.512 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.512 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.512 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.512 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.512 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.511+0000 7fb0e55f5640 1 Processor -- start 2026-02-17T21:25:36.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.511+0000 7fb0e55f5640 1 -- start start 2026-02-17T21:25:36.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.511+0000 7fb0e55f5640 10 monclient: init 2026-02-17T21:25:36.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.512+0000 7f3c92ffd640 10 monclient(hunting): get_auth_request con 0x7f3c940c7240 auth_method 0 2026-02-17T21:25:36.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.512+0000 7f3c92ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.512+0000 7f3c92ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.512+0000 7f3c92ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.512+0000 7fb0e55f5640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.514 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.512+0000 7fb0e55f5640 10 monclient: _add_conns ranks=[2,5,0,3,1,4] 2026-02-17T21:25:36.514 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.512+0000 7fb0e55f5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb0e00ce5d0 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:36.514 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.512+0000 7fb0e55f5640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fb0e015bf30 0x7fb0e00ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.514 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.512+0000 7fb0e55f5640 10 monclient(hunting): picked mon.noname-c con 0x7fb0e015bf30 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:36.514 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.512+0000 7fb0e55f5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb0e00ceef0 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:36.514 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.512+0000 7fb0e55f5640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0e00d20d0 con 0x7fb0e00ceef0 2026-02-17T21:25:36.514 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.512+0000 7fb0e55f5640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0e00d23b0 con 0x7fb0e00ce5d0 2026-02-17T21:25:36.514 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.512+0000 7fb0e55f5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.514 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.512+0000 7fb0e55f5640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb0e00d2690 con 0x7fb0e015bf30 2026-02-17T21:25:36.514 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.512+0000 7f3c92ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.514 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.512+0000 7f3c92ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.514 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.512+0000 7f3c92ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.514 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.512+0000 7fb0e55f5640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.514 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.512+0000 7fb0e55f5640 10 monclient(hunting): authenticate will time out at 1042.077676s 2026-02-17T21:25:36.514 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.513+0000 7fb0deffd640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7fb0e00ce5d0 0x7fb0e00d18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:45294/0 (socket says 10.20.193.5:45294) 2026-02-17T21:25:36.514 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.513+0000 7fb0deffd640 1 -- 10.20.193.5:0/3715398910 learned_addr learned my addr 10.20.193.5:0/3715398910 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:36.515 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.513+0000 7fbd9184f640 1 --2- 10.20.193.5:0/3422762480 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbd8c14e920 0x7fbd8c1560c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c0098a0 tx=0x7fbd7c02ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e57c2d8261326b1b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.515 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.513+0000 7f1f06488640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.515 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.513+0000 7f1f06488640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.515 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.513+0000 7f1f06488640 10 monclient: monmap: 2026-02-17T21:25:36.515 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.515 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.515 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.514509+0000 2026-02-17T21:25:36.515 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.514509+0000 2026-02-17T21:25:36.515 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.515 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.515 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.515 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.515 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.515 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.515 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.515 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.515 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7fbd9084d640 1 -- 10.20.193.5:0/3422762480 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c03c070 con 0x7fbd8c14e920 2026-02-17T21:25:36.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7fbd9084d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7fbd9084d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:36.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7fbd9084d640 10 monclient: dump: 2026-02-17T21:25:36.516 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.516 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.516 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.516 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.516 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.516 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.516 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.516 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.516 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.516 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7fbd9084d640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7fbd9084d640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7fbd9084d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7fbd93ada640 5 monclient: authenticate success, global_id 4477 2026-02-17T21:25:36.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7fbd93ada640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:36.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7f1f06488640 1 Processor -- start 2026-02-17T21:25:36.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7f1f06488640 1 -- start start 2026-02-17T21:25:36.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7f1f06488640 10 monclient: init 2026-02-17T21:25:36.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7fb0de7fc640 1 --2- 10.20.193.5:0/3715398910 >> v2:10.20.193.135:3300/0 conn(0x7fb0e015bf30 0x7fb0e00ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7fb0ddffb640 1 -- 10.20.193.5:0/3715398910 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3713295278 0 0) 0x7fb0e00d23b0 con 0x7fb0e00ce5d0 2026-02-17T21:25:36.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7fb0ddffb640 10 monclient(hunting): _negotiate 2026-02-17T21:25:36.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7fb0ddffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7fb0ddffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7fb0ddffb640 10 monclient(hunting): my global_id is 4481 2026-02-17T21:25:36.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7fb0ddffb640 1 -- 10.20.193.5:0/3715398910 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0cc003620 con 0x7fb0e00ce5d0 2026-02-17T21:25:36.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7fbd9084d640 1 -- 10.20.193.5:0/3422762480 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd7c02fc10 con 0x7fbd8c14e920 2026-02-17T21:25:36.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7fbd9084d640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7fbd9084d640 1 -- 10.20.193.5:0/3422762480 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c037440 con 0x7fbd8c14e920 2026-02-17T21:25:36.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7fbd93ada640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7fbd93ada640 4 set_mon_vals no callback set 2026-02-17T21:25:36.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7fb0de7fc640 10 monclient(hunting): get_auth_request con 0x7fb0e015bf30 auth_method 0 2026-02-17T21:25:36.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7fb0de7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7fb0de7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.514+0000 7fb0de7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7f3c92ffd640 10 monclient(hunting): handle_auth_done global_id 4449 payload 274 2026-02-17T21:25:36.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7f3c92ffd640 1 -- 10.20.193.5:0/1610035653 >> v1:10.20.193.119:6789/0 conn(0x7f3c940c7620 legacy=0x7f3c94161710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7f3c92ffd640 1 -- 10.20.193.5:0/1610035653 >> v1:10.20.193.5:6789/0 conn(0x7f3c94163810 legacy=0x7f3c94163c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7f3c92ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7f3c92ffd640 1 monclient: found mon.noname-a 2026-02-17T21:25:36.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7f3c92ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7f3c92ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7f3c92ffd640 1 -- 10.20.193.5:0/1610035653 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c940730a0 con 0x7f3c940c7240 2026-02-17T21:25:36.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7fb0de7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7fb0de7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7fb0de7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7fbd9084d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7fbd9084d640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:36.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7fbd9084d640 10 monclient: dump: 2026-02-17T21:25:36.519 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.519 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.519 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.519 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.519 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.519 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.519 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.519 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.519 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.519 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7f1f06488640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7f1f06488640 10 monclient: _add_conns ranks=[0,1,4,3,5,2] 2026-02-17T21:25:36.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7f1f06488640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1f00150310 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:36.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7f1f06488640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f1f001506f0 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:36.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7f1f06488640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f1f000c5bf0 0x7f1f00164430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7f1f06488640 10 monclient(hunting): picked mon.noname-b con 0x7f1f000c5bf0 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:36.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7f1f06488640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f00159cc0 con 0x7f1f00150310 2026-02-17T21:25:36.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7f1f06488640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f00159fa0 con 0x7f1f001506f0 2026-02-17T21:25:36.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7f1f06488640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7f1f06488640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f1f000c5050 con 0x7f1f000c5bf0 2026-02-17T21:25:36.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7f1f06488640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7f1f06488640 10 monclient(hunting): authenticate will time out at 1042.080402s 2026-02-17T21:25:36.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7fbd93ada640 10 monclient: shutdown 2026-02-17T21:25:36.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7fbd93ada640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7fbd93ada640 1 -- 10.20.193.5:0/3422762480 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbd8c14e920 msgr2=0x7fbd8c1560c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7fbd93ada640 1 --2- 10.20.193.5:0/3422762480 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbd8c14e920 0x7fbd8c1560c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c0098a0 tx=0x7fbd7c02ef00 comp rx=0 tx=0).stop 2026-02-17T21:25:36.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7fbd93ada640 1 -- 10.20.193.5:0/3422762480 shutdown_connections 2026-02-17T21:25:36.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7fbd93ada640 1 --2- 10.20.193.5:0/3422762480 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbd8c14e920 0x7fbd8c1560c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7fbd93ada640 1 -- 10.20.193.5:0/3422762480 >> 10.20.193.5:0/3422762480 conn(0x7fbd8c0c9f40 msgr2=0x7fbd8c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7fbd93ada640 1 -- 10.20.193.5:0/3422762480 shutdown_connections 2026-02-17T21:25:36.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7f3449a85640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7fbd93ada640 1 -- 10.20.193.5:0/3422762480 wait complete. 2026-02-17T21:25:36.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7f3449a85640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.515+0000 7f3449a85640 10 monclient: monmap: 2026-02-17T21:25:36.520 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.520 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.520 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.516355+0000 2026-02-17T21:25:36.520 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.516355+0000 2026-02-17T21:25:36.520 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.520 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.516+0000 7f3449a85640 1 Processor -- start 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.516+0000 7f3449a85640 1 -- start start 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.516+0000 7f3449a85640 10 monclient: init 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.516+0000 7f439dda7640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.516+0000 7f439dda7640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.516+0000 7f439dda7640 10 monclient: monmap: 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.517190+0000 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.517190+0000 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.516+0000 7fbd93ada640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.522 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.516+0000 7fbd93ada640 10 monclient: monmap: 2026-02-17T21:25:36.522 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.522 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.522 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.522 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.522 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.522 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.522 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.522 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.522 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.522 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.522 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.516+0000 7f1f049fe640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f1f000c5bf0 0x7f1f00164430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.522 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.516+0000 7f3449a85640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.522 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.516+0000 7f3449a85640 10 monclient: _add_conns ranks=[0,1,4,5,3,2] 2026-02-17T21:25:36.522 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.516+0000 7f3449a85640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f34440d1b60 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:36.522 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.516+0000 7f3449a85640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f34440d1f40 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:36.522 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.516+0000 7f3449a85640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f344415e060 0x7f344415c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.522 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.516+0000 7f3449a85640 10 monclient(hunting): picked mon.noname-b con 0x7f344415e060 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:36.523 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f439dda7640 1 Processor -- start 2026-02-17T21:25:36.523 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fbd93ada640 1 librados: starting msgr at 2026-02-17T21:25:36.523 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fbd93ada640 1 librados: starting objecter 2026-02-17T21:25:36.523 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f3449a85640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34440c98e0 con 0x7f34440d1b60 2026-02-17T21:25:36.523 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f3449a85640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34440c9bc0 con 0x7f34440d1f40 2026-02-17T21:25:36.523 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f3449a85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.523 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f3449a85640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f344415cd80 con 0x7f344415e060 2026-02-17T21:25:36.523 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f3449a85640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.523 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f3449a85640 10 monclient(hunting): authenticate will time out at 1042.082077s 2026-02-17T21:25:36.523 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fbd93ada640 1 Processor -- start 2026-02-17T21:25:36.523 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f439dda7640 1 -- start start 2026-02-17T21:25:36.523 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f439dda7640 10 monclient: init 2026-02-17T21:25:36.523 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fbd93ada640 1 -- start start 2026-02-17T21:25:36.523 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fbd93ada640 1 librados: setting wanted keys 2026-02-17T21:25:36.523 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fbd93ada640 1 librados: calling monclient init 2026-02-17T21:25:36.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fbd93ada640 10 monclient: init 2026-02-17T21:25:36.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f1eff7fe640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f1f001506f0 0x7f1f00070820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:57730/0 (socket says 10.20.193.5:57730) 2026-02-17T21:25:36.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f1eff7fe640 1 -- 10.20.193.5:0/3404956738 learned_addr learned my addr 10.20.193.5:0/3404956738 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:36.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f1f049fe640 10 monclient(hunting): get_auth_request con 0x7f1f000c5bf0 auth_method 0 2026-02-17T21:25:36.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f1f049fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f1f049fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f1f049fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fbd93ada640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fb0de7fc640 10 monclient(hunting): handle_auth_done global_id 4484 payload 274 2026-02-17T21:25:36.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fb0de7fc640 1 -- 10.20.193.5:0/3715398910 >> v1:10.20.193.135:6789/0 conn(0x7fb0e00ce5d0 legacy=0x7fb0e00d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fb0de7fc640 1 -- 10.20.193.5:0/3715398910 >> v1:10.20.193.5:6789/0 conn(0x7fb0e00ceef0 legacy=0x7fb0e00c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fb0de7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fb0de7fc640 1 monclient: found mon.noname-c 2026-02-17T21:25:36.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fb0de7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fb0de7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fb0de7fc640 1 -- 10.20.193.5:0/3715398910 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e00c8f80 con 0x7fb0e015bf30 2026-02-17T21:25:36.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fbd93ada640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:25:36.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fbd93ada640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbd8c14e920 0x7fbd8c0bb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fbd93ada640 10 monclient(hunting): picked mon.noname-b con 0x7fbd8c14e920 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fbd93ada640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbd8c14ed00 0x7fbd8c13a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fbd93ada640 10 monclient(hunting): picked mon.noname-a con 0x7fbd8c14ed00 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fbd93ada640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbd8c15b290 0x7fbd8c13ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fbd93ada640 10 monclient(hunting): picked mon.noname-c con 0x7fbd8c15b290 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fbd93ada640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fbd93ada640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c15aa90 con 0x7fbd8c14ed00 2026-02-17T21:25:36.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fbd93ada640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fbd93ada640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c15a7b0 con 0x7fbd8c14e920 2026-02-17T21:25:36.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fbd93ada640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fbd93ada640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c15ad70 con 0x7fbd8c15b290 2026-02-17T21:25:36.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fbd93ada640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7fbd93ada640 10 monclient(hunting): authenticate will time out at 1042.082681s 2026-02-17T21:25:36.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f439dda7640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f439dda7640 10 monclient: _add_conns ranks=[2,1,4,5,3,0] 2026-02-17T21:25:36.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f439dda7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f43981527c0 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:36.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f439dda7640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f43980c8cf0 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:36.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f439dda7640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f439815df20 0x7f43980c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f439dda7640 10 monclient(hunting): picked mon.noname-b con 0x7f439815df20 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:36.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f439dda7640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43980c97e0 con 0x7f43980c8cf0 2026-02-17T21:25:36.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f439dda7640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43980c9ac0 con 0x7f43981527c0 2026-02-17T21:25:36.526 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f439dda7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.526 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f439dda7640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f43980ca360 con 0x7f439815df20 2026-02-17T21:25:36.526 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f439dda7640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.526 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f439dda7640 10 monclient(hunting): authenticate will time out at 1042.082875s 2026-02-17T21:25:36.526 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f40e08c9640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.526 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f40e08c9640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.526 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f40e08c9640 10 monclient: monmap: 2026-02-17T21:25:36.526 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.526 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.526 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.518507+0000 2026-02-17T21:25:36.526 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.518507+0000 2026-02-17T21:25:36.526 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.526 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.526 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.526 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.526 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.526 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.526 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.526 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.526 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.526 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f3c92ffd640 1 --2- 10.20.193.5:0/1610035653 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c940c7240 0x7f3c940726d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3c880098a0 tx=0x7f3c8802ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1577fbf09d5f86 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.526 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f1f049fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f1f049fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.517+0000 7f1f049fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.518+0000 7ff9d8771640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.518+0000 7ff9d8771640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.518+0000 7ff9d8771640 10 monclient: monmap: 2026-02-17T21:25:36.527 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.527 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.527 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.518916+0000 2026-02-17T21:25:36.527 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.518916+0000 2026-02-17T21:25:36.527 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.527 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.527 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.527 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.527 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.527 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.527 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.527 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.527 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.518+0000 7fa2db47c640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.518+0000 7fa2db47c640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.518+0000 7fa2db47c640 10 monclient: monmap: 2026-02-17T21:25:36.527 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.527 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.527 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.518955+0000 2026-02-17T21:25:36.528 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.518955+0000 2026-02-17T21:25:36.528 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.528 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.528 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.528 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.528 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.528 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.528 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.528 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.528 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.518+0000 7f40e08c9640 1 Processor -- start 2026-02-17T21:25:36.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.518+0000 7f40e08c9640 1 -- start start 2026-02-17T21:25:36.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.518+0000 7f40e08c9640 10 monclient: init 2026-02-17T21:25:36.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.518+0000 7ff9d8771640 1 Processor -- start 2026-02-17T21:25:36.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.518+0000 7fa2db47c640 1 Processor -- start 2026-02-17T21:25:36.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.518+0000 7f40e08c9640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.518+0000 7f1f049fe640 10 monclient(hunting): handle_auth_done global_id 4486 payload 274 2026-02-17T21:25:36.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7f1f049fe640 1 -- 10.20.193.5:0/3404956738 >> v1:10.20.193.119:6789/0 conn(0x7f1f001506f0 legacy=0x7f1f00070820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7f1f049fe640 1 -- 10.20.193.5:0/3404956738 >> v1:10.20.193.5:6789/0 conn(0x7f1f00150310 legacy=0x7f1f000c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7f1f049fe640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7f1f049fe640 1 monclient: found mon.noname-b 2026-02-17T21:25:36.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7f1f049fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7f1f049fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7f1f049fe640 1 -- 10.20.193.5:0/3404956738 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0015a280 con 0x7f1f000c5bf0 2026-02-17T21:25:36.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.518+0000 7f40e08c9640 10 monclient: _add_conns ranks=[0,5,4,1,2,3] 2026-02-17T21:25:36.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7f40e08c9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f40d80d1b60 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:36.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7f40e08c9640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f40d80d1f40 0x7f40d815c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7f40e08c9640 10 monclient(hunting): picked mon.noname-c con 0x7f40d80d1f40 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:36.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7f40e08c9640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f40d815d950 0x7f40d815dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7f40e08c9640 10 monclient(hunting): picked mon.noname-b con 0x7f40d815d950 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:36.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7f40e08c9640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40d815e2d0 con 0x7f40d80d1b60 2026-02-17T21:25:36.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7f40e08c9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7f40e08c9640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f40d815cd80 con 0x7f40d815d950 2026-02-17T21:25:36.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7f40e08c9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7f40e08c9640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f40d80ca460 con 0x7f40d80d1f40 2026-02-17T21:25:36.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7f40e08c9640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7f40e08c9640 10 monclient(hunting): authenticate will time out at 1042.084101s 2026-02-17T21:25:36.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7fa2db47c640 1 -- start start 2026-02-17T21:25:36.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7fa2db47c640 10 monclient: init 2026-02-17T21:25:36.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7fb0de7fc640 1 --2- 10.20.193.5:0/3715398910 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb0e015bf30 0x7fb0e00ce9b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb0c80098a0 tx=0x7fb0c802ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e57c4f437282318b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.518+0000 7ff9d8771640 1 -- start start 2026-02-17T21:25:36.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.518+0000 7ff9d8771640 10 monclient: init 2026-02-17T21:25:36.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7ff9d8771640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7ff9d8771640 10 monclient: _add_conns ranks=[2,5,3,4,1,0] 2026-02-17T21:25:36.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7ff9d8771640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff9d0152700 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:36.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7ff9d8771640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7ff9d015ef80 0x7ff9d00c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7ff9d8771640 10 monclient(hunting): picked mon.noname-c con 0x7ff9d015ef80 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:36.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7ff9d8771640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7ff9d0152ae0 0x7ff9d00c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7ff9d8771640 10 monclient(hunting): picked mon.noname-a con 0x7ff9d0152ae0 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:36.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7ff9d8771640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9d015d4f0 con 0x7ff9d0152700 2026-02-17T21:25:36.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7ff9d8771640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7ff9d8771640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff9d015d7d0 con 0x7ff9d0152ae0 2026-02-17T21:25:36.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7ff9d8771640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7ff9d8771640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff9d015dab0 con 0x7ff9d015ef80 2026-02-17T21:25:36.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7ff9d8771640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7ff9d8771640 10 monclient(hunting): authenticate will time out at 1042.084561s 2026-02-17T21:25:36.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7fa2db47c640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7fa2db47c640 10 monclient: _add_conns ranks=[1,3,4,5,2,0] 2026-02-17T21:25:36.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7fa2db47c640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fa2d40d1b60 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:36.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7fa2db47c640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fa2d40d1f40 0x7fa2d40c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7fa2db47c640 10 monclient(hunting): picked mon.noname-a con 0x7fa2d40d1f40 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:36.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7fa2db47c640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fa2d40ca100 0x7fa2d4160350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7fa2db47c640 10 monclient(hunting): picked mon.noname-b con 0x7fa2d40ca100 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:36.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7fa2db47c640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2d4160ed0 con 0x7fa2d40d1b60 2026-02-17T21:25:36.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7fa2db47c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7fa2db47c640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa2d40cc2e0 con 0x7fa2d40d1f40 2026-02-17T21:25:36.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7fa2db47c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7fa2db47c640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fa2d40c9730 con 0x7fa2d40ca100 2026-02-17T21:25:36.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7fa2db47c640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7fa2db47c640 10 monclient(hunting): authenticate will time out at 1042.084727s 2026-02-17T21:25:36.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.519+0000 7f40dee3f640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f40d815d950 0x7f40d815dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.520+0000 7f40dde3d640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f40d80d1f40 0x7f40d815c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.520+0000 7f40dee3f640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f40d815d950 0x7f40d815dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:37868/0 (socket says 10.20.193.5:37868) 2026-02-17T21:25:36.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.520+0000 7f40dee3f640 1 -- 10.20.193.5:0/1340277578 learned_addr learned my addr 10.20.193.5:0/1340277578 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.520+0000 7f40dee3f640 10 monclient(hunting): get_auth_request con 0x7f40d815d950 auth_method 0 2026-02-17T21:25:36.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.520+0000 7f1f049fe640 1 --2- 10.20.193.5:0/3404956738 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1f000c5bf0 0x7f1f00164430 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4009d90 tx=0x7f1ef402f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3c6e43d9e4d2e0e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.520+0000 7f40dee3f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.520+0000 7f40dee3f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.520+0000 7f40dee3f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.520+0000 7fe173596640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.520+0000 7fe173596640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.520+0000 7fe173596640 10 monclient: monmap: 2026-02-17T21:25:36.532 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.532 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.532 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.521614+0000 2026-02-17T21:25:36.532 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.521614+0000 2026-02-17T21:25:36.532 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.532 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.532 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.532 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.532 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.532 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.532 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.532 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.532 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7f40dee3f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7f40dee3f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7f40dee3f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7fe173596640 1 Processor -- start 2026-02-17T21:25:36.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7fe173596640 1 -- start start 2026-02-17T21:25:36.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7f40dde3d640 10 monclient(hunting): get_auth_request con 0x7f40d80d1f40 auth_method 0 2026-02-17T21:25:36.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7f40dde3d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7f40dde3d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7f40dde3d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7fe173596640 10 monclient: init 2026-02-17T21:25:36.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7f34437fe640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f344415e060 0x7f344415c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7fb0ddffb640 1 -- 10.20.193.5:0/3715398910 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c803c070 con 0x7fb0e015bf30 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7fb0ddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7fb0ddffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7fb0ddffb640 10 monclient: dump: 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7fb0ddffb640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7fb0ddffb640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7fb0ddffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7fb0ddffb640 1 -- 10.20.193.5:0/3715398910 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0c802fad0 con 0x7fb0e015bf30 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7fb0ddffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7fb0ddffb640 1 -- 10.20.193.5:0/3715398910 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8037440 con 0x7fb0e015bf30 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7fb0ddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7fb0ddffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7fb0ddffb640 10 monclient: dump: 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7fb0e55f5640 5 monclient: authenticate success, global_id 4484 2026-02-17T21:25:36.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7fb0e55f5640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7fb0e55f5640 4 set_mon_vals no callback set 2026-02-17T21:25:36.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7fa777ef1640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7fa777ef1640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7fa777ef1640 10 monclient: monmap: 2026-02-17T21:25:36.535 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.535 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.535 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.522569+0000 2026-02-17T21:25:36.535 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.522569+0000 2026-02-17T21:25:36.535 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.535 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.535 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.535 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.535 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.535 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.535 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.535 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.535 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7fab3deda640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7fab3deda640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.521+0000 7fab3deda640 10 monclient: monmap: 2026-02-17T21:25:36.535 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.535 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.535 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.522626+0000 2026-02-17T21:25:36.535 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.522626+0000 2026-02-17T21:25:36.536 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.536 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.536 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.536 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.536 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.536 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.536 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.536 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.536 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7f40dde3d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7f40dde3d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7f40dde3d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fe173596640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fe173596640 10 monclient: _add_conns ranks=[0,4,2,5,1,3] 2026-02-17T21:25:36.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fe173596640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe16c0d1b60 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:36.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fbd92050640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbd8c15b290 0x7fbd8c13ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fe173596640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fe16c0d1f40 0x7fe16c15c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fe173596640 10 monclient(hunting): picked mon.noname-b con 0x7fe16c0d1f40 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:36.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fe173596640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe16c15d950 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:36.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7f43977fe640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f43981527c0 0x7f43980d2250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:45308/0 (socket says 10.20.193.5:45308) 2026-02-17T21:25:36.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7f43977fe640 1 -- 10.20.193.5:0/4143288740 learned_addr learned my addr 10.20.193.5:0/4143288740 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:36.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fe173596640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe16c0c98e0 con 0x7fe16c0d1b60 2026-02-17T21:25:36.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7f40dee3f640 10 monclient(hunting): handle_auth_done global_id 4489 payload 274 2026-02-17T21:25:36.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7f40dee3f640 1 -- 10.20.193.5:0/1340277578 >> v2:10.20.193.135:3300/0 conn(0x7f40d80d1f40 msgr2=0x7f40d815c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7f40dee3f640 1 --2- 10.20.193.5:0/1340277578 >> v2:10.20.193.135:3300/0 conn(0x7f40d80d1f40 0x7f40d815c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7f40dee3f640 1 -- 10.20.193.5:0/1340277578 >> v1:10.20.193.5:6789/0 conn(0x7f40d80d1b60 legacy=0x7f40d80c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7f40dee3f640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fe173596640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe16c0c9bc0 con 0x7fe16c15d950 2026-02-17T21:25:36.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7f40dee3f640 1 monclient: found mon.noname-b 2026-02-17T21:25:36.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7f40dee3f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7f40dee3f640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7f40dee3f640 1 -- 10.20.193.5:0/1340277578 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d80c98e0 con 0x7f40d815d950 2026-02-17T21:25:36.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fe173596640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fb0e55f5640 10 monclient: shutdown 2026-02-17T21:25:36.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fb0e55f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fe173596640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fe16c15cd80 con 0x7fe16c0d1f40 2026-02-17T21:25:36.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fe173596640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fb0e55f5640 1 -- 10.20.193.5:0/3715398910 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb0e015bf30 msgr2=0x7fb0e00ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fb0e55f5640 1 --2- 10.20.193.5:0/3715398910 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb0e015bf30 0x7fb0e00ce9b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb0c80098a0 tx=0x7fb0c802ee10 comp rx=0 tx=0).stop 2026-02-17T21:25:36.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fe173596640 10 monclient(hunting): authenticate will time out at 1042.087390s 2026-02-17T21:25:36.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fa777ef1640 1 Processor -- start 2026-02-17T21:25:36.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7ff9d6ce7640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7ff9d0152ae0 0x7ff9d00c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fab3deda640 1 Processor -- start 2026-02-17T21:25:36.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7ff9d6ce7640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7ff9d0152ae0 0x7ff9d00c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:50220/0 (socket says 10.20.193.5:50220) 2026-02-17T21:25:36.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7ff9d6ce7640 1 -- 10.20.193.5:0/1578963609 learned_addr learned my addr 10.20.193.5:0/1578963609 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7ff9d6ce7640 10 monclient(hunting): get_auth_request con 0x7ff9d0152ae0 auth_method 0 2026-02-17T21:25:36.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7ff9d6ce7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7ff9d6ce7640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7ff9d6ce7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fa777ef1640 1 -- start start 2026-02-17T21:25:36.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fa777ef1640 10 monclient: init 2026-02-17T21:25:36.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fab3deda640 1 -- start start 2026-02-17T21:25:36.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fab3deda640 10 monclient: init 2026-02-17T21:25:36.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fab3deda640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fab3deda640 10 monclient: _add_conns ranks=[0,1,5,3,2,4] 2026-02-17T21:25:36.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.522+0000 7fab3deda640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fab381527c0 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:36.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fa777ef1640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fa777ef1640 10 monclient: _add_conns ranks=[4,5,1,3,2,0] 2026-02-17T21:25:36.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fa777ef1640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fa770152700 0x7fa77015e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fa777ef1640 10 monclient(hunting): picked mon.noname-b con 0x7fa770152700 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:36.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fa777ef1640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fa770152ae0 0x7fa77015edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fa777ef1640 10 monclient(hunting): picked mon.noname-c con 0x7fa770152ae0 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:36.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fa777ef1640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fa7700c9730 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:36.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fab3deda640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fab380c8cf0 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:36.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fab3deda640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fab3815df20 0x7fab380c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fab3deda640 10 monclient(hunting): picked mon.noname-c con 0x7fab3815df20 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:36.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fab3deda640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab380c97e0 con 0x7fab381527c0 2026-02-17T21:25:36.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fab3deda640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab380c9ac0 con 0x7fab380c8cf0 2026-02-17T21:25:36.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fa777ef1640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa77015d4f0 con 0x7fa7700c9730 2026-02-17T21:25:36.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fa777ef1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fa777ef1640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fa77015d7d0 con 0x7fa770152700 2026-02-17T21:25:36.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fa777ef1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fab3deda640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fab3deda640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fab380ca360 con 0x7fab3815df20 2026-02-17T21:25:36.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fab3deda640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fab3deda640 10 monclient(hunting): authenticate will time out at 1042.088113s 2026-02-17T21:25:36.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fa777ef1640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa77015dab0 con 0x7fa770152ae0 2026-02-17T21:25:36.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fa777ef1640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fa777ef1640 10 monclient(hunting): authenticate will time out at 1042.088113s 2026-02-17T21:25:36.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fbd92050640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbd8c15b290 0x7fbd8c13ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:47848/0 (socket says 10.20.193.5:47848) 2026-02-17T21:25:36.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fbd92050640 1 -- 10.20.193.5:0/2021679235 learned_addr learned my addr 10.20.193.5:0/2021679235 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fbd92050640 10 monclient(hunting): get_auth_request con 0x7fbd8c15b290 auth_method 0 2026-02-17T21:25:36.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fbd92050640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fbd92050640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fbd92050640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7ff9d6ce7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7ff9d6ce7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7ff9d6ce7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7f4397fff640 1 --2- 10.20.193.5:0/4143288740 >> v2:10.20.193.119:3300/0 conn(0x7f439815df20 0x7f43980c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fb0e55f5640 1 -- 10.20.193.5:0/3715398910 shutdown_connections 2026-02-17T21:25:36.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fb0e55f5640 1 --2- 10.20.193.5:0/3715398910 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb0e015bf30 0x7fb0e00ce9b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fb0e55f5640 1 -- 10.20.193.5:0/3715398910 >> 10.20.193.5:0/3715398910 conn(0x7fb0e0073030 msgr2=0x7fb0e0073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7f34437fe640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f344415e060 0x7f344415c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:37860/0 (socket says 10.20.193.5:37860) 2026-02-17T21:25:36.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7f34437fe640 1 -- 10.20.193.5:0/4229194437 learned_addr learned my addr 10.20.193.5:0/4229194437 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7f34437fe640 10 monclient(hunting): get_auth_request con 0x7f344415e060 auth_method 0 2026-02-17T21:25:36.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fb0e55f5640 1 -- 10.20.193.5:0/3715398910 shutdown_connections 2026-02-17T21:25:36.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7f34437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7f34437fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7f34437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7fb0e55f5640 1 -- 10.20.193.5:0/3715398910 wait complete. 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7f940d901640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7f940d901640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7f940d901640 10 monclient: monmap: 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.524517+0000 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.524517+0000 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7f4397fff640 10 monclient(hunting): get_auth_request con 0x7f439815df20 auth_method 0 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7f4397fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7f4397fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.523+0000 7f4397fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7fb0e55f5640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7fb0e55f5640 10 monclient: monmap: 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.542 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.543 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.543 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.543 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.543 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.543 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.543 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7f940d901640 1 Processor -- start 2026-02-17T21:25:36.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7fbd92050640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7fbd92050640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7fbd92050640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7f940d901640 1 -- start start 2026-02-17T21:25:36.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7f940d901640 10 monclient: init 2026-02-17T21:25:36.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7fb0e55f5640 1 librados: starting msgr at 2026-02-17T21:25:36.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7fb0e55f5640 1 librados: starting objecter 2026-02-17T21:25:36.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7fb0e55f5640 1 Processor -- start 2026-02-17T21:25:36.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7f34437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7f34437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7f34437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7ff9d6ce7640 10 monclient(hunting): handle_auth_done global_id 4455 payload 274 2026-02-17T21:25:36.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7ff9d6ce7640 1 -- 10.20.193.5:0/1578963609 >> v2:10.20.193.135:3300/0 conn(0x7ff9d015ef80 msgr2=0x7ff9d00c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7ff9d6ce7640 1 --2- 10.20.193.5:0/1578963609 >> v2:10.20.193.135:3300/0 conn(0x7ff9d015ef80 0x7ff9d00c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7ff9d6ce7640 1 -- 10.20.193.5:0/1578963609 >> v1:10.20.193.135:6789/0 conn(0x7ff9d0152700 legacy=0x7ff9d015e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7ff9d6ce7640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7ff9d6ce7640 1 monclient: found mon.noname-a 2026-02-17T21:25:36.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7ff9d6ce7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7ff9d6ce7640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7ff9d6ce7640 1 -- 10.20.193.5:0/1578963609 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d015dd90 con 0x7ff9d0152ae0 2026-02-17T21:25:36.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7fb0e55f5640 1 -- start start 2026-02-17T21:25:36.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7fb0e55f5640 1 librados: setting wanted keys 2026-02-17T21:25:36.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7fb0e55f5640 1 librados: calling monclient init 2026-02-17T21:25:36.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7fb0e55f5640 10 monclient: init 2026-02-17T21:25:36.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7f4397fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7f4397fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7f4397fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7f40dee3f640 1 --2- 10.20.193.5:0/1340277578 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f40d815d950 0x7f40d815dd90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f40d808fc80 tx=0x7f40cc02f280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44a929f96961da00 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.524+0000 7f3c91ffb640 1 -- 10.20.193.5:0/1610035653 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c8803c070 con 0x7f3c940c7240 2026-02-17T21:25:36.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f3c91ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f3c91ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:36.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f3c91ffb640 10 monclient: dump: 2026-02-17T21:25:36.544 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f3c91ffb640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f3c91ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f3c91ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f3c91ffb640 1 -- 10.20.193.5:0/1610035653 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c8802fb80 con 0x7f3c940c7240 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f940d901640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f3c91ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f3c91ffb640 1 -- 10.20.193.5:0/1610035653 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c88037440 con 0x7f3c940c7240 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f3c91ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f3c91ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f3c91ffb640 10 monclient: dump: 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f940d901640 10 monclient: _add_conns ranks=[3,5,1,2,0,4] 2026-02-17T21:25:36.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f3c99596640 5 monclient: authenticate success, global_id 4449 2026-02-17T21:25:36.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f3c99596640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f3c99596640 4 set_mon_vals no callback set 2026-02-17T21:25:36.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f940d901640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f94080ce5d0 0x7f94080d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f940d901640 10 monclient(hunting): picked mon.noname-a con 0x7f94080ce5d0 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:36.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fb0e55f5640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f940d901640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f940815bf30 0x7f94080ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f940d901640 10 monclient(hunting): picked mon.noname-c con 0x7f940815bf30 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:36.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f940d901640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f94080ceef0 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:36.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fb0e55f5640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:25:36.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f940d901640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94080d1e00 con 0x7f94080ceef0 2026-02-17T21:25:36.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f940d901640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f940d901640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f94080d20d0 con 0x7f94080ce5d0 2026-02-17T21:25:36.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f940d901640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fb0e55f5640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb0e00ce5d0 0x7fb0e00ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fb0e55f5640 10 monclient(hunting): picked mon.noname-a con 0x7fb0e00ce5d0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f940d901640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f94080d23b0 con 0x7f940815bf30 2026-02-17T21:25:36.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f940d901640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f940d901640 10 monclient(hunting): authenticate will time out at 1042.090096s 2026-02-17T21:25:36.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fb0e55f5640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb0e00ceef0 0x7fb0e01f4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fb0e55f5640 10 monclient(hunting): picked mon.noname-c con 0x7fb0e00ceef0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fb0e55f5640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb0e015bf30 0x7fb0e01f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fb0e55f5640 10 monclient(hunting): picked mon.noname-b con 0x7fb0e015bf30 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fb0e55f5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fb0e55f5640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e00cbc30 con 0x7fb0e00ce5d0 2026-02-17T21:25:36.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fb0e55f5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fb0e55f5640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e00c9e90 con 0x7fb0e015bf30 2026-02-17T21:25:36.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fb0e55f5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fb0e55f5640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e00d0c20 con 0x7fb0e00ceef0 2026-02-17T21:25:36.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fb0e55f5640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fb0e55f5640 10 monclient(hunting): authenticate will time out at 1042.090123s 2026-02-17T21:25:36.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fa2d89f0640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fa2d40d1f40 0x7fa2d40c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f3c99596640 10 monclient: shutdown 2026-02-17T21:25:36.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f3c99596640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f3c99596640 1 -- 10.20.193.5:0/1610035653 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c940c7240 msgr2=0x7f3c940726d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f3c99596640 1 --2- 10.20.193.5:0/1610035653 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c940c7240 0x7f3c940726d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3c880098a0 tx=0x7f3c8802ee70 comp rx=0 tx=0).stop 2026-02-17T21:25:36.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f34437fe640 10 monclient(hunting): handle_auth_done global_id 4492 payload 274 2026-02-17T21:25:36.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f34437fe640 1 -- 10.20.193.5:0/4229194437 >> v1:10.20.193.119:6789/0 conn(0x7f34440d1f40 legacy=0x7f344415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f34437fe640 1 -- 10.20.193.5:0/4229194437 >> v1:10.20.193.5:6789/0 conn(0x7f34440d1b60 legacy=0x7f34440c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f34437fe640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f34437fe640 1 monclient: found mon.noname-b 2026-02-17T21:25:36.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f34437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f34437fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f34437fe640 1 -- 10.20.193.5:0/4229194437 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34440c9ea0 con 0x7f344415e060 2026-02-17T21:25:36.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f3c99596640 1 -- 10.20.193.5:0/1610035653 shutdown_connections 2026-02-17T21:25:36.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f3c99596640 1 --2- 10.20.193.5:0/1610035653 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c940c7240 0x7f3c940726d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f3c99596640 1 -- 10.20.193.5:0/1610035653 >> 10.20.193.5:0/1610035653 conn(0x7f3c940c9f40 msgr2=0x7f3c940ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f3c99596640 1 -- 10.20.193.5:0/1610035653 shutdown_connections 2026-02-17T21:25:36.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7f3c99596640 1 -- 10.20.193.5:0/1610035653 wait complete. 2026-02-17T21:25:36.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fa2d89f0640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fa2d40d1f40 0x7fa2d40c9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:50232/0 (socket says 10.20.193.5:50232) 2026-02-17T21:25:36.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fa2d89f0640 1 -- 10.20.193.5:0/715595769 learned_addr learned my addr 10.20.193.5:0/715595769 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fa2d89f0640 10 monclient(hunting): get_auth_request con 0x7fa2d40d1f40 auth_method 0 2026-02-17T21:25:36.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fa2d89f0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fa2d89f0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fa2d89f0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fbd92050640 10 monclient(hunting): handle_auth_done global_id 4490 payload 824 2026-02-17T21:25:36.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fbd92050640 1 -- 10.20.193.5:0/2021679235 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbd8c14e920 msgr2=0x7fbd8c0bb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fbd92050640 1 --2- 10.20.193.5:0/2021679235 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbd8c14e920 0x7fbd8c0bb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fbd92050640 1 -- 10.20.193.5:0/2021679235 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbd8c14ed00 msgr2=0x7fbd8c13a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fbd92050640 1 --2- 10.20.193.5:0/2021679235 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbd8c14ed00 0x7fbd8c13a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fbd92050640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fbd92050640 1 monclient: found mon.noname-c 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fbd92050640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fbd92050640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.525+0000 7fbd92050640 1 -- 10.20.193.5:0/2021679235 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8c143ac0 con 0x7fbd8c15b290 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7ff9d6ce7640 1 --2- 10.20.193.5:0/1578963609 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff9d0152ae0 0x7ff9d00c9c70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff9d008e820 tx=0x7ff9cc02f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1454e75954cafd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f3c99596640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f3c99596640 10 monclient: monmap: 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f3c99596640 1 librados: starting msgr at 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f3c99596640 1 librados: starting objecter 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f3c99596640 1 Processor -- start 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f3c99596640 1 -- start start 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f3c99596640 1 librados: setting wanted keys 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f3c99596640 1 librados: calling monclient init 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f3c99596640 10 monclient: init 2026-02-17T21:25:36.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7fa2d89f0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7fa2d89f0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7fa2d89f0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f4397fff640 10 monclient(hunting): handle_auth_done global_id 4495 payload 274 2026-02-17T21:25:36.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f4397fff640 1 -- 10.20.193.5:0/4143288740 >> v1:10.20.193.135:6789/0 conn(0x7f43981527c0 legacy=0x7f43980d2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f4397fff640 1 -- 10.20.193.5:0/4143288740 >> v1:10.20.193.119:6789/0 conn(0x7f43980c8cf0 legacy=0x7f439815d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f4397fff640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f4397fff640 1 monclient: found mon.noname-b 2026-02-17T21:25:36.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f4397fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f4397fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f4397fff640 1 -- 10.20.193.5:0/4143288740 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43980c9da0 con 0x7f439815df20 2026-02-17T21:25:36.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f3c99596640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f3c99596640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:25:36.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f3c99596640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c940c7240 0x7f3c9414c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f3c99596640 10 monclient(hunting): picked mon.noname-b con 0x7f3c940c7240 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f3c99596640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3c940c7620 0x7f3c941f6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f3c99596640 10 monclient(hunting): picked mon.noname-c con 0x7f3c940c7620 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f3c99596640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c94163810 0x7f3c941f6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f3c99596640 10 monclient(hunting): picked mon.noname-a con 0x7f3c94163810 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f3c99596640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f3c99596640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3c94073940 con 0x7f3c94163810 2026-02-17T21:25:36.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f3c99596640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f3c99596640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3c94073660 con 0x7f3c940c7240 2026-02-17T21:25:36.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f3c99596640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f3c99596640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3c94073c20 con 0x7f3c940c7620 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f3c99596640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7f3c99596640 10 monclient(hunting): authenticate will time out at 1042.091968s 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7fabab348640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7fabab348640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.526+0000 7fabab348640 10 monclient: monmap: 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.527636+0000 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.527636+0000 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.527+0000 7fabab348640 1 Processor -- start 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.527+0000 7fabab348640 1 -- start start 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.527+0000 7fabab348640 10 monclient: init 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.528+0000 7fabab348640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.528+0000 7fabab348640 10 monclient: _add_conns ranks=[5,1,0,2,3,4] 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.528+0000 7fabab348640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7faba40d1b60 0x7faba40d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.528+0000 7fabab348640 10 monclient(hunting): picked mon.noname-c con 0x7faba40d1b60 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.528+0000 7fabab348640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7faba415c840 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:36.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.528+0000 7fabab348640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7faba415d950 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:36.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.528+0000 7fabab348640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faba40c98e0 con 0x7faba415d950 2026-02-17T21:25:36.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.528+0000 7fabab348640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faba40c9bc0 con 0x7faba415c840 2026-02-17T21:25:36.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.528+0000 7fabab348640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.528+0000 7fabab348640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7faba40ca460 con 0x7faba40d1b60 2026-02-17T21:25:36.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.528+0000 7fabab348640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.528+0000 7fabab348640 10 monclient(hunting): authenticate will time out at 1042.093098s 2026-02-17T21:25:36.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.528+0000 7fbd92050640 1 --2- 10.20.193.5:0/2021679235 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbd8c15b290 0x7fbd8c13ad20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbd8800cbd0 tx=0x7fbd8800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.528+0000 7fbd7a7fc640 10 client.?.objecter ms_handle_connect 0x7fbd8c15b290 2026-02-17T21:25:36.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.528+0000 7fbd7a7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.528+0000 7f34437fe640 1 --2- 10.20.193.5:0/4229194437 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f344415e060 0x7f344415c840 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3434009e50 tx=0x7f343402f2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8b01d85620799e8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.528+0000 7fa2d89f0640 10 monclient(hunting): handle_auth_done global_id 4458 payload 274 2026-02-17T21:25:36.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.528+0000 7fa2d89f0640 1 -- 10.20.193.5:0/715595769 >> v2:10.20.193.119:3300/0 conn(0x7fa2d40ca100 msgr2=0x7fa2d4160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.528+0000 7fa2d89f0640 1 --2- 10.20.193.5:0/715595769 >> v2:10.20.193.119:3300/0 conn(0x7fa2d40ca100 0x7fa2d4160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.528+0000 7fa2d89f0640 1 -- 10.20.193.5:0/715595769 >> v1:10.20.193.119:6789/0 conn(0x7fa2d40d1b60 legacy=0x7fa2d41642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.528+0000 7fa2d89f0640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.528+0000 7fa2d89f0640 1 monclient: found mon.noname-a 2026-02-17T21:25:36.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.528+0000 7fa2d89f0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.528+0000 7fa2d89f0640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.528+0000 7fa2d89f0640 1 -- 10.20.193.5:0/715595769 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d40c8e00 con 0x7fa2d40d1f40 2026-02-17T21:25:36.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.529+0000 7f4397fff640 1 --2- 10.20.193.5:0/4143288740 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f439815df20 0x7f43980c9180 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f438c009d90 tx=0x7f438c02f190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4058e35c16437fe server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.529+0000 7feaf9f2c640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.529+0000 7feaf9f2c640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.529+0000 7feaf9f2c640 10 monclient: monmap: 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.530233+0000 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.530233+0000 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.530+0000 7feaf9f2c640 1 Processor -- start 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.530+0000 7feaf9f2c640 1 -- start start 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.530+0000 7feaf9f2c640 10 monclient: init 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.530+0000 7f0ac688f640 10 monclient: get_monmap_and_config 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.530+0000 7f0ac688f640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.530+0000 7f0ac688f640 10 monclient: monmap: 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:36.530900+0000 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:36.530900+0000 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:36.553 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.530+0000 7fe17130b640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7fe16c0d1b60 0x7fe16c0c8d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:42928/0 (socket says 10.20.193.5:42928) 2026-02-17T21:25:36.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.530+0000 7fe17130b640 1 -- 10.20.193.5:0/4133187899 learned_addr learned my addr 10.20.193.5:0/4133187899 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:36.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.530+0000 7fb0deffd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb0e00ce5d0 0x7fb0e00ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.530+0000 7feaf9f2c640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.530+0000 7feaf9f2c640 10 monclient: _add_conns ranks=[0,5,1,4,2,3] 2026-02-17T21:25:36.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.530+0000 7feaf9f2c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7feaf40d1b60 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:36.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.530+0000 7feaf9f2c640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7feaf40d1f40 0x7feaf415c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.530+0000 7feaf9f2c640 10 monclient(hunting): picked mon.noname-c con 0x7feaf40d1f40 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:36.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.530+0000 7feaf9f2c640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7feaf415d950 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:36.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.530+0000 7f0ac688f640 1 Processor -- start 2026-02-17T21:25:36.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.530+0000 7feaf9f2c640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaf40c98e0 con 0x7feaf40d1b60 2026-02-17T21:25:36.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.530+0000 7feaf9f2c640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaf40c9bc0 con 0x7feaf415d950 2026-02-17T21:25:36.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.530+0000 7feaf9f2c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.530+0000 7feaf9f2c640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7feaf415cd80 con 0x7feaf40d1f40 2026-02-17T21:25:36.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.530+0000 7f0ac688f640 1 -- start start 2026-02-17T21:25:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.530+0000 7f0ac688f640 10 monclient: init 2026-02-17T21:25:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.530+0000 7feaf9f2c640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.530+0000 7feaf9f2c640 10 monclient(hunting): authenticate will time out at 1042.095882s 2026-02-17T21:25:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.530+0000 7fa775465640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fa770152ae0 0x7fa77015edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fb0deffd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb0e00ce5d0 0x7fb0e00ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:50260/0 (socket says 10.20.193.5:50260) 2026-02-17T21:25:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fb0deffd640 1 -- 10.20.193.5:0/2971988754 learned_addr learned my addr 10.20.193.5:0/2971988754 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fb0deffd640 10 monclient(hunting): get_auth_request con 0x7fb0e00ce5d0 auth_method 0 2026-02-17T21:25:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fb0deffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fb0deffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fb0deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fa775465640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fa770152ae0 0x7fa77015edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:47878/0 (socket says 10.20.193.5:47878) 2026-02-17T21:25:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fa775465640 1 -- 10.20.193.5:0/2785207424 learned_addr learned my addr 10.20.193.5:0/2785207424 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fa775465640 10 monclient(hunting): get_auth_request con 0x7fa770152ae0 auth_method 0 2026-02-17T21:25:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fa775465640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fa775465640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fa775465640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fab37fff640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fab3815df20 0x7fab380c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7f0ac688f640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7f0ac688f640 10 monclient: _add_conns ranks=[2,3,1,4,5,0] 2026-02-17T21:25:36.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fb0deffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fb0deffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fb0deffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7f0ac688f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0ac015a380 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:36.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7f0ac688f640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f0ac015a760 0x7f0ac0160d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7f0ac688f640 10 monclient(hunting): picked mon.noname-a con 0x7f0ac015a760 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:36.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7f0ac688f640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f0ac0162dc0 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:36.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7f0ac688f640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ac006f180 con 0x7f0ac0162dc0 2026-02-17T21:25:36.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7f0ac688f640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ac01618f0 con 0x7f0ac015a380 2026-02-17T21:25:36.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7f0ac688f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7f0ac688f640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0ac0161290 con 0x7f0ac015a760 2026-02-17T21:25:36.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7f0ac688f640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7f0ac688f640 10 monclient(hunting): authenticate will time out at 1042.096459s 2026-02-17T21:25:36.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fa775465640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fa775465640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fa775465640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fa2d89f0640 1 --2- 10.20.193.5:0/715595769 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa2d40d1f40 0x7fa2d40c9bc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40c8c30 tx=0x7fa2c802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba732dbcd5d0ead server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fab37fff640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fab3815df20 0x7fab380c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:47870/0 (socket says 10.20.193.5:47870) 2026-02-17T21:25:36.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fab37fff640 1 -- 10.20.193.5:0/1421171529 learned_addr learned my addr 10.20.193.5:0/1421171529 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fab37fff640 10 monclient(hunting): get_auth_request con 0x7fab3815df20 auth_method 0 2026-02-17T21:25:36.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fab37fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fab37fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.531+0000 7fab37fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f9406ffd640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f94080ce5d0 0x7f94080d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f1efeffd640 1 -- 10.20.193.5:0/3404956738 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef403c070 con 0x7f1f000c5bf0 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f1efeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f1efeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f1efeffd640 10 monclient: dump: 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f1efeffd640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f1efeffd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f1efeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f1efeffd640 1 -- 10.20.193.5:0/3404956738 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef4037440 con 0x7f1f000c5bf0 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f1efeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f1efeffd640 1 -- 10.20.193.5:0/3404956738 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4037810 con 0x7f1f000c5bf0 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f1efeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f1efeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f1efeffd640 10 monclient: dump: 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7fa775465640 10 monclient(hunting): handle_auth_done global_id 4496 payload 274 2026-02-17T21:25:36.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7fa775465640 1 -- 10.20.193.5:0/2785207424 >> v2:10.20.193.119:3300/0 conn(0x7fa770152700 msgr2=0x7fa77015e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7fa775465640 1 --2- 10.20.193.5:0/2785207424 >> v2:10.20.193.119:3300/0 conn(0x7fa770152700 0x7fa77015e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7fa775465640 1 -- 10.20.193.5:0/2785207424 >> v1:10.20.193.119:6789/0 conn(0x7fa7700c9730 legacy=0x7fa7700c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7fa775465640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7fa775465640 1 monclient: found mon.noname-c 2026-02-17T21:25:36.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7fa775465640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7fa775465640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7fa775465640 1 -- 10.20.193.5:0/2785207424 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa77015dd90 con 0x7fa770152ae0 2026-02-17T21:25:36.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f1f06488640 5 monclient: authenticate success, global_id 4486 2026-02-17T21:25:36.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f1f06488640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f1f06488640 4 set_mon_vals no callback set 2026-02-17T21:25:36.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f1f06488640 10 monclient: shutdown 2026-02-17T21:25:36.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f1f06488640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f1f06488640 1 -- 10.20.193.5:0/3404956738 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1f000c5bf0 msgr2=0x7f1f00164430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f1f06488640 1 --2- 10.20.193.5:0/3404956738 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1f000c5bf0 0x7f1f00164430 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4009d90 tx=0x7f1ef402f1e0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7fab37fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7fab37fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7fab37fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f1f06488640 1 -- 10.20.193.5:0/3404956738 shutdown_connections 2026-02-17T21:25:36.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f1f06488640 1 --2- 10.20.193.5:0/3404956738 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1f000c5bf0 0x7f1f00164430 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f1f06488640 1 -- 10.20.193.5:0/3404956738 >> 10.20.193.5:0/3404956738 conn(0x7f1f000ce070 msgr2=0x7f1f000ce480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f1f06488640 1 -- 10.20.193.5:0/3404956738 shutdown_connections 2026-02-17T21:25:36.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.532+0000 7f1f06488640 1 -- 10.20.193.5:0/3404956738 wait complete. 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7fb0deffd640 10 monclient(hunting): handle_auth_done global_id 4461 payload 824 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7fb0deffd640 1 -- 10.20.193.5:0/2971988754 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb0e00ceef0 msgr2=0x7fb0e01f4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7fb0deffd640 1 --2- 10.20.193.5:0/2971988754 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb0e00ceef0 0x7fb0e01f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7fb0deffd640 1 -- 10.20.193.5:0/2971988754 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb0e015bf30 msgr2=0x7fb0e01f4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7fb0deffd640 1 --2- 10.20.193.5:0/2971988754 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb0e015bf30 0x7fb0e01f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7fb0deffd640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7fb0deffd640 1 monclient: found mon.noname-a 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7fb0deffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7fb0deffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7fb0deffd640 1 -- 10.20.193.5:0/2971988754 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e01f3460 con 0x7fb0e00ce5d0 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f43967fc640 1 -- 10.20.193.5:0/4143288740 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438c03c070 con 0x7f439815df20 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f1f06488640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f1f06488640 10 monclient: monmap: 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f43967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f43967fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f40dd63c640 1 -- 10.20.193.5:0/1340277578 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40cc02fce0 con 0x7f40d815d950 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f40dd63c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f40dd63c640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f40dd63c640 10 monclient: dump: 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f40dd63c640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f40dd63c640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f40dd63c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f40dd63c640 1 -- 10.20.193.5:0/1340277578 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40cc0373f0 con 0x7f40d815d950 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f40dd63c640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f40dd63c640 1 -- 10.20.193.5:0/1340277578 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40cc0377c0 con 0x7f40d815d950 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f40dd63c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f40dd63c640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f40dd63c640 10 monclient: dump: 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f1f06488640 1 librados: starting msgr at 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f1f06488640 1 librados: starting objecter 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f1f06488640 1 Processor -- start 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f43967fc640 10 monclient: dump: 2026-02-17T21:25:36.560 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f43967fc640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f43967fc640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f40e08c9640 5 monclient: authenticate success, global_id 4489 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f40e08c9640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f40e08c9640 4 set_mon_vals no callback set 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f43967fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f1f06488640 1 -- start start 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f1f06488640 1 librados: setting wanted keys 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f1f06488640 1 librados: calling monclient init 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f1f06488640 10 monclient: init 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f43967fc640 1 -- 10.20.193.5:0/4143288740 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f438c02fe10 con 0x7f439815df20 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f439dda7640 5 monclient: authenticate success, global_id 4495 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f439dda7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f43967fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f439dda7640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f43967fc640 1 -- 10.20.193.5:0/4143288740 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438c037660 con 0x7f439815df20 2026-02-17T21:25:36.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f439dda7640 4 set_mon_vals no callback set 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f43967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f43967fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.533+0000 7f43967fc640 10 monclient: dump: 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f1f06488640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7fab37fff640 10 monclient(hunting): handle_auth_done global_id 4499 payload 274 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7fab37fff640 1 -- 10.20.193.5:0/1421171529 >> v1:10.20.193.119:6789/0 conn(0x7fab380c8cf0 legacy=0x7fab3815d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7fab37fff640 1 -- 10.20.193.5:0/1421171529 >> v1:10.20.193.5:6789/0 conn(0x7fab381527c0 legacy=0x7fab380d2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7fab37fff640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7fab37fff640 1 monclient: found mon.noname-c 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7fab37fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7fab37fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7fab37fff640 1 -- 10.20.193.5:0/1421171529 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab380c9da0 con 0x7fab3815df20 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f1f06488640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f1f06488640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1f000c5bf0 0x7f1f001f7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f1f06488640 10 monclient(hunting): picked mon.noname-a con 0x7f1f000c5bf0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f1f06488640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1f00150310 0x7f1f000742f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f1f06488640 10 monclient(hunting): picked mon.noname-c con 0x7f1f00150310 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f1f06488640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1f001506f0 0x7f1f001f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f1f06488640 10 monclient(hunting): picked mon.noname-b con 0x7f1f001506f0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f1f06488640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f1f06488640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1f000c7f50 con 0x7f1f000c5bf0 2026-02-17T21:25:36.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f1f06488640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f1f06488640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0015a840 con 0x7f1f001506f0 2026-02-17T21:25:36.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f1f06488640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f1f06488640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1f00070f30 con 0x7f1f00150310 2026-02-17T21:25:36.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f1f06488640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f1f06488640 10 monclient(hunting): authenticate will time out at 1042.099264s 2026-02-17T21:25:36.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f40e08c9640 10 monclient: shutdown 2026-02-17T21:25:36.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f40e08c9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f40e08c9640 1 -- 10.20.193.5:0/1340277578 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f40d815d950 msgr2=0x7f40d815dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f40e08c9640 1 --2- 10.20.193.5:0/1340277578 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f40d815d950 0x7f40d815dd90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f40d808fc80 tx=0x7f40cc02f280 comp rx=0 tx=0).stop 2026-02-17T21:25:36.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f439dda7640 10 monclient: shutdown 2026-02-17T21:25:36.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f439dda7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f439dda7640 1 -- 10.20.193.5:0/4143288740 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f439815df20 msgr2=0x7f43980c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f439dda7640 1 --2- 10.20.193.5:0/4143288740 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f439815df20 0x7f43980c9180 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f438c009d90 tx=0x7f438c02f190 comp rx=0 tx=0).stop 2026-02-17T21:25:36.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f439dda7640 1 -- 10.20.193.5:0/4143288740 shutdown_connections 2026-02-17T21:25:36.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f439dda7640 1 --2- 10.20.193.5:0/4143288740 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f439815df20 0x7f43980c9180 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f40e08c9640 1 -- 10.20.193.5:0/1340277578 shutdown_connections 2026-02-17T21:25:36.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f40e08c9640 1 --2- 10.20.193.5:0/1340277578 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f40d815d950 0x7f40d815dd90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f40e08c9640 1 --2- 10.20.193.5:0/1340277578 >> v2:10.20.193.135:3300/0 conn(0x7f40d80d1f40 0x7f40d815c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f40e08c9640 1 -- 10.20.193.5:0/1340277578 >> 10.20.193.5:0/1340277578 conn(0x7f40d806d9b0 msgr2=0x7f40d806ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f439dda7640 1 -- 10.20.193.5:0/4143288740 >> 10.20.193.5:0/4143288740 conn(0x7f4398073030 msgr2=0x7f4398073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f40e08c9640 1 -- 10.20.193.5:0/1340277578 shutdown_connections 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f40e08c9640 1 -- 10.20.193.5:0/1340277578 wait complete. 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f439dda7640 1 -- 10.20.193.5:0/4143288740 shutdown_connections 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f439dda7640 1 -- 10.20.193.5:0/4143288740 wait complete. 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f439dda7640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.534+0000 7f439dda7640 10 monclient: monmap: 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f40e08c9640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f40e08c9640 10 monclient: monmap: 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f9406ffd640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f94080ce5d0 0x7f94080d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:50246/0 (socket says 10.20.193.5:50246) 2026-02-17T21:25:36.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f9406ffd640 1 -- 10.20.193.5:0/807612469 learned_addr learned my addr 10.20.193.5:0/807612469 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f9406ffd640 10 monclient(hunting): get_auth_request con 0x7f94080ce5d0 auth_method 0 2026-02-17T21:25:36.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f9406ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f9406ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f9406ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f439dda7640 1 librados: starting msgr at 2026-02-17T21:25:36.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f439dda7640 1 librados: starting objecter 2026-02-17T21:25:36.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f439dda7640 1 Processor -- start 2026-02-17T21:25:36.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7fa775465640 1 --2- 10.20.193.5:0/2785207424 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa770152ae0 0x7fa77015edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa77008e820 tx=0x7fa76402eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6710a7d750eff4a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f439dda7640 1 -- start start 2026-02-17T21:25:36.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f439dda7640 1 librados: setting wanted keys 2026-02-17T21:25:36.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f439dda7640 1 librados: calling monclient init 2026-02-17T21:25:36.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f439dda7640 10 monclient: init 2026-02-17T21:25:36.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f40e08c9640 1 librados: starting msgr at 2026-02-17T21:25:36.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f40e08c9640 1 librados: starting objecter 2026-02-17T21:25:36.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f40e08c9640 1 Processor -- start 2026-02-17T21:25:36.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f9406ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f9406ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f9406ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f439dda7640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f439dda7640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:25:36.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f439dda7640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f43980c8cf0 0x7f43981f4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f439dda7640 10 monclient(hunting): picked mon.noname-c con 0x7f43980c8cf0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f439dda7640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f43981527c0 0x7f43981f5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f439dda7640 10 monclient(hunting): picked mon.noname-b con 0x7f43981527c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f439dda7640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f439815df20 0x7f43980cd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f439dda7640 10 monclient(hunting): picked mon.noname-a con 0x7f439815df20 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f439dda7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f439dda7640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4398152ba0 con 0x7f439815df20 2026-02-17T21:25:36.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f439dda7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f439dda7640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f439815d2f0 con 0x7f43981527c0 2026-02-17T21:25:36.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f439dda7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f439dda7640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4398160100 con 0x7f43980c8cf0 2026-02-17T21:25:36.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f439dda7640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f439dda7640 10 monclient(hunting): authenticate will time out at 1042.100867s 2026-02-17T21:25:36.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7fab37fff640 1 --2- 10.20.193.5:0/1421171529 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fab3815df20 0x7fab380c9180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009e50 tx=0x7fab2c02f260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9b156b88ca6da35 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f40e08c9640 1 -- start start 2026-02-17T21:25:36.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f40e08c9640 1 librados: setting wanted keys 2026-02-17T21:25:36.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f40e08c9640 1 librados: calling monclient init 2026-02-17T21:25:36.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7fb0deffd640 1 --2- 10.20.193.5:0/2971988754 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb0e00ce5d0 0x7fb0e00ca4e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400c730 tx=0x7fb0d400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7f40e08c9640 10 monclient: init 2026-02-17T21:25:36.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7fb0bf7fe640 10 client.?.objecter ms_handle_connect 0x7fb0e00ce5d0 2026-02-17T21:25:36.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.535+0000 7fb0bf7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.536+0000 7f40e08c9640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.536+0000 7f40e08c9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:25:36.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.536+0000 7f40e08c9640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f40d80d1b60 0x7f40d8147470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.536+0000 7f40e08c9640 10 monclient(hunting): picked mon.noname-a con 0x7f40d80d1b60 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.536+0000 7f40e08c9640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f40d80d1f40 0x7f40d81f6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.536+0000 7f40e08c9640 10 monclient(hunting): picked mon.noname-c con 0x7f40d80d1f40 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.536+0000 7f40e08c9640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f40d815d950 0x7f40d81f7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.536+0000 7f40e08c9640 10 monclient(hunting): picked mon.noname-b con 0x7f40d815d950 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.536+0000 7f40e08c9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.536+0000 7f40e08c9640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f40d80c9ea0 con 0x7f40d80d1b60 2026-02-17T21:25:36.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.536+0000 7f40e08c9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.536+0000 7f40e08c9640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f40d815d4c0 con 0x7f40d815d950 2026-02-17T21:25:36.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.536+0000 7f40e08c9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.536+0000 7f40e08c9640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f40d80ca180 con 0x7f40d80d1f40 2026-02-17T21:25:36.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.536+0000 7f40e08c9640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.536+0000 7f40e08c9640 10 monclient(hunting): authenticate will time out at 1042.101708s 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.536+0000 7f3c92ffd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c940c7240 0x7f3c9414c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7f3c92ffd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c940c7240 0x7f3c9414c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:37896/0 (socket says 10.20.193.5:37896) 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7f3c92ffd640 1 -- 10.20.193.5:0/40581367 learned_addr learned my addr 10.20.193.5:0/40581367 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7f3c92ffd640 10 monclient(hunting): get_auth_request con 0x7f3c940c7240 auth_method 0 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7f3c92ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7f3c92ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7f3c92ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7f1f049fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1f001506f0 0x7f1f001f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7fbd7a7fc640 1 -- 10.20.193.5:0/2021679235 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8800ad50 con 0x7fbd8c15b290 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7fbd7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7fbd7a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7fbd7a7fc640 10 monclient: dump: 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7fbd7a7fc640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7fbd7a7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7fbd7a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7fbd7a7fc640 1 -- 10.20.193.5:0/2021679235 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd88003a70 con 0x7fbd8c15b290 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7fbd7a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7fbd7a7fc640 1 -- 10.20.193.5:0/2021679235 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd88003e40 con 0x7fbd8c15b290 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7fbd93ada640 5 monclient: authenticate success, global_id 4490 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7fbd7bfff640 4 set_mon_vals no callback set 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7fbd7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7fbd7a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:36.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7f4396ffd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f43981527c0 0x7f43981f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7fbd7a7fc640 10 monclient: dump: 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7fbd93ada640 10 monclient: _renew_subs 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7fbd93ada640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7fbd93ada640 1 -- 10.20.193.5:0/2021679235 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd8c143da0 con 0x7fbd8c15b290 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7fbd93ada640 10 client.4490.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7fbd93ada640 10 monclient: _renew_subs 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7fbd93ada640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7fbd93ada640 1 -- 10.20.193.5:0/2021679235 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd8c13f040 con 0x7fbd8c15b290 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7fbd93ada640 1 librados: init done 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7f1f049fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1f001506f0 0x7f1f001f4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:37902/0 (socket says 10.20.193.5:37902) 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7f1f049fe640 1 -- 10.20.193.5:0/1166099527 learned_addr learned my addr 10.20.193.5:0/1166099527 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7f1f049fe640 10 monclient(hunting): get_auth_request con 0x7f1f001506f0 auth_method 0 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7f1f049fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7f1f049fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.537+0000 7f1f049fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.538+0000 7f4396ffd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f43981527c0 0x7f43981f5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:37918/0 (socket says 10.20.193.5:37918) 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.538+0000 7f4396ffd640 1 -- 10.20.193.5:0/526279737 learned_addr learned my addr 10.20.193.5:0/526279737 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.538+0000 7f4396ffd640 10 monclient(hunting): get_auth_request con 0x7f43981527c0 auth_method 0 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.538+0000 7f4396ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.538+0000 7f4396ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.538+0000 7f4396ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.538+0000 7f1f049fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.538+0000 7f1f049fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.538+0000 7f1f049fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.538+0000 7fbd93ada640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.538+0000 7fbd93ada640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.538+0000 7fbd93ada640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.538+0000 7fbd93ada640 1 -- 10.20.193.5:0/2021679235 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd8c155fc0 con 0x7fbd8c15b290 2026-02-17T21:25:36.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.538+0000 7f4396ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.538+0000 7f4396ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.538+0000 7f94067fc640 1 --2- 10.20.193.5:0/807612469 >> v2:10.20.193.135:3300/0 conn(0x7f940815bf30 0x7f94080ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.538+0000 7f4396ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f94067fc640 10 monclient(hunting): get_auth_request con 0x7f940815bf30 auth_method 0 2026-02-17T21:25:36.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f94067fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f94067fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f94067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f3c927fc640 1 --2- 10.20.193.5:0/40581367 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3c940c7620 0x7f3c941f6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7feaf2ffd640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7feaf40d1f40 0x7feaf415c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7feaf2ffd640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7feaf40d1f40 0x7feaf415c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:47928/0 (socket says 10.20.193.5:47928) 2026-02-17T21:25:36.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7feaf2ffd640 1 -- 10.20.193.5:0/55782788 learned_addr learned my addr 10.20.193.5:0/55782788 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7feaf2ffd640 10 monclient(hunting): get_auth_request con 0x7feaf40d1f40 auth_method 0 2026-02-17T21:25:36.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7feaf2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7feaf2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7feaf2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f9406ffd640 10 monclient(hunting): handle_auth_done global_id 4464 payload 274 2026-02-17T21:25:36.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f1f049fe640 10 monclient(hunting): handle_auth_done global_id 4498 payload 824 2026-02-17T21:25:36.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f3c927fc640 10 monclient(hunting): get_auth_request con 0x7f3c940c7620 auth_method 0 2026-02-17T21:25:36.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f3c927fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f3c927fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f3c927fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f9406ffd640 1 -- 10.20.193.5:0/807612469 >> v2:10.20.193.135:3300/0 conn(0x7f940815bf30 msgr2=0x7f94080ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f9406ffd640 1 --2- 10.20.193.5:0/807612469 >> v2:10.20.193.135:3300/0 conn(0x7f940815bf30 0x7f94080ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f9406ffd640 1 -- 10.20.193.5:0/807612469 >> v1:10.20.193.119:6789/0 conn(0x7f94080ceef0 legacy=0x7f94080c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f9406ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f9406ffd640 1 monclient: found mon.noname-a 2026-02-17T21:25:36.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f9406ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f9406ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f9406ffd640 1 -- 10.20.193.5:0/807612469 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94080d2690 con 0x7f94080ce5d0 2026-02-17T21:25:36.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f1f049fe640 1 -- 10.20.193.5:0/1166099527 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1f00150310 msgr2=0x7f1f000742f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f1f049fe640 1 --2- 10.20.193.5:0/1166099527 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1f00150310 0x7f1f000742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f1f049fe640 1 -- 10.20.193.5:0/1166099527 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1f000c5bf0 msgr2=0x7f1f001f7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f1f049fe640 1 --2- 10.20.193.5:0/1166099527 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1f000c5bf0 0x7f1f001f7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f1f049fe640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f1f049fe640 1 monclient: found mon.noname-b 2026-02-17T21:25:36.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f1f049fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f1f049fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.539+0000 7f1f049fe640 1 -- 10.20.193.5:0/1166099527 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f001f4740 con 0x7f1f001506f0 2026-02-17T21:25:36.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.540+0000 7feaf2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.540+0000 7feaf2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.540+0000 7feaf2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.540+0000 7f3c927fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.540+0000 7f3c927fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.540+0000 7f3c927fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.540+0000 7faba90bd640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7faba40d1b60 0x7faba40d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.540+0000 7fa2c3fff640 1 -- 10.20.193.5:0/715595769 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c803c070 con 0x7fa2d40d1f40 2026-02-17T21:25:36.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.540+0000 7fa2c3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.540+0000 7fa2c3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.540+0000 7fa2c3fff640 10 monclient: dump: 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.540+0000 7fa2c3fff640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.540+0000 7fa2c3fff640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.540+0000 7fa2c3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.540+0000 7fa2c3fff640 1 -- 10.20.193.5:0/715595769 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2c802fa90 con 0x7fa2d40d1f40 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.540+0000 7fa2c3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.540+0000 7fa2c3fff640 1 -- 10.20.193.5:0/715595769 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c802fe60 con 0x7fa2d40d1f40 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.540+0000 7fa2db47c640 5 monclient: authenticate success, global_id 4458 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.540+0000 7fa2db47c640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.540+0000 7fa2db47c640 4 set_mon_vals no callback set 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.540+0000 7fa2c3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.540+0000 7fa2c3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.540+0000 7fa2c3fff640 10 monclient: dump: 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7fa2db47c640 10 monclient: shutdown 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7fa2db47c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7fa2db47c640 1 -- 10.20.193.5:0/715595769 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa2d40d1f40 msgr2=0x7fa2d40c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7fa2db47c640 1 --2- 10.20.193.5:0/715595769 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa2d40d1f40 0x7fa2d40c9bc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40c8c30 tx=0x7fa2c802ee60 comp rx=0 tx=0).stop 2026-02-17T21:25:36.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7feaf2ffd640 10 monclient(hunting): handle_auth_done global_id 4505 payload 274 2026-02-17T21:25:36.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7feaf2ffd640 1 -- 10.20.193.5:0/55782788 >> v1:10.20.193.119:6789/0 conn(0x7feaf415d950 legacy=0x7feaf415dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7feaf2ffd640 1 -- 10.20.193.5:0/55782788 >> v1:10.20.193.5:6789/0 conn(0x7feaf40d1b60 legacy=0x7feaf40c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7feaf2ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7feaf2ffd640 1 monclient: found mon.noname-c 2026-02-17T21:25:36.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7feaf2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7feaf2ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7feaf2ffd640 1 -- 10.20.193.5:0/55782788 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf40c9ea0 con 0x7feaf40d1f40 2026-02-17T21:25:36.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7fa2db47c640 1 -- 10.20.193.5:0/715595769 shutdown_connections 2026-02-17T21:25:36.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7fa2db47c640 1 --2- 10.20.193.5:0/715595769 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa2d40d1f40 0x7fa2d40c9bc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7fa2db47c640 1 --2- 10.20.193.5:0/715595769 >> v2:10.20.193.119:3300/0 conn(0x7fa2d40ca100 0x7fa2d4160350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7fa2db47c640 1 -- 10.20.193.5:0/715595769 >> 10.20.193.5:0/715595769 conn(0x7fa2d406d9b0 msgr2=0x7fa2d406ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7ff9d54e4640 1 -- 10.20.193.5:0/1578963609 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc02fcd0 con 0x7ff9d0152ae0 2026-02-17T21:25:36.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7fa2db47c640 1 -- 10.20.193.5:0/715595769 shutdown_connections 2026-02-17T21:25:36.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7fa2db47c640 1 -- 10.20.193.5:0/715595769 wait complete. 2026-02-17T21:25:36.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7ff9d54e4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7ff9d54e4640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:36.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7ff9d54e4640 10 monclient: dump: 2026-02-17T21:25:36.574 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.574 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.574 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.574 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.574 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.574 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7ff9d54e4640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7ff9d54e4640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7ff9d54e4640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7ff9d54e4640 1 -- 10.20.193.5:0/1578963609 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9cc0373f0 con 0x7ff9d0152ae0 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7ff9d54e4640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7ff9d54e4640 1 -- 10.20.193.5:0/1578963609 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc0377c0 con 0x7ff9d0152ae0 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7ff9d8771640 5 monclient: authenticate success, global_id 4455 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7ff9d8771640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7ff9d8771640 4 set_mon_vals no callback set 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7ff9d54e4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7ff9d54e4640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.541+0000 7ff9d54e4640 10 monclient: dump: 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7f4396ffd640 10 monclient(hunting): handle_auth_done global_id 4501 payload 824 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7f4396ffd640 1 -- 10.20.193.5:0/526279737 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f43980c8cf0 msgr2=0x7f43981f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7f4396ffd640 1 --2- 10.20.193.5:0/526279737 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f43980c8cf0 0x7f43981f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7f4396ffd640 1 -- 10.20.193.5:0/526279737 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f439815df20 msgr2=0x7f43980cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7f4396ffd640 1 --2- 10.20.193.5:0/526279737 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f439815df20 0x7f43980cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7f4396ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7f4396ffd640 1 monclient: found mon.noname-b 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7f4396ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7f4396ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7f4396ffd640 1 -- 10.20.193.5:0/526279737 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43981e8d60 con 0x7f43981527c0 2026-02-17T21:25:36.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7fa2db47c640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7fa2db47c640 10 monclient: monmap: 2026-02-17T21:25:36.576 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.576 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.576 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.576 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.576 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.576 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.576 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.576 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.576 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.576 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7ff9d8771640 10 monclient: shutdown 2026-02-17T21:25:36.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7ff9d8771640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7ff9d8771640 1 -- 10.20.193.5:0/1578963609 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff9d0152ae0 msgr2=0x7ff9d00c9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7ff9d8771640 1 --2- 10.20.193.5:0/1578963609 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff9d0152ae0 0x7ff9d00c9c70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff9d008e820 tx=0x7ff9cc02f270 comp rx=0 tx=0).stop 2026-02-17T21:25:36.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7ff9d8771640 1 -- 10.20.193.5:0/1578963609 shutdown_connections 2026-02-17T21:25:36.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7ff9d8771640 1 --2- 10.20.193.5:0/1578963609 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff9d0152ae0 0x7ff9d00c9c70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7ff9d8771640 1 --2- 10.20.193.5:0/1578963609 >> v2:10.20.193.135:3300/0 conn(0x7ff9d015ef80 0x7ff9d00c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7ff9d8771640 1 -- 10.20.193.5:0/1578963609 >> 10.20.193.5:0/1578963609 conn(0x7ff9d0073030 msgr2=0x7ff9d0073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7fa2db47c640 1 librados: starting msgr at 2026-02-17T21:25:36.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7fa2db47c640 1 librados: starting objecter 2026-02-17T21:25:36.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7fa2db47c640 1 Processor -- start 2026-02-17T21:25:36.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7ff9d8771640 1 -- 10.20.193.5:0/1578963609 shutdown_connections 2026-02-17T21:25:36.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7ff9d8771640 1 -- 10.20.193.5:0/1578963609 wait complete. 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7fa2db47c640 1 -- start start 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7fa2db47c640 1 librados: setting wanted keys 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7fa2db47c640 1 librados: calling monclient init 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7fa2db47c640 10 monclient: init 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7fa2db47c640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7fa2db47c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7fa2db47c640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa2d40ca100 0x7fa2d41f7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7fa2db47c640 10 monclient(hunting): picked mon.noname-a con 0x7fa2d40ca100 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7fa2db47c640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa2d40d1b60 0x7fa2d4155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7fa2db47c640 10 monclient(hunting): picked mon.noname-c con 0x7fa2d40d1b60 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7fa2db47c640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa2d40d1f40 0x7fa2d40d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7fa2db47c640 10 monclient(hunting): picked mon.noname-b con 0x7fa2d40d1f40 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7fa2db47c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7fa2db47c640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d406e820 con 0x7fa2d40ca100 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7fa2db47c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7fa2db47c640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d40c93c0 con 0x7fa2d40d1f40 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7fa2db47c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7fa2db47c640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d41611b0 con 0x7fa2d40d1b60 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7fa2db47c640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7fa2db47c640 10 monclient(hunting): authenticate will time out at 1042.107832s 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7ff9d8771640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7ff9d8771640 10 monclient: monmap: 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.577 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.578 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.578 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.578 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.578 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.578 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7f3c927fc640 10 monclient(hunting): handle_auth_done global_id 4508 payload 824 2026-02-17T21:25:36.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7f3c927fc640 1 -- 10.20.193.5:0/40581367 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c940c7240 msgr2=0x7f3c9414c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7f3c927fc640 1 --2- 10.20.193.5:0/40581367 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c940c7240 0x7f3c9414c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7f3c927fc640 1 -- 10.20.193.5:0/40581367 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c94163810 msgr2=0x7f3c941f6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7f3c927fc640 1 --2- 10.20.193.5:0/40581367 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c94163810 0x7f3c941f6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7f3c927fc640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7f3c927fc640 1 monclient: found mon.noname-c 2026-02-17T21:25:36.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7f3c927fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7f3c927fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.542+0000 7f3c927fc640 1 -- 10.20.193.5:0/40581367 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c941fa670 con 0x7f3c940c7620 2026-02-17T21:25:36.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7faba90bd640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7faba40d1b60 0x7faba40d1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:47926/0 (socket says 10.20.193.5:47926) 2026-02-17T21:25:36.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7faba90bd640 1 -- 10.20.193.5:0/2422723802 learned_addr learned my addr 10.20.193.5:0/2422723802 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7faba90bd640 10 monclient(hunting): get_auth_request con 0x7faba40d1b60 auth_method 0 2026-02-17T21:25:36.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7faba90bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7faba90bd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7faba90bd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7ff9d8771640 1 librados: starting msgr at 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7ff9d8771640 1 librados: starting objecter 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7ff9d8771640 1 Processor -- start 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7ff9d8771640 1 -- start start 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7ff9d8771640 1 librados: setting wanted keys 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7ff9d8771640 1 librados: calling monclient init 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7ff9d8771640 10 monclient: init 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7ff9d8771640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7ff9d8771640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7ff9d8771640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff9d0152700 0x7ff9d015b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7ff9d8771640 10 monclient(hunting): picked mon.noname-b con 0x7ff9d0152700 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7ff9d8771640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff9d0152ae0 0x7ff9d01f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7ff9d8771640 10 monclient(hunting): picked mon.noname-a con 0x7ff9d0152ae0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7ff9d8771640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff9d015ef80 0x7ff9d0148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7ff9d8771640 10 monclient(hunting): picked mon.noname-c con 0x7ff9d015ef80 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7ff9d8771640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7ff9d8771640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d00ca1b0 con 0x7ff9d0152ae0 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7ff9d8771640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7ff9d8771640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d015e350 con 0x7ff9d0152700 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7ff9d8771640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7ff9d8771640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d00ca330 con 0x7ff9d015ef80 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7ff9d8771640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7ff9d8771640 10 monclient(hunting): authenticate will time out at 1042.108606s 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7fb0bf7fe640 1 -- 10.20.193.5:0/2971988754 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d4017070 con 0x7fb0e00ce5d0 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7fb0bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7fb0bf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7fb0bf7fe640 10 monclient: dump: 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.579 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7fb0bf7fe640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7fb0bf7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7fb0bf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7fb0bf7fe640 1 -- 10.20.193.5:0/2971988754 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d4005bb0 con 0x7fb0e00ce5d0 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7fb0e55f5640 5 monclient: authenticate success, global_id 4461 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7fb0e55f5640 10 monclient: _renew_subs 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7fb0e55f5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7fb0e55f5640 1 -- 10.20.193.5:0/2971988754 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0e00d0ea0 con 0x7fb0e00ce5d0 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7fb0bf7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7f40de63e640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f40d80d1b60 0x7f40d8147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7fb0bf7fe640 1 -- 10.20.193.5:0/2971988754 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d4007070 con 0x7fb0e00ce5d0 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7f1f049fe640 1 --2- 10.20.193.5:0/1166099527 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1f001506f0 0x7f1f001f4cf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1ef403a040 tx=0x7f1ef4004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7fb0bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7fb0bf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7fb0dd7fa640 4 set_mon_vals no callback set 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7fb0bf7fe640 10 monclient: dump: 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7fb0e55f5640 10 client.4461.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7fb0e55f5640 10 monclient: _renew_subs 2026-02-17T21:25:36.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7fb0e55f5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7f1efcff9640 10 client.?.objecter ms_handle_connect 0x7f1f001506f0 2026-02-17T21:25:36.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7f1efcff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7fb0e55f5640 1 -- 10.20.193.5:0/2971988754 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0e00d1460 con 0x7fb0e00ce5d0 2026-02-17T21:25:36.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.543+0000 7fb0e55f5640 1 librados: init done 2026-02-17T21:25:36.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.544+0000 7f40de63e640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f40d80d1b60 0x7f40d8147470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:50304/0 (socket says 10.20.193.5:50304) 2026-02-17T21:25:36.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.544+0000 7f40de63e640 1 -- 10.20.193.5:0/3006183881 learned_addr learned my addr 10.20.193.5:0/3006183881 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.544+0000 7f40de63e640 10 monclient(hunting): get_auth_request con 0x7f40d80d1b60 auth_method 0 2026-02-17T21:25:36.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.544+0000 7f40de63e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.544+0000 7f40de63e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.544+0000 7f40de63e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.544+0000 7fb0e55f5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.544+0000 7fb0e55f5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.544+0000 7fb0e55f5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.544+0000 7fb0e55f5640 1 -- 10.20.193.5:0/2971988754 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0e00ce9b0 con 0x7fb0e00ce5d0 2026-02-17T21:25:36.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.544+0000 7f40de63e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.544+0000 7f40de63e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.544+0000 7faba90bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.544+0000 7faba90bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.544+0000 7faba90bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.544+0000 7f40de63e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.544+0000 7f4396ffd640 1 --2- 10.20.193.5:0/526279737 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f43981527c0 0x7f43981f5630 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f438800b4d0 tx=0x7f438800b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.544+0000 7f4373fff640 10 client.?.objecter ms_handle_connect 0x7f43981527c0 2026-02-17T21:25:36.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.544+0000 7f4373fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.544+0000 7f9406ffd640 1 --2- 10.20.193.5:0/807612469 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f94080ce5d0 0x7f94080d18c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f940815d030 tx=0x7f93fc02eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef8af7655ae15d4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.545+0000 7feaf2ffd640 1 --2- 10.20.193.5:0/55782788 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7feaf40d1f40 0x7feaf415c840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7feae4009970 tx=0x7feae402eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=764b6be7ca06aaa6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.545+0000 7f3c927fc640 1 --2- 10.20.193.5:0/40581367 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3c940c7620 0x7f3c941f6740 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00c450 tx=0x7f3c7c00c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.545+0000 7f3c737fe640 10 client.?.objecter ms_handle_connect 0x7f3c940c7620 2026-02-17T21:25:36.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.545+0000 7f3c737fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.545+0000 7faba90bd640 10 monclient(hunting): handle_auth_done global_id 4511 payload 274 2026-02-17T21:25:36.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.545+0000 7faba90bd640 1 -- 10.20.193.5:0/2422723802 >> v1:10.20.193.119:6789/0 conn(0x7faba415c840 legacy=0x7faba40c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.545+0000 7faba90bd640 1 -- 10.20.193.5:0/2422723802 >> v1:10.20.193.5:6789/0 conn(0x7faba415d950 legacy=0x7faba415dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:36.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.545+0000 7faba90bd640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.545+0000 7faba90bd640 1 monclient: found mon.noname-c 2026-02-17T21:25:36.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.545+0000 7faba90bd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.545+0000 7faba90bd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.545+0000 7faba90bd640 1 -- 10.20.193.5:0/2422723802 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba40c9ea0 con 0x7faba40d1b60 2026-02-17T21:25:36.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.547+0000 7faba90bd640 1 --2- 10.20.193.5:0/2422723802 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7faba40d1b60 0x7faba40d1f40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fab94009970 tx=0x7fab9402eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23127a7618026f62 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.548+0000 7f40de63e640 10 monclient(hunting): handle_auth_done global_id 4467 payload 824 2026-02-17T21:25:36.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.548+0000 7f40de63e640 1 -- 10.20.193.5:0/3006183881 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f40d80d1f40 msgr2=0x7f40d81f6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.548+0000 7f40de63e640 1 --2- 10.20.193.5:0/3006183881 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f40d80d1f40 0x7f40d81f6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.548+0000 7f40de63e640 1 -- 10.20.193.5:0/3006183881 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f40d815d950 msgr2=0x7f40d81f7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.548+0000 7f40de63e640 1 --2- 10.20.193.5:0/3006183881 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f40d815d950 0x7f40d81f7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.548+0000 7f40de63e640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.548+0000 7f40de63e640 1 monclient: found mon.noname-a 2026-02-17T21:25:36.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.548+0000 7f40de63e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.548+0000 7f40de63e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.548+0000 7f40de63e640 1 -- 10.20.193.5:0/3006183881 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d81f1450 con 0x7f40d80d1b60 2026-02-17T21:25:36.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.549+0000 7fe170b0a640 1 --2- 10.20.193.5:0/4133187899 >> v2:10.20.193.119:3300/0 conn(0x7fe16c0d1f40 0x7fe16c15c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.549+0000 7f0abf7fe640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f0ac015a760 0x7f0ac0160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.549+0000 7fe170b0a640 10 monclient(hunting): get_auth_request con 0x7fe16c0d1f40 auth_method 0 2026-02-17T21:25:36.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.549+0000 7fe170b0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.549+0000 7fe170b0a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.549+0000 7fe170b0a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.549+0000 7f0abffff640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f0ac015a380 0x7f0ac01626b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:45340/0 (socket says 10.20.193.5:45340) 2026-02-17T21:25:36.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.549+0000 7f0abffff640 1 -- 10.20.193.5:0/569319092 learned_addr learned my addr 10.20.193.5:0/569319092 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:36.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.550+0000 7fe170b0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.550+0000 7fe170b0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.550+0000 7fe170b0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.550+0000 7f0abf7fe640 10 monclient(hunting): get_auth_request con 0x7f0ac015a760 auth_method 0 2026-02-17T21:25:36.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.550+0000 7f0abf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.550+0000 7f0abf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.550+0000 7f0abf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.550+0000 7f0abf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.550+0000 7f0abf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.550+0000 7f0abf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7f40de63e640 1 --2- 10.20.193.5:0/3006183881 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f40d80d1b60 0x7f40d8147470 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f40d000b4d0 tx=0x7f40d000b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fe170b0a640 10 monclient(hunting): handle_auth_done global_id 4507 payload 274 2026-02-17T21:25:36.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7f40c2ffd640 10 client.?.objecter ms_handle_connect 0x7f40d80d1b60 2026-02-17T21:25:36.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7f40c2ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fe170b0a640 1 -- 10.20.193.5:0/4133187899 >> v1:10.20.193.135:6789/0 conn(0x7fe16c15d950 legacy=0x7fe16c15dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fe170b0a640 1 -- 10.20.193.5:0/4133187899 >> v1:10.20.193.5:6789/0 conn(0x7fe16c0d1b60 legacy=0x7fe16c0c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fe170b0a640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fe170b0a640 1 monclient: found mon.noname-b 2026-02-17T21:25:36.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fe170b0a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fe170b0a640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fe170b0a640 1 -- 10.20.193.5:0/4133187899 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16c0c9ea0 con 0x7fe16c0d1f40 2026-02-17T21:25:36.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fa774c64640 1 -- 10.20.193.5:0/2785207424 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76403c070 con 0x7fa770152ae0 2026-02-17T21:25:36.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fa774c64640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fa774c64640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fa774c64640 10 monclient: dump: 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fa774c64640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fa774c64640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fa774c64640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fa774c64640 1 -- 10.20.193.5:0/2785207424 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa76402fb40 con 0x7fa770152ae0 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fa774c64640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fa774c64640 1 -- 10.20.193.5:0/2785207424 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa764037440 con 0x7fa770152ae0 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fa774c64640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fa774c64640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fa774c64640 10 monclient: dump: 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fa777ef1640 5 monclient: authenticate success, global_id 4496 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fa777ef1640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fa777ef1640 4 set_mon_vals no callback set 2026-02-17T21:25:36.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fa2d91f1640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa2d40ca100 0x7fa2d41f7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fab367fc640 1 -- 10.20.193.5:0/1421171529 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c02fc80 con 0x7fab3815df20 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fab367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fab367fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fab367fc640 10 monclient: dump: 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fab367fc640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fab367fc640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fab367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fab367fc640 1 -- 10.20.193.5:0/1421171529 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab2c02fe20 con 0x7fab3815df20 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fab367fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fab367fc640 1 -- 10.20.193.5:0/1421171529 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c037610 con 0x7fab3815df20 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fab367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fab367fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fab367fc640 10 monclient: dump: 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fab3deda640 5 monclient: authenticate success, global_id 4499 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fab3deda640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fab3deda640 4 set_mon_vals no callback set 2026-02-17T21:25:36.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fa2d91f1640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa2d40ca100 0x7fa2d41f7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:50318/0 (socket says 10.20.193.5:50318) 2026-02-17T21:25:36.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fa2d91f1640 1 -- 10.20.193.5:0/2348331773 learned_addr learned my addr 10.20.193.5:0/2348331773 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fa2d91f1640 10 monclient(hunting): get_auth_request con 0x7fa2d40ca100 auth_method 0 2026-02-17T21:25:36.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fa2d91f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fa2d91f1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.551+0000 7fa2d91f1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fa2d91f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fa2d91f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fa2d91f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fa777ef1640 10 monclient: shutdown 2026-02-17T21:25:36.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fa777ef1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fa777ef1640 1 -- 10.20.193.5:0/2785207424 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa770152ae0 msgr2=0x7fa77015edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fa777ef1640 1 --2- 10.20.193.5:0/2785207424 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa770152ae0 0x7fa77015edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa77008e820 tx=0x7fa76402eed0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fa777ef1640 1 -- 10.20.193.5:0/2785207424 shutdown_connections 2026-02-17T21:25:36.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fa777ef1640 1 --2- 10.20.193.5:0/2785207424 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa770152ae0 0x7fa77015edb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fa777ef1640 1 --2- 10.20.193.5:0/2785207424 >> v2:10.20.193.119:3300/0 conn(0x7fa770152700 0x7fa77015e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fa777ef1640 1 -- 10.20.193.5:0/2785207424 >> 10.20.193.5:0/2785207424 conn(0x7fa770073030 msgr2=0x7fa770073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fa777ef1640 1 -- 10.20.193.5:0/2785207424 shutdown_connections 2026-02-17T21:25:36.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fa777ef1640 1 -- 10.20.193.5:0/2785207424 wait complete. 2026-02-17T21:25:36.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fab3deda640 10 monclient: shutdown 2026-02-17T21:25:36.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fab3deda640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fab3deda640 1 -- 10.20.193.5:0/1421171529 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fab3815df20 msgr2=0x7fab380c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fab3deda640 1 --2- 10.20.193.5:0/1421171529 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fab3815df20 0x7fab380c9180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009e50 tx=0x7fab2c02f260 comp rx=0 tx=0).stop 2026-02-17T21:25:36.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fab3deda640 1 -- 10.20.193.5:0/1421171529 shutdown_connections 2026-02-17T21:25:36.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fab3deda640 1 --2- 10.20.193.5:0/1421171529 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fab3815df20 0x7fab380c9180 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fab3deda640 1 -- 10.20.193.5:0/1421171529 >> 10.20.193.5:0/1421171529 conn(0x7fab38073030 msgr2=0x7fab38073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fab3deda640 1 -- 10.20.193.5:0/1421171529 shutdown_connections 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fab3deda640 1 -- 10.20.193.5:0/1421171529 wait complete. 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fa777ef1640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fa777ef1640 10 monclient: monmap: 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7ff9d64e6640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff9d0152700 0x7ff9d015b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7f0abf7fe640 10 monclient(hunting): handle_auth_done global_id 4473 payload 274 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7f0abf7fe640 1 -- 10.20.193.5:0/569319092 >> v1:10.20.193.135:6789/0 conn(0x7f0ac015a380 legacy=0x7f0ac01626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7f0abf7fe640 1 -- 10.20.193.5:0/569319092 >> v1:10.20.193.119:6789/0 conn(0x7f0ac0162dc0 legacy=0x7f0ac0163850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fab3deda640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fab3deda640 10 monclient: monmap: 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.588 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.589 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7f0abf7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7f0abf7fe640 1 monclient: found mon.noname-a 2026-02-17T21:25:36.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7f0abf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7f0abf7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7f0abf7fe640 1 -- 10.20.193.5:0/569319092 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac0161bd0 con 0x7f0ac015a760 2026-02-17T21:25:36.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fa777ef1640 1 librados: starting msgr at 2026-02-17T21:25:36.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.552+0000 7fa777ef1640 1 librados: starting objecter 2026-02-17T21:25:36.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fa777ef1640 1 Processor -- start 2026-02-17T21:25:36.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fab3deda640 1 librados: starting msgr at 2026-02-17T21:25:36.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fab3deda640 1 librados: starting objecter 2026-02-17T21:25:36.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fab3deda640 1 Processor -- start 2026-02-17T21:25:36.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fa777ef1640 1 -- start start 2026-02-17T21:25:36.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fa777ef1640 1 librados: setting wanted keys 2026-02-17T21:25:36.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fa777ef1640 1 librados: calling monclient init 2026-02-17T21:25:36.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fa777ef1640 10 monclient: init 2026-02-17T21:25:36.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fab3deda640 1 -- start start 2026-02-17T21:25:36.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fab3deda640 1 librados: setting wanted keys 2026-02-17T21:25:36.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fab3deda640 1 librados: calling monclient init 2026-02-17T21:25:36.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fab3deda640 10 monclient: init 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7ff9d64e6640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff9d0152700 0x7ff9d015b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:37936/0 (socket says 10.20.193.5:37936) 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7ff9d64e6640 1 -- 10.20.193.5:0/2531019158 learned_addr learned my addr 10.20.193.5:0/2531019158 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7ff9d64e6640 10 monclient(hunting): get_auth_request con 0x7ff9d0152700 auth_method 0 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7ff9d64e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7ff9d64e6640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7ff9d64e6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7feaf27fc640 1 -- 10.20.193.5:0/55782788 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae403c070 con 0x7feaf40d1f40 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7feaf27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7feaf27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7feaf27fc640 10 monclient: dump: 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7feaf27fc640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7feaf27fc640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7feaf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7feaf27fc640 1 -- 10.20.193.5:0/55782788 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae402fb60 con 0x7feaf40d1f40 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7feaf27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7feaf27fc640 1 -- 10.20.193.5:0/55782788 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae4037440 con 0x7feaf40d1f40 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7feaf27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7feaf27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7feaf27fc640 10 monclient: dump: 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.590 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.591 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.591 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.591 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.591 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.591 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.591 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.591 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.591 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7feaf9f2c640 5 monclient: authenticate success, global_id 4505 2026-02-17T21:25:36.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7feaf9f2c640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7feaf9f2c640 4 set_mon_vals no callback set 2026-02-17T21:25:36.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fab3deda640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fab3deda640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:25:36.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fab3deda640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fab380c8cf0 0x7fab381f7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fa777ef1640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fa777ef1640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:25:36.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fab3deda640 10 monclient(hunting): picked mon.noname-b con 0x7fab380c8cf0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fab3deda640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fab381527c0 0x7fab3814b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fab3deda640 10 monclient(hunting): picked mon.noname-a con 0x7fab381527c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fab3deda640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fab3815df20 0x7fab3814bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fab3deda640 10 monclient(hunting): picked mon.noname-c con 0x7fab3815df20 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fa777ef1640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa7700c9730 0x7fa7701554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fa777ef1640 10 monclient(hunting): picked mon.noname-c con 0x7fa7700c9730 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fab3deda640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fab3deda640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fab38152ba0 con 0x7fab381527c0 2026-02-17T21:25:36.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fab3deda640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fab3deda640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fab3815d2f0 con 0x7fab380c8cf0 2026-02-17T21:25:36.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fab3deda640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fa777ef1640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa770152700 0x7fa770142110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fa777ef1640 10 monclient(hunting): picked mon.noname-a con 0x7fa770152700 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fa777ef1640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa770152ae0 0x7fa770142650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fab3deda640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fab38160100 con 0x7fab3815df20 2026-02-17T21:25:36.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fab3deda640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fab3deda640 10 monclient(hunting): authenticate will time out at 1042.118635s 2026-02-17T21:25:36.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fe170b0a640 1 --2- 10.20.193.5:0/4133187899 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe16c0d1f40 0x7fe16c15c840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe1600098a0 tx=0x7fe16002ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e35d35dfeb86ac75 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fa777ef1640 10 monclient(hunting): picked mon.noname-b con 0x7fa770152ae0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fa777ef1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fa777ef1640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa7700ca270 con 0x7fa770152700 2026-02-17T21:25:36.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fa777ef1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fa777ef1640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa77015e350 con 0x7fa770152ae0 2026-02-17T21:25:36.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fa777ef1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fa777ef1640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa7700ca3f0 con 0x7fa7700c9730 2026-02-17T21:25:36.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fa777ef1640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7fa777ef1640 10 monclient(hunting): authenticate will time out at 1042.118650s 2026-02-17T21:25:36.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7f4373fff640 1 -- 10.20.193.5:0/526279737 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388004480 con 0x7f43981527c0 2026-02-17T21:25:36.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7f4373fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7f4373fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7f4373fff640 10 monclient: dump: 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7f4373fff640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7f4373fff640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7f4373fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7f4373fff640 1 -- 10.20.193.5:0/526279737 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4388015070 con 0x7f43981527c0 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7f4373fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7f4373fff640 1 -- 10.20.193.5:0/526279737 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388002920 con 0x7f43981527c0 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7f439dda7640 5 monclient: authenticate success, global_id 4501 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7f439dda7640 10 monclient: _renew_subs 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7f439dda7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7f439dda7640 1 -- 10.20.193.5:0/526279737 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43981e9040 con 0x7f43981527c0 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7feaf9f2c640 10 monclient: shutdown 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7feaf9f2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7feaf9f2c640 1 -- 10.20.193.5:0/55782788 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7feaf40d1f40 msgr2=0x7feaf415c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7feaf9f2c640 1 --2- 10.20.193.5:0/55782788 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7feaf40d1f40 0x7feaf415c840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7feae4009970 tx=0x7feae402eef0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7feaf9f2c640 1 -- 10.20.193.5:0/55782788 shutdown_connections 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7feaf9f2c640 1 --2- 10.20.193.5:0/55782788 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7feaf40d1f40 0x7feaf415c840 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7feaf9f2c640 1 -- 10.20.193.5:0/55782788 >> 10.20.193.5:0/55782788 conn(0x7feaf406d9b0 msgr2=0x7feaf406ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7feaf9f2c640 1 -- 10.20.193.5:0/55782788 shutdown_connections 2026-02-17T21:25:36.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7feaf9f2c640 1 -- 10.20.193.5:0/55782788 wait complete. 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c737fe640 1 -- 10.20.193.5:0/40581367 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c0052d0 con 0x7f3c940c7620 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c737fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c737fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c737fe640 10 monclient: dump: 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c737fe640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c737fe640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c737fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7f4373fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7f4373fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7f4373fff640 10 monclient: dump: 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7f4395ffb640 4 set_mon_vals no callback set 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7f439dda7640 10 client.4501.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7f439dda7640 10 monclient: _renew_subs 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7f439dda7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7f439dda7640 1 -- 10.20.193.5:0/526279737 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43981e9600 con 0x7f43981527c0 2026-02-17T21:25:36.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.553+0000 7f439dda7640 1 librados: init done 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c737fe640 1 -- 10.20.193.5:0/40581367 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c7c005470 con 0x7f3c940c7620 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c737fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c737fe640 1 -- 10.20.193.5:0/40581367 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c0038f0 con 0x7f3c940c7620 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c737fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c917fa640 4 set_mon_vals no callback set 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c737fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c737fe640 10 monclient: dump: 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c99596640 5 monclient: authenticate success, global_id 4508 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c99596640 10 monclient: _renew_subs 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c99596640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c99596640 1 -- 10.20.193.5:0/40581367 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c941fa950 con 0x7f3c940c7620 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c99596640 10 client.4508.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c99596640 10 monclient: _renew_subs 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c99596640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c99596640 1 -- 10.20.193.5:0/40581367 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c941faf10 con 0x7f3c940c7620 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c99596640 1 librados: init done 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f439dda7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f439dda7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f439dda7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7feaf9f2c640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7feaf9f2c640 10 monclient: monmap: 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7feaf9f2c640 1 librados: starting msgr at 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7feaf9f2c640 1 librados: starting objecter 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7feaf9f2c640 1 Processor -- start 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f439dda7640 1 -- 10.20.193.5:0/526279737 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43980c9180 con 0x7f43981527c0 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7feaf9f2c640 1 -- start start 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7feaf9f2c640 1 librados: setting wanted keys 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7feaf9f2c640 1 librados: calling monclient init 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7feaf9f2c640 10 monclient: init 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7ff9d64e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7ff9d64e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7ff9d64e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c99596640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c99596640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c99596640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.554+0000 7f3c99596640 1 -- 10.20.193.5:0/40581367 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c940726d0 con 0x7f3c940c7620 2026-02-17T21:25:36.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.555+0000 7feaf9f2c640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.555+0000 7feaf9f2c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:25:36.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.555+0000 7feaf9f2c640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7feaf40d1b60 0x7feaf4150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.555+0000 7feaf9f2c640 10 monclient(hunting): picked mon.noname-a con 0x7feaf40d1b60 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.555+0000 7feaf9f2c640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7feaf40d1f40 0x7feaf41f47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.555+0000 7feaf9f2c640 10 monclient(hunting): picked mon.noname-b con 0x7feaf40d1f40 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.555+0000 7feaf9f2c640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7feaf415d950 0x7feaf41f4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.555+0000 7feaf9f2c640 10 monclient(hunting): picked mon.noname-c con 0x7feaf415d950 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.555+0000 7feaf9f2c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.555+0000 7feaf9f2c640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7feaf415d4c0 con 0x7feaf40d1b60 2026-02-17T21:25:36.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.555+0000 7feaf9f2c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.555+0000 7feaf9f2c640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7feaf40ca460 con 0x7feaf40d1f40 2026-02-17T21:25:36.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.555+0000 7feaf9f2c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.555+0000 7feaf9f2c640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7feaf406e7b0 con 0x7feaf415d950 2026-02-17T21:25:36.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.555+0000 7feaf9f2c640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.555+0000 7feaf9f2c640 10 monclient(hunting): authenticate will time out at 1042.120362s 2026-02-17T21:25:36.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.555+0000 7ff9d6ce7640 1 --2- 10.20.193.5:0/2531019158 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff9d015ef80 0x7ff9d0148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.556+0000 7ff9d6ce7640 10 monclient(hunting): get_auth_request con 0x7ff9d015ef80 auth_method 0 2026-02-17T21:25:36.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.556+0000 7ff9d6ce7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.556+0000 7ff9d6ce7640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.556+0000 7ff9d6ce7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.557+0000 7ff9d64e6640 10 monclient(hunting): handle_auth_done global_id 4510 payload 824 2026-02-17T21:25:36.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.557+0000 7ff9d64e6640 1 -- 10.20.193.5:0/2531019158 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff9d015ef80 msgr2=0x7ff9d0148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.557+0000 7ff9d64e6640 1 --2- 10.20.193.5:0/2531019158 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff9d015ef80 0x7ff9d0148100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.557+0000 7ff9d64e6640 1 -- 10.20.193.5:0/2531019158 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff9d0152ae0 msgr2=0x7ff9d01f3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.557+0000 7ff9d64e6640 1 --2- 10.20.193.5:0/2531019158 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff9d0152ae0 0x7ff9d01f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.557+0000 7ff9d64e6640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.557+0000 7ff9d64e6640 1 monclient: found mon.noname-b 2026-02-17T21:25:36.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.557+0000 7ff9d64e6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.557+0000 7ff9d64e6640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.557+0000 7ff9d64e6640 1 -- 10.20.193.5:0/2531019158 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d015a130 con 0x7ff9d0152700 2026-02-17T21:25:36.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.557+0000 7fa2d91f1640 10 monclient(hunting): handle_auth_done global_id 4476 payload 824 2026-02-17T21:25:36.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.557+0000 7fa2d91f1640 1 -- 10.20.193.5:0/2348331773 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa2d40d1b60 msgr2=0x7fa2d4155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.557+0000 7fa2d91f1640 1 --2- 10.20.193.5:0/2348331773 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa2d40d1b60 0x7fa2d4155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.557+0000 7fa2d91f1640 1 -- 10.20.193.5:0/2348331773 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa2d40d1f40 msgr2=0x7fa2d40d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.557+0000 7fa2d91f1640 1 --2- 10.20.193.5:0/2348331773 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa2d40d1f40 0x7fa2d40d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.557+0000 7fa2d91f1640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.557+0000 7fa2d91f1640 1 monclient: found mon.noname-a 2026-02-17T21:25:36.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.557+0000 7fa2d91f1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.557+0000 7fa2d91f1640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.557+0000 7fa2d91f1640 1 -- 10.20.193.5:0/2348331773 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d41f7e70 con 0x7fa2d40ca100 2026-02-17T21:25:36.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.559+0000 7ff9d64e6640 1 --2- 10.20.193.5:0/2531019158 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff9d0152700 0x7ff9d015b4b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff9c000b500 tx=0x7ff9c000b9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.559+0000 7ff9b6ffd640 10 client.?.objecter ms_handle_connect 0x7ff9d0152700 2026-02-17T21:25:36.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.559+0000 7ff9b6ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.563+0000 7fa775c66640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa7700c9730 0x7fa7701554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.564+0000 7fa775c66640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa7700c9730 0x7fa7701554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:47978/0 (socket says 10.20.193.5:47978) 2026-02-17T21:25:36.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.564+0000 7fa775c66640 1 -- 10.20.193.5:0/1411838837 learned_addr learned my addr 10.20.193.5:0/1411838837 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.564+0000 7fa775c66640 10 monclient(hunting): get_auth_request con 0x7fa7700c9730 auth_method 0 2026-02-17T21:25:36.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.564+0000 7fa775c66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.564+0000 7fa775c66640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.564+0000 7fa775c66640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.564+0000 7fab93fff640 1 -- 10.20.193.5:0/2422723802 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9403c070 con 0x7faba40d1b60 2026-02-17T21:25:36.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.564+0000 7fab93fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.564+0000 7fab93fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:36.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.564+0000 7fab93fff640 10 monclient: dump: 2026-02-17T21:25:36.599 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.599 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.599 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.564+0000 7fab93fff640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.564+0000 7fab93fff640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.564+0000 7fab93fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.564+0000 7fab93fff640 1 -- 10.20.193.5:0/2422723802 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab9402fb60 con 0x7faba40d1b60 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.564+0000 7fab93fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.564+0000 7fab93fff640 1 -- 10.20.193.5:0/2422723802 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab94037440 con 0x7faba40d1b60 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.564+0000 7fabab348640 5 monclient: authenticate success, global_id 4511 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.564+0000 7fabab348640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.564+0000 7fabab348640 4 set_mon_vals no callback set 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.564+0000 7fab93fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.564+0000 7fab93fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.564+0000 7fab93fff640 10 monclient: dump: 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.565+0000 7fabab348640 10 monclient: shutdown 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.565+0000 7fabab348640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.565+0000 7fabab348640 1 -- 10.20.193.5:0/2422723802 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7faba40d1b60 msgr2=0x7faba40d1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.565+0000 7fabab348640 1 --2- 10.20.193.5:0/2422723802 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7faba40d1b60 0x7faba40d1f40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fab94009970 tx=0x7fab9402eef0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.565+0000 7fabab348640 1 -- 10.20.193.5:0/2422723802 shutdown_connections 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.565+0000 7fabab348640 1 --2- 10.20.193.5:0/2422723802 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7faba40d1b60 0x7faba40d1f40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.565+0000 7fabab348640 1 -- 10.20.193.5:0/2422723802 >> 10.20.193.5:0/2422723802 conn(0x7faba406d9b0 msgr2=0x7faba406ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.565+0000 7fabab348640 1 -- 10.20.193.5:0/2422723802 shutdown_connections 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.565+0000 7fabab348640 1 -- 10.20.193.5:0/2422723802 wait complete. 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.565+0000 7fabab348640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.565+0000 7fabab348640 10 monclient: monmap: 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.600 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.566+0000 7fabab348640 1 librados: starting msgr at 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.566+0000 7fabab348640 1 librados: starting objecter 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.566+0000 7fabab348640 1 Processor -- start 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.566+0000 7fabab348640 1 -- start start 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.566+0000 7fabab348640 1 librados: setting wanted keys 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.566+0000 7fabab348640 1 librados: calling monclient init 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.566+0000 7fabab348640 10 monclient: init 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.566+0000 7fabab348640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.566+0000 7fabab348640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.566+0000 7fabab348640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faba40d1b60 0x7faba414da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.566+0000 7fabab348640 10 monclient(hunting): picked mon.noname-b con 0x7faba40d1b60 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.566+0000 7fabab348640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7faba415c840 0x7faba41f93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.566+0000 7fabab348640 10 monclient(hunting): picked mon.noname-c con 0x7faba415c840 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.566+0000 7fabab348640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7faba415d950 0x7faba41fb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.566+0000 7fabab348640 10 monclient(hunting): picked mon.noname-a con 0x7faba415d950 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.566+0000 7fabab348640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.566+0000 7fabab348640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7faba415cc90 con 0x7faba415d950 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.566+0000 7fabab348640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.566+0000 7fabab348640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7faba415d4c0 con 0x7faba40d1b60 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.566+0000 7fabab348640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.566+0000 7fabab348640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7faba406e7b0 con 0x7faba415c840 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.566+0000 7fabab348640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.566+0000 7fabab348640 10 monclient(hunting): authenticate will time out at 1042.131805s 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.588+0000 7fa2d91f1640 1 --2- 10.20.193.5:0/2348331773 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa2d40ca100 0x7fa2d41f7730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400b570 tx=0x7fa2c400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.588+0000 7fa2c1ffb640 10 client.?.objecter ms_handle_connect 0x7fa2d40ca100 2026-02-17T21:25:36.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.588+0000 7fa2c1ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.662+0000 7f40c2ffd640 1 -- 10.20.193.5:0/3006183881 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d0004480 con 0x7f40d80d1b60 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.662+0000 7f40c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.662+0000 7f40c2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.662+0000 7f40c2ffd640 10 monclient: dump: 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.662+0000 7f40c2ffd640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.662+0000 7f40c2ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.662+0000 7f40c2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.662+0000 7f40c2ffd640 1 -- 10.20.193.5:0/3006183881 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d0015070 con 0x7f40d80d1b60 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.662+0000 7f40c2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.662+0000 7f40c2ffd640 1 -- 10.20.193.5:0/3006183881 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d0002920 con 0x7f40d80d1b60 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.662+0000 7f40c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.662+0000 7f40c2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.662+0000 7f40c2ffd640 10 monclient: dump: 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.664 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.665 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.665 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.662+0000 7f40dce3b640 4 set_mon_vals no callback set 2026-02-17T21:25:36.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.662+0000 7f40e08c9640 5 monclient: authenticate success, global_id 4467 2026-02-17T21:25:36.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.662+0000 7f40e08c9640 10 monclient: _renew_subs 2026-02-17T21:25:36.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.662+0000 7f40e08c9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.662+0000 7f40e08c9640 1 -- 10.20.193.5:0/3006183881 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40d81f5ea0 con 0x7f40d80d1b60 2026-02-17T21:25:36.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.662+0000 7f40e08c9640 10 client.4467.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.662+0000 7f40e08c9640 10 monclient: _renew_subs 2026-02-17T21:25:36.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.662+0000 7f40e08c9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.662+0000 7f40e08c9640 1 -- 10.20.193.5:0/3006183881 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40d81f6460 con 0x7f40d80d1b60 2026-02-17T21:25:36.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.662+0000 7f40e08c9640 1 librados: init done 2026-02-17T21:25:36.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.663+0000 7f40e08c9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.663+0000 7f40e08c9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.663+0000 7f40e08c9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.663+0000 7f40e08c9640 1 -- 10.20.193.5:0/3006183881 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40d806e7b0 con 0x7f40d80d1b60 2026-02-17T21:25:36.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.670+0000 7fb0bf7fe640 1 -- 10.20.193.5:0/2971988754 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fb0d4007210 con 0x7fb0e00ce5d0 2026-02-17T21:25:36.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.671+0000 7fb0bf7fe640 1 --2- 10.20.193.5:0/2971988754 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb0ac079300 0x7fb0ac07b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.671+0000 7fb0de7fc640 1 --2- 10.20.193.5:0/2971988754 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb0ac079300 0x7fb0ac07b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.671+0000 7fb0de7fc640 10 monclient: get_auth_request con 0x7fb0ac079300 auth_method 0 2026-02-17T21:25:36.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.671+0000 7fb0de7fc640 1 --2- 10.20.193.5:0/2971988754 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb0ac079300 0x7fb0ac07b7c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8039000 tx=0x7fb0c8031000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.671+0000 7fb0bf7fe640 10 client.4461.objecter ms_handle_connect 0x7fb0ac079300 2026-02-17T21:25:36.673 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.672+0000 7f4373fff640 1 -- 10.20.193.5:0/526279737 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f4388010480 con 0x7f43981527c0 2026-02-17T21:25:36.673 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.673+0000 7f4373fff640 1 --2- 10.20.193.5:0/526279737 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4368079300 0x7f436807b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.674 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.673+0000 7f43977fe640 1 --2- 10.20.193.5:0/526279737 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4368079300 0x7f436807b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.674 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.673+0000 7f43977fe640 10 monclient: get_auth_request con 0x7f4368079300 auth_method 0 2026-02-17T21:25:36.674 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.673+0000 7f43977fe640 1 --2- 10.20.193.5:0/526279737 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4368079300 0x7f436807b7c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4384007fd0 tx=0x7f4384007b40 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.674 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.673+0000 7f4373fff640 10 client.4501.objecter ms_handle_connect 0x7f4368079300 2026-02-17T21:25:36.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.675+0000 7f4373fff640 1 -- 10.20.193.5:0/526279737 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f438805e560 con 0x7f43981527c0 2026-02-17T21:25:36.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.675+0000 7f4373fff640 10 client.4501.objecter ms_dispatch2 0x7f4398000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:36.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.675+0000 7f4373fff640 3 client.4501.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:36.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.675+0000 7f4373fff640 3 client.4501.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:36.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.675+0000 7f4373fff640 20 client.4501.objecter dump_active .. 0 homeless 2026-02-17T21:25:36.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.679+0000 7fb0bf7fe640 1 -- 10.20.193.5:0/2971988754 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fb0d405d840 con 0x7fb0e00ce5d0 2026-02-17T21:25:36.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.679+0000 7fb0bf7fe640 10 client.4461.objecter ms_dispatch2 0x7fb0e0000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:36.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.679+0000 7fb0bf7fe640 3 client.4461.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:36.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.679+0000 7fb0bf7fe640 3 client.4461.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:36.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.679+0000 7fb0bf7fe640 20 client.4461.objecter dump_active .. 0 homeless 2026-02-17T21:25:36.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.679+0000 7fb0bf7fe640 1 -- 10.20.193.5:0/2971988754 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb0d4021020 con 0x7fb0e00ce5d0 2026-02-17T21:25:36.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.679+0000 7fb0bf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.679+0000 7fb0bf7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:36.683 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f1efcff9640 1 -- 10.20.193.5:0/1166099527 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4047020 con 0x7f1f001506f0 2026-02-17T21:25:36.683 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f1efcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.683 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f1efcff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:36.683 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f1efcff9640 10 monclient: dump: 2026-02-17T21:25:36.683 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.683 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.683 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.683 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.683 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.683 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.683 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.683 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.683 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.683 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f1efcff9640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f1efcff9640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f1efcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f1efcff9640 1 -- 10.20.193.5:0/1166099527 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef40358f0 con 0x7f1f001506f0 2026-02-17T21:25:36.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f1efcff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f1efcff9640 1 -- 10.20.193.5:0/1166099527 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef403c040 con 0x7f1f001506f0 2026-02-17T21:25:36.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f1f06488640 5 monclient: authenticate success, global_id 4498 2026-02-17T21:25:36.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f1efe7fc640 4 set_mon_vals no callback set 2026-02-17T21:25:36.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f1f06488640 10 monclient: _renew_subs 2026-02-17T21:25:36.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f1f06488640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f1f06488640 1 -- 10.20.193.5:0/1166099527 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0006ee90 con 0x7f1f001506f0 2026-02-17T21:25:36.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f1efcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f1efcff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:36.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f1efcff9640 10 monclient: dump: 2026-02-17T21:25:36.684 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.684 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.684 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.684 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.685 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.685 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.685 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.685 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.685 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.685 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f1f06488640 10 client.4498.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f1f06488640 10 monclient: _renew_subs 2026-02-17T21:25:36.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f1f06488640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f1f06488640 1 -- 10.20.193.5:0/1166099527 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f0006f450 con 0x7f1f001506f0 2026-02-17T21:25:36.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f1f06488640 1 librados: init done 2026-02-17T21:25:36.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f4373fff640 1 -- 10.20.193.5:0/526279737 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f438800d360 con 0x7f43981527c0 2026-02-17T21:25:36.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f4373fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.686 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.681+0000 7f4373fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:36.686 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.682+0000 7f1f06488640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.686 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.682+0000 7f1f06488640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.686 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.682+0000 7f1f06488640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.686 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.682+0000 7f1f06488640 1 -- 10.20.193.5:0/1166099527 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f000c54e0 con 0x7f1f001506f0 2026-02-17T21:25:36.687 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.682+0000 7f9405ffb640 1 -- 10.20.193.5:0/807612469 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc03c070 con 0x7f94080ce5d0 2026-02-17T21:25:36.687 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.682+0000 7f9405ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.687 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.682+0000 7f9405ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:36.687 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.682+0000 7f9405ffb640 10 monclient: dump: 2026-02-17T21:25:36.687 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.688 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.688 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.688 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.688 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.688 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.688 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.688 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.688 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.688 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.682+0000 7f9405ffb640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.682+0000 7f9405ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.682+0000 7f9405ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.682+0000 7f9405ffb640 1 -- 10.20.193.5:0/807612469 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93fc02fb40 con 0x7f94080ce5d0 2026-02-17T21:25:36.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.682+0000 7f9405ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.682+0000 7f9405ffb640 1 -- 10.20.193.5:0/807612469 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc037440 con 0x7f94080ce5d0 2026-02-17T21:25:36.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.682+0000 7f940d901640 5 monclient: authenticate success, global_id 4464 2026-02-17T21:25:36.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.682+0000 7f940d901640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.682+0000 7f940d901640 4 set_mon_vals no callback set 2026-02-17T21:25:36.689 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.682+0000 7f9405ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.689 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.682+0000 7f9405ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:36.689 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.682+0000 7f9405ffb640 10 monclient: dump: 2026-02-17T21:25:36.689 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.689 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.689 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.689 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.689 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.689 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.689 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.689 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.689 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.689 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.689 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.683+0000 7f940d901640 10 monclient: shutdown 2026-02-17T21:25:36.689 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.683+0000 7f940d901640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.689 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.683+0000 7f940d901640 1 -- 10.20.193.5:0/807612469 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f94080ce5d0 msgr2=0x7f94080d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.689 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.683+0000 7f940d901640 1 --2- 10.20.193.5:0/807612469 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f94080ce5d0 0x7f94080d18c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f940815d030 tx=0x7f93fc02eed0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.689 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.683+0000 7f940d901640 1 -- 10.20.193.5:0/807612469 shutdown_connections 2026-02-17T21:25:36.689 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.683+0000 7f940d901640 1 --2- 10.20.193.5:0/807612469 >> v2:10.20.193.135:3300/0 conn(0x7f940815bf30 0x7f94080ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.683+0000 7f940d901640 1 --2- 10.20.193.5:0/807612469 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f94080ce5d0 0x7f94080d18c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.683+0000 7f940d901640 1 -- 10.20.193.5:0/807612469 >> 10.20.193.5:0/807612469 conn(0x7f9408073030 msgr2=0x7f9408073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.683+0000 7f940d901640 1 -- 10.20.193.5:0/807612469 shutdown_connections 2026-02-17T21:25:36.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.683+0000 7f940d901640 1 -- 10.20.193.5:0/807612469 wait complete. 2026-02-17T21:25:36.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.683+0000 7f940d901640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.683+0000 7f940d901640 10 monclient: monmap: 2026-02-17T21:25:36.690 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.690 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.690 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.690 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.690 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.690 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.690 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.690 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.690 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.690 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f940d901640 1 librados: starting msgr at 2026-02-17T21:25:36.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f940d901640 1 librados: starting objecter 2026-02-17T21:25:36.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f940d901640 1 Processor -- start 2026-02-17T21:25:36.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f940d901640 1 -- start start 2026-02-17T21:25:36.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f940d901640 1 librados: setting wanted keys 2026-02-17T21:25:36.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f940d901640 1 librados: calling monclient init 2026-02-17T21:25:36.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f940d901640 10 monclient: init 2026-02-17T21:25:36.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f3441ffb640 1 -- 10.20.193.5:0/4229194437 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f343402fd00 con 0x7f344415e060 2026-02-17T21:25:36.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f3441ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f3441ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:36.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f3441ffb640 10 monclient: dump: 2026-02-17T21:25:36.692 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.692 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.692 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.692 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.692 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.692 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.692 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.692 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.692 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.692 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f3441ffb640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f3441ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f3441ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f3441ffb640 1 -- 10.20.193.5:0/4229194437 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34340373f0 con 0x7f344415e060 2026-02-17T21:25:36.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f3441ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f3441ffb640 1 -- 10.20.193.5:0/4229194437 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34340377c0 con 0x7f344415e060 2026-02-17T21:25:36.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f3441ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f3441ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:36.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f3441ffb640 10 monclient: dump: 2026-02-17T21:25:36.693 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.693 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.693 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.693 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.693 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.693 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.693 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.693 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.693 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.693 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.693 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f3449a85640 5 monclient: authenticate success, global_id 4492 2026-02-17T21:25:36.693 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f3449a85640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.693 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f3449a85640 4 set_mon_vals no callback set 2026-02-17T21:25:36.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f940d901640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f940d901640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:25:36.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f940d901640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f94080ce5d0 0x7f94080d1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f940d901640 10 monclient(hunting): picked mon.noname-a con 0x7f94080ce5d0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f940d901640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f94080ceef0 0x7f940814bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f940d901640 10 monclient(hunting): picked mon.noname-b con 0x7f94080ceef0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f940d901640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f940815bf30 0x7f940814c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f940d901640 10 monclient(hunting): picked mon.noname-c con 0x7f940815bf30 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f940d901640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f940d901640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f94080cbc30 con 0x7f94080ce5d0 2026-02-17T21:25:36.695 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f940d901640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.695 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f940d901640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f94080c9260 con 0x7f94080ceef0 2026-02-17T21:25:36.695 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f940d901640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.695 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f940d901640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f94081f49d0 con 0x7f940815bf30 2026-02-17T21:25:36.695 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f940d901640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.695 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f940d901640 10 monclient(hunting): authenticate will time out at 1042.249647s 2026-02-17T21:25:36.696 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f3449a85640 10 monclient: shutdown 2026-02-17T21:25:36.696 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f3449a85640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.696 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f3449a85640 1 -- 10.20.193.5:0/4229194437 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f344415e060 msgr2=0x7f344415c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.696 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f3449a85640 1 --2- 10.20.193.5:0/4229194437 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f344415e060 0x7f344415c840 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3434009e50 tx=0x7f343402f2a0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.696 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f3449a85640 1 -- 10.20.193.5:0/4229194437 shutdown_connections 2026-02-17T21:25:36.696 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f3449a85640 1 --2- 10.20.193.5:0/4229194437 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f344415e060 0x7f344415c840 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.697 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f3449a85640 1 -- 10.20.193.5:0/4229194437 >> 10.20.193.5:0/4229194437 conn(0x7f344406d9b0 msgr2=0x7f344406ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.697 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f3449a85640 1 -- 10.20.193.5:0/4229194437 shutdown_connections 2026-02-17T21:25:36.697 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.684+0000 7f3449a85640 1 -- 10.20.193.5:0/4229194437 wait complete. 2026-02-17T21:25:36.697 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.687+0000 7f3449a85640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.697 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.687+0000 7f3449a85640 10 monclient: monmap: 2026-02-17T21:25:36.697 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.697 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.697 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.697 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.697 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.697 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.697 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.697 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.697 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.697 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.697 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.687+0000 7f3449a85640 1 librados: starting msgr at 2026-02-17T21:25:36.697 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.687+0000 7f3449a85640 1 librados: starting objecter 2026-02-17T21:25:36.697 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.687+0000 7f3449a85640 1 Processor -- start 2026-02-17T21:25:36.697 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.687+0000 7f3449a85640 1 -- start start 2026-02-17T21:25:36.697 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.687+0000 7f3449a85640 1 librados: setting wanted keys 2026-02-17T21:25:36.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.687+0000 7f3449a85640 1 librados: calling monclient init 2026-02-17T21:25:36.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.687+0000 7f3449a85640 10 monclient: init 2026-02-17T21:25:36.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.688+0000 7f3449a85640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.688+0000 7f3449a85640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:25:36.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.688+0000 7f3449a85640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f34440d1b60 0x7f3444151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.688+0000 7f3449a85640 10 monclient(hunting): picked mon.noname-b con 0x7f34440d1b60 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.688+0000 7f3449a85640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f34440d1f40 0x7f344414d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.688+0000 7f3449a85640 10 monclient(hunting): picked mon.noname-a con 0x7f34440d1f40 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.688+0000 7f3449a85640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f344415e060 0x7f34441f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.688+0000 7f3449a85640 10 monclient(hunting): picked mon.noname-c con 0x7f344415e060 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.688+0000 7f3449a85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.688+0000 7f3449a85640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f344415d4c0 con 0x7f34440d1f40 2026-02-17T21:25:36.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.688+0000 7f3449a85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.688+0000 7f3449a85640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f34440ca460 con 0x7f34440d1b60 2026-02-17T21:25:36.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.688+0000 7f3449a85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.688+0000 7f3449a85640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f344406e7b0 con 0x7f344415e060 2026-02-17T21:25:36.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.688+0000 7f3449a85640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.688+0000 7f3449a85640 10 monclient(hunting): authenticate will time out at 1042.253157s 2026-02-17T21:25:36.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.752+0000 7fa775c66640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.752+0000 7fa775c66640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.752+0000 7fa775c66640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.760+0000 7fbd7a7fc640 1 -- 10.20.193.5:0/2021679235 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fbd880050d0 con 0x7fbd8c15b290 2026-02-17T21:25:36.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.761+0000 7fbd7a7fc640 1 --2- 10.20.193.5:0/2021679235 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbd5c0792b0 0x7fbd5c07b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.761+0000 7fbd9184f640 1 --2- 10.20.193.5:0/2021679235 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbd5c0792b0 0x7fbd5c07b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.761+0000 7fa775c66640 10 monclient(hunting): handle_auth_done global_id 4523 payload 824 2026-02-17T21:25:36.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.761+0000 7fbd9184f640 10 monclient: get_auth_request con 0x7fbd5c0792b0 auth_method 0 2026-02-17T21:25:36.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.761+0000 7fa775c66640 1 -- 10.20.193.5:0/1411838837 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa770152ae0 msgr2=0x7fa770142650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.761+0000 7fa775c66640 1 --2- 10.20.193.5:0/1411838837 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa770152ae0 0x7fa770142650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.761+0000 7fa775c66640 1 -- 10.20.193.5:0/1411838837 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa770152700 msgr2=0x7fa770142110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.761+0000 7fa775c66640 1 --2- 10.20.193.5:0/1411838837 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa770152700 0x7fa770142110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.761+0000 7fa775c66640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.761+0000 7fa775c66640 1 monclient: found mon.noname-c 2026-02-17T21:25:36.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.761+0000 7fab37fff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fab3815df20 0x7fab3814bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.761+0000 7fa775c66640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.761+0000 7fa775c66640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.761+0000 7fa775c66640 1 -- 10.20.193.5:0/1411838837 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa770154120 con 0x7fa7700c9730 2026-02-17T21:25:36.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.762+0000 7fbd9184f640 1 --2- 10.20.193.5:0/2021679235 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbd5c0792b0 0x7fbd5c07b770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c039000 tx=0x7fbd7c031000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.762+0000 7fbd7a7fc640 10 client.4490.objecter ms_handle_connect 0x7fbd5c0792b0 2026-02-17T21:25:36.766 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.765+0000 7fbd7a7fc640 1 -- 10.20.193.5:0/2021679235 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fbd8805eb00 con 0x7fbd8c15b290 2026-02-17T21:25:36.766 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.765+0000 7fbd7a7fc640 10 client.4490.objecter ms_dispatch2 0x7fbd8c000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:36.766 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.765+0000 7fbd7a7fc640 3 client.4490.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:36.766 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.765+0000 7fbd7a7fc640 3 client.4490.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:36.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.765+0000 7fab37fff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fab3815df20 0x7fab3814bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:47976/0 (socket says 10.20.193.5:47976) 2026-02-17T21:25:36.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.765+0000 7fab37fff640 1 -- 10.20.193.5:0/2762579657 learned_addr learned my addr 10.20.193.5:0/2762579657 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.765+0000 7fab37fff640 10 monclient(hunting): get_auth_request con 0x7fab3815df20 auth_method 0 2026-02-17T21:25:36.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.765+0000 7fab37fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.765+0000 7fab37fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.765+0000 7fab37fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.765+0000 7fbd7a7fc640 20 client.4490.objecter dump_active .. 0 homeless 2026-02-17T21:25:36.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.765+0000 7fb0e55f5640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T21:25:36.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.765+0000 7fb0e55f5640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T21:25:36.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.765+0000 7fb0e55f5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.765+0000 7fb0e55f5640 1 -- 10.20.193.5:0/2971988754 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb0e00cbdb0 con 0x7fb0e00ce5d0 2026-02-17T21:25:36.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.766+0000 7f439dda7640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T21:25:36.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.766+0000 7f439dda7640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T21:25:36.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.766+0000 7f439dda7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.766+0000 7f439dda7640 1 -- 10.20.193.5:0/526279737 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f43981596f0 con 0x7f43981527c0 2026-02-17T21:25:36.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.771+0000 7fbd7a7fc640 1 -- 10.20.193.5:0/2021679235 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbd8c155fc0 con 0x7fbd8c15b290 2026-02-17T21:25:36.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.771+0000 7fbd7a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.771+0000 7fbd7a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:36.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.771+0000 7fab37fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.771+0000 7fab37fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.771+0000 7fab37fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.774+0000 7fab37fff640 10 monclient(hunting): handle_auth_done global_id 4526 payload 824 2026-02-17T21:25:36.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.774+0000 7fab37fff640 1 -- 10.20.193.5:0/2762579657 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fab380c8cf0 msgr2=0x7fab381f7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.774+0000 7fab37fff640 1 --2- 10.20.193.5:0/2762579657 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fab380c8cf0 0x7fab381f7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.774+0000 7fab37fff640 1 -- 10.20.193.5:0/2762579657 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fab381527c0 msgr2=0x7fab3814b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.774+0000 7fab37fff640 1 --2- 10.20.193.5:0/2762579657 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fab381527c0 0x7fab3814b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.774+0000 7fab37fff640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.774+0000 7fab37fff640 1 monclient: found mon.noname-c 2026-02-17T21:25:36.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.774+0000 7fab37fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.774+0000 7fab37fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.774+0000 7fab37fff640 1 -- 10.20.193.5:0/2762579657 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab381f47e0 con 0x7fab3815df20 2026-02-17T21:25:36.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.774+0000 7fa775c66640 1 --2- 10.20.193.5:0/1411838837 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa7700c9730 0x7fa7701554a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa76000b500 tx=0x7fa76000b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.774+0000 7fa75e7fc640 10 client.?.objecter ms_handle_connect 0x7fa7700c9730 2026-02-17T21:25:36.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.774+0000 7fa75e7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.776+0000 7fab37fff640 1 --2- 10.20.193.5:0/2762579657 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fab3815df20 0x7fab3814bb90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009e50 tx=0x7fab2c004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.776+0000 7fab13fff640 10 client.?.objecter ms_handle_connect 0x7fab3815df20 2026-02-17T21:25:36.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.776+0000 7fab13fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.783+0000 7ff9b6ffd640 1 -- 10.20.193.5:0/2531019158 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0004480 con 0x7ff9d0152700 2026-02-17T21:25:36.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.783+0000 7ff9b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.783+0000 7ff9b6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:36.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.783+0000 7ff9b6ffd640 10 monclient: dump: 2026-02-17T21:25:36.785 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.785 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.786 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.786 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.786 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.786 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.786 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.786 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.786 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.786 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.783+0000 7ff9b6ffd640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.783+0000 7ff9b6ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.783+0000 7ff9b6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.783+0000 7ff9b6ffd640 1 -- 10.20.193.5:0/2531019158 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9c0014070 con 0x7ff9d0152700 2026-02-17T21:25:36.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.783+0000 7ff9b6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.783+0000 7ff9b6ffd640 1 -- 10.20.193.5:0/2531019158 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0002920 con 0x7ff9d0152700 2026-02-17T21:25:36.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.783+0000 7ff9d8771640 5 monclient: authenticate success, global_id 4510 2026-02-17T21:25:36.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.783+0000 7ff9d8771640 10 monclient: _renew_subs 2026-02-17T21:25:36.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.783+0000 7ff9d4ce3640 4 set_mon_vals no callback set 2026-02-17T21:25:36.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.783+0000 7ff9d8771640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.783+0000 7ff9d8771640 1 -- 10.20.193.5:0/2531019158 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d015a410 con 0x7ff9d0152700 2026-02-17T21:25:36.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.783+0000 7ff9b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.783+0000 7ff9b6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:36.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.783+0000 7ff9b6ffd640 10 monclient: dump: 2026-02-17T21:25:36.787 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.787 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.788 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.788 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.788 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.788 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.788 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.788 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.788 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.788 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.783+0000 7ff9d8771640 10 client.4510.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.783+0000 7ff9d8771640 10 monclient: _renew_subs 2026-02-17T21:25:36.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.783+0000 7ff9d8771640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.783+0000 7ff9d8771640 1 -- 10.20.193.5:0/2531019158 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d015a9d0 con 0x7ff9d0152700 2026-02-17T21:25:36.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.783+0000 7ff9d8771640 1 librados: init done 2026-02-17T21:25:36.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.784+0000 7ff9d8771640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.784+0000 7ff9d8771640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.784+0000 7ff9d8771640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.790 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.784+0000 7ff9d8771640 1 -- 10.20.193.5:0/2531019158 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9d006a240 con 0x7ff9d0152700 2026-02-17T21:25:36.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.785+0000 7f3c737fe640 1 -- 10.20.193.5:0/40581367 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f3c7c003a90 con 0x7f3c940c7620 2026-02-17T21:25:36.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.785+0000 7f3c737fe640 1 --2- 10.20.193.5:0/40581367 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3c60079280 0x7f3c6007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.785+0000 7f3c92ffd640 1 --2- 10.20.193.5:0/40581367 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3c60079280 0x7f3c6007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.785+0000 7f3c92ffd640 10 monclient: get_auth_request con 0x7f3c60079280 auth_method 0 2026-02-17T21:25:36.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.785+0000 7f3c737fe640 10 client.4508.objecter ms_handle_connect 0x7f3c60079280 2026-02-17T21:25:36.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.785+0000 7f3c92ffd640 1 --2- 10.20.193.5:0/40581367 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3c60079280 0x7f3c6007b740 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3c88002410 tx=0x7f3c88033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.787+0000 7f3c737fe640 1 -- 10.20.193.5:0/40581367 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f3c7c05e380 con 0x7f3c940c7620 2026-02-17T21:25:36.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.787+0000 7f3c737fe640 10 client.4508.objecter ms_dispatch2 0x7f3c94000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:36.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.787+0000 7f3c737fe640 3 client.4508.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:36.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.787+0000 7f3c737fe640 3 client.4508.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:36.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.787+0000 7f3c737fe640 20 client.4508.objecter dump_active .. 0 homeless 2026-02-17T21:25:36.792 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.791+0000 7f1efcff9640 1 -- 10.20.193.5:0/1166099527 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f1ef4035ce0 con 0x7f1f001506f0 2026-02-17T21:25:36.792 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.791+0000 7f1efcff9640 1 --2- 10.20.193.5:0/1166099527 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1ed00792d0 0x7f1ed007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.793 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.791+0000 7f1efffff640 1 --2- 10.20.193.5:0/1166099527 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1ed00792d0 0x7f1ed007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.793 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.791+0000 7f1efffff640 10 monclient: get_auth_request con 0x7f1ed00792d0 auth_method 0 2026-02-17T21:25:36.793 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.792+0000 7f1efcff9640 10 client.4498.objecter ms_handle_connect 0x7f1ed00792d0 2026-02-17T21:25:36.794 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.792+0000 7f1efffff640 1 --2- 10.20.193.5:0/1166099527 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1ed00792d0 0x7f1ed007b790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1eec006fd0 tx=0x7f1eec006d40 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.795 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.793+0000 7f3c737fe640 1 -- 10.20.193.5:0/40581367 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3c7c062a40 con 0x7f3c940c7620 2026-02-17T21:25:36.795 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.793+0000 7f3c737fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.795 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.793+0000 7f3c737fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:36.795 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.794+0000 7f1efcff9640 1 -- 10.20.193.5:0/1166099527 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f1ef4084740 con 0x7f1f001506f0 2026-02-17T21:25:36.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.794+0000 7f1efcff9640 10 client.4498.objecter ms_dispatch2 0x7f1f00000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:36.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.794+0000 7f1efcff9640 3 client.4498.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:36.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.794+0000 7f1efcff9640 3 client.4498.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:36.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.794+0000 7f1efcff9640 20 client.4498.objecter dump_active .. 0 homeless 2026-02-17T21:25:36.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.794+0000 7feaf3fff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7feaf415d950 0x7feaf41f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.797 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.794+0000 7faba88bc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7faba415c840 0x7faba41f93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.794+0000 7fa75e7fc640 1 -- 10.20.193.5:0/1411838837 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa760004480 con 0x7fa7700c9730 2026-02-17T21:25:36.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.794+0000 7fa75e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.794+0000 7fa75e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:36.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.794+0000 7fa75e7fc640 10 monclient: dump: 2026-02-17T21:25:36.798 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.798 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.798 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.798 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.798 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.798 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.799 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.799 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.799 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.799 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.794+0000 7fa75e7fc640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.794+0000 7fa75e7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.794+0000 7fa75e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.794+0000 7fa75e7fc640 1 -- 10.20.193.5:0/1411838837 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa760014070 con 0x7fa7700c9730 2026-02-17T21:25:36.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.794+0000 7fa75e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7fa75e7fc640 1 -- 10.20.193.5:0/1411838837 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa760002920 con 0x7fa7700c9730 2026-02-17T21:25:36.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7fa75e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7fa75e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:36.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7fa75e7fc640 10 monclient: dump: 2026-02-17T21:25:36.800 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.800 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.800 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.800 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.800 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.800 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.800 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.800 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.800 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.801 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.801 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7fa75ffff640 4 set_mon_vals no callback set 2026-02-17T21:25:36.801 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7fa777ef1640 5 monclient: authenticate success, global_id 4523 2026-02-17T21:25:36.801 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7fa777ef1640 10 monclient: _renew_subs 2026-02-17T21:25:36.801 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7fa777ef1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.801 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7fa777ef1640 1 -- 10.20.193.5:0/1411838837 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa770154400 con 0x7fa7700c9730 2026-02-17T21:25:36.801 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7fa777ef1640 10 client.4523.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.801 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7fa777ef1640 10 monclient: _renew_subs 2026-02-17T21:25:36.801 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7fa777ef1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.801 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7fa777ef1640 1 -- 10.20.193.5:0/1411838837 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7701549c0 con 0x7fa7700c9730 2026-02-17T21:25:36.801 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7fa777ef1640 1 librados: init done 2026-02-17T21:25:36.802 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7f40c2ffd640 1 -- 10.20.193.5:0/3006183881 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f40d0010480 con 0x7f40d80d1b60 2026-02-17T21:25:36.802 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7f34437fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f344415e060 0x7f34441f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.803 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7feaf3fff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7feaf415d950 0x7feaf41f4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:48002/0 (socket says 10.20.193.5:48002) 2026-02-17T21:25:36.803 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7feaf3fff640 1 -- 10.20.193.5:0/3745365924 learned_addr learned my addr 10.20.193.5:0/3745365924 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.803 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7feaf3fff640 10 monclient(hunting): get_auth_request con 0x7feaf415d950 auth_method 0 2026-02-17T21:25:36.803 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7feaf3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.803 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7feaf3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.803 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7feaf3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.803 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7faba88bc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7faba415c840 0x7faba41f93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:48010/0 (socket says 10.20.193.5:48010) 2026-02-17T21:25:36.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7faba88bc640 1 -- 10.20.193.5:0/1477742226 learned_addr learned my addr 10.20.193.5:0/1477742226 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7faba88bc640 10 monclient(hunting): get_auth_request con 0x7faba415c840 auth_method 0 2026-02-17T21:25:36.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7faba88bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7faba88bc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7faba88bc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7f40c2ffd640 1 --2- 10.20.193.5:0/3006183881 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f40a8079300 0x7f40a807b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7f34437fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f344415e060 0x7f34441f2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:48026/0 (socket says 10.20.193.5:48026) 2026-02-17T21:25:36.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7f34437fe640 1 -- 10.20.193.5:0/2321650236 learned_addr learned my addr 10.20.193.5:0/2321650236 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7f34437fe640 10 monclient(hunting): get_auth_request con 0x7f344415e060 auth_method 0 2026-02-17T21:25:36.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7f34437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7f34437fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7f34437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7f40dde3d640 1 --2- 10.20.193.5:0/3006183881 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f40a8079300 0x7f40a807b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7f40dde3d640 10 monclient: get_auth_request con 0x7f40a8079300 auth_method 0 2026-02-17T21:25:36.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7feaf3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7feaf3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7feaf3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7fa777ef1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7fa777ef1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7fa777ef1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7fa777ef1640 1 -- 10.20.193.5:0/1411838837 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7700c9b60 con 0x7fa7700c9730 2026-02-17T21:25:36.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7faba88bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7faba88bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.795+0000 7faba88bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.809 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.796+0000 7f40c2ffd640 10 client.4467.objecter ms_handle_connect 0x7f40a8079300 2026-02-17T21:25:36.809 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.796+0000 7f40dde3d640 1 --2- 10.20.193.5:0/3006183881 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f40a8079300 0x7f40a807b7c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f40c4006b90 tx=0x7f40c4006b20 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.809 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.797+0000 7feaf3fff640 10 monclient(hunting): handle_auth_done global_id 4529 payload 824 2026-02-17T21:25:36.809 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.797+0000 7feaf3fff640 1 -- 10.20.193.5:0/3745365924 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7feaf40d1f40 msgr2=0x7feaf41f47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.809 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.797+0000 7feaf3fff640 1 --2- 10.20.193.5:0/3745365924 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7feaf40d1f40 0x7feaf41f47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.797+0000 7feaf3fff640 1 -- 10.20.193.5:0/3745365924 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7feaf40d1b60 msgr2=0x7feaf4150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.797+0000 7feaf3fff640 1 --2- 10.20.193.5:0/3745365924 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7feaf40d1b60 0x7feaf4150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.797+0000 7feaf3fff640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.797+0000 7feaf3fff640 1 monclient: found mon.noname-c 2026-02-17T21:25:36.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.797+0000 7feaf3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.797+0000 7feaf3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.797+0000 7feaf3fff640 1 -- 10.20.193.5:0/3745365924 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf41f6c30 con 0x7feaf415d950 2026-02-17T21:25:36.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.798+0000 7f34437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.798+0000 7f34437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.798+0000 7f34437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.811 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.799+0000 7faba88bc640 10 monclient(hunting): handle_auth_done global_id 4532 payload 824 2026-02-17T21:25:36.811 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.799+0000 7faba88bc640 1 -- 10.20.193.5:0/1477742226 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faba40d1b60 msgr2=0x7faba414da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.811 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.799+0000 7faba88bc640 1 --2- 10.20.193.5:0/1477742226 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faba40d1b60 0x7faba414da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.811 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.799+0000 7faba88bc640 1 -- 10.20.193.5:0/1477742226 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7faba415d950 msgr2=0x7faba41fb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.812 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.799+0000 7faba88bc640 1 --2- 10.20.193.5:0/1477742226 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7faba415d950 0x7faba41fb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.812 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.799+0000 7faba88bc640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.812 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.799+0000 7faba88bc640 1 monclient: found mon.noname-c 2026-02-17T21:25:36.812 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.799+0000 7faba88bc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.812 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.799+0000 7faba88bc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.812 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.799+0000 7faba88bc640 1 -- 10.20.193.5:0/1477742226 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba414c6e0 con 0x7faba415c840 2026-02-17T21:25:36.812 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.801+0000 7f4373fff640 1 -- 10.20.193.5:0/526279737 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4388062c20 con 0x7f43981527c0 2026-02-17T21:25:36.812 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.801+0000 7f4373fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T21:25:36.812 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.801+0000 7f4373fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:36.813 INFO:teuthology.orchestra.run.trial005.stdout:103079215107 2026-02-17T21:25:36.813 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.801+0000 7f1efcff9640 1 -- 10.20.193.5:0/1166099527 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1ef4051070 con 0x7f1f001506f0 2026-02-17T21:25:36.813 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.801+0000 7f1efcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.813 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.801+0000 7f1efcff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:36.814 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.801+0000 7f34437fe640 10 monclient(hunting): handle_auth_done global_id 4535 payload 824 2026-02-17T21:25:36.814 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.801+0000 7f34437fe640 1 -- 10.20.193.5:0/2321650236 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f34440d1b60 msgr2=0x7f3444151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.814 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.801+0000 7f34437fe640 1 --2- 10.20.193.5:0/2321650236 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f34440d1b60 0x7f3444151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.814 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.801+0000 7f34437fe640 1 -- 10.20.193.5:0/2321650236 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f34440d1f40 msgr2=0x7f344414d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.814 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.801+0000 7f34437fe640 1 --2- 10.20.193.5:0/2321650236 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f34440d1f40 0x7f344414d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.814 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.801+0000 7f34437fe640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.814 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.801+0000 7f34437fe640 1 monclient: found mon.noname-c 2026-02-17T21:25:36.814 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.801+0000 7f34437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.814 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.801+0000 7f34437fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.814 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.801+0000 7f34437fe640 1 -- 10.20.193.5:0/2321650236 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34441f45e0 con 0x7f344415e060 2026-02-17T21:25:36.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.802+0000 7feaf3fff640 1 --2- 10.20.193.5:0/3745365924 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7feaf415d950 0x7feaf41f4ce0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feae800b9c0 tx=0x7feae800be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.802+0000 7feacffff640 10 client.?.objecter ms_handle_connect 0x7feaf415d950 2026-02-17T21:25:36.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.802+0000 7feacffff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.803+0000 7f439dda7640 10 librados: watch_flush enter 2026-02-17T21:25:36.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.803+0000 7f439dda7640 10 librados: watch_flush exit 2026-02-17T21:25:36.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.803+0000 7f439dda7640 20 client.4501.objecter shutdown clearing up homeless session... 2026-02-17T21:25:36.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.803+0000 7f439dda7640 10 client.4501.objecter successfully canceled tick 2026-02-17T21:25:36.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.803+0000 7f439dda7640 1 -- 10.20.193.5:0/526279737 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4368079300 msgr2=0x7f436807b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.803+0000 7f439dda7640 1 --2- 10.20.193.5:0/526279737 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4368079300 0x7f436807b7c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4384007fd0 tx=0x7f4384007b40 comp rx=0 tx=0).stop 2026-02-17T21:25:36.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.803+0000 7f439dda7640 10 monclient: shutdown 2026-02-17T21:25:36.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.803+0000 7f439dda7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.803+0000 7f439dda7640 1 -- 10.20.193.5:0/526279737 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f43981527c0 msgr2=0x7f43981f5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.803+0000 7f439dda7640 1 --2- 10.20.193.5:0/526279737 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f43981527c0 0x7f43981f5630 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f438800b4d0 tx=0x7f438800b9a0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.803+0000 7f439dda7640 1 -- 10.20.193.5:0/526279737 shutdown_connections 2026-02-17T21:25:36.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.803+0000 7f439dda7640 1 --2- 10.20.193.5:0/526279737 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4368079300 0x7f436807b7c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.803+0000 7f439dda7640 1 --2- 10.20.193.5:0/526279737 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f439815df20 0x7f43980cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.803+0000 7f439dda7640 1 --2- 10.20.193.5:0/526279737 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f43981527c0 0x7f43981f5630 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.803+0000 7f439dda7640 1 --2- 10.20.193.5:0/526279737 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f43980c8cf0 0x7f43981f4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.803+0000 7f439dda7640 1 -- 10.20.193.5:0/526279737 >> 10.20.193.5:0/526279737 conn(0x7f4398073030 msgr2=0x7f4398151a50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.803+0000 7f439dda7640 1 -- 10.20.193.5:0/526279737 shutdown_connections 2026-02-17T21:25:36.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.803+0000 7f439dda7640 1 -- 10.20.193.5:0/526279737 wait complete. 2026-02-17T21:25:36.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.803+0000 7f34437fe640 1 --2- 10.20.193.5:0/2321650236 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f344415e060 0x7f34441f2830 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3434009e50 tx=0x7f3434004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.803+0000 7f341bfff640 10 client.?.objecter ms_handle_connect 0x7f344415e060 2026-02-17T21:25:36.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.803+0000 7f341bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.803+0000 7f439dda7640 1 librados: shutdown 2026-02-17T21:25:36.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.803+0000 7faba88bc640 1 --2- 10.20.193.5:0/1477742226 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7faba415c840 0x7faba41f93e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fab9800b5a0 tx=0x7fab9800ba70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.803+0000 7fab91ffb640 10 client.?.objecter ms_handle_connect 0x7faba415c840 2026-02-17T21:25:36.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.803+0000 7fab91ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.804+0000 7f94077fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f940815bf30 0x7f940814c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.804+0000 7f94077fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f940815bf30 0x7f940814c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:48020/0 (socket says 10.20.193.5:48020) 2026-02-17T21:25:36.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.804+0000 7f94077fe640 1 -- 10.20.193.5:0/2248465611 learned_addr learned my addr 10.20.193.5:0/2248465611 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.804+0000 7f94077fe640 10 monclient(hunting): get_auth_request con 0x7f940815bf30 auth_method 0 2026-02-17T21:25:36.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.804+0000 7f94077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.804+0000 7f94077fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.804+0000 7f94077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.804+0000 7f40c2ffd640 1 -- 10.20.193.5:0/3006183881 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f40d005e5a0 con 0x7f40d80d1b60 2026-02-17T21:25:36.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.804+0000 7f40c2ffd640 10 client.4467.objecter ms_dispatch2 0x7f40d8000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:36.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.804+0000 7f40c2ffd640 3 client.4467.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:36.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.804+0000 7f40c2ffd640 3 client.4467.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:36.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.804+0000 7f40c2ffd640 20 client.4467.objecter dump_active .. 0 homeless 2026-02-17T21:25:36.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.804+0000 7f40c2ffd640 1 -- 10.20.193.5:0/3006183881 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f40d000d360 con 0x7f40d80d1b60 2026-02-17T21:25:36.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.804+0000 7f40c2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.804+0000 7f40c2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:36.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7f94077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7f94077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7f94077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7fa2c1ffb640 1 -- 10.20.193.5:0/2348331773 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c4013020 con 0x7fa2d40ca100 2026-02-17T21:25:36.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7fa2c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7fa2c1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:36.822 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7fa2c1ffb640 10 monclient: dump: 2026-02-17T21:25:36.822 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.822 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.822 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.822 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.822 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.822 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.822 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.822 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.822 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.822 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.822 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7fa2c1ffb640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.822 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7fa2c1ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.822 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7fa2c1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.822 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7fa2c1ffb640 1 -- 10.20.193.5:0/2348331773 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2c40044a0 con 0x7fa2d40ca100 2026-02-17T21:25:36.822 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7fa2c1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.822 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7fa2c1ffb640 1 -- 10.20.193.5:0/2348331773 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c40029c0 con 0x7fa2d40ca100 2026-02-17T21:25:36.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7fa2db47c640 5 monclient: authenticate success, global_id 4476 2026-02-17T21:25:36.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7fa2c37fe640 4 set_mon_vals no callback set 2026-02-17T21:25:36.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7fa2db47c640 10 monclient: _renew_subs 2026-02-17T21:25:36.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7fa2db47c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7fa2db47c640 1 -- 10.20.193.5:0/2348331773 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d41f8150 con 0x7fa2d40ca100 2026-02-17T21:25:36.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7fa2c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7fa2c1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:36.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7fa2c1ffb640 10 monclient: dump: 2026-02-17T21:25:36.823 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.823 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.823 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.823 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.823 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.823 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.823 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.823 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.823 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.823 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7fa2db47c640 10 client.4476.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7fa2db47c640 10 monclient: _renew_subs 2026-02-17T21:25:36.824 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7fa2db47c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.824 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7fa2db47c640 1 -- 10.20.193.5:0/2348331773 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d41634b0 con 0x7fa2d40ca100 2026-02-17T21:25:36.824 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.805+0000 7fa2db47c640 1 librados: init done 2026-02-17T21:25:36.824 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.806+0000 7fa2db47c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.824 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.806+0000 7fa2db47c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.824 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.806+0000 7fa2db47c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.824 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.806+0000 7fa2db47c640 1 -- 10.20.193.5:0/2348331773 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2d4076de0 con 0x7fa2d40ca100 2026-02-17T21:25:36.824 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.806+0000 7f0abf7fe640 1 --2- 10.20.193.5:0/569319092 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0ac015a760 0x7f0ac0160d50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0ab00098a0 tx=0x7f0ab002ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c538189336cdae47 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215108 got 103079215107 for osd.0 2026-02-17T21:25:36.825 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.812+0000 7fb0bf7fe640 1 -- 10.20.193.5:0/2971988754 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb0e01f3460 con 0x7fb0e00ce5d0 2026-02-17T21:25:36.825 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.812+0000 7fb0bf7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T21:25:36.825 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.812+0000 7fb0bf7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:36.825 INFO:teuthology.orchestra.run.trial005.stdout:115964117000 2026-02-17T21:25:36.826 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.814+0000 7fb0e55f5640 10 librados: watch_flush enter 2026-02-17T21:25:36.826 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.814+0000 7fb0e55f5640 10 librados: watch_flush exit 2026-02-17T21:25:36.826 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.814+0000 7fb0e55f5640 20 client.4461.objecter shutdown clearing up homeless session... 2026-02-17T21:25:36.826 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.814+0000 7fb0e55f5640 10 client.4461.objecter successfully canceled tick 2026-02-17T21:25:36.826 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.814+0000 7fb0e55f5640 1 -- 10.20.193.5:0/2971988754 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb0ac079300 msgr2=0x7fb0ac07b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.826 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.814+0000 7fb0e55f5640 1 --2- 10.20.193.5:0/2971988754 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb0ac079300 0x7fb0ac07b7c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8039000 tx=0x7fb0c8031000 comp rx=0 tx=0).stop 2026-02-17T21:25:36.826 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.814+0000 7fb0e55f5640 10 monclient: shutdown 2026-02-17T21:25:36.827 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.814+0000 7fb0e55f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.827 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.814+0000 7fb0e55f5640 1 -- 10.20.193.5:0/2971988754 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb0e00ce5d0 msgr2=0x7fb0e00ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.827 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.814+0000 7fb0e55f5640 1 --2- 10.20.193.5:0/2971988754 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb0e00ce5d0 0x7fb0e00ca4e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400c730 tx=0x7fb0d400cc00 comp rx=0 tx=0).stop 2026-02-17T21:25:36.827 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.814+0000 7fb0e55f5640 1 -- 10.20.193.5:0/2971988754 shutdown_connections 2026-02-17T21:25:36.827 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.814+0000 7fb0e55f5640 1 --2- 10.20.193.5:0/2971988754 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb0ac079300 0x7fb0ac07b7c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.827 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.814+0000 7fb0e55f5640 1 --2- 10.20.193.5:0/2971988754 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb0e015bf30 0x7fb0e01f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.827 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.814+0000 7fb0e55f5640 1 --2- 10.20.193.5:0/2971988754 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb0e00ceef0 0x7fb0e01f4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.827 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.814+0000 7fb0e55f5640 1 --2- 10.20.193.5:0/2971988754 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb0e00ce5d0 0x7fb0e00ca4e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.827 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.814+0000 7fb0e55f5640 1 -- 10.20.193.5:0/2971988754 >> 10.20.193.5:0/2971988754 conn(0x7fb0e0073030 msgr2=0x7fb0e0150460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.827 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.814+0000 7fb0e55f5640 1 -- 10.20.193.5:0/2971988754 shutdown_connections 2026-02-17T21:25:36.827 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.814+0000 7fb0e55f5640 1 -- 10.20.193.5:0/2971988754 wait complete. 2026-02-17T21:25:36.827 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.814+0000 7fb0e55f5640 1 librados: shutdown 2026-02-17T21:25:36.827 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.819+0000 7f0abeffd640 1 -- 10.20.193.5:0/569319092 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab003c070 con 0x7f0ac015a760 2026-02-17T21:25:36.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.819+0000 7f0abeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.819+0000 7f0abeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:36.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.819+0000 7f0abeffd640 10 monclient: dump: 2026-02-17T21:25:36.828 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.828 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.828 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.828 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.828 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.828 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.828 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.828 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.828 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.828 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.819+0000 7f0abeffd640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.819+0000 7f0abeffd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.819+0000 7f0abeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.819+0000 7f0abeffd640 1 -- 10.20.193.5:0/569319092 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ab002fb70 con 0x7f0ac015a760 2026-02-17T21:25:36.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.819+0000 7f0abeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.819+0000 7f0abeffd640 1 -- 10.20.193.5:0/569319092 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0037440 con 0x7f0ac015a760 2026-02-17T21:25:36.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.819+0000 7f0ac688f640 5 monclient: authenticate success, global_id 4473 2026-02-17T21:25:36.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.819+0000 7f0ac688f640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.819+0000 7f0ac688f640 4 set_mon_vals no callback set 2026-02-17T21:25:36.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.819+0000 7f0abeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.819+0000 7f0abeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:36.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.819+0000 7f0abeffd640 10 monclient: dump: 2026-02-17T21:25:36.829 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.829 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.829 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.829 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.829 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.829 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.829 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.829 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.829 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.829 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.820+0000 7f9406ffd640 1 --2- 10.20.193.5:0/2248465611 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f94080ce5d0 0x7f94080d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.820+0000 7f0ac688f640 10 monclient: shutdown 2026-02-17T21:25:36.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.820+0000 7f0ac688f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.820+0000 7f0ac688f640 1 -- 10.20.193.5:0/569319092 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0ac015a760 msgr2=0x7f0ac0160d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.820+0000 7f0ac688f640 1 --2- 10.20.193.5:0/569319092 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0ac015a760 0x7f0ac0160d50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0ab00098a0 tx=0x7f0ab002ee60 comp rx=0 tx=0).stop 2026-02-17T21:25:36.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.820+0000 7f0ac688f640 1 -- 10.20.193.5:0/569319092 shutdown_connections 2026-02-17T21:25:36.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.820+0000 7f0ac688f640 1 --2- 10.20.193.5:0/569319092 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0ac015a760 0x7f0ac0160d50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.820+0000 7f0ac688f640 1 -- 10.20.193.5:0/569319092 >> 10.20.193.5:0/569319092 conn(0x7f0ac006c890 msgr2=0x7f0ac006cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.820+0000 7f0ac688f640 1 -- 10.20.193.5:0/569319092 shutdown_connections 2026-02-17T21:25:36.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.820+0000 7f0ac688f640 1 -- 10.20.193.5:0/569319092 wait complete. 2026-02-17T21:25:36.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.820+0000 7f9406ffd640 10 monclient(hunting): get_auth_request con 0x7f94080ce5d0 auth_method 0 2026-02-17T21:25:36.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.820+0000 7f9406ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.820+0000 7f9406ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.820+0000 7f9406ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f0ac688f640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f0ac688f640 10 monclient: monmap: 2026-02-17T21:25:36.831 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.831 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.831 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.831 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.831 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.831 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.831 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.831 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.831 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.831 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f0ac688f640 1 librados: starting msgr at 2026-02-17T21:25:36.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f0ac688f640 1 librados: starting objecter 2026-02-17T21:25:36.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f0ac688f640 1 Processor -- start 2026-02-17T21:25:36.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f0ac688f640 1 -- start start 2026-02-17T21:25:36.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f0ac688f640 1 librados: setting wanted keys 2026-02-17T21:25:36.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f0ac688f640 1 librados: calling monclient init 2026-02-17T21:25:36.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f0ac688f640 10 monclient: init 2026-02-17T21:25:36.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f0ac688f640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f0ac688f640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:25:36.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f9406ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f9406ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f9406ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f0ac688f640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0ac015a380 0x7f0ac00c1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f0ac688f640 10 monclient(hunting): picked mon.noname-b con 0x7f0ac015a380 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f0ac688f640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0ac0162dc0 0x7f0ac01ec210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f0ac688f640 10 monclient(hunting): picked mon.noname-c con 0x7f0ac0162dc0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f0ac688f640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0ac0155690 0x7f0ac0155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f0ac688f640 10 monclient(hunting): picked mon.noname-a con 0x7f0ac0155690 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f0ac688f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f0ac688f640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac0163f60 con 0x7f0ac0155690 2026-02-17T21:25:36.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f0ac688f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f0ac688f640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac0162220 con 0x7f0ac015a380 2026-02-17T21:25:36.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f0ac688f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f0ac688f640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac01640e0 con 0x7f0ac0162dc0 2026-02-17T21:25:36.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f0ac688f640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.821+0000 7f0ac688f640 10 monclient(hunting): authenticate will time out at 1042.386730s 2026-02-17T21:25:36.834 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117001 got 115964117000 for osd.3 2026-02-17T21:25:36.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.863+0000 7fbd93ada640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T21:25:36.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.863+0000 7fbd93ada640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T21:25:36.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.863+0000 7fbd93ada640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.863+0000 7fbd93ada640 1 -- 10.20.193.5:0/2021679235 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fbd8c0c88b0 con 0x7fbd8c15b290 2026-02-17T21:25:36.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.885+0000 7f3c99596640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T21:25:36.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.885+0000 7f3c99596640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T21:25:36.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.885+0000 7f3c99596640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.885+0000 7f3c99596640 1 -- 10.20.193.5:0/40581367 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f3c940c6860 con 0x7f3c940c7620 2026-02-17T21:25:36.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.890+0000 7f1f06488640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T21:25:36.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.890+0000 7f1f06488640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T21:25:36.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.890+0000 7f1f06488640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.890+0000 7f1f06488640 1 -- 10.20.193.5:0/1166099527 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f1f0014a850 con 0x7f1f001506f0 2026-02-17T21:25:36.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.895+0000 7f40e08c9640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T21:25:36.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.895+0000 7f40e08c9640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T21:25:36.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.895+0000 7f40e08c9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:36.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.895+0000 7f40e08c9640 1 -- 10.20.193.5:0/3006183881 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 15} v 0) -- 0x7f40d81597e0 con 0x7f40d80d1b60 2026-02-17T21:25:36.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe15bfff640 1 -- 10.20.193.5:0/4133187899 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16003c070 con 0x7fe16c0d1f40 2026-02-17T21:25:36.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe15bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe15bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:36.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe15bfff640 10 monclient: dump: 2026-02-17T21:25:36.902 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.902 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.902 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.902 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.902 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.902 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.902 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.903 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.903 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.903 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe15bfff640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe15bfff640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe15bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe15bfff640 1 -- 10.20.193.5:0/4133187899 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe16002fb70 con 0x7fe16c0d1f40 2026-02-17T21:25:36.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe173596640 5 monclient: authenticate success, global_id 4507 2026-02-17T21:25:36.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe173596640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:36.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe15bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe15bfff640 1 -- 10.20.193.5:0/4133187899 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe160037440 con 0x7fe16c0d1f40 2026-02-17T21:25:36.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe173596640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:36.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe15bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe173596640 4 set_mon_vals no callback set 2026-02-17T21:25:36.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe15bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:36.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe15bfff640 10 monclient: dump: 2026-02-17T21:25:36.904 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.904 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.904 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.904 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.904 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.904 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.904 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.904 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.905 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.905 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7f94067fc640 1 --2- 10.20.193.5:0/2248465611 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f94080ceef0 0x7f940814bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe173596640 10 monclient: shutdown 2026-02-17T21:25:36.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe173596640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe173596640 1 -- 10.20.193.5:0/4133187899 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe16c0d1f40 msgr2=0x7fe16c15c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe173596640 1 --2- 10.20.193.5:0/4133187899 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe16c0d1f40 0x7fe16c15c840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe1600098a0 tx=0x7fe16002ee60 comp rx=0 tx=0).stop 2026-02-17T21:25:36.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7f94067fc640 10 monclient(hunting): get_auth_request con 0x7f94080ceef0 auth_method 0 2026-02-17T21:25:36.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7f94067fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7f94067fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7f94067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe173596640 1 -- 10.20.193.5:0/4133187899 shutdown_connections 2026-02-17T21:25:36.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe173596640 1 --2- 10.20.193.5:0/4133187899 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe16c0d1f40 0x7fe16c15c840 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe173596640 1 -- 10.20.193.5:0/4133187899 >> 10.20.193.5:0/4133187899 conn(0x7fe16c06d9b0 msgr2=0x7fe16c06ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe173596640 1 -- 10.20.193.5:0/4133187899 shutdown_connections 2026-02-17T21:25:36.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.900+0000 7fe173596640 1 -- 10.20.193.5:0/4133187899 wait complete. 2026-02-17T21:25:36.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.901+0000 7f94067fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.901+0000 7f94067fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.901+0000 7f94067fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.901+0000 7fe173596640 10 monclient: build_initial_monmap 2026-02-17T21:25:36.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.901+0000 7fe173596640 10 monclient: monmap: 2026-02-17T21:25:36.910 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:36.910 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:36.910 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:36.910 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:36.911 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:36.911 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.911 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:36.911 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:36.911 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:36.911 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.901+0000 7fe173596640 1 librados: starting msgr at 2026-02-17T21:25:36.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.901+0000 7fe173596640 1 librados: starting objecter 2026-02-17T21:25:36.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.901+0000 7fe173596640 1 Processor -- start 2026-02-17T21:25:36.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.901+0000 7fe173596640 1 -- start start 2026-02-17T21:25:36.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.901+0000 7fe173596640 1 librados: setting wanted keys 2026-02-17T21:25:36.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.901+0000 7fe173596640 1 librados: calling monclient init 2026-02-17T21:25:36.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.901+0000 7fe173596640 10 monclient: init 2026-02-17T21:25:36.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.902+0000 7fe173596640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:36.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.902+0000 7fe173596640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:25:36.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.902+0000 7fe173596640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe16c0d1b60 0x7fe16c15b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.902+0000 7fe173596640 10 monclient(hunting): picked mon.noname-a con 0x7fe16c0d1b60 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:36.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.902+0000 7fe173596640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe16c0d1f40 0x7fe16c1f6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.902+0000 7fe173596640 10 monclient(hunting): picked mon.noname-c con 0x7fe16c0d1f40 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:36.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.902+0000 7fe173596640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe16c15d950 0x7fe16c0cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.902+0000 7fe173596640 10 monclient(hunting): picked mon.noname-b con 0x7fe16c15d950 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:36.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.902+0000 7fe173596640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.902+0000 7fe173596640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe16c15d4c0 con 0x7fe16c0d1b60 2026-02-17T21:25:36.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.902+0000 7fe173596640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.902+0000 7fe173596640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe16c0ca460 con 0x7fe16c15d950 2026-02-17T21:25:36.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.902+0000 7fe173596640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:36.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.902+0000 7fe173596640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe16c06e7b0 con 0x7fe16c0d1f40 2026-02-17T21:25:36.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.902+0000 7fe173596640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:36.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.902+0000 7fe173596640 10 monclient(hunting): authenticate will time out at 1042.467273s 2026-02-17T21:25:36.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.905+0000 7f94077fe640 10 monclient(hunting): handle_auth_done global_id 4538 payload 824 2026-02-17T21:25:36.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.905+0000 7f94077fe640 1 -- 10.20.193.5:0/2248465611 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f94080ceef0 msgr2=0x7f940814bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.905+0000 7f94077fe640 1 --2- 10.20.193.5:0/2248465611 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f94080ceef0 0x7f940814bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.905+0000 7f94077fe640 1 -- 10.20.193.5:0/2248465611 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f94080ce5d0 msgr2=0x7f94080d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.905+0000 7f94077fe640 1 --2- 10.20.193.5:0/2248465611 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f94080ce5d0 0x7f94080d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.905+0000 7f94077fe640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.905+0000 7f94077fe640 1 monclient: found mon.noname-c 2026-02-17T21:25:36.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.905+0000 7f94077fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.905+0000 7f94077fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.905+0000 7f94077fe640 1 -- 10.20.193.5:0/2248465611 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94081f3b70 con 0x7f940815bf30 2026-02-17T21:25:36.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f341bfff640 1 -- 10.20.193.5:0/2321650236 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3434046020 con 0x7f344415e060 2026-02-17T21:25:36.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f341bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f341bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:36.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f341bfff640 10 monclient: dump: 2026-02-17T21:25:36.917 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.917 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.917 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.918 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.918 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.918 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.918 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.918 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.918 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.918 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f341bfff640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f341bfff640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f341bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f341bfff640 1 -- 10.20.193.5:0/2321650236 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3434037de0 con 0x7f344415e060 2026-02-17T21:25:36.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f341bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f341bfff640 1 -- 10.20.193.5:0/2321650236 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3434041690 con 0x7f344415e060 2026-02-17T21:25:36.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f3449a85640 5 monclient: authenticate success, global_id 4535 2026-02-17T21:25:36.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f34417fa640 4 set_mon_vals no callback set 2026-02-17T21:25:36.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f3449a85640 10 monclient: _renew_subs 2026-02-17T21:25:36.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f3449a85640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f3449a85640 1 -- 10.20.193.5:0/2321650236 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34441f1a70 con 0x7f344415e060 2026-02-17T21:25:36.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f341bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f341bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:36.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f341bfff640 10 monclient: dump: 2026-02-17T21:25:36.920 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.920 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.920 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.920 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.920 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.920 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.920 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.920 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.920 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.920 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f3449a85640 10 client.4535.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f3449a85640 10 monclient: _renew_subs 2026-02-17T21:25:36.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f3449a85640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f3449a85640 1 -- 10.20.193.5:0/2321650236 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34441f2030 con 0x7f344415e060 2026-02-17T21:25:36.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f3449a85640 1 librados: init done 2026-02-17T21:25:36.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f3449a85640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f3449a85640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f3449a85640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.908+0000 7f3449a85640 1 -- 10.20.193.5:0/2321650236 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f344415c840 con 0x7f344415e060 2026-02-17T21:25:36.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.909+0000 7ff9b6ffd640 1 -- 10.20.193.5:0/2531019158 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7ff9c0019460 con 0x7ff9d0152700 2026-02-17T21:25:36.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.909+0000 7ff9b6ffd640 1 --2- 10.20.193.5:0/2531019158 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff9a00792d0 0x7ff9a007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.910+0000 7ff9d5ce5640 1 --2- 10.20.193.5:0/2531019158 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff9a00792d0 0x7ff9a007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.910+0000 7ff9d5ce5640 10 monclient: get_auth_request con 0x7ff9a00792d0 auth_method 0 2026-02-17T21:25:36.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.910+0000 7ff9d5ce5640 1 --2- 10.20.193.5:0/2531019158 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff9a00792d0 0x7ff9a007b790 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0149d60 tx=0x7ff9c4006cf0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.910+0000 7ff9b6ffd640 10 client.4510.objecter ms_handle_connect 0x7ff9a00792d0 2026-02-17T21:25:36.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7ff9b6ffd640 1 -- 10.20.193.5:0/2531019158 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7ff9c005e200 con 0x7ff9d0152700 2026-02-17T21:25:36.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7ff9b6ffd640 10 client.4510.objecter ms_dispatch2 0x7ff9d0000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:36.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7ff9b6ffd640 3 client.4510.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:36.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7ff9b6ffd640 3 client.4510.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:36.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7ff9b6ffd640 20 client.4510.objecter dump_active .. 0 homeless 2026-02-17T21:25:36.925 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7fab91ffb640 1 -- 10.20.193.5:0/1477742226 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab98012070 con 0x7faba415c840 2026-02-17T21:25:36.925 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7fab91ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.925 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7fab91ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:36.925 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7fab91ffb640 10 monclient: dump: 2026-02-17T21:25:36.926 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.926 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.926 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.926 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.926 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.926 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.926 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.926 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.926 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.926 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7fab91ffb640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7fab91ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7fab91ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7fab91ffb640 1 -- 10.20.193.5:0/1477742226 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab980044a0 con 0x7faba415c840 2026-02-17T21:25:36.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7fab91ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7fab91ffb640 1 -- 10.20.193.5:0/1477742226 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab980029c0 con 0x7faba415c840 2026-02-17T21:25:36.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7fab91ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7fab91ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:36.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7fab91ffb640 10 monclient: dump: 2026-02-17T21:25:36.927 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.927 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.927 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.928 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.928 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.928 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.928 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.928 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.928 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.928 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.928 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7fab937fe640 4 set_mon_vals no callback set 2026-02-17T21:25:36.928 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7fabab348640 5 monclient: authenticate success, global_id 4532 2026-02-17T21:25:36.928 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7fabab348640 10 monclient: _renew_subs 2026-02-17T21:25:36.928 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7fabab348640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.928 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7fabab348640 1 -- 10.20.193.5:0/1477742226 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faba414c9c0 con 0x7faba415c840 2026-02-17T21:25:36.928 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7fabab348640 10 client.4532.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.929 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7fabab348640 10 monclient: _renew_subs 2026-02-17T21:25:36.929 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7fabab348640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.929 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7fabab348640 1 -- 10.20.193.5:0/1477742226 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faba414cf80 con 0x7faba415c840 2026-02-17T21:25:36.929 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.915+0000 7fabab348640 1 librados: init done 2026-02-17T21:25:36.929 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.916+0000 7fabab348640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.929 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.916+0000 7fabab348640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.929 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.916+0000 7fabab348640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:36.929 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.916+0000 7fabab348640 1 -- 10.20.193.5:0/1477742226 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faba40d1f40 con 0x7faba415c840 2026-02-17T21:25:36.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.916+0000 7fa75e7fc640 1 -- 10.20.193.5:0/1411838837 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fa760019460 con 0x7fa7700c9730 2026-02-17T21:25:36.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.916+0000 7fa75e7fc640 1 --2- 10.20.193.5:0/1411838837 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa740079300 0x7fa74007b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.916+0000 7fa775465640 1 --2- 10.20.193.5:0/1411838837 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa740079300 0x7fa74007b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.916+0000 7fa775465640 10 monclient: get_auth_request con 0x7fa740079300 auth_method 0 2026-02-17T21:25:36.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.917+0000 7fa75e7fc640 10 client.4523.objecter ms_handle_connect 0x7fa740079300 2026-02-17T21:25:36.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.917+0000 7fa775465640 1 --2- 10.20.193.5:0/1411838837 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa740079300 0x7fa74007b7c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa7700cbf90 tx=0x7fa764031000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.917+0000 7fa75e7fc640 1 -- 10.20.193.5:0/1411838837 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fa76005e150 con 0x7fa7700c9730 2026-02-17T21:25:36.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.917+0000 7fa75e7fc640 10 client.4523.objecter ms_dispatch2 0x7fa770000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:36.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.917+0000 7fa75e7fc640 3 client.4523.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:36.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.917+0000 7fa75e7fc640 3 client.4523.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:36.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.918+0000 7fa75e7fc640 20 client.4523.objecter dump_active .. 0 homeless 2026-02-17T21:25:36.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.922+0000 7ff9b6ffd640 1 -- 10.20.193.5:0/2531019158 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff9d006a240 con 0x7ff9d0152700 2026-02-17T21:25:36.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.922+0000 7ff9b6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.922+0000 7ff9b6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:36.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.924+0000 7f94077fe640 1 --2- 10.20.193.5:0/2248465611 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f940815bf30 0x7f940814c420 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f93f800b990 tx=0x7f93f800be60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.924+0000 7f93dffff640 10 client.?.objecter ms_handle_connect 0x7f940815bf30 2026-02-17T21:25:36.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.924+0000 7f93dffff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.924+0000 7fa75e7fc640 1 -- 10.20.193.5:0/1411838837 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa76000e360 con 0x7fa7700c9730 2026-02-17T21:25:36.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.924+0000 7fa75e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.924+0000 7fa75e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:36.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.924+0000 7f1efcff9640 1 -- 10.20.193.5:0/1166099527 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1ef4037e20 con 0x7f1f001506f0 2026-02-17T21:25:36.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.924+0000 7f1efcff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T21:25:36.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.924+0000 7f1efcff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:36.933 INFO:teuthology.orchestra.run.trial005.stdout:98784247812 2026-02-17T21:25:36.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.926+0000 7f1f06488640 10 librados: watch_flush enter 2026-02-17T21:25:36.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.926+0000 7f1f06488640 10 librados: watch_flush exit 2026-02-17T21:25:36.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.926+0000 7f1f06488640 20 client.4498.objecter shutdown clearing up homeless session... 2026-02-17T21:25:36.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.926+0000 7f1f06488640 10 client.4498.objecter successfully canceled tick 2026-02-17T21:25:36.934 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.926+0000 7fe171b0c640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe16c15d950 0x7fe16c0cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.934 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.926+0000 7f1f06488640 1 -- 10.20.193.5:0/1166099527 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1ed00792d0 msgr2=0x7f1ed007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.934 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.926+0000 7f1f06488640 1 --2- 10.20.193.5:0/1166099527 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1ed00792d0 0x7f1ed007b790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1eec006fd0 tx=0x7f1eec006d40 comp rx=0 tx=0).stop 2026-02-17T21:25:36.934 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.926+0000 7f1f06488640 10 monclient: shutdown 2026-02-17T21:25:36.934 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.926+0000 7f1f06488640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.934 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.926+0000 7f1f06488640 1 -- 10.20.193.5:0/1166099527 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1f001506f0 msgr2=0x7f1f001f4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.934 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.926+0000 7f1f06488640 1 --2- 10.20.193.5:0/1166099527 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1f001506f0 0x7f1f001f4cf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1ef403a040 tx=0x7f1ef4004b40 comp rx=0 tx=0).stop 2026-02-17T21:25:36.935 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.926+0000 7f1f06488640 1 -- 10.20.193.5:0/1166099527 shutdown_connections 2026-02-17T21:25:36.935 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.926+0000 7f1f06488640 1 --2- 10.20.193.5:0/1166099527 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1ed00792d0 0x7f1ed007b790 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.935 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.926+0000 7f1f06488640 1 --2- 10.20.193.5:0/1166099527 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1f001506f0 0x7f1f001f4cf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.935 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.926+0000 7f1f06488640 1 --2- 10.20.193.5:0/1166099527 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1f00150310 0x7f1f000742f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.935 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.926+0000 7f1f06488640 1 --2- 10.20.193.5:0/1166099527 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1f000c5bf0 0x7f1f001f7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.935 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.926+0000 7f0abffff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0ac015a380 0x7f0ac00c1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.936 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.926+0000 7f1f06488640 1 -- 10.20.193.5:0/1166099527 >> 10.20.193.5:0/1166099527 conn(0x7f1f000ce070 msgr2=0x7f1f0014e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.936 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.926+0000 7f1f06488640 1 -- 10.20.193.5:0/1166099527 shutdown_connections 2026-02-17T21:25:36.936 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.926+0000 7f1f06488640 1 -- 10.20.193.5:0/1166099527 wait complete. 2026-02-17T21:25:36.936 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.926+0000 7f1f06488640 1 librados: shutdown 2026-02-17T21:25:36.936 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.927+0000 7fe171b0c640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe16c15d950 0x7fe16c0cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:38006/0 (socket says 10.20.193.5:38006) 2026-02-17T21:25:36.936 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.927+0000 7fe171b0c640 1 -- 10.20.193.5:0/3875883530 learned_addr learned my addr 10.20.193.5:0/3875883530 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.936 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.927+0000 7fe171b0c640 10 monclient(hunting): get_auth_request con 0x7fe16c15d950 auth_method 0 2026-02-17T21:25:36.936 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.927+0000 7fe171b0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.936 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.927+0000 7fe171b0c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.937 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.927+0000 7fe171b0c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.937 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.927+0000 7f0abffff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0ac015a380 0x7f0ac00c1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:38000/0 (socket says 10.20.193.5:38000) 2026-02-17T21:25:36.937 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.927+0000 7f0abffff640 1 -- 10.20.193.5:0/829767381 learned_addr learned my addr 10.20.193.5:0/829767381 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:36.937 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.927+0000 7f0abffff640 10 monclient(hunting): get_auth_request con 0x7f0ac015a380 auth_method 0 2026-02-17T21:25:36.937 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.927+0000 7f0abffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:36.937 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.927+0000 7f0abffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:36.937 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.927+0000 7f0abffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:36.938 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.927+0000 7fe171b0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.938 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.927+0000 7fe171b0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.938 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.927+0000 7fe171b0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.938 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.927+0000 7f0abffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:36.938 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.927+0000 7f0abffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:36.938 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.927+0000 7f0abffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:36.938 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.927+0000 7f3c737fe640 1 -- 10.20.193.5:0/40581367 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3c7c062340 con 0x7f3c940c7620 2026-02-17T21:25:36.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.927+0000 7f3c737fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T21:25:36.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.927+0000 7f3c737fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:36.939 INFO:teuthology.orchestra.run.trial005.stdout:120259084293 2026-02-17T21:25:36.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.929+0000 7fe171b0c640 10 monclient(hunting): handle_auth_done global_id 4516 payload 824 2026-02-17T21:25:36.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.929+0000 7fe171b0c640 1 -- 10.20.193.5:0/3875883530 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe16c0d1f40 msgr2=0x7fe16c1f6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.929+0000 7fe171b0c640 1 --2- 10.20.193.5:0/3875883530 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe16c0d1f40 0x7fe16c1f6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.929+0000 7fe171b0c640 1 -- 10.20.193.5:0/3875883530 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe16c0d1b60 msgr2=0x7fe16c15b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.929+0000 7fe171b0c640 1 --2- 10.20.193.5:0/3875883530 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe16c0d1b60 0x7fe16c15b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.929+0000 7fe171b0c640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.929+0000 7fe171b0c640 1 monclient: found mon.noname-b 2026-02-17T21:25:36.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.929+0000 7fe171b0c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.929+0000 7fe171b0c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.929+0000 7fe171b0c640 1 -- 10.20.193.5:0/3875883530 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16c0ccaa0 con 0x7fe16c15d950 2026-02-17T21:25:36.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.929+0000 7f3c99596640 10 librados: watch_flush enter 2026-02-17T21:25:36.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f3c99596640 10 librados: watch_flush exit 2026-02-17T21:25:36.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f3c99596640 20 client.4508.objecter shutdown clearing up homeless session... 2026-02-17T21:25:36.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f3c99596640 10 client.4508.objecter successfully canceled tick 2026-02-17T21:25:36.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f3c99596640 1 -- 10.20.193.5:0/40581367 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3c60079280 msgr2=0x7f3c6007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f3c99596640 1 --2- 10.20.193.5:0/40581367 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3c60079280 0x7f3c6007b740 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3c88002410 tx=0x7f3c88033000 comp rx=0 tx=0).stop 2026-02-17T21:25:36.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f3c99596640 10 monclient: shutdown 2026-02-17T21:25:36.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f3c99596640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f3c99596640 1 -- 10.20.193.5:0/40581367 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3c940c7620 msgr2=0x7f3c941f6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f3c99596640 1 --2- 10.20.193.5:0/40581367 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3c940c7620 0x7f3c941f6740 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00c450 tx=0x7f3c7c00c920 comp rx=0 tx=0).stop 2026-02-17T21:25:36.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f3c99596640 1 -- 10.20.193.5:0/40581367 shutdown_connections 2026-02-17T21:25:36.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f3c99596640 1 --2- 10.20.193.5:0/40581367 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3c60079280 0x7f3c6007b740 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f3c99596640 1 --2- 10.20.193.5:0/40581367 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c94163810 0x7f3c941f6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f3c99596640 1 --2- 10.20.193.5:0/40581367 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3c940c7620 0x7f3c941f6740 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.942 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f3c99596640 1 --2- 10.20.193.5:0/40581367 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c940c7240 0x7f3c9414c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.942 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f3c99596640 1 -- 10.20.193.5:0/40581367 >> 10.20.193.5:0/40581367 conn(0x7f3c940c9f40 msgr2=0x7f3c940ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.942 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f3c99596640 1 -- 10.20.193.5:0/40581367 shutdown_connections 2026-02-17T21:25:36.942 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f3c99596640 1 -- 10.20.193.5:0/40581367 wait complete. 2026-02-17T21:25:36.942 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f3c99596640 1 librados: shutdown 2026-02-17T21:25:36.942 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f0abffff640 10 monclient(hunting): handle_auth_done global_id 4519 payload 824 2026-02-17T21:25:36.942 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f0abffff640 1 -- 10.20.193.5:0/829767381 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0ac0162dc0 msgr2=0x7f0ac01ec210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.942 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f0abffff640 1 --2- 10.20.193.5:0/829767381 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0ac0162dc0 0x7f0ac01ec210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f0abffff640 1 -- 10.20.193.5:0/829767381 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0ac0155690 msgr2=0x7f0ac0155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f0abffff640 1 --2- 10.20.193.5:0/829767381 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0ac0155690 0x7f0ac0155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f0abffff640 10 monclient: _finish_hunting 0 2026-02-17T21:25:36.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f0abffff640 1 monclient: found mon.noname-b 2026-02-17T21:25:36.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f0abffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:36.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f0abffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.930+0000 7f0abffff640 1 -- 10.20.193.5:0/829767381 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac015da50 con 0x7f0ac015a380 2026-02-17T21:25:36.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.932+0000 7fe171b0c640 1 --2- 10.20.193.5:0/3875883530 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe16c15d950 0x7fe16c0cbfb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe16800cbe0 tx=0x7fe16800a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.932+0000 7fe159ffb640 10 client.?.objecter ms_handle_connect 0x7fe16c15d950 2026-02-17T21:25:36.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.932+0000 7fe159ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.932+0000 7f0abffff640 1 --2- 10.20.193.5:0/829767381 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0ac015a380 0x7f0ac00c1590 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0aac00c4d0 tx=0x7f0aac00c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.932+0000 7f0abcff9640 10 client.?.objecter ms_handle_connect 0x7f0ac015a380 2026-02-17T21:25:36.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.932+0000 7f0abcff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:36.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247813 got 98784247812 for osd.7 2026-02-17T21:25:36.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7f0abcff9640 1 -- 10.20.193.5:0/829767381 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac017070 con 0x7f0ac015a380 2026-02-17T21:25:36.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7f0abcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7f0abcff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:36.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7f0abcff9640 10 monclient: dump: 2026-02-17T21:25:36.945 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.945 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.945 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.945 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.945 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.945 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.945 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.945 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.945 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.945 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7f0abcff9640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7f0abcff9640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7f0abcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7f0ac688f640 5 monclient: authenticate success, global_id 4519 2026-02-17T21:25:36.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7f0ac688f640 10 monclient: _renew_subs 2026-02-17T21:25:36.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7f0ac688f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7f0ac688f640 1 -- 10.20.193.5:0/829767381 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ac01ec750 con 0x7f0ac015a380 2026-02-17T21:25:36.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7f0ac688f640 10 client.4519.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7f0ac688f640 10 monclient: _renew_subs 2026-02-17T21:25:36.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7f0ac688f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7f0ac688f640 1 -- 10.20.193.5:0/829767381 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ac01ecfa0 con 0x7f0ac015a380 2026-02-17T21:25:36.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7f0ac688f640 1 librados: init done 2026-02-17T21:25:36.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7fe159ffb640 1 -- 10.20.193.5:0/3875883530 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16800ad60 con 0x7fe16c15d950 2026-02-17T21:25:36.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7fe159ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7fe159ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:36.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7fe159ffb640 10 monclient: dump: 2026-02-17T21:25:36.947 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.947 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.947 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.947 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.947 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.947 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.947 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.947 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.947 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.947 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7fe159ffb640 10 monclient: _finish_auth 0 2026-02-17T21:25:36.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7fe159ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:25:36.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7fe159ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:36.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7fe159ffb640 1 -- 10.20.193.5:0/3875883530 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe168003a70 con 0x7fe16c15d950 2026-02-17T21:25:36.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7fe159ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7fe159ffb640 1 -- 10.20.193.5:0/3875883530 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe168003e60 con 0x7fe16c15d950 2026-02-17T21:25:36.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7fe159ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7fe159ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:36.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7fe159ffb640 10 monclient: dump: 2026-02-17T21:25:36.948 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.948 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.948 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.948 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.948 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.948 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.948 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.948 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.948 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.948 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7fe15b7fe640 4 set_mon_vals no callback set 2026-02-17T21:25:36.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7fe173596640 5 monclient: authenticate success, global_id 4516 2026-02-17T21:25:36.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7fe173596640 10 monclient: _renew_subs 2026-02-17T21:25:36.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7fe173596640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7fe173596640 1 -- 10.20.193.5:0/3875883530 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe16c0ccd80 con 0x7fe16c15d950 2026-02-17T21:25:36.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7fe173596640 10 client.4516.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:36.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7fe173596640 10 monclient: _renew_subs 2026-02-17T21:25:36.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7fe173596640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7fe173596640 1 -- 10.20.193.5:0/3875883530 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe16c0cd340 con 0x7fe16c15d950 2026-02-17T21:25:36.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7fe173596640 1 librados: init done 2026-02-17T21:25:36.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7f0ac688f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7f0ac688f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7f0ac688f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.935+0000 7f0ac688f640 1 -- 10.20.193.5:0/829767381 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ac0160d50 con 0x7f0ac015a380 2026-02-17T21:25:36.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.936+0000 7f0abcff9640 1 -- 10.20.193.5:0/829767381 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0aac005de0 con 0x7f0ac015a380 2026-02-17T21:25:36.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.936+0000 7f0abcff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:36.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.936+0000 7f0abcff9640 1 -- 10.20.193.5:0/829767381 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac002a20 con 0x7f0ac015a380 2026-02-17T21:25:36.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.936+0000 7f0abcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:36.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.936+0000 7f0abcff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:36.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.936+0000 7f0abe7fc640 4 set_mon_vals no callback set 2026-02-17T21:25:36.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.936+0000 7f0abcff9640 10 monclient: dump: 2026-02-17T21:25:36.949 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:36.949 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:36.949 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.949 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:36.949 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:36.949 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:36.949 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:36.950 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:36.950 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:36.950 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:36.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.936+0000 7fe173596640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.936+0000 7fe173596640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.936+0000 7fe173596640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:36.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.936+0000 7fe173596640 1 -- 10.20.193.5:0/3875883530 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe16c15c840 con 0x7fe16c15d950 2026-02-17T21:25:36.951 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084295 got 120259084293 for osd.4 2026-02-17T21:25:36.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.940+0000 7fa2c1ffb640 1 -- 10.20.193.5:0/2348331773 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fa2c4002b60 con 0x7fa2d40ca100 2026-02-17T21:25:36.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.940+0000 7fa2c1ffb640 1 --2- 10.20.193.5:0/2348331773 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa2a40792d0 0x7fa2a407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:36.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.941+0000 7fa2d89f0640 1 --2- 10.20.193.5:0/2348331773 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa2a40792d0 0x7fa2a407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:36.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.941+0000 7fa2d89f0640 10 monclient: get_auth_request con 0x7fa2a40792d0 auth_method 0 2026-02-17T21:25:36.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.941+0000 7fa2d89f0640 1 --2- 10.20.193.5:0/2348331773 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa2a40792d0 0x7fa2a407b790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa2d415aba0 tx=0x7fa2c8031000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:36.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.941+0000 7fa2c1ffb640 10 client.4476.objecter ms_handle_connect 0x7fa2a40792d0 2026-02-17T21:25:36.953 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.952+0000 7fa2c1ffb640 1 -- 10.20.193.5:0/2348331773 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fa2c405e3d0 con 0x7fa2d40ca100 2026-02-17T21:25:36.953 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.952+0000 7fa2c1ffb640 10 client.4476.objecter ms_dispatch2 0x7fa2d4000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:36.953 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.952+0000 7fa2c1ffb640 3 client.4476.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:36.953 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.952+0000 7fa2c1ffb640 3 client.4476.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:36.953 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.952+0000 7fa2c1ffb640 20 client.4476.objecter dump_active .. 0 homeless 2026-02-17T21:25:36.953 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.952+0000 7fa2c1ffb640 1 -- 10.20.193.5:0/2348331773 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa2c401d020 con 0x7fa2d40ca100 2026-02-17T21:25:36.953 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.952+0000 7fa2c1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:36.953 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.952+0000 7fa2c1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:36.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.953+0000 7f40c2ffd640 1 -- 10.20.193.5:0/3006183881 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 15}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f40d0062c60 con 0x7f40d80d1b60 2026-02-17T21:25:36.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.954+0000 7f40c2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T21:25:36.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.954+0000 7f40c2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:36.955 INFO:teuthology.orchestra.run.trial005.stdout:120259084293 2026-02-17T21:25:36.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.956+0000 7f40e08c9640 10 librados: watch_flush enter 2026-02-17T21:25:36.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.956+0000 7f40e08c9640 10 librados: watch_flush exit 2026-02-17T21:25:36.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.956+0000 7f40e08c9640 20 client.4467.objecter shutdown clearing up homeless session... 2026-02-17T21:25:36.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.956+0000 7f40e08c9640 10 client.4467.objecter successfully canceled tick 2026-02-17T21:25:36.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.956+0000 7f40e08c9640 1 -- 10.20.193.5:0/3006183881 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f40a8079300 msgr2=0x7f40a807b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.956+0000 7f40e08c9640 1 --2- 10.20.193.5:0/3006183881 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f40a8079300 0x7f40a807b7c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f40c4006b90 tx=0x7f40c4006b20 comp rx=0 tx=0).stop 2026-02-17T21:25:36.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.956+0000 7f40e08c9640 10 monclient: shutdown 2026-02-17T21:25:36.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.956+0000 7f40e08c9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:36.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.956+0000 7f40e08c9640 1 -- 10.20.193.5:0/3006183881 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f40d80d1b60 msgr2=0x7f40d8147470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:36.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.956+0000 7f40e08c9640 1 --2- 10.20.193.5:0/3006183881 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f40d80d1b60 0x7f40d8147470 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f40d000b4d0 tx=0x7f40d000b9a0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.956+0000 7f40e08c9640 1 -- 10.20.193.5:0/3006183881 shutdown_connections 2026-02-17T21:25:36.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.956+0000 7f40e08c9640 1 --2- 10.20.193.5:0/3006183881 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f40a8079300 0x7f40a807b7c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.956+0000 7f40e08c9640 1 --2- 10.20.193.5:0/3006183881 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f40d815d950 0x7f40d81f7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.956+0000 7f40e08c9640 1 --2- 10.20.193.5:0/3006183881 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f40d80d1f40 0x7f40d81f6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.956+0000 7f40e08c9640 1 --2- 10.20.193.5:0/3006183881 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f40d80d1b60 0x7f40d8147470 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:36.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.956+0000 7f40e08c9640 1 -- 10.20.193.5:0/3006183881 >> 10.20.193.5:0/3006183881 conn(0x7f40d806d9b0 msgr2=0x7f40d80d10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:36.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.956+0000 7f40e08c9640 1 -- 10.20.193.5:0/3006183881 shutdown_connections 2026-02-17T21:25:36.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.956+0000 7f40e08c9640 1 -- 10.20.193.5:0/3006183881 wait complete. 2026-02-17T21:25:36.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:36.956+0000 7f40e08c9640 1 librados: shutdown 2026-02-17T21:25:36.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084295 got 120259084293 for osd.15 2026-02-17T21:25:37.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.010+0000 7fa777ef1640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T21:25:37.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.010+0000 7fa777ef1640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T21:25:37.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.010+0000 7fa777ef1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:37.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.010+0000 7fa777ef1640 1 -- 10.20.193.5:0/1411838837 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fa770151e80 con 0x7fa7700c9730 2026-02-17T21:25:37.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.011+0000 7ff9d8771640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T21:25:37.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.011+0000 7ff9d8771640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T21:25:37.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.011+0000 7ff9d8771640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:37.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.011+0000 7ff9d8771640 1 -- 10.20.193.5:0/2531019158 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 12} v 0) -- 0x7ff9d0073d50 con 0x7ff9d0152700 2026-02-17T21:25:37.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.036+0000 7fa2db47c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T21:25:37.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.036+0000 7fa2db47c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T21:25:37.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.036+0000 7fa2db47c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:37.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.036+0000 7fa2db47c640 1 -- 10.20.193.5:0/2348331773 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fa2d40cc8f0 con 0x7fa2d40ca100 2026-02-17T21:25:37.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.039+0000 7fa2c1ffb640 1 -- 10.20.193.5:0/2348331773 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa2c4062a90 con 0x7fa2d40ca100 2026-02-17T21:25:37.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.039+0000 7fa2c1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T21:25:37.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.039+0000 7fa2c1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:37.041 INFO:teuthology.orchestra.run.trial005.stdout:94489280517 2026-02-17T21:25:37.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.040+0000 7fa2db47c640 10 librados: watch_flush enter 2026-02-17T21:25:37.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.040+0000 7fa2db47c640 10 librados: watch_flush exit 2026-02-17T21:25:37.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.040+0000 7fa2db47c640 20 client.4476.objecter shutdown clearing up homeless session... 2026-02-17T21:25:37.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.040+0000 7fa2db47c640 10 client.4476.objecter successfully canceled tick 2026-02-17T21:25:37.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.040+0000 7fa2db47c640 1 -- 10.20.193.5:0/2348331773 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa2a40792d0 msgr2=0x7fa2a407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.040+0000 7fa2db47c640 1 --2- 10.20.193.5:0/2348331773 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa2a40792d0 0x7fa2a407b790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa2d415aba0 tx=0x7fa2c8031000 comp rx=0 tx=0).stop 2026-02-17T21:25:37.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.040+0000 7fa2db47c640 10 monclient: shutdown 2026-02-17T21:25:37.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.040+0000 7fa2db47c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:37.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.040+0000 7fa2db47c640 1 -- 10.20.193.5:0/2348331773 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa2d40ca100 msgr2=0x7fa2d41f7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.040+0000 7fa2db47c640 1 --2- 10.20.193.5:0/2348331773 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa2d40ca100 0x7fa2d41f7730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400b570 tx=0x7fa2c400ba40 comp rx=0 tx=0).stop 2026-02-17T21:25:37.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.040+0000 7fa2db47c640 1 -- 10.20.193.5:0/2348331773 shutdown_connections 2026-02-17T21:25:37.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.040+0000 7fa2db47c640 1 --2- 10.20.193.5:0/2348331773 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa2a40792d0 0x7fa2a407b790 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.040+0000 7fa2db47c640 1 --2- 10.20.193.5:0/2348331773 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa2d40d1f40 0x7fa2d40d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.040+0000 7fa2db47c640 1 --2- 10.20.193.5:0/2348331773 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa2d40d1b60 0x7fa2d4155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.040+0000 7fa2db47c640 1 --2- 10.20.193.5:0/2348331773 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa2d40ca100 0x7fa2d41f7730 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.040+0000 7fa2db47c640 1 -- 10.20.193.5:0/2348331773 >> 10.20.193.5:0/2348331773 conn(0x7fa2d406d9b0 msgr2=0x7fa2d4152710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:37.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.040+0000 7fa2db47c640 1 -- 10.20.193.5:0/2348331773 shutdown_connections 2026-02-17T21:25:37.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.040+0000 7fa2db47c640 1 -- 10.20.193.5:0/2348331773 wait complete. 2026-02-17T21:25:37.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.041+0000 7fa2db47c640 1 librados: shutdown 2026-02-17T21:25:37.051 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280517 for osd.5 2026-02-17T21:25:37.130 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.128+0000 7fab13fff640 1 -- 10.20.193.5:0/2762579657 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c046070 con 0x7fab3815df20 2026-02-17T21:25:37.131 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.128+0000 7fab13fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:37.131 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.128+0000 7fab13fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:37.131 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.128+0000 7fab13fff640 10 monclient: dump: 2026-02-17T21:25:37.131 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:37.131 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:37.131 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.131 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.131 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:37.131 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:37.131 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:37.131 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:37.132 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:37.132 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:37.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.128+0000 7fab13fff640 10 monclient: _finish_auth 0 2026-02-17T21:25:37.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.128+0000 7fab13fff640 10 monclient: _check_auth_tickets 2026-02-17T21:25:37.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.128+0000 7fab13fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:37.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.128+0000 7fab13fff640 1 -- 10.20.193.5:0/2762579657 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab2c042640 con 0x7fab3815df20 2026-02-17T21:25:37.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.128+0000 7fab13fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:37.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.128+0000 7fab13fff640 1 -- 10.20.193.5:0/2762579657 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c042a30 con 0x7fab3815df20 2026-02-17T21:25:37.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.128+0000 7fab3deda640 5 monclient: authenticate success, global_id 4526 2026-02-17T21:25:37.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.128+0000 7fab3deda640 10 monclient: _renew_subs 2026-02-17T21:25:37.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.128+0000 7fab3deda640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:37.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.128+0000 7fab35ffb640 4 set_mon_vals no callback set 2026-02-17T21:25:37.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.128+0000 7fab3deda640 1 -- 10.20.193.5:0/2762579657 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab381e8490 con 0x7fab3815df20 2026-02-17T21:25:37.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.128+0000 7fab13fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:37.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.128+0000 7fab13fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:37.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.128+0000 7fab13fff640 10 monclient: dump: 2026-02-17T21:25:37.133 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:37.133 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:37.133 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.133 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.133 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:37.133 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:37.133 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:37.133 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:37.134 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:37.134 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:37.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.128+0000 7fab3deda640 10 client.4526.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:37.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.128+0000 7fab3deda640 10 monclient: _renew_subs 2026-02-17T21:25:37.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.128+0000 7fab3deda640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:37.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.128+0000 7fab3deda640 1 -- 10.20.193.5:0/2762579657 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab381e8a50 con 0x7fab3815df20 2026-02-17T21:25:37.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.128+0000 7fab3deda640 1 librados: init done 2026-02-17T21:25:37.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.129+0000 7fab3deda640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:37.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.129+0000 7fab3deda640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:37.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.129+0000 7fab3deda640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:37.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.129+0000 7fab3deda640 1 -- 10.20.193.5:0/2762579657 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab380c9180 con 0x7fab3815df20 2026-02-17T21:25:37.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.137+0000 7f341bfff640 1 -- 10.20.193.5:0/2321650236 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f3434041830 con 0x7f344415e060 2026-02-17T21:25:37.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.138+0000 7f341bfff640 1 --2- 10.20.193.5:0/2321650236 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f34140792d0 0x7f341407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:37.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.138+0000 7f3442ffd640 1 --2- 10.20.193.5:0/2321650236 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f34140792d0 0x7f341407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:37.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.138+0000 7f3442ffd640 10 monclient: get_auth_request con 0x7f34140792d0 auth_method 0 2026-02-17T21:25:37.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.138+0000 7fe159ffb640 1 -- 10.20.193.5:0/3875883530 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fe1680050d0 con 0x7fe16c15d950 2026-02-17T21:25:37.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.138+0000 7f341bfff640 10 client.4535.objecter ms_handle_connect 0x7f34140792d0 2026-02-17T21:25:37.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.138+0000 7f3442ffd640 1 --2- 10.20.193.5:0/2321650236 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f34140792d0 0x7f341407b790 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3438009750 tx=0x7f3438006ca0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:37.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.138+0000 7fe159ffb640 1 --2- 10.20.193.5:0/3875883530 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe13c0792b0 0x7fe13c07b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:37.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.139+0000 7fe17130b640 1 --2- 10.20.193.5:0/3875883530 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe13c0792b0 0x7fe13c07b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:37.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.139+0000 7fe17130b640 10 monclient: get_auth_request con 0x7fe13c0792b0 auth_method 0 2026-02-17T21:25:37.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.139+0000 7fe17130b640 1 --2- 10.20.193.5:0/3875883530 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe13c0792b0 0x7fe13c07b770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe15c007fd0 tx=0x7fe15c007b40 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:37.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.139+0000 7fe159ffb640 10 client.4516.objecter ms_handle_connect 0x7fe13c0792b0 2026-02-17T21:25:37.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.139+0000 7f341bfff640 1 -- 10.20.193.5:0/2321650236 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f3434083e10 con 0x7f344415e060 2026-02-17T21:25:37.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.139+0000 7f341bfff640 10 client.4535.objecter ms_dispatch2 0x7f3444000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:37.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.139+0000 7f341bfff640 3 client.4535.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:37.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.139+0000 7f341bfff640 3 client.4535.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:37.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.139+0000 7f341bfff640 20 client.4535.objecter dump_active .. 0 homeless 2026-02-17T21:25:37.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.145+0000 7f0abcff9640 1 -- 10.20.193.5:0/829767381 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f0aac0072d0 con 0x7f0ac015a380 2026-02-17T21:25:37.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.146+0000 7f341bfff640 1 -- 10.20.193.5:0/2321650236 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3434050030 con 0x7f344415e060 2026-02-17T21:25:37.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.146+0000 7f341bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:37.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.146+0000 7f341bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:37.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.146+0000 7f0abcff9640 1 --2- 10.20.193.5:0/829767381 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0a8c079280 0x7f0a8c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:37.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.146+0000 7f0abf7fe640 1 --2- 10.20.193.5:0/829767381 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0a8c079280 0x7f0a8c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:37.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.146+0000 7f0abf7fe640 10 monclient: get_auth_request con 0x7f0a8c079280 auth_method 0 2026-02-17T21:25:37.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.147+0000 7f0abcff9640 10 client.4519.objecter ms_handle_connect 0x7f0a8c079280 2026-02-17T21:25:37.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.147+0000 7f0abf7fe640 1 --2- 10.20.193.5:0/829767381 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0a8c079280 0x7f0a8c07b740 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0039000 tx=0x7f0ab0031000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:37.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.147+0000 7fe159ffb640 1 -- 10.20.193.5:0/3875883530 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fe16805ead0 con 0x7fe16c15d950 2026-02-17T21:25:37.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.147+0000 7fe159ffb640 10 client.4516.objecter ms_dispatch2 0x7fe16c000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:37.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.147+0000 7fe159ffb640 3 client.4516.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:37.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.147+0000 7fe159ffb640 3 client.4516.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:37.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.147+0000 7fe159ffb640 20 client.4516.objecter dump_active .. 0 homeless 2026-02-17T21:25:37.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.150+0000 7f0abcff9640 1 -- 10.20.193.5:0/829767381 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f0aac097280 con 0x7f0ac015a380 2026-02-17T21:25:37.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.150+0000 7f0abcff9640 10 client.4519.objecter ms_dispatch2 0x7f0ac0000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:37.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.150+0000 7f0abcff9640 3 client.4519.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:37.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.150+0000 7f0abcff9640 3 client.4519.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:37.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.151+0000 7f0abcff9640 20 client.4519.objecter dump_active .. 0 homeless 2026-02-17T21:25:37.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.163+0000 7fe159ffb640 1 -- 10.20.193.5:0/3875883530 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe168019300 con 0x7fe16c15d950 2026-02-17T21:25:37.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.163+0000 7fe159ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:37.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.163+0000 7fe159ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:37.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.164+0000 7f0abcff9640 1 -- 10.20.193.5:0/829767381 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0aac022020 con 0x7f0ac015a380 2026-02-17T21:25:37.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.164+0000 7f0abcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:37.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.164+0000 7f0abcff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:37.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.168+0000 7ff9b6ffd640 1 -- 10.20.193.5:0/2531019158 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 12}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7ff9d0073d50 con 0x7ff9d0152700 2026-02-17T21:25:37.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.168+0000 7ff9b6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T21:25:37.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.168+0000 7ff9b6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:37.169 INFO:teuthology.orchestra.run.trial005.stdout:103079215108 2026-02-17T21:25:37.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.170+0000 7ff9d8771640 10 librados: watch_flush enter 2026-02-17T21:25:37.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.170+0000 7ff9d8771640 10 librados: watch_flush exit 2026-02-17T21:25:37.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.170+0000 7ff9d8771640 20 client.4510.objecter shutdown clearing up homeless session... 2026-02-17T21:25:37.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.170+0000 7ff9d8771640 10 client.4510.objecter successfully canceled tick 2026-02-17T21:25:37.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.170+0000 7ff9d8771640 1 -- 10.20.193.5:0/2531019158 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff9a00792d0 msgr2=0x7ff9a007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.170+0000 7ff9d8771640 1 --2- 10.20.193.5:0/2531019158 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff9a00792d0 0x7ff9a007b790 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0149d60 tx=0x7ff9c4006cf0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.170+0000 7ff9d8771640 10 monclient: shutdown 2026-02-17T21:25:37.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.170+0000 7ff9d8771640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:37.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.170+0000 7ff9d8771640 1 -- 10.20.193.5:0/2531019158 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff9d0152700 msgr2=0x7ff9d015b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.170+0000 7ff9d8771640 1 --2- 10.20.193.5:0/2531019158 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff9d0152700 0x7ff9d015b4b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff9c000b500 tx=0x7ff9c000b9d0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.170+0000 7ff9d8771640 1 -- 10.20.193.5:0/2531019158 shutdown_connections 2026-02-17T21:25:37.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.170+0000 7ff9d8771640 1 --2- 10.20.193.5:0/2531019158 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff9a00792d0 0x7ff9a007b790 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.170+0000 7ff9d8771640 1 --2- 10.20.193.5:0/2531019158 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff9d015ef80 0x7ff9d0148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.170+0000 7ff9d8771640 1 --2- 10.20.193.5:0/2531019158 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff9d0152ae0 0x7ff9d01f3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.170+0000 7ff9d8771640 1 --2- 10.20.193.5:0/2531019158 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff9d0152700 0x7ff9d015b4b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.170+0000 7ff9d8771640 1 -- 10.20.193.5:0/2531019158 >> 10.20.193.5:0/2531019158 conn(0x7ff9d0073030 msgr2=0x7ff9d015fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:37.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.170+0000 7ff9d8771640 1 -- 10.20.193.5:0/2531019158 shutdown_connections 2026-02-17T21:25:37.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.170+0000 7ff9d8771640 1 -- 10.20.193.5:0/2531019158 wait complete. 2026-02-17T21:25:37.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.170+0000 7ff9d8771640 1 librados: shutdown 2026-02-17T21:25:37.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215109 got 103079215108 for osd.12 2026-02-17T21:25:37.234 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.233+0000 7f3449a85640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T21:25:37.234 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.233+0000 7f3449a85640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T21:25:37.234 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.233+0000 7f3449a85640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:37.234 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.233+0000 7f3449a85640 1 -- 10.20.193.5:0/2321650236 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 13} v 0) -- 0x7f34441597e0 con 0x7f344415e060 2026-02-17T21:25:37.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.246+0000 7feacffff640 1 -- 10.20.193.5:0/3745365924 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae8006e60 con 0x7feaf415d950 2026-02-17T21:25:37.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.246+0000 7feacffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:37.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.246+0000 7feacffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:37.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.246+0000 7feacffff640 10 monclient: dump: 2026-02-17T21:25:37.249 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:37.249 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:37.249 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.250 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.250 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:37.250 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:37.250 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:37.250 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:37.250 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:37.250 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:37.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.246+0000 7feacffff640 10 monclient: _finish_auth 0 2026-02-17T21:25:37.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.246+0000 7feacffff640 10 monclient: _check_auth_tickets 2026-02-17T21:25:37.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.246+0000 7feacffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:37.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.246+0000 7feacffff640 1 -- 10.20.193.5:0/3745365924 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae8010070 con 0x7feaf415d950 2026-02-17T21:25:37.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.246+0000 7feacffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:37.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.246+0000 7feacffff640 1 -- 10.20.193.5:0/3745365924 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae800c9d0 con 0x7feaf415d950 2026-02-17T21:25:37.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.246+0000 7feaf9f2c640 5 monclient: authenticate success, global_id 4529 2026-02-17T21:25:37.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.246+0000 7feaf1ffb640 4 set_mon_vals no callback set 2026-02-17T21:25:37.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.246+0000 7feaf9f2c640 10 monclient: _renew_subs 2026-02-17T21:25:37.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.246+0000 7feaf9f2c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:37.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.246+0000 7feaf9f2c640 1 -- 10.20.193.5:0/3745365924 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaf41f6f10 con 0x7feaf415d950 2026-02-17T21:25:37.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.246+0000 7feacffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:37.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.246+0000 7feacffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:37.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.246+0000 7feacffff640 10 monclient: dump: 2026-02-17T21:25:37.251 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:37.251 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:37.251 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.252 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.252 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:37.252 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:37.252 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:37.252 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:37.252 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:37.252 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:37.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.246+0000 7feaf9f2c640 10 client.4529.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:37.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.246+0000 7feaf9f2c640 10 monclient: _renew_subs 2026-02-17T21:25:37.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.246+0000 7feaf9f2c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:37.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.246+0000 7feaf9f2c640 1 -- 10.20.193.5:0/3745365924 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaf41f74d0 con 0x7feaf415d950 2026-02-17T21:25:37.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.246+0000 7feaf9f2c640 1 librados: init done 2026-02-17T21:25:37.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.247+0000 7feaf9f2c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:37.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.247+0000 7feaf9f2c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:37.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.247+0000 7feaf9f2c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:37.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.247+0000 7feaf9f2c640 1 -- 10.20.193.5:0/3745365924 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaf4069f90 con 0x7feaf415d950 2026-02-17T21:25:37.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.247+0000 7f93dffff640 1 -- 10.20.193.5:0/2248465611 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f8006e60 con 0x7f940815bf30 2026-02-17T21:25:37.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.247+0000 7f93dffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:37.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.247+0000 7f93dffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:37.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.247+0000 7f93dffff640 10 monclient: dump: 2026-02-17T21:25:37.255 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:37.255 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:37.255 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.255 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.255 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:37.255 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:37.255 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:37.255 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:37.256 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:37.256 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:37.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.247+0000 7f93dffff640 10 monclient: _finish_auth 0 2026-02-17T21:25:37.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.247+0000 7f93dffff640 10 monclient: _check_auth_tickets 2026-02-17T21:25:37.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.247+0000 7f93dffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:37.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.247+0000 7f93dffff640 1 -- 10.20.193.5:0/2248465611 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93f8010070 con 0x7f940815bf30 2026-02-17T21:25:37.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.247+0000 7f93dffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:37.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.247+0000 7f93dffff640 1 -- 10.20.193.5:0/2248465611 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f800c9d0 con 0x7f940815bf30 2026-02-17T21:25:37.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.247+0000 7f940d901640 5 monclient: authenticate success, global_id 4538 2026-02-17T21:25:37.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.247+0000 7f940d901640 10 monclient: _renew_subs 2026-02-17T21:25:37.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.247+0000 7f94057fa640 4 set_mon_vals no callback set 2026-02-17T21:25:37.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.247+0000 7f940d901640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:37.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.248+0000 7f940d901640 1 -- 10.20.193.5:0/2248465611 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94081f3e50 con 0x7f940815bf30 2026-02-17T21:25:37.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.248+0000 7f93dffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:37.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.248+0000 7f93dffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:37.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.248+0000 7f93dffff640 10 monclient: dump: 2026-02-17T21:25:37.257 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:37.257 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:37.257 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.257 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.257 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:37.257 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:37.257 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:37.257 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:37.258 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:37.258 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:37.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.248+0000 7f940d901640 10 client.4538.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:37.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.248+0000 7f940d901640 10 monclient: _renew_subs 2026-02-17T21:25:37.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.248+0000 7f940d901640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:37.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.248+0000 7f940d901640 1 -- 10.20.193.5:0/2248465611 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94081f4410 con 0x7f940815bf30 2026-02-17T21:25:37.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.248+0000 7f940d901640 1 librados: init done 2026-02-17T21:25:37.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.248+0000 7f940d901640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:37.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.248+0000 7f940d901640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:37.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.248+0000 7f940d901640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:37.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.248+0000 7f940d901640 1 -- 10.20.193.5:0/2248465611 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94080d18c0 con 0x7f940815bf30 2026-02-17T21:25:37.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.250+0000 7f0ac688f640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T21:25:37.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.250+0000 7f0ac688f640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T21:25:37.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.250+0000 7f0ac688f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:37.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.250+0000 7f0ac688f640 1 -- 10.20.193.5:0/829767381 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f0ac006fbf0 con 0x7f0ac015a380 2026-02-17T21:25:37.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.251+0000 7fe173596640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T21:25:37.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.251+0000 7fe173596640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T21:25:37.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.251+0000 7fe173596640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:37.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.251+0000 7fe173596640 1 -- 10.20.193.5:0/3875883530 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fe16c14e9e0 con 0x7fe16c15d950 2026-02-17T21:25:37.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.251+0000 7fa75e7fc640 1 -- 10.20.193.5:0/1411838837 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fa760062810 con 0x7fa7700c9730 2026-02-17T21:25:37.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.251+0000 7fa75e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T21:25:37.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.251+0000 7fa75e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:37.261 INFO:teuthology.orchestra.run.trial005.stdout:120259084294 2026-02-17T21:25:37.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.251+0000 7f341bfff640 1 -- 10.20.193.5:0/2321650236 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 13}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f3434053390 con 0x7f344415e060 2026-02-17T21:25:37.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.251+0000 7f341bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T21:25:37.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.251+0000 7f341bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:37.262 INFO:teuthology.orchestra.run.trial005.stdout:111669149701 2026-02-17T21:25:37.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.252+0000 7f0abcff9640 1 -- 10.20.193.5:0/829767381 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0aac061e60 con 0x7f0ac015a380 2026-02-17T21:25:37.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.252+0000 7f0abcff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T21:25:37.263 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.252+0000 7f0abcff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:37.263 INFO:teuthology.orchestra.run.trial005.stdout:111669149703 2026-02-17T21:25:37.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7fa777ef1640 10 librados: watch_flush enter 2026-02-17T21:25:37.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7fa777ef1640 10 librados: watch_flush exit 2026-02-17T21:25:37.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7fa777ef1640 20 client.4523.objecter shutdown clearing up homeless session... 2026-02-17T21:25:37.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7fa777ef1640 10 client.4523.objecter successfully canceled tick 2026-02-17T21:25:37.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7fa777ef1640 1 -- 10.20.193.5:0/1411838837 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa740079300 msgr2=0x7fa74007b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7fa777ef1640 1 --2- 10.20.193.5:0/1411838837 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa740079300 0x7fa74007b7c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa7700cbf90 tx=0x7fa764031000 comp rx=0 tx=0).stop 2026-02-17T21:25:37.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7fa777ef1640 10 monclient: shutdown 2026-02-17T21:25:37.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7fa777ef1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:37.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7fa777ef1640 1 -- 10.20.193.5:0/1411838837 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa7700c9730 msgr2=0x7fa7701554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7fa777ef1640 1 --2- 10.20.193.5:0/1411838837 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa7700c9730 0x7fa7701554a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa76000b500 tx=0x7fa76000b9d0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7fa777ef1640 1 -- 10.20.193.5:0/1411838837 shutdown_connections 2026-02-17T21:25:37.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7fa777ef1640 1 --2- 10.20.193.5:0/1411838837 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa740079300 0x7fa74007b7c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7fa777ef1640 1 --2- 10.20.193.5:0/1411838837 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa770152ae0 0x7fa770142650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7fa777ef1640 1 --2- 10.20.193.5:0/1411838837 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa770152700 0x7fa770142110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7fa777ef1640 1 --2- 10.20.193.5:0/1411838837 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa7700c9730 0x7fa7701554a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7fa777ef1640 1 -- 10.20.193.5:0/1411838837 >> 10.20.193.5:0/1411838837 conn(0x7fa770073030 msgr2=0x7fa77014eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:37.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7fa777ef1640 1 -- 10.20.193.5:0/1411838837 shutdown_connections 2026-02-17T21:25:37.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f3449a85640 10 librados: watch_flush enter 2026-02-17T21:25:37.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7fa777ef1640 1 -- 10.20.193.5:0/1411838837 wait complete. 2026-02-17T21:25:37.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f3449a85640 10 librados: watch_flush exit 2026-02-17T21:25:37.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f3449a85640 20 client.4535.objecter shutdown clearing up homeless session... 2026-02-17T21:25:37.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f3449a85640 10 client.4535.objecter successfully canceled tick 2026-02-17T21:25:37.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7fa777ef1640 1 librados: shutdown 2026-02-17T21:25:37.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f3449a85640 1 -- 10.20.193.5:0/2321650236 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f34140792d0 msgr2=0x7f341407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f3449a85640 1 --2- 10.20.193.5:0/2321650236 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f34140792d0 0x7f341407b790 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3438009750 tx=0x7f3438006ca0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f3449a85640 10 monclient: shutdown 2026-02-17T21:25:37.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f3449a85640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:37.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f3449a85640 1 -- 10.20.193.5:0/2321650236 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f344415e060 msgr2=0x7f34441f2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f3449a85640 1 --2- 10.20.193.5:0/2321650236 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f344415e060 0x7f34441f2830 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3434009e50 tx=0x7f3434004b40 comp rx=0 tx=0).stop 2026-02-17T21:25:37.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f3449a85640 1 -- 10.20.193.5:0/2321650236 shutdown_connections 2026-02-17T21:25:37.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f3449a85640 1 --2- 10.20.193.5:0/2321650236 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f34140792d0 0x7f341407b790 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f3449a85640 1 --2- 10.20.193.5:0/2321650236 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f344415e060 0x7f34441f2830 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f3449a85640 1 --2- 10.20.193.5:0/2321650236 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f34440d1f40 0x7f344414d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f3449a85640 1 --2- 10.20.193.5:0/2321650236 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f34440d1b60 0x7f3444151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f3449a85640 1 -- 10.20.193.5:0/2321650236 >> 10.20.193.5:0/2321650236 conn(0x7f344406d9b0 msgr2=0x7f344414e660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:37.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f3449a85640 1 -- 10.20.193.5:0/2321650236 shutdown_connections 2026-02-17T21:25:37.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f3449a85640 1 -- 10.20.193.5:0/2321650236 wait complete. 2026-02-17T21:25:37.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f3449a85640 1 librados: shutdown 2026-02-17T21:25:37.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f0ac688f640 10 librados: watch_flush enter 2026-02-17T21:25:37.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f0ac688f640 10 librados: watch_flush exit 2026-02-17T21:25:37.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f0ac688f640 20 client.4519.objecter shutdown clearing up homeless session... 2026-02-17T21:25:37.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f0ac688f640 10 client.4519.objecter successfully canceled tick 2026-02-17T21:25:37.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f0ac688f640 1 -- 10.20.193.5:0/829767381 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0a8c079280 msgr2=0x7f0a8c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f0ac688f640 1 --2- 10.20.193.5:0/829767381 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0a8c079280 0x7f0a8c07b740 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0039000 tx=0x7f0ab0031000 comp rx=0 tx=0).stop 2026-02-17T21:25:37.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f0ac688f640 10 monclient: shutdown 2026-02-17T21:25:37.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f0ac688f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:37.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f0ac688f640 1 -- 10.20.193.5:0/829767381 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0ac015a380 msgr2=0x7f0ac00c1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f0ac688f640 1 --2- 10.20.193.5:0/829767381 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0ac015a380 0x7f0ac00c1590 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0aac00c4d0 tx=0x7f0aac00c9a0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f0ac688f640 1 -- 10.20.193.5:0/829767381 shutdown_connections 2026-02-17T21:25:37.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f0ac688f640 1 --2- 10.20.193.5:0/829767381 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0a8c079280 0x7f0a8c07b740 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f0ac688f640 1 --2- 10.20.193.5:0/829767381 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0ac0155690 0x7f0ac0155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f0ac688f640 1 --2- 10.20.193.5:0/829767381 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0ac0162dc0 0x7f0ac01ec210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f0ac688f640 1 --2- 10.20.193.5:0/829767381 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0ac015a380 0x7f0ac00c1590 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.254+0000 7f0ac688f640 1 -- 10.20.193.5:0/829767381 >> 10.20.193.5:0/829767381 conn(0x7f0ac006c890 msgr2=0x7f0ac006cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:37.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.255+0000 7f0ac688f640 1 -- 10.20.193.5:0/829767381 shutdown_connections 2026-02-17T21:25:37.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.255+0000 7f0ac688f640 1 -- 10.20.193.5:0/829767381 wait complete. 2026-02-17T21:25:37.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.255+0000 7f0ac688f640 1 librados: shutdown 2026-02-17T21:25:37.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.255+0000 7fe159ffb640 1 -- 10.20.193.5:0/3875883530 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7fe168063190 con 0x7fe16c15d950 2026-02-17T21:25:37.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.255+0000 7fe159ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T21:25:37.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.255+0000 7fe159ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:37.274 INFO:teuthology.orchestra.run.trial005.stdout:98784247813 2026-02-17T21:25:37.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.257+0000 7fe173596640 10 librados: watch_flush enter 2026-02-17T21:25:37.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.257+0000 7fe173596640 10 librados: watch_flush exit 2026-02-17T21:25:37.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.257+0000 7fe173596640 20 client.4516.objecter shutdown clearing up homeless session... 2026-02-17T21:25:37.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.257+0000 7fe173596640 10 client.4516.objecter successfully canceled tick 2026-02-17T21:25:37.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.257+0000 7fe173596640 1 -- 10.20.193.5:0/3875883530 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe13c0792b0 msgr2=0x7fe13c07b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.257+0000 7fe173596640 1 --2- 10.20.193.5:0/3875883530 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe13c0792b0 0x7fe13c07b770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe15c007fd0 tx=0x7fe15c007b40 comp rx=0 tx=0).stop 2026-02-17T21:25:37.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.257+0000 7fe173596640 10 monclient: shutdown 2026-02-17T21:25:37.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.257+0000 7fe173596640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:37.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.257+0000 7fe173596640 1 -- 10.20.193.5:0/3875883530 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe16c15d950 msgr2=0x7fe16c0cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.257+0000 7fe173596640 1 --2- 10.20.193.5:0/3875883530 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe16c15d950 0x7fe16c0cbfb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe16800cbe0 tx=0x7fe16800a430 comp rx=0 tx=0).stop 2026-02-17T21:25:37.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.257+0000 7fe173596640 1 -- 10.20.193.5:0/3875883530 shutdown_connections 2026-02-17T21:25:37.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.257+0000 7fe173596640 1 --2- 10.20.193.5:0/3875883530 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe13c0792b0 0x7fe13c07b770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.257+0000 7fe173596640 1 --2- 10.20.193.5:0/3875883530 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe16c15d950 0x7fe16c0cbfb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.257+0000 7fe173596640 1 --2- 10.20.193.5:0/3875883530 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe16c0d1f40 0x7fe16c1f6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.257+0000 7fe173596640 1 --2- 10.20.193.5:0/3875883530 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe16c0d1b60 0x7fe16c15b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.257+0000 7fe173596640 1 -- 10.20.193.5:0/3875883530 >> 10.20.193.5:0/3875883530 conn(0x7fe16c06d9b0 msgr2=0x7fe16c14fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:37.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.257+0000 7fe173596640 1 -- 10.20.193.5:0/3875883530 shutdown_connections 2026-02-17T21:25:37.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.257+0000 7fe173596640 1 -- 10.20.193.5:0/3875883530 wait complete. 2026-02-17T21:25:37.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.257+0000 7fe173596640 1 librados: shutdown 2026-02-17T21:25:37.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084295 got 120259084294 for osd.10 2026-02-17T21:25:37.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149704 got 111669149703 for osd.9 2026-02-17T21:25:37.280 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149702 got 111669149701 for osd.13 2026-02-17T21:25:37.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247814 got 98784247813 for osd.11 2026-02-17T21:25:37.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.351+0000 7fbd7a7fc640 1 -- 10.20.193.5:0/2021679235 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbd880102e0 con 0x7fbd8c15b290 2026-02-17T21:25:37.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.351+0000 7fbd7a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T21:25:37.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.351+0000 7fbd7a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:37.353 INFO:teuthology.orchestra.run.trial005.stdout:94489280516 2026-02-17T21:25:37.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.355+0000 7fbd93ada640 10 librados: watch_flush enter 2026-02-17T21:25:37.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.355+0000 7fbd93ada640 10 librados: watch_flush exit 2026-02-17T21:25:37.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.355+0000 7fbd93ada640 20 client.4490.objecter shutdown clearing up homeless session... 2026-02-17T21:25:37.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.355+0000 7fbd93ada640 10 client.4490.objecter successfully canceled tick 2026-02-17T21:25:37.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.355+0000 7fbd93ada640 1 -- 10.20.193.5:0/2021679235 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbd5c0792b0 msgr2=0x7fbd5c07b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.355+0000 7fbd93ada640 1 --2- 10.20.193.5:0/2021679235 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbd5c0792b0 0x7fbd5c07b770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c039000 tx=0x7fbd7c031000 comp rx=0 tx=0).stop 2026-02-17T21:25:37.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.355+0000 7fbd93ada640 10 monclient: shutdown 2026-02-17T21:25:37.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.355+0000 7fbd93ada640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:37.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.355+0000 7fbd93ada640 1 -- 10.20.193.5:0/2021679235 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbd8c15b290 msgr2=0x7fbd8c13ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.355+0000 7fbd93ada640 1 --2- 10.20.193.5:0/2021679235 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbd8c15b290 0x7fbd8c13ad20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbd8800cbd0 tx=0x7fbd8800a430 comp rx=0 tx=0).stop 2026-02-17T21:25:37.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.355+0000 7fbd93ada640 1 -- 10.20.193.5:0/2021679235 shutdown_connections 2026-02-17T21:25:37.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.355+0000 7fbd93ada640 1 --2- 10.20.193.5:0/2021679235 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbd5c0792b0 0x7fbd5c07b770 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.355+0000 7fbd93ada640 1 --2- 10.20.193.5:0/2021679235 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbd8c15b290 0x7fbd8c13ad20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.355+0000 7fbd93ada640 1 --2- 10.20.193.5:0/2021679235 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbd8c14ed00 0x7fbd8c13a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.355+0000 7fbd93ada640 1 --2- 10.20.193.5:0/2021679235 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbd8c14e920 0x7fbd8c0bb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.355+0000 7fbd93ada640 1 -- 10.20.193.5:0/2021679235 >> 10.20.193.5:0/2021679235 conn(0x7fbd8c0c9f40 msgr2=0x7fbd8c0cc100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:37.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.355+0000 7fbd93ada640 1 -- 10.20.193.5:0/2021679235 shutdown_connections 2026-02-17T21:25:37.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.356+0000 7fbd93ada640 1 -- 10.20.193.5:0/2021679235 wait complete. 2026-02-17T21:25:37.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.356+0000 7fbd93ada640 1 librados: shutdown 2026-02-17T21:25:37.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.359+0000 7fab91ffb640 1 -- 10.20.193.5:0/1477742226 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fab98021480 con 0x7faba415c840 2026-02-17T21:25:37.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.359+0000 7fab91ffb640 1 --2- 10.20.193.5:0/1477742226 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fab740792d0 0x7fab7407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:37.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.359+0000 7faba90bd640 1 --2- 10.20.193.5:0/1477742226 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fab740792d0 0x7fab7407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:37.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.359+0000 7faba90bd640 10 monclient: get_auth_request con 0x7fab740792d0 auth_method 0 2026-02-17T21:25:37.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.360+0000 7fab91ffb640 10 client.4532.objecter ms_handle_connect 0x7fab740792d0 2026-02-17T21:25:37.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.360+0000 7faba90bd640 1 --2- 10.20.193.5:0/1477742226 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fab740792d0 0x7fab7407b790 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7faba40751e0 tx=0x7fab94031000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:37.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.361+0000 7fab91ffb640 1 -- 10.20.193.5:0/1477742226 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fab9805dd80 con 0x7faba415c840 2026-02-17T21:25:37.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.361+0000 7fab91ffb640 10 client.4532.objecter ms_dispatch2 0x7faba4000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:37.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.361+0000 7fab91ffb640 3 client.4532.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:37.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.361+0000 7fab91ffb640 3 client.4532.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:37.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.361+0000 7fab91ffb640 20 client.4532.objecter dump_active .. 0 homeless 2026-02-17T21:25:37.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280516 for osd.1 2026-02-17T21:25:37.369 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.368+0000 7fab13fff640 1 -- 10.20.193.5:0/2762579657 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fab2c052060 con 0x7fab3815df20 2026-02-17T21:25:37.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.369+0000 7fab13fff640 1 --2- 10.20.193.5:0/2762579657 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fab080792d0 0x7fab0807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:37.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.369+0000 7fab377fe640 1 --2- 10.20.193.5:0/2762579657 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fab080792d0 0x7fab0807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:37.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.369+0000 7fab377fe640 10 monclient: get_auth_request con 0x7fab080792d0 auth_method 0 2026-02-17T21:25:37.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.370+0000 7fab377fe640 1 --2- 10.20.193.5:0/2762579657 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fab080792d0 0x7fab0807b790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fab24009750 tx=0x7fab24006ca0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:37.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.370+0000 7fab13fff640 10 client.4526.objecter ms_handle_connect 0x7fab080792d0 2026-02-17T21:25:37.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.381+0000 7fab13fff640 1 -- 10.20.193.5:0/2762579657 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fab2c0837e0 con 0x7fab3815df20 2026-02-17T21:25:37.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.381+0000 7fab13fff640 10 client.4526.objecter ms_dispatch2 0x7fab38000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:37.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.381+0000 7fab13fff640 3 client.4526.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:37.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.381+0000 7fab13fff640 3 client.4526.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:37.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.381+0000 7fab13fff640 20 client.4526.objecter dump_active .. 0 homeless 2026-02-17T21:25:37.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.475+0000 7fab91ffb640 1 -- 10.20.193.5:0/1477742226 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fab98062440 con 0x7faba415c840 2026-02-17T21:25:37.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.475+0000 7fab91ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:37.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.475+0000 7fab91ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:37.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.481+0000 7fab13fff640 1 -- 10.20.193.5:0/2762579657 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fab2c087ea0 con 0x7fab3815df20 2026-02-17T21:25:37.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.481+0000 7fab13fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:37.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.481+0000 7fab13fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:37.492 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.491+0000 7feacffff640 1 -- 10.20.193.5:0/3745365924 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7feae801d030 con 0x7feaf415d950 2026-02-17T21:25:37.493 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.491+0000 7feacffff640 1 --2- 10.20.193.5:0/3745365924 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7feac40792d0 0x7feac407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:37.493 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.492+0000 7feaf37fe640 1 --2- 10.20.193.5:0/3745365924 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7feac40792d0 0x7feac407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:37.493 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.492+0000 7feaf37fe640 10 monclient: get_auth_request con 0x7feac40792d0 auth_method 0 2026-02-17T21:25:37.494 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.493+0000 7feaf37fe640 1 --2- 10.20.193.5:0/3745365924 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7feac40792d0 0x7feac407b790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feae0009750 tx=0x7feae0006ca0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:37.494 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.493+0000 7feacffff640 10 client.4529.objecter ms_handle_connect 0x7feac40792d0 2026-02-17T21:25:37.495 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.493+0000 7feacffff640 1 -- 10.20.193.5:0/3745365924 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7feae805dab0 con 0x7feaf415d950 2026-02-17T21:25:37.495 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.493+0000 7feacffff640 10 client.4529.objecter ms_dispatch2 0x7feaf4000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:37.495 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.493+0000 7feacffff640 3 client.4529.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:37.495 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.493+0000 7feacffff640 3 client.4529.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:37.495 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.493+0000 7feacffff640 20 client.4529.objecter dump_active .. 0 homeless 2026-02-17T21:25:37.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.500+0000 7feacffff640 1 -- 10.20.193.5:0/3745365924 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7feaf4069f90 con 0x7feaf415d950 2026-02-17T21:25:37.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.500+0000 7feacffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:37.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.500+0000 7feacffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:37.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.516+0000 7f93dffff640 1 -- 10.20.193.5:0/2248465611 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f93f800cb70 con 0x7f940815bf30 2026-02-17T21:25:37.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.516+0000 7f93dffff640 1 --2- 10.20.193.5:0/2248465611 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f93d80792d0 0x7f93d807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:37.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.517+0000 7f9406ffd640 1 --2- 10.20.193.5:0/2248465611 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f93d80792d0 0x7f93d807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:37.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.517+0000 7f9406ffd640 10 monclient: get_auth_request con 0x7f93d80792d0 auth_method 0 2026-02-17T21:25:37.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.517+0000 7f93dffff640 10 client.4538.objecter ms_handle_connect 0x7f93d80792d0 2026-02-17T21:25:37.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.517+0000 7f9406ffd640 1 --2- 10.20.193.5:0/2248465611 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f93d80792d0 0x7f93d807b790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9408075130 tx=0x7f93fc033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:37.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.522+0000 7f93dffff640 1 -- 10.20.193.5:0/2248465611 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f93f805ddd0 con 0x7f940815bf30 2026-02-17T21:25:37.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.522+0000 7f93dffff640 10 client.4538.objecter ms_dispatch2 0x7f9408000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:37.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.522+0000 7f93dffff640 3 client.4538.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:37.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.522+0000 7f93dffff640 3 client.4538.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:37.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.522+0000 7f93dffff640 20 client.4538.objecter dump_active .. 0 homeless 2026-02-17T21:25:37.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.530+0000 7f93dffff640 1 -- 10.20.193.5:0/2248465611 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f93f8061d90 con 0x7f940815bf30 2026-02-17T21:25:37.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.530+0000 7f93dffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:37.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.530+0000 7f93dffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:37.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.561+0000 7fabab348640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T21:25:37.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.561+0000 7fabab348640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T21:25:37.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.561+0000 7fabab348640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:37.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.561+0000 7fabab348640 1 -- 10.20.193.5:0/1477742226 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7faba40c9620 con 0x7faba415c840 2026-02-17T21:25:37.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.564+0000 7fab91ffb640 1 -- 10.20.193.5:0/1477742226 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fab98061d40 con 0x7faba415c840 2026-02-17T21:25:37.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.564+0000 7fab91ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T21:25:37.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.564+0000 7fab91ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:37.565 INFO:teuthology.orchestra.run.trial005.stdout:115964117000 2026-02-17T21:25:37.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.566+0000 7fabab348640 10 librados: watch_flush enter 2026-02-17T21:25:37.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.566+0000 7fabab348640 10 librados: watch_flush exit 2026-02-17T21:25:37.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.566+0000 7fabab348640 20 client.4532.objecter shutdown clearing up homeless session... 2026-02-17T21:25:37.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.566+0000 7fabab348640 10 client.4532.objecter successfully canceled tick 2026-02-17T21:25:37.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.566+0000 7fabab348640 1 -- 10.20.193.5:0/1477742226 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fab740792d0 msgr2=0x7fab7407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.566+0000 7fabab348640 1 --2- 10.20.193.5:0/1477742226 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fab740792d0 0x7fab7407b790 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7faba40751e0 tx=0x7fab94031000 comp rx=0 tx=0).stop 2026-02-17T21:25:37.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.566+0000 7fabab348640 10 monclient: shutdown 2026-02-17T21:25:37.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.566+0000 7fabab348640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:37.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.566+0000 7fabab348640 1 -- 10.20.193.5:0/1477742226 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7faba415c840 msgr2=0x7faba41f93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.566+0000 7fabab348640 1 --2- 10.20.193.5:0/1477742226 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7faba415c840 0x7faba41f93e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fab9800b5a0 tx=0x7fab9800ba70 comp rx=0 tx=0).stop 2026-02-17T21:25:37.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.566+0000 7fabab348640 1 -- 10.20.193.5:0/1477742226 shutdown_connections 2026-02-17T21:25:37.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.566+0000 7fabab348640 1 --2- 10.20.193.5:0/1477742226 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fab740792d0 0x7fab7407b790 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.566+0000 7fabab348640 1 --2- 10.20.193.5:0/1477742226 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7faba415d950 0x7faba41fb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.566+0000 7fabab348640 1 --2- 10.20.193.5:0/1477742226 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7faba415c840 0x7faba41f93e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.566+0000 7fabab348640 1 --2- 10.20.193.5:0/1477742226 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faba40d1b60 0x7faba414da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.566+0000 7fabab348640 1 -- 10.20.193.5:0/1477742226 >> 10.20.193.5:0/1477742226 conn(0x7faba406d9b0 msgr2=0x7faba415c090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:37.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.566+0000 7fabab348640 1 -- 10.20.193.5:0/1477742226 shutdown_connections 2026-02-17T21:25:37.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.566+0000 7fabab348640 1 -- 10.20.193.5:0/1477742226 wait complete. 2026-02-17T21:25:37.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.566+0000 7fabab348640 1 librados: shutdown 2026-02-17T21:25:37.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.566+0000 7fab3deda640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T21:25:37.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.566+0000 7fab3deda640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T21:25:37.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.566+0000 7fab3deda640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:37.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.566+0000 7fab3deda640 1 -- 10.20.193.5:0/2762579657 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 14} v 0) -- 0x7fab380c8ad0 con 0x7fab3815df20 2026-02-17T21:25:37.571 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:02:17.195 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:37.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.569+0000 7fab13fff640 1 -- 10.20.193.5:0/2762579657 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 14}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fab2c0877a0 con 0x7fab3815df20 2026-02-17T21:25:37.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.569+0000 7fab13fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T21:25:37.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.569+0000 7fab13fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:37.572 INFO:teuthology.orchestra.run.trial005.stdout:103079215108 2026-02-17T21:25:37.572 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:02:17.198 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:37.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.571+0000 7fab3deda640 10 librados: watch_flush enter 2026-02-17T21:25:37.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.571+0000 7fab3deda640 10 librados: watch_flush exit 2026-02-17T21:25:37.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.571+0000 7fab3deda640 20 client.4526.objecter shutdown clearing up homeless session... 2026-02-17T21:25:37.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.571+0000 7fab3deda640 10 client.4526.objecter successfully canceled tick 2026-02-17T21:25:37.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.571+0000 7fab3deda640 1 -- 10.20.193.5:0/2762579657 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fab080792d0 msgr2=0x7fab0807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.571+0000 7fab3deda640 1 --2- 10.20.193.5:0/2762579657 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fab080792d0 0x7fab0807b790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fab24009750 tx=0x7fab24006ca0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.571+0000 7fab3deda640 10 monclient: shutdown 2026-02-17T21:25:37.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.571+0000 7fab3deda640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:37.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.571+0000 7fab3deda640 1 -- 10.20.193.5:0/2762579657 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fab3815df20 msgr2=0x7fab3814bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.571+0000 7fab3deda640 1 --2- 10.20.193.5:0/2762579657 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fab3815df20 0x7fab3814bb90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009e50 tx=0x7fab2c004b40 comp rx=0 tx=0).stop 2026-02-17T21:25:37.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.571+0000 7fab3deda640 1 -- 10.20.193.5:0/2762579657 shutdown_connections 2026-02-17T21:25:37.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.571+0000 7fab3deda640 1 --2- 10.20.193.5:0/2762579657 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fab080792d0 0x7fab0807b790 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.571+0000 7fab3deda640 1 --2- 10.20.193.5:0/2762579657 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fab3815df20 0x7fab3814bb90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.571+0000 7fab3deda640 1 --2- 10.20.193.5:0/2762579657 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fab381527c0 0x7fab3814b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.571+0000 7fab3deda640 1 --2- 10.20.193.5:0/2762579657 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fab380c8cf0 0x7fab381f7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.571+0000 7fab3deda640 1 -- 10.20.193.5:0/2762579657 >> 10.20.193.5:0/2762579657 conn(0x7fab38073030 msgr2=0x7fab3815d810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:37.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.571+0000 7fab3deda640 1 -- 10.20.193.5:0/2762579657 shutdown_connections 2026-02-17T21:25:37.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.571+0000 7fab3deda640 1 -- 10.20.193.5:0/2762579657 wait complete. 2026-02-17T21:25:37.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.571+0000 7fab3deda640 1 librados: shutdown 2026-02-17T21:25:37.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117001 got 115964117000 for osd.6 2026-02-17T21:25:37.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215109 got 103079215108 for osd.14 2026-02-17T21:25:37.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.586+0000 7feaf9f2c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-17T21:25:37.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.586+0000 7feaf9f2c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-17T21:25:37.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.586+0000 7feaf9f2c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:37.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.586+0000 7feaf9f2c640 1 -- 10.20.193.5:0/3745365924 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7feaf40cff00 con 0x7feaf415d950 2026-02-17T21:25:37.600 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:02:17.223 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:37.601 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:02:17.187 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:37.605 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:02:17.229 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:37.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.604+0000 7feacffff640 1 -- 10.20.193.5:0/3745365924 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7feaf40cff00 con 0x7feaf415d950 2026-02-17T21:25:37.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.604+0000 7feacffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-17T21:25:37.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.604+0000 7feacffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:37.607 INFO:teuthology.orchestra.run.trial005.stdout:120259084293 2026-02-17T21:25:37.607 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:02:17.232 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:37.607 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:02:17.192 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:37.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.606+0000 7feaf9f2c640 10 librados: watch_flush enter 2026-02-17T21:25:37.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.607+0000 7feaf9f2c640 10 librados: watch_flush exit 2026-02-17T21:25:37.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.607+0000 7feaf9f2c640 20 client.4529.objecter shutdown clearing up homeless session... 2026-02-17T21:25:37.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.607+0000 7feaf9f2c640 10 client.4529.objecter successfully canceled tick 2026-02-17T21:25:37.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.607+0000 7feaf9f2c640 1 -- 10.20.193.5:0/3745365924 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7feac40792d0 msgr2=0x7feac407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.607+0000 7feaf9f2c640 1 --2- 10.20.193.5:0/3745365924 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7feac40792d0 0x7feac407b790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feae0009750 tx=0x7feae0006ca0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.607+0000 7feaf9f2c640 10 monclient: shutdown 2026-02-17T21:25:37.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.607+0000 7feaf9f2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:37.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.607+0000 7feaf9f2c640 1 -- 10.20.193.5:0/3745365924 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7feaf415d950 msgr2=0x7feaf41f4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.607+0000 7feaf9f2c640 1 --2- 10.20.193.5:0/3745365924 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7feaf415d950 0x7feaf41f4ce0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feae800b9c0 tx=0x7feae800be90 comp rx=0 tx=0).stop 2026-02-17T21:25:37.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.607+0000 7feaf9f2c640 1 -- 10.20.193.5:0/3745365924 shutdown_connections 2026-02-17T21:25:37.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.607+0000 7feaf9f2c640 1 --2- 10.20.193.5:0/3745365924 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7feac40792d0 0x7feac407b790 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.607+0000 7feaf9f2c640 1 --2- 10.20.193.5:0/3745365924 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7feaf415d950 0x7feaf41f4ce0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.607+0000 7feaf9f2c640 1 --2- 10.20.193.5:0/3745365924 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7feaf40d1f40 0x7feaf41f47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.607+0000 7feaf9f2c640 1 --2- 10.20.193.5:0/3745365924 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7feaf40d1b60 0x7feaf4150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.607+0000 7feaf9f2c640 1 -- 10.20.193.5:0/3745365924 >> 10.20.193.5:0/3745365924 conn(0x7feaf406d9b0 msgr2=0x7feaf40d0140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:37.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.607+0000 7feaf9f2c640 1 -- 10.20.193.5:0/3745365924 shutdown_connections 2026-02-17T21:25:37.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.607+0000 7feaf9f2c640 1 -- 10.20.193.5:0/3745365924 wait complete. 2026-02-17T21:25:37.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.607+0000 7feaf9f2c640 1 librados: shutdown 2026-02-17T21:25:37.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084295 got 120259084293 for osd.8 2026-02-17T21:25:37.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.618+0000 7f940d901640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T21:25:37.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.618+0000 7f940d901640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T21:25:37.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.618+0000 7f940d901640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:37.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.618+0000 7f940d901640 1 -- 10.20.193.5:0/2248465611 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f940814bc40 con 0x7f940815bf30 2026-02-17T21:25:37.632 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:02:17.256 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:37.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.634+0000 7f93dffff640 1 -- 10.20.193.5:0/2248465611 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f93f8066090 con 0x7f940815bf30 2026-02-17T21:25:37.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.634+0000 7f93dffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T21:25:37.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.634+0000 7f93dffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:37.636 INFO:teuthology.orchestra.run.trial005.stdout:120259084294 2026-02-17T21:25:37.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.636+0000 7f940d901640 10 librados: watch_flush enter 2026-02-17T21:25:37.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.636+0000 7f940d901640 10 librados: watch_flush exit 2026-02-17T21:25:37.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.636+0000 7f940d901640 20 client.4538.objecter shutdown clearing up homeless session... 2026-02-17T21:25:37.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.636+0000 7f940d901640 10 client.4538.objecter successfully canceled tick 2026-02-17T21:25:37.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.636+0000 7f940d901640 1 -- 10.20.193.5:0/2248465611 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f93d80792d0 msgr2=0x7f93d807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.636+0000 7f940d901640 1 --2- 10.20.193.5:0/2248465611 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f93d80792d0 0x7f93d807b790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9408075130 tx=0x7f93fc033000 comp rx=0 tx=0).stop 2026-02-17T21:25:37.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.636+0000 7f940d901640 10 monclient: shutdown 2026-02-17T21:25:37.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.636+0000 7f940d901640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:37.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.636+0000 7f940d901640 1 -- 10.20.193.5:0/2248465611 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f940815bf30 msgr2=0x7f940814c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.636+0000 7f940d901640 1 --2- 10.20.193.5:0/2248465611 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f940815bf30 0x7f940814c420 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f93f800b990 tx=0x7f93f800be60 comp rx=0 tx=0).stop 2026-02-17T21:25:37.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.636+0000 7f940d901640 1 -- 10.20.193.5:0/2248465611 shutdown_connections 2026-02-17T21:25:37.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.636+0000 7f940d901640 1 --2- 10.20.193.5:0/2248465611 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f93d80792d0 0x7f93d807b790 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.636+0000 7f940d901640 1 --2- 10.20.193.5:0/2248465611 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f940815bf30 0x7f940814c420 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.636+0000 7f940d901640 1 --2- 10.20.193.5:0/2248465611 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f94080ceef0 0x7f940814bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.636+0000 7f940d901640 1 --2- 10.20.193.5:0/2248465611 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f94080ce5d0 0x7f94080d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.636+0000 7f940d901640 1 -- 10.20.193.5:0/2248465611 >> 10.20.193.5:0/2248465611 conn(0x7f9408073030 msgr2=0x7f94080cbfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:37.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.636+0000 7f940d901640 1 -- 10.20.193.5:0/2248465611 shutdown_connections 2026-02-17T21:25:37.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.636+0000 7f940d901640 1 -- 10.20.193.5:0/2248465611 wait complete. 2026-02-17T21:25:37.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.636+0000 7f940d901640 1 librados: shutdown 2026-02-17T21:25:37.641 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:02:17.227 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:37.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084296 got 120259084294 for osd.2 2026-02-17T21:25:37.825 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T21:25:37.835 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T21:25:37.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.892+0000 7fe72ec32640 10 monclient: get_monmap_and_config 2026-02-17T21:25:37.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.892+0000 7fe72ec32640 10 monclient: build_initial_monmap 2026-02-17T21:25:37.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.892+0000 7fe72ec32640 10 monclient: monmap: 2026-02-17T21:25:37.894 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:37.894 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:37.894 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:37.892972+0000 2026-02-17T21:25:37.894 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:37.892972+0000 2026-02-17T21:25:37.894 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:37.894 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:37.894 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:37.894 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:37.894 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:37.895 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:37.895 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:37.895 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:37.895 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:37.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.892+0000 7fe72ec32640 1 Processor -- start 2026-02-17T21:25:37.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.892+0000 7fe72ec32640 1 -- start start 2026-02-17T21:25:37.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.892+0000 7fe72ec32640 10 monclient: init 2026-02-17T21:25:37.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.893+0000 7fe72ec32640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:37.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.893+0000 7fe72ec32640 10 monclient: _add_conns ranks=[4,3,2,0,5,1] 2026-02-17T21:25:37.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.893+0000 7fe72ec32640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fe728152700 0x7fe72815e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:37.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.893+0000 7fe72ec32640 10 monclient(hunting): picked mon.noname-b con 0x7fe728152700 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:37.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.893+0000 7fe72ec32640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fe728152ae0 0x7fe72815edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:37.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.893+0000 7fe72ec32640 10 monclient(hunting): picked mon.noname-a con 0x7fe728152ae0 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:37.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.893+0000 7fe72ec32640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe7280c9730 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:37.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.893+0000 7fe72ec32640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe72815d4f0 con 0x7fe7280c9730 2026-02-17T21:25:37.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.893+0000 7fe72ec32640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:37.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.893+0000 7fe72ec32640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe72815d7d0 con 0x7fe728152ae0 2026-02-17T21:25:37.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.893+0000 7fe72ec32640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:37.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.893+0000 7fe72ec32640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fe72815dab0 con 0x7fe728152700 2026-02-17T21:25:37.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.893+0000 7fe72ec32640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:37.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.893+0000 7fe72ec32640 10 monclient(hunting): authenticate will time out at 1043.458483s 2026-02-17T21:25:37.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.893+0000 7fe72d1a8640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7fe7280c9730 0x7fe7280c9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:47662/0 (socket says 10.20.193.5:47662) 2026-02-17T21:25:37.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.893+0000 7fe72d1a8640 1 -- 10.20.193.5:0/3170600693 learned_addr learned my addr 10.20.193.5:0/3170600693 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:37.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.894+0000 7fe72c9a7640 1 --2- 10.20.193.5:0/3170600693 >> v2:10.20.193.119:3300/0 conn(0x7fe728152700 0x7fe72815e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:37.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.894+0000 7fe71ffff640 1 --2- 10.20.193.5:0/3170600693 >> v2:10.20.193.5:3300/0 conn(0x7fe728152ae0 0x7fe72815edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:37.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.894+0000 7fe71ffff640 10 monclient(hunting): get_auth_request con 0x7fe728152ae0 auth_method 0 2026-02-17T21:25:37.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.894+0000 7fe71ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:37.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.894+0000 7fe71ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:37.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.894+0000 7fe71ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:37.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.894+0000 7fe72c9a7640 10 monclient(hunting): get_auth_request con 0x7fe728152700 auth_method 0 2026-02-17T21:25:37.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.894+0000 7fe72c9a7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:37.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.894+0000 7fe72c9a7640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:37.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.894+0000 7fe72c9a7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:37.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.894+0000 7fe71ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:37.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.894+0000 7fe71ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:37.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.894+0000 7fe71ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:37.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.894+0000 7fe72c9a7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:37.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.894+0000 7fe72c9a7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:37.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.894+0000 7fe72c9a7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:37.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.895+0000 7fe71f7fe640 1 -- 10.20.193.5:0/3170600693 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1788460975 0 0) 0x7fe72815d4f0 con 0x7fe7280c9730 2026-02-17T21:25:37.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.895+0000 7fe71f7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:25:37.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.895+0000 7fe71f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:37.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.895+0000 7fe71f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:37.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.895+0000 7fe71f7fe640 10 monclient(hunting): my global_id is 4541 2026-02-17T21:25:37.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.895+0000 7fe71f7fe640 1 -- 10.20.193.5:0/3170600693 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe714003620 con 0x7fe7280c9730 2026-02-17T21:25:37.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.895+0000 7fe71ffff640 10 monclient(hunting): handle_auth_done global_id 4482 payload 274 2026-02-17T21:25:37.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.895+0000 7fe71ffff640 1 -- 10.20.193.5:0/3170600693 >> v2:10.20.193.119:3300/0 conn(0x7fe728152700 msgr2=0x7fe72815e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:37.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.895+0000 7fe71ffff640 1 --2- 10.20.193.5:0/3170600693 >> v2:10.20.193.119:3300/0 conn(0x7fe728152700 0x7fe72815e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.895+0000 7fe71ffff640 1 -- 10.20.193.5:0/3170600693 >> v1:10.20.193.135:6789/0 conn(0x7fe7280c9730 legacy=0x7fe7280c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.895+0000 7fe71ffff640 10 monclient: _finish_hunting 0 2026-02-17T21:25:37.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.895+0000 7fe71ffff640 1 monclient: found mon.noname-a 2026-02-17T21:25:37.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.895+0000 7fe71ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:37.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.895+0000 7fe71ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:37.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.895+0000 7fe71ffff640 1 -- 10.20.193.5:0/3170600693 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72815dd90 con 0x7fe728152ae0 2026-02-17T21:25:37.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.896+0000 7fe71ffff640 1 --2- 10.20.193.5:0/3170600693 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe728152ae0 0x7fe72815edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe72808e940 tx=0x7fe71002ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52354b770932a89 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:37.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.898+0000 7fe71f7fe640 1 -- 10.20.193.5:0/3170600693 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71003c070 con 0x7fe728152ae0 2026-02-17T21:25:37.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.898+0000 7fe71f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:37.909 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.899+0000 7fe71f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:37.909 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.899+0000 7fe71f7fe640 10 monclient: dump: 2026-02-17T21:25:37.909 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:37.909 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:37.909 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.909 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.909 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:37.909 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:37.909 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:37.909 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:37.909 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:37.909 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:37.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.899+0000 7fe71f7fe640 10 monclient: _finish_auth 0 2026-02-17T21:25:37.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.899+0000 7fe71f7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:25:37.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.899+0000 7fe71f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:37.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.899+0000 7fe71f7fe640 1 -- 10.20.193.5:0/3170600693 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe71002faf0 con 0x7fe728152ae0 2026-02-17T21:25:37.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.899+0000 7fe71f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:37.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.899+0000 7fe72ec32640 5 monclient: authenticate success, global_id 4482 2026-02-17T21:25:37.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.899+0000 7fe71f7fe640 1 -- 10.20.193.5:0/3170600693 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe710037440 con 0x7fe728152ae0 2026-02-17T21:25:37.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.899+0000 7fe71f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:37.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.899+0000 7fe71f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:37.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.899+0000 7fe71f7fe640 10 monclient: dump: 2026-02-17T21:25:37.910 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:37.910 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:37.911 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.911 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.911 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:37.911 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:37.911 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:37.911 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:37.911 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:37.911 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:37.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.899+0000 7fe72ec32640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:37.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.899+0000 7fe72ec32640 4 set_mon_vals no callback set 2026-02-17T21:25:37.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.899+0000 7fe72ec32640 10 monclient: shutdown 2026-02-17T21:25:37.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.899+0000 7fe72ec32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:37.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.899+0000 7fe72ec32640 1 -- 10.20.193.5:0/3170600693 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe728152ae0 msgr2=0x7fe72815edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.899+0000 7fe72ec32640 1 --2- 10.20.193.5:0/3170600693 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe728152ae0 0x7fe72815edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe72808e940 tx=0x7fe71002ede0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.899+0000 7fe72ec32640 1 -- 10.20.193.5:0/3170600693 shutdown_connections 2026-02-17T21:25:37.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.899+0000 7fe72ec32640 1 --2- 10.20.193.5:0/3170600693 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe728152ae0 0x7fe72815edb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.899+0000 7fe72ec32640 1 --2- 10.20.193.5:0/3170600693 >> v2:10.20.193.119:3300/0 conn(0x7fe728152700 0x7fe72815e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.899+0000 7fe72ec32640 1 -- 10.20.193.5:0/3170600693 >> 10.20.193.5:0/3170600693 conn(0x7fe728073030 msgr2=0x7fe728073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:37.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.899+0000 7fe72ec32640 1 -- 10.20.193.5:0/3170600693 shutdown_connections 2026-02-17T21:25:37.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.899+0000 7fe72ec32640 1 -- 10.20.193.5:0/3170600693 wait complete. 2026-02-17T21:25:37.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.900+0000 7fe72ec32640 10 monclient: build_initial_monmap 2026-02-17T21:25:37.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.900+0000 7fe72ec32640 10 monclient: monmap: 2026-02-17T21:25:37.912 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:37.912 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:37.912 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:37.913 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:37.913 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:37.913 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:37.913 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:37.913 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:37.913 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:37.913 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:37.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.900+0000 7fe72ec32640 1 librados: starting msgr at 2026-02-17T21:25:37.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.900+0000 7fe72ec32640 1 librados: starting objecter 2026-02-17T21:25:37.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.900+0000 7fe72ec32640 1 Processor -- start 2026-02-17T21:25:37.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.900+0000 7fe72ec32640 1 -- start start 2026-02-17T21:25:37.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.900+0000 7fe72ec32640 1 librados: setting wanted keys 2026-02-17T21:25:37.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.900+0000 7fe72ec32640 1 librados: calling monclient init 2026-02-17T21:25:37.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.900+0000 7fe72ec32640 10 monclient: init 2026-02-17T21:25:37.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.900+0000 7fe72ec32640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:37.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.900+0000 7fe72ec32640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:25:37.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.900+0000 7fe72ec32640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe7280c9730 0x7fe728155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:37.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.900+0000 7fe72ec32640 10 monclient(hunting): picked mon.noname-a con 0x7fe7280c9730 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:37.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.900+0000 7fe72ec32640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe728152700 0x7fe7281446a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:37.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.900+0000 7fe72ec32640 10 monclient(hunting): picked mon.noname-b con 0x7fe728152700 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:37.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.900+0000 7fe72ec32640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe728152ae0 0x7fe728141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:37.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.900+0000 7fe72ec32640 10 monclient(hunting): picked mon.noname-c con 0x7fe728152ae0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:37.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.900+0000 7fe72ec32640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:37.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.900+0000 7fe72ec32640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe7280ca270 con 0x7fe7280c9730 2026-02-17T21:25:37.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.900+0000 7fe72ec32640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:37.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.900+0000 7fe72ec32640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe72815e350 con 0x7fe728152700 2026-02-17T21:25:37.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.900+0000 7fe72ec32640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:37.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.900+0000 7fe72ec32640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe7280ca3f0 con 0x7fe728152ae0 2026-02-17T21:25:37.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.900+0000 7fe72ec32640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:37.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.900+0000 7fe72ec32640 10 monclient(hunting): authenticate will time out at 1043.465841s 2026-02-17T21:25:37.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe72c9a7640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe7280c9730 0x7fe728155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:37.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe71ffff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe728152700 0x7fe7281446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:37.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe72d1a8640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe728152ae0 0x7fe728141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:37.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe72c9a7640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe7280c9730 0x7fe728155920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:58388/0 (socket says 10.20.193.5:58388) 2026-02-17T21:25:37.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe72c9a7640 1 -- 10.20.193.5:0/2450747123 learned_addr learned my addr 10.20.193.5:0/2450747123 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:37.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe72c9a7640 10 monclient(hunting): get_auth_request con 0x7fe7280c9730 auth_method 0 2026-02-17T21:25:37.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe72c9a7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:37.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe72c9a7640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:37.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe72c9a7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:37.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe71ffff640 10 monclient(hunting): get_auth_request con 0x7fe728152700 auth_method 0 2026-02-17T21:25:37.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe71ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:37.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe71ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:37.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe71ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:37.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe72d1a8640 10 monclient(hunting): get_auth_request con 0x7fe728152ae0 auth_method 0 2026-02-17T21:25:37.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe72d1a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:37.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe72d1a8640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:37.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe72d1a8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:37.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe72c9a7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:37.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe72c9a7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:37.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe72c9a7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:37.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe71ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:37.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe71ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:37.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe71ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:37.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe72d1a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:37.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe72d1a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:37.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.901+0000 7fe72d1a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:37.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.903+0000 7fe71ffff640 10 monclient(hunting): handle_auth_done global_id 4525 payload 824 2026-02-17T21:25:37.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.903+0000 7fe71ffff640 1 -- 10.20.193.5:0/2450747123 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe728152ae0 msgr2=0x7fe728141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.903+0000 7fe71ffff640 1 --2- 10.20.193.5:0/2450747123 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe728152ae0 0x7fe728141fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.903+0000 7fe71ffff640 1 -- 10.20.193.5:0/2450747123 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe7280c9730 msgr2=0x7fe728155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.903+0000 7fe71ffff640 1 --2- 10.20.193.5:0/2450747123 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe7280c9730 0x7fe728155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.903+0000 7fe71ffff640 10 monclient: _finish_hunting 0 2026-02-17T21:25:37.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.903+0000 7fe71ffff640 1 monclient: found mon.noname-b 2026-02-17T21:25:37.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.903+0000 7fe71ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:37.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.903+0000 7fe71ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:37.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.903+0000 7fe71ffff640 1 -- 10.20.193.5:0/2450747123 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe728144d70 con 0x7fe728152700 2026-02-17T21:25:37.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.903+0000 7fe72c9a7640 1 --2- 10.20.193.5:0/2450747123 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe7280c9730 0x7fe728155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T21:25:37.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.904+0000 7fe71ffff640 1 --2- 10.20.193.5:0/2450747123 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe728152700 0x7fe7281446a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe710036000 tx=0x7fe7100047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:37.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.904+0000 7fe71d7fa640 10 client.?.objecter ms_handle_connect 0x7fe728152700 2026-02-17T21:25:37.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.904+0000 7fe71d7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:37.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.905+0000 7fe71d7fa640 1 -- 10.20.193.5:0/2450747123 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe710045020 con 0x7fe728152700 2026-02-17T21:25:37.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.905+0000 7fe71d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:37.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.905+0000 7fe71d7fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:37.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.905+0000 7fe71d7fa640 10 monclient: dump: 2026-02-17T21:25:37.918 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:37.919 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:37.919 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.919 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.919 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:37.919 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:37.919 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:37.919 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:37.919 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:37.919 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:37.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.905+0000 7fe71d7fa640 10 monclient: _finish_auth 0 2026-02-17T21:25:37.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.905+0000 7fe71d7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:25:37.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.905+0000 7fe71d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:37.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.905+0000 7fe72ec32640 5 monclient: authenticate success, global_id 4525 2026-02-17T21:25:37.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.905+0000 7fe72ec32640 10 monclient: _renew_subs 2026-02-17T21:25:37.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.905+0000 7fe72ec32640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:37.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.905+0000 7fe72ec32640 1 -- 10.20.193.5:0/2450747123 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe728152ff0 con 0x7fe728152700 2026-02-17T21:25:37.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.905+0000 7fe72ec32640 10 client.4525.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:37.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.905+0000 7fe72ec32640 10 monclient: _renew_subs 2026-02-17T21:25:37.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.905+0000 7fe72ec32640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:37.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.905+0000 7fe72ec32640 1 -- 10.20.193.5:0/2450747123 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7281535b0 con 0x7fe728152700 2026-02-17T21:25:37.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.905+0000 7fe72ec32640 1 librados: init done 2026-02-17T21:25:37.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.906+0000 7fe71d7fa640 1 -- 10.20.193.5:0/2450747123 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe71003d040 con 0x7fe728152700 2026-02-17T21:25:37.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.906+0000 7fe71d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:37.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.906+0000 7fe71d7fa640 1 -- 10.20.193.5:0/2450747123 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71003c070 con 0x7fe728152700 2026-02-17T21:25:37.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.906+0000 7fe71d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:37.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.906+0000 7fe71d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:37.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.906+0000 7fe71d7fa640 10 monclient: dump: 2026-02-17T21:25:37.921 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:37.921 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:37.921 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.921 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.921 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:37.921 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:37.921 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:37.921 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:37.921 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:37.921 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:37.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.906+0000 7fe71effd640 4 set_mon_vals no callback set 2026-02-17T21:25:37.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.906+0000 7fe72ec32640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:37.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.906+0000 7fe72ec32640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:37.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.906+0000 7fe72ec32640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:37.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.906+0000 7fe72ec32640 1 -- 10.20.193.5:0/2450747123 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe72814e420 con 0x7fe728152700 2026-02-17T21:25:37.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.917+0000 7fe71d7fa640 1 -- 10.20.193.5:0/2450747123 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fe710041810 con 0x7fe728152700 2026-02-17T21:25:37.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.918+0000 7fe71d7fa640 1 --2- 10.20.193.5:0/2450747123 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe6f8079280 0x7fe6f807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:37.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.918+0000 7fe72c9a7640 1 --2- 10.20.193.5:0/2450747123 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe6f8079280 0x7fe6f807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:37.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.918+0000 7fe72c9a7640 10 monclient: get_auth_request con 0x7fe6f8079280 auth_method 0 2026-02-17T21:25:37.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.919+0000 7fe72c9a7640 1 --2- 10.20.193.5:0/2450747123 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe6f8079280 0x7fe6f807b740 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe718011310 tx=0x7fe718009290 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:37.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.919+0000 7fe71d7fa640 10 client.4525.objecter ms_handle_connect 0x7fe6f8079280 2026-02-17T21:25:37.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.920+0000 7fe71d7fa640 1 -- 10.20.193.5:0/2450747123 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fe7100832d0 con 0x7fe728152700 2026-02-17T21:25:37.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.920+0000 7fe71d7fa640 10 client.4525.objecter ms_dispatch2 0x7fe728000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:37.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.920+0000 7fe71d7fa640 3 client.4525.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:37.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.920+0000 7fe71d7fa640 3 client.4525.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:37.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.920+0000 7fe71d7fa640 20 client.4525.objecter dump_active .. 0 homeless 2026-02-17T21:25:37.935 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.934+0000 7f9aeada9640 10 monclient: get_monmap_and_config 2026-02-17T21:25:37.935 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.934+0000 7f9aeada9640 10 monclient: build_initial_monmap 2026-02-17T21:25:37.936 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.934+0000 7f9aeada9640 10 monclient: monmap: 2026-02-17T21:25:37.936 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:37.936 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:37.936 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:37.935178+0000 2026-02-17T21:25:37.936 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:37.935178+0000 2026-02-17T21:25:37.936 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:37.936 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:37.936 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:37.936 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:37.936 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:37.936 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:37.937 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:37.937 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:37.937 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:37.938 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.934+0000 7f9aeada9640 1 Processor -- start 2026-02-17T21:25:37.938 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.934+0000 7f9aeada9640 1 -- start start 2026-02-17T21:25:37.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.934+0000 7f9aeada9640 10 monclient: init 2026-02-17T21:25:37.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.935+0000 7f9aeada9640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:37.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.935+0000 7f9aeada9640 10 monclient: _add_conns ranks=[4,1,2,5,0,3] 2026-02-17T21:25:37.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.935+0000 7f9aeada9640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f9ae40c7170 0x7f9ae40c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:37.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.935+0000 7f9aeada9640 10 monclient(hunting): picked mon.noname-b con 0x7f9ae40c7170 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:37.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.935+0000 7f9aeada9640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f9ae40c48c0 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:37.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.935+0000 7f9aeada9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9ae40c4d10 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:37.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.935+0000 7f9aeada9640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ae415a9a0 con 0x7f9ae40c48c0 2026-02-17T21:25:37.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.935+0000 7f9aeada9640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ae40c5270 con 0x7f9ae40c4d10 2026-02-17T21:25:37.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.935+0000 7f9aeada9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:37.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.935+0000 7f9aeada9640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f9ae40c8530 con 0x7f9ae40c7170 2026-02-17T21:25:37.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.935+0000 7f9aeada9640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:37.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.935+0000 7f9aeada9640 10 monclient(hunting): authenticate will time out at 1043.500496s 2026-02-17T21:25:37.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.935+0000 7f9ae931f640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f9ae40c4d10 0x7f9ae40c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:47678/0 (socket says 10.20.193.5:47678) 2026-02-17T21:25:37.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.935+0000 7f9ae931f640 1 -- 10.20.193.5:0/1461887579 learned_addr learned my addr 10.20.193.5:0/1461887579 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:37.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.937+0000 7f9adb7fe640 1 -- 10.20.193.5:0/1461887579 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 379734988 0 0) 0x7f9ae40c5270 con 0x7f9ae40c4d10 2026-02-17T21:25:37.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.937+0000 7f9adb7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:25:37.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.937+0000 7f9adb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:37.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.937+0000 7f9adb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:37.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.937+0000 7f9adb7fe640 10 monclient(hunting): my global_id is 4547 2026-02-17T21:25:37.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.937+0000 7f9adb7fe640 1 -- 10.20.193.5:0/1461887579 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ad0003620 con 0x7f9ae40c4d10 2026-02-17T21:25:37.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.938+0000 7f9adb7fe640 1 -- 10.20.193.5:0/1461887579 <== mon.2 v1:10.20.193.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4111648359 0 0) 0x7f9ad0003620 con 0x7f9ae40c4d10 2026-02-17T21:25:37.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.938+0000 7f9adb7fe640 1 -- 10.20.193.5:0/1461887579 >> v2:10.20.193.119:3300/0 conn(0x7f9ae40c7170 msgr2=0x7f9ae40c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:37.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.938+0000 7f9adb7fe640 1 --2- 10.20.193.5:0/1461887579 >> v2:10.20.193.119:3300/0 conn(0x7f9ae40c7170 0x7f9ae40c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.938+0000 7f9adb7fe640 1 -- 10.20.193.5:0/1461887579 >> v1:10.20.193.119:6789/0 conn(0x7f9ae40c48c0 legacy=0x7f9ae40749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:37.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.938+0000 7f9adb7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:25:37.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.938+0000 7f9adb7fe640 1 monclient: found mon.noname-c-legacy 2026-02-17T21:25:37.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.938+0000 7f9adb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:37.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.938+0000 7f9adb7fe640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.135:6789/0 2026-02-17T21:25:37.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.938+0000 7f9adb7fe640 1 -- 10.20.193.5:0/1461887579 --> v1:10.20.193.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae40c5550 con 0x7f9ae40c4d10 2026-02-17T21:25:37.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.938+0000 7f9adb7fe640 10 monclient: _finish_auth 0 2026-02-17T21:25:37.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.938+0000 7f9adb7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:25:37.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.938+0000 7f9adb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:37.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.938+0000 7f9aeada9640 5 monclient: authenticate success, global_id 4547 2026-02-17T21:25:37.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.938+0000 7f9aeada9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:37.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.938+0000 7f9adb7fe640 1 -- 10.20.193.5:0/1461887579 <== mon.2 v1:10.20.193.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3880376286 0 0) 0x7f9ae0003280 con 0x7f9ae40c4d10 2026-02-17T21:25:37.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.938+0000 7f9adb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:37.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.938+0000 7f9adb7fe640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T21:25:37.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.938+0000 7f9adb7fe640 10 monclient: dump: 2026-02-17T21:25:37.946 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:37.946 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:37.946 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.946 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.946 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:37.947 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:37.947 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:37.947 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:37.947 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:37.947 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:37.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.938+0000 7f9adb7fe640 1 monclient: mon.c has (v2) addrs [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] but i'm connected to v1:10.20.193.135:6789/0, reconnecting 2026-02-17T21:25:37.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.938+0000 7f9adb7fe640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:37.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.938+0000 7f9adb7fe640 1 -- 10.20.193.5:0/1461887579 >> v1:10.20.193.135:6789/0 conn(0x7f9ae40c4d10 legacy=0x7f9ae40c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.938+0000 7f9adb7fe640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:25:37.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.938+0000 7f9adb7fe640 1 --2- 10.20.193.5:0/1461887579 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9ad0003b50 0x7f9ad0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:37.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.938+0000 7f9adb7fe640 10 monclient(hunting): picked mon.c con 0x7f9ad0003b50 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:37.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.939+0000 7f9adb7fe640 1 --2- 10.20.193.5:0/1461887579 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9ad0004900 0x7f9ad0004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:37.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.939+0000 7f9adb7fe640 10 monclient(hunting): picked mon.b con 0x7f9ad0004900 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:37.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.939+0000 7f9adb7fe640 1 --2- 10.20.193.5:0/1461887579 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9ad00054c0 0x7f9ad000bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:37.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.939+0000 7f9adb7fe640 10 monclient(hunting): picked mon.a con 0x7f9ad00054c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:37.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.939+0000 7f9adb7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:37.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.939+0000 7f9adb7fe640 1 -- 10.20.193.5:0/1461887579 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae40c8530 con 0x7f9ad00054c0 2026-02-17T21:25:37.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.939+0000 7f9adb7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:37.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.939+0000 7f9adb7fe640 1 -- 10.20.193.5:0/1461887579 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad000c400 con 0x7f9ad0004900 2026-02-17T21:25:37.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.939+0000 7f9adb7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:37.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.939+0000 7f9adb7fe640 1 -- 10.20.193.5:0/1461887579 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad000c600 con 0x7f9ad0003b50 2026-02-17T21:25:37.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.939+0000 7f9adb7fe640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:37.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.939+0000 7f9adb7fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:25:37.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.939+0000 7f9aeada9640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:37.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.939+0000 7f9ae931f640 1 --2- 10.20.193.5:0/1461887579 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9ad00054c0 0x7f9ad000bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:37.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.939+0000 7f9ae931f640 10 monclient(hunting): get_auth_request con 0x7f9ad00054c0 auth_method 0 2026-02-17T21:25:37.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.939+0000 7f9ae931f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:37.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.939+0000 7f9ae931f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:37.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.939+0000 7f9ae931f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:25:37.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.939+0000 7f9ae931f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:37.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.939+0000 7f9ae931f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:37.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.939+0000 7f9ae931f640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:25:37.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.940+0000 7f9ae8b1e640 1 --2- 10.20.193.5:0/1461887579 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9ad0003b50 0x7f9ad0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:37.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.940+0000 7f9ae8b1e640 10 monclient(hunting): get_auth_request con 0x7f9ad0003b50 auth_method 0 2026-02-17T21:25:37.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.940+0000 7f9ae8b1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:37.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.940+0000 7f9ae8b1e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:37.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.940+0000 7f9ae8b1e640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:25:37.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.940+0000 7f9ae8b1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:37.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.940+0000 7f9ae8b1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:37.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.940+0000 7f9ae8b1e640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:25:37.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.940+0000 7f9ae931f640 10 monclient(hunting): handle_auth_done global_id 4547 payload 293 2026-02-17T21:25:37.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.940+0000 7f9ae931f640 1 -- 10.20.193.5:0/1461887579 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9ad0003b50 msgr2=0x7f9ad0003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:37.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.940+0000 7f9ae931f640 1 --2- 10.20.193.5:0/1461887579 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9ad0003b50 0x7f9ad0003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.940+0000 7f9ae931f640 1 -- 10.20.193.5:0/1461887579 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9ad0004900 msgr2=0x7f9ad0004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:37.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.940+0000 7f9ae931f640 1 --2- 10.20.193.5:0/1461887579 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9ad0004900 0x7f9ad0004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.940+0000 7f9ae931f640 10 monclient: _finish_hunting 0 2026-02-17T21:25:37.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.940+0000 7f9ae931f640 1 monclient: found mon.a 2026-02-17T21:25:37.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.940+0000 7f9ae931f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:37.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.940+0000 7f9ae931f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:37.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.940+0000 7f9ae931f640 1 -- 10.20.193.5:0/1461887579 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad0003620 con 0x7f9ad00054c0 2026-02-17T21:25:37.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.940+0000 7f9ae931f640 10 monclient: _finish_auth 0 2026-02-17T21:25:37.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.940+0000 7f9ae931f640 10 monclient: _check_auth_tickets 2026-02-17T21:25:37.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.940+0000 7f9ae931f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:37.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.941+0000 7f9ae931f640 1 -- 10.20.193.5:0/1461887579 reap_dead start 2026-02-17T21:25:37.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.942+0000 7f9ae931f640 1 --2- 10.20.193.5:0/1461887579 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9ad00054c0 0x7f9ad000bb20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40c51a0 tx=0x7f9ae002fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9be880590d505e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:37.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.943+0000 7f9adb7fe640 1 -- 10.20.193.5:0/1461887579 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae000a4c0 con 0x7f9ad00054c0 2026-02-17T21:25:37.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.943+0000 7f9adb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:37.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.943+0000 7f9adb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:37.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.943+0000 7f9adb7fe640 10 monclient: dump: 2026-02-17T21:25:37.952 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:37.952 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:37.952 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.952 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.952 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:37.952 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:37.952 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:37.952 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:37.952 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:37.952 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:37.952 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.943+0000 7f9aeada9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:37.953 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-17T21:25:37.953 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-17T21:25:37.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.944+0000 7f9adb7fe640 1 -- 10.20.193.5:0/1461887579 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ae0031680 con 0x7f9ad00054c0 2026-02-17T21:25:37.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.944+0000 7f9adb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:37.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.944+0000 7f9adb7fe640 1 -- 10.20.193.5:0/1461887579 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0031a70 con 0x7f9ad00054c0 2026-02-17T21:25:37.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.944+0000 7f9adb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:37.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.944+0000 7f9adb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:37.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.944+0000 7f9adb7fe640 10 monclient: dump: 2026-02-17T21:25:37.959 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:37.959 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:37.960 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.960 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.960 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:37.960 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:37.960 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:37.960 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:37.960 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:37.960 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:37.960 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.944+0000 7f9aeada9640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:37.960 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.944+0000 7f9aeada9640 4 set_mon_vals no callback set 2026-02-17T21:25:37.960 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.944+0000 7f9aeada9640 10 monclient: shutdown 2026-02-17T21:25:37.960 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.944+0000 7f9aeada9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:37.960 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.944+0000 7f9aeada9640 1 -- 10.20.193.5:0/1461887579 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9ad00054c0 msgr2=0x7f9ad000bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.944+0000 7f9aeada9640 1 --2- 10.20.193.5:0/1461887579 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9ad00054c0 0x7f9ad000bb20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40c51a0 tx=0x7f9ae002fc10 comp rx=0 tx=0).stop 2026-02-17T21:25:37.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.944+0000 7f9aeada9640 1 -- 10.20.193.5:0/1461887579 shutdown_connections 2026-02-17T21:25:37.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.944+0000 7f9aeada9640 1 --2- 10.20.193.5:0/1461887579 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9ad00054c0 0x7f9ad000bb20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.944+0000 7f9aeada9640 1 -- 10.20.193.5:0/1461887579 >> 10.20.193.5:0/1461887579 conn(0x7f9ae40c9f40 msgr2=0x7f9ae40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:37.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.944+0000 7f9aeada9640 1 -- 10.20.193.5:0/1461887579 shutdown_connections 2026-02-17T21:25:37.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.944+0000 7f9aeada9640 1 -- 10.20.193.5:0/1461887579 wait complete. 2026-02-17T21:25:37.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.944+0000 7f9aeada9640 10 monclient: build_initial_monmap 2026-02-17T21:25:37.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.944+0000 7f9aeada9640 10 monclient: monmap: 2026-02-17T21:25:37.961 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:37.961 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:37.961 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:37.961 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:37.961 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:37.961 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:37.962 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:37.962 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:37.962 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:37.962 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:37.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.944+0000 7f9aeada9640 1 librados: starting msgr at 2026-02-17T21:25:37.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.944+0000 7f9aeada9640 1 librados: starting objecter 2026-02-17T21:25:37.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.944+0000 7f9aeada9640 1 Processor -- start 2026-02-17T21:25:37.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9aeada9640 1 -- start start 2026-02-17T21:25:37.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9aeada9640 1 librados: setting wanted keys 2026-02-17T21:25:37.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9aeada9640 1 librados: calling monclient init 2026-02-17T21:25:37.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9aeada9640 10 monclient: init 2026-02-17T21:25:37.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9aeada9640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:37.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9aeada9640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:25:37.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9aeada9640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9ad00054c0 0x7f9ae41f1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:37.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9aeada9640 10 monclient(hunting): picked mon.noname-a con 0x7f9ad00054c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:37.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9aeada9640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9ae41f54b0 0x7f9ae414c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:37.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9aeada9640 10 monclient(hunting): picked mon.noname-b con 0x7f9ae41f54b0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:37.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9aeada9640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9ae40c38f0 0x7f9ae40c3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:37.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9aeada9640 10 monclient(hunting): picked mon.noname-c con 0x7f9ae40c38f0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:37.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9aeada9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:37.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9aeada9640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae40c81c0 con 0x7f9ad00054c0 2026-02-17T21:25:37.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9aeada9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:37.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9aeada9640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae40c7ee0 con 0x7f9ae41f54b0 2026-02-17T21:25:37.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9aeada9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:37.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9aeada9640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae40c7550 con 0x7f9ae40c38f0 2026-02-17T21:25:37.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9aeada9640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:37.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9aeada9640 10 monclient(hunting): authenticate will time out at 1043.510445s 2026-02-17T21:25:37.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9ae8b1e640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9ad00054c0 0x7f9ae41f1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:37.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9ae931f640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9ae40c38f0 0x7f9ae40c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:37.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9ae8b1e640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9ad00054c0 0x7f9ae41f1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:58416/0 (socket says 10.20.193.5:58416) 2026-02-17T21:25:37.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9ae8b1e640 1 -- 10.20.193.5:0/1737598302 learned_addr learned my addr 10.20.193.5:0/1737598302 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:37.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9ae8b1e640 10 monclient(hunting): get_auth_request con 0x7f9ad00054c0 auth_method 0 2026-02-17T21:25:37.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9ae8b1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:37.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9ae8b1e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:37.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9ae8b1e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:37.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9ae931f640 10 monclient(hunting): get_auth_request con 0x7f9ae40c38f0 auth_method 0 2026-02-17T21:25:37.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9ae931f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:37.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9ae931f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:37.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.945+0000 7f9ae931f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:37.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.946+0000 7f9ae8b1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:37.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.946+0000 7f9ae8b1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:37.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.946+0000 7f9ae8b1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:37.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.946+0000 7f9ae931f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:37.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.946+0000 7f9ae931f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:37.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.946+0000 7f9ae931f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:37.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.947+0000 7f9ae8b1e640 10 monclient(hunting): handle_auth_done global_id 4488 payload 824 2026-02-17T21:25:37.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.947+0000 7f9ae8b1e640 1 -- 10.20.193.5:0/1737598302 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9ae40c38f0 msgr2=0x7f9ae40c3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.947+0000 7f9ae8b1e640 1 --2- 10.20.193.5:0/1737598302 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9ae40c38f0 0x7f9ae40c3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.947+0000 7f9ae8b1e640 1 -- 10.20.193.5:0/1737598302 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9ae41f54b0 msgr2=0x7f9ae414c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:37.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.947+0000 7f9ae8b1e640 1 --2- 10.20.193.5:0/1737598302 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9ae41f54b0 0x7f9ae414c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:37.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.947+0000 7f9ae8b1e640 10 monclient: _finish_hunting 0 2026-02-17T21:25:37.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.947+0000 7f9ae8b1e640 1 monclient: found mon.noname-a 2026-02-17T21:25:37.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.947+0000 7f9ae8b1e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:37.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.947+0000 7f9ae8b1e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:37.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.947+0000 7f9ae8b1e640 1 -- 10.20.193.5:0/1737598302 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae41f18e0 con 0x7f9ad00054c0 2026-02-17T21:25:37.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.948+0000 7f9ae8b1e640 1 --2- 10.20.193.5:0/1737598302 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9ad00054c0 0x7f9ae41f1280 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4009740 tx=0x7f9ad4009c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:37.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.948+0000 7f9ad97fa640 10 client.?.objecter ms_handle_connect 0x7f9ad00054c0 2026-02-17T21:25:37.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.948+0000 7f9ad97fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:37.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.950+0000 7f9ad97fa640 1 -- 10.20.193.5:0/1737598302 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad400e7b0 con 0x7f9ad00054c0 2026-02-17T21:25:37.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.950+0000 7f9ad97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:37.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.950+0000 7f9ad97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:37.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.950+0000 7f9ad97fa640 10 monclient: dump: 2026-02-17T21:25:37.965 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:37.965 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:37.966 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.966 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.966 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:37.966 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:37.966 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:37.966 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:37.966 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:37.966 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:37.966 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.950+0000 7f9ad97fa640 10 monclient: _finish_auth 0 2026-02-17T21:25:37.966 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.950+0000 7f9ad97fa640 10 monclient: _check_auth_tickets 2026-02-17T21:25:37.966 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.950+0000 7f9ad97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:37.966 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.950+0000 7f9ad97fa640 1 -- 10.20.193.5:0/1737598302 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ad4017070 con 0x7f9ad00054c0 2026-02-17T21:25:37.966 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.950+0000 7f9ad97fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:37.966 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.950+0000 7f9ad97fa640 1 -- 10.20.193.5:0/1737598302 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad400ebb0 con 0x7f9ad00054c0 2026-02-17T21:25:37.966 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.950+0000 7f9ad97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:37.966 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.950+0000 7f9ad97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:37.966 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.950+0000 7f9adaffd640 4 set_mon_vals no callback set 2026-02-17T21:25:37.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.950+0000 7f9ad97fa640 10 monclient: dump: 2026-02-17T21:25:37.967 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:37.967 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:37.967 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.967 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:37.967 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:37.967 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:37.967 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:37.967 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:37.967 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:37.967 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:37.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.950+0000 7f9aeada9640 5 monclient: authenticate success, global_id 4488 2026-02-17T21:25:37.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.950+0000 7f9aeada9640 10 monclient: _renew_subs 2026-02-17T21:25:37.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.950+0000 7f9aeada9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:37.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.950+0000 7f9aeada9640 1 -- 10.20.193.5:0/1737598302 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ae41f1bc0 con 0x7f9ad00054c0 2026-02-17T21:25:37.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.950+0000 7f9aeada9640 10 client.4488.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:37.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.950+0000 7f9aeada9640 10 monclient: _renew_subs 2026-02-17T21:25:37.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.950+0000 7f9aeada9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:37.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.950+0000 7f9aeada9640 1 -- 10.20.193.5:0/1737598302 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ae40c30f0 con 0x7f9ad00054c0 2026-02-17T21:25:37.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.950+0000 7f9aeada9640 1 librados: init done 2026-02-17T21:25:37.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.951+0000 7f9aeada9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:37.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.951+0000 7f9aeada9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:37.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.951+0000 7f9aeada9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:37.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.951+0000 7f9aeada9640 1 -- 10.20.193.5:0/1737598302 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ae41f20e0 con 0x7f9ad00054c0 2026-02-17T21:25:37.968 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2026-02-17T21:25:37.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.962+0000 7f9ad97fa640 1 -- 10.20.193.5:0/1737598302 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f9ad401c460 con 0x7f9ad00054c0 2026-02-17T21:25:37.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.963+0000 7f9ad97fa640 1 --2- 10.20.193.5:0/1737598302 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9ab40792b0 0x7f9ab407b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:37.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.963+0000 7f9adbfff640 1 --2- 10.20.193.5:0/1737598302 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9ab40792b0 0x7f9ab407b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:37.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.963+0000 7f9adbfff640 10 monclient: get_auth_request con 0x7f9ab40792b0 auth_method 0 2026-02-17T21:25:37.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.963+0000 7f9ad97fa640 10 client.4488.objecter ms_handle_connect 0x7f9ab40792b0 2026-02-17T21:25:37.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.963+0000 7f9adbfff640 1 --2- 10.20.193.5:0/1737598302 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9ab40792b0 0x7f9ab407b770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4157b30 tx=0x7f9acc006db0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:37.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.964+0000 7f9ad97fa640 1 -- 10.20.193.5:0/1737598302 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f9ad400ed50 con 0x7f9ad00054c0 2026-02-17T21:25:37.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.964+0000 7f9ad97fa640 10 client.4488.objecter ms_dispatch2 0x7f9ae4000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:37.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.964+0000 7f9ad97fa640 3 client.4488.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:37.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.964+0000 7f9ad97fa640 3 client.4488.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:37.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:37.964+0000 7f9ad97fa640 20 client.4488.objecter dump_active .. 0 homeless 2026-02-17T21:25:38.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.023+0000 7fe71d7fa640 1 -- 10.20.193.5:0/2450747123 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe72814e420 con 0x7fe728152700 2026-02-17T21:25:38.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.023+0000 7fe71d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.023+0000 7fe71d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:38.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.036+0000 7fc5c3577640 10 monclient: get_monmap_and_config 2026-02-17T21:25:38.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.036+0000 7fc5c3577640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.036+0000 7fc5c3577640 10 monclient: monmap: 2026-02-17T21:25:38.038 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.038 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.038 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:38.037639+0000 2026-02-17T21:25:38.038 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:38.037639+0000 2026-02-17T21:25:38.038 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.039 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.039 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:38.039 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:38.039 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:38.039 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:38.039 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:38.039 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:38.039 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.037+0000 7fc5c3577640 1 Processor -- start 2026-02-17T21:25:38.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.037+0000 7fc5c3577640 1 -- start start 2026-02-17T21:25:38.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.037+0000 7fc5c3577640 10 monclient: init 2026-02-17T21:25:38.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.037+0000 7f26d0eb9640 10 monclient: get_monmap_and_config 2026-02-17T21:25:38.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.037+0000 7f26d0eb9640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.037+0000 7f26d0eb9640 10 monclient: monmap: 2026-02-17T21:25:38.041 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.041 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.041 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:38.038334+0000 2026-02-17T21:25:38.041 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:38.038334+0000 2026-02-17T21:25:38.041 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.041 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.041 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:38.041 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:38.041 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:38.041 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:38.041 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:38.042 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:38.042 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7fc5c3577640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7fc5c3577640 10 monclient: _add_conns ranks=[0,3,2,4,5,1] 2026-02-17T21:25:38.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7fc5c3577640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc5c40740d0 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:38.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7fc5c3577640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fc5c415ed60 0x7fc5c40744b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7fc5c3577640 10 monclient(hunting): picked mon.noname-a con 0x7fc5c415ed60 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:38.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7fc5c3577640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc5c4159c00 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:38.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7fc5c3577640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5c415d9e0 con 0x7fc5c40740d0 2026-02-17T21:25:38.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7fc5c3577640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5c415dcc0 con 0x7fc5c4159c00 2026-02-17T21:25:38.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7fc5c3577640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7fc5c3577640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc5c415dfa0 con 0x7fc5c415ed60 2026-02-17T21:25:38.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7fc5c3577640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7fc5c3577640 10 monclient(hunting): authenticate will time out at 1043.603155s 2026-02-17T21:25:38.045 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7f26d0eb9640 1 Processor -- start 2026-02-17T21:25:38.045 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7f26d0eb9640 1 -- start start 2026-02-17T21:25:38.045 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7f26d0eb9640 10 monclient: init 2026-02-17T21:25:38.045 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7fc5c2d76640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7fc5c4159c00 0x7fc5c4152080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:47680/0 (socket says 10.20.193.5:47680) 2026-02-17T21:25:38.045 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7fc5c2d76640 1 -- 10.20.193.5:0/3216903287 learned_addr learned my addr 10.20.193.5:0/3216903287 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:38.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7f26d0eb9640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7f26d0eb9640 10 monclient: _add_conns ranks=[0,3,2,1,4,5] 2026-02-17T21:25:38.047 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7f26d0eb9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f26cc0d1b60 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:38.047 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7f26d0eb9640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f26cc0d1f40 0x7f26cc15c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.047 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7f26d0eb9640 10 monclient(hunting): picked mon.noname-a con 0x7f26cc0d1f40 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:38.047 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7f26d0eb9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f26cc15d950 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:38.047 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7f26d0eb9640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26cc0c98e0 con 0x7f26cc0d1b60 2026-02-17T21:25:38.047 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7f26d0eb9640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26cc0c9bc0 con 0x7f26cc15d950 2026-02-17T21:25:38.047 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7f26d0eb9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.047 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7f26d0eb9640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f26cc15cd80 con 0x7f26cc0d1f40 2026-02-17T21:25:38.047 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7f26d0eb9640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.047 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.038+0000 7f26d0eb9640 10 monclient(hunting): authenticate will time out at 1043.603917s 2026-02-17T21:25:38.048 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.039+0000 7fc5c1573640 1 -- 10.20.193.5:0/3216903287 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1714118333 0 0) 0x7fc5c415dcc0 con 0x7fc5c4159c00 2026-02-17T21:25:38.048 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.039+0000 7fc5c1573640 10 monclient(hunting): _negotiate 2026-02-17T21:25:38.048 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.039+0000 7fc5c1573640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.048 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.039+0000 7fc5c1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.049 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.039+0000 7fc5c1573640 10 monclient(hunting): my global_id is 4553 2026-02-17T21:25:38.049 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.039+0000 7fc5c1573640 1 -- 10.20.193.5:0/3216903287 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5b0003620 con 0x7fc5c4159c00 2026-02-17T21:25:38.049 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.040+0000 7f26cad76640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f26cc15d950 0x7f26cc15dd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:47692/0 (socket says 10.20.193.5:47692) 2026-02-17T21:25:38.049 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.040+0000 7f26cad76640 1 -- 10.20.193.5:0/2846258454 learned_addr learned my addr 10.20.193.5:0/2846258454 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:38.052 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-17T21:25:38.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 1 -- 10.20.193.5:0/3216903287 <== mon.2 v1:10.20.193.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1812915280 0 0) 0x7fc5b0003620 con 0x7fc5c4159c00 2026-02-17T21:25:38.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 1 -- 10.20.193.5:0/3216903287 >> v2:10.20.193.5:3300/0 conn(0x7fc5c415ed60 msgr2=0x7fc5c40744b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 1 --2- 10.20.193.5:0/3216903287 >> v2:10.20.193.5:3300/0 conn(0x7fc5c415ed60 0x7fc5c40744b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 1 -- 10.20.193.5:0/3216903287 >> v1:10.20.193.5:6789/0 conn(0x7fc5c40740d0 legacy=0x7fc5c415d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.054 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.054 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 1 monclient: found mon.noname-c-legacy 2026-02-17T21:25:38.054 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.054 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.135:6789/0 2026-02-17T21:25:38.054 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 1 -- 10.20.193.5:0/3216903287 --> v1:10.20.193.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c415e280 con 0x7fc5c4159c00 2026-02-17T21:25:38.054 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.054 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.054 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.054 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 1 -- 10.20.193.5:0/3216903287 <== mon.2 v1:10.20.193.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3880376286 0 0) 0x7fc5b4003280 con 0x7fc5c4159c00 2026-02-17T21:25:38.054 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c3577640 5 monclient: authenticate success, global_id 4553 2026-02-17T21:25:38.054 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c3577640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:38.054 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.055 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T21:25:38.055 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 10 monclient: dump: 2026-02-17T21:25:38.055 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.055 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.055 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.055 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.055 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.055 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.055 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.055 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.055 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.055 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.056 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 1 monclient: mon.c has (v2) addrs [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] but i'm connected to v1:10.20.193.135:6789/0, reconnecting 2026-02-17T21:25:38.056 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.056 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 1 -- 10.20.193.5:0/3216903287 >> v1:10.20.193.135:6789/0 conn(0x7fc5c4159c00 legacy=0x7fc5c4152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.056 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:25:38.056 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 1 --2- 10.20.193.5:0/3216903287 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc5b0003ba0 0x7fc5b0003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.056 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 10 monclient(hunting): picked mon.a con 0x7fc5b0003ba0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:38.056 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 1 --2- 10.20.193.5:0/3216903287 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc5b0004900 0x7fc5b0004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.056 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 10 monclient(hunting): picked mon.b con 0x7fc5b0004900 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:38.056 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 1 --2- 10.20.193.5:0/3216903287 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc5b0005470 0x7fc5b000bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.056 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 10 monclient(hunting): picked mon.c con 0x7fc5b0005470 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:38.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 1 -- 10.20.193.5:0/3216903287 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c415dfa0 con 0x7fc5b0003ba0 2026-02-17T21:25:38.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 1 -- 10.20.193.5:0/3216903287 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b000c3c0 con 0x7fc5b0004900 2026-02-17T21:25:38.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 1 -- 10.20.193.5:0/3216903287 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b000c5c0 con 0x7fc5b0005470 2026-02-17T21:25:38.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1573640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:25:38.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c3577640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:38.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1d74640 1 --2- 10.20.193.5:0/3216903287 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc5b0004900 0x7fc5b0004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1d74640 10 monclient(hunting): get_auth_request con 0x7fc5b0004900 auth_method 0 2026-02-17T21:25:38.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.042+0000 7fc5c1d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:25:38.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.043+0000 7fc5c1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.043+0000 7fc5c1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.043+0000 7fc5c1d74640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:25:38.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.044+0000 7fc5c1d74640 10 monclient(hunting): handle_auth_done global_id 4553 payload 293 2026-02-17T21:25:38.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.044+0000 7fc5c1d74640 1 -- 10.20.193.5:0/3216903287 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc5b0005470 msgr2=0x7fc5b000bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.044+0000 7fc5c1d74640 1 --2- 10.20.193.5:0/3216903287 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc5b0005470 0x7fc5b000bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.044+0000 7fc5c1d74640 1 -- 10.20.193.5:0/3216903287 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc5b0003ba0 msgr2=0x7fc5b0003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.044+0000 7fc5c1d74640 1 --2- 10.20.193.5:0/3216903287 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc5b0003ba0 0x7fc5b0003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.044+0000 7fc5c1d74640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.044+0000 7fc5c1d74640 1 monclient: found mon.b 2026-02-17T21:25:38.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.044+0000 7fc5c1d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.044+0000 7fc5c1d74640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.044+0000 7fc5c2d76640 1 -- 10.20.193.5:0/3216903287 reap_dead start 2026-02-17T21:25:38.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.044+0000 7fc5c1d74640 1 -- 10.20.193.5:0/3216903287 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5b0003620 con 0x7fc5b0004900 2026-02-17T21:25:38.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.044+0000 7fc5c1d74640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.044+0000 7fc5c1d74640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.044+0000 7fc5c1d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.060 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.044+0000 7f26c9573640 1 -- 10.20.193.5:0/2846258454 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1106556011 0 0) 0x7f26cc0c9bc0 con 0x7f26cc15d950 2026-02-17T21:25:38.060 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.044+0000 7f26c9573640 10 monclient(hunting): _negotiate 2026-02-17T21:25:38.060 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.044+0000 7f26c9573640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.060 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.044+0000 7f26c9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.060 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.044+0000 7f26c9573640 10 monclient(hunting): my global_id is 4556 2026-02-17T21:25:38.060 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.044+0000 7f26c9573640 1 -- 10.20.193.5:0/2846258454 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26b8003620 con 0x7f26cc15d950 2026-02-17T21:25:38.061 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.045+0000 7fc5c1d74640 1 --2- 10.20.193.5:0/3216903287 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc5b0004900 0x7fc5b0004d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac009980 tx=0x7fc5ac02ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e41fb96cad11daff server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.062 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 1 -- 10.20.193.5:0/2846258454 <== mon.2 v1:10.20.193.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2177055395 0 0) 0x7f26b8003620 con 0x7f26cc15d950 2026-02-17T21:25:38.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 1 -- 10.20.193.5:0/2846258454 >> v2:10.20.193.5:3300/0 conn(0x7f26cc0d1f40 msgr2=0x7f26cc15c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 1 --2- 10.20.193.5:0/2846258454 >> v2:10.20.193.5:3300/0 conn(0x7f26cc0d1f40 0x7f26cc15c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 1 -- 10.20.193.5:0/2846258454 >> v1:10.20.193.5:6789/0 conn(0x7f26cc0d1b60 legacy=0x7f26cc0c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 1 monclient: found mon.noname-c-legacy 2026-02-17T21:25:38.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.135:6789/0 2026-02-17T21:25:38.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 1 -- 10.20.193.5:0/2846258454 --> v1:10.20.193.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26cc0c9ea0 con 0x7f26cc15d950 2026-02-17T21:25:38.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 1 -- 10.20.193.5:0/2846258454 <== mon.2 v1:10.20.193.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3880376286 0 0) 0x7f26bc003280 con 0x7f26cc15d950 2026-02-17T21:25:38.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T21:25:38.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 10 monclient: dump: 2026-02-17T21:25:38.064 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.064 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.064 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.064 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.064 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.064 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.064 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.065 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.065 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.065 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 1 monclient: mon.c has (v2) addrs [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] but i'm connected to v1:10.20.193.135:6789/0, reconnecting 2026-02-17T21:25:38.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 1 -- 10.20.193.5:0/2846258454 >> v1:10.20.193.135:6789/0 conn(0x7f26cc15d950 legacy=0x7f26cc15dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:25:38.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 1 --2- 10.20.193.5:0/2846258454 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f26b8003ba0 0x7f26b8003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 10 monclient(hunting): picked mon.a con 0x7f26b8003ba0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:38.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 1 --2- 10.20.193.5:0/2846258454 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f26b8004900 0x7f26b8004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 10 monclient(hunting): picked mon.b con 0x7f26b8004900 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:38.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 1 --2- 10.20.193.5:0/2846258454 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f26b8005510 0x7f26b800bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 10 monclient(hunting): picked mon.c con 0x7f26b8005510 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:38.066 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.066 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 1 -- 10.20.193.5:0/2846258454 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc15cd80 con 0x7f26b8003ba0 2026-02-17T21:25:38.066 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.066 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 1 -- 10.20.193.5:0/2846258454 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f26b800c450 con 0x7f26b8004900 2026-02-17T21:25:38.066 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.066 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 1 -- 10.20.193.5:0/2846258454 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f26b800c650 con 0x7f26b8005510 2026-02-17T21:25:38.066 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.066 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7f26c9573640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:25:38.067 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7fc5c1573640 1 -- 10.20.193.5:0/3216903287 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac03c070 con 0x7fc5b0004900 2026-02-17T21:25:38.067 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7fc5c1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.067 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7fc5c1573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:38.067 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7fc5c1573640 10 monclient: dump: 2026-02-17T21:25:38.067 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.067 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.067 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.068 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.068 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.068 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.068 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.068 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.068 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.068 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7fc5c1573640 1 -- 10.20.193.5:0/3216903287 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5ac02f790 con 0x7fc5b0004900 2026-02-17T21:25:38.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7fc5c3577640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:38.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7fc5c1573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7fc5c1573640 1 -- 10.20.193.5:0/3216903287 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac009550 con 0x7fc5b0004900 2026-02-17T21:25:38.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7fc5c1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7fc5c1573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:38.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7fc5c1573640 10 monclient: dump: 2026-02-17T21:25:38.069 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.069 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.069 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.069 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.069 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.069 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.069 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.069 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.069 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.069 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7fc5c3577640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:38.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.046+0000 7fc5c3577640 4 set_mon_vals no callback set 2026-02-17T21:25:38.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.047+0000 7fc5c3577640 10 monclient: shutdown 2026-02-17T21:25:38.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.047+0000 7fc5c3577640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.047+0000 7fc5c3577640 1 -- 10.20.193.5:0/3216903287 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc5b0004900 msgr2=0x7fc5b0004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.047+0000 7fc5c3577640 1 --2- 10.20.193.5:0/3216903287 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc5b0004900 0x7fc5b0004d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac009980 tx=0x7fc5ac02ed30 comp rx=0 tx=0).stop 2026-02-17T21:25:38.070 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.047+0000 7f26c9d74640 1 --2- 10.20.193.5:0/2846258454 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f26b8004900 0x7f26b8004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.070 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.047+0000 7fc5c3577640 1 -- 10.20.193.5:0/3216903287 shutdown_connections 2026-02-17T21:25:38.070 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.047+0000 7fc5c3577640 1 --2- 10.20.193.5:0/3216903287 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc5b0004900 0x7fc5b0004d80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.070 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.047+0000 7fc5c3577640 1 -- 10.20.193.5:0/3216903287 >> 10.20.193.5:0/3216903287 conn(0x7fc5c40d1d80 msgr2=0x7fc5c40ce1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.047+0000 7fc5c3577640 1 -- 10.20.193.5:0/3216903287 shutdown_connections 2026-02-17T21:25:38.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.047+0000 7fc5c3577640 1 -- 10.20.193.5:0/3216903287 wait complete. 2026-02-17T21:25:38.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.047+0000 7f26c9d74640 10 monclient(hunting): get_auth_request con 0x7f26b8004900 auth_method 0 2026-02-17T21:25:38.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.047+0000 7f26c9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.047+0000 7f26c9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.047+0000 7f26c9d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:25:38.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.047+0000 7f26cad76640 1 --2- 10.20.193.5:0/2846258454 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f26b8005510 0x7f26b800bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.047+0000 7fc5c3577640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.047+0000 7fc5c3577640 10 monclient: monmap: 2026-02-17T21:25:38.072 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.072 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:38.072 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:38.072 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:38.072 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.072 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.072 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:38.073 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:38.073 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:38.073 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.047+0000 7fc5c3577640 1 librados: starting msgr at 2026-02-17T21:25:38.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.047+0000 7fc5c3577640 1 librados: starting objecter 2026-02-17T21:25:38.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.047+0000 7fc5c3577640 1 Processor -- start 2026-02-17T21:25:38.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.047+0000 7fc5c3577640 1 -- start start 2026-02-17T21:25:38.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.047+0000 7fc5c3577640 1 librados: setting wanted keys 2026-02-17T21:25:38.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.047+0000 7fc5c3577640 1 librados: calling monclient init 2026-02-17T21:25:38.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.047+0000 7fc5c3577640 10 monclient: init 2026-02-17T21:25:38.074 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7f26c9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.074 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7f26c9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.074 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7f26c9d74640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:25:38.074 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7f26cad76640 10 monclient(hunting): get_auth_request con 0x7f26b8005510 auth_method 0 2026-02-17T21:25:38.074 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7f26cad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.074 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7f26cad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.074 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7f26cad76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:25:38.074 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7f26cad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.074 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7f26cad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.074 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7fc5c3577640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7f26cad76640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:25:38.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7fc5c3577640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:25:38.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7fc5c3577640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc5b0004900 0x7fc5c4150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7fc5c3577640 10 monclient(hunting): picked mon.noname-a con 0x7fc5b0004900 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:38.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7fc5c3577640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc5c41f3e40 0x7fc5c41f1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7fc5c3577640 10 monclient(hunting): picked mon.noname-c con 0x7fc5c41f3e40 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:38.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7fc5c3577640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc5c41f46b0 0x7fc5c40cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7fc5c3577640 10 monclient(hunting): picked mon.noname-b con 0x7fc5c41f46b0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:38.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7fc5c3577640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7fc5c3577640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c415a040 con 0x7fc5b0004900 2026-02-17T21:25:38.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7fc5c3577640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7fc5c3577640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c415e840 con 0x7fc5c41f46b0 2026-02-17T21:25:38.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7fc5c3577640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7fc5c3577640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c40744b0 con 0x7fc5c41f3e40 2026-02-17T21:25:38.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7fc5c3577640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.048+0000 7fc5c3577640 10 monclient(hunting): authenticate will time out at 1043.613387s 2026-02-17T21:25:38.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.049+0000 7f26c9d74640 10 monclient(hunting): handle_auth_done global_id 4556 payload 293 2026-02-17T21:25:38.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.049+0000 7f26c9d74640 1 -- 10.20.193.5:0/2846258454 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f26b8005510 msgr2=0x7f26b800bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.049+0000 7f26c9d74640 1 --2- 10.20.193.5:0/2846258454 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f26b8005510 0x7f26b800bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.049+0000 7f26c9d74640 1 -- 10.20.193.5:0/2846258454 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f26b8003ba0 msgr2=0x7f26b8003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.049+0000 7f26c9d74640 1 --2- 10.20.193.5:0/2846258454 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f26b8003ba0 0x7f26b8003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.049+0000 7f26c9d74640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.049+0000 7f26c9d74640 1 monclient: found mon.b 2026-02-17T21:25:38.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.049+0000 7f26c9d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.049+0000 7f26c9d74640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.049+0000 7f26c9d74640 1 -- 10.20.193.5:0/2846258454 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b8003620 con 0x7f26b8004900 2026-02-17T21:25:38.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.049+0000 7f26c9d74640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.049+0000 7f26c9d74640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.049+0000 7f26c9d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.049+0000 7f26cad76640 1 -- 10.20.193.5:0/2846258454 reap_dead start 2026-02-17T21:25:38.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.049+0000 7f26d0eb9640 5 monclient: authenticate success, global_id 4556 2026-02-17T21:25:38.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.049+0000 7f26d0eb9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:38.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.049+0000 7fc5c2d76640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc5c41f46b0 0x7fc5c40cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.050+0000 7fc5c2d76640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc5c41f46b0 0x7fc5c40cd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:59980/0 (socket says 10.20.193.5:59980) 2026-02-17T21:25:38.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.050+0000 7fc5c2d76640 1 -- 10.20.193.5:0/1953016475 learned_addr learned my addr 10.20.193.5:0/1953016475 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:38.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.050+0000 7fc5c2d76640 10 monclient(hunting): get_auth_request con 0x7fc5c41f46b0 auth_method 0 2026-02-17T21:25:38.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.050+0000 7fc5c2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.050+0000 7fc5c2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.050+0000 7fc5c2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.050+0000 7fc5c1d74640 1 --2- 10.20.193.5:0/1953016475 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc5c41f3e40 0x7fc5c41f1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.050+0000 7fc5c1d74640 10 monclient(hunting): get_auth_request con 0x7fc5c41f3e40 auth_method 0 2026-02-17T21:25:38.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.050+0000 7fc5c1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.050+0000 7fc5c1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.050+0000 7fc5c1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.050+0000 7f26c9d74640 1 --2- 10.20.193.5:0/2846258454 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f26b8004900 0x7f26b8004d80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009980 tx=0x7f26b402ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=847abed81b2605df server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.050+0000 7fc5c2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.050+0000 7fc5c2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.050+0000 7fc5c2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.050+0000 7fc5c1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.050+0000 7fc5c1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.050+0000 7fc5c1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.052+0000 7fc5c1d74640 10 monclient(hunting): handle_auth_done global_id 4559 payload 824 2026-02-17T21:25:38.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.052+0000 7fc5c1d74640 1 -- 10.20.193.5:0/1953016475 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc5c41f46b0 msgr2=0x7fc5c40cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.052+0000 7fc5c1d74640 1 --2- 10.20.193.5:0/1953016475 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc5c41f46b0 0x7fc5c40cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.052+0000 7fc5c1d74640 1 -- 10.20.193.5:0/1953016475 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc5b0004900 msgr2=0x7fc5c4150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.052+0000 7fc5c1d74640 1 --2- 10.20.193.5:0/1953016475 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc5b0004900 0x7fc5c4150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.052+0000 7fc5c1d74640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.052+0000 7fc5c1d74640 1 monclient: found mon.noname-c 2026-02-17T21:25:38.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.052+0000 7fc5c1d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.052+0000 7fc5c1d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.052+0000 7fc5c1d74640 1 -- 10.20.193.5:0/1953016475 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c4151300 con 0x7fc5c41f3e40 2026-02-17T21:25:38.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.053+0000 7fc5c1d74640 1 --2- 10.20.193.5:0/1953016475 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc5c41f3e40 0x7fc5c41f1130 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac036000 tx=0x7fc5ac0048d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.053+0000 7fc5aaffd640 10 client.?.objecter ms_handle_connect 0x7fc5c41f3e40 2026-02-17T21:25:38.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.053+0000 7fc5aaffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:38.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7f26c9573640 1 -- 10.20.193.5:0/2846258454 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b403c070 con 0x7f26b8004900 2026-02-17T21:25:38.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7f26c9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7f26c9573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:38.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7f26c9573640 10 monclient: dump: 2026-02-17T21:25:38.082 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.082 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.082 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.082 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.082 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.082 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.082 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.082 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.082 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.082 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7f26c9573640 1 -- 10.20.193.5:0/2846258454 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26b402f770 con 0x7f26b8004900 2026-02-17T21:25:38.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7f26c9573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7f26d0eb9640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:38.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7f26c9573640 1 -- 10.20.193.5:0/2846258454 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b4009550 con 0x7f26b8004900 2026-02-17T21:25:38.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7f26c9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7f26d0eb9640 4 set_mon_vals no callback set 2026-02-17T21:25:38.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7f26c9573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:38.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7f26c9573640 10 monclient: dump: 2026-02-17T21:25:38.083 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.083 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.083 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.083 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.083 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.083 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.083 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.083 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.083 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.083 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.084 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7fc5aaffd640 1 -- 10.20.193.5:0/1953016475 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac045020 con 0x7fc5c41f3e40 2026-02-17T21:25:38.084 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7fc5aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.084 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7fc5aaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:38.084 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7fc5aaffd640 10 monclient: dump: 2026-02-17T21:25:38.084 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.084 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.084 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.084 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.084 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.084 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.084 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.084 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.084 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.084 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7fc5aaffd640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7fc5aaffd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7fc5aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7fc5aaffd640 1 -- 10.20.193.5:0/1953016475 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5ac030e50 con 0x7fc5c41f3e40 2026-02-17T21:25:38.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7fc5c3577640 5 monclient: authenticate success, global_id 4559 2026-02-17T21:25:38.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7fc5c3577640 10 monclient: _renew_subs 2026-02-17T21:25:38.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7fc5c3577640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7fc5c3577640 1 -- 10.20.193.5:0/1953016475 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5c41f5080 con 0x7fc5c41f3e40 2026-02-17T21:25:38.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7fc5aaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7fc5aaffd640 1 -- 10.20.193.5:0/1953016475 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac03c040 con 0x7fc5c41f3e40 2026-02-17T21:25:38.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7fc5aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7fc5aaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:38.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7fc5aaffd640 10 monclient: dump: 2026-02-17T21:25:38.085 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.085 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.085 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.085 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.085 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.085 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.085 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.085 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.086 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.086 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7fc5c0d72640 4 set_mon_vals no callback set 2026-02-17T21:25:38.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7fc5c3577640 10 client.4559.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:38.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7fc5c3577640 10 monclient: _renew_subs 2026-02-17T21:25:38.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7fc5c3577640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7fc5c3577640 1 -- 10.20.193.5:0/1953016475 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5c41f5640 con 0x7fc5c41f3e40 2026-02-17T21:25:38.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7fc5c3577640 1 librados: init done 2026-02-17T21:25:38.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7f26d0eb9640 10 monclient: shutdown 2026-02-17T21:25:38.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7f26d0eb9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7f26d0eb9640 1 -- 10.20.193.5:0/2846258454 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f26b8004900 msgr2=0x7f26b8004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7f26d0eb9640 1 --2- 10.20.193.5:0/2846258454 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f26b8004900 0x7f26b8004d80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009980 tx=0x7f26b402ed10 comp rx=0 tx=0).stop 2026-02-17T21:25:38.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7f26d0eb9640 1 -- 10.20.193.5:0/2846258454 shutdown_connections 2026-02-17T21:25:38.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7f26d0eb9640 1 --2- 10.20.193.5:0/2846258454 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f26b8004900 0x7f26b8004d80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7f26d0eb9640 1 -- 10.20.193.5:0/2846258454 >> 10.20.193.5:0/2846258454 conn(0x7f26cc06d9b0 msgr2=0x7f26cc06ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7f26d0eb9640 1 -- 10.20.193.5:0/2846258454 shutdown_connections 2026-02-17T21:25:38.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.055+0000 7f26d0eb9640 1 -- 10.20.193.5:0/2846258454 wait complete. 2026-02-17T21:25:38.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7f26d0eb9640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7f26d0eb9640 10 monclient: monmap: 2026-02-17T21:25:38.087 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.087 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:38.087 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:38.087 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:38.087 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.087 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.087 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:38.087 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:38.087 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:38.088 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7fc5c3577640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7fc5c3577640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7fc5c3577640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7fc5c3577640 1 -- 10.20.193.5:0/1953016475 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5c415d180 con 0x7fc5c41f3e40 2026-02-17T21:25:38.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7f26d0eb9640 1 librados: starting msgr at 2026-02-17T21:25:38.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7f26d0eb9640 1 librados: starting objecter 2026-02-17T21:25:38.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7f26d0eb9640 1 Processor -- start 2026-02-17T21:25:38.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7f26d0eb9640 1 -- start start 2026-02-17T21:25:38.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7f26d0eb9640 1 librados: setting wanted keys 2026-02-17T21:25:38.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7f26d0eb9640 1 librados: calling monclient init 2026-02-17T21:25:38.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7f26d0eb9640 10 monclient: init 2026-02-17T21:25:38.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7f26d0eb9640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7f26d0eb9640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:25:38.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7f26d0eb9640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f26b8004900 0x7f26cc1f4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7f26d0eb9640 10 monclient(hunting): picked mon.noname-c con 0x7f26b8004900 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:38.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7f26d0eb9640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f26cc14b620 0x7f26cc149c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7f26d0eb9640 10 monclient(hunting): picked mon.noname-b con 0x7f26cc14b620 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:38.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7f26d0eb9640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f26cc15c070 0x7f26cc1f3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7f26d0eb9640 10 monclient(hunting): picked mon.noname-a con 0x7f26cc15c070 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:38.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7f26d0eb9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7f26d0eb9640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc15d4c0 con 0x7f26cc15c070 2026-02-17T21:25:38.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7f26d0eb9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7f26d0eb9640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc0ca460 con 0x7f26cc14b620 2026-02-17T21:25:38.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7f26d0eb9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7f26d0eb9640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc06e7b0 con 0x7f26b8004900 2026-02-17T21:25:38.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7f26d0eb9640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.056+0000 7f26d0eb9640 10 monclient(hunting): authenticate will time out at 1043.621860s 2026-02-17T21:25:38.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.057+0000 7f26c9d74640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f26cc14b620 0x7f26cc149c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.057+0000 7f26c9d74640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f26cc14b620 0x7f26cc149c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:59990/0 (socket says 10.20.193.5:59990) 2026-02-17T21:25:38.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.057+0000 7f26c9d74640 1 -- 10.20.193.5:0/3236479413 learned_addr learned my addr 10.20.193.5:0/3236479413 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:38.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.057+0000 7f26c9d74640 10 monclient(hunting): get_auth_request con 0x7f26cc14b620 auth_method 0 2026-02-17T21:25:38.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.057+0000 7f26c9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.057+0000 7f26c9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.057+0000 7f26c9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.057+0000 7f26c9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.057+0000 7f26c9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.057+0000 7f26c9d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.059+0000 7f26c9d74640 10 monclient(hunting): handle_auth_done global_id 4531 payload 824 2026-02-17T21:25:38.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.059+0000 7f26c9d74640 1 -- 10.20.193.5:0/3236479413 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f26b8004900 msgr2=0x7f26cc1f4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.059+0000 7f26c9d74640 1 --2- 10.20.193.5:0/3236479413 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f26b8004900 0x7f26cc1f4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.059+0000 7f26c9d74640 1 -- 10.20.193.5:0/3236479413 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f26cc15c070 msgr2=0x7f26cc1f3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.059+0000 7f26c9d74640 1 --2- 10.20.193.5:0/3236479413 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f26cc15c070 0x7f26cc1f3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.059+0000 7f26c9d74640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.059+0000 7f26c9d74640 1 monclient: found mon.noname-b 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.059+0000 7f26c9d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.059+0000 7f26c9d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.059+0000 7f26c9d74640 1 -- 10.20.193.5:0/3236479413 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26cc14ba60 con 0x7f26cc14b620 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.060+0000 7f26c9d74640 1 --2- 10.20.193.5:0/3236479413 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f26cc14b620 0x7f26cc149c50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f26b402ed50 tx=0x7f26b40048d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.060+0000 7f26b2ffd640 10 client.?.objecter ms_handle_connect 0x7f26cc14b620 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.060+0000 7f26b2ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.062+0000 7f26b2ffd640 1 -- 10.20.193.5:0/3236479413 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b403c050 con 0x7f26cc14b620 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.062+0000 7f26b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.062+0000 7f26b2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.062+0000 7f26b2ffd640 10 monclient: dump: 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.062+0000 7f26b2ffd640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.062+0000 7f26b2ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.062+0000 7f26b2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.062+0000 7f26b2ffd640 1 -- 10.20.193.5:0/3236479413 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26b4048070 con 0x7f26cc14b620 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.062+0000 7f26b2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.062+0000 7f26b2ffd640 1 -- 10.20.193.5:0/3236479413 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b4006e60 con 0x7f26cc14b620 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.062+0000 7f26d0eb9640 5 monclient: authenticate success, global_id 4531 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.062+0000 7f26d0eb9640 10 monclient: _renew_subs 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.062+0000 7f26d0eb9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.062+0000 7f26c8d72640 4 set_mon_vals no callback set 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.062+0000 7f26d0eb9640 1 -- 10.20.193.5:0/3236479413 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26cc148bf0 con 0x7f26cc14b620 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.062+0000 7f26b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.062+0000 7f26b2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.062+0000 7f26b2ffd640 10 monclient: dump: 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.062+0000 7f26d0eb9640 10 client.4531.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.062+0000 7f26d0eb9640 10 monclient: _renew_subs 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.062+0000 7f26d0eb9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.062+0000 7f26d0eb9640 1 -- 10.20.193.5:0/3236479413 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26cc149170 con 0x7f26cc14b620 2026-02-17T21:25:38.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.062+0000 7f26d0eb9640 1 librados: init done 2026-02-17T21:25:38.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.063+0000 7f26d0eb9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.063+0000 7f26d0eb9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.063+0000 7f26d0eb9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.063+0000 7f26d0eb9640 1 -- 10.20.193.5:0/3236479413 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26cc08fad0 con 0x7f26cc14b620 2026-02-17T21:25:38.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.071+0000 7f9ad97fa640 1 -- 10.20.193.5:0/1737598302 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9ae41f20e0 con 0x7f9ad00054c0 2026-02-17T21:25:38.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.071+0000 7f9ad97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.071+0000 7f9ad97fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:38.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.075+0000 7f26b2ffd640 1 -- 10.20.193.5:0/3236479413 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f26b402f5d0 con 0x7f26cc14b620 2026-02-17T21:25:38.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.075+0000 7f26b2ffd640 1 --2- 10.20.193.5:0/3236479413 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f26980792b0 0x7f269807b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.075+0000 7f26ca575640 1 --2- 10.20.193.5:0/3236479413 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f26980792b0 0x7f269807b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.075+0000 7f26ca575640 10 monclient: get_auth_request con 0x7f26980792b0 auth_method 0 2026-02-17T21:25:38.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.076+0000 7f26b2ffd640 1 -- 10.20.193.5:0/3236479413 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f26b40839e0 con 0x7f26cc14b620 2026-02-17T21:25:38.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.076+0000 7f26b2ffd640 10 client.4531.objecter ms_dispatch2 0x7f26cc000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:38.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.076+0000 7f26b2ffd640 3 client.4531.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:38.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.076+0000 7f26b2ffd640 3 client.4531.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:38.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.076+0000 7f26ca575640 1 --2- 10.20.193.5:0/3236479413 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f26980792b0 0x7f269807b770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0664a0 tx=0x7f26c0006d40 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.076+0000 7f26b2ffd640 20 client.4531.objecter dump_active .. 0 homeless 2026-02-17T21:25:38.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.076+0000 7f26b2ffd640 10 client.4531.objecter ms_handle_connect 0x7f26980792b0 2026-02-17T21:25:38.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.077+0000 7fc7891fe640 10 monclient: get_monmap_and_config 2026-02-17T21:25:38.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.077+0000 7fc7891fe640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.077+0000 7fc7891fe640 10 monclient: monmap: 2026-02-17T21:25:38.096 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.096 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.096 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:38.078217+0000 2026-02-17T21:25:38.096 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:38.078217+0000 2026-02-17T21:25:38.096 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.096 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.096 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:38.096 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:38.096 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:38.096 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:38.096 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:38.096 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:38.096 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.078+0000 7fc7891fe640 1 Processor -- start 2026-02-17T21:25:38.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.078+0000 7fc7891fe640 1 -- start start 2026-02-17T21:25:38.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.078+0000 7fc7891fe640 10 monclient: init 2026-02-17T21:25:38.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.078+0000 7fc7891fe640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.078+0000 7fc7891fe640 10 monclient: _add_conns ranks=[1,3,0,5,2,4] 2026-02-17T21:25:38.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.078+0000 7fc7891fe640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fc7840d1b60 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:38.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.078+0000 7fc7891fe640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fc7840d1f40 0x7fc78415c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.078+0000 7fc7891fe640 10 monclient(hunting): picked mon.noname-a con 0x7fc7840d1f40 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:38.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.078+0000 7fc7891fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc78415d950 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:38.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.078+0000 7fc7891fe640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7840c98e0 con 0x7fc78415d950 2026-02-17T21:25:38.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.078+0000 7fc7891fe640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7840c9bc0 con 0x7fc7840d1b60 2026-02-17T21:25:38.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.078+0000 7fc7891fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.078+0000 7fc7891fe640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc78415cd80 con 0x7fc7840d1f40 2026-02-17T21:25:38.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.078+0000 7fc7891fe640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.078+0000 7fc7891fe640 10 monclient(hunting): authenticate will time out at 1043.643711s 2026-02-17T21:25:38.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.078+0000 7fc782575640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fc7840d1f40 0x7fc78415c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.079+0000 7fc783577640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7fc78415d950 0x7fc78415dd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:37534/0 (socket says 10.20.193.5:37534) 2026-02-17T21:25:38.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.079+0000 7fc783577640 1 -- 10.20.193.5:0/1242824744 learned_addr learned my addr 10.20.193.5:0/1242824744 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:38.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.079+0000 7fc782575640 10 monclient(hunting): get_auth_request con 0x7fc7840d1f40 auth_method 0 2026-02-17T21:25:38.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.079+0000 7fc782575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.079+0000 7fc782575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.079+0000 7fc782575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.079+0000 7fc782575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.079+0000 7fc782575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.079+0000 7fc782575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.080+0000 7fc782575640 10 monclient(hunting): handle_auth_done global_id 4491 payload 274 2026-02-17T21:25:38.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.080+0000 7fc782575640 1 -- 10.20.193.5:0/1242824744 >> v1:10.20.193.119:6789/0 conn(0x7fc7840d1b60 legacy=0x7fc7840c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.080+0000 7fc782575640 1 -- 10.20.193.5:0/1242824744 >> v1:10.20.193.5:6789/0 conn(0x7fc78415d950 legacy=0x7fc78415dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.080+0000 7fc782575640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.080+0000 7fc782575640 1 monclient: found mon.noname-a 2026-02-17T21:25:38.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.080+0000 7fc782575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.080+0000 7fc782575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.080+0000 7fc782575640 1 -- 10.20.193.5:0/1242824744 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7840c9ea0 con 0x7fc7840d1f40 2026-02-17T21:25:38.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.082+0000 7fc782575640 1 --2- 10.20.193.5:0/1242824744 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc7840d1f40 0x7fc78415c840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0098a0 tx=0x7fc76c02ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d85006fd7ab92c26 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.084+0000 7fc781d74640 1 -- 10.20.193.5:0/1242824744 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c03c070 con 0x7fc7840d1f40 2026-02-17T21:25:38.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.084+0000 7fc781d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.084+0000 7fc781d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:38.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.084+0000 7fc781d74640 10 monclient: dump: 2026-02-17T21:25:38.100 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.100 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.100 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.100 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.100 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.100 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.100 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.084+0000 7fc781d74640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.084+0000 7fc781d74640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.084+0000 7fc781d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.084+0000 7fc781d74640 1 -- 10.20.193.5:0/1242824744 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc76c02fad0 con 0x7fc7840d1f40 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.084+0000 7fc781d74640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.084+0000 7fc781d74640 1 -- 10.20.193.5:0/1242824744 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c037440 con 0x7fc7840d1f40 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.084+0000 7fc7891fe640 5 monclient: authenticate success, global_id 4491 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.084+0000 7fc7891fe640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.084+0000 7fc7891fe640 4 set_mon_vals no callback set 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.084+0000 7fc781d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.084+0000 7fc781d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.084+0000 7fc781d74640 10 monclient: dump: 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.085+0000 7fc7891fe640 10 monclient: shutdown 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.085+0000 7fc7891fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.085+0000 7fc7891fe640 1 -- 10.20.193.5:0/1242824744 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc7840d1f40 msgr2=0x7fc78415c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.085+0000 7fc7891fe640 1 --2- 10.20.193.5:0/1242824744 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc7840d1f40 0x7fc78415c840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0098a0 tx=0x7fc76c02ee10 comp rx=0 tx=0).stop 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.085+0000 7fc7891fe640 1 -- 10.20.193.5:0/1242824744 shutdown_connections 2026-02-17T21:25:38.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.085+0000 7fc7891fe640 1 --2- 10.20.193.5:0/1242824744 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc7840d1f40 0x7fc78415c840 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.085+0000 7fc7891fe640 1 -- 10.20.193.5:0/1242824744 >> 10.20.193.5:0/1242824744 conn(0x7fc78406d9b0 msgr2=0x7fc78406ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.085+0000 7fc7891fe640 1 -- 10.20.193.5:0/1242824744 shutdown_connections 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.085+0000 7fc7891fe640 1 -- 10.20.193.5:0/1242824744 wait complete. 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.085+0000 7fc7891fe640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.085+0000 7fc7891fe640 10 monclient: monmap: 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.085+0000 7fc7891fe640 1 librados: starting msgr at 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.085+0000 7fc7891fe640 1 librados: starting objecter 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.085+0000 7fc7891fe640 1 Processor -- start 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.085+0000 7fc7891fe640 1 -- start start 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.085+0000 7fc7891fe640 1 librados: setting wanted keys 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.085+0000 7fc7891fe640 1 librados: calling monclient init 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.085+0000 7fc7891fe640 10 monclient: init 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.086+0000 7fc7891fe640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.086+0000 7fc7891fe640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.086+0000 7fc7891fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc7840d1b60 0x7fc784147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.086+0000 7fc7891fe640 10 monclient(hunting): picked mon.noname-b con 0x7fc7840d1b60 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.086+0000 7fc7891fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc7840d1f40 0x7fc784148250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.086+0000 7fc7891fe640 10 monclient(hunting): picked mon.noname-c con 0x7fc7840d1f40 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.086+0000 7fc7891fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc78415d950 0x7fc7841f5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.086+0000 7fc7891fe640 10 monclient(hunting): picked mon.noname-a con 0x7fc78415d950 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.086+0000 7fc7891fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.086+0000 7fc7891fe640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc78415d4c0 con 0x7fc78415d950 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.086+0000 7fc7891fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.086+0000 7fc7891fe640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc7840ca460 con 0x7fc7840d1b60 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.086+0000 7fc7891fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.086+0000 7fc7891fe640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc78406e7b0 con 0x7fc7840d1f40 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.086+0000 7fc7891fe640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.086+0000 7fc7891fe640 10 monclient(hunting): authenticate will time out at 1043.651411s 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.086+0000 7fc783577640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc78415d950 0x7fc7841f5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.086+0000 7fc783577640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc78415d950 0x7fc7841f5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:58494/0 (socket says 10.20.193.5:58494) 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.086+0000 7fc783577640 1 -- 10.20.193.5:0/2838182670 learned_addr learned my addr 10.20.193.5:0/2838182670 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.086+0000 7fc783577640 10 monclient(hunting): get_auth_request con 0x7fc78415d950 auth_method 0 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.086+0000 7fc783577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.086+0000 7fc783577640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.086+0000 7fc783577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.087+0000 7fc783577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.087+0000 7fc783577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.087+0000 7fc783577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.088+0000 7fc783577640 10 monclient(hunting): handle_auth_done global_id 4497 payload 824 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.088+0000 7fc783577640 1 -- 10.20.193.5:0/2838182670 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc7840d1f40 msgr2=0x7fc784148250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.088+0000 7fc783577640 1 --2- 10.20.193.5:0/2838182670 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc7840d1f40 0x7fc784148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.088+0000 7fc783577640 1 -- 10.20.193.5:0/2838182670 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc7840d1b60 msgr2=0x7fc784147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.088+0000 7fc783577640 1 --2- 10.20.193.5:0/2838182670 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc7840d1b60 0x7fc784147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.088+0000 7fc783577640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.088+0000 7fc783577640 1 monclient: found mon.noname-a 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.088+0000 7fc783577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.088+0000 7fc783577640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.088+0000 7fc783577640 1 -- 10.20.193.5:0/2838182670 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc78415b5f0 con 0x7fc78415d950 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.089+0000 7fc783577640 1 --2- 10.20.193.5:0/2838182670 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc78415d950 0x7fc7841f5950 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc77400cb80 tx=0x7fc77400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.089+0000 7fc7637fe640 10 client.?.objecter ms_handle_connect 0x7fc78415d950 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.089+0000 7fc7637fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.090+0000 7fc7637fe640 1 -- 10.20.193.5:0/2838182670 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc774017070 con 0x7fc78415d950 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.090+0000 7fc7637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.090+0000 7fc7637fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.090+0000 7fc7637fe640 10 monclient: dump: 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.090+0000 7fc7637fe640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.090+0000 7fc7637fe640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.090+0000 7fc7637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.090+0000 7fc7637fe640 1 -- 10.20.193.5:0/2838182670 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc77400ad50 con 0x7fc78415d950 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.090+0000 7fc7637fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.090+0000 7fc7637fe640 1 -- 10.20.193.5:0/2838182670 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc774012600 con 0x7fc78415d950 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.090+0000 7fc7891fe640 5 monclient: authenticate success, global_id 4497 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.090+0000 7fc7891fe640 10 monclient: _renew_subs 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.090+0000 7fc781573640 4 set_mon_vals no callback set 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.090+0000 7fc7891fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.090+0000 7fc7891fe640 1 -- 10.20.193.5:0/2838182670 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc78415b8d0 con 0x7fc78415d950 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.090+0000 7fc7637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.090+0000 7fc7637fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.090+0000 7fc7637fe640 10 monclient: dump: 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.104 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.105 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.105 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.105 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.105 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.105 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.105 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.105 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.090+0000 7fc7891fe640 10 client.4497.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:38.105 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.090+0000 7fc7891fe640 10 monclient: _renew_subs 2026-02-17T21:25:38.105 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.090+0000 7fc7891fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.105 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.090+0000 7fc7891fe640 1 -- 10.20.193.5:0/2838182670 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7841f4e70 con 0x7fc78415d950 2026-02-17T21:25:38.105 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.090+0000 7fc7891fe640 1 librados: init done 2026-02-17T21:25:38.105 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.091+0000 7fc7891fe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.105 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.091+0000 7fc7891fe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.105 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.091+0000 7fc7891fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.105 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.091+0000 7fc7891fe640 1 -- 10.20.193.5:0/2838182670 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc78415c840 con 0x7fc78415d950 2026-02-17T21:25:38.106 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.105+0000 7fc7637fe640 1 -- 10.20.193.5:0/2838182670 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fc7740127a0 con 0x7fc78415d950 2026-02-17T21:25:38.106 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.105+0000 7fc7637fe640 1 --2- 10.20.193.5:0/2838182670 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc7500792d0 0x7fc75007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.106+0000 7fc782d76640 1 --2- 10.20.193.5:0/2838182670 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc7500792d0 0x7fc75007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.106+0000 7fc782d76640 10 monclient: get_auth_request con 0x7fc7500792d0 auth_method 0 2026-02-17T21:25:38.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.106+0000 7fc7637fe640 10 client.4497.objecter ms_handle_connect 0x7fc7500792d0 2026-02-17T21:25:38.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.106+0000 7fc782d76640 1 --2- 10.20.193.5:0/2838182670 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc7500792d0 0x7fc75007b790 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc778009750 tx=0x7fc778006ca0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.109+0000 7fe72ec32640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T21:25:38.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.109+0000 7fe72ec32640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T21:25:38.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.109+0000 7fe72ec32640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.109+0000 7fe72ec32640 1 -- 10.20.193.5:0/2450747123 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe7280c9b60 con 0x7fe728152700 2026-02-17T21:25:38.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.145+0000 7f4cd7c5b640 10 monclient: get_monmap_and_config 2026-02-17T21:25:38.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.145+0000 7f4cd7c5b640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.145+0000 7f4cd7c5b640 10 monclient: monmap: 2026-02-17T21:25:38.146 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.146 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.146 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:38.146020+0000 2026-02-17T21:25:38.146 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:38.146020+0000 2026-02-17T21:25:38.146 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.146 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.146 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:38.147 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:38.147 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:38.147 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:38.147 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:38.147 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:38.147 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.145+0000 7f4cd7c5b640 1 Processor -- start 2026-02-17T21:25:38.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.145+0000 7f4cd7c5b640 1 -- start start 2026-02-17T21:25:38.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.145+0000 7f4cd7c5b640 10 monclient: init 2026-02-17T21:25:38.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.146+0000 7f4cd7c5b640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.146+0000 7f4cd7c5b640 10 monclient: _add_conns ranks=[0,5,4,3,2,1] 2026-02-17T21:25:38.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.146+0000 7f4cd7c5b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4cd01560e0 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:38.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.146+0000 7f4cd7c5b640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f4cd015fe10 0x7f4cd00c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.146+0000 7f4cd7c5b640 10 monclient(hunting): picked mon.noname-c con 0x7f4cd015fe10 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:38.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.146+0000 7f4cd7c5b640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f4cd00ca040 0x7f4cd00ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.146+0000 7f4cd7c5b640 10 monclient(hunting): picked mon.noname-b con 0x7f4cd00ca040 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:38.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.146+0000 7f4cd7c5b640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cd00d2130 con 0x7f4cd01560e0 2026-02-17T21:25:38.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.146+0000 7f4cd7c5b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.146+0000 7f4cd7c5b640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f4cd00c9670 con 0x7f4cd00ca040 2026-02-17T21:25:38.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.146+0000 7f4cd7c5b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.146+0000 7f4cd7c5b640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f4cd00d2410 con 0x7f4cd015fe10 2026-02-17T21:25:38.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.146+0000 7f4cd7c5b640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.146+0000 7f4cd7c5b640 10 monclient(hunting): authenticate will time out at 1043.711406s 2026-02-17T21:25:38.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.157+0000 7f9aeada9640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T21:25:38.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.157+0000 7f9aeada9640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T21:25:38.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.157+0000 7f9aeada9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.157+0000 7f9aeada9640 1 -- 10.20.193.5:0/1737598302 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9ae414f7d0 con 0x7f9ad00054c0 2026-02-17T21:25:38.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.162+0000 7fc5aaffd640 1 -- 10.20.193.5:0/1953016475 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fc5ac037870 con 0x7fc5c41f3e40 2026-02-17T21:25:38.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.162+0000 7fc5aaffd640 1 --2- 10.20.193.5:0/1953016475 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc590079300 0x7fc59007b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.162+0000 7fc5c2575640 1 --2- 10.20.193.5:0/1953016475 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc590079300 0x7fc59007b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.162+0000 7fc5c2575640 10 monclient: get_auth_request con 0x7fc590079300 auth_method 0 2026-02-17T21:25:38.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.163+0000 7fc5aaffd640 10 client.4559.objecter ms_handle_connect 0x7fc590079300 2026-02-17T21:25:38.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.163+0000 7fc5c2575640 1 --2- 10.20.193.5:0/1953016475 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc590079300 0x7fc59007b7c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc5b80097d0 tx=0x7fc5b8006db0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.164+0000 7fc5aaffd640 1 -- 10.20.193.5:0/1953016475 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fc5ac004520 con 0x7fc5c41f3e40 2026-02-17T21:25:38.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.164+0000 7fc5aaffd640 10 client.4559.objecter ms_dispatch2 0x7fc5c4000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:38.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.164+0000 7fc5aaffd640 3 client.4559.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:38.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.164+0000 7fc5aaffd640 3 client.4559.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:38.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.164+0000 7fc5aaffd640 20 client.4559.objecter dump_active .. 0 homeless 2026-02-17T21:25:38.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.172+0000 7fc5aaffd640 1 -- 10.20.193.5:0/1953016475 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc5ac04f030 con 0x7fc5c41f3e40 2026-02-17T21:25:38.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.172+0000 7fc5aaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.172+0000 7fc5aaffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:38.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.172+0000 7f4cd51cf640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f4cd015fe10 0x7f4cd00c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.172+0000 7f4cd51cf640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f4cd015fe10 0x7f4cd00c9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:54280/0 (socket says 10.20.193.5:54280) 2026-02-17T21:25:38.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.172+0000 7f4cd51cf640 1 -- 10.20.193.5:0/2121953706 learned_addr learned my addr 10.20.193.5:0/2121953706 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:38.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.172+0000 7f4cd51cf640 10 monclient(hunting): get_auth_request con 0x7f4cd015fe10 auth_method 0 2026-02-17T21:25:38.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.172+0000 7f4cd51cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.172+0000 7f4cd51cf640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.172+0000 7f4cd51cf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.173+0000 7f4cd51cf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.173+0000 7f4cd51cf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.173+0000 7f4cd51cf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.174+0000 7f4cd51cf640 10 monclient(hunting): handle_auth_done global_id 4562 payload 274 2026-02-17T21:25:38.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.174+0000 7f4cd51cf640 1 -- 10.20.193.5:0/2121953706 >> v2:10.20.193.119:3300/0 conn(0x7f4cd00ca040 msgr2=0x7f4cd00ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.174+0000 7f4cd51cf640 1 --2- 10.20.193.5:0/2121953706 >> v2:10.20.193.119:3300/0 conn(0x7f4cd00ca040 0x7f4cd00ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.174+0000 7f4cd51cf640 1 -- 10.20.193.5:0/2121953706 >> v1:10.20.193.5:6789/0 conn(0x7f4cd01560e0 legacy=0x7f4cd00d1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.174+0000 7f4cd51cf640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.174+0000 7f4cd51cf640 1 monclient: found mon.noname-c 2026-02-17T21:25:38.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.174+0000 7f4cd51cf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.174+0000 7f4cd51cf640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.174+0000 7f4cd51cf640 1 -- 10.20.193.5:0/2121953706 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd00d26f0 con 0x7f4cd015fe10 2026-02-17T21:25:38.177 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.175+0000 7f4cd51cf640 1 --2- 10.20.193.5:0/2121953706 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f4cd015fe10 0x7f4cd00c9b00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4cd00cf430 tx=0x7f4cc402eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e461d84c1600890 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.176+0000 7f4cd49ce640 1 -- 10.20.193.5:0/2121953706 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc403c070 con 0x7f4cd015fe10 2026-02-17T21:25:38.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.176+0000 7f4cd49ce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.176+0000 7f4cd49ce640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:38.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.177+0000 7f4cd49ce640 10 monclient: dump: 2026-02-17T21:25:38.181 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.181 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.181 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.182 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.182 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.182 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.182 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.182 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.182 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.182 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.177+0000 7f4cd49ce640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.177+0000 7f4cd49ce640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.177+0000 7f4cd49ce640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.177+0000 7f4cd49ce640 1 -- 10.20.193.5:0/2121953706 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc402fb40 con 0x7f4cd015fe10 2026-02-17T21:25:38.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.177+0000 7f4cd49ce640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.177+0000 7f4cd49ce640 1 -- 10.20.193.5:0/2121953706 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4037440 con 0x7f4cd015fe10 2026-02-17T21:25:38.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.177+0000 7f4cd7c5b640 5 monclient: authenticate success, global_id 4562 2026-02-17T21:25:38.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.177+0000 7f4cd7c5b640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:38.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.177+0000 7f4cd7c5b640 4 set_mon_vals no callback set 2026-02-17T21:25:38.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.177+0000 7f4cd49ce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.177+0000 7f4cd49ce640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:38.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.177+0000 7f4cd49ce640 10 monclient: dump: 2026-02-17T21:25:38.183 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.183 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.183 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.183 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.184 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.184 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.184 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.184 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.184 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.184 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.177+0000 7f4cd7c5b640 10 monclient: shutdown 2026-02-17T21:25:38.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.177+0000 7f4cd7c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.177+0000 7f4cd7c5b640 1 -- 10.20.193.5:0/2121953706 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f4cd015fe10 msgr2=0x7f4cd00c9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.177+0000 7f4cd7c5b640 1 --2- 10.20.193.5:0/2121953706 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f4cd015fe10 0x7f4cd00c9b00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4cd00cf430 tx=0x7f4cc402eed0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.177+0000 7f4cd7c5b640 1 -- 10.20.193.5:0/2121953706 shutdown_connections 2026-02-17T21:25:38.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.177+0000 7f4cd7c5b640 1 --2- 10.20.193.5:0/2121953706 >> v2:10.20.193.119:3300/0 conn(0x7f4cd00ca040 0x7f4cd00ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.177+0000 7f4cd7c5b640 1 --2- 10.20.193.5:0/2121953706 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f4cd015fe10 0x7f4cd00c9b00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.177+0000 7f4cd7c5b640 1 -- 10.20.193.5:0/2121953706 >> 10.20.193.5:0/2121953706 conn(0x7f4cd0073030 msgr2=0x7f4cd0073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.177+0000 7f4cd7c5b640 1 -- 10.20.193.5:0/2121953706 shutdown_connections 2026-02-17T21:25:38.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.177+0000 7f4cd7c5b640 1 -- 10.20.193.5:0/2121953706 wait complete. 2026-02-17T21:25:38.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.177+0000 7f4cd7c5b640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.177+0000 7f4cd7c5b640 10 monclient: monmap: 2026-02-17T21:25:38.185 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.185 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:38.185 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:38.185 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:38.185 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.186 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.186 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:38.186 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:38.186 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:38.186 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.178+0000 7f4cd7c5b640 1 librados: starting msgr at 2026-02-17T21:25:38.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.178+0000 7f4cd7c5b640 1 librados: starting objecter 2026-02-17T21:25:38.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.178+0000 7f4cd7c5b640 1 Processor -- start 2026-02-17T21:25:38.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.178+0000 7f4cd7c5b640 1 -- start start 2026-02-17T21:25:38.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.178+0000 7f4cd7c5b640 1 librados: setting wanted keys 2026-02-17T21:25:38.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.178+0000 7f4cd7c5b640 1 librados: calling monclient init 2026-02-17T21:25:38.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.178+0000 7f4cd7c5b640 10 monclient: init 2026-02-17T21:25:38.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.178+0000 7f4cd7c5b640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.178+0000 7f4cd7c5b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:25:38.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.178+0000 7f4cd7c5b640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f4cd00ca040 0x7f4cd01e7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.178+0000 7f4cd7c5b640 10 monclient(hunting): picked mon.noname-c con 0x7f4cd00ca040 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:38.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.178+0000 7f4cd7c5b640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4cd01560e0 0x7f4cd01f6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.178+0000 7f4cd7c5b640 10 monclient(hunting): picked mon.noname-b con 0x7f4cd01560e0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:38.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.178+0000 7f4cd7c5b640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f4cd015fe10 0x7f4cd00cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.178+0000 7f4cd7c5b640 10 monclient(hunting): picked mon.noname-a con 0x7f4cd015fe10 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:38.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.178+0000 7f4cd7c5b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.178+0000 7f4cd7c5b640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd00c9300 con 0x7f4cd015fe10 2026-02-17T21:25:38.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.178+0000 7f4cd7c5b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.178+0000 7f4cd7c5b640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd00c9020 con 0x7f4cd01560e0 2026-02-17T21:25:38.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.178+0000 7f4cd7c5b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.178+0000 7f4cd7c5b640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd0160270 con 0x7f4cd00ca040 2026-02-17T21:25:38.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.178+0000 7f4cd7c5b640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.178+0000 7f4cd7c5b640 10 monclient(hunting): authenticate will time out at 1043.743509s 2026-02-17T21:25:38.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.178+0000 7f4cd59d0640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f4cd00ca040 0x7f4cd01e7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.179+0000 7f4cd59d0640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f4cd00ca040 0x7f4cd01e7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:54296/0 (socket says 10.20.193.5:54296) 2026-02-17T21:25:38.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.179+0000 7f4cd59d0640 1 -- 10.20.193.5:0/2419355732 learned_addr learned my addr 10.20.193.5:0/2419355732 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:38.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.179+0000 7f4cd59d0640 10 monclient(hunting): get_auth_request con 0x7f4cd00ca040 auth_method 0 2026-02-17T21:25:38.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.179+0000 7f4cd59d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.179+0000 7f4cd59d0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.179+0000 7f4cd59d0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.179+0000 7f26b2ffd640 1 -- 10.20.193.5:0/3236479413 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f26cc08fad0 con 0x7f26cc14b620 2026-02-17T21:25:38.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.179+0000 7f26b2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.179+0000 7f26b2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:38.191 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2026-02-17T21:25:38.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.179+0000 7f4cd59d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.179+0000 7f4cd59d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.179+0000 7f4cd59d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.180+0000 7f4cd51cf640 1 --2- 10.20.193.5:0/2419355732 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4cd01560e0 0x7f4cd01f6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.180+0000 7f4cd59d0640 10 monclient(hunting): handle_auth_done global_id 4565 payload 824 2026-02-17T21:25:38.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.180+0000 7f4cd59d0640 1 -- 10.20.193.5:0/2419355732 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4cd01560e0 msgr2=0x7f4cd01f6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.180+0000 7f4cd59d0640 1 --2- 10.20.193.5:0/2419355732 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4cd01560e0 0x7f4cd01f6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.180+0000 7f4cd59d0640 1 -- 10.20.193.5:0/2419355732 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f4cd015fe10 msgr2=0x7f4cd00cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.180+0000 7f4cd59d0640 1 --2- 10.20.193.5:0/2419355732 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f4cd015fe10 0x7f4cd00cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.180+0000 7f4cd59d0640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.180+0000 7f4cd59d0640 1 monclient: found mon.noname-c 2026-02-17T21:25:38.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.180+0000 7f4cd59d0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.180+0000 7f4cd59d0640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.180+0000 7f4cd59d0640 1 -- 10.20.193.5:0/2419355732 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd00d0120 con 0x7f4cd00ca040 2026-02-17T21:25:38.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.181+0000 7f4cd59d0640 1 --2- 10.20.193.5:0/2419355732 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f4cd00ca040 0x7f4cd01e7dc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000b570 tx=0x7f4cc000ba40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.194 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.181+0000 7f4cbe7fc640 10 client.?.objecter ms_handle_connect 0x7f4cd00ca040 2026-02-17T21:25:38.194 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.181+0000 7f4cbe7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:38.194 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.182+0000 7f4cbe7fc640 1 -- 10.20.193.5:0/2419355732 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0013020 con 0x7f4cd00ca040 2026-02-17T21:25:38.194 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.182+0000 7f4cbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.194 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.182+0000 7f4cbe7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:38.194 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.182+0000 7f4cbe7fc640 10 monclient: dump: 2026-02-17T21:25:38.194 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.194 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.194 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.194 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.194 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.194 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.194 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.195 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.195 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.195 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.182+0000 7f4cbe7fc640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.182+0000 7f4cbe7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.182+0000 7f4cbe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.182+0000 7f4cd7c5b640 5 monclient: authenticate success, global_id 4565 2026-02-17T21:25:38.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.182+0000 7f4cd7c5b640 10 monclient: _renew_subs 2026-02-17T21:25:38.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.182+0000 7f4cd7c5b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.182+0000 7f4cd7c5b640 1 -- 10.20.193.5:0/2419355732 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd00d0400 con 0x7f4cd00ca040 2026-02-17T21:25:38.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.182+0000 7f4cd7c5b640 10 client.4565.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:38.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.182+0000 7f4cd7c5b640 10 monclient: _renew_subs 2026-02-17T21:25:38.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.182+0000 7f4cd7c5b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.182+0000 7f4cd7c5b640 1 -- 10.20.193.5:0/2419355732 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd00d09c0 con 0x7f4cd00ca040 2026-02-17T21:25:38.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.182+0000 7f4cd7c5b640 1 librados: init done 2026-02-17T21:25:38.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.183+0000 7f4cd7c5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.183+0000 7f4cd7c5b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.183+0000 7f4cd7c5b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.183+0000 7f4cd7c5b640 1 -- 10.20.193.5:0/2419355732 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd00cc2c0 con 0x7f4cd00ca040 2026-02-17T21:25:38.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.183+0000 7f4cbe7fc640 1 -- 10.20.193.5:0/2419355732 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc0004480 con 0x7f4cd00ca040 2026-02-17T21:25:38.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.183+0000 7f4cbe7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.183+0000 7f4cbffff640 4 set_mon_vals no callback set 2026-02-17T21:25:38.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.183+0000 7f4cbe7fc640 1 -- 10.20.193.5:0/2419355732 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0009380 con 0x7f4cd00ca040 2026-02-17T21:25:38.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.183+0000 7f4cbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.183+0000 7f4cbe7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:38.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.183+0000 7f4cbe7fc640 10 monclient: dump: 2026-02-17T21:25:38.196 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.197 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.197 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.197 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.197 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.197 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.197 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.197 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.197 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.197 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.184+0000 7fe71d7fa640 1 -- 10.20.193.5:0/2450747123 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe71004f030 con 0x7fe728152700 2026-02-17T21:25:38.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.184+0000 7fe71d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T21:25:38.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.184+0000 7fe71d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:38.198 INFO:teuthology.orchestra.run.trial005.stdout:103079215107 2026-02-17T21:25:38.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.186+0000 7fe72ec32640 10 librados: watch_flush enter 2026-02-17T21:25:38.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.186+0000 7fe72ec32640 10 librados: watch_flush exit 2026-02-17T21:25:38.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.186+0000 7fe72ec32640 20 client.4525.objecter shutdown clearing up homeless session... 2026-02-17T21:25:38.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.186+0000 7fe72ec32640 10 client.4525.objecter successfully canceled tick 2026-02-17T21:25:38.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.186+0000 7fe72ec32640 1 -- 10.20.193.5:0/2450747123 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe6f8079280 msgr2=0x7fe6f807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.186+0000 7fe72ec32640 1 --2- 10.20.193.5:0/2450747123 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe6f8079280 0x7fe6f807b740 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe718011310 tx=0x7fe718009290 comp rx=0 tx=0).stop 2026-02-17T21:25:38.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.186+0000 7fe72ec32640 10 monclient: shutdown 2026-02-17T21:25:38.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.186+0000 7fe72ec32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.186+0000 7fe72ec32640 1 -- 10.20.193.5:0/2450747123 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe728152700 msgr2=0x7fe7281446a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.186+0000 7fe72ec32640 1 --2- 10.20.193.5:0/2450747123 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe728152700 0x7fe7281446a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe710036000 tx=0x7fe7100047c0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.186+0000 7fe72ec32640 1 -- 10.20.193.5:0/2450747123 shutdown_connections 2026-02-17T21:25:38.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.186+0000 7fe72ec32640 1 --2- 10.20.193.5:0/2450747123 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe6f8079280 0x7fe6f807b740 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.186+0000 7fe72ec32640 1 --2- 10.20.193.5:0/2450747123 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe728152ae0 0x7fe728141fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.186+0000 7fe72ec32640 1 --2- 10.20.193.5:0/2450747123 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe728152700 0x7fe7281446a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.186+0000 7fe72ec32640 1 --2- 10.20.193.5:0/2450747123 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe7280c9730 0x7fe728155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.186+0000 7fe72ec32640 1 -- 10.20.193.5:0/2450747123 >> 10.20.193.5:0/2450747123 conn(0x7fe728073030 msgr2=0x7fe72815e750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.186+0000 7fe72ec32640 1 -- 10.20.193.5:0/2450747123 shutdown_connections 2026-02-17T21:25:38.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.186+0000 7fe72ec32640 1 -- 10.20.193.5:0/2450747123 wait complete. 2026-02-17T21:25:38.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.186+0000 7fe72ec32640 1 librados: shutdown 2026-02-17T21:25:38.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215108 got 103079215107 for osd.0 2026-02-17T21:25:38.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.208+0000 7fc7637fe640 1 -- 10.20.193.5:0/2838182670 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fc77405e0b0 con 0x7fc78415d950 2026-02-17T21:25:38.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.208+0000 7fc7637fe640 10 client.4497.objecter ms_dispatch2 0x7fc784000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:38.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.208+0000 7fc7637fe640 3 client.4497.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:38.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.208+0000 7fc7637fe640 3 client.4497.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:38.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.208+0000 7fc7637fe640 20 client.4497.objecter dump_active .. 0 homeless 2026-02-17T21:25:38.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.209+0000 7fc7637fe640 1 -- 10.20.193.5:0/2838182670 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc774022020 con 0x7fc78415d950 2026-02-17T21:25:38.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.209+0000 7fc7637fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.209+0000 7fc7637fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:38.217 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.215+0000 7f9ad97fa640 1 -- 10.20.193.5:0/1737598302 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9ae414f7d0 con 0x7f9ad00054c0 2026-02-17T21:25:38.217 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.215+0000 7f9ad97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T21:25:38.217 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.215+0000 7f9ad97fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:38.217 INFO:teuthology.orchestra.run.trial005.stdout:115964117000 2026-02-17T21:25:38.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.218+0000 7f9aeada9640 10 librados: watch_flush enter 2026-02-17T21:25:38.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.218+0000 7f9aeada9640 10 librados: watch_flush exit 2026-02-17T21:25:38.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.218+0000 7f9aeada9640 20 client.4488.objecter shutdown clearing up homeless session... 2026-02-17T21:25:38.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.218+0000 7f9aeada9640 10 client.4488.objecter successfully canceled tick 2026-02-17T21:25:38.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.218+0000 7f9aeada9640 1 -- 10.20.193.5:0/1737598302 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9ab40792b0 msgr2=0x7f9ab407b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.218+0000 7f9aeada9640 1 --2- 10.20.193.5:0/1737598302 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9ab40792b0 0x7f9ab407b770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4157b30 tx=0x7f9acc006db0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.218+0000 7f9aeada9640 10 monclient: shutdown 2026-02-17T21:25:38.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.218+0000 7f9aeada9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.218+0000 7f9aeada9640 1 -- 10.20.193.5:0/1737598302 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9ad00054c0 msgr2=0x7f9ae41f1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.218+0000 7f9aeada9640 1 --2- 10.20.193.5:0/1737598302 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9ad00054c0 0x7f9ae41f1280 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4009740 tx=0x7f9ad4009c10 comp rx=0 tx=0).stop 2026-02-17T21:25:38.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.218+0000 7f9aeada9640 1 -- 10.20.193.5:0/1737598302 shutdown_connections 2026-02-17T21:25:38.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.218+0000 7f9aeada9640 1 --2- 10.20.193.5:0/1737598302 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9ab40792b0 0x7f9ab407b770 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.218+0000 7f9aeada9640 1 --2- 10.20.193.5:0/1737598302 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9ae40c38f0 0x7f9ae40c3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.218+0000 7f9aeada9640 1 --2- 10.20.193.5:0/1737598302 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9ae41f54b0 0x7f9ae414c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.218+0000 7f9aeada9640 1 --2- 10.20.193.5:0/1737598302 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9ad00054c0 0x7f9ae41f1280 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.218+0000 7f9aeada9640 1 -- 10.20.193.5:0/1737598302 >> 10.20.193.5:0/1737598302 conn(0x7f9ae40c9f40 msgr2=0x7f9ae40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.218+0000 7f9aeada9640 1 -- 10.20.193.5:0/1737598302 shutdown_connections 2026-02-17T21:25:38.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.218+0000 7f9aeada9640 1 -- 10.20.193.5:0/1737598302 wait complete. 2026-02-17T21:25:38.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.218+0000 7f9aeada9640 1 librados: shutdown 2026-02-17T21:25:38.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117001 got 115964117000 for osd.3 2026-02-17T21:25:38.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.263+0000 7fc5c3577640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T21:25:38.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.263+0000 7fc5c3577640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T21:25:38.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.263+0000 7fc5c3577640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.263+0000 7fc5c3577640 1 -- 10.20.193.5:0/1953016475 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fc5c41500e0 con 0x7fc5c41f3e40 2026-02-17T21:25:38.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.264+0000 7f26d0eb9640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T21:25:38.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.264+0000 7f26d0eb9640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T21:25:38.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.264+0000 7f26d0eb9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.264+0000 7f26d0eb9640 1 -- 10.20.193.5:0/3236479413 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f26cc0c9b20 con 0x7f26cc14b620 2026-02-17T21:25:38.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.264+0000 7f446c77e640 10 monclient: get_monmap_and_config 2026-02-17T21:25:38.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.264+0000 7f446c77e640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.264+0000 7f446c77e640 10 monclient: monmap: 2026-02-17T21:25:38.268 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.268 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.268 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:38.265150+0000 2026-02-17T21:25:38.268 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:38.265150+0000 2026-02-17T21:25:38.268 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.268 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.268 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:38.268 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:38.269 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:38.269 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:38.269 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:38.269 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:38.269 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.264+0000 7f446c77e640 1 Processor -- start 2026-02-17T21:25:38.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.265+0000 7f446c77e640 1 -- start start 2026-02-17T21:25:38.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.265+0000 7f446c77e640 10 monclient: init 2026-02-17T21:25:38.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.265+0000 7f446c77e640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.265+0000 7f446c77e640 10 monclient: _add_conns ranks=[2,5,3,1,0,4] 2026-02-17T21:25:38.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.265+0000 7f446c77e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f44640d1b60 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:38.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.265+0000 7f446c77e640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f44640d1f40 0x7f446415c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.265+0000 7f446c77e640 10 monclient(hunting): picked mon.noname-c con 0x7f44640d1f40 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:38.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.265+0000 7f446c77e640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f446415d950 0x7f446415dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.265+0000 7f446c77e640 10 monclient(hunting): picked mon.noname-a con 0x7f446415d950 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:38.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.265+0000 7f446c77e640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f446415e2d0 con 0x7f44640d1b60 2026-02-17T21:25:38.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.265+0000 7f446c77e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.265+0000 7f446c77e640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f446415cd80 con 0x7f446415d950 2026-02-17T21:25:38.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.265+0000 7f446c77e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.265+0000 7f446c77e640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f44640ca460 con 0x7f44640d1f40 2026-02-17T21:25:38.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.265+0000 7f446c77e640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.265+0000 7f446c77e640 10 monclient(hunting): authenticate will time out at 1043.830549s 2026-02-17T21:25:38.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.265+0000 7f446acf4640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f446415d950 0x7f446415dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.266+0000 7f446acf4640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f446415d950 0x7f446415dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:58506/0 (socket says 10.20.193.5:58506) 2026-02-17T21:25:38.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.266+0000 7f446acf4640 1 -- 10.20.193.5:0/1972593700 learned_addr learned my addr 10.20.193.5:0/1972593700 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:38.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.266+0000 7f446acf4640 10 monclient(hunting): get_auth_request con 0x7f446415d950 auth_method 0 2026-02-17T21:25:38.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.266+0000 7f446acf4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.266+0000 7f446acf4640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.266+0000 7f446acf4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.266+0000 7f26b2ffd640 1 -- 10.20.193.5:0/3236479413 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f26b4037e20 con 0x7f26cc14b620 2026-02-17T21:25:38.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.266+0000 7f26b2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T21:25:38.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.266+0000 7f26b2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:38.272 INFO:teuthology.orchestra.run.trial005.stdout:120259084293 2026-02-17T21:25:38.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.266+0000 7f446acf4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.266+0000 7f446acf4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.266+0000 7f446acf4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.267+0000 7f446acf4640 10 monclient(hunting): handle_auth_done global_id 4500 payload 274 2026-02-17T21:25:38.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.267+0000 7f446acf4640 1 -- 10.20.193.5:0/1972593700 >> v2:10.20.193.135:3300/0 conn(0x7f44640d1f40 msgr2=0x7f446415c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.267+0000 7f446acf4640 1 --2- 10.20.193.5:0/1972593700 >> v2:10.20.193.135:3300/0 conn(0x7f44640d1f40 0x7f446415c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.267+0000 7f446acf4640 1 -- 10.20.193.5:0/1972593700 >> v1:10.20.193.135:6789/0 conn(0x7f44640d1b60 legacy=0x7f44640c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.267+0000 7f446acf4640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.267+0000 7f446acf4640 1 monclient: found mon.noname-a 2026-02-17T21:25:38.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.267+0000 7f446acf4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.267+0000 7f446acf4640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.267+0000 7f446acf4640 1 -- 10.20.193.5:0/1972593700 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44640c98e0 con 0x7f446415d950 2026-02-17T21:25:38.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.268+0000 7f26d0eb9640 10 librados: watch_flush enter 2026-02-17T21:25:38.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.268+0000 7f26d0eb9640 10 librados: watch_flush exit 2026-02-17T21:25:38.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.268+0000 7f26d0eb9640 20 client.4531.objecter shutdown clearing up homeless session... 2026-02-17T21:25:38.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.268+0000 7f26d0eb9640 10 client.4531.objecter successfully canceled tick 2026-02-17T21:25:38.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.268+0000 7f26d0eb9640 1 -- 10.20.193.5:0/3236479413 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f26980792b0 msgr2=0x7f269807b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.268+0000 7f26d0eb9640 1 --2- 10.20.193.5:0/3236479413 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f26980792b0 0x7f269807b770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0664a0 tx=0x7f26c0006d40 comp rx=0 tx=0).stop 2026-02-17T21:25:38.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.268+0000 7f26d0eb9640 10 monclient: shutdown 2026-02-17T21:25:38.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.268+0000 7f26d0eb9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.268+0000 7f26d0eb9640 1 -- 10.20.193.5:0/3236479413 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f26cc14b620 msgr2=0x7f26cc149c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.268+0000 7f26d0eb9640 1 --2- 10.20.193.5:0/3236479413 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f26cc14b620 0x7f26cc149c50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f26b402ed50 tx=0x7f26b40048d0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.268+0000 7f26d0eb9640 1 -- 10.20.193.5:0/3236479413 shutdown_connections 2026-02-17T21:25:38.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.268+0000 7f26d0eb9640 1 --2- 10.20.193.5:0/3236479413 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f26980792b0 0x7f269807b770 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.268+0000 7f26d0eb9640 1 --2- 10.20.193.5:0/3236479413 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f26cc15c070 0x7f26cc1f3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.268+0000 7f26d0eb9640 1 --2- 10.20.193.5:0/3236479413 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f26cc14b620 0x7f26cc149c50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.268+0000 7f26d0eb9640 1 --2- 10.20.193.5:0/3236479413 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f26b8004900 0x7f26cc1f4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.268+0000 7f26d0eb9640 1 -- 10.20.193.5:0/3236479413 >> 10.20.193.5:0/3236479413 conn(0x7f26cc06d9b0 msgr2=0x7f26cc0cfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.268+0000 7f26d0eb9640 1 -- 10.20.193.5:0/3236479413 shutdown_connections 2026-02-17T21:25:38.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.268+0000 7f26d0eb9640 1 -- 10.20.193.5:0/3236479413 wait complete. 2026-02-17T21:25:38.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.268+0000 7f26d0eb9640 1 librados: shutdown 2026-02-17T21:25:38.281 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-17T21:25:38.282 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-17T21:25:38.282 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-17T21:25:38.283 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-17T21:25:38.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.269+0000 7f446acf4640 1 --2- 10.20.193.5:0/1972593700 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f446415d950 0x7f446415dd90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f446408fc80 tx=0x7f446002f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f172679cd61b142f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f44694f1640 1 -- 10.20.193.5:0/1972593700 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446002fcd0 con 0x7f446415d950 2026-02-17T21:25:38.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f44694f1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f44694f1640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:38.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f44694f1640 10 monclient: dump: 2026-02-17T21:25:38.284 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.284 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.285 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.285 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.285 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.285 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.285 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.285 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.285 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.285 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f44694f1640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f44694f1640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f44694f1640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f446c77e640 5 monclient: authenticate success, global_id 4500 2026-02-17T21:25:38.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f44694f1640 1 -- 10.20.193.5:0/1972593700 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44600373f0 con 0x7f446415d950 2026-02-17T21:25:38.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f446c77e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:38.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f44694f1640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f44694f1640 1 -- 10.20.193.5:0/1972593700 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44600377c0 con 0x7f446415d950 2026-02-17T21:25:38.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f446c77e640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:38.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f44694f1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f446c77e640 4 set_mon_vals no callback set 2026-02-17T21:25:38.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f44694f1640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:38.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f44694f1640 10 monclient: dump: 2026-02-17T21:25:38.286 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.286 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.287 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.287 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.287 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.287 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.287 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.287 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.287 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.287 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f446c77e640 10 monclient: shutdown 2026-02-17T21:25:38.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f446c77e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f446c77e640 1 -- 10.20.193.5:0/1972593700 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f446415d950 msgr2=0x7f446415dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f446c77e640 1 --2- 10.20.193.5:0/1972593700 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f446415d950 0x7f446415dd90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f446408fc80 tx=0x7f446002f270 comp rx=0 tx=0).stop 2026-02-17T21:25:38.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f446c77e640 1 -- 10.20.193.5:0/1972593700 shutdown_connections 2026-02-17T21:25:38.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f446c77e640 1 --2- 10.20.193.5:0/1972593700 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f446415d950 0x7f446415dd90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f446c77e640 1 --2- 10.20.193.5:0/1972593700 >> v2:10.20.193.135:3300/0 conn(0x7f44640d1f40 0x7f446415c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f446c77e640 1 -- 10.20.193.5:0/1972593700 >> 10.20.193.5:0/1972593700 conn(0x7f446406d9b0 msgr2=0x7f446406ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f446c77e640 1 -- 10.20.193.5:0/1972593700 shutdown_connections 2026-02-17T21:25:38.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.272+0000 7f446c77e640 1 -- 10.20.193.5:0/1972593700 wait complete. 2026-02-17T21:25:38.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.273+0000 7f446c77e640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.273+0000 7f446c77e640 10 monclient: monmap: 2026-02-17T21:25:38.288 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.288 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:38.288 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:38.288 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:38.289 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.289 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.289 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:38.289 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:38.289 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:38.289 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.273+0000 7f446c77e640 1 librados: starting msgr at 2026-02-17T21:25:38.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.273+0000 7f446c77e640 1 librados: starting objecter 2026-02-17T21:25:38.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.273+0000 7f446c77e640 1 Processor -- start 2026-02-17T21:25:38.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.273+0000 7f446c77e640 1 -- start start 2026-02-17T21:25:38.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.273+0000 7f446c77e640 1 librados: setting wanted keys 2026-02-17T21:25:38.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.273+0000 7f446c77e640 1 librados: calling monclient init 2026-02-17T21:25:38.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.273+0000 7f446c77e640 10 monclient: init 2026-02-17T21:25:38.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.273+0000 7f446c77e640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.273+0000 7f446c77e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:25:38.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.273+0000 7f446c77e640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f44640d1b60 0x7f44641f4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.273+0000 7f446c77e640 10 monclient(hunting): picked mon.noname-b con 0x7f44640d1b60 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:38.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.273+0000 7f446c77e640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f44640d1f40 0x7f44641f5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.273+0000 7f446c77e640 10 monclient(hunting): picked mon.noname-a con 0x7f44640d1f40 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:38.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.273+0000 7f446c77e640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f446415d950 0x7f44641411f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.273+0000 7f446c77e640 10 monclient(hunting): picked mon.noname-c con 0x7f446415d950 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:38.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.273+0000 7f446c77e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.273+0000 7f446c77e640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f44640c9ea0 con 0x7f44640d1f40 2026-02-17T21:25:38.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.273+0000 7f446c77e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.273+0000 7f446c77e640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f446415d4c0 con 0x7f44640d1b60 2026-02-17T21:25:38.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.273+0000 7f446c77e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.273+0000 7f446c77e640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f44640ca180 con 0x7f446415d950 2026-02-17T21:25:38.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.273+0000 7f446c77e640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.273+0000 7f446c77e640 10 monclient(hunting): authenticate will time out at 1043.838788s 2026-02-17T21:25:38.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.274+0000 7f4469cf2640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f44640d1f40 0x7f44641f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.274+0000 7f446a4f3640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f44640d1b60 0x7f44641f4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.274+0000 7f4469cf2640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f44640d1f40 0x7f44641f5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:58514/0 (socket says 10.20.193.5:58514) 2026-02-17T21:25:38.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.274+0000 7f4469cf2640 1 -- 10.20.193.5:0/3586122047 learned_addr learned my addr 10.20.193.5:0/3586122047 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:38.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.274+0000 7f4469cf2640 10 monclient(hunting): get_auth_request con 0x7f44640d1f40 auth_method 0 2026-02-17T21:25:38.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.274+0000 7f4469cf2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.274+0000 7f4469cf2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.274+0000 7f4469cf2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.274+0000 7f446a4f3640 10 monclient(hunting): get_auth_request con 0x7f44640d1b60 auth_method 0 2026-02-17T21:25:38.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.274+0000 7f446a4f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.274+0000 7f446a4f3640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.274+0000 7f446a4f3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.274+0000 7f4469cf2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.274+0000 7f4469cf2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.274+0000 7f4469cf2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.274+0000 7f446a4f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.274+0000 7f446a4f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.274+0000 7f446a4f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.275+0000 7f446a4f3640 10 monclient(hunting): handle_auth_done global_id 4534 payload 824 2026-02-17T21:25:38.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.275+0000 7f446a4f3640 1 -- 10.20.193.5:0/3586122047 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f446415d950 msgr2=0x7f44641411f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.275+0000 7f446a4f3640 1 --2- 10.20.193.5:0/3586122047 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f446415d950 0x7f44641411f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.275+0000 7f446a4f3640 1 -- 10.20.193.5:0/3586122047 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f44640d1f40 msgr2=0x7f44641f5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.275+0000 7f446a4f3640 1 --2- 10.20.193.5:0/3586122047 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f44640d1f40 0x7f44641f5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.275+0000 7f446a4f3640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.275+0000 7f446a4f3640 1 monclient: found mon.noname-b 2026-02-17T21:25:38.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.275+0000 7f446a4f3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.275+0000 7f446a4f3640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.275+0000 7f446a4f3640 1 -- 10.20.193.5:0/3586122047 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4464147450 con 0x7f44640d1b60 2026-02-17T21:25:38.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084295 got 120259084293 for osd.4 2026-02-17T21:25:38.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.276+0000 7f446a4f3640 1 --2- 10.20.193.5:0/3586122047 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f44640d1b60 0x7f44641f4d10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f445400b440 tx=0x7f445400b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.276+0000 7f444affd640 10 client.?.objecter ms_handle_connect 0x7f44640d1b60 2026-02-17T21:25:38.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.276+0000 7f444affd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:38.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.277+0000 7f444affd640 1 -- 10.20.193.5:0/3586122047 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4454016070 con 0x7f44640d1b60 2026-02-17T21:25:38.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.277+0000 7f444affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.277+0000 7f444affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:38.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.277+0000 7f444affd640 10 monclient: dump: 2026-02-17T21:25:38.296 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.296 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.296 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.296 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.296 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.296 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.296 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.296 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.296 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.296 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.277+0000 7f444affd640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.277+0000 7f444affd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.277+0000 7f444affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.277+0000 7f446c77e640 5 monclient: authenticate success, global_id 4534 2026-02-17T21:25:38.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.277+0000 7f446c77e640 10 monclient: _renew_subs 2026-02-17T21:25:38.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.277+0000 7f446c77e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.277+0000 7f446c77e640 1 -- 10.20.193.5:0/3586122047 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4464147730 con 0x7f44640d1b60 2026-02-17T21:25:38.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.277+0000 7f446c77e640 10 client.4534.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:38.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.277+0000 7f446c77e640 10 monclient: _renew_subs 2026-02-17T21:25:38.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.277+0000 7f446c77e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.277+0000 7f446c77e640 1 -- 10.20.193.5:0/3586122047 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4464147cf0 con 0x7f44640d1b60 2026-02-17T21:25:38.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.277+0000 7f446c77e640 1 librados: init done 2026-02-17T21:25:38.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.278+0000 7f446c77e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.278+0000 7f446c77e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.278+0000 7f446c77e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.278+0000 7f446c77e640 1 -- 10.20.193.5:0/3586122047 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f446406e7b0 con 0x7f44640d1b60 2026-02-17T21:25:38.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.278+0000 7f444affd640 1 -- 10.20.193.5:0/3586122047 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4454004480 con 0x7f44640d1b60 2026-02-17T21:25:38.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.278+0000 7f444affd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.278+0000 7f444affd640 1 -- 10.20.193.5:0/3586122047 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4454020060 con 0x7f44640d1b60 2026-02-17T21:25:38.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.278+0000 7f444affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.278+0000 7f444affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:38.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.278+0000 7f4468cf0640 4 set_mon_vals no callback set 2026-02-17T21:25:38.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.278+0000 7f444affd640 10 monclient: dump: 2026-02-17T21:25:38.298 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.298 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.298 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.298 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.298 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.298 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.298 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.298 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.298 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.298 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.288+0000 7f4cbe7fc640 1 -- 10.20.193.5:0/2419355732 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f4cc000f460 con 0x7f4cd00ca040 2026-02-17T21:25:38.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.288+0000 7f4cbe7fc640 1 --2- 10.20.193.5:0/2419355732 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4ca0079280 0x7f4ca007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.288+0000 7f4cd51cf640 1 --2- 10.20.193.5:0/2419355732 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4ca0079280 0x7f4ca007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.288+0000 7f4cd51cf640 10 monclient: get_auth_request con 0x7f4ca0079280 auth_method 0 2026-02-17T21:25:38.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.289+0000 7f4cd51cf640 1 --2- 10.20.193.5:0/2419355732 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4ca0079280 0x7f4ca007b740 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0074f00 tx=0x7f4cc4033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.289+0000 7f4cbe7fc640 10 client.4565.objecter ms_handle_connect 0x7f4ca0079280 2026-02-17T21:25:38.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.289+0000 7f4cbe7fc640 1 -- 10.20.193.5:0/2419355732 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f4cc0097ff0 con 0x7f4cd00ca040 2026-02-17T21:25:38.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.289+0000 7f4cbe7fc640 10 client.4565.objecter ms_dispatch2 0x7f4cd0000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:38.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.289+0000 7f4cbe7fc640 3 client.4565.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:38.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.289+0000 7f4cbe7fc640 3 client.4565.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:38.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.289+0000 7f4cbe7fc640 20 client.4565.objecter dump_active .. 0 homeless 2026-02-17T21:25:38.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.296+0000 7fc7891fe640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T21:25:38.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.296+0000 7fc7891fe640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T21:25:38.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.296+0000 7fc7891fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.296+0000 7fc7891fe640 1 -- 10.20.193.5:0/2838182670 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 15} v 0) -- 0x7fc78414eb20 con 0x7fc78415d950 2026-02-17T21:25:38.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.296+0000 7f4cbe7fc640 1 -- 10.20.193.5:0/2419355732 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4cc001d020 con 0x7f4cd00ca040 2026-02-17T21:25:38.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.296+0000 7f4cbe7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.296+0000 7f4cbe7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:38.302 INFO:teuthology.orchestra.run.trial005.stdout:120259084293 2026-02-17T21:25:38.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.298+0000 7fc7637fe640 1 -- 10.20.193.5:0/2838182670 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 15}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fc78414eb20 con 0x7fc78415d950 2026-02-17T21:25:38.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.298+0000 7fc7637fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T21:25:38.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.298+0000 7fc7637fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:38.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.300+0000 7fc7891fe640 10 librados: watch_flush enter 2026-02-17T21:25:38.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.300+0000 7fc7891fe640 10 librados: watch_flush exit 2026-02-17T21:25:38.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.300+0000 7fc7891fe640 20 client.4497.objecter shutdown clearing up homeless session... 2026-02-17T21:25:38.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.300+0000 7fc7891fe640 10 client.4497.objecter successfully canceled tick 2026-02-17T21:25:38.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.300+0000 7fc7891fe640 1 -- 10.20.193.5:0/2838182670 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc7500792d0 msgr2=0x7fc75007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.300+0000 7fc7891fe640 1 --2- 10.20.193.5:0/2838182670 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc7500792d0 0x7fc75007b790 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc778009750 tx=0x7fc778006ca0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.300+0000 7fc7891fe640 10 monclient: shutdown 2026-02-17T21:25:38.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.300+0000 7fc7891fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.300+0000 7fc7891fe640 1 -- 10.20.193.5:0/2838182670 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc78415d950 msgr2=0x7fc7841f5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.300+0000 7fc7891fe640 1 --2- 10.20.193.5:0/2838182670 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc78415d950 0x7fc7841f5950 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc77400cb80 tx=0x7fc77400a430 comp rx=0 tx=0).stop 2026-02-17T21:25:38.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.300+0000 7fc7891fe640 1 -- 10.20.193.5:0/2838182670 shutdown_connections 2026-02-17T21:25:38.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.300+0000 7fc7891fe640 1 --2- 10.20.193.5:0/2838182670 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc7500792d0 0x7fc75007b790 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.300+0000 7fc7891fe640 1 --2- 10.20.193.5:0/2838182670 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc78415d950 0x7fc7841f5950 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.300+0000 7fc7891fe640 1 --2- 10.20.193.5:0/2838182670 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc7840d1f40 0x7fc784148250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.300+0000 7fc7891fe640 1 --2- 10.20.193.5:0/2838182670 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc7840d1b60 0x7fc784147d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.300+0000 7fc7891fe640 1 -- 10.20.193.5:0/2838182670 >> 10.20.193.5:0/2838182670 conn(0x7fc78406d9b0 msgr2=0x7fc7840d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.300+0000 7fc7891fe640 1 -- 10.20.193.5:0/2838182670 shutdown_connections 2026-02-17T21:25:38.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.300+0000 7fc7891fe640 1 -- 10.20.193.5:0/2838182670 wait complete. 2026-02-17T21:25:38.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.300+0000 7fc7891fe640 1 librados: shutdown 2026-02-17T21:25:38.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.301+0000 7fc5aaffd640 1 -- 10.20.193.5:0/1953016475 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc5ac087200 con 0x7fc5c41f3e40 2026-02-17T21:25:38.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.301+0000 7fc5aaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T21:25:38.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.301+0000 7fc5aaffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:38.306 INFO:teuthology.orchestra.run.trial005.stdout:98784247812 2026-02-17T21:25:38.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.303+0000 7fc5c3577640 10 librados: watch_flush enter 2026-02-17T21:25:38.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.303+0000 7fc5c3577640 10 librados: watch_flush exit 2026-02-17T21:25:38.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.303+0000 7fc5c3577640 20 client.4559.objecter shutdown clearing up homeless session... 2026-02-17T21:25:38.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.303+0000 7fc5c3577640 10 client.4559.objecter successfully canceled tick 2026-02-17T21:25:38.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.303+0000 7fc5c3577640 1 -- 10.20.193.5:0/1953016475 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc590079300 msgr2=0x7fc59007b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.303+0000 7fc5c3577640 1 --2- 10.20.193.5:0/1953016475 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc590079300 0x7fc59007b7c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc5b80097d0 tx=0x7fc5b8006db0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.303+0000 7fc5c3577640 10 monclient: shutdown 2026-02-17T21:25:38.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.303+0000 7fc5c3577640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.303+0000 7fc5c3577640 1 -- 10.20.193.5:0/1953016475 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc5c41f3e40 msgr2=0x7fc5c41f1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.303+0000 7fc5c3577640 1 --2- 10.20.193.5:0/1953016475 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc5c41f3e40 0x7fc5c41f1130 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac036000 tx=0x7fc5ac0048d0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.303+0000 7fc5c3577640 1 -- 10.20.193.5:0/1953016475 shutdown_connections 2026-02-17T21:25:38.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.303+0000 7fc5c3577640 1 --2- 10.20.193.5:0/1953016475 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc590079300 0x7fc59007b7c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.303+0000 7fc5c3577640 1 --2- 10.20.193.5:0/1953016475 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc5c41f46b0 0x7fc5c40cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.303+0000 7fc5c3577640 1 --2- 10.20.193.5:0/1953016475 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc5c41f3e40 0x7fc5c41f1130 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.303+0000 7fc5c3577640 1 --2- 10.20.193.5:0/1953016475 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc5b0004900 0x7fc5c4150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.303+0000 7fc5c3577640 1 -- 10.20.193.5:0/1953016475 >> 10.20.193.5:0/1953016475 conn(0x7fc5c40d1d80 msgr2=0x7fc5c40cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.303+0000 7fc5c3577640 1 -- 10.20.193.5:0/1953016475 shutdown_connections 2026-02-17T21:25:38.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.303+0000 7fc5c3577640 1 -- 10.20.193.5:0/1953016475 wait complete. 2026-02-17T21:25:38.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.304+0000 7fc5c3577640 1 librados: shutdown 2026-02-17T21:25:38.310 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084295 got 120259084293 for osd.15 2026-02-17T21:25:38.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247813 got 98784247812 for osd.7 2026-02-17T21:25:38.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.365+0000 7fa1c26da640 10 monclient: get_monmap_and_config 2026-02-17T21:25:38.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.365+0000 7fa1c26da640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.365+0000 7fa1c26da640 10 monclient: monmap: 2026-02-17T21:25:38.367 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.367 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.367 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:38.366262+0000 2026-02-17T21:25:38.367 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:38.366262+0000 2026-02-17T21:25:38.367 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.367 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.367 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:38.368 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:38.368 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:38.368 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:38.368 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:38.368 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:38.368 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.369 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T21:25:38.369 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.365+0000 7fa43d3ce640 10 monclient: get_monmap_and_config 2026-02-17T21:25:38.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.365+0000 7fa43d3ce640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.365+0000 7fa43d3ce640 10 monclient: monmap: 2026-02-17T21:25:38.370 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.370 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.370 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:38.366620+0000 2026-02-17T21:25:38.370 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:38.366620+0000 2026-02-17T21:25:38.370 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.370 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.370 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:38.370 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:38.370 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:38.371 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:38.371 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:38.371 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:38.371 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7fa1c26da640 1 Processor -- start 2026-02-17T21:25:38.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7f09fc3a9640 10 monclient: get_monmap_and_config 2026-02-17T21:25:38.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7f09fc3a9640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7f09fc3a9640 10 monclient: monmap: 2026-02-17T21:25:38.372 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.372 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.372 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:38.366798+0000 2026-02-17T21:25:38.372 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:38.366798+0000 2026-02-17T21:25:38.372 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.372 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.372 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:38.372 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:38.373 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:38.373 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:38.373 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:38.373 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:38.373 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7fa1c26da640 1 -- start start 2026-02-17T21:25:38.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7fa1c26da640 10 monclient: init 2026-02-17T21:25:38.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7fa43d3ce640 1 Processor -- start 2026-02-17T21:25:38.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7fa43d3ce640 1 -- start start 2026-02-17T21:25:38.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7fa43d3ce640 10 monclient: init 2026-02-17T21:25:38.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7f78abe96640 10 monclient: get_monmap_and_config 2026-02-17T21:25:38.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7f78abe96640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7f78abe96640 10 monclient: monmap: 2026-02-17T21:25:38.375 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.375 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.375 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:38.367151+0000 2026-02-17T21:25:38.375 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:38.367151+0000 2026-02-17T21:25:38.375 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.375 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.376 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:38.376 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:38.376 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:38.376 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:38.376 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:38.376 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:38.376 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7f09fc3a9640 1 Processor -- start 2026-02-17T21:25:38.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7f09fc3a9640 1 -- start start 2026-02-17T21:25:38.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7f09fc3a9640 10 monclient: init 2026-02-17T21:25:38.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7fa1c26da640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7fa1c26da640 10 monclient: _add_conns ranks=[0,1,4,5,2,3] 2026-02-17T21:25:38.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7fa1c26da640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa1bc0d1b60 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:38.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7fa1c26da640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fa1bc0d1f40 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:38.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7fa1c26da640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fa1bc15e060 0x7fa1bc15c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7fa1c26da640 10 monclient(hunting): picked mon.noname-b con 0x7fa1bc15e060 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:38.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7fa1c26da640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1bc0c98e0 con 0x7fa1bc0d1b60 2026-02-17T21:25:38.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7fa1c26da640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1bc0c9bc0 con 0x7fa1bc0d1f40 2026-02-17T21:25:38.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7fa1c26da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7fa1c26da640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fa1bc15cd80 con 0x7fa1bc15e060 2026-02-17T21:25:38.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7fa1c26da640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7fa1c26da640 10 monclient(hunting): authenticate will time out at 1043.931752s 2026-02-17T21:25:38.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.366+0000 7f78abe96640 1 Processor -- start 2026-02-17T21:25:38.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7fa43d3ce640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f78abe96640 1 -- start start 2026-02-17T21:25:38.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f78abe96640 10 monclient: init 2026-02-17T21:25:38.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7fa43d3ce640 10 monclient: _add_conns ranks=[5,1,0,2,3,4] 2026-02-17T21:25:38.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7fa43d3ce640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fa4380c7170 0x7fa4380c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7fa43d3ce640 10 monclient(hunting): picked mon.noname-c con 0x7fa4380c7170 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:38.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7fa43d3ce640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fa4380c48c0 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:38.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7fa43d3ce640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa4380c4d10 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:38.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7fa43d3ce640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa43815a9a0 con 0x7fa4380c4d10 2026-02-17T21:25:38.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7fa43d3ce640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4380c5270 con 0x7fa4380c48c0 2026-02-17T21:25:38.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7fa43d3ce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7fa43d3ce640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa4380c8530 con 0x7fa4380c7170 2026-02-17T21:25:38.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7fa43d3ce640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7fa43d3ce640 10 monclient(hunting): authenticate will time out at 1043.932097s 2026-02-17T21:25:38.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f09fc3a9640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f09fc3a9640 10 monclient: _add_conns ranks=[3,0,5,1,4,2] 2026-02-17T21:25:38.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f09fc3a9640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f09f40d1b60 0x7f09f40d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f09fc3a9640 10 monclient(hunting): picked mon.noname-a con 0x7f09f40d1b60 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:38.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f09fc3a9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f09f415c840 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:38.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f09fc3a9640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f09f415d950 0x7f09f415dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f09fc3a9640 10 monclient(hunting): picked mon.noname-c con 0x7f09f415d950 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:38.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f09fc3a9640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09f415e2d0 con 0x7f09f415c840 2026-02-17T21:25:38.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f09fc3a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f09fc3a9640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f09f40ca460 con 0x7f09f40d1b60 2026-02-17T21:25:38.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f09fc3a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f09fc3a9640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f09f415d4c0 con 0x7f09f415d950 2026-02-17T21:25:38.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f09fc3a9640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f09fc3a9640 10 monclient(hunting): authenticate will time out at 1043.932224s 2026-02-17T21:25:38.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7fa1bbfff640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7fa1bc0d1b60 0x7fa1bc0c8d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:37546/0 (socket says 10.20.193.5:37546) 2026-02-17T21:25:38.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7fa1bbfff640 1 -- 10.20.193.5:0/4243085932 learned_addr learned my addr 10.20.193.5:0/4243085932 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:38.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f78abe96640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f78abe96640 10 monclient: _add_conns ranks=[3,4,1,2,0,5] 2026-02-17T21:25:38.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f78abe96640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f78a4152680 0x7f78a4076230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f78abe96640 10 monclient(hunting): picked mon.noname-a con 0x7f78a4152680 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:38.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f78abe96640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f78a4152a60 0x7f78a40c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f78abe96640 10 monclient(hunting): picked mon.noname-b con 0x7f78a4152a60 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:38.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f78abe96640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f78a4073720 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:38.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f78abe96640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a40c8640 con 0x7f78a4073720 2026-02-17T21:25:38.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f78abe96640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f78abe96640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f78a40c88b0 con 0x7f78a4152680 2026-02-17T21:25:38.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f78abe96640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f78abe96640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f78a40c8b90 con 0x7f78a4152a60 2026-02-17T21:25:38.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f78abe96640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f78abe96640 10 monclient(hunting): authenticate will time out at 1043.932586s 2026-02-17T21:25:38.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7fa436ffd640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fa4380c7170 0x7fa4380c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f09fa11e640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f09f40d1b60 0x7f09f40d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f09fa91f640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f09f415d950 0x7f09f415dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7fa436ffd640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fa4380c7170 0x7fa4380c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:54324/0 (socket says 10.20.193.5:54324) 2026-02-17T21:25:38.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7fa436ffd640 1 -- 10.20.193.5:0/956705976 learned_addr learned my addr 10.20.193.5:0/956705976 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:38.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7fa436ffd640 10 monclient(hunting): get_auth_request con 0x7fa4380c7170 auth_method 0 2026-02-17T21:25:38.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7fa436ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7fa436ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7fa436ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f09fa11e640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f09f40d1b60 0x7f09f40d1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:58524/0 (socket says 10.20.193.5:58524) 2026-02-17T21:25:38.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f09fa11e640 1 -- 10.20.193.5:0/454906152 learned_addr learned my addr 10.20.193.5:0/454906152 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:38.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f09fa11e640 10 monclient(hunting): get_auth_request con 0x7f09f40d1b60 auth_method 0 2026-02-17T21:25:38.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f09fa11e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f09fa11e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.367+0000 7f09fa11e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.368+0000 7f09fa91f640 10 monclient(hunting): get_auth_request con 0x7f09f415d950 auth_method 0 2026-02-17T21:25:38.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.368+0000 7f09fa91f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.368+0000 7f09fa91f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.368+0000 7f09fa91f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.368+0000 7fa436ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.368+0000 7fa436ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.368+0000 7fa436ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.368+0000 7f09fa11e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.368+0000 7f09fa11e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.368+0000 7f09fa11e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.368+0000 7f09fa91f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.368+0000 7f09fa91f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.368+0000 7f09fa91f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.394 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.369+0000 7fa436ffd640 10 monclient(hunting): handle_auth_done global_id 4568 payload 274 2026-02-17T21:25:38.394 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.369+0000 7fa436ffd640 1 -- 10.20.193.5:0/956705976 >> v1:10.20.193.119:6789/0 conn(0x7fa4380c48c0 legacy=0x7fa4380749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.394 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.369+0000 7fa436ffd640 1 -- 10.20.193.5:0/956705976 >> v1:10.20.193.5:6789/0 conn(0x7fa4380c4d10 legacy=0x7fa4380c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.394 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.369+0000 7fa436ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.394 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.369+0000 7fa436ffd640 1 monclient: found mon.noname-c 2026-02-17T21:25:38.394 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.369+0000 7fa436ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.394 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.369+0000 7fa436ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.394 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.369+0000 7fa436ffd640 1 -- 10.20.193.5:0/956705976 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4380c5550 con 0x7fa4380c7170 2026-02-17T21:25:38.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.369+0000 7f09fa11e640 10 monclient(hunting): handle_auth_done global_id 4506 payload 274 2026-02-17T21:25:38.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.369+0000 7f09fa11e640 1 -- 10.20.193.5:0/454906152 >> v2:10.20.193.135:3300/0 conn(0x7f09f415d950 msgr2=0x7f09f415dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.369+0000 7f09fa11e640 1 --2- 10.20.193.5:0/454906152 >> v2:10.20.193.135:3300/0 conn(0x7f09f415d950 0x7f09f415dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.369+0000 7f09fa11e640 1 -- 10.20.193.5:0/454906152 >> v1:10.20.193.5:6789/0 conn(0x7f09f415c840 legacy=0x7f09f40c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.369+0000 7f09fa11e640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.369+0000 7f09fa11e640 1 monclient: found mon.noname-a 2026-02-17T21:25:38.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.369+0000 7f09fa11e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.369+0000 7f09fa11e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.369+0000 7f09fa11e640 1 -- 10.20.193.5:0/454906152 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f40c98e0 con 0x7f09f40d1b60 2026-02-17T21:25:38.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.371+0000 7fa436ffd640 1 --2- 10.20.193.5:0/956705976 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa4380c7170 0x7fa4380c7550 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009970 tx=0x7fa42c02eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abd3104f2c5de146 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.372+0000 7f09fa11e640 1 --2- 10.20.193.5:0/454906152 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09f40d1b60 0x7f09f40d1f40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f09f40751e0 tx=0x7f09e402eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e3bc01b10b21cd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.397 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa435ffb640 1 -- 10.20.193.5:0/956705976 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa42c03c070 con 0x7fa4380c7170 2026-02-17T21:25:38.397 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa435ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.397 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa435ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:38.397 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa435ffb640 10 monclient: dump: 2026-02-17T21:25:38.397 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.397 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.397 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.397 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.397 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.397 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.397 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.397 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.397 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.398 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa435ffb640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa435ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa435ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa435ffb640 1 -- 10.20.193.5:0/956705976 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa42c02fbb0 con 0x7fa4380c7170 2026-02-17T21:25:38.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa43d3ce640 5 monclient: authenticate success, global_id 4568 2026-02-17T21:25:38.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa43d3ce640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:38.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa435ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa435ffb640 1 -- 10.20.193.5:0/956705976 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa42c037440 con 0x7fa4380c7170 2026-02-17T21:25:38.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa435ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa435ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:38.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa435ffb640 10 monclient: dump: 2026-02-17T21:25:38.398 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.398 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.399 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.399 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.399 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.399 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.399 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.399 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.399 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.399 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa43d3ce640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:38.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa43d3ce640 4 set_mon_vals no callback set 2026-02-17T21:25:38.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7f78a9c0b640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f78a4152680 0x7f78a4076230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa1baffd640 1 -- 10.20.193.5:0/4243085932 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3113061507 0 0) 0x7fa1bc0c98e0 con 0x7fa1bc0d1b60 2026-02-17T21:25:38.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa1baffd640 10 monclient(hunting): _negotiate 2026-02-17T21:25:38.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa1baffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa1baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa1baffd640 10 monclient(hunting): my global_id is 4509 2026-02-17T21:25:38.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa1baffd640 1 -- 10.20.193.5:0/4243085932 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1a0003620 con 0x7fa1bc0d1b60 2026-02-17T21:25:38.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa43d3ce640 10 monclient: shutdown 2026-02-17T21:25:38.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa43d3ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa43d3ce640 1 -- 10.20.193.5:0/956705976 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa4380c7170 msgr2=0x7fa4380c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa43d3ce640 1 --2- 10.20.193.5:0/956705976 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa4380c7170 0x7fa4380c7550 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009970 tx=0x7fa42c02eef0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa43d3ce640 1 -- 10.20.193.5:0/956705976 shutdown_connections 2026-02-17T21:25:38.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa43d3ce640 1 --2- 10.20.193.5:0/956705976 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa4380c7170 0x7fa4380c7550 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa43d3ce640 1 -- 10.20.193.5:0/956705976 >> 10.20.193.5:0/956705976 conn(0x7fa4380c9f40 msgr2=0x7fa4380ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa43d3ce640 1 -- 10.20.193.5:0/956705976 shutdown_connections 2026-02-17T21:25:38.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.373+0000 7fa43d3ce640 1 -- 10.20.193.5:0/956705976 wait complete. 2026-02-17T21:25:38.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7fa43d3ce640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7fa43d3ce640 10 monclient: monmap: 2026-02-17T21:25:38.402 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.402 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:38.402 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:38.402 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:38.402 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.402 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.402 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:38.402 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:38.402 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:38.402 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7fa43d3ce640 1 librados: starting msgr at 2026-02-17T21:25:38.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7fa43d3ce640 1 librados: starting objecter 2026-02-17T21:25:38.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7fa43d3ce640 1 Processor -- start 2026-02-17T21:25:38.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7fa43d3ce640 1 -- start start 2026-02-17T21:25:38.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7fa43d3ce640 1 librados: setting wanted keys 2026-02-17T21:25:38.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7fa43d3ce640 1 librados: calling monclient init 2026-02-17T21:25:38.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7fa43d3ce640 10 monclient: init 2026-02-17T21:25:38.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7f78a9c0b640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f78a4152680 0x7f78a4076230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:58538/0 (socket says 10.20.193.5:58538) 2026-02-17T21:25:38.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7f78a9c0b640 1 -- 10.20.193.5:0/3628251705 learned_addr learned my addr 10.20.193.5:0/3628251705 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:38.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7f78a9c0b640 10 monclient(hunting): get_auth_request con 0x7f78a4152680 auth_method 0 2026-02-17T21:25:38.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7f78a9c0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7f78a9c0b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7f78a9c0b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7fa43d3ce640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7fa43d3ce640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:25:38.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7fa43d3ce640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa4380c48c0 0x7fa4381f3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7fa43d3ce640 10 monclient(hunting): picked mon.noname-a con 0x7fa4380c48c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:38.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7fa43d3ce640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa4380c4d10 0x7fa4381f38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7fa43d3ce640 10 monclient(hunting): picked mon.noname-b con 0x7fa4380c4d10 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:38.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7fa43d3ce640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa4380c7170 0x7fa43815aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7fa43d3ce640 10 monclient(hunting): picked mon.noname-c con 0x7fa4380c7170 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:38.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7fa43d3ce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7fa43d3ce640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa4380c81c0 con 0x7fa4380c48c0 2026-02-17T21:25:38.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7fa43d3ce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7fa43d3ce640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa4380c7ee0 con 0x7fa4380c4d10 2026-02-17T21:25:38.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7fa43d3ce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7fa43d3ce640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa4380750c0 con 0x7fa4380c7170 2026-02-17T21:25:38.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7fa43d3ce640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.374+0000 7fa43d3ce640 10 monclient(hunting): authenticate will time out at 1043.939982s 2026-02-17T21:25:38.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.375+0000 7fa4377fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa4380c7170 0x7fa43815aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.375+0000 7f78a9c0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.375+0000 7fa4377fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa4380c7170 0x7fa43815aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:54342/0 (socket says 10.20.193.5:54342) 2026-02-17T21:25:38.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.375+0000 7fa4377fe640 1 -- 10.20.193.5:0/3548995151 learned_addr learned my addr 10.20.193.5:0/3548995151 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:38.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.375+0000 7f78a9c0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.375+0000 7fa4377fe640 10 monclient(hunting): get_auth_request con 0x7fa4380c7170 auth_method 0 2026-02-17T21:25:38.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.375+0000 7fa4377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.375+0000 7fa4377fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.375+0000 7fa4377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.375+0000 7f78a9c0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.375+0000 7fa4377fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.375+0000 7fa4377fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.375+0000 7fa4377fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.376+0000 7fa4377fe640 10 monclient(hunting): handle_auth_done global_id 4574 payload 824 2026-02-17T21:25:38.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.376+0000 7fa4377fe640 1 -- 10.20.193.5:0/3548995151 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa4380c4d10 msgr2=0x7fa4381f38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.376+0000 7fa4377fe640 1 --2- 10.20.193.5:0/3548995151 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa4380c4d10 0x7fa4381f38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.376+0000 7fa4377fe640 1 -- 10.20.193.5:0/3548995151 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa4380c48c0 msgr2=0x7fa4381f3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.376+0000 7fa4377fe640 1 --2- 10.20.193.5:0/3548995151 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa4380c48c0 0x7fa4381f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.376+0000 7fa4377fe640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.376+0000 7fa4377fe640 1 monclient: found mon.noname-c 2026-02-17T21:25:38.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.376+0000 7fa4377fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.376+0000 7fa4377fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.376+0000 7fa4377fe640 1 -- 10.20.193.5:0/3548995151 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43815d600 con 0x7fa4380c7170 2026-02-17T21:25:38.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.377+0000 7fa4377fe640 1 --2- 10.20.193.5:0/3548995151 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa4380c7170 0x7fa43815aec0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa42800cbc0 tx=0x7fa42800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.377+0000 7fa4177fe640 10 client.?.objecter ms_handle_connect 0x7fa4380c7170 2026-02-17T21:25:38.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.377+0000 7fa4177fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:38.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f78a9c0b640 10 monclient(hunting): handle_auth_done global_id 4512 payload 274 2026-02-17T21:25:38.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f78a9c0b640 1 -- 10.20.193.5:0/3628251705 >> v2:10.20.193.119:3300/0 conn(0x7f78a4152a60 msgr2=0x7f78a40c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f78a9c0b640 1 --2- 10.20.193.5:0/3628251705 >> v2:10.20.193.119:3300/0 conn(0x7f78a4152a60 0x7f78a40c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f78a9c0b640 1 -- 10.20.193.5:0/3628251705 >> v1:10.20.193.119:6789/0 conn(0x7f78a4073720 legacy=0x7f78a415f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f78a9c0b640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f78a9c0b640 1 monclient: found mon.noname-a 2026-02-17T21:25:38.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f78a9c0b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f78a9c0b640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f78a9c0b640 1 -- 10.20.193.5:0/3628251705 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a40c8e70 con 0x7f78a4152680 2026-02-17T21:25:38.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09f911c640 1 -- 10.20.193.5:0/454906152 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e403c070 con 0x7f09f40d1b60 2026-02-17T21:25:38.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09f911c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09f911c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:38.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09f911c640 10 monclient: dump: 2026-02-17T21:25:38.410 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.410 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.410 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.410 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.410 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.411 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.411 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.411 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.411 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.411 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09f911c640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09f911c640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09f911c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09f911c640 1 -- 10.20.193.5:0/454906152 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e402fb40 con 0x7f09f40d1b60 2026-02-17T21:25:38.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09f911c640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09fc3a9640 5 monclient: authenticate success, global_id 4506 2026-02-17T21:25:38.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09f911c640 1 -- 10.20.193.5:0/454906152 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e4037440 con 0x7f09f40d1b60 2026-02-17T21:25:38.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09fc3a9640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:38.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09fc3a9640 4 set_mon_vals no callback set 2026-02-17T21:25:38.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09f911c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09f911c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:38.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09f911c640 10 monclient: dump: 2026-02-17T21:25:38.411 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.411 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.411 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.411 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.412 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.412 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.412 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.412 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.412 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.412 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09fc3a9640 10 monclient: shutdown 2026-02-17T21:25:38.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09fc3a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09fc3a9640 1 -- 10.20.193.5:0/454906152 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09f40d1b60 msgr2=0x7f09f40d1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09fc3a9640 1 --2- 10.20.193.5:0/454906152 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09f40d1b60 0x7f09f40d1f40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f09f40751e0 tx=0x7f09e402eed0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09fc3a9640 1 -- 10.20.193.5:0/454906152 shutdown_connections 2026-02-17T21:25:38.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09fc3a9640 1 --2- 10.20.193.5:0/454906152 >> v2:10.20.193.135:3300/0 conn(0x7f09f415d950 0x7f09f415dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09fc3a9640 1 --2- 10.20.193.5:0/454906152 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09f40d1b60 0x7f09f40d1f40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09fc3a9640 1 -- 10.20.193.5:0/454906152 >> 10.20.193.5:0/454906152 conn(0x7f09f406d9b0 msgr2=0x7f09f406ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09fc3a9640 1 -- 10.20.193.5:0/454906152 shutdown_connections 2026-02-17T21:25:38.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7f09fc3a9640 1 -- 10.20.193.5:0/454906152 wait complete. 2026-02-17T21:25:38.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa4177fe640 1 -- 10.20.193.5:0/3548995151 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa42800ad50 con 0x7fa4380c7170 2026-02-17T21:25:38.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa4177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa4177fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:38.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa4177fe640 10 monclient: dump: 2026-02-17T21:25:38.413 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.413 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.413 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.413 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.413 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.413 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.413 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.413 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.413 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.413 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa4177fe640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa4177fe640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa4177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa43d3ce640 5 monclient: authenticate success, global_id 4574 2026-02-17T21:25:38.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa43d3ce640 10 monclient: _renew_subs 2026-02-17T21:25:38.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa43d3ce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa43d3ce640 1 -- 10.20.193.5:0/3548995151 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa43815d040 con 0x7fa4380c7170 2026-02-17T21:25:38.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa43d3ce640 10 client.4574.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:38.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa43d3ce640 10 monclient: _renew_subs 2026-02-17T21:25:38.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa43d3ce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa43d3ce640 1 -- 10.20.193.5:0/3548995151 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4381f2880 con 0x7fa4380c7170 2026-02-17T21:25:38.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa43d3ce640 1 librados: init done 2026-02-17T21:25:38.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 1 -- 10.20.193.5:0/4243085932 <== mon.0 v1:10.20.193.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 63494104 0 0) 0x7fa1a0003620 con 0x7fa1bc0d1b60 2026-02-17T21:25:38.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 1 -- 10.20.193.5:0/4243085932 >> v2:10.20.193.119:3300/0 conn(0x7fa1bc15e060 msgr2=0x7fa1bc15c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 1 --2- 10.20.193.5:0/4243085932 >> v2:10.20.193.119:3300/0 conn(0x7fa1bc15e060 0x7fa1bc15c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 1 -- 10.20.193.5:0/4243085932 >> v1:10.20.193.119:6789/0 conn(0x7fa1bc0d1f40 legacy=0x7fa1bc15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 1 monclient: found mon.noname-a-legacy 2026-02-17T21:25:38.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.5:6789/0 2026-02-17T21:25:38.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 1 -- 10.20.193.5:0/4243085932 --> v1:10.20.193.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1bc0c9ea0 con 0x7fa1bc0d1b60 2026-02-17T21:25:38.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 1 -- 10.20.193.5:0/4243085932 <== mon.0 v1:10.20.193.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3880376286 0 0) 0x7fa1a8002f00 con 0x7fa1bc0d1b60 2026-02-17T21:25:38.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T21:25:38.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 10 monclient: dump: 2026-02-17T21:25:38.415 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.415 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.415 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.415 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.415 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.416 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.416 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.416 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.416 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.416 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] but i'm connected to v1:10.20.193.5:6789/0, reconnecting 2026-02-17T21:25:38.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 1 -- 10.20.193.5:0/4243085932 >> v1:10.20.193.5:6789/0 conn(0x7fa1bc0d1b60 legacy=0x7fa1bc0c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:25:38.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 1 --2- 10.20.193.5:0/4243085932 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa1a0003ba0 0x7fa1a0003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 10 monclient(hunting): picked mon.c con 0x7fa1a0003ba0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:38.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 1 --2- 10.20.193.5:0/4243085932 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa1a0004900 0x7fa1a0004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 10 monclient(hunting): picked mon.a con 0x7fa1a0004900 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:38.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 1 --2- 10.20.193.5:0/4243085932 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa1a0005510 0x7fa1a000bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 10 monclient(hunting): picked mon.b con 0x7fa1a0005510 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:38.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 1 -- 10.20.193.5:0/4243085932 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa1bc15cd80 con 0x7fa1a0004900 2026-02-17T21:25:38.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 1 -- 10.20.193.5:0/4243085932 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a000c450 con 0x7fa1a0005510 2026-02-17T21:25:38.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 1 -- 10.20.193.5:0/4243085932 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a000c650 con 0x7fa1a0003ba0 2026-02-17T21:25:38.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.378+0000 7fa1baffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:25:38.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f09fc3a9640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f09fc3a9640 10 monclient: monmap: 2026-02-17T21:25:38.417 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.417 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:38.417 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:38.417 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:38.417 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.417 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.417 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:38.417 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:38.417 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:38.417 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7fa43d3ce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7fa43d3ce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f09fc3a9640 1 librados: starting msgr at 2026-02-17T21:25:38.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f09fc3a9640 1 librados: starting objecter 2026-02-17T21:25:38.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7fa43d3ce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7fa43d3ce640 1 -- 10.20.193.5:0/3548995151 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4380c7550 con 0x7fa4380c7170 2026-02-17T21:25:38.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f09fc3a9640 1 Processor -- start 2026-02-17T21:25:38.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f09fc3a9640 1 -- start start 2026-02-17T21:25:38.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f09fc3a9640 1 librados: setting wanted keys 2026-02-17T21:25:38.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f09fc3a9640 1 librados: calling monclient init 2026-02-17T21:25:38.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f09fc3a9640 10 monclient: init 2026-02-17T21:25:38.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7fa4177fe640 1 -- 10.20.193.5:0/3548995151 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa428003c30 con 0x7fa4380c7170 2026-02-17T21:25:38.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7fa4177fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7fa4177fe640 1 -- 10.20.193.5:0/3548995151 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4280050d0 con 0x7fa4380c7170 2026-02-17T21:25:38.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7fa4177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7fa4177fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:38.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7fa4177fe640 10 monclient: dump: 2026-02-17T21:25:38.419 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.419 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.419 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.419 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.419 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.419 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.419 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.419 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.419 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.419 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7fa4357fa640 4 set_mon_vals no callback set 2026-02-17T21:25:38.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f09fc3a9640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f09fc3a9640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:25:38.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f09fc3a9640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f09f40d1b60 0x7f09f40cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f09fc3a9640 10 monclient(hunting): picked mon.noname-c con 0x7f09f40d1b60 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:38.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f09fc3a9640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f09f415c840 0x7f09f41f1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f09fc3a9640 10 monclient(hunting): picked mon.noname-b con 0x7f09f415c840 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:38.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f09fc3a9640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09f415d950 0x7f09f41f19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f09fc3a9640 10 monclient(hunting): picked mon.noname-a con 0x7f09f415d950 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:38.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f09fc3a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f09fc3a9640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f09f40ca180 con 0x7f09f415d950 2026-02-17T21:25:38.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f09fc3a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f09fc3a9640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f09f40c9ea0 con 0x7f09f415c840 2026-02-17T21:25:38.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f78a9c0b640 1 --2- 10.20.193.5:0/3628251705 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f78a4152680 0x7f78a4076230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f78a40c4f60 tx=0x7f789402ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35cbd496daeacb server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f09fc3a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f09fc3a9640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f09f415cc90 con 0x7f09f40d1b60 2026-02-17T21:25:38.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f09fc3a9640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.379+0000 7f09fc3a9640 10 monclient(hunting): authenticate will time out at 1043.944953s 2026-02-17T21:25:38.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.382+0000 7f444affd640 1 -- 10.20.193.5:0/3586122047 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f4454023080 con 0x7f44640d1b60 2026-02-17T21:25:38.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.382+0000 7fa1bb7fe640 1 --2- 10.20.193.5:0/4243085932 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa1a0004900 0x7fa1a0004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.383+0000 7f444affd640 1 --2- 10.20.193.5:0/3586122047 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4434079280 0x7f443407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.383+0000 7f4469cf2640 1 --2- 10.20.193.5:0/3586122047 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4434079280 0x7f443407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.383+0000 7fa1bb7fe640 10 monclient(hunting): get_auth_request con 0x7fa1a0004900 auth_method 0 2026-02-17T21:25:38.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.383+0000 7fa1bb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.383+0000 7f4469cf2640 10 monclient: get_auth_request con 0x7f4434079280 auth_method 0 2026-02-17T21:25:38.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.383+0000 7fa1bb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.383+0000 7fa1bb7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:25:38.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.383+0000 7f444affd640 10 client.4534.objecter ms_handle_connect 0x7f4434079280 2026-02-17T21:25:38.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.383+0000 7f4469cf2640 1 --2- 10.20.193.5:0/3586122047 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4434079280 0x7f443407b740 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f44641f7bf0 tx=0x7f4458009240 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.383+0000 7fa1bb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.383+0000 7fa1bb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.383+0000 7fa1bb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:25:38.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.383+0000 7f4cd7c5b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T21:25:38.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f4cd7c5b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T21:25:38.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f09fa91f640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09f415d950 0x7f09f41f19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f4cd7c5b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f4cd7c5b640 1 -- 10.20.193.5:0/2419355732 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f4cd014f8d0 con 0x7f4cd00ca040 2026-02-17T21:25:38.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f444affd640 1 -- 10.20.193.5:0/3586122047 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f445405d800 con 0x7f44640d1b60 2026-02-17T21:25:38.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f444affd640 10 client.4534.objecter ms_dispatch2 0x7f4464000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:38.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f444affd640 3 client.4534.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:38.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f444affd640 3 client.4534.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:38.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f444affd640 20 client.4534.objecter dump_active .. 0 homeless 2026-02-17T21:25:38.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78a8c09640 1 -- 10.20.193.5:0/3628251705 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789403c070 con 0x7f78a4152680 2026-02-17T21:25:38.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78a8c09640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78a8c09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:38.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78a8c09640 10 monclient: dump: 2026-02-17T21:25:38.424 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.424 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.424 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.424 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.424 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.424 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.424 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.424 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.424 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78a8c09640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78a8c09640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78a8c09640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78a8c09640 1 -- 10.20.193.5:0/3628251705 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f789402fbd0 con 0x7f78a4152680 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78abe96640 5 monclient: authenticate success, global_id 4512 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78abe96640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78a8c09640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78abe96640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78a8c09640 1 -- 10.20.193.5:0/3628251705 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7894037440 con 0x7f78a4152680 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78abe96640 4 set_mon_vals no callback set 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78a8c09640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78a8c09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78a8c09640 10 monclient: dump: 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78abe96640 10 monclient: shutdown 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78abe96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78abe96640 1 -- 10.20.193.5:0/3628251705 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f78a4152680 msgr2=0x7f78a4076230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78abe96640 1 --2- 10.20.193.5:0/3628251705 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f78a4152680 0x7f78a4076230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f78a40c4f60 tx=0x7f789402ef60 comp rx=0 tx=0).stop 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78abe96640 1 -- 10.20.193.5:0/3628251705 shutdown_connections 2026-02-17T21:25:38.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78abe96640 1 --2- 10.20.193.5:0/3628251705 >> v2:10.20.193.119:3300/0 conn(0x7f78a4152a60 0x7f78a40c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78abe96640 1 --2- 10.20.193.5:0/3628251705 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f78a4152680 0x7f78a4076230 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78abe96640 1 -- 10.20.193.5:0/3628251705 >> 10.20.193.5:0/3628251705 conn(0x7f78a40ca740 msgr2=0x7f78a40cab50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78abe96640 1 -- 10.20.193.5:0/3628251705 shutdown_connections 2026-02-17T21:25:38.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78abe96640 1 -- 10.20.193.5:0/3628251705 wait complete. 2026-02-17T21:25:38.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78abe96640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.384+0000 7f78abe96640 10 monclient: monmap: 2026-02-17T21:25:38.426 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.426 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:38.426 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:38.426 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:38.426 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.426 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.426 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:38.426 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:38.426 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:38.426 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f78abe96640 1 librados: starting msgr at 2026-02-17T21:25:38.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f78abe96640 1 librados: starting objecter 2026-02-17T21:25:38.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7fa1bb7fe640 10 monclient(hunting): handle_auth_done global_id 4509 payload 293 2026-02-17T21:25:38.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7fa1bb7fe640 1 -- 10.20.193.5:0/4243085932 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa1a0003ba0 msgr2=0x7fa1a0003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7fa1bb7fe640 1 --2- 10.20.193.5:0/4243085932 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa1a0003ba0 0x7fa1a0003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f78abe96640 1 Processor -- start 2026-02-17T21:25:38.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7fa1bb7fe640 1 -- 10.20.193.5:0/4243085932 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa1a0005510 msgr2=0x7fa1a000bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7fa1bb7fe640 1 --2- 10.20.193.5:0/4243085932 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa1a0005510 0x7fa1a000bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7fa1bb7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7fa1bb7fe640 1 monclient: found mon.a 2026-02-17T21:25:38.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7fa1bb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7fa1bb7fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7fa1bb7fe640 1 -- 10.20.193.5:0/4243085932 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a0003620 con 0x7fa1a0004900 2026-02-17T21:25:38.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7fa1bb7fe640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7fa1bb7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7fa1bb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7fa1c0c50640 1 -- 10.20.193.5:0/4243085932 reap_dead start 2026-02-17T21:25:38.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7fa1c26da640 5 monclient: authenticate success, global_id 4509 2026-02-17T21:25:38.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7fa1c26da640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:38.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f09fa91f640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09f415d950 0x7f09f41f19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:58552/0 (socket says 10.20.193.5:58552) 2026-02-17T21:25:38.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f09fa91f640 1 -- 10.20.193.5:0/2183627585 learned_addr learned my addr 10.20.193.5:0/2183627585 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:38.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f09fa91f640 10 monclient(hunting): get_auth_request con 0x7f09f415d950 auth_method 0 2026-02-17T21:25:38.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f09fa91f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f09fa91f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f09fa91f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f78abe96640 1 -- start start 2026-02-17T21:25:38.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f78abe96640 1 librados: setting wanted keys 2026-02-17T21:25:38.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f78abe96640 1 librados: calling monclient init 2026-02-17T21:25:38.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f78abe96640 10 monclient: init 2026-02-17T21:25:38.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f78abe96640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f78abe96640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:25:38.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f78abe96640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f78a4073720 0x7f78a41f7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f78abe96640 10 monclient(hunting): picked mon.noname-b con 0x7f78a4073720 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:38.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f78abe96640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f78a4152680 0x7f78a414b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f78abe96640 10 monclient(hunting): picked mon.noname-a con 0x7f78a4152680 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:38.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f78abe96640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f78a4152a60 0x7f78a41f5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f78abe96640 10 monclient(hunting): picked mon.noname-c con 0x7f78a4152a60 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:38.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f78abe96640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f78abe96640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f78a415d2c0 con 0x7f78a4152680 2026-02-17T21:25:38.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f78abe96640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f78abe96640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f78a40c9430 con 0x7f78a4073720 2026-02-17T21:25:38.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f78abe96640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f78abe96640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f78a40cb480 con 0x7f78a4152a60 2026-02-17T21:25:38.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f78abe96640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.385+0000 7f78abe96640 10 monclient(hunting): authenticate will time out at 1043.950671s 2026-02-17T21:25:38.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.386+0000 7f09fa91f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.386+0000 7f09fa91f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.386+0000 7f09fa91f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.387+0000 7f09fa91f640 10 monclient(hunting): handle_auth_done global_id 4515 payload 824 2026-02-17T21:25:38.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.387+0000 7f09fa91f640 1 -- 10.20.193.5:0/2183627585 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f09f40d1b60 msgr2=0x7f09f40cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.387+0000 7f09fa91f640 1 --2- 10.20.193.5:0/2183627585 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f09f40d1b60 0x7f09f40cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.387+0000 7f09fa91f640 1 -- 10.20.193.5:0/2183627585 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f09f415c840 msgr2=0x7f09f41f1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.387+0000 7f09fa91f640 1 --2- 10.20.193.5:0/2183627585 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f09f415c840 0x7f09f41f1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.387+0000 7f09fa91f640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.387+0000 7f09fa91f640 1 monclient: found mon.noname-a 2026-02-17T21:25:38.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.387+0000 7f09fa91f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.387+0000 7f09fa91f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.387+0000 7f09fa91f640 1 -- 10.20.193.5:0/2183627585 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f41f5690 con 0x7f09f415d950 2026-02-17T21:25:38.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.388+0000 7fa1bb7fe640 1 --2- 10.20.193.5:0/4243085932 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa1a0004900 0x7fa1a0004d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac002f60 tx=0x7fa1ac02ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fec609bcfc57c25 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.388+0000 7f78a940a640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f78a4152680 0x7f78a414b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.389+0000 7f78a940a640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f78a4152680 0x7f78a414b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:58562/0 (socket says 10.20.193.5:58562) 2026-02-17T21:25:38.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.389+0000 7f78a940a640 1 -- 10.20.193.5:0/2731527037 learned_addr learned my addr 10.20.193.5:0/2731527037 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:38.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.389+0000 7f78a940a640 10 monclient(hunting): get_auth_request con 0x7f78a4152680 auth_method 0 2026-02-17T21:25:38.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.389+0000 7f78a940a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.389+0000 7f78a940a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.389+0000 7f78a940a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.389+0000 7f78a940a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.389+0000 7f78a940a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.389+0000 7f78a940a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.389+0000 7f09fa91f640 1 --2- 10.20.193.5:0/2183627585 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09f415d950 0x7f09f41f19d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f09f000efc0 tx=0x7f09f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.389+0000 7f09daffd640 10 client.?.objecter ms_handle_connect 0x7f09f415d950 2026-02-17T21:25:38.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.389+0000 7f09daffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:38.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.390+0000 7f444affd640 1 -- 10.20.193.5:0/3586122047 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f44540617c0 con 0x7f44640d1b60 2026-02-17T21:25:38.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.390+0000 7f444affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.390+0000 7f444affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:38.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.391+0000 7f78a940a640 10 monclient(hunting): handle_auth_done global_id 4518 payload 824 2026-02-17T21:25:38.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.391+0000 7f78a940a640 1 -- 10.20.193.5:0/2731527037 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f78a4152a60 msgr2=0x7f78a41f5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.391+0000 7f78a940a640 1 --2- 10.20.193.5:0/2731527037 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f78a4152a60 0x7f78a41f5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.391+0000 7f78a940a640 1 -- 10.20.193.5:0/2731527037 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f78a4073720 msgr2=0x7f78a41f7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.391+0000 7f78a940a640 1 --2- 10.20.193.5:0/2731527037 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f78a4073720 0x7f78a41f7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.391+0000 7f78a940a640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.391+0000 7f78a940a640 1 monclient: found mon.noname-a 2026-02-17T21:25:38.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.391+0000 7f78a940a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.391+0000 7f78a940a640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.391+0000 7f78a940a640 1 -- 10.20.193.5:0/2731527037 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a414e640 con 0x7f78a4152680 2026-02-17T21:25:38.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.394+0000 7fa1baffd640 1 -- 10.20.193.5:0/4243085932 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac002b30 con 0x7fa1a0004900 2026-02-17T21:25:38.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.394+0000 7fa1baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.394+0000 7fa1baffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:38.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.394+0000 7fa1baffd640 10 monclient: dump: 2026-02-17T21:25:38.432 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.432 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.432 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.432 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.432 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.432 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.432 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.432 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.432 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.432 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.394+0000 7fa1baffd640 1 -- 10.20.193.5:0/4243085932 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1ac033070 con 0x7fa1a0004900 2026-02-17T21:25:38.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.394+0000 7fa1baffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.394+0000 7fa1baffd640 1 -- 10.20.193.5:0/4243085932 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac0054d0 con 0x7fa1a0004900 2026-02-17T21:25:38.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.394+0000 7fa1c26da640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:38.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.394+0000 7fa1c26da640 4 set_mon_vals no callback set 2026-02-17T21:25:38.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.394+0000 7fa1baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.394+0000 7fa1baffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:38.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.394+0000 7fa1baffd640 10 monclient: dump: 2026-02-17T21:25:38.433 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.433 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.433 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.433 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.433 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.433 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.433 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.433 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.433 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.433 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09daffd640 1 -- 10.20.193.5:0/2183627585 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f0018020 con 0x7f09f415d950 2026-02-17T21:25:38.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09daffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:38.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09daffd640 10 monclient: dump: 2026-02-17T21:25:38.433 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.433 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09daffd640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09daffd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09daffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09daffd640 1 -- 10.20.193.5:0/2183627585 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f0014480 con 0x7f09f415d950 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09daffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09daffd640 1 -- 10.20.193.5:0/2183627585 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f0014870 con 0x7f09f415d950 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09daffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09daffd640 10 monclient: dump: 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09fc3a9640 5 monclient: authenticate success, global_id 4515 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09f891b640 4 set_mon_vals no callback set 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09fc3a9640 10 monclient: _renew_subs 2026-02-17T21:25:38.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7fa1c26da640 10 monclient: shutdown 2026-02-17T21:25:38.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7fa1c26da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7fa1c26da640 1 -- 10.20.193.5:0/4243085932 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa1a0004900 msgr2=0x7fa1a0004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09fc3a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09fc3a9640 1 -- 10.20.193.5:0/2183627585 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09f41f5970 con 0x7f09f415d950 2026-02-17T21:25:38.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7fa1c26da640 1 --2- 10.20.193.5:0/4243085932 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa1a0004900 0x7fa1a0004d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac002f60 tx=0x7fa1ac02ecb0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f78a940a640 1 --2- 10.20.193.5:0/2731527037 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f78a4152680 0x7f78a414b230 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f789800b7b0 tx=0x7f789800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f78927fc640 10 client.?.objecter ms_handle_connect 0x7f78a4152680 2026-02-17T21:25:38.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f78927fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:38.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09fc3a9640 10 client.4515.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:38.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09fc3a9640 10 monclient: _renew_subs 2026-02-17T21:25:38.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09fc3a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7fa1c26da640 1 -- 10.20.193.5:0/4243085932 shutdown_connections 2026-02-17T21:25:38.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7fa1c26da640 1 --2- 10.20.193.5:0/4243085932 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa1a0004900 0x7fa1a0004d80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7fa1c26da640 1 -- 10.20.193.5:0/4243085932 >> 10.20.193.5:0/4243085932 conn(0x7fa1bc06d9b0 msgr2=0x7fa1bc06ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09fc3a9640 1 -- 10.20.193.5:0/2183627585 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09f41f5f30 con 0x7f09f415d950 2026-02-17T21:25:38.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09fc3a9640 1 librados: init done 2026-02-17T21:25:38.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7fa1c26da640 1 -- 10.20.193.5:0/4243085932 shutdown_connections 2026-02-17T21:25:38.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7fa1c26da640 1 -- 10.20.193.5:0/4243085932 wait complete. 2026-02-17T21:25:38.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09fc3a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09fc3a9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09fc3a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.395+0000 7f09fc3a9640 1 -- 10.20.193.5:0/2183627585 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09f406e7b0 con 0x7f09f415d950 2026-02-17T21:25:38.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.396+0000 7fa1c26da640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.396+0000 7fa1c26da640 10 monclient: monmap: 2026-02-17T21:25:38.437 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.437 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.396+0000 7fa1c26da640 1 librados: starting msgr at 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.396+0000 7fa1c26da640 1 librados: starting objecter 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.396+0000 7fa1c26da640 1 Processor -- start 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.396+0000 7fa1c26da640 1 -- start start 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.396+0000 7fa1c26da640 1 librados: setting wanted keys 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.396+0000 7fa1c26da640 1 librados: calling monclient init 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.396+0000 7fa1c26da640 10 monclient: init 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.396+0000 7fa1c26da640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.396+0000 7fa1c26da640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.396+0000 7fa1c26da640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa1a0004900 0x7fa1bc0ce590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.396+0000 7fa1c26da640 10 monclient(hunting): picked mon.noname-c con 0x7fa1a0004900 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.396+0000 7fa1c26da640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa1bc14a720 0x7fa1bc1f4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.396+0000 7fa1c26da640 10 monclient(hunting): picked mon.noname-a con 0x7fa1bc14a720 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.396+0000 7fa1c26da640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa1bc1f5500 0x7fa1bc15bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.396+0000 7fa1c26da640 10 monclient(hunting): picked mon.noname-b con 0x7fa1bc1f5500 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.396+0000 7fa1c26da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.396+0000 7fa1c26da640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa1bc15d4c0 con 0x7fa1bc14a720 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.396+0000 7fa1c26da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.396+0000 7fa1c26da640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa1bc0ca460 con 0x7fa1bc1f5500 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.396+0000 7fa1c26da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.396+0000 7fa1c26da640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa1bc06e7b0 con 0x7fa1a0004900 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.396+0000 7fa1c26da640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.396+0000 7fa1c26da640 10 monclient(hunting): authenticate will time out at 1043.961884s 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.399+0000 7fa1c0c50640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa1bc1f5500 0x7fa1bc15bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.399+0000 7fa1c0c50640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa1bc1f5500 0x7fa1bc15bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:60078/0 (socket says 10.20.193.5:60078) 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.399+0000 7fa1c0c50640 1 -- 10.20.193.5:0/1505112149 learned_addr learned my addr 10.20.193.5:0/1505112149 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.399+0000 7fa1c0c50640 10 monclient(hunting): get_auth_request con 0x7fa1bc1f5500 auth_method 0 2026-02-17T21:25:38.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.399+0000 7fa1c0c50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.399+0000 7fa1c0c50640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.399+0000 7fa1c0c50640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.399+0000 7fa1c0c50640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.399+0000 7fa1c0c50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.399+0000 7fa1c0c50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.400+0000 7fa1c0c50640 10 monclient(hunting): handle_auth_done global_id 4537 payload 824 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.400+0000 7fa1c0c50640 1 -- 10.20.193.5:0/1505112149 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa1a0004900 msgr2=0x7fa1bc0ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.400+0000 7fa1c0c50640 1 --2- 10.20.193.5:0/1505112149 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa1a0004900 0x7fa1bc0ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.400+0000 7fa1c0c50640 1 -- 10.20.193.5:0/1505112149 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa1bc14a720 msgr2=0x7fa1bc1f4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.400+0000 7fa1c0c50640 1 --2- 10.20.193.5:0/1505112149 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa1bc14a720 0x7fa1bc1f4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.400+0000 7fa1c0c50640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.400+0000 7fa1c0c50640 1 monclient: found mon.noname-b 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.400+0000 7fa1c0c50640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.400+0000 7fa1c0c50640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.400+0000 7fa1c0c50640 1 -- 10.20.193.5:0/1505112149 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1bc14aba0 con 0x7fa1bc1f5500 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.401+0000 7fa1c0c50640 1 --2- 10.20.193.5:0/1505112149 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa1bc1f5500 0x7fa1bc15bc40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc08e4e0 tx=0x7fa1b000cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.401+0000 7fa1b8ff9640 10 client.?.objecter ms_handle_connect 0x7fa1bc1f5500 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.401+0000 7fa1b8ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.403+0000 7fa1b8ff9640 1 -- 10.20.193.5:0/1505112149 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0017070 con 0x7fa1bc1f5500 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.403+0000 7fa1b8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.403+0000 7fa1b8ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.403+0000 7fa1b8ff9640 10 monclient: dump: 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.403+0000 7fa1b8ff9640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.403+0000 7fa1b8ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.403+0000 7fa1b8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.403+0000 7fa1b8ff9640 1 -- 10.20.193.5:0/1505112149 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b000aa40 con 0x7fa1bc1f5500 2026-02-17T21:25:38.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.403+0000 7fa1b8ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.403+0000 7fa1b8ff9640 1 -- 10.20.193.5:0/1505112149 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0007e60 con 0x7fa1bc1f5500 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.403+0000 7fa1b8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.403+0000 7fa1b8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.403+0000 7fa1b8ff9640 10 monclient: dump: 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.403+0000 7fa1ba7fc640 4 set_mon_vals no callback set 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.403+0000 7fa1c26da640 5 monclient: authenticate success, global_id 4537 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.403+0000 7fa1c26da640 10 monclient: _renew_subs 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.403+0000 7fa1c26da640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.403+0000 7fa1c26da640 1 -- 10.20.193.5:0/1505112149 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1bc14ae80 con 0x7fa1bc1f5500 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.403+0000 7fa1c26da640 10 client.4537.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.403+0000 7fa1c26da640 10 monclient: _renew_subs 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.403+0000 7fa1c26da640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.403+0000 7fa1c26da640 1 -- 10.20.193.5:0/1505112149 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1bc14b440 con 0x7fa1bc1f5500 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.403+0000 7fa1c26da640 1 librados: init done 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.404+0000 7fa1c26da640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.404+0000 7fa1c26da640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.404+0000 7fa1c26da640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.404+0000 7fa1c26da640 1 -- 10.20.193.5:0/1505112149 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1bc0c9b20 con 0x7fa1bc1f5500 2026-02-17T21:25:38.441 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.407+0000 7f09daffd640 1 -- 10.20.193.5:0/2183627585 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f09f0014a10 con 0x7f09f415d950 2026-02-17T21:25:38.441 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.408+0000 7f09daffd640 1 --2- 10.20.193.5:0/2183627585 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f09c40792d0 0x7f09c407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.441 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.408+0000 7f09fa11e640 1 --2- 10.20.193.5:0/2183627585 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f09c40792d0 0x7f09c407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.441 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.408+0000 7f09fa11e640 10 monclient: get_auth_request con 0x7f09c40792d0 auth_method 0 2026-02-17T21:25:38.441 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.409+0000 7f09fa11e640 1 --2- 10.20.193.5:0/2183627585 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f09c40792d0 0x7f09c407b790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f09f408fc80 tx=0x7f09e4031000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.441 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.409+0000 7f09daffd640 10 client.4515.objecter ms_handle_connect 0x7f09c40792d0 2026-02-17T21:25:38.441 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.412+0000 7f78927fc640 1 -- 10.20.193.5:0/2731527037 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7898004480 con 0x7f78a4152680 2026-02-17T21:25:38.441 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.412+0000 7f78927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.441 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.412+0000 7f78927fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:38.441 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.412+0000 7f78927fc640 10 monclient: dump: 2026-02-17T21:25:38.441 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.441 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.441 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.441 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.441 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.441 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.441 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.441 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.441 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.441 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.441 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.412+0000 7f78927fc640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.441 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.412+0000 7f78927fc640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.441 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.412+0000 7f78927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.412+0000 7f78927fc640 1 -- 10.20.193.5:0/2731527037 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7898010070 con 0x7f78a4152680 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.412+0000 7f78abe96640 5 monclient: authenticate success, global_id 4518 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.412+0000 7f78abe96640 10 monclient: _renew_subs 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.412+0000 7f78abe96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.412+0000 7f78abe96640 1 -- 10.20.193.5:0/2731527037 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78a414e920 con 0x7f78a4152680 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.412+0000 7f78927fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.412+0000 7f78927fc640 1 -- 10.20.193.5:0/2731527037 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7898002920 con 0x7f78a4152680 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.412+0000 7f78927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.412+0000 7f78927fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.412+0000 7f78927fc640 10 monclient: dump: 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.412+0000 7f7893fff640 4 set_mon_vals no callback set 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.412+0000 7f78abe96640 10 client.4518.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.412+0000 7f78abe96640 10 monclient: _renew_subs 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.412+0000 7f78abe96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.412+0000 7f78abe96640 1 -- 10.20.193.5:0/2731527037 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78a414eee0 con 0x7f78a4152680 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.412+0000 7f78abe96640 1 librados: init done 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.413+0000 7f78abe96640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.413+0000 7f78abe96640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.413+0000 7f78abe96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.413+0000 7f78abe96640 1 -- 10.20.193.5:0/2731527037 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78a4076c10 con 0x7f78a4152680 2026-02-17T21:25:38.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.416+0000 7fa1b8ff9640 1 -- 10.20.193.5:0/1505112149 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fa1b001b3b0 con 0x7fa1bc1f5500 2026-02-17T21:25:38.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.416+0000 7fa1b8ff9640 1 --2- 10.20.193.5:0/1505112149 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa18c079280 0x7fa18c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.417+0000 7fa1bbfff640 1 --2- 10.20.193.5:0/1505112149 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa18c079280 0x7fa18c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.417+0000 7fa1bbfff640 10 monclient: get_auth_request con 0x7fa18c079280 auth_method 0 2026-02-17T21:25:38.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.417+0000 7fa1bbfff640 1 --2- 10.20.193.5:0/1505112149 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa18c079280 0x7fa18c07b740 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa1a80036e0 tx=0x7fa1a8002e80 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.417+0000 7fa1b8ff9640 10 client.4537.objecter ms_handle_connect 0x7fa18c079280 2026-02-17T21:25:38.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.418+0000 7fa1b8ff9640 1 -- 10.20.193.5:0/1505112149 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fa1b000ae30 con 0x7fa1bc1f5500 2026-02-17T21:25:38.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.418+0000 7fa1b8ff9640 10 client.4537.objecter ms_dispatch2 0x7fa1bc000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:38.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.418+0000 7fa1b8ff9640 3 client.4537.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:38.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.418+0000 7fa1b8ff9640 3 client.4537.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:38.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.418+0000 7fa1b8ff9640 20 client.4537.objecter dump_active .. 0 homeless 2026-02-17T21:25:38.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.459+0000 7f11297ce640 10 monclient: get_monmap_and_config 2026-02-17T21:25:38.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.459+0000 7f11297ce640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.459+0000 7f11297ce640 10 monclient: monmap: 2026-02-17T21:25:38.460 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.460 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.460 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:38.459791+0000 2026-02-17T21:25:38.460 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:38.459791+0000 2026-02-17T21:25:38.460 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.460 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.460 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:38.460 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:38.461 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:38.461 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:38.461 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:38.461 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:38.461 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.459+0000 7f11297ce640 1 Processor -- start 2026-02-17T21:25:38.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.459+0000 7f11297ce640 1 -- start start 2026-02-17T21:25:38.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.459+0000 7f11297ce640 10 monclient: init 2026-02-17T21:25:38.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.460+0000 7f11297ce640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.460+0000 7f11297ce640 10 monclient: _add_conns ranks=[2,1,4,3,0,5] 2026-02-17T21:25:38.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.460+0000 7f11297ce640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f11240c7170 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:38.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.460+0000 7f11297ce640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f11240c7550 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:38.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.460+0000 7f11297ce640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f11240c89c0 0x7f11240c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.460+0000 7f11297ce640 10 monclient(hunting): picked mon.noname-b con 0x7f11240c89c0 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:38.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.460+0000 7f11297ce640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11240c4fd0 con 0x7f11240c7550 2026-02-17T21:25:38.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.460+0000 7f11297ce640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f112415a9a0 con 0x7f11240c7170 2026-02-17T21:25:38.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.460+0000 7f11297ce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.460+0000 7f11297ce640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f11240c8530 con 0x7f11240c89c0 2026-02-17T21:25:38.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.460+0000 7f11297ce640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.460+0000 7f11297ce640 10 monclient(hunting): authenticate will time out at 1044.025132s 2026-02-17T21:25:38.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.474+0000 7f446c77e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T21:25:38.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.474+0000 7f446c77e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T21:25:38.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.474+0000 7f446c77e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.474+0000 7f446c77e640 1 -- 10.20.193.5:0/3586122047 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 12} v 0) -- 0x7f44641597e0 con 0x7f44640d1b60 2026-02-17T21:25:38.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.487+0000 7fa4177fe640 1 -- 10.20.193.5:0/3548995151 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fa428005270 con 0x7fa4380c7170 2026-02-17T21:25:38.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.488+0000 7fa4177fe640 1 --2- 10.20.193.5:0/3548995151 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa404079280 0x7fa40407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.488+0000 7fa436ffd640 1 --2- 10.20.193.5:0/3548995151 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa404079280 0x7fa40407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.488+0000 7fa436ffd640 10 monclient: get_auth_request con 0x7fa404079280 auth_method 0 2026-02-17T21:25:38.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.489+0000 7fa4177fe640 1 -- 10.20.193.5:0/3548995151 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fa4280987e0 con 0x7fa4380c7170 2026-02-17T21:25:38.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.489+0000 7fa4177fe640 10 client.4574.objecter ms_dispatch2 0x7fa438000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:38.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.489+0000 7fa4177fe640 3 client.4574.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:38.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.489+0000 7fa4177fe640 3 client.4574.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:38.491 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.489+0000 7fa4177fe640 20 client.4574.objecter dump_active .. 0 homeless 2026-02-17T21:25:38.491 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.489+0000 7fa4177fe640 10 client.4574.objecter ms_handle_connect 0x7fa404079280 2026-02-17T21:25:38.491 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.489+0000 7fa436ffd640 1 --2- 10.20.193.5:0/3548995151 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa404079280 0x7fa40407b740 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa4380c6e90 tx=0x7fa42c031000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.497+0000 7fa4177fe640 1 -- 10.20.193.5:0/3548995151 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa4280633c0 con 0x7fa4380c7170 2026-02-17T21:25:38.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.497+0000 7fa4177fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.497+0000 7fa4177fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:38.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.498+0000 7f1122ffd640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f11240c7170 0x7f11240c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:47710/0 (socket says 10.20.193.5:47710) 2026-02-17T21:25:38.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.498+0000 7f1122ffd640 1 -- 10.20.193.5:0/1815185281 learned_addr learned my addr 10.20.193.5:0/1815185281 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:38.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.498+0000 7f4cbe7fc640 1 -- 10.20.193.5:0/2419355732 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4cc0062ac0 con 0x7f4cd00ca040 2026-02-17T21:25:38.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.498+0000 7f4cbe7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T21:25:38.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.498+0000 7f4cbe7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:38.500 INFO:teuthology.orchestra.run.trial005.stdout:94489280517 2026-02-17T21:25:38.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.501+0000 7f1121ffb640 1 -- 10.20.193.5:0/1815185281 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1037368565 0 0) 0x7f112415a9a0 con 0x7f11240c7170 2026-02-17T21:25:38.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.501+0000 7f1121ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:25:38.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.501+0000 7f1121ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.501+0000 7f1121ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.501+0000 7f1121ffb640 10 monclient(hunting): my global_id is 4577 2026-02-17T21:25:38.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.501+0000 7f1121ffb640 1 -- 10.20.193.5:0/1815185281 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1110003620 con 0x7f11240c7170 2026-02-17T21:25:38.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.501+0000 7f4cd7c5b640 10 librados: watch_flush enter 2026-02-17T21:25:38.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.501+0000 7f4cd7c5b640 10 librados: watch_flush exit 2026-02-17T21:25:38.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.501+0000 7f4cd7c5b640 20 client.4565.objecter shutdown clearing up homeless session... 2026-02-17T21:25:38.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.501+0000 7f4cd7c5b640 10 client.4565.objecter successfully canceled tick 2026-02-17T21:25:38.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.501+0000 7f4cd7c5b640 1 -- 10.20.193.5:0/2419355732 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4ca0079280 msgr2=0x7f4ca007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.501+0000 7f4cd7c5b640 1 --2- 10.20.193.5:0/2419355732 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4ca0079280 0x7f4ca007b740 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0074f00 tx=0x7f4cc4033000 comp rx=0 tx=0).stop 2026-02-17T21:25:38.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.501+0000 7f4cd7c5b640 10 monclient: shutdown 2026-02-17T21:25:38.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.501+0000 7f4cd7c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.501+0000 7f4cd7c5b640 1 -- 10.20.193.5:0/2419355732 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f4cd00ca040 msgr2=0x7f4cd01e7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.501+0000 7f4cd7c5b640 1 --2- 10.20.193.5:0/2419355732 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f4cd00ca040 0x7f4cd01e7dc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000b570 tx=0x7f4cc000ba40 comp rx=0 tx=0).stop 2026-02-17T21:25:38.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.501+0000 7f4cd7c5b640 1 -- 10.20.193.5:0/2419355732 shutdown_connections 2026-02-17T21:25:38.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.501+0000 7f4cd7c5b640 1 --2- 10.20.193.5:0/2419355732 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4ca0079280 0x7f4ca007b740 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.501+0000 7f4cd7c5b640 1 --2- 10.20.193.5:0/2419355732 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f4cd015fe10 0x7f4cd00cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.501+0000 7f4cd7c5b640 1 --2- 10.20.193.5:0/2419355732 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4cd01560e0 0x7f4cd01f6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.501+0000 7f4cd7c5b640 1 --2- 10.20.193.5:0/2419355732 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f4cd00ca040 0x7f4cd01e7dc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.501+0000 7f4cd7c5b640 1 -- 10.20.193.5:0/2419355732 >> 10.20.193.5:0/2419355732 conn(0x7f4cd0073030 msgr2=0x7f4cd006da20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.501+0000 7f4cd7c5b640 1 -- 10.20.193.5:0/2419355732 shutdown_connections 2026-02-17T21:25:38.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.501+0000 7f4cd7c5b640 1 -- 10.20.193.5:0/2419355732 wait complete. 2026-02-17T21:25:38.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.501+0000 7f4cd7c5b640 1 librados: shutdown 2026-02-17T21:25:38.507 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 1 -- 10.20.193.5:0/1815185281 <== mon.2 v1:10.20.193.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 513359448 0 0) 0x7f1110003620 con 0x7f11240c7170 2026-02-17T21:25:38.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 1 -- 10.20.193.5:0/1815185281 >> v2:10.20.193.119:3300/0 conn(0x7f11240c89c0 msgr2=0x7f11240c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 1 --2- 10.20.193.5:0/1815185281 >> v2:10.20.193.119:3300/0 conn(0x7f11240c89c0 0x7f11240c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 1 -- 10.20.193.5:0/1815185281 >> v1:10.20.193.119:6789/0 conn(0x7f11240c7550 legacy=0x7f11240749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 1 monclient: found mon.noname-c-legacy 2026-02-17T21:25:38.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.135:6789/0 2026-02-17T21:25:38.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 1 -- 10.20.193.5:0/1815185281 --> v1:10.20.193.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11240c5270 con 0x7f11240c7170 2026-02-17T21:25:38.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 1 -- 10.20.193.5:0/1815185281 <== mon.2 v1:10.20.193.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3880376286 0 0) 0x7f1118002f00 con 0x7f11240c7170 2026-02-17T21:25:38.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T21:25:38.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 10 monclient: dump: 2026-02-17T21:25:38.509 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.509 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.509 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.509 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.509 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.509 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.509 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.509 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.509 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.509 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 1 monclient: mon.c has (v2) addrs [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] but i'm connected to v1:10.20.193.135:6789/0, reconnecting 2026-02-17T21:25:38.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 1 -- 10.20.193.5:0/1815185281 >> v1:10.20.193.135:6789/0 conn(0x7f11240c7170 legacy=0x7f11240c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:25:38.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 1 --2- 10.20.193.5:0/1815185281 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1110003ba0 0x7f1110003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 10 monclient(hunting): picked mon.b con 0x7f1110003ba0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:38.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 1 --2- 10.20.193.5:0/1815185281 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1110004900 0x7f1110004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 10 monclient(hunting): picked mon.c con 0x7f1110004900 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:38.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 1 --2- 10.20.193.5:0/1815185281 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1110005510 0x7f111000bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 10 monclient(hunting): picked mon.a con 0x7f1110005510 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:38.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 1 -- 10.20.193.5:0/1815185281 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f11240c8530 con 0x7f1110005510 2026-02-17T21:25:38.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 1 -- 10.20.193.5:0/1815185281 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f111000c450 con 0x7f1110003ba0 2026-02-17T21:25:38.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 1 -- 10.20.193.5:0/1815185281 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f111000c650 con 0x7f1110004900 2026-02-17T21:25:38.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.503+0000 7f1121ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:25:38.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.504+0000 7f11227fc640 1 --2- 10.20.193.5:0/1815185281 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1110004900 0x7f1110004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.504+0000 7f11227fc640 10 monclient(hunting): get_auth_request con 0x7f1110004900 auth_method 0 2026-02-17T21:25:38.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.504+0000 7f11227fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.504+0000 7f11227fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.504+0000 7f11227fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:25:38.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.505+0000 7f11227fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.505+0000 7f11227fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.505+0000 7f11227fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:25:38.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.506+0000 7f11227fc640 10 monclient(hunting): handle_auth_done global_id 4577 payload 293 2026-02-17T21:25:38.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.506+0000 7f11227fc640 1 -- 10.20.193.5:0/1815185281 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1110003ba0 msgr2=0x7f1110003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.506+0000 7f11227fc640 1 --2- 10.20.193.5:0/1815185281 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1110003ba0 0x7f1110003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.506+0000 7f11227fc640 1 -- 10.20.193.5:0/1815185281 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1110005510 msgr2=0x7f111000bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.506+0000 7f11227fc640 1 --2- 10.20.193.5:0/1815185281 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1110005510 0x7f111000bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.506+0000 7f11227fc640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.506+0000 7f11227fc640 1 monclient: found mon.c 2026-02-17T21:25:38.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.506+0000 7f11227fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.506+0000 7f11227fc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.506+0000 7f11227fc640 1 -- 10.20.193.5:0/1815185281 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1110003620 con 0x7f1110004900 2026-02-17T21:25:38.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.506+0000 7f11227fc640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.506+0000 7f11227fc640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.506+0000 7f11227fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.506+0000 7f11297ce640 5 monclient: authenticate success, global_id 4577 2026-02-17T21:25:38.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.506+0000 7f11297ce640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:38.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.506+0000 7f11237fe640 1 -- 10.20.193.5:0/1815185281 reap_dead start 2026-02-17T21:25:38.515 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.506+0000 7f11227fc640 1 --2- 10.20.193.5:0/1815185281 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1110004900 0x7f1110004d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f110c002f60 tx=0x7f110c02ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af4071a4a2cac801 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.515 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.508+0000 7f1121ffb640 1 -- 10.20.193.5:0/1815185281 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110c002b30 con 0x7f1110004900 2026-02-17T21:25:38.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.508+0000 7f1121ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.508+0000 7f1121ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:38.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.508+0000 7f1121ffb640 10 monclient: dump: 2026-02-17T21:25:38.516 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.516 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.516 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.516 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.516 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.516 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.516 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.516 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.516 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.517 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.508+0000 7f1121ffb640 1 -- 10.20.193.5:0/1815185281 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f110c033070 con 0x7f1110004900 2026-02-17T21:25:38.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.508+0000 7f1121ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.508+0000 7f1121ffb640 1 -- 10.20.193.5:0/1815185281 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110c0054d0 con 0x7f1110004900 2026-02-17T21:25:38.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.508+0000 7f11297ce640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:38.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.508+0000 7f1121ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.508+0000 7f11297ce640 4 set_mon_vals no callback set 2026-02-17T21:25:38.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.508+0000 7f1121ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:38.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.508+0000 7f1121ffb640 10 monclient: dump: 2026-02-17T21:25:38.517 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.517 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.517 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.517 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.518 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.518 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.518 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.518 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.518 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.518 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.508+0000 7f11297ce640 10 monclient: shutdown 2026-02-17T21:25:38.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.508+0000 7f11297ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.508+0000 7f11297ce640 1 -- 10.20.193.5:0/1815185281 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1110004900 msgr2=0x7f1110004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.508+0000 7f11297ce640 1 --2- 10.20.193.5:0/1815185281 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1110004900 0x7f1110004d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f110c002f60 tx=0x7f110c02ecb0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.509+0000 7f11297ce640 1 -- 10.20.193.5:0/1815185281 shutdown_connections 2026-02-17T21:25:38.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.509+0000 7f11297ce640 1 --2- 10.20.193.5:0/1815185281 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1110004900 0x7f1110004d80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.509+0000 7f11297ce640 1 -- 10.20.193.5:0/1815185281 >> 10.20.193.5:0/1815185281 conn(0x7f11240c9f40 msgr2=0x7f11240ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.509+0000 7f11297ce640 1 -- 10.20.193.5:0/1815185281 shutdown_connections 2026-02-17T21:25:38.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.509+0000 7f11297ce640 1 -- 10.20.193.5:0/1815185281 wait complete. 2026-02-17T21:25:38.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.509+0000 7f11297ce640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.509+0000 7f11297ce640 10 monclient: monmap: 2026-02-17T21:25:38.519 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.519 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:38.519 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:38.519 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:38.519 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.519 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.519 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:38.519 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:38.519 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:38.519 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.509+0000 7f11297ce640 1 librados: starting msgr at 2026-02-17T21:25:38.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.509+0000 7f11297ce640 1 librados: starting objecter 2026-02-17T21:25:38.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.509+0000 7f11297ce640 1 Processor -- start 2026-02-17T21:25:38.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.509+0000 7f11297ce640 1 -- start start 2026-02-17T21:25:38.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.509+0000 7f11297ce640 1 librados: setting wanted keys 2026-02-17T21:25:38.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.509+0000 7f11297ce640 1 librados: calling monclient init 2026-02-17T21:25:38.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.509+0000 7f11297ce640 10 monclient: init 2026-02-17T21:25:38.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.510+0000 7f11297ce640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.510+0000 7f11297ce640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:25:38.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.510+0000 7f11297ce640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1110004900 0x7f112415d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.510+0000 7f11297ce640 10 monclient(hunting): picked mon.noname-c con 0x7f1110004900 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:38.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.510+0000 7f11297ce640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f112415d800 0x7f11241f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.510+0000 7f11297ce640 10 monclient(hunting): picked mon.noname-b con 0x7f112415d800 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:38.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.510+0000 7f11297ce640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f11241f3730 0x7f1124149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.510+0000 7f11297ce640 10 monclient(hunting): picked mon.noname-a con 0x7f11241f3730 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:38.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.510+0000 7f11297ce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.510+0000 7f11297ce640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f11240c7ee0 con 0x7f11241f3730 2026-02-17T21:25:38.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.510+0000 7f11297ce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.510+0000 7f11297ce640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f11240c5830 con 0x7f112415d800 2026-02-17T21:25:38.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.510+0000 7f11297ce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.510+0000 7f11297ce640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f11240c81c0 con 0x7f1110004900 2026-02-17T21:25:38.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.510+0000 7f11297ce640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.510+0000 7f11297ce640 10 monclient(hunting): authenticate will time out at 1044.075245s 2026-02-17T21:25:38.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.510+0000 7f1122ffd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1110004900 0x7f112415d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.510+0000 7f1122ffd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1110004900 0x7f112415d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:54396/0 (socket says 10.20.193.5:54396) 2026-02-17T21:25:38.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.510+0000 7f1122ffd640 1 -- 10.20.193.5:0/1202708951 learned_addr learned my addr 10.20.193.5:0/1202708951 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:38.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.510+0000 7f1122ffd640 10 monclient(hunting): get_auth_request con 0x7f1110004900 auth_method 0 2026-02-17T21:25:38.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.510+0000 7f1122ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.510+0000 7f1122ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.521 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.510+0000 7f1122ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.522 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.511+0000 7f1122ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.522 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.511+0000 7f1122ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.522 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.511+0000 7f1122ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280517 for osd.5 2026-02-17T21:25:38.523 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.512+0000 7f1122ffd640 10 monclient(hunting): handle_auth_done global_id 4580 payload 824 2026-02-17T21:25:38.523 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.512+0000 7f1122ffd640 1 -- 10.20.193.5:0/1202708951 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f112415d800 msgr2=0x7f11241f31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.512+0000 7f1122ffd640 1 --2- 10.20.193.5:0/1202708951 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f112415d800 0x7f11241f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.512+0000 7f1122ffd640 1 -- 10.20.193.5:0/1202708951 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f11241f3730 msgr2=0x7f1124149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.512+0000 7f1122ffd640 1 --2- 10.20.193.5:0/1202708951 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f11241f3730 0x7f1124149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.512+0000 7f1122ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.512+0000 7f1122ffd640 1 monclient: found mon.noname-c 2026-02-17T21:25:38.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.512+0000 7f1122ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.512+0000 7f1122ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.512+0000 7f1122ffd640 1 -- 10.20.193.5:0/1202708951 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11241f3bc0 con 0x7f1110004900 2026-02-17T21:25:38.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.513+0000 7f1122ffd640 1 --2- 10.20.193.5:0/1202708951 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1110004900 0x7f112415d2c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f111800caa0 tx=0x7f111800cf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.513+0000 7f11037fe640 10 client.?.objecter ms_handle_connect 0x7f1110004900 2026-02-17T21:25:38.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.513+0000 7f11037fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:38.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f09daffd640 1 -- 10.20.193.5:0/2183627585 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f09f005f5e0 con 0x7f09f415d950 2026-02-17T21:25:38.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f09daffd640 10 client.4515.objecter ms_dispatch2 0x7f09f4000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:38.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f09daffd640 3 client.4515.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:38.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f09daffd640 3 client.4515.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:38.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f09daffd640 20 client.4515.objecter dump_active .. 0 homeless 2026-02-17T21:25:38.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f09daffd640 1 -- 10.20.193.5:0/2183627585 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f09f0022020 con 0x7f09f415d950 2026-02-17T21:25:38.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f09daffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f09daffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:38.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f11037fe640 1 -- 10.20.193.5:0/1202708951 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1118004cf0 con 0x7f1110004900 2026-02-17T21:25:38.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f11037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f11037fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:38.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f11037fe640 10 monclient: dump: 2026-02-17T21:25:38.527 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.527 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.527 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.527 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.527 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.527 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.527 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.527 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.527 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.527 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f11037fe640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f11037fe640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f11037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f11037fe640 1 -- 10.20.193.5:0/1202708951 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1118007110 con 0x7f1110004900 2026-02-17T21:25:38.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f11037fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f11037fe640 1 -- 10.20.193.5:0/1202708951 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11180074e0 con 0x7f1110004900 2026-02-17T21:25:38.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f11037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f11037fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:38.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f11217fa640 4 set_mon_vals no callback set 2026-02-17T21:25:38.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f11037fe640 10 monclient: dump: 2026-02-17T21:25:38.528 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.528 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.528 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.528 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.528 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.528 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.528 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.528 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.528 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.528 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f11297ce640 5 monclient: authenticate success, global_id 4580 2026-02-17T21:25:38.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f11297ce640 10 monclient: _renew_subs 2026-02-17T21:25:38.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f11297ce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f11297ce640 1 -- 10.20.193.5:0/1202708951 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f112415c060 con 0x7f1110004900 2026-02-17T21:25:38.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f11297ce640 10 client.4580.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:38.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f11297ce640 10 monclient: _renew_subs 2026-02-17T21:25:38.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f11297ce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f11297ce640 1 -- 10.20.193.5:0/1202708951 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f112415c620 con 0x7f1110004900 2026-02-17T21:25:38.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.516+0000 7f11297ce640 1 librados: init done 2026-02-17T21:25:38.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.517+0000 7f11297ce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.517+0000 7f11297ce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.517+0000 7f11297ce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.517+0000 7f11297ce640 1 -- 10.20.193.5:0/1202708951 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11240c8e70 con 0x7f1110004900 2026-02-17T21:25:38.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.519+0000 7fa1b8ff9640 1 -- 10.20.193.5:0/1505112149 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa1b0021020 con 0x7fa1bc1f5500 2026-02-17T21:25:38.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.519+0000 7fa1b8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.519+0000 7fa1b8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:38.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.523+0000 7f444affd640 1 -- 10.20.193.5:0/3586122047 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 12}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f4454065ac0 con 0x7f44640d1b60 2026-02-17T21:25:38.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.523+0000 7f444affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T21:25:38.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.523+0000 7f444affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:38.530 INFO:teuthology.orchestra.run.trial005.stdout:103079215108 2026-02-17T21:25:38.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.525+0000 7f446c77e640 10 librados: watch_flush enter 2026-02-17T21:25:38.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.525+0000 7f446c77e640 10 librados: watch_flush exit 2026-02-17T21:25:38.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.525+0000 7f446c77e640 20 client.4534.objecter shutdown clearing up homeless session... 2026-02-17T21:25:38.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.525+0000 7f446c77e640 10 client.4534.objecter successfully canceled tick 2026-02-17T21:25:38.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.525+0000 7f446c77e640 1 -- 10.20.193.5:0/3586122047 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4434079280 msgr2=0x7f443407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.525+0000 7f446c77e640 1 --2- 10.20.193.5:0/3586122047 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4434079280 0x7f443407b740 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f44641f7bf0 tx=0x7f4458009240 comp rx=0 tx=0).stop 2026-02-17T21:25:38.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.525+0000 7f446c77e640 10 monclient: shutdown 2026-02-17T21:25:38.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.525+0000 7f446c77e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.525+0000 7f446c77e640 1 -- 10.20.193.5:0/3586122047 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f44640d1b60 msgr2=0x7f44641f4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.525+0000 7f446c77e640 1 --2- 10.20.193.5:0/3586122047 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f44640d1b60 0x7f44641f4d10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f445400b440 tx=0x7f445400b910 comp rx=0 tx=0).stop 2026-02-17T21:25:38.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.525+0000 7f446c77e640 1 -- 10.20.193.5:0/3586122047 shutdown_connections 2026-02-17T21:25:38.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.525+0000 7f446c77e640 1 --2- 10.20.193.5:0/3586122047 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4434079280 0x7f443407b740 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.525+0000 7f446c77e640 1 --2- 10.20.193.5:0/3586122047 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f446415d950 0x7f44641411f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.525+0000 7f446c77e640 1 --2- 10.20.193.5:0/3586122047 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f44640d1f40 0x7f44641f5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.525+0000 7f446c77e640 1 --2- 10.20.193.5:0/3586122047 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f44640d1b60 0x7f44641f4d10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.525+0000 7f446c77e640 1 -- 10.20.193.5:0/3586122047 >> 10.20.193.5:0/3586122047 conn(0x7f446406d9b0 msgr2=0x7f446406b600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.525+0000 7f446c77e640 1 -- 10.20.193.5:0/3586122047 shutdown_connections 2026-02-17T21:25:38.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.525+0000 7f446c77e640 1 -- 10.20.193.5:0/3586122047 wait complete. 2026-02-17T21:25:38.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.525+0000 7f446c77e640 1 librados: shutdown 2026-02-17T21:25:38.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.528+0000 7f11037fe640 1 -- 10.20.193.5:0/1202708951 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f111800a610 con 0x7f1110004900 2026-02-17T21:25:38.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.528+0000 7f11037fe640 1 --2- 10.20.193.5:0/1202708951 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f10f0079280 0x7f10f007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.528+0000 7f11227fc640 1 --2- 10.20.193.5:0/1202708951 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f10f0079280 0x7f10f007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.528+0000 7f11227fc640 10 monclient: get_auth_request con 0x7f10f0079280 auth_method 0 2026-02-17T21:25:38.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.529+0000 7f11037fe640 1 -- 10.20.193.5:0/1202708951 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f1118007680 con 0x7f1110004900 2026-02-17T21:25:38.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.529+0000 7f11037fe640 10 client.4580.objecter ms_dispatch2 0x7f1124000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:38.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.529+0000 7f11037fe640 3 client.4580.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:38.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.529+0000 7f11037fe640 3 client.4580.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:38.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.529+0000 7f11227fc640 1 --2- 10.20.193.5:0/1202708951 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f10f0079280 0x7f10f007b740 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f110c037000 tx=0x7f110c031000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.529+0000 7f11037fe640 20 client.4580.objecter dump_active .. 0 homeless 2026-02-17T21:25:38.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.529+0000 7f11037fe640 10 client.4580.objecter ms_handle_connect 0x7f10f0079280 2026-02-17T21:25:38.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215109 got 103079215108 for osd.12 2026-02-17T21:25:38.577 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-17T21:25:38.582 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2026-02-17T21:25:38.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.588+0000 7fa43d3ce640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T21:25:38.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.588+0000 7fa43d3ce640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T21:25:38.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.588+0000 7fa43d3ce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.588+0000 7fa43d3ce640 1 -- 10.20.193.5:0/3548995151 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fa43814ed60 con 0x7fa4380c7170 2026-02-17T21:25:38.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.601+0000 7f09fc3a9640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T21:25:38.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.601+0000 7f09fc3a9640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T21:25:38.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.601+0000 7f09fc3a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.601+0000 7f09fc3a9640 1 -- 10.20.193.5:0/2183627585 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f09f4150010 con 0x7f09f415d950 2026-02-17T21:25:38.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.604+0000 7fa1c26da640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T21:25:38.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.604+0000 7fa1c26da640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T21:25:38.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.604+0000 7fa1c26da640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.604+0000 7fa1c26da640 1 -- 10.20.193.5:0/1505112149 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 13} v 0) -- 0x7fa1bc1f4d20 con 0x7fa1bc1f5500 2026-02-17T21:25:38.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.606+0000 7fa1b8ff9640 1 -- 10.20.193.5:0/1505112149 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 13}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fa1b0062010 con 0x7fa1bc1f5500 2026-02-17T21:25:38.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.606+0000 7fa1b8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T21:25:38.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.606+0000 7fa1b8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:38.608 INFO:teuthology.orchestra.run.trial005.stdout:111669149701 2026-02-17T21:25:38.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.608+0000 7fa1c26da640 10 librados: watch_flush enter 2026-02-17T21:25:38.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.608+0000 7fa1c26da640 10 librados: watch_flush exit 2026-02-17T21:25:38.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.608+0000 7fa1c26da640 20 client.4537.objecter shutdown clearing up homeless session... 2026-02-17T21:25:38.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.608+0000 7fa1c26da640 10 client.4537.objecter successfully canceled tick 2026-02-17T21:25:38.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.608+0000 7fa1c26da640 1 -- 10.20.193.5:0/1505112149 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa18c079280 msgr2=0x7fa18c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.608+0000 7fa1c26da640 1 --2- 10.20.193.5:0/1505112149 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa18c079280 0x7fa18c07b740 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa1a80036e0 tx=0x7fa1a8002e80 comp rx=0 tx=0).stop 2026-02-17T21:25:38.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.608+0000 7fa1c26da640 10 monclient: shutdown 2026-02-17T21:25:38.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.608+0000 7fa1c26da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.608+0000 7fa1c26da640 1 -- 10.20.193.5:0/1505112149 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa1bc1f5500 msgr2=0x7fa1bc15bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.608+0000 7fa1c26da640 1 --2- 10.20.193.5:0/1505112149 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa1bc1f5500 0x7fa1bc15bc40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc08e4e0 tx=0x7fa1b000cc10 comp rx=0 tx=0).stop 2026-02-17T21:25:38.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.608+0000 7fa1c26da640 1 -- 10.20.193.5:0/1505112149 shutdown_connections 2026-02-17T21:25:38.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.608+0000 7fa1c26da640 1 --2- 10.20.193.5:0/1505112149 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa18c079280 0x7fa18c07b740 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.608+0000 7fa1c26da640 1 --2- 10.20.193.5:0/1505112149 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa1bc1f5500 0x7fa1bc15bc40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.608+0000 7fa1c26da640 1 --2- 10.20.193.5:0/1505112149 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa1bc14a720 0x7fa1bc1f4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.608+0000 7fa1c26da640 1 --2- 10.20.193.5:0/1505112149 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa1a0004900 0x7fa1bc0ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.608+0000 7fa1c26da640 1 -- 10.20.193.5:0/1505112149 >> 10.20.193.5:0/1505112149 conn(0x7fa1bc06d9b0 msgr2=0x7fa1bc0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.608+0000 7fa1c26da640 1 -- 10.20.193.5:0/1505112149 shutdown_connections 2026-02-17T21:25:38.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.608+0000 7fa1c26da640 1 -- 10.20.193.5:0/1505112149 wait complete. 2026-02-17T21:25:38.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.608+0000 7fa1c26da640 1 librados: shutdown 2026-02-17T21:25:38.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149702 got 111669149701 for osd.13 2026-02-17T21:25:38.618 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-17T21:25:38.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.626+0000 7f11037fe640 1 -- 10.20.193.5:0/1202708951 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1118062bf0 con 0x7f1110004900 2026-02-17T21:25:38.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.626+0000 7f11037fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.626+0000 7f11037fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:38.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.629+0000 7fa4177fe640 1 -- 10.20.193.5:0/3548995151 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fa428062cc0 con 0x7fa4380c7170 2026-02-17T21:25:38.631 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.629+0000 7fa4177fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T21:25:38.631 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.629+0000 7fa4177fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:38.631 INFO:teuthology.orchestra.run.trial005.stdout:120259084294 2026-02-17T21:25:38.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.631+0000 7fa43d3ce640 10 librados: watch_flush enter 2026-02-17T21:25:38.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.631+0000 7fa43d3ce640 10 librados: watch_flush exit 2026-02-17T21:25:38.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.631+0000 7fa43d3ce640 20 client.4574.objecter shutdown clearing up homeless session... 2026-02-17T21:25:38.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.631+0000 7fa43d3ce640 10 client.4574.objecter successfully canceled tick 2026-02-17T21:25:38.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.631+0000 7fa43d3ce640 1 -- 10.20.193.5:0/3548995151 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa404079280 msgr2=0x7fa40407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.631+0000 7fa43d3ce640 1 --2- 10.20.193.5:0/3548995151 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa404079280 0x7fa40407b740 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa4380c6e90 tx=0x7fa42c031000 comp rx=0 tx=0).stop 2026-02-17T21:25:38.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.631+0000 7fa43d3ce640 10 monclient: shutdown 2026-02-17T21:25:38.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.631+0000 7fa43d3ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.631+0000 7fa43d3ce640 1 -- 10.20.193.5:0/3548995151 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa4380c7170 msgr2=0x7fa43815aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.631+0000 7fa43d3ce640 1 --2- 10.20.193.5:0/3548995151 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa4380c7170 0x7fa43815aec0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa42800cbc0 tx=0x7fa42800a430 comp rx=0 tx=0).stop 2026-02-17T21:25:38.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.631+0000 7fa43d3ce640 1 -- 10.20.193.5:0/3548995151 shutdown_connections 2026-02-17T21:25:38.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.631+0000 7fa43d3ce640 1 --2- 10.20.193.5:0/3548995151 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa404079280 0x7fa40407b740 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.631+0000 7fa43d3ce640 1 --2- 10.20.193.5:0/3548995151 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa4380c7170 0x7fa43815aec0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.631+0000 7fa43d3ce640 1 --2- 10.20.193.5:0/3548995151 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa4380c4d10 0x7fa4381f38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.631+0000 7fa43d3ce640 1 --2- 10.20.193.5:0/3548995151 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa4380c48c0 0x7fa4381f3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.631+0000 7fa43d3ce640 1 -- 10.20.193.5:0/3548995151 >> 10.20.193.5:0/3548995151 conn(0x7fa4380c9f40 msgr2=0x7fa438157940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.631+0000 7fa43d3ce640 1 -- 10.20.193.5:0/3548995151 shutdown_connections 2026-02-17T21:25:38.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.631+0000 7fa43d3ce640 1 -- 10.20.193.5:0/3548995151 wait complete. 2026-02-17T21:25:38.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.631+0000 7fa43d3ce640 1 librados: shutdown 2026-02-17T21:25:38.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.632+0000 7f78927fc640 1 -- 10.20.193.5:0/2731527037 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f789801d030 con 0x7f78a4152680 2026-02-17T21:25:38.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.632+0000 7f78927fc640 1 --2- 10.20.193.5:0/2731527037 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f78740792d0 0x7f787407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.632+0000 7f78a9c0b640 1 --2- 10.20.193.5:0/2731527037 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f78740792d0 0x7f787407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.632+0000 7f78a9c0b640 10 monclient: get_auth_request con 0x7f78740792d0 auth_method 0 2026-02-17T21:25:38.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.633+0000 7f78927fc640 10 client.4518.objecter ms_handle_connect 0x7f78740792d0 2026-02-17T21:25:38.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.633+0000 7f78a9c0b640 1 --2- 10.20.193.5:0/2731527037 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f78740792d0 0x7f787407b790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f78a4071670 tx=0x7f7894031000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084295 got 120259084294 for osd.10 2026-02-17T21:25:38.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.641+0000 7f78927fc640 1 -- 10.20.193.5:0/2731527037 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f789801de10 con 0x7f78a4152680 2026-02-17T21:25:38.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.641+0000 7f78927fc640 10 client.4518.objecter ms_dispatch2 0x7f78a4000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:38.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.641+0000 7f78927fc640 3 client.4518.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:38.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.641+0000 7f78927fc640 3 client.4518.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:38.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.641+0000 7f78927fc640 20 client.4518.objecter dump_active .. 0 homeless 2026-02-17T21:25:38.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.641+0000 7f78927fc640 1 -- 10.20.193.5:0/2731527037 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7898024080 con 0x7f78a4152680 2026-02-17T21:25:38.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.641+0000 7f78927fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.641+0000 7f78927fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:38.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.643+0000 7f9bfafa1640 10 monclient: get_monmap_and_config 2026-02-17T21:25:38.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.643+0000 7f9bfafa1640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.643+0000 7f9bfafa1640 10 monclient: monmap: 2026-02-17T21:25:38.645 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.645 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.645 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:38.644228+0000 2026-02-17T21:25:38.645 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:38.644228+0000 2026-02-17T21:25:38.645 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.645 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.645 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:38.646 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:38.646 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:38.646 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:38.646 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:38.646 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:38.646 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.644+0000 7f9bfafa1640 1 Processor -- start 2026-02-17T21:25:38.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.644+0000 7f9bfafa1640 1 -- start start 2026-02-17T21:25:38.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.644+0000 7f9bfafa1640 10 monclient: init 2026-02-17T21:25:38.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.644+0000 7f9bfafa1640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.644+0000 7f9bfafa1640 10 monclient: _add_conns ranks=[3,0,5,2,1,4] 2026-02-17T21:25:38.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.644+0000 7f9bfafa1640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f9bf40d1b60 0x7f9bf40d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.644+0000 7f9bfafa1640 10 monclient(hunting): picked mon.noname-a con 0x7f9bf40d1b60 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:38.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.644+0000 7f9bfafa1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9bf415c840 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:38.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.644+0000 7f9bfafa1640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f9bf415d950 0x7f9bf415dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.644+0000 7f9bfafa1640 10 monclient(hunting): picked mon.noname-c con 0x7f9bf415d950 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:38.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.644+0000 7f9bfafa1640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bf415e2d0 con 0x7f9bf415c840 2026-02-17T21:25:38.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.644+0000 7f9bfafa1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.644+0000 7f9bfafa1640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9bf40ca460 con 0x7f9bf40d1b60 2026-02-17T21:25:38.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.644+0000 7f9bfafa1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.644+0000 7f9bfafa1640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f9bf415d4c0 con 0x7f9bf415d950 2026-02-17T21:25:38.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.644+0000 7f9bfafa1640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.644+0000 7f9bfafa1640 10 monclient(hunting): authenticate will time out at 1044.209638s 2026-02-17T21:25:38.650 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.646+0000 7f9bf9517640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f9bf415d950 0x7f9bf415dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.650 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.646+0000 7f9bf9517640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f9bf415d950 0x7f9bf415dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:54412/0 (socket says 10.20.193.5:54412) 2026-02-17T21:25:38.650 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.646+0000 7f9bf9517640 1 -- 10.20.193.5:0/2511191151 learned_addr learned my addr 10.20.193.5:0/2511191151 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:38.650 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.646+0000 7f9bf9517640 10 monclient(hunting): get_auth_request con 0x7f9bf415d950 auth_method 0 2026-02-17T21:25:38.650 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.646+0000 7f9bf9517640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.650 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.646+0000 7f9bf9517640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.650 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.646+0000 7f9bf9517640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.650 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.646+0000 7f9bf9517640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.650 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.646+0000 7f9bf9517640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.650 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.646+0000 7f9bf9517640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.651 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T21:25:38.656 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.647+0000 7f9bf9517640 10 monclient(hunting): handle_auth_done global_id 4583 payload 274 2026-02-17T21:25:38.656 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.647+0000 7f9bf9517640 1 -- 10.20.193.5:0/2511191151 >> v2:10.20.193.5:3300/0 conn(0x7f9bf40d1b60 msgr2=0x7f9bf40d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.656 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.647+0000 7f9bf9517640 1 --2- 10.20.193.5:0/2511191151 >> v2:10.20.193.5:3300/0 conn(0x7f9bf40d1b60 0x7f9bf40d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.656 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.647+0000 7f9bf9517640 1 -- 10.20.193.5:0/2511191151 >> v1:10.20.193.5:6789/0 conn(0x7f9bf415c840 legacy=0x7f9bf40c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.656 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.647+0000 7f9bf9517640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.656 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.647+0000 7f9bf9517640 1 monclient: found mon.noname-c 2026-02-17T21:25:38.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.647+0000 7f9bf9517640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.647+0000 7f9bf9517640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.647+0000 7f9bf9517640 1 -- 10.20.193.5:0/2511191151 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf40c98e0 con 0x7f9bf415d950 2026-02-17T21:25:38.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.648+0000 7f9bf9517640 1 --2- 10.20.193.5:0/2511191151 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9bf415d950 0x7f9bf415dd90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40751e0 tx=0x7f9bf002f270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f666951f37fa087d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.649+0000 7f9beb7fe640 1 -- 10.20.193.5:0/2511191151 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf002fcd0 con 0x7f9bf415d950 2026-02-17T21:25:38.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.649+0000 7f9beb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.649+0000 7f9beb7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:38.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.649+0000 7f9beb7fe640 10 monclient: dump: 2026-02-17T21:25:38.657 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.657 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.657 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.657 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.658 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.658 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.658 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.658 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.658 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.658 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.649+0000 7f9beb7fe640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.649+0000 7f9beb7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.649+0000 7f9beb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.649+0000 7f9bfafa1640 5 monclient: authenticate success, global_id 4583 2026-02-17T21:25:38.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.649+0000 7f9bfafa1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:38.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.650+0000 7f9beb7fe640 1 -- 10.20.193.5:0/2511191151 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf00373f0 con 0x7f9bf415d950 2026-02-17T21:25:38.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.650+0000 7f9beb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.650+0000 7f9beb7fe640 1 -- 10.20.193.5:0/2511191151 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf00377c0 con 0x7f9bf415d950 2026-02-17T21:25:38.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.650+0000 7f9bfafa1640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:38.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.650+0000 7f9bfafa1640 4 set_mon_vals no callback set 2026-02-17T21:25:38.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.650+0000 7f9beb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.650+0000 7f9beb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:38.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.650+0000 7f9beb7fe640 10 monclient: dump: 2026-02-17T21:25:38.659 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.659 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.659 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.660 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.660 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.660 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.660 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.660 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.660 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.660 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.650+0000 7f9bfafa1640 10 monclient: shutdown 2026-02-17T21:25:38.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.650+0000 7f9bfafa1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.650+0000 7f9bfafa1640 1 -- 10.20.193.5:0/2511191151 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9bf415d950 msgr2=0x7f9bf415dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.650+0000 7f9bfafa1640 1 --2- 10.20.193.5:0/2511191151 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9bf415d950 0x7f9bf415dd90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40751e0 tx=0x7f9bf002f270 comp rx=0 tx=0).stop 2026-02-17T21:25:38.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.650+0000 7f9bfafa1640 1 -- 10.20.193.5:0/2511191151 shutdown_connections 2026-02-17T21:25:38.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.650+0000 7f9bfafa1640 1 --2- 10.20.193.5:0/2511191151 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9bf415d950 0x7f9bf415dd90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.650+0000 7f9bfafa1640 1 --2- 10.20.193.5:0/2511191151 >> v2:10.20.193.5:3300/0 conn(0x7f9bf40d1b60 0x7f9bf40d1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.650+0000 7f9bfafa1640 1 -- 10.20.193.5:0/2511191151 >> 10.20.193.5:0/2511191151 conn(0x7f9bf406d9b0 msgr2=0x7f9bf406ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.650+0000 7f9bfafa1640 1 -- 10.20.193.5:0/2511191151 shutdown_connections 2026-02-17T21:25:38.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.650+0000 7f9bfafa1640 1 -- 10.20.193.5:0/2511191151 wait complete. 2026-02-17T21:25:38.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.651+0000 7f9bfafa1640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.651+0000 7f9bfafa1640 10 monclient: monmap: 2026-02-17T21:25:38.661 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.661 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:38.661 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:38.662 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:38.662 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.662 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.662 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:38.662 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:38.662 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:38.662 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.651+0000 7f9bfafa1640 1 librados: starting msgr at 2026-02-17T21:25:38.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.651+0000 7f9bfafa1640 1 librados: starting objecter 2026-02-17T21:25:38.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.651+0000 7f9bfafa1640 1 Processor -- start 2026-02-17T21:25:38.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.651+0000 7f9bfafa1640 1 -- start start 2026-02-17T21:25:38.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.651+0000 7f9bfafa1640 1 librados: setting wanted keys 2026-02-17T21:25:38.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.651+0000 7f9bfafa1640 1 librados: calling monclient init 2026-02-17T21:25:38.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.651+0000 7f9bfafa1640 10 monclient: init 2026-02-17T21:25:38.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bfafa1640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bfafa1640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:25:38.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bfafa1640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9bf40d1b60 0x7f9bf4148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bfafa1640 10 monclient(hunting): picked mon.noname-b con 0x7f9bf40d1b60 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:38.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bfafa1640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9bf415c840 0x7f9bf40d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bfafa1640 10 monclient(hunting): picked mon.noname-a con 0x7f9bf415c840 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:38.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bfafa1640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9bf415d950 0x7f9bf41570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bfafa1640 10 monclient(hunting): picked mon.noname-c con 0x7f9bf415d950 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:38.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bfafa1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bfafa1640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf40ca180 con 0x7f9bf415c840 2026-02-17T21:25:38.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bfafa1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bfafa1640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf40c9ea0 con 0x7f9bf40d1b60 2026-02-17T21:25:38.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bfafa1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bfafa1640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf415cc90 con 0x7f9bf415d950 2026-02-17T21:25:38.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bfafa1640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bfafa1640 10 monclient(hunting): authenticate will time out at 1044.217319s 2026-02-17T21:25:38.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bf9517640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9bf415d950 0x7f9bf41570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bf8d16640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9bf40d1b60 0x7f9bf4148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bf9517640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9bf415d950 0x7f9bf41570c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:54420/0 (socket says 10.20.193.5:54420) 2026-02-17T21:25:38.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bf9517640 1 -- 10.20.193.5:0/929887899 learned_addr learned my addr 10.20.193.5:0/929887899 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:38.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bf9517640 10 monclient(hunting): get_auth_request con 0x7f9bf415d950 auth_method 0 2026-02-17T21:25:38.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bf9517640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bf9517640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bf9517640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bf8d16640 10 monclient(hunting): get_auth_request con 0x7f9bf40d1b60 auth_method 0 2026-02-17T21:25:38.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bf8d16640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bf8d16640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.652+0000 7f9bf8d16640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.653+0000 7f9bf9517640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.653+0000 7f9bf9517640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.653+0000 7f9bf9517640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.653+0000 7f9bf8d16640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.653+0000 7f9bf8d16640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.653+0000 7f9bf8d16640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.654+0000 7f9bf9517640 10 monclient(hunting): handle_auth_done global_id 4586 payload 824 2026-02-17T21:25:38.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.654+0000 7f9bf9517640 1 -- 10.20.193.5:0/929887899 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9bf40d1b60 msgr2=0x7f9bf4148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.654+0000 7f9bf9517640 1 --2- 10.20.193.5:0/929887899 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9bf40d1b60 0x7f9bf4148590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.654+0000 7f9bf9517640 1 -- 10.20.193.5:0/929887899 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9bf415c840 msgr2=0x7f9bf40d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.654+0000 7f9bf9517640 1 --2- 10.20.193.5:0/929887899 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9bf415c840 0x7f9bf40d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.654+0000 7f9bf9517640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.654+0000 7f9bf9517640 1 monclient: found mon.noname-c 2026-02-17T21:25:38.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.654+0000 7f9bf9517640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.654+0000 7f9bf9517640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.654+0000 7f9bf9517640 1 -- 10.20.193.5:0/929887899 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf4157bb0 con 0x7f9bf415d950 2026-02-17T21:25:38.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.655+0000 7f9bf9517640 1 --2- 10.20.193.5:0/929887899 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9bf415d950 0x7f9bf41570c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0039040 tx=0x7f9bf0004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.655+0000 7f9be97fa640 10 client.?.objecter ms_handle_connect 0x7f9bf415d950 2026-02-17T21:25:38.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.655+0000 7f9be97fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:38.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7f9be97fa640 1 -- 10.20.193.5:0/929887899 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0046020 con 0x7f9bf415d950 2026-02-17T21:25:38.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7f9be97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7f9be97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:38.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7f9be97fa640 10 monclient: dump: 2026-02-17T21:25:38.669 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.669 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.669 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.669 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.669 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.669 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.669 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.669 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.669 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.669 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7f9be97fa640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7f9be97fa640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7f9be97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7f9be97fa640 1 -- 10.20.193.5:0/929887899 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf0041450 con 0x7f9bf415d950 2026-02-17T21:25:38.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7f9be97fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7f9be97fa640 1 -- 10.20.193.5:0/929887899 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0037e60 con 0x7f9bf415d950 2026-02-17T21:25:38.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7f9be97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7f9be97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:38.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7f9beaffd640 4 set_mon_vals no callback set 2026-02-17T21:25:38.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7f9be97fa640 10 monclient: dump: 2026-02-17T21:25:38.670 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.670 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.670 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.670 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.670 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.671 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.671 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.671 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.671 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.671 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7f9bfafa1640 5 monclient: authenticate success, global_id 4586 2026-02-17T21:25:38.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7f9bfafa1640 10 monclient: _renew_subs 2026-02-17T21:25:38.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7f9bfafa1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7f9bfafa1640 1 -- 10.20.193.5:0/929887899 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bf4157e90 con 0x7f9bf415d950 2026-02-17T21:25:38.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7f9bfafa1640 10 client.4586.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:38.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7f9bfafa1640 10 monclient: _renew_subs 2026-02-17T21:25:38.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7f9bfafa1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7f9bfafa1640 1 -- 10.20.193.5:0/929887899 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bf41f47a0 con 0x7f9bf415d950 2026-02-17T21:25:38.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7f9bfafa1640 1 librados: init done 2026-02-17T21:25:38.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7fe2e45e4640 10 monclient: get_monmap_and_config 2026-02-17T21:25:38.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7fe2e45e4640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.657+0000 7fe2e45e4640 10 monclient: monmap: 2026-02-17T21:25:38.672 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.672 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.672 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:38.658178+0000 2026-02-17T21:25:38.672 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:38.658178+0000 2026-02-17T21:25:38.672 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.672 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.672 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:38.672 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:38.673 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:38.673 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:38.673 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:38.673 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:38.673 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.673 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.658+0000 7f9bfafa1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.673 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.658+0000 7f9bfafa1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.673 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.658+0000 7f9bfafa1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.673 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.658+0000 7f9bfafa1640 1 -- 10.20.193.5:0/929887899 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bf41583b0 con 0x7f9bf415d950 2026-02-17T21:25:38.674 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.658+0000 7f09daffd640 1 -- 10.20.193.5:0/2183627585 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f09f0010040 con 0x7f09f415d950 2026-02-17T21:25:38.674 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.658+0000 7f09daffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T21:25:38.674 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.658+0000 7f09daffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:38.674 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.658+0000 7fe2e45e4640 1 Processor -- start 2026-02-17T21:25:38.674 INFO:teuthology.orchestra.run.trial005.stdout:111669149703 2026-02-17T21:25:38.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.658+0000 7fe2e45e4640 1 -- start start 2026-02-17T21:25:38.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.658+0000 7fe2e45e4640 10 monclient: init 2026-02-17T21:25:38.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.659+0000 7fe2e45e4640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.659+0000 7fe2e45e4640 10 monclient: _add_conns ranks=[3,4,5,2,0,1] 2026-02-17T21:25:38.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.659+0000 7fe2e45e4640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fe2dc1527c0 0x7fe2dc0d2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.659+0000 7fe2e45e4640 10 monclient(hunting): picked mon.noname-a con 0x7fe2dc1527c0 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:38.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.659+0000 7fe2e45e4640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fe2dc0c8cf0 0x7fe2dc0c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.659+0000 7fe2e45e4640 10 monclient(hunting): picked mon.noname-b con 0x7fe2dc0c8cf0 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:38.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.659+0000 7fe2e45e4640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fe2dc15d810 0x7fe2dc15dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.659+0000 7fe2e45e4640 10 monclient(hunting): picked mon.noname-c con 0x7fe2dc15d810 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:38.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.659+0000 7fe2e45e4640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.659+0000 7fe2e45e4640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe2dc0ca360 con 0x7fe2dc1527c0 2026-02-17T21:25:38.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.659+0000 7fe2e45e4640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.659+0000 7fe2e45e4640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fe2dc0c97e0 con 0x7fe2dc0c8cf0 2026-02-17T21:25:38.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.659+0000 7fe2e45e4640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.659+0000 7fe2e45e4640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe2dc0c9ac0 con 0x7fe2dc15d810 2026-02-17T21:25:38.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.659+0000 7fe2e45e4640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.659+0000 7fe2e45e4640 10 monclient(hunting): authenticate will time out at 1044.224245s 2026-02-17T21:25:38.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.659+0000 7fe2e1b58640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fe2dc0c8cf0 0x7fe2dc0c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.659+0000 7fe2e1b58640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fe2dc0c8cf0 0x7fe2dc0c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:60136/0 (socket says 10.20.193.5:60136) 2026-02-17T21:25:38.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.659+0000 7fe2e1b58640 1 -- 10.20.193.5:0/150168899 learned_addr learned my addr 10.20.193.5:0/150168899 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:38.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.659+0000 7fe2e1b58640 10 monclient(hunting): get_auth_request con 0x7fe2dc0c8cf0 auth_method 0 2026-02-17T21:25:38.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.659+0000 7fe2e1b58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.659+0000 7fe2e1b58640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.659+0000 7fe2e1b58640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7fe2e1b58640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7fe2e1b58640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7fe2e1b58640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7f09fc3a9640 10 librados: watch_flush enter 2026-02-17T21:25:38.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7f09fc3a9640 10 librados: watch_flush exit 2026-02-17T21:25:38.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7f09fc3a9640 20 client.4515.objecter shutdown clearing up homeless session... 2026-02-17T21:25:38.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7f09fc3a9640 10 client.4515.objecter successfully canceled tick 2026-02-17T21:25:38.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7f09fc3a9640 1 -- 10.20.193.5:0/2183627585 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f09c40792d0 msgr2=0x7f09c407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7f09fc3a9640 1 --2- 10.20.193.5:0/2183627585 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f09c40792d0 0x7f09c407b790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f09f408fc80 tx=0x7f09e4031000 comp rx=0 tx=0).stop 2026-02-17T21:25:38.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7f09fc3a9640 10 monclient: shutdown 2026-02-17T21:25:38.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7f09fc3a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7f09fc3a9640 1 -- 10.20.193.5:0/2183627585 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09f415d950 msgr2=0x7f09f41f19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7f09fc3a9640 1 --2- 10.20.193.5:0/2183627585 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09f415d950 0x7f09f41f19d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f09f000efc0 tx=0x7f09f000c490 comp rx=0 tx=0).stop 2026-02-17T21:25:38.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7f09fc3a9640 1 -- 10.20.193.5:0/2183627585 shutdown_connections 2026-02-17T21:25:38.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7f09fc3a9640 1 --2- 10.20.193.5:0/2183627585 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f09c40792d0 0x7f09c407b790 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7f09fc3a9640 1 --2- 10.20.193.5:0/2183627585 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09f415d950 0x7f09f41f19d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7f09fc3a9640 1 --2- 10.20.193.5:0/2183627585 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f09f415c840 0x7f09f41f1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7f09fc3a9640 1 --2- 10.20.193.5:0/2183627585 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f09f40d1b60 0x7f09f40cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7f09fc3a9640 1 -- 10.20.193.5:0/2183627585 >> 10.20.193.5:0/2183627585 conn(0x7f09f406d9b0 msgr2=0x7f09f40d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7f09fc3a9640 1 -- 10.20.193.5:0/2183627585 shutdown_connections 2026-02-17T21:25:38.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7f09fc3a9640 1 -- 10.20.193.5:0/2183627585 wait complete. 2026-02-17T21:25:38.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7f09fc3a9640 1 librados: shutdown 2026-02-17T21:25:38.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7fe2e1b58640 10 monclient(hunting): handle_auth_done global_id 4543 payload 274 2026-02-17T21:25:38.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7fe2e1b58640 1 -- 10.20.193.5:0/150168899 >> v2:10.20.193.135:3300/0 conn(0x7fe2dc15d810 msgr2=0x7fe2dc15dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7fe2e1b58640 1 --2- 10.20.193.5:0/150168899 >> v2:10.20.193.135:3300/0 conn(0x7fe2dc15d810 0x7fe2dc15dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7fe2e1b58640 1 -- 10.20.193.5:0/150168899 >> v2:10.20.193.5:3300/0 conn(0x7fe2dc1527c0 msgr2=0x7fe2dc0d2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7fe2e1b58640 1 --2- 10.20.193.5:0/150168899 >> v2:10.20.193.5:3300/0 conn(0x7fe2dc1527c0 0x7fe2dc0d2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7fe2e1b58640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7fe2e1b58640 1 monclient: found mon.noname-b 2026-02-17T21:25:38.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7fe2e1b58640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7fe2e1b58640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.660+0000 7fe2e1b58640 1 -- 10.20.193.5:0/150168899 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2dc0c9da0 con 0x7fe2dc0c8cf0 2026-02-17T21:25:38.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.662+0000 7fe2e1b58640 1 --2- 10.20.193.5:0/150168899 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe2dc0c8cf0 0x7fe2dc0c9180 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc08e450 tx=0x7fe2d002edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b457baf5061a164 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149704 got 111669149703 for osd.9 2026-02-17T21:25:38.693 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e1357640 1 -- 10.20.193.5:0/150168899 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d003c070 con 0x7fe2dc0c8cf0 2026-02-17T21:25:38.693 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e1357640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.693 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e1357640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:38.693 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e1357640 10 monclient: dump: 2026-02-17T21:25:38.693 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.693 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.693 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.693 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.694 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.694 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.694 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.694 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.694 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.694 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e1357640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e1357640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e1357640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e1357640 1 -- 10.20.193.5:0/150168899 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d002fab0 con 0x7fe2dc0c8cf0 2026-02-17T21:25:38.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e1357640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e1357640 1 -- 10.20.193.5:0/150168899 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0037440 con 0x7fe2dc0c8cf0 2026-02-17T21:25:38.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e1357640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e1357640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:38.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e1357640 10 monclient: dump: 2026-02-17T21:25:38.694 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.694 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.694 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.694 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.695 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.695 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.695 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.695 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.695 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.695 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.695 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e45e4640 5 monclient: authenticate success, global_id 4543 2026-02-17T21:25:38.695 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e45e4640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:38.695 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e45e4640 4 set_mon_vals no callback set 2026-02-17T21:25:38.697 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e45e4640 10 monclient: shutdown 2026-02-17T21:25:38.697 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e45e4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.697 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e45e4640 1 -- 10.20.193.5:0/150168899 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe2dc0c8cf0 msgr2=0x7fe2dc0c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.697 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e45e4640 1 --2- 10.20.193.5:0/150168899 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe2dc0c8cf0 0x7fe2dc0c9180 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc08e450 tx=0x7fe2d002edf0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.697 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e45e4640 1 -- 10.20.193.5:0/150168899 shutdown_connections 2026-02-17T21:25:38.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e45e4640 1 --2- 10.20.193.5:0/150168899 >> v2:10.20.193.135:3300/0 conn(0x7fe2dc15d810 0x7fe2dc15dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e45e4640 1 --2- 10.20.193.5:0/150168899 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe2dc0c8cf0 0x7fe2dc0c9180 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e45e4640 1 --2- 10.20.193.5:0/150168899 >> v2:10.20.193.5:3300/0 conn(0x7fe2dc1527c0 0x7fe2dc0d2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e45e4640 1 -- 10.20.193.5:0/150168899 >> 10.20.193.5:0/150168899 conn(0x7fe2dc073030 msgr2=0x7fe2dc073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e45e4640 1 -- 10.20.193.5:0/150168899 shutdown_connections 2026-02-17T21:25:38.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.692+0000 7fe2e45e4640 1 -- 10.20.193.5:0/150168899 wait complete. 2026-02-17T21:25:38.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.693+0000 7fe2e45e4640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.693+0000 7fe2e45e4640 10 monclient: monmap: 2026-02-17T21:25:38.698 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.698 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:38.698 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:38.698 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:38.698 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.698 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.698 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:38.698 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:38.698 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:38.698 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.693+0000 7fe2e45e4640 1 librados: starting msgr at 2026-02-17T21:25:38.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.693+0000 7fe2e45e4640 1 librados: starting objecter 2026-02-17T21:25:38.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.693+0000 7fe2e45e4640 1 Processor -- start 2026-02-17T21:25:38.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.693+0000 7fe2e45e4640 1 -- start start 2026-02-17T21:25:38.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.693+0000 7fe2e45e4640 1 librados: setting wanted keys 2026-02-17T21:25:38.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.693+0000 7fe2e45e4640 1 librados: calling monclient init 2026-02-17T21:25:38.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.693+0000 7fe2e45e4640 10 monclient: init 2026-02-17T21:25:38.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e45e4640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e45e4640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:25:38.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e45e4640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe2dc0c8cf0 0x7fe2dc1f3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e45e4640 10 monclient(hunting): picked mon.noname-b con 0x7fe2dc0c8cf0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:38.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e45e4640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe2dc1527c0 0x7fe2dc1f7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e45e4640 10 monclient(hunting): picked mon.noname-c con 0x7fe2dc1527c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:38.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e45e4640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe2dc15d810 0x7fe2dc0cf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e45e4640 10 monclient(hunting): picked mon.noname-a con 0x7fe2dc15d810 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:38.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e45e4640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e45e4640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc152ba0 con 0x7fe2dc15d810 2026-02-17T21:25:38.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e45e4640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e45e4640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc15d2f0 con 0x7fe2dc0c8cf0 2026-02-17T21:25:38.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e45e4640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e45e4640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc0d2790 con 0x7fe2dc1527c0 2026-02-17T21:25:38.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e45e4640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e45e4640 10 monclient(hunting): authenticate will time out at 1044.259173s 2026-02-17T21:25:38.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e2359640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe2dc0c8cf0 0x7fe2dc1f3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e2359640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe2dc0c8cf0 0x7fe2dc1f3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:60150/0 (socket says 10.20.193.5:60150) 2026-02-17T21:25:38.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e2359640 1 -- 10.20.193.5:0/1624603985 learned_addr learned my addr 10.20.193.5:0/1624603985 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:38.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e2359640 10 monclient(hunting): get_auth_request con 0x7fe2dc0c8cf0 auth_method 0 2026-02-17T21:25:38.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e2359640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e2359640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e2359640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e2359640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e2359640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.694+0000 7fe2e2359640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.696+0000 7fe2e2359640 10 monclient(hunting): handle_auth_done global_id 4546 payload 824 2026-02-17T21:25:38.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.696+0000 7fe2e2359640 1 -- 10.20.193.5:0/1624603985 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe2dc1527c0 msgr2=0x7fe2dc1f7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.696+0000 7fe2e2359640 1 --2- 10.20.193.5:0/1624603985 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe2dc1527c0 0x7fe2dc1f7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.696+0000 7fe2e2359640 1 -- 10.20.193.5:0/1624603985 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe2dc15d810 msgr2=0x7fe2dc0cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.696+0000 7fe2e2359640 1 --2- 10.20.193.5:0/1624603985 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe2dc15d810 0x7fe2dc0cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.696+0000 7fe2e2359640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.696+0000 7fe2e2359640 1 monclient: found mon.noname-b 2026-02-17T21:25:38.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.696+0000 7fe2e2359640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.696+0000 7fe2e2359640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.696+0000 7fe2e2359640 1 -- 10.20.193.5:0/1624603985 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2dc0cd920 con 0x7fe2dc0c8cf0 2026-02-17T21:25:38.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.697+0000 7fcbfe4cd640 10 monclient: get_monmap_and_config 2026-02-17T21:25:38.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.697+0000 7fcbfe4cd640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.697+0000 7fcbfe4cd640 10 monclient: monmap: 2026-02-17T21:25:38.701 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.701 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.701 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:38.697830+0000 2026-02-17T21:25:38.702 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:38.697830+0000 2026-02-17T21:25:38.702 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.702 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.702 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:38.702 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:38.702 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:38.702 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:38.702 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:38.702 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:38.702 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.697+0000 7fcbfe4cd640 1 Processor -- start 2026-02-17T21:25:38.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.697+0000 7fcbfe4cd640 1 -- start start 2026-02-17T21:25:38.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.697+0000 7fcbfe4cd640 10 monclient: init 2026-02-17T21:25:38.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.698+0000 7fe2e2359640 1 --2- 10.20.193.5:0/1624603985 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe2dc0c8cf0 0x7fe2dc1f3870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00b500 tx=0x7fe2cc00b9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.703 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.698+0000 7fe2c2ffd640 10 client.?.objecter ms_handle_connect 0x7fe2dc0c8cf0 2026-02-17T21:25:38.703 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.698+0000 7fe2c2ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:38.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.698+0000 7fcbfe4cd640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.698+0000 7fcbfe4cd640 10 monclient: _add_conns ranks=[1,4,2,3,0,5] 2026-02-17T21:25:38.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.698+0000 7fcbfe4cd640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fcbf8155d40 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:38.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.698+0000 7fcbfe4cd640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fcbf80ccc00 0x7fcbf8156120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.698+0000 7fcbfe4cd640 10 monclient(hunting): picked mon.noname-b con 0x7fcbf80ccc00 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:38.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.698+0000 7fcbfe4cd640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fcbf80caff0 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:38.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.698+0000 7fcbfe4cd640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbf815c8d0 con 0x7fcbf8155d40 2026-02-17T21:25:38.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.698+0000 7fcbfe4cd640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbf815cbb0 con 0x7fcbf80caff0 2026-02-17T21:25:38.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.698+0000 7fcbfe4cd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.698+0000 7fcbfe4cd640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fcbf806c890 con 0x7fcbf80ccc00 2026-02-17T21:25:38.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.698+0000 7fcbfe4cd640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.698+0000 7fcbfe4cd640 10 monclient(hunting): authenticate will time out at 1044.263338s 2026-02-17T21:25:38.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.700+0000 7fcbf77fe640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fcbf80ccc00 0x7fcbf8156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.700+0000 7fcbf77fe640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fcbf80ccc00 0x7fcbf8156120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:60152/0 (socket says 10.20.193.5:60152) 2026-02-17T21:25:38.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.700+0000 7fcbf77fe640 1 -- 10.20.193.5:0/1706919332 learned_addr learned my addr 10.20.193.5:0/1706919332 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:38.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.700+0000 7fcbf77fe640 10 monclient(hunting): get_auth_request con 0x7fcbf80ccc00 auth_method 0 2026-02-17T21:25:38.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.700+0000 7fcbf77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.705 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.700+0000 7fcbf77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.705 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.700+0000 7fcbf77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.705 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.701+0000 7fcbf77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.705 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.701+0000 7fcbf77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.705 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.701+0000 7fcbf77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.702+0000 7fe2c2ffd640 1 -- 10.20.193.5:0/1624603985 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc004480 con 0x7fe2dc0c8cf0 2026-02-17T21:25:38.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.702+0000 7fe2c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.702+0000 7fe2c2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:38.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.702+0000 7fe2c2ffd640 10 monclient: dump: 2026-02-17T21:25:38.706 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.706 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.706 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.706 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.706 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.706 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.706 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.706 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.706 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.707 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.702+0000 7fe2c2ffd640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.702+0000 7fe2c2ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.702+0000 7fe2c2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.702+0000 7fe2c2ffd640 1 -- 10.20.193.5:0/1624603985 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2cc014070 con 0x7fe2dc0c8cf0 2026-02-17T21:25:38.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.702+0000 7fe2e45e4640 5 monclient: authenticate success, global_id 4546 2026-02-17T21:25:38.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.702+0000 7fe2e45e4640 10 monclient: _renew_subs 2026-02-17T21:25:38.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.702+0000 7fe2e45e4640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.702+0000 7fe2e45e4640 1 -- 10.20.193.5:0/1624603985 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2dc1f3fb0 con 0x7fe2dc0c8cf0 2026-02-17T21:25:38.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.702+0000 7fe2c2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.702+0000 7fe2c2ffd640 1 -- 10.20.193.5:0/1624603985 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc002920 con 0x7fe2dc0c8cf0 2026-02-17T21:25:38.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.702+0000 7fe2c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.702+0000 7fe2c2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:38.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.702+0000 7fe2e0b56640 4 set_mon_vals no callback set 2026-02-17T21:25:38.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.702+0000 7fe2c2ffd640 10 monclient: dump: 2026-02-17T21:25:38.707 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.707 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.707 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.707 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.707 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.708 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.708 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.708 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.708 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.708 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.702+0000 7fe2e45e4640 10 client.4546.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:38.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.702+0000 7fe2e45e4640 10 monclient: _renew_subs 2026-02-17T21:25:38.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.702+0000 7fe2e45e4640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.702+0000 7fe2e45e4640 1 -- 10.20.193.5:0/1624603985 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2dc1f4570 con 0x7fe2dc0c8cf0 2026-02-17T21:25:38.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.702+0000 7fe2e45e4640 1 librados: init done 2026-02-17T21:25:38.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.703+0000 7fe2e45e4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.703+0000 7fe2e45e4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.703+0000 7fe2e45e4640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.703+0000 7fe2e45e4640 1 -- 10.20.193.5:0/1624603985 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2dc160100 con 0x7fe2dc0c8cf0 2026-02-17T21:25:38.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.703+0000 7fcbf77fe640 10 monclient(hunting): handle_auth_done global_id 4549 payload 274 2026-02-17T21:25:38.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.703+0000 7fcbf77fe640 1 -- 10.20.193.5:0/1706919332 >> v1:10.20.193.135:6789/0 conn(0x7fcbf80caff0 legacy=0x7fcbf80cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.703+0000 7fcbf77fe640 1 -- 10.20.193.5:0/1706919332 >> v1:10.20.193.119:6789/0 conn(0x7fcbf8155d40 legacy=0x7fcbf815d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.703+0000 7fcbf77fe640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.703+0000 7fcbf77fe640 1 monclient: found mon.noname-b 2026-02-17T21:25:38.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.703+0000 7fcbf77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.703+0000 7fcbf77fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.703+0000 7fcbf77fe640 1 -- 10.20.193.5:0/1706919332 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf806cae0 con 0x7fcbf80ccc00 2026-02-17T21:25:38.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.705+0000 7fcbf77fe640 1 --2- 10.20.193.5:0/1706919332 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fcbf80ccc00 0x7fcbf8156120 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8009970 tx=0x7fcbe802ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3ac2a7609827431 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.714+0000 7f11297ce640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T21:25:38.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.714+0000 7f11297ce640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T21:25:38.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.714+0000 7f11297ce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.714+0000 7f11297ce640 1 -- 10.20.193.5:0/1202708951 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f112415ac60 con 0x7f1110004900 2026-02-17T21:25:38.724 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.723+0000 7f6b2cabd640 10 monclient: get_monmap_and_config 2026-02-17T21:25:38.724 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.723+0000 7f6b2cabd640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.724 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.723+0000 7f6b2cabd640 10 monclient: monmap: 2026-02-17T21:25:38.724 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.724 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.724 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:38.723844+0000 2026-02-17T21:25:38.724 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:38.723844+0000 2026-02-17T21:25:38.724 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.724 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.724 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:38.724 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:38.724 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:38.725 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:38.725 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:38.725 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:38.725 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.723+0000 7f6b2cabd640 1 Processor -- start 2026-02-17T21:25:38.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.723+0000 7f6b2cabd640 1 -- start start 2026-02-17T21:25:38.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.723+0000 7f6b2cabd640 10 monclient: init 2026-02-17T21:25:38.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.724+0000 7f6b2cabd640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.724+0000 7f6b2cabd640 10 monclient: _add_conns ranks=[5,0,3,2,4,1] 2026-02-17T21:25:38.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.724+0000 7f6b2cabd640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f6b2815d370 0x7f6b2815d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.724+0000 7f6b2cabd640 10 monclient(hunting): picked mon.noname-c con 0x7f6b2815d370 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:38.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.724+0000 7f6b2cabd640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6b280c7e20 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:38.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.724+0000 7f6b2cabd640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f6b280c74c0 0x7f6b280c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.724+0000 7f6b2cabd640 10 monclient(hunting): picked mon.noname-a con 0x7f6b280c74c0 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:38.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.724+0000 7f6b2cabd640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b280c8350 con 0x7f6b280c7e20 2026-02-17T21:25:38.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.724+0000 7f6b2cabd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.724+0000 7f6b2cabd640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6b2815b710 con 0x7f6b280c74c0 2026-02-17T21:25:38.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.724+0000 7f6b2cabd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.724+0000 7f6b2cabd640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f6b280c9240 con 0x7f6b2815d370 2026-02-17T21:25:38.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.724+0000 7f6b2cabd640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.724+0000 7f6b2cabd640 10 monclient(hunting): authenticate will time out at 1044.289137s 2026-02-17T21:25:38.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.724+0000 7f6b26d76640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f6b280c74c0 0x7f6b280c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.724+0000 7f6b26d76640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f6b280c74c0 0x7f6b280c52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:58644/0 (socket says 10.20.193.5:58644) 2026-02-17T21:25:38.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.724+0000 7f6b26d76640 1 -- 10.20.193.5:0/3819241117 learned_addr learned my addr 10.20.193.5:0/3819241117 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:38.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.724+0000 7f6b26d76640 10 monclient(hunting): get_auth_request con 0x7f6b280c74c0 auth_method 0 2026-02-17T21:25:38.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.724+0000 7f6b26d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.724+0000 7f6b26d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.724+0000 7f6b26d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.725+0000 7f6b26d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.725+0000 7f6b26d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.725+0000 7f6b26d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.726+0000 7f6b26d76640 10 monclient(hunting): handle_auth_done global_id 4521 payload 274 2026-02-17T21:25:38.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.726+0000 7f6b26d76640 1 -- 10.20.193.5:0/3819241117 >> v2:10.20.193.135:3300/0 conn(0x7f6b2815d370 msgr2=0x7f6b2815d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:38.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.726+0000 7f6b26d76640 1 --2- 10.20.193.5:0/3819241117 >> v2:10.20.193.135:3300/0 conn(0x7f6b2815d370 0x7f6b2815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.726+0000 7f6b26d76640 1 -- 10.20.193.5:0/3819241117 >> v1:10.20.193.5:6789/0 conn(0x7f6b280c7e20 legacy=0x7f6b2815b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.726+0000 7f6b26d76640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.726+0000 7f6b26d76640 1 monclient: found mon.noname-a 2026-02-17T21:25:38.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.726+0000 7f6b26d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.726+0000 7f6b26d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.726+0000 7f6b26d76640 1 -- 10.20.193.5:0/3819241117 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b280c8630 con 0x7f6b280c74c0 2026-02-17T21:25:38.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.728+0000 7f6b26d76640 1 --2- 10.20.193.5:0/3819241117 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6b280c74c0 0x7f6b280c52b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6b280698d0 tx=0x7f6b1802f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faeb55f2f50604c2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.730+0000 7f6b25573640 1 -- 10.20.193.5:0/3819241117 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1802fd70 con 0x7f6b280c74c0 2026-02-17T21:25:38.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.730+0000 7f6b25573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.730+0000 7f6b25573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:38.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.730+0000 7f6b25573640 10 monclient: dump: 2026-02-17T21:25:38.733 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.733 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.733 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.733 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.733 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.733 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.733 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.733 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.734 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.734 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.730+0000 7f6b25573640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.730+0000 7f6b25573640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.730+0000 7f6b25573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.730+0000 7f6b25573640 1 -- 10.20.193.5:0/3819241117 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b180373f0 con 0x7f6b280c74c0 2026-02-17T21:25:38.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.730+0000 7f6b2cabd640 5 monclient: authenticate success, global_id 4521 2026-02-17T21:25:38.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.730+0000 7f6b25573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.730+0000 7f6b25573640 1 -- 10.20.193.5:0/3819241117 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b180377c0 con 0x7f6b280c74c0 2026-02-17T21:25:38.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.730+0000 7f6b25573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.730+0000 7f6b25573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:38.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.730+0000 7f6b25573640 10 monclient: dump: 2026-02-17T21:25:38.734 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.734 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.734 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.734 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.734 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.735 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.735 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.735 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.735 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.735 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.730+0000 7f6b2cabd640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:38.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.730+0000 7f6b2cabd640 4 set_mon_vals no callback set 2026-02-17T21:25:38.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.731+0000 7f6b2cabd640 10 monclient: shutdown 2026-02-17T21:25:38.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.731+0000 7f6b2cabd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.731+0000 7f6b2cabd640 1 -- 10.20.193.5:0/3819241117 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6b280c74c0 msgr2=0x7f6b280c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.731+0000 7f6b2cabd640 1 --2- 10.20.193.5:0/3819241117 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6b280c74c0 0x7f6b280c52b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6b280698d0 tx=0x7f6b1802f270 comp rx=0 tx=0).stop 2026-02-17T21:25:38.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.731+0000 7f6b2cabd640 1 -- 10.20.193.5:0/3819241117 shutdown_connections 2026-02-17T21:25:38.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.731+0000 7f6b2cabd640 1 --2- 10.20.193.5:0/3819241117 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6b280c74c0 0x7f6b280c52b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.731+0000 7f6b2cabd640 1 --2- 10.20.193.5:0/3819241117 >> v2:10.20.193.135:3300/0 conn(0x7f6b2815d370 0x7f6b2815d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.731+0000 7f6b2cabd640 1 -- 10.20.193.5:0/3819241117 >> 10.20.193.5:0/3819241117 conn(0x7f6b280c9f20 msgr2=0x7f6b280ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.731+0000 7f6b2cabd640 1 -- 10.20.193.5:0/3819241117 shutdown_connections 2026-02-17T21:25:38.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.731+0000 7f6b2cabd640 1 -- 10.20.193.5:0/3819241117 wait complete. 2026-02-17T21:25:38.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.731+0000 7f6b2cabd640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.731+0000 7f6b2cabd640 10 monclient: monmap: 2026-02-17T21:25:38.736 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.736 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:38.736 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:38.736 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:38.736 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.736 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.736 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:38.736 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:38.736 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:38.736 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.731+0000 7f6b2cabd640 1 librados: starting msgr at 2026-02-17T21:25:38.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.731+0000 7f6b2cabd640 1 librados: starting objecter 2026-02-17T21:25:38.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.731+0000 7f6b2cabd640 1 Processor -- start 2026-02-17T21:25:38.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.731+0000 7f6b2cabd640 1 -- start start 2026-02-17T21:25:38.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.731+0000 7f6b2cabd640 1 librados: setting wanted keys 2026-02-17T21:25:38.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.731+0000 7f6b2cabd640 1 librados: calling monclient init 2026-02-17T21:25:38.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.731+0000 7f6b2cabd640 10 monclient: init 2026-02-17T21:25:38.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.732+0000 7f6b2cabd640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.732+0000 7f6b2cabd640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:25:38.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.732+0000 7f6b2cabd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6b280c74c0 0x7f6b28148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.732+0000 7f6b2cabd640 10 monclient(hunting): picked mon.noname-a con 0x7f6b280c74c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:38.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.732+0000 7f6b2cabd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6b280c7e20 0x7f6b280cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.732+0000 7f6b2cabd640 10 monclient(hunting): picked mon.noname-c con 0x7f6b280c7e20 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:38.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.732+0000 7f6b2cabd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6b2815d370 0x7f6b280cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.732+0000 7f6b2cabd640 10 monclient(hunting): picked mon.noname-b con 0x7f6b2815d370 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:38.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.732+0000 7f6b2cabd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.732+0000 7f6b2cabd640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6b280c8ed0 con 0x7f6b280c74c0 2026-02-17T21:25:38.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.732+0000 7f6b2cabd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.732+0000 7f6b2cabd640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6b280c8bf0 con 0x7f6b2815d370 2026-02-17T21:25:38.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.732+0000 7f6b2cabd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.732+0000 7f6b2cabd640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6b280c96d0 con 0x7f6b280c7e20 2026-02-17T21:25:38.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.732+0000 7f6b2cabd640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.732+0000 7f6b2cabd640 10 monclient(hunting): authenticate will time out at 1044.297343s 2026-02-17T21:25:38.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.732+0000 7f6b26575640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6b280c74c0 0x7f6b28148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.732+0000 7f6b26575640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6b280c74c0 0x7f6b28148cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:58656/0 (socket says 10.20.193.5:58656) 2026-02-17T21:25:38.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.732+0000 7f6b26575640 1 -- 10.20.193.5:0/2614929990 learned_addr learned my addr 10.20.193.5:0/2614929990 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:38.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.732+0000 7f6b26575640 10 monclient(hunting): get_auth_request con 0x7f6b280c74c0 auth_method 0 2026-02-17T21:25:38.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.732+0000 7f6b26575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.732+0000 7f6b26575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.732+0000 7f6b26575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.732+0000 7f6b26575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.732+0000 7f6b26575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.733+0000 7f6b26575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.734+0000 7f78abe96640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T21:25:38.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.734+0000 7f78abe96640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T21:25:38.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.734+0000 7f78abe96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.734+0000 7f78abe96640 1 -- 10.20.193.5:0/2731527037 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f78a40cb260 con 0x7f78a4152680 2026-02-17T21:25:38.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.734+0000 7f6b26575640 10 monclient(hunting): handle_auth_done global_id 4527 payload 824 2026-02-17T21:25:38.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.734+0000 7f6b26575640 1 -- 10.20.193.5:0/2614929990 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6b280c7e20 msgr2=0x7f6b280cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.734+0000 7f6b26575640 1 --2- 10.20.193.5:0/2614929990 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6b280c7e20 0x7f6b280cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.734+0000 7f6b26575640 1 -- 10.20.193.5:0/2614929990 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6b2815d370 msgr2=0x7f6b280cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.734+0000 7f6b26575640 1 --2- 10.20.193.5:0/2614929990 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6b2815d370 0x7f6b280cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.734+0000 7f6b26575640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.734+0000 7f6b26575640 1 monclient: found mon.noname-a 2026-02-17T21:25:38.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.734+0000 7f6b26575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.734+0000 7f6b26575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.734+0000 7f6b26575640 1 -- 10.20.193.5:0/2614929990 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b281f1510 con 0x7f6b280c74c0 2026-02-17T21:25:38.742 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.735+0000 7f6b26575640 1 --2- 10.20.193.5:0/2614929990 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6b280c74c0 0x7f6b28148cb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00b7b0 tx=0x7f6b1c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.742 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.735+0000 7f6b0effd640 10 client.?.objecter ms_handle_connect 0x7f6b280c74c0 2026-02-17T21:25:38.742 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.735+0000 7f6b0effd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:38.742 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.737+0000 7f78927fc640 1 -- 10.20.193.5:0/2731527037 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7f7898068e20 con 0x7f78a4152680 2026-02-17T21:25:38.742 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.737+0000 7f78927fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T21:25:38.742 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.737+0000 7f78927fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:38.742 INFO:teuthology.orchestra.run.trial005.stdout:98784247814 2026-02-17T21:25:38.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f78abe96640 10 librados: watch_flush enter 2026-02-17T21:25:38.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f78abe96640 10 librados: watch_flush exit 2026-02-17T21:25:38.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f78abe96640 20 client.4518.objecter shutdown clearing up homeless session... 2026-02-17T21:25:38.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f78abe96640 10 client.4518.objecter successfully canceled tick 2026-02-17T21:25:38.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f6b0effd640 1 -- 10.20.193.5:0/2614929990 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c004480 con 0x7f6b280c74c0 2026-02-17T21:25:38.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f6b0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f6b0effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:38.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f78abe96640 1 -- 10.20.193.5:0/2731527037 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f78740792d0 msgr2=0x7f787407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f78abe96640 1 --2- 10.20.193.5:0/2731527037 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f78740792d0 0x7f787407b790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f78a4071670 tx=0x7f7894031000 comp rx=0 tx=0).stop 2026-02-17T21:25:38.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f6b0effd640 10 monclient: dump: 2026-02-17T21:25:38.744 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.744 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.744 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.744 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.744 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.745 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.745 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.745 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.745 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.745 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f6b0effd640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f6b0effd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f78abe96640 10 monclient: shutdown 2026-02-17T21:25:38.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f78abe96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f6b0effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f6b0effd640 1 -- 10.20.193.5:0/2614929990 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b1c010070 con 0x7f6b280c74c0 2026-02-17T21:25:38.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f6b0effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f78abe96640 1 -- 10.20.193.5:0/2731527037 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f78a4152680 msgr2=0x7f78a414b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f78abe96640 1 --2- 10.20.193.5:0/2731527037 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f78a4152680 0x7f78a414b230 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f789800b7b0 tx=0x7f789800bc80 comp rx=0 tx=0).stop 2026-02-17T21:25:38.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f6b0effd640 1 -- 10.20.193.5:0/2614929990 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c002920 con 0x7f6b280c74c0 2026-02-17T21:25:38.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f6b0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f6b0effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:38.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f6b24d72640 4 set_mon_vals no callback set 2026-02-17T21:25:38.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f6b0effd640 10 monclient: dump: 2026-02-17T21:25:38.747 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.747 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.747 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.747 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.747 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.747 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.747 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.747 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.747 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.747 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f6b2cabd640 5 monclient: authenticate success, global_id 4527 2026-02-17T21:25:38.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f6b2cabd640 10 monclient: _renew_subs 2026-02-17T21:25:38.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f6b2cabd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f6b2cabd640 1 -- 10.20.193.5:0/2614929990 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b2814ab40 con 0x7f6b280c74c0 2026-02-17T21:25:38.748 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f78abe96640 1 -- 10.20.193.5:0/2731527037 shutdown_connections 2026-02-17T21:25:38.748 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f78abe96640 1 --2- 10.20.193.5:0/2731527037 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f78740792d0 0x7f787407b790 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.748 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f78abe96640 1 --2- 10.20.193.5:0/2731527037 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f78a4152a60 0x7f78a41f5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.748 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f78abe96640 1 --2- 10.20.193.5:0/2731527037 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f78a4152680 0x7f78a414b230 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.748 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f78abe96640 1 --2- 10.20.193.5:0/2731527037 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f78a4073720 0x7f78a41f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.748 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.739+0000 7f78abe96640 1 -- 10.20.193.5:0/2731527037 >> 10.20.193.5:0/2731527037 conn(0x7f78a40ca740 msgr2=0x7f78a40c9950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.748 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.740+0000 7f6b2cabd640 10 client.4527.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:38.748 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.740+0000 7f6b2cabd640 10 monclient: _renew_subs 2026-02-17T21:25:38.748 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.740+0000 7f6b2cabd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.740+0000 7f78abe96640 1 -- 10.20.193.5:0/2731527037 shutdown_connections 2026-02-17T21:25:38.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.740+0000 7f6b2cabd640 1 -- 10.20.193.5:0/2614929990 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b280cb6b0 con 0x7f6b280c74c0 2026-02-17T21:25:38.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.740+0000 7f6b2cabd640 1 librados: init done 2026-02-17T21:25:38.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.740+0000 7f78abe96640 1 -- 10.20.193.5:0/2731527037 wait complete. 2026-02-17T21:25:38.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.740+0000 7f78abe96640 1 librados: shutdown 2026-02-17T21:25:38.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.740+0000 7f6b2cabd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.740+0000 7f6b2cabd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.740+0000 7f6b2cabd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.740+0000 7f6b2cabd640 1 -- 10.20.193.5:0/2614929990 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b2815d750 con 0x7f6b280c74c0 2026-02-17T21:25:38.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247814 got 98784247814 for osd.11 2026-02-17T21:25:38.750 DEBUG:teuthology.parallel:result is None 2026-02-17T21:25:38.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.753+0000 7f6b0effd640 1 -- 10.20.193.5:0/2614929990 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f6b1c01d030 con 0x7f6b280c74c0 2026-02-17T21:25:38.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.754+0000 7f6b0effd640 1 --2- 10.20.193.5:0/2614929990 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6af40792d0 0x7f6af407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.754+0000 7f6b25d74640 1 --2- 10.20.193.5:0/2614929990 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6af40792d0 0x7f6af407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.754+0000 7f6b25d74640 10 monclient: get_auth_request con 0x7f6af40792d0 auth_method 0 2026-02-17T21:25:38.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.754+0000 7f6b0effd640 10 client.4527.objecter ms_handle_connect 0x7f6af40792d0 2026-02-17T21:25:38.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.754+0000 7f6b25d74640 1 --2- 10.20.193.5:0/2614929990 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6af40792d0 0x7f6af407b790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6b10002770 tx=0x7f6b10007ab0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.756 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.754+0000 7f6b0effd640 1 -- 10.20.193.5:0/2614929990 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f6b1c01de30 con 0x7f6b280c74c0 2026-02-17T21:25:38.756 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.754+0000 7f6b0effd640 10 client.4527.objecter ms_dispatch2 0x7f6b28000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:38.756 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.754+0000 7f6b0effd640 3 client.4527.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:38.756 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.754+0000 7f6b0effd640 3 client.4527.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:38.756 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.755+0000 7f6b0effd640 20 client.4527.objecter dump_active .. 0 homeless 2026-02-17T21:25:38.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.760+0000 7f9be97fa640 1 -- 10.20.193.5:0/929887899 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f9bf0041820 con 0x7f9bf415d950 2026-02-17T21:25:38.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.761+0000 7f9be97fa640 1 --2- 10.20.193.5:0/929887899 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9bc4079300 0x7f9bc407b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.761+0000 7f9bf8d16640 1 --2- 10.20.193.5:0/929887899 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9bc4079300 0x7f9bc407b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.761+0000 7f9bf8d16640 10 monclient: get_auth_request con 0x7f9bc4079300 auth_method 0 2026-02-17T21:25:38.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.762+0000 7f9be97fa640 10 client.4586.objecter ms_handle_connect 0x7f9bc4079300 2026-02-17T21:25:38.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.762+0000 7f9bf8d16640 1 --2- 10.20.193.5:0/929887899 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9bc4079300 0x7f9bc407b7c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9be4006fd0 tx=0x7f9be4009190 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.762+0000 7f9be97fa640 1 -- 10.20.193.5:0/929887899 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f9bf0083f10 con 0x7f9bf415d950 2026-02-17T21:25:38.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.762+0000 7f9be97fa640 10 client.4586.objecter ms_dispatch2 0x7f9bf4000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:38.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.762+0000 7f9be97fa640 3 client.4586.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:38.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.762+0000 7f9be97fa640 3 client.4586.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:38.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.762+0000 7f9be97fa640 20 client.4586.objecter dump_active .. 0 homeless 2026-02-17T21:25:38.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.768+0000 7f9be97fa640 1 -- 10.20.193.5:0/929887899 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9bf41583b0 con 0x7f9bf415d950 2026-02-17T21:25:38.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.768+0000 7f9be97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.768+0000 7f9be97fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:38.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.770+0000 7f11037fe640 1 -- 10.20.193.5:0/1202708951 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f11180624f0 con 0x7f1110004900 2026-02-17T21:25:38.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.770+0000 7f11037fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T21:25:38.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.770+0000 7f11037fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:38.771 INFO:teuthology.orchestra.run.trial005.stdout:94489280516 2026-02-17T21:25:38.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.772+0000 7f11297ce640 10 librados: watch_flush enter 2026-02-17T21:25:38.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.772+0000 7f11297ce640 10 librados: watch_flush exit 2026-02-17T21:25:38.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.772+0000 7f11297ce640 20 client.4580.objecter shutdown clearing up homeless session... 2026-02-17T21:25:38.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.772+0000 7f11297ce640 10 client.4580.objecter successfully canceled tick 2026-02-17T21:25:38.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.772+0000 7f11297ce640 1 -- 10.20.193.5:0/1202708951 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f10f0079280 msgr2=0x7f10f007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.772+0000 7f11297ce640 1 --2- 10.20.193.5:0/1202708951 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f10f0079280 0x7f10f007b740 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f110c037000 tx=0x7f110c031000 comp rx=0 tx=0).stop 2026-02-17T21:25:38.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.772+0000 7f11297ce640 10 monclient: shutdown 2026-02-17T21:25:38.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.772+0000 7f11297ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.772+0000 7f11297ce640 1 -- 10.20.193.5:0/1202708951 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1110004900 msgr2=0x7f112415d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.772+0000 7f11297ce640 1 --2- 10.20.193.5:0/1202708951 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1110004900 0x7f112415d2c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f111800caa0 tx=0x7f111800cf70 comp rx=0 tx=0).stop 2026-02-17T21:25:38.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.772+0000 7f11297ce640 1 -- 10.20.193.5:0/1202708951 shutdown_connections 2026-02-17T21:25:38.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.772+0000 7f11297ce640 1 --2- 10.20.193.5:0/1202708951 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f10f0079280 0x7f10f007b740 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.772+0000 7f11297ce640 1 --2- 10.20.193.5:0/1202708951 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f11241f3730 0x7f1124149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.772+0000 7f11297ce640 1 --2- 10.20.193.5:0/1202708951 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f112415d800 0x7f11241f31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.772+0000 7f11297ce640 1 --2- 10.20.193.5:0/1202708951 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1110004900 0x7f112415d2c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.772+0000 7f11297ce640 1 -- 10.20.193.5:0/1202708951 >> 10.20.193.5:0/1202708951 conn(0x7f11240c9f40 msgr2=0x7f11240ccb80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.772+0000 7f11297ce640 1 -- 10.20.193.5:0/1202708951 shutdown_connections 2026-02-17T21:25:38.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.772+0000 7f11297ce640 1 -- 10.20.193.5:0/1202708951 wait complete. 2026-02-17T21:25:38.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.773+0000 7f11297ce640 1 librados: shutdown 2026-02-17T21:25:38.782 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280516 for osd.1 2026-02-17T21:25:38.809 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.807+0000 7fe2c2ffd640 1 -- 10.20.193.5:0/1624603985 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fe2cc002ac0 con 0x7fe2dc0c8cf0 2026-02-17T21:25:38.809 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.808+0000 7fe2c2ffd640 1 --2- 10.20.193.5:0/1624603985 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe2ac079280 0x7fe2ac07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.808+0000 7fe2e1b58640 1 --2- 10.20.193.5:0/1624603985 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe2ac079280 0x7fe2ac07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.808+0000 7fe2e1b58640 10 monclient: get_auth_request con 0x7fe2ac079280 auth_method 0 2026-02-17T21:25:38.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.809+0000 7fe2c2ffd640 10 client.4546.objecter ms_handle_connect 0x7fe2ac079280 2026-02-17T21:25:38.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.809+0000 7fe2e1b58640 1 --2- 10.20.193.5:0/1624603985 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe2ac079280 0x7fe2ac07b740 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc06ea30 tx=0x7fe2d0031000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.811 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.810+0000 7fe2c2ffd640 1 -- 10.20.193.5:0/1624603985 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fe2cc05e240 con 0x7fe2dc0c8cf0 2026-02-17T21:25:38.811 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.810+0000 7fe2c2ffd640 10 client.4546.objecter ms_dispatch2 0x7fe2dc000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:38.811 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.810+0000 7fe2c2ffd640 3 client.4546.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:38.811 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.810+0000 7fe2c2ffd640 3 client.4546.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:38.811 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.810+0000 7fe2c2ffd640 20 client.4546.objecter dump_active .. 0 homeless 2026-02-17T21:25:38.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.817+0000 7fe2c2ffd640 1 -- 10.20.193.5:0/1624603985 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe2cc062900 con 0x7fe2dc0c8cf0 2026-02-17T21:25:38.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.817+0000 7fe2c2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.817+0000 7fe2c2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:38.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.818+0000 7fcbf6ffd640 1 -- 10.20.193.5:0/1706919332 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe803c070 con 0x7fcbf80ccc00 2026-02-17T21:25:38.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.818+0000 7fcbf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.818+0000 7fcbf6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:38.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.818+0000 7fcbf6ffd640 10 monclient: dump: 2026-02-17T21:25:38.821 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.821 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.821 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.821 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.821 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.821 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.821 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.821 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.821 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.821 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.818+0000 7fcbf6ffd640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.822 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.818+0000 7fcbf6ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.822 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.818+0000 7fcbf6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.822 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.818+0000 7fcbf6ffd640 1 -- 10.20.193.5:0/1706919332 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe802fb10 con 0x7fcbf80ccc00 2026-02-17T21:25:38.822 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.818+0000 7fcbf6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.822 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.818+0000 7fcbf6ffd640 1 -- 10.20.193.5:0/1706919332 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8037440 con 0x7fcbf80ccc00 2026-02-17T21:25:38.822 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.818+0000 7fcbf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.822 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.818+0000 7fcbf6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:38.822 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.818+0000 7fcbf6ffd640 10 monclient: dump: 2026-02-17T21:25:38.822 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.822 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.822 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.822 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.823 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.823 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.823 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.823 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.823 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.823 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.818+0000 7fcbfe4cd640 5 monclient: authenticate success, global_id 4549 2026-02-17T21:25:38.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.818+0000 7fcbfe4cd640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:38.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.818+0000 7fcbfe4cd640 4 set_mon_vals no callback set 2026-02-17T21:25:38.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.818+0000 7fcbfe4cd640 10 monclient: shutdown 2026-02-17T21:25:38.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.818+0000 7fcbfe4cd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.818+0000 7fcbfe4cd640 1 -- 10.20.193.5:0/1706919332 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fcbf80ccc00 msgr2=0x7fcbf8156120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.824 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.818+0000 7fcbfe4cd640 1 --2- 10.20.193.5:0/1706919332 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fcbf80ccc00 0x7fcbf8156120 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8009970 tx=0x7fcbe802ee90 comp rx=0 tx=0).stop 2026-02-17T21:25:38.824 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.818+0000 7fcbfe4cd640 1 -- 10.20.193.5:0/1706919332 shutdown_connections 2026-02-17T21:25:38.824 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.818+0000 7fcbfe4cd640 1 --2- 10.20.193.5:0/1706919332 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fcbf80ccc00 0x7fcbf8156120 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.824 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.818+0000 7fcbfe4cd640 1 -- 10.20.193.5:0/1706919332 >> 10.20.193.5:0/1706919332 conn(0x7fcbf80cc0e0 msgr2=0x7fcbf80cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.824 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.819+0000 7fcbfe4cd640 1 -- 10.20.193.5:0/1706919332 shutdown_connections 2026-02-17T21:25:38.824 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.819+0000 7fcbfe4cd640 1 -- 10.20.193.5:0/1706919332 wait complete. 2026-02-17T21:25:38.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.819+0000 7fcbfe4cd640 10 monclient: build_initial_monmap 2026-02-17T21:25:38.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.819+0000 7fcbfe4cd640 10 monclient: monmap: 2026-02-17T21:25:38.828 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:38.828 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:38.828 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:38.829 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:38.829 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:38.829 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.829 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:38.829 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:38.829 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:38.829 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.820+0000 7fcbfe4cd640 1 librados: starting msgr at 2026-02-17T21:25:38.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.820+0000 7fcbfe4cd640 1 librados: starting objecter 2026-02-17T21:25:38.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.820+0000 7fcbfe4cd640 1 Processor -- start 2026-02-17T21:25:38.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.820+0000 7fcbfe4cd640 1 -- start start 2026-02-17T21:25:38.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.820+0000 7fcbfe4cd640 1 librados: setting wanted keys 2026-02-17T21:25:38.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.820+0000 7fcbfe4cd640 1 librados: calling monclient init 2026-02-17T21:25:38.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.820+0000 7fcbfe4cd640 10 monclient: init 2026-02-17T21:25:38.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.820+0000 7fcbfe4cd640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:38.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.820+0000 7fcbfe4cd640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:25:38.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.820+0000 7fcbfe4cd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fcbf80caff0 0x7fcbf8158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.820+0000 7fcbfe4cd640 10 monclient(hunting): picked mon.noname-a con 0x7fcbf80caff0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:38.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.820+0000 7fcbfe4cd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fcbf80ccc00 0x7fcbf8159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.820+0000 7fcbfe4cd640 10 monclient(hunting): picked mon.noname-c con 0x7fcbf80ccc00 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:38.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.820+0000 7fcbfe4cd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fcbf8155d40 0x7fcbf815f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.820+0000 7fcbfe4cd640 10 monclient(hunting): picked mon.noname-b con 0x7fcbf8155d40 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:38.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.820+0000 7fcbfe4cd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.820+0000 7fcbfe4cd640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf806d0a0 con 0x7fcbf80caff0 2026-02-17T21:25:38.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.820+0000 7fcbfe4cd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.820+0000 7fcbfe4cd640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf806d410 con 0x7fcbf8155d40 2026-02-17T21:25:38.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.820+0000 7fcbfe4cd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:38.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.820+0000 7fcbfe4cd640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf815d9b0 con 0x7fcbf80ccc00 2026-02-17T21:25:38.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.820+0000 7fcbfe4cd640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:38.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.820+0000 7fcbfe4cd640 10 monclient(hunting): authenticate will time out at 1044.385779s 2026-02-17T21:25:38.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.821+0000 7fcbfca43640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fcbf8155d40 0x7fcbf815f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.821+0000 7fcbf77fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fcbf80ccc00 0x7fcbf8159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.821+0000 7fcbfca43640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fcbf8155d40 0x7fcbf815f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:60172/0 (socket says 10.20.193.5:60172) 2026-02-17T21:25:38.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.821+0000 7fcbfca43640 1 -- 10.20.193.5:0/3184097759 learned_addr learned my addr 10.20.193.5:0/3184097759 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:38.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.821+0000 7fcbfca43640 10 monclient(hunting): get_auth_request con 0x7fcbf8155d40 auth_method 0 2026-02-17T21:25:38.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.821+0000 7fcbfca43640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.821+0000 7fcbfca43640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.821+0000 7fcbfca43640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.821+0000 7fcbf77fe640 10 monclient(hunting): get_auth_request con 0x7fcbf80ccc00 auth_method 0 2026-02-17T21:25:38.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.821+0000 7fcbf77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:38.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.821+0000 7fcbf77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:38.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.821+0000 7fcbf77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:38.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.821+0000 7fcbfca43640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.821+0000 7fcbfca43640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.821+0000 7fcbfca43640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.821+0000 7fcbf77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:38.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.821+0000 7fcbf77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:38.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.821+0000 7fcbf77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:38.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.822+0000 7fcbfca43640 10 monclient(hunting): handle_auth_done global_id 4552 payload 824 2026-02-17T21:25:38.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.822+0000 7fcbfca43640 1 -- 10.20.193.5:0/3184097759 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fcbf80ccc00 msgr2=0x7fcbf8159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.822+0000 7fcbfca43640 1 --2- 10.20.193.5:0/3184097759 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fcbf80ccc00 0x7fcbf8159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.822+0000 7fcbfca43640 1 -- 10.20.193.5:0/3184097759 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fcbf80caff0 msgr2=0x7fcbf8158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.822+0000 7fcbfca43640 1 --2- 10.20.193.5:0/3184097759 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fcbf80caff0 0x7fcbf8158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.822+0000 7fcbfca43640 10 monclient: _finish_hunting 0 2026-02-17T21:25:38.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.822+0000 7fcbfca43640 1 monclient: found mon.noname-b 2026-02-17T21:25:38.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.822+0000 7fcbfca43640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:38.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.822+0000 7fcbfca43640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.822+0000 7fcbfca43640 1 -- 10.20.193.5:0/3184097759 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf8157410 con 0x7fcbf8155d40 2026-02-17T21:25:38.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.823+0000 7fcbfca43640 1 --2- 10.20.193.5:0/3184097759 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fcbf8155d40 0x7fcbf815f890 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcbec00b990 tx=0x7fcbec00be60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.823+0000 7fcbf4ff9640 10 client.?.objecter ms_handle_connect 0x7fcbf8155d40 2026-02-17T21:25:38.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.823+0000 7fcbf4ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:38.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.825+0000 7fcbf4ff9640 1 -- 10.20.193.5:0/3184097759 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbec00c790 con 0x7fcbf8155d40 2026-02-17T21:25:38.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.825+0000 7fcbf4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.825+0000 7fcbf4ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:38.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.825+0000 7fcbf4ff9640 10 monclient: dump: 2026-02-17T21:25:38.834 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.834 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.834 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.834 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.834 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.834 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.834 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.834 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.835 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.835 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.825+0000 7fcbf4ff9640 10 monclient: _finish_auth 0 2026-02-17T21:25:38.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.825+0000 7fcbf4ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:25:38.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.825+0000 7fcbf4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:38.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.825+0000 7fcbf4ff9640 1 -- 10.20.193.5:0/3184097759 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbec010070 con 0x7fcbf8155d40 2026-02-17T21:25:38.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.825+0000 7fcbf4ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:38.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.825+0000 7fcbf4ff9640 1 -- 10.20.193.5:0/3184097759 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbec00cbb0 con 0x7fcbf8155d40 2026-02-17T21:25:38.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.825+0000 7fcbfe4cd640 5 monclient: authenticate success, global_id 4552 2026-02-17T21:25:38.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.825+0000 7fcbf67fc640 4 set_mon_vals no callback set 2026-02-17T21:25:38.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.825+0000 7fcbfe4cd640 10 monclient: _renew_subs 2026-02-17T21:25:38.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.825+0000 7fcbfe4cd640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.825+0000 7fcbfe4cd640 1 -- 10.20.193.5:0/3184097759 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbf81576f0 con 0x7fcbf8155d40 2026-02-17T21:25:38.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.825+0000 7fcbf4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:38.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.825+0000 7fcbf4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:38.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.825+0000 7fcbf4ff9640 10 monclient: dump: 2026-02-17T21:25:38.836 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:38.836 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:38.836 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.836 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:38.836 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:38.836 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:38.836 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:38.836 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:38.836 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:38.837 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:38.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.825+0000 7fcbfe4cd640 10 client.4552.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:38.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.825+0000 7fcbfe4cd640 10 monclient: _renew_subs 2026-02-17T21:25:38.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.825+0000 7fcbfe4cd640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.825+0000 7fcbfe4cd640 1 -- 10.20.193.5:0/3184097759 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbf815f0b0 con 0x7fcbf8155d40 2026-02-17T21:25:38.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.825+0000 7fcbfe4cd640 1 librados: init done 2026-02-17T21:25:38.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.826+0000 7fcbfe4cd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.826+0000 7fcbfe4cd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.826+0000 7fcbfe4cd640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.826+0000 7fcbfe4cd640 1 -- 10.20.193.5:0/3184097759 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbf8073080 con 0x7fcbf8155d40 2026-02-17T21:25:38.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.837+0000 7fcbf4ff9640 1 -- 10.20.193.5:0/3184097759 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fcbec004070 con 0x7fcbf8155d40 2026-02-17T21:25:38.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.837+0000 7fcbf4ff9640 1 --2- 10.20.193.5:0/3184097759 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fcbc80792d0 0x7fcbc807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:38.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.837+0000 7fcbf7fff640 1 --2- 10.20.193.5:0/3184097759 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fcbc80792d0 0x7fcbc807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:38.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.837+0000 7fcbf7fff640 10 monclient: get_auth_request con 0x7fcbc80792d0 auth_method 0 2026-02-17T21:25:38.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.838+0000 7fcbf4ff9640 10 client.4552.objecter ms_handle_connect 0x7fcbc80792d0 2026-02-17T21:25:38.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.838+0000 7fcbf7fff640 1 --2- 10.20.193.5:0/3184097759 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fcbc80792d0 0x7fcbc807b790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4002e60 tx=0x7fcbe4007a70 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:38.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.839+0000 7fcbf4ff9640 1 -- 10.20.193.5:0/3184097759 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fcbec00cd50 con 0x7fcbf8155d40 2026-02-17T21:25:38.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.839+0000 7fcbf4ff9640 10 client.4552.objecter ms_dispatch2 0x7fcbf8000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:38.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.839+0000 7fcbf4ff9640 3 client.4552.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:38.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.839+0000 7fcbf4ff9640 3 client.4552.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:38.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.839+0000 7fcbf4ff9640 20 client.4552.objecter dump_active .. 0 homeless 2026-02-17T21:25:38.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.856+0000 7f9bfafa1640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T21:25:38.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.856+0000 7f9bfafa1640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T21:25:38.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.856+0000 7f9bfafa1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:38.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.856+0000 7f9bfafa1640 1 -- 10.20.193.5:0/929887899 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9bf406e7b0 con 0x7f9bf415d950 2026-02-17T21:25:38.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.859+0000 7f9be97fa640 1 -- 10.20.193.5:0/929887899 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9bf0050070 con 0x7f9bf415d950 2026-02-17T21:25:38.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.859+0000 7f9be97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T21:25:38.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.859+0000 7f9be97fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:38.861 INFO:teuthology.orchestra.run.trial005.stdout:115964117001 2026-02-17T21:25:38.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.861+0000 7f9bfafa1640 10 librados: watch_flush enter 2026-02-17T21:25:38.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.861+0000 7f9bfafa1640 10 librados: watch_flush exit 2026-02-17T21:25:38.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.861+0000 7f6b0effd640 1 -- 10.20.193.5:0/2614929990 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6b1c024080 con 0x7f6b280c74c0 2026-02-17T21:25:38.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.861+0000 7f6b0effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.861+0000 7f6b0effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:38.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.861+0000 7f9bfafa1640 20 client.4586.objecter shutdown clearing up homeless session... 2026-02-17T21:25:38.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.861+0000 7f9bfafa1640 10 client.4586.objecter successfully canceled tick 2026-02-17T21:25:38.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.861+0000 7f9bfafa1640 1 -- 10.20.193.5:0/929887899 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9bc4079300 msgr2=0x7f9bc407b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.861+0000 7f9bfafa1640 1 --2- 10.20.193.5:0/929887899 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9bc4079300 0x7f9bc407b7c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9be4006fd0 tx=0x7f9be4009190 comp rx=0 tx=0).stop 2026-02-17T21:25:38.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.861+0000 7f9bfafa1640 10 monclient: shutdown 2026-02-17T21:25:38.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.861+0000 7f9bfafa1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.861+0000 7f9bfafa1640 1 -- 10.20.193.5:0/929887899 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9bf415d950 msgr2=0x7f9bf41570c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.861+0000 7f9bfafa1640 1 --2- 10.20.193.5:0/929887899 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9bf415d950 0x7f9bf41570c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0039040 tx=0x7f9bf0004b40 comp rx=0 tx=0).stop 2026-02-17T21:25:38.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.861+0000 7f9bfafa1640 1 -- 10.20.193.5:0/929887899 shutdown_connections 2026-02-17T21:25:38.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.861+0000 7f9bfafa1640 1 --2- 10.20.193.5:0/929887899 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9bc4079300 0x7f9bc407b7c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.861+0000 7f9bfafa1640 1 --2- 10.20.193.5:0/929887899 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9bf415d950 0x7f9bf41570c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.861+0000 7f9bfafa1640 1 --2- 10.20.193.5:0/929887899 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9bf415c840 0x7f9bf40d0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.861+0000 7f9bfafa1640 1 --2- 10.20.193.5:0/929887899 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9bf40d1b60 0x7f9bf4148590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.861+0000 7f9bfafa1640 1 -- 10.20.193.5:0/929887899 >> 10.20.193.5:0/929887899 conn(0x7f9bf406d9b0 msgr2=0x7f9bf40d0050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.862+0000 7f9bfafa1640 1 -- 10.20.193.5:0/929887899 shutdown_connections 2026-02-17T21:25:38.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.862+0000 7f9bfafa1640 1 -- 10.20.193.5:0/929887899 wait complete. 2026-02-17T21:25:38.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.862+0000 7f9bfafa1640 1 librados: shutdown 2026-02-17T21:25:38.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117001 got 115964117001 for osd.6 2026-02-17T21:25:38.872 DEBUG:teuthology.parallel:result is None 2026-02-17T21:25:38.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.905+0000 7fe2e45e4640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T21:25:38.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.905+0000 7fe2e45e4640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T21:25:38.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.905+0000 7fe2e45e4640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:38.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.905+0000 7fe2e45e4640 1 -- 10.20.193.5:0/1624603985 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 14} v 0) -- 0x7fe2dc14fb70 con 0x7fe2dc0c8cf0 2026-02-17T21:25:38.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.942+0000 7fcbf4ff9640 1 -- 10.20.193.5:0/3184097759 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcbec062640 con 0x7fcbf8155d40 2026-02-17T21:25:38.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.942+0000 7fcbf4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:38.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.942+0000 7fcbf4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:38.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.942+0000 7fe2c2ffd640 1 -- 10.20.193.5:0/1624603985 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 14}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fe2cc062200 con 0x7fe2dc0c8cf0 2026-02-17T21:25:38.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.943+0000 7fe2c2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T21:25:38.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.943+0000 7fe2c2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:38.944 INFO:teuthology.orchestra.run.trial005.stdout:103079215110 2026-02-17T21:25:38.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.945+0000 7fe2e45e4640 10 librados: watch_flush enter 2026-02-17T21:25:38.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.945+0000 7fe2e45e4640 10 librados: watch_flush exit 2026-02-17T21:25:38.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.945+0000 7fe2e45e4640 20 client.4546.objecter shutdown clearing up homeless session... 2026-02-17T21:25:38.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.945+0000 7fe2e45e4640 10 client.4546.objecter successfully canceled tick 2026-02-17T21:25:38.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.945+0000 7fe2e45e4640 1 -- 10.20.193.5:0/1624603985 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe2ac079280 msgr2=0x7fe2ac07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.945+0000 7fe2e45e4640 1 --2- 10.20.193.5:0/1624603985 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe2ac079280 0x7fe2ac07b740 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc06ea30 tx=0x7fe2d0031000 comp rx=0 tx=0).stop 2026-02-17T21:25:38.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.945+0000 7fe2e45e4640 10 monclient: shutdown 2026-02-17T21:25:38.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.945+0000 7fe2e45e4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.945+0000 7fe2e45e4640 1 -- 10.20.193.5:0/1624603985 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe2dc0c8cf0 msgr2=0x7fe2dc1f3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.945+0000 7fe2e45e4640 1 --2- 10.20.193.5:0/1624603985 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe2dc0c8cf0 0x7fe2dc1f3870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00b500 tx=0x7fe2cc00b9d0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.945+0000 7fe2e45e4640 1 -- 10.20.193.5:0/1624603985 shutdown_connections 2026-02-17T21:25:38.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.945+0000 7fe2e45e4640 1 --2- 10.20.193.5:0/1624603985 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe2ac079280 0x7fe2ac07b740 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.945+0000 7fe2e45e4640 1 --2- 10.20.193.5:0/1624603985 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe2dc15d810 0x7fe2dc0cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.945+0000 7fe2e45e4640 1 --2- 10.20.193.5:0/1624603985 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe2dc1527c0 0x7fe2dc1f7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.945+0000 7fe2e45e4640 1 --2- 10.20.193.5:0/1624603985 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe2dc0c8cf0 0x7fe2dc1f3870 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.945+0000 7fe2e45e4640 1 -- 10.20.193.5:0/1624603985 >> 10.20.193.5:0/1624603985 conn(0x7fe2dc073030 msgr2=0x7fe2dc148160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.945+0000 7fe2e45e4640 1 -- 10.20.193.5:0/1624603985 shutdown_connections 2026-02-17T21:25:38.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.945+0000 7fe2e45e4640 1 -- 10.20.193.5:0/1624603985 wait complete. 2026-02-17T21:25:38.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.945+0000 7fe2e45e4640 1 librados: shutdown 2026-02-17T21:25:38.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.947+0000 7f6b2cabd640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T21:25:38.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.947+0000 7f6b2cabd640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T21:25:38.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.947+0000 7f6b2cabd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:38.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.947+0000 7f6b2cabd640 1 -- 10.20.193.5:0/2614929990 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6b280700e0 con 0x7f6b280c74c0 2026-02-17T21:25:38.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.950+0000 7f6b0effd640 1 -- 10.20.193.5:0/2614929990 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6b1c068e20 con 0x7f6b280c74c0 2026-02-17T21:25:38.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.950+0000 7f6b0effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T21:25:38.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.950+0000 7f6b0effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:38.951 INFO:teuthology.orchestra.run.trial005.stdout:120259084296 2026-02-17T21:25:38.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.951+0000 7f6b2cabd640 10 librados: watch_flush enter 2026-02-17T21:25:38.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.951+0000 7f6b2cabd640 10 librados: watch_flush exit 2026-02-17T21:25:38.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.951+0000 7f6b2cabd640 20 client.4527.objecter shutdown clearing up homeless session... 2026-02-17T21:25:38.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.951+0000 7f6b2cabd640 10 client.4527.objecter successfully canceled tick 2026-02-17T21:25:38.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.951+0000 7f6b2cabd640 1 -- 10.20.193.5:0/2614929990 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6af40792d0 msgr2=0x7f6af407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.951+0000 7f6b2cabd640 1 --2- 10.20.193.5:0/2614929990 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6af40792d0 0x7f6af407b790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6b10002770 tx=0x7f6b10007ab0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.951+0000 7f6b2cabd640 10 monclient: shutdown 2026-02-17T21:25:38.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.951+0000 7f6b2cabd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:38.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.951+0000 7f6b2cabd640 1 -- 10.20.193.5:0/2614929990 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6b280c74c0 msgr2=0x7f6b28148cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:38.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.951+0000 7f6b2cabd640 1 --2- 10.20.193.5:0/2614929990 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6b280c74c0 0x7f6b28148cb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00b7b0 tx=0x7f6b1c00bc80 comp rx=0 tx=0).stop 2026-02-17T21:25:38.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.951+0000 7f6b2cabd640 1 -- 10.20.193.5:0/2614929990 shutdown_connections 2026-02-17T21:25:38.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.951+0000 7f6b2cabd640 1 --2- 10.20.193.5:0/2614929990 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6af40792d0 0x7f6af407b790 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.951+0000 7f6b2cabd640 1 --2- 10.20.193.5:0/2614929990 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6b2815d370 0x7f6b280cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.951+0000 7f6b2cabd640 1 --2- 10.20.193.5:0/2614929990 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6b280c7e20 0x7f6b280cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.951+0000 7f6b2cabd640 1 --2- 10.20.193.5:0/2614929990 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6b280c74c0 0x7f6b28148cb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:38.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.951+0000 7f6b2cabd640 1 -- 10.20.193.5:0/2614929990 >> 10.20.193.5:0/2614929990 conn(0x7f6b280c9f20 msgr2=0x7f6b280ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:38.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.952+0000 7f6b2cabd640 1 -- 10.20.193.5:0/2614929990 shutdown_connections 2026-02-17T21:25:38.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.952+0000 7f6b2cabd640 1 -- 10.20.193.5:0/2614929990 wait complete. 2026-02-17T21:25:38.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:38.952+0000 7f6b2cabd640 1 librados: shutdown 2026-02-17T21:25:38.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215109 got 103079215110 for osd.14 2026-02-17T21:25:38.957 DEBUG:teuthology.parallel:result is None 2026-02-17T21:25:38.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084296 got 120259084296 for osd.2 2026-02-17T21:25:38.961 DEBUG:teuthology.parallel:result is None 2026-02-17T21:25:39.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.025+0000 7fcbfe4cd640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-17T21:25:39.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.025+0000 7fcbfe4cd640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-17T21:25:39.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.025+0000 7fcbfe4cd640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.025+0000 7fcbfe4cd640 1 -- 10.20.193.5:0/3184097759 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fcbf815d5f0 con 0x7fcbf8155d40 2026-02-17T21:25:39.029 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.028+0000 7fcbf4ff9640 1 -- 10.20.193.5:0/3184097759 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcbec061f40 con 0x7fcbf8155d40 2026-02-17T21:25:39.029 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.028+0000 7fcbf4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-17T21:25:39.029 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.028+0000 7fcbf4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:39.030 INFO:teuthology.orchestra.run.trial005.stdout:120259084295 2026-02-17T21:25:39.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.029+0000 7fcbfe4cd640 10 librados: watch_flush enter 2026-02-17T21:25:39.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.029+0000 7fcbfe4cd640 10 librados: watch_flush exit 2026-02-17T21:25:39.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.029+0000 7fcbfe4cd640 20 client.4552.objecter shutdown clearing up homeless session... 2026-02-17T21:25:39.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.029+0000 7fcbfe4cd640 10 client.4552.objecter successfully canceled tick 2026-02-17T21:25:39.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.029+0000 7fcbfe4cd640 1 -- 10.20.193.5:0/3184097759 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fcbc80792d0 msgr2=0x7fcbc807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.029+0000 7fcbfe4cd640 1 --2- 10.20.193.5:0/3184097759 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fcbc80792d0 0x7fcbc807b790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4002e60 tx=0x7fcbe4007a70 comp rx=0 tx=0).stop 2026-02-17T21:25:39.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.029+0000 7fcbfe4cd640 10 monclient: shutdown 2026-02-17T21:25:39.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.029+0000 7fcbfe4cd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:39.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.029+0000 7fcbfe4cd640 1 -- 10.20.193.5:0/3184097759 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fcbf8155d40 msgr2=0x7fcbf815f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.029+0000 7fcbfe4cd640 1 --2- 10.20.193.5:0/3184097759 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fcbf8155d40 0x7fcbf815f890 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcbec00b990 tx=0x7fcbec00be60 comp rx=0 tx=0).stop 2026-02-17T21:25:39.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.029+0000 7fcbfe4cd640 1 -- 10.20.193.5:0/3184097759 shutdown_connections 2026-02-17T21:25:39.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.029+0000 7fcbfe4cd640 1 --2- 10.20.193.5:0/3184097759 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fcbc80792d0 0x7fcbc807b790 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.029+0000 7fcbfe4cd640 1 --2- 10.20.193.5:0/3184097759 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fcbf8155d40 0x7fcbf815f890 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.029+0000 7fcbfe4cd640 1 --2- 10.20.193.5:0/3184097759 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fcbf80ccc00 0x7fcbf8159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.029+0000 7fcbfe4cd640 1 --2- 10.20.193.5:0/3184097759 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fcbf80caff0 0x7fcbf8158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.029+0000 7fcbfe4cd640 1 -- 10.20.193.5:0/3184097759 >> 10.20.193.5:0/3184097759 conn(0x7fcbf80cc0e0 msgr2=0x7fcbf8070400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:39.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.029+0000 7fcbfe4cd640 1 -- 10.20.193.5:0/3184097759 shutdown_connections 2026-02-17T21:25:39.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.029+0000 7fcbfe4cd640 1 -- 10.20.193.5:0/3184097759 wait complete. 2026-02-17T21:25:39.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.029+0000 7fcbfe4cd640 1 librados: shutdown 2026-02-17T21:25:39.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084295 got 120259084295 for osd.8 2026-02-17T21:25:39.039 DEBUG:teuthology.parallel:result is None 2026-02-17T21:25:39.202 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T21:25:39.229 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T21:25:39.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.271+0000 7f38edb19640 10 monclient: get_monmap_and_config 2026-02-17T21:25:39.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.271+0000 7f38edb19640 10 monclient: build_initial_monmap 2026-02-17T21:25:39.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.271+0000 7f38edb19640 10 monclient: monmap: 2026-02-17T21:25:39.273 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:39.273 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.273 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:39.271881+0000 2026-02-17T21:25:39.273 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:39.271881+0000 2026-02-17T21:25:39.273 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:39.273 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.273 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:39.273 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:39.273 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:39.273 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:39.273 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:39.274 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:39.274 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.271+0000 7f38edb19640 1 Processor -- start 2026-02-17T21:25:39.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.271+0000 7f38edb19640 1 -- start start 2026-02-17T21:25:39.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.271+0000 7f38edb19640 10 monclient: init 2026-02-17T21:25:39.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.272+0000 7f38edb19640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:39.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.272+0000 7f38edb19640 10 monclient: _add_conns ranks=[5,4,0,2,1,3] 2026-02-17T21:25:39.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.272+0000 7f38edb19640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f38e80ce5d0 0x7f38e80d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.272+0000 7f38edb19640 10 monclient(hunting): picked mon.noname-c con 0x7f38e80ce5d0 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:39.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.272+0000 7f38edb19640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f38e815bf30 0x7f38e80ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.272+0000 7f38edb19640 10 monclient(hunting): picked mon.noname-b con 0x7f38e815bf30 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:39.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.272+0000 7f38edb19640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f38e80ceef0 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:39.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.272+0000 7f38edb19640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38e80d1e00 con 0x7f38e80ceef0 2026-02-17T21:25:39.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.272+0000 7f38edb19640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.272+0000 7f38edb19640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f38e80d20d0 con 0x7f38e815bf30 2026-02-17T21:25:39.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.272+0000 7f38edb19640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.272+0000 7f38edb19640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f38e80d23b0 con 0x7f38e80ce5d0 2026-02-17T21:25:39.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.272+0000 7f38edb19640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:39.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.272+0000 7f38edb19640 10 monclient(hunting): authenticate will time out at 1044.837407s 2026-02-17T21:25:39.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.272+0000 7f38e7fff640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f38e80ceef0 0x7f38e80c9780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:37592/0 (socket says 10.20.193.5:37592) 2026-02-17T21:25:39.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.272+0000 7f38e7fff640 1 -- 10.20.193.5:0/2340781813 learned_addr learned my addr 10.20.193.5:0/2340781813 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:39.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.272+0000 7f38e6ffd640 1 --2- 10.20.193.5:0/2340781813 >> v2:10.20.193.119:3300/0 conn(0x7f38e815bf30 0x7f38e80ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.272+0000 7f38e77fe640 1 --2- 10.20.193.5:0/2340781813 >> v2:10.20.193.135:3300/0 conn(0x7f38e80ce5d0 0x7f38e80d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.273+0000 7f38e6ffd640 10 monclient(hunting): get_auth_request con 0x7f38e815bf30 auth_method 0 2026-02-17T21:25:39.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.273+0000 7f38e6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.273+0000 7f38e6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.273+0000 7f38e6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.273+0000 7f38e77fe640 10 monclient(hunting): get_auth_request con 0x7f38e80ce5d0 auth_method 0 2026-02-17T21:25:39.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.273+0000 7f38e77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.273+0000 7f38e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.273+0000 7f38e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.273+0000 7f38e6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.273+0000 7f38e6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.273+0000 7f38e6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.273+0000 7f38e77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.273+0000 7f38e77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.273+0000 7f38e77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.274+0000 7f38e6ffd640 10 monclient(hunting): handle_auth_done global_id 4555 payload 274 2026-02-17T21:25:39.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.274+0000 7f38e6ffd640 1 -- 10.20.193.5:0/2340781813 >> v2:10.20.193.135:3300/0 conn(0x7f38e80ce5d0 msgr2=0x7f38e80d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:39.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.274+0000 7f38e6ffd640 1 --2- 10.20.193.5:0/2340781813 >> v2:10.20.193.135:3300/0 conn(0x7f38e80ce5d0 0x7f38e80d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.274+0000 7f38e6ffd640 1 -- 10.20.193.5:0/2340781813 >> v1:10.20.193.5:6789/0 conn(0x7f38e80ceef0 legacy=0x7f38e80c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.274+0000 7f38e6ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:25:39.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.274+0000 7f38e6ffd640 1 monclient: found mon.noname-b 2026-02-17T21:25:39.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.274+0000 7f38e6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:39.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.274+0000 7f38e6ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.274+0000 7f38e6ffd640 1 -- 10.20.193.5:0/2340781813 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e80d2690 con 0x7f38e815bf30 2026-02-17T21:25:39.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.275+0000 7f38e6ffd640 1 --2- 10.20.193.5:0/2340781813 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f38e815bf30 0x7f38e80ce9b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f38e80cf4c0 tx=0x7f38d802ede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c3a9219e1b24a98 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.276+0000 7f38e67fc640 1 -- 10.20.193.5:0/2340781813 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d803c070 con 0x7f38e815bf30 2026-02-17T21:25:39.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.276+0000 7f38e67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.276+0000 7f38e67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:39.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.276+0000 7f38e67fc640 10 monclient: dump: 2026-02-17T21:25:39.287 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.287 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.287 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.287 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.287 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.287 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.287 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.287 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.288 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.288 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.276+0000 7f38e67fc640 10 monclient: _finish_auth 0 2026-02-17T21:25:39.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.276+0000 7f38e67fc640 10 monclient: _check_auth_tickets 2026-02-17T21:25:39.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.276+0000 7f38e67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:39.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.276+0000 7f38e67fc640 1 -- 10.20.193.5:0/2340781813 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38d802faf0 con 0x7f38e815bf30 2026-02-17T21:25:39.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.276+0000 7f38edb19640 5 monclient: authenticate success, global_id 4555 2026-02-17T21:25:39.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.276+0000 7f38e67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:39.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.276+0000 7f38edb19640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:39.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.276+0000 7f38edb19640 4 set_mon_vals no callback set 2026-02-17T21:25:39.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.276+0000 7f38e67fc640 1 -- 10.20.193.5:0/2340781813 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d8037440 con 0x7f38e815bf30 2026-02-17T21:25:39.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.276+0000 7f38e67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.276+0000 7f38e67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:39.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.276+0000 7f38e67fc640 10 monclient: dump: 2026-02-17T21:25:39.289 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.289 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.289 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.289 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.289 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.289 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.289 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.289 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.289 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.289 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.277+0000 7f38edb19640 10 monclient: shutdown 2026-02-17T21:25:39.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.277+0000 7f38edb19640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:39.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.277+0000 7f38edb19640 1 -- 10.20.193.5:0/2340781813 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f38e815bf30 msgr2=0x7f38e80ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.277+0000 7f38edb19640 1 --2- 10.20.193.5:0/2340781813 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f38e815bf30 0x7f38e80ce9b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f38e80cf4c0 tx=0x7f38d802ede0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.277+0000 7f38edb19640 1 -- 10.20.193.5:0/2340781813 shutdown_connections 2026-02-17T21:25:39.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.277+0000 7f38edb19640 1 --2- 10.20.193.5:0/2340781813 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f38e815bf30 0x7f38e80ce9b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.277+0000 7f38edb19640 1 --2- 10.20.193.5:0/2340781813 >> v2:10.20.193.135:3300/0 conn(0x7f38e80ce5d0 0x7f38e80d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.277+0000 7f38edb19640 1 -- 10.20.193.5:0/2340781813 >> 10.20.193.5:0/2340781813 conn(0x7f38e8073030 msgr2=0x7f38e8073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:39.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.277+0000 7f38edb19640 1 -- 10.20.193.5:0/2340781813 shutdown_connections 2026-02-17T21:25:39.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.277+0000 7f38edb19640 1 -- 10.20.193.5:0/2340781813 wait complete. 2026-02-17T21:25:39.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.277+0000 7f38edb19640 10 monclient: build_initial_monmap 2026-02-17T21:25:39.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.277+0000 7f38edb19640 10 monclient: monmap: 2026-02-17T21:25:39.291 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:39.291 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:39.291 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:39.291 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:39.291 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:39.291 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.291 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:39.291 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:39.291 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:39.291 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.277+0000 7f38edb19640 1 librados: starting msgr at 2026-02-17T21:25:39.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.277+0000 7f38edb19640 1 librados: starting objecter 2026-02-17T21:25:39.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.277+0000 7f38edb19640 1 Processor -- start 2026-02-17T21:25:39.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38edb19640 1 -- start start 2026-02-17T21:25:39.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38edb19640 1 librados: setting wanted keys 2026-02-17T21:25:39.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38edb19640 1 librados: calling monclient init 2026-02-17T21:25:39.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38edb19640 10 monclient: init 2026-02-17T21:25:39.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38edb19640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:39.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38edb19640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:25:39.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38edb19640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f38e80ce5d0 0x7f38e81f7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38edb19640 10 monclient(hunting): picked mon.noname-b con 0x7f38e80ce5d0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:39.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38edb19640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f38e80ceef0 0x7f38e815b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38edb19640 10 monclient(hunting): picked mon.noname-c con 0x7f38e80ceef0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:39.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38edb19640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f38e815bf30 0x7f38e80cfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38edb19640 10 monclient(hunting): picked mon.noname-a con 0x7f38e815bf30 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:39.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38edb19640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38edb19640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f38e80cbc30 con 0x7f38e815bf30 2026-02-17T21:25:39.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38edb19640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38edb19640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f38e80c9260 con 0x7f38e80ce5d0 2026-02-17T21:25:39.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38edb19640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38edb19640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f38e80d15b0 con 0x7f38e80ceef0 2026-02-17T21:25:39.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38edb19640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:39.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38edb19640 10 monclient(hunting): authenticate will time out at 1044.843411s 2026-02-17T21:25:39.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38e77fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f38e80ce5d0 0x7f38e81f7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38e7fff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f38e815bf30 0x7f38e80cfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38e6ffd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f38e80ceef0 0x7f38e815b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38e77fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f38e80ce5d0 0x7f38e81f7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:60192/0 (socket says 10.20.193.5:60192) 2026-02-17T21:25:39.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38e77fe640 1 -- 10.20.193.5:0/4091279194 learned_addr learned my addr 10.20.193.5:0/4091279194 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:39.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38e77fe640 10 monclient(hunting): get_auth_request con 0x7f38e80ce5d0 auth_method 0 2026-02-17T21:25:39.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38e77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38e6ffd640 10 monclient(hunting): get_auth_request con 0x7f38e80ceef0 auth_method 0 2026-02-17T21:25:39.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38e6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38e6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38e6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38e7fff640 10 monclient(hunting): get_auth_request con 0x7f38e815bf30 auth_method 0 2026-02-17T21:25:39.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38e7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.278+0000 7f38e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.279+0000 7f38e77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.279+0000 7f38e77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.279+0000 7f38e77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.279+0000 7f38e6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.279+0000 7f38e6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.279+0000 7f38e6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.279+0000 7f38e7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.279+0000 7f38e7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.279+0000 7f38e7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.280+0000 7f38e77fe640 10 monclient(hunting): handle_auth_done global_id 4558 payload 824 2026-02-17T21:25:39.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.280+0000 7f38e77fe640 1 -- 10.20.193.5:0/4091279194 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f38e80ceef0 msgr2=0x7f38e815b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.280+0000 7f38e77fe640 1 --2- 10.20.193.5:0/4091279194 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f38e80ceef0 0x7f38e815b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.280+0000 7f38e77fe640 1 -- 10.20.193.5:0/4091279194 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f38e815bf30 msgr2=0x7f38e80cfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.280+0000 7f38e77fe640 1 --2- 10.20.193.5:0/4091279194 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f38e815bf30 0x7f38e80cfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.280+0000 7f38e77fe640 10 monclient: _finish_hunting 0 2026-02-17T21:25:39.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.280+0000 7f38e77fe640 1 monclient: found mon.noname-b 2026-02-17T21:25:39.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.280+0000 7f38e77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:39.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.280+0000 7f38e77fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.280+0000 7f38e77fe640 1 -- 10.20.193.5:0/4091279194 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e80d06c0 con 0x7f38e80ce5d0 2026-02-17T21:25:39.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.280+0000 7f38e6ffd640 1 --2- 10.20.193.5:0/4091279194 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f38e80ceef0 0x7f38e815b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T21:25:39.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.281+0000 7f38e77fe640 1 --2- 10.20.193.5:0/4091279194 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f38e80ce5d0 0x7f38e81f7900 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f38d400e890 tx=0x7f38d400ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.281+0000 7f38c3fff640 10 client.?.objecter ms_handle_connect 0x7f38e80ce5d0 2026-02-17T21:25:39.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.281+0000 7f38c3fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:39.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.282+0000 7f38c3fff640 1 -- 10.20.193.5:0/4091279194 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d4017070 con 0x7f38e80ce5d0 2026-02-17T21:25:39.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.282+0000 7f38c3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.282+0000 7f38c3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:39.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.282+0000 7f38c3fff640 10 monclient: dump: 2026-02-17T21:25:39.297 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.297 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.297 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.297 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.297 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.297 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.297 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.297 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.297 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.297 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.282+0000 7f38c3fff640 10 monclient: _finish_auth 0 2026-02-17T21:25:39.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.282+0000 7f38c3fff640 10 monclient: _check_auth_tickets 2026-02-17T21:25:39.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.282+0000 7f38c3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:39.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.282+0000 7f38edb19640 5 monclient: authenticate success, global_id 4558 2026-02-17T21:25:39.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.282+0000 7f38edb19640 10 monclient: _renew_subs 2026-02-17T21:25:39.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.282+0000 7f38edb19640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.282+0000 7f38edb19640 1 -- 10.20.193.5:0/4091279194 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38e80d09a0 con 0x7f38e80ce5d0 2026-02-17T21:25:39.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.282+0000 7f38edb19640 10 client.4558.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:39.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.282+0000 7f38edb19640 10 monclient: _renew_subs 2026-02-17T21:25:39.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.282+0000 7f38edb19640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.282+0000 7f38edb19640 1 -- 10.20.193.5:0/4091279194 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38e80d0f60 con 0x7f38e80ce5d0 2026-02-17T21:25:39.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.282+0000 7f38edb19640 1 librados: init done 2026-02-17T21:25:39.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.282+0000 7f38c3fff640 1 -- 10.20.193.5:0/4091279194 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38d400c940 con 0x7f38e80ce5d0 2026-02-17T21:25:39.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.282+0000 7f38c3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:39.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.282+0000 7f38c3fff640 1 -- 10.20.193.5:0/4091279194 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d4021060 con 0x7f38e80ce5d0 2026-02-17T21:25:39.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.282+0000 7f38c3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.282+0000 7f38c3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:39.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.282+0000 7f38c3fff640 10 monclient: dump: 2026-02-17T21:25:39.299 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.299 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.299 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.299 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.299 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.299 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.299 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.300 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.300 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.300 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.282+0000 7f38e5ffb640 4 set_mon_vals no callback set 2026-02-17T21:25:39.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.282+0000 7f38edb19640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.283+0000 7f38edb19640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.283+0000 7f38edb19640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.283+0000 7f38edb19640 1 -- 10.20.193.5:0/4091279194 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38e80d18c0 con 0x7f38e80ce5d0 2026-02-17T21:25:39.300 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-17T21:25:39.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.293+0000 7f38c3fff640 1 -- 10.20.193.5:0/4091279194 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f38d4026480 con 0x7f38e80ce5d0 2026-02-17T21:25:39.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.294+0000 7f38c3fff640 1 --2- 10.20.193.5:0/4091279194 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f38b80792b0 0x7f38b807b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.294+0000 7f38e6ffd640 1 --2- 10.20.193.5:0/4091279194 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f38b80792b0 0x7f38b807b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.294+0000 7f38e6ffd640 10 monclient: get_auth_request con 0x7f38b80792b0 auth_method 0 2026-02-17T21:25:39.303 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.295+0000 7f38c3fff640 10 client.4558.objecter ms_handle_connect 0x7f38b80792b0 2026-02-17T21:25:39.303 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.295+0000 7f38e6ffd640 1 --2- 10.20.193.5:0/4091279194 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f38b80792b0 0x7f38b807b770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f38d8039000 tx=0x7f38d8033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.303 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.295+0000 7f38c3fff640 1 -- 10.20.193.5:0/4091279194 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f38d400ccf0 con 0x7f38e80ce5d0 2026-02-17T21:25:39.303 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.295+0000 7f38c3fff640 10 client.4558.objecter ms_dispatch2 0x7f38e8000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:39.303 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.295+0000 7f38c3fff640 3 client.4558.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:39.303 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.295+0000 7f38c3fff640 3 client.4558.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:39.303 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.295+0000 7f38c3fff640 20 client.4558.objecter dump_active .. 0 homeless 2026-02-17T21:25:39.311 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2026-02-17T21:25:39.314 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-17T21:25:39.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.313+0000 7f8f4cd03640 10 monclient: get_monmap_and_config 2026-02-17T21:25:39.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.313+0000 7f8f4cd03640 10 monclient: build_initial_monmap 2026-02-17T21:25:39.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.313+0000 7f8f4cd03640 10 monclient: monmap: 2026-02-17T21:25:39.317 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:39.317 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.317 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:39.313765+0000 2026-02-17T21:25:39.317 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:39.313765+0000 2026-02-17T21:25:39.317 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:39.317 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.317 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:39.317 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:39.317 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:39.317 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:39.317 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:39.318 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:39.318 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.313+0000 7f8f4cd03640 1 Processor -- start 2026-02-17T21:25:39.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.313+0000 7f8f4cd03640 1 -- start start 2026-02-17T21:25:39.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.313+0000 7f8f4cd03640 10 monclient: init 2026-02-17T21:25:39.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.314+0000 7f8f4cd03640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:39.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.314+0000 7f8f4cd03640 10 monclient: _add_conns ranks=[5,2,3,1,4,0] 2026-02-17T21:25:39.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.314+0000 7f8f4cd03640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f8f48155b60 0x7f8f48155f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.314+0000 7f8f4cd03640 10 monclient(hunting): picked mon.noname-c con 0x7f8f48155b60 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:39.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.314+0000 7f8f4cd03640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8f4815fdf0 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:39.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.314+0000 7f8f4cd03640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f8f480ccc50 0x7f8f480cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.314+0000 7f8f4cd03640 10 monclient(hunting): picked mon.noname-a con 0x7f8f480ccc50 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:39.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.314+0000 7f8f4cd03640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f48160270 con 0x7f8f4815fdf0 2026-02-17T21:25:39.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.314+0000 7f8f4cd03640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.314+0000 7f8f4cd03640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f8f4815d9f0 con 0x7f8f480ccc50 2026-02-17T21:25:39.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.314+0000 7f8f4cd03640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.314+0000 7f8f4cd03640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f8f4806c930 con 0x7f8f48155b60 2026-02-17T21:25:39.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.314+0000 7f8f4cd03640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:39.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.314+0000 7f8f4cd03640 10 monclient(hunting): authenticate will time out at 1044.879337s 2026-02-17T21:25:39.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.314+0000 7f8f46d76640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f8f480ccc50 0x7f8f480cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.314+0000 7f8f46575640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f8f48155b60 0x7f8f48155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.314+0000 7f8f46d76640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f8f480ccc50 0x7f8f480cb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:58682/0 (socket says 10.20.193.5:58682) 2026-02-17T21:25:39.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.314+0000 7f8f46d76640 1 -- 10.20.193.5:0/2719664166 learned_addr learned my addr 10.20.193.5:0/2719664166 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:39.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.314+0000 7f8f46d76640 10 monclient(hunting): get_auth_request con 0x7f8f480ccc50 auth_method 0 2026-02-17T21:25:39.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.314+0000 7f8f46d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.314+0000 7f8f46d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.314+0000 7f8f46d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.315+0000 7f8f46575640 10 monclient(hunting): get_auth_request con 0x7f8f48155b60 auth_method 0 2026-02-17T21:25:39.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.315+0000 7f8f46575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.315+0000 7f8f46575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.315+0000 7f8f46575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.315+0000 7f8f46d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.315+0000 7f8f46d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.315+0000 7f8f46d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.315+0000 7f8f46575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.315+0000 7f8f46575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.315+0000 7f8f46575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.316+0000 7f8f46d76640 10 monclient(hunting): handle_auth_done global_id 4536 payload 274 2026-02-17T21:25:39.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.316+0000 7f8f46d76640 1 -- 10.20.193.5:0/2719664166 >> v2:10.20.193.135:3300/0 conn(0x7f8f48155b60 msgr2=0x7f8f48155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:39.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.316+0000 7f8f46d76640 1 --2- 10.20.193.5:0/2719664166 >> v2:10.20.193.135:3300/0 conn(0x7f8f48155b60 0x7f8f48155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.316+0000 7f8f46d76640 1 -- 10.20.193.5:0/2719664166 >> v1:10.20.193.135:6789/0 conn(0x7f8f4815fdf0 legacy=0x7f8f4815d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.316+0000 7f8f46d76640 10 monclient: _finish_hunting 0 2026-02-17T21:25:39.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.316+0000 7f8f46d76640 1 monclient: found mon.noname-a 2026-02-17T21:25:39.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.316+0000 7f8f46d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:39.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.316+0000 7f8f46d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:39.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.316+0000 7f8f46d76640 1 -- 10.20.193.5:0/2719664166 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f4806cc10 con 0x7f8f480ccc50 2026-02-17T21:25:39.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.317+0000 7f8f46d76640 1 --2- 10.20.193.5:0/2719664166 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8f480ccc50 0x7f8f480cb040 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8f48076d10 tx=0x7f8f3802f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2333d925b51b9cbf server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f45573640 1 -- 10.20.193.5:0/2719664166 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3802fd70 con 0x7f8f480ccc50 2026-02-17T21:25:39.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f45573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f45573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:39.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f45573640 10 monclient: dump: 2026-02-17T21:25:39.330 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.331 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.331 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.331 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.331 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.331 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.331 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.331 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.331 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.331 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f45573640 10 monclient: _finish_auth 0 2026-02-17T21:25:39.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f45573640 10 monclient: _check_auth_tickets 2026-02-17T21:25:39.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f45573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:39.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f45573640 1 -- 10.20.193.5:0/2719664166 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f380373f0 con 0x7f8f480ccc50 2026-02-17T21:25:39.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f4cd03640 5 monclient: authenticate success, global_id 4536 2026-02-17T21:25:39.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f4cd03640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:39.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f45573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:39.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f4cd03640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:39.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f45573640 1 -- 10.20.193.5:0/2719664166 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f380377c0 con 0x7f8f480ccc50 2026-02-17T21:25:39.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f4cd03640 4 set_mon_vals no callback set 2026-02-17T21:25:39.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f45573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f45573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:39.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f45573640 10 monclient: dump: 2026-02-17T21:25:39.332 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.332 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.333 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.333 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.333 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.333 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.333 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.333 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.333 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.333 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f4cd03640 10 monclient: shutdown 2026-02-17T21:25:39.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f4cd03640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:39.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f4cd03640 1 -- 10.20.193.5:0/2719664166 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8f480ccc50 msgr2=0x7f8f480cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f4cd03640 1 --2- 10.20.193.5:0/2719664166 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8f480ccc50 0x7f8f480cb040 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8f48076d10 tx=0x7f8f3802f270 comp rx=0 tx=0).stop 2026-02-17T21:25:39.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f4cd03640 1 -- 10.20.193.5:0/2719664166 shutdown_connections 2026-02-17T21:25:39.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f4cd03640 1 --2- 10.20.193.5:0/2719664166 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8f480ccc50 0x7f8f480cb040 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f4cd03640 1 --2- 10.20.193.5:0/2719664166 >> v2:10.20.193.135:3300/0 conn(0x7f8f48155b60 0x7f8f48155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f4cd03640 1 -- 10.20.193.5:0/2719664166 >> 10.20.193.5:0/2719664166 conn(0x7f8f480cc130 msgr2=0x7f8f480cc540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:39.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f4cd03640 1 -- 10.20.193.5:0/2719664166 shutdown_connections 2026-02-17T21:25:39.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f4cd03640 1 -- 10.20.193.5:0/2719664166 wait complete. 2026-02-17T21:25:39.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f4cd03640 10 monclient: build_initial_monmap 2026-02-17T21:25:39.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.319+0000 7f8f4cd03640 10 monclient: monmap: 2026-02-17T21:25:39.334 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:39.334 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:39.334 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:39.334 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:39.334 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:39.334 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.334 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:39.335 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:39.335 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:39.335 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.320+0000 7f8f4cd03640 1 librados: starting msgr at 2026-02-17T21:25:39.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.320+0000 7f8f4cd03640 1 librados: starting objecter 2026-02-17T21:25:39.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.320+0000 7f8f4cd03640 1 Processor -- start 2026-02-17T21:25:39.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.320+0000 7f8f4cd03640 1 -- start start 2026-02-17T21:25:39.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.320+0000 7f8f4cd03640 1 librados: setting wanted keys 2026-02-17T21:25:39.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.320+0000 7f8f4cd03640 1 librados: calling monclient init 2026-02-17T21:25:39.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.320+0000 7f8f4cd03640 10 monclient: init 2026-02-17T21:25:39.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.320+0000 7f8f4cd03640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:39.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.320+0000 7f8f4cd03640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:25:39.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.320+0000 7f8f4cd03640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8f480ccc50 0x7f8f48070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.320+0000 7f8f4cd03640 10 monclient(hunting): picked mon.noname-c con 0x7f8f480ccc50 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:39.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.320+0000 7f8f4cd03640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8f48155b60 0x7f8f4806f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.320+0000 7f8f4cd03640 10 monclient(hunting): picked mon.noname-b con 0x7f8f48155b60 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:39.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.320+0000 7f8f4cd03640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8f4815fdf0 0x7f8f48158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.320+0000 7f8f4cd03640 10 monclient(hunting): picked mon.noname-a con 0x7f8f4815fdf0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:39.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.320+0000 7f8f4cd03640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.320+0000 7f8f4cd03640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4806d4b0 con 0x7f8f4815fdf0 2026-02-17T21:25:39.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.320+0000 7f8f4cd03640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.320+0000 7f8f4cd03640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4806d1d0 con 0x7f8f48155b60 2026-02-17T21:25:39.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.320+0000 7f8f4cd03640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.320+0000 7f8f4cd03640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8f48072ac0 con 0x7f8f480ccc50 2026-02-17T21:25:39.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.320+0000 7f8f4cd03640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:39.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.320+0000 7f8f4cd03640 10 monclient(hunting): authenticate will time out at 1044.885660s 2026-02-17T21:25:39.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.320+0000 7f8f46d76640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8f4815fdf0 0x7f8f48158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.320+0000 7f8f46575640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8f480ccc50 0x7f8f48070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.321+0000 7f8f46575640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8f480ccc50 0x7f8f48070b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:54518/0 (socket says 10.20.193.5:54518) 2026-02-17T21:25:39.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.321+0000 7f8f46575640 1 -- 10.20.193.5:0/3939004317 learned_addr learned my addr 10.20.193.5:0/3939004317 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:39.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.321+0000 7f8f46d76640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8f4815fdf0 0x7f8f48158fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:58686/0 (socket says 10.20.193.5:58686) 2026-02-17T21:25:39.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.321+0000 7f8f46d76640 10 monclient(hunting): get_auth_request con 0x7f8f4815fdf0 auth_method 0 2026-02-17T21:25:39.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.321+0000 7f8f46d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.321+0000 7f8f46d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.321+0000 7f8f46d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.321+0000 7f8f46575640 10 monclient(hunting): get_auth_request con 0x7f8f480ccc50 auth_method 0 2026-02-17T21:25:39.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.321+0000 7f8f46575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.321+0000 7f8f46575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.321+0000 7f8f46575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.321+0000 7f8f46d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.321+0000 7f8f46d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.321+0000 7f8f46d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.321+0000 7f8f46575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.321+0000 7f8f46575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.321+0000 7f8f46575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.322+0000 7f8f46575640 10 monclient(hunting): handle_auth_done global_id 4604 payload 824 2026-02-17T21:25:39.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.322+0000 7f8f46575640 1 -- 10.20.193.5:0/3939004317 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8f48155b60 msgr2=0x7f8f4806f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.322+0000 7f8f46575640 1 --2- 10.20.193.5:0/3939004317 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8f48155b60 0x7f8f4806f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.322+0000 7f8f46575640 1 -- 10.20.193.5:0/3939004317 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8f4815fdf0 msgr2=0x7f8f48158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.322+0000 7f8f46575640 1 --2- 10.20.193.5:0/3939004317 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8f4815fdf0 0x7f8f48158fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.322+0000 7f8f46575640 10 monclient: _finish_hunting 0 2026-02-17T21:25:39.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.322+0000 7f8f46575640 1 monclient: found mon.noname-c 2026-02-17T21:25:39.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.322+0000 7f8f46575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:39.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.322+0000 7f8f46575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.322+0000 7f8f46575640 1 -- 10.20.193.5:0/3939004317 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f481502b0 con 0x7f8f480ccc50 2026-02-17T21:25:39.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.323+0000 7f8f46575640 1 --2- 10.20.193.5:0/3939004317 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8f480ccc50 0x7f8f48070b40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00ebe0 tx=0x7f8f3c00c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.323+0000 7f8f2effd640 10 client.?.objecter ms_handle_connect 0x7f8f480ccc50 2026-02-17T21:25:39.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.323+0000 7f8f2effd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:39.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.325+0000 7f8f2effd640 1 -- 10.20.193.5:0/3939004317 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c017070 con 0x7f8f480ccc50 2026-02-17T21:25:39.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.325+0000 7f8f2effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.325+0000 7f8f2effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:39.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.325+0000 7f8f2effd640 10 monclient: dump: 2026-02-17T21:25:39.339 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.339 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.339 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.339 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.339 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.339 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.339 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.339 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.339 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.339 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.325+0000 7f8f2effd640 10 monclient: _finish_auth 0 2026-02-17T21:25:39.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.325+0000 7f8f2effd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:39.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.325+0000 7f8f2effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:39.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.325+0000 7f8f4cd03640 5 monclient: authenticate success, global_id 4604 2026-02-17T21:25:39.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.325+0000 7f8f4cd03640 10 monclient: _renew_subs 2026-02-17T21:25:39.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.325+0000 7f8f4cd03640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.325+0000 7f8f4cd03640 1 -- 10.20.193.5:0/3939004317 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f48071180 con 0x7f8f480ccc50 2026-02-17T21:25:39.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.325+0000 7f8f4cd03640 10 client.4604.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:39.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.325+0000 7f8f4cd03640 10 monclient: _renew_subs 2026-02-17T21:25:39.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.325+0000 7f8f4cd03640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.325+0000 7f8f4cd03640 1 -- 10.20.193.5:0/3939004317 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f48150570 con 0x7f8f480ccc50 2026-02-17T21:25:39.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.325+0000 7f8f4cd03640 1 librados: init done 2026-02-17T21:25:39.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.325+0000 7f8f2effd640 1 -- 10.20.193.5:0/3939004317 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f3c00cc40 con 0x7f8f480ccc50 2026-02-17T21:25:39.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.325+0000 7f8f2effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:39.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.325+0000 7f8f2effd640 1 -- 10.20.193.5:0/3939004317 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c021060 con 0x7f8f480ccc50 2026-02-17T21:25:39.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.325+0000 7f8f2effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.325+0000 7f8f2effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:39.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.325+0000 7f8f44d72640 4 set_mon_vals no callback set 2026-02-17T21:25:39.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.325+0000 7f8f2effd640 10 monclient: dump: 2026-02-17T21:25:39.341 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.341 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.341 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.341 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.341 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.341 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.341 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.341 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.341 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.341 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.325+0000 7f8f4cd03640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.326+0000 7f8f4cd03640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.326+0000 7f8f4cd03640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.326+0000 7f8f4cd03640 1 -- 10.20.193.5:0/3939004317 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f48073080 con 0x7f8f480ccc50 2026-02-17T21:25:39.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.336+0000 7f8f2effd640 1 -- 10.20.193.5:0/3939004317 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f8f3c024060 con 0x7f8f480ccc50 2026-02-17T21:25:39.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.336+0000 7f8f2effd640 1 --2- 10.20.193.5:0/3939004317 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8f14079280 0x7f8f1407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.337+0000 7f8f45d74640 1 --2- 10.20.193.5:0/3939004317 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8f14079280 0x7f8f1407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.337+0000 7f8f45d74640 10 monclient: get_auth_request con 0x7f8f14079280 auth_method 0 2026-02-17T21:25:39.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.337+0000 7f8f2effd640 10 client.4604.objecter ms_handle_connect 0x7f8f14079280 2026-02-17T21:25:39.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.337+0000 7f8f45d74640 1 --2- 10.20.193.5:0/3939004317 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8f14079280 0x7f8f1407b740 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8f30002770 tx=0x7f8f30007ab0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.338+0000 7f8f2effd640 1 -- 10.20.193.5:0/3939004317 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f8f3c097c30 con 0x7f8f480ccc50 2026-02-17T21:25:39.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.338+0000 7f8f2effd640 10 client.4604.objecter ms_dispatch2 0x7f8f48000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:39.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.338+0000 7f8f2effd640 3 client.4604.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:39.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.338+0000 7f8f2effd640 3 client.4604.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:39.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.338+0000 7f8f2effd640 20 client.4604.objecter dump_active .. 0 homeless 2026-02-17T21:25:39.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.369+0000 7f20a28ea640 10 monclient: get_monmap_and_config 2026-02-17T21:25:39.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.369+0000 7f20a28ea640 10 monclient: build_initial_monmap 2026-02-17T21:25:39.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.369+0000 7f20a28ea640 10 monclient: monmap: 2026-02-17T21:25:39.370 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:39.370 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.370 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:39.369943+0000 2026-02-17T21:25:39.371 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:39.369943+0000 2026-02-17T21:25:39.371 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:39.371 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.371 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:39.371 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:39.371 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:39.371 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:39.371 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:39.371 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:39.371 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.369+0000 7f20a28ea640 1 Processor -- start 2026-02-17T21:25:39.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.369+0000 7f20a28ea640 1 -- start start 2026-02-17T21:25:39.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.369+0000 7f20a28ea640 10 monclient: init 2026-02-17T21:25:39.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.370+0000 7f20a28ea640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:39.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.370+0000 7f20a28ea640 10 monclient: _add_conns ranks=[0,3,1,4,5,2] 2026-02-17T21:25:39.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.370+0000 7f20a28ea640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f209c15f570 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:39.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.370+0000 7f20a28ea640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f209c15f950 0x7f209c0be810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.370+0000 7f20a28ea640 10 monclient(hunting): picked mon.noname-a con 0x7f209c15f950 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:39.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.370+0000 7f20a28ea640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f209c155770 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:39.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.370+0000 7f20a28ea640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f209c0bee70 con 0x7f209c15f570 2026-02-17T21:25:39.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.370+0000 7f20a28ea640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f209c0bf150 con 0x7f209c155770 2026-02-17T21:25:39.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.370+0000 7f20a28ea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.370+0000 7f20a28ea640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f209c0bfd60 con 0x7f209c15f950 2026-02-17T21:25:39.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.370+0000 7f20a28ea640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:39.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.370+0000 7f20a28ea640 10 monclient(hunting): authenticate will time out at 1044.935265s 2026-02-17T21:25:39.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.370+0000 7f209b7fe640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f209c15f950 0x7f209c0be810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.370+0000 7f209b7fe640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f209c15f950 0x7f209c0be810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:58698/0 (socket says 10.20.193.5:58698) 2026-02-17T21:25:39.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.370+0000 7f209b7fe640 1 -- 10.20.193.5:0/770153826 learned_addr learned my addr 10.20.193.5:0/770153826 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:39.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.370+0000 7f209b7fe640 10 monclient(hunting): get_auth_request con 0x7f209c15f950 auth_method 0 2026-02-17T21:25:39.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.370+0000 7f209b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.370+0000 7f209b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.370+0000 7f209b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.371+0000 7f209b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.371+0000 7f209b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.371+0000 7f209b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.372+0000 7f209b7fe640 10 monclient(hunting): handle_auth_done global_id 4542 payload 274 2026-02-17T21:25:39.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.372+0000 7f209b7fe640 1 -- 10.20.193.5:0/770153826 >> v1:10.20.193.119:6789/0 conn(0x7f209c155770 legacy=0x7f209c155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:39.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.372+0000 7f209b7fe640 1 -- 10.20.193.5:0/770153826 >> v1:10.20.193.5:6789/0 conn(0x7f209c15f570 legacy=0x7f209c15d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.372+0000 7f209b7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:25:39.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.372+0000 7f209b7fe640 1 monclient: found mon.noname-a 2026-02-17T21:25:39.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.372+0000 7f209b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:39.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.372+0000 7f209b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:39.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.372+0000 7f209b7fe640 1 -- 10.20.193.5:0/770153826 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c0bf430 con 0x7f209c15f950 2026-02-17T21:25:39.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.375+0000 7f209b7fe640 1 --2- 10.20.193.5:0/770153826 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f209c15f950 0x7f209c0be810 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f208c009970 tx=0x7f208c02eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7df3cec42b7199a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.376+0000 7f209affd640 1 -- 10.20.193.5:0/770153826 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c03c070 con 0x7f209c15f950 2026-02-17T21:25:39.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.376+0000 7f209affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.376+0000 7f209affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:39.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.376+0000 7f209affd640 10 monclient: dump: 2026-02-17T21:25:39.381 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.381 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.381 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.381 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.381 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.381 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.381 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.381 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.381 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.381 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.376+0000 7f209affd640 10 monclient: _finish_auth 0 2026-02-17T21:25:39.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.376+0000 7f209affd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:39.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.376+0000 7f209affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:39.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.376+0000 7f209affd640 1 -- 10.20.193.5:0/770153826 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f208c02fbb0 con 0x7f209c15f950 2026-02-17T21:25:39.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.376+0000 7f209affd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:39.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.376+0000 7f20a28ea640 5 monclient: authenticate success, global_id 4542 2026-02-17T21:25:39.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.376+0000 7f209affd640 1 -- 10.20.193.5:0/770153826 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c037440 con 0x7f209c15f950 2026-02-17T21:25:39.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.376+0000 7f209affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.376+0000 7f209affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:39.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.376+0000 7f209affd640 10 monclient: dump: 2026-02-17T21:25:39.382 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.382 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.382 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.382 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.382 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.383 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.383 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.383 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.383 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.383 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.376+0000 7f20a28ea640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:39.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.376+0000 7f20a28ea640 4 set_mon_vals no callback set 2026-02-17T21:25:39.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.377+0000 7f20a28ea640 10 monclient: shutdown 2026-02-17T21:25:39.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.377+0000 7f20a28ea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:39.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.377+0000 7f20a28ea640 1 -- 10.20.193.5:0/770153826 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f209c15f950 msgr2=0x7f209c0be810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.377+0000 7f20a28ea640 1 --2- 10.20.193.5:0/770153826 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f209c15f950 0x7f209c0be810 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f208c009970 tx=0x7f208c02eef0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.377+0000 7f20a28ea640 1 -- 10.20.193.5:0/770153826 shutdown_connections 2026-02-17T21:25:39.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.377+0000 7f20a28ea640 1 --2- 10.20.193.5:0/770153826 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f209c15f950 0x7f209c0be810 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.377+0000 7f20a28ea640 1 -- 10.20.193.5:0/770153826 >> 10.20.193.5:0/770153826 conn(0x7f209c0c9f40 msgr2=0x7f209c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:39.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.377+0000 7f20a28ea640 1 -- 10.20.193.5:0/770153826 shutdown_connections 2026-02-17T21:25:39.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.377+0000 7f20a28ea640 1 -- 10.20.193.5:0/770153826 wait complete. 2026-02-17T21:25:39.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.377+0000 7f20a28ea640 10 monclient: build_initial_monmap 2026-02-17T21:25:39.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.377+0000 7f20a28ea640 10 monclient: monmap: 2026-02-17T21:25:39.384 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:39.384 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:39.384 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:39.384 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:39.384 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:39.384 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.384 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:39.384 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:39.384 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:39.385 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.377+0000 7f20a28ea640 1 librados: starting msgr at 2026-02-17T21:25:39.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.377+0000 7f20a28ea640 1 librados: starting objecter 2026-02-17T21:25:39.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.377+0000 7f20a28ea640 1 Processor -- start 2026-02-17T21:25:39.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.378+0000 7f20a28ea640 1 -- start start 2026-02-17T21:25:39.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.378+0000 7f20a28ea640 1 librados: setting wanted keys 2026-02-17T21:25:39.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.378+0000 7f20a28ea640 1 librados: calling monclient init 2026-02-17T21:25:39.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.378+0000 7f20a28ea640 10 monclient: init 2026-02-17T21:25:39.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.378+0000 7f20a28ea640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:39.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.378+0000 7f20a28ea640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:25:39.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.378+0000 7f20a28ea640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f209c155770 0x7f209c06f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.378+0000 7f20a28ea640 10 monclient(hunting): picked mon.noname-a con 0x7f209c155770 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:39.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.378+0000 7f20a28ea640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f209c15f570 0x7f209c0c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.378+0000 7f20a28ea640 10 monclient(hunting): picked mon.noname-b con 0x7f209c15f570 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:39.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.378+0000 7f20a28ea640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f209c15f950 0x7f209c0c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.378+0000 7f20a28ea640 10 monclient(hunting): picked mon.noname-c con 0x7f209c15f950 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:39.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.378+0000 7f20a28ea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.378+0000 7f20a28ea640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f209c15d910 con 0x7f209c155770 2026-02-17T21:25:39.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.378+0000 7f20a28ea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.378+0000 7f20a28ea640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f209c0bf9f0 con 0x7f209c15f570 2026-02-17T21:25:39.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.378+0000 7f20a28ea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.378+0000 7f20a28ea640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f209c0c01f0 con 0x7f209c15f950 2026-02-17T21:25:39.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.378+0000 7f20a28ea640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:39.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.378+0000 7f20a28ea640 10 monclient(hunting): authenticate will time out at 1044.943508s 2026-02-17T21:25:39.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.378+0000 7f209bfff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f209c155770 0x7f209c06f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.379+0000 7f209bfff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f209c155770 0x7f209c06f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:58706/0 (socket says 10.20.193.5:58706) 2026-02-17T21:25:39.386 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.379+0000 7f209bfff640 1 -- 10.20.193.5:0/2841672594 learned_addr learned my addr 10.20.193.5:0/2841672594 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:39.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.379+0000 7f209bfff640 10 monclient(hunting): get_auth_request con 0x7f209c155770 auth_method 0 2026-02-17T21:25:39.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.379+0000 7f209bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.379+0000 7f209bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.379+0000 7f209bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.379+0000 7f209bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.379+0000 7f209bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.379+0000 7f209bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.380+0000 7f209bfff640 10 monclient(hunting): handle_auth_done global_id 4548 payload 824 2026-02-17T21:25:39.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.380+0000 7f209bfff640 1 -- 10.20.193.5:0/2841672594 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f209c15f950 msgr2=0x7f209c0c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.380+0000 7f209bfff640 1 --2- 10.20.193.5:0/2841672594 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f209c15f950 0x7f209c0c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.380+0000 7f209bfff640 1 -- 10.20.193.5:0/2841672594 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f209c15f570 msgr2=0x7f209c0c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.380+0000 7f209bfff640 1 --2- 10.20.193.5:0/2841672594 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f209c15f570 0x7f209c0c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.380+0000 7f209bfff640 10 monclient: _finish_hunting 0 2026-02-17T21:25:39.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.380+0000 7f209bfff640 1 monclient: found mon.noname-a 2026-02-17T21:25:39.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.380+0000 7f209bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:39.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.380+0000 7f209bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:39.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.380+0000 7f209bfff640 1 -- 10.20.193.5:0/2841672594 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c1f7c80 con 0x7f209c155770 2026-02-17T21:25:39.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.381+0000 7f209bfff640 1 --2- 10.20.193.5:0/2841672594 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f209c155770 0x7f209c06f130 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f208800c5b0 tx=0x7f208800ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.381+0000 7f2098ff9640 10 client.?.objecter ms_handle_connect 0x7f209c155770 2026-02-17T21:25:39.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.381+0000 7f2098ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:39.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.383+0000 7f2098ff9640 1 -- 10.20.193.5:0/2841672594 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20880052d0 con 0x7f209c155770 2026-02-17T21:25:39.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.383+0000 7f2098ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.383+0000 7f2098ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:39.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.383+0000 7f2098ff9640 10 monclient: dump: 2026-02-17T21:25:39.390 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.390 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.390 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.390 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.390 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.390 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.390 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.391 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.391 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.391 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.383+0000 7f2098ff9640 10 monclient: _finish_auth 0 2026-02-17T21:25:39.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.383+0000 7f2098ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:25:39.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.383+0000 7f2098ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:39.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.383+0000 7f2098ff9640 1 -- 10.20.193.5:0/2841672594 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2088005470 con 0x7f209c155770 2026-02-17T21:25:39.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.383+0000 7f20a28ea640 5 monclient: authenticate success, global_id 4548 2026-02-17T21:25:39.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.383+0000 7f20a28ea640 10 monclient: _renew_subs 2026-02-17T21:25:39.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.383+0000 7f20a28ea640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:39.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.383+0000 7f20a28ea640 1 -- 10.20.193.5:0/2841672594 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f209c1f3970 con 0x7f209c155770 2026-02-17T21:25:39.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.383+0000 7f2098ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:39.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.383+0000 7f2098ff9640 1 -- 10.20.193.5:0/2841672594 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20880038f0 con 0x7f209c155770 2026-02-17T21:25:39.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.383+0000 7f2098ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.383+0000 7f2098ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:39.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.383+0000 7f209a7fc640 4 set_mon_vals no callback set 2026-02-17T21:25:39.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.383+0000 7f2098ff9640 10 monclient: dump: 2026-02-17T21:25:39.392 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.392 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.392 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.392 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.392 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.392 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.392 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.392 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.392 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.392 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.383+0000 7f20a28ea640 10 client.4548.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:39.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.383+0000 7f20a28ea640 10 monclient: _renew_subs 2026-02-17T21:25:39.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.383+0000 7f20a28ea640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:39.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.383+0000 7f20a28ea640 1 -- 10.20.193.5:0/2841672594 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f209c1f3f30 con 0x7f209c155770 2026-02-17T21:25:39.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.383+0000 7f20a28ea640 1 librados: init done 2026-02-17T21:25:39.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.384+0000 7f20a28ea640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.384+0000 7f20a28ea640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.384+0000 7f20a28ea640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:39.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.384+0000 7f64c7be7640 10 monclient: get_monmap_and_config 2026-02-17T21:25:39.394 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.384+0000 7f64c7be7640 10 monclient: build_initial_monmap 2026-02-17T21:25:39.394 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.384+0000 7f64c7be7640 10 monclient: monmap: 2026-02-17T21:25:39.394 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:39.394 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.394 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:39.384878+0000 2026-02-17T21:25:39.394 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:39.384878+0000 2026-02-17T21:25:39.394 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:39.394 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.394 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:39.394 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:39.394 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:39.394 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:39.394 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:39.394 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:39.395 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.384+0000 7f20a28ea640 1 -- 10.20.193.5:0/2841672594 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f209c1f4540 con 0x7f209c155770 2026-02-17T21:25:39.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.384+0000 7f64c7be7640 1 Processor -- start 2026-02-17T21:25:39.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.384+0000 7f64c7be7640 1 -- start start 2026-02-17T21:25:39.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.384+0000 7f64c7be7640 10 monclient: init 2026-02-17T21:25:39.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.385+0000 7f74bd23b640 10 monclient: get_monmap_and_config 2026-02-17T21:25:39.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.385+0000 7f74bd23b640 10 monclient: build_initial_monmap 2026-02-17T21:25:39.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.385+0000 7f74bd23b640 10 monclient: monmap: 2026-02-17T21:25:39.396 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:39.396 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.396 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:39.385775+0000 2026-02-17T21:25:39.396 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:39.385775+0000 2026-02-17T21:25:39.396 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:39.396 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.397 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:39.397 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:39.397 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:39.397 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:39.397 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:39.397 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:39.397 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.385+0000 7f64c7be7640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:39.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.385+0000 7f64c7be7640 10 monclient: _add_conns ranks=[5,0,2,4,1,3] 2026-02-17T21:25:39.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.385+0000 7f64c7be7640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f64c015f570 0x7f64c015f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.385+0000 7f64c7be7640 10 monclient(hunting): picked mon.noname-c con 0x7f64c015f570 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:39.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.385+0000 7f64c7be7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f64c015d200 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:39.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.385+0000 7f64c7be7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f64c0070fd0 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:39.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.385+0000 7f64c7be7640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64c00c8360 con 0x7f64c015d200 2026-02-17T21:25:39.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.385+0000 7f64c7be7640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64c00c8620 con 0x7f64c0070fd0 2026-02-17T21:25:39.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.385+0000 7f64c7be7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.385+0000 7f64c7be7640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f64c00c9230 con 0x7f64c015f570 2026-02-17T21:25:39.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.385+0000 7f64c7be7640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:39.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.385+0000 7f64c7be7640 10 monclient(hunting): authenticate will time out at 1044.950275s 2026-02-17T21:25:39.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.385+0000 7f74bd23b640 1 Processor -- start 2026-02-17T21:25:39.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.385+0000 7f74bd23b640 1 -- start start 2026-02-17T21:25:39.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.385+0000 7f74bd23b640 10 monclient: init 2026-02-17T21:25:39.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.386+0000 7f74bd23b640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:39.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.386+0000 7f74bd23b640 10 monclient: _add_conns ranks=[1,5,2,4,0,3] 2026-02-17T21:25:39.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.386+0000 7f74bd23b640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f74b815d450 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:39.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.386+0000 7f74bd23b640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f74b80ca970 0x7f74b80cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.386+0000 7f74bd23b640 10 monclient(hunting): picked mon.noname-c con 0x7f74b80ca970 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:39.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.386+0000 7f74bd23b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f74b80c5a20 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:39.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.386+0000 7f74bd23b640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74b8070b20 con 0x7f74b815d450 2026-02-17T21:25:39.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.386+0000 7f74bd23b640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74b80685e0 con 0x7f74b80c5a20 2026-02-17T21:25:39.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.386+0000 7f74bd23b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.386+0000 7f74bd23b640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f74b80691f0 con 0x7f74b80ca970 2026-02-17T21:25:39.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.386+0000 7f74bd23b640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:39.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.386+0000 7f74bd23b640 10 monclient(hunting): authenticate will time out at 1044.951291s 2026-02-17T21:25:39.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.396+0000 7f2098ff9640 1 -- 10.20.193.5:0/2841672594 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f2088003a90 con 0x7f209c155770 2026-02-17T21:25:39.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.396+0000 7f2098ff9640 1 --2- 10.20.193.5:0/2841672594 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f206c0792d0 0x7f206c07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.396+0000 7f209b7fe640 1 --2- 10.20.193.5:0/2841672594 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f206c0792d0 0x7f206c07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.396+0000 7f209b7fe640 10 monclient: get_auth_request con 0x7f206c0792d0 auth_method 0 2026-02-17T21:25:39.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.397+0000 7f2098ff9640 10 client.4548.objecter ms_handle_connect 0x7f206c0792d0 2026-02-17T21:25:39.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.397+0000 7f209b7fe640 1 --2- 10.20.193.5:0/2841672594 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f206c0792d0 0x7f206c07b790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f209c0696f0 tx=0x7f208c031000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.398+0000 7f2098ff9640 1 -- 10.20.193.5:0/2841672594 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f208805e4d0 con 0x7f209c155770 2026-02-17T21:25:39.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.398+0000 7f2098ff9640 10 client.4548.objecter ms_dispatch2 0x7f209c000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:39.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.398+0000 7f2098ff9640 3 client.4548.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:39.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.398+0000 7f2098ff9640 3 client.4548.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:39.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.398+0000 7f2098ff9640 20 client.4548.objecter dump_active .. 0 homeless 2026-02-17T21:25:39.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.398+0000 7f64c515b640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f64c015d200 0x7f64c00c96c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:37608/0 (socket says 10.20.193.5:37608) 2026-02-17T21:25:39.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.398+0000 7f64c515b640 1 -- 10.20.193.5:0/3310169343 learned_addr learned my addr 10.20.193.5:0/3310169343 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:39.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.405+0000 7f38c3fff640 1 -- 10.20.193.5:0/4091279194 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f38d4062790 con 0x7f38e80ce5d0 2026-02-17T21:25:39.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.405+0000 7f38c3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.405+0000 7f38c3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:39.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.408+0000 7f74b6d76640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f74b815d450 0x7f74b815d830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:56910/0 (socket says 10.20.193.5:56910) 2026-02-17T21:25:39.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.408+0000 7f74b6d76640 1 -- 10.20.193.5:0/2604728384 learned_addr learned my addr 10.20.193.5:0/2604728384 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:39.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.410+0000 7f74b5d74640 1 -- 10.20.193.5:0/2604728384 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1671354917 0 0) 0x7f74b8070b20 con 0x7f74b815d450 2026-02-17T21:25:39.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.410+0000 7f74b5d74640 10 monclient(hunting): _negotiate 2026-02-17T21:25:39.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.410+0000 7f74b5d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.410+0000 7f74b5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.410+0000 7f74b5d74640 10 monclient(hunting): my global_id is 4561 2026-02-17T21:25:39.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.410+0000 7f74b5d74640 1 -- 10.20.193.5:0/2604728384 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74a4003620 con 0x7f74b815d450 2026-02-17T21:25:39.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.411+0000 7f74b5d74640 1 -- 10.20.193.5:0/2604728384 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 779741868 0 0) 0x7f74a4003620 con 0x7f74b815d450 2026-02-17T21:25:39.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.411+0000 7f74b5d74640 1 -- 10.20.193.5:0/2604728384 >> v2:10.20.193.135:3300/0 conn(0x7f74b80ca970 msgr2=0x7f74b80cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:39.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.411+0000 7f74b5d74640 1 --2- 10.20.193.5:0/2604728384 >> v2:10.20.193.135:3300/0 conn(0x7f74b80ca970 0x7f74b80cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.411+0000 7f74b5d74640 1 -- 10.20.193.5:0/2604728384 >> v1:10.20.193.135:6789/0 conn(0x7f74b80c5a20 legacy=0x7f74b80c5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:39.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.411+0000 7f74b5d74640 10 monclient: _finish_hunting 0 2026-02-17T21:25:39.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.411+0000 7f74b5d74640 1 monclient: found mon.noname-b-legacy 2026-02-17T21:25:39.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.411+0000 7f74b5d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:39.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.411+0000 7f74b5d74640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.119:6789/0 2026-02-17T21:25:39.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.411+0000 7f74b5d74640 1 -- 10.20.193.5:0/2604728384 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b80688c0 con 0x7f74b815d450 2026-02-17T21:25:39.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.411+0000 7f74b5d74640 10 monclient: _finish_auth 0 2026-02-17T21:25:39.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.411+0000 7f74b5d74640 10 monclient: _check_auth_tickets 2026-02-17T21:25:39.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.411+0000 7f74b5d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:39.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.411+0000 7f74b5d74640 1 -- 10.20.193.5:0/2604728384 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3880376286 0 0) 0x7f74ac002f00 con 0x7f74b815d450 2026-02-17T21:25:39.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.411+0000 7f74bd23b640 5 monclient: authenticate success, global_id 4561 2026-02-17T21:25:39.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.412+0000 7f74bd23b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:39.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.412+0000 7f74b5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.412+0000 7f74b5d74640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T21:25:39.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.412+0000 7f74b5d74640 10 monclient: dump: 2026-02-17T21:25:39.415 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.415 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.415 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.415 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.415 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.415 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.415 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.415 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.415 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.415 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.412+0000 7f74b5d74640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] but i'm connected to v1:10.20.193.119:6789/0, reconnecting 2026-02-17T21:25:39.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.412+0000 7f74b5d74640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:39.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.412+0000 7f74b5d74640 1 -- 10.20.193.5:0/2604728384 >> v1:10.20.193.119:6789/0 conn(0x7f74b815d450 legacy=0x7f74b815d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.412+0000 7f74b5d74640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:25:39.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.412+0000 7f74b5d74640 1 --2- 10.20.193.5:0/2604728384 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f74a4003ba0 0x7f74a4003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.412+0000 7f74b5d74640 10 monclient(hunting): picked mon.c con 0x7f74a4003ba0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:39.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.412+0000 7f74b5d74640 1 --2- 10.20.193.5:0/2604728384 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f74a4004900 0x7f74a4004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.412+0000 7f74b5d74640 10 monclient(hunting): picked mon.b con 0x7f74a4004900 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:39.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.412+0000 7f74b5d74640 1 --2- 10.20.193.5:0/2604728384 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f74a4009ab0 0x7f74a400bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.412+0000 7f74b5d74640 10 monclient(hunting): picked mon.a con 0x7f74a4009ab0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:39.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.412+0000 7f74b5d74640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.412+0000 7f74b5d74640 1 -- 10.20.193.5:0/2604728384 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f74b80691f0 con 0x7f74a4009ab0 2026-02-17T21:25:39.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.412+0000 7f74b5d74640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.412+0000 7f74b5d74640 1 -- 10.20.193.5:0/2604728384 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f74a400c4f0 con 0x7f74a4004900 2026-02-17T21:25:39.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.412+0000 7f74b5d74640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.412+0000 7f74b5d74640 1 -- 10.20.193.5:0/2604728384 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f74a400c6f0 con 0x7f74a4003ba0 2026-02-17T21:25:39.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.412+0000 7f74b5d74640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:39.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.412+0000 7f74b5d74640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:25:39.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.412+0000 7f74bd23b640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:39.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.413+0000 7f74b6575640 1 --2- 10.20.193.5:0/2604728384 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f74a4004900 0x7f74a4004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.413+0000 7f74b6575640 10 monclient(hunting): get_auth_request con 0x7f74a4004900 auth_method 0 2026-02-17T21:25:39.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.413+0000 7f74b6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.413+0000 7f74b6575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.413+0000 7f74b6575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:25:39.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.413+0000 7f74b6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.413+0000 7f74b6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.413+0000 7f74b6575640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:25:39.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.414+0000 7f74b6575640 10 monclient(hunting): handle_auth_done global_id 4561 payload 293 2026-02-17T21:25:39.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.414+0000 7f74b6575640 1 -- 10.20.193.5:0/2604728384 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f74a4003ba0 msgr2=0x7f74a4003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:39.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.414+0000 7f74b6575640 1 --2- 10.20.193.5:0/2604728384 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f74a4003ba0 0x7f74a4003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.414+0000 7f74b6575640 1 -- 10.20.193.5:0/2604728384 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f74a4009ab0 msgr2=0x7f74a400bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:39.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.414+0000 7f74b6575640 1 --2- 10.20.193.5:0/2604728384 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f74a4009ab0 0x7f74a400bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.414+0000 7f74b6575640 10 monclient: _finish_hunting 0 2026-02-17T21:25:39.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.414+0000 7f74b6575640 1 monclient: found mon.b 2026-02-17T21:25:39.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.414+0000 7f74b6575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:39.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.414+0000 7f74b6575640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.414+0000 7f74b6575640 1 -- 10.20.193.5:0/2604728384 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a4003620 con 0x7f74a4004900 2026-02-17T21:25:39.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.414+0000 7f74b6575640 10 monclient: _finish_auth 0 2026-02-17T21:25:39.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.414+0000 7f74b6575640 10 monclient: _check_auth_tickets 2026-02-17T21:25:39.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.414+0000 7f74b6575640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:39.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.414+0000 7f74b7577640 1 -- 10.20.193.5:0/2604728384 reap_dead start 2026-02-17T21:25:39.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.415+0000 7f74b6575640 1 --2- 10.20.193.5:0/2604728384 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f74a4004900 0x7f74a4004d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f74a0009980 tx=0x7f74a002ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79f1984060c0c979 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.417+0000 7f74b5d74640 1 -- 10.20.193.5:0/2604728384 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a003c070 con 0x7f74a4004900 2026-02-17T21:25:39.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.417+0000 7f74b5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.417+0000 7f74b5d74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:39.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.417+0000 7f74b5d74640 10 monclient: dump: 2026-02-17T21:25:39.420 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.420 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.420 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.420 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.420 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.420 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.420 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.420 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.421 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.421 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.417+0000 7f74b5d74640 1 -- 10.20.193.5:0/2604728384 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74a002f7b0 con 0x7f74a4004900 2026-02-17T21:25:39.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.417+0000 7f74b5d74640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:39.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.417+0000 7f74b5d74640 1 -- 10.20.193.5:0/2604728384 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a0009550 con 0x7f74a4004900 2026-02-17T21:25:39.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.417+0000 7f74b5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.417+0000 7f74b5d74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:39.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.417+0000 7f74b5d74640 10 monclient: dump: 2026-02-17T21:25:39.421 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.421 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.421 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.421 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.421 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.421 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.421 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.421 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.421 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.421 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.417+0000 7f74bd23b640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:39.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.417+0000 7f74bd23b640 4 set_mon_vals no callback set 2026-02-17T21:25:39.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.417+0000 7f74bd23b640 10 monclient: shutdown 2026-02-17T21:25:39.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.417+0000 7f74bd23b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:39.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.417+0000 7f74bd23b640 1 -- 10.20.193.5:0/2604728384 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f74a4004900 msgr2=0x7f74a4004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.417+0000 7f74bd23b640 1 --2- 10.20.193.5:0/2604728384 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f74a4004900 0x7f74a4004d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f74a0009980 tx=0x7f74a002ed50 comp rx=0 tx=0).stop 2026-02-17T21:25:39.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.418+0000 7f74bd23b640 1 -- 10.20.193.5:0/2604728384 shutdown_connections 2026-02-17T21:25:39.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.418+0000 7f74bd23b640 1 --2- 10.20.193.5:0/2604728384 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f74a4004900 0x7f74a4004d80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.418+0000 7f74bd23b640 1 -- 10.20.193.5:0/2604728384 >> 10.20.193.5:0/2604728384 conn(0x7f74b80cafa0 msgr2=0x7f74b80cb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:39.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.418+0000 7f74bd23b640 1 -- 10.20.193.5:0/2604728384 shutdown_connections 2026-02-17T21:25:39.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.418+0000 7f74bd23b640 1 -- 10.20.193.5:0/2604728384 wait complete. 2026-02-17T21:25:39.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.418+0000 7f74bd23b640 10 monclient: build_initial_monmap 2026-02-17T21:25:39.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.418+0000 7f74bd23b640 10 monclient: monmap: 2026-02-17T21:25:39.422 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:39.422 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:39.422 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:39.422 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:39.422 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:39.423 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.423 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:39.423 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:39.423 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:39.423 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.418+0000 7f74bd23b640 1 librados: starting msgr at 2026-02-17T21:25:39.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.418+0000 7f74bd23b640 1 librados: starting objecter 2026-02-17T21:25:39.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.418+0000 7f74bd23b640 1 Processor -- start 2026-02-17T21:25:39.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.418+0000 7f74bd23b640 1 -- start start 2026-02-17T21:25:39.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.418+0000 7f74bd23b640 1 librados: setting wanted keys 2026-02-17T21:25:39.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.418+0000 7f74bd23b640 1 librados: calling monclient init 2026-02-17T21:25:39.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.418+0000 7f74bd23b640 10 monclient: init 2026-02-17T21:25:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.419+0000 7f74bd23b640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.419+0000 7f74bd23b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:25:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.419+0000 7f74bd23b640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f74a4004900 0x7f74b806f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.419+0000 7f74bd23b640 10 monclient(hunting): picked mon.noname-c con 0x7f74a4004900 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.419+0000 7f74bd23b640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f74b806fa70 0x7f74b81f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.419+0000 7f74bd23b640 10 monclient(hunting): picked mon.noname-b con 0x7f74b806fa70 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.419+0000 7f74bd23b640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f74b81f6420 0x7f74b8151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.419+0000 7f74bd23b640 10 monclient(hunting): picked mon.noname-a con 0x7f74b81f6420 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.419+0000 7f74bd23b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.419+0000 7f74bd23b640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f74b80cf330 con 0x7f74b81f6420 2026-02-17T21:25:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.419+0000 7f74bd23b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.419+0000 7f74bd23b640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f74b8068e80 con 0x7f74b806fa70 2026-02-17T21:25:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.419+0000 7f74bd23b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.419+0000 7f74bd23b640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f74b80cf4b0 con 0x7f74a4004900 2026-02-17T21:25:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.419+0000 7f74bd23b640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:39.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.419+0000 7f74bd23b640 10 monclient(hunting): authenticate will time out at 1044.984421s 2026-02-17T21:25:39.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.420+0000 7f74b6575640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f74b806fa70 0x7f74b81f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.420+0000 7f74b6575640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f74b806fa70 0x7f74b81f5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:60218/0 (socket says 10.20.193.5:60218) 2026-02-17T21:25:39.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.420+0000 7f74b6575640 1 -- 10.20.193.5:0/3197148754 learned_addr learned my addr 10.20.193.5:0/3197148754 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:39.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.420+0000 7f74b6575640 10 monclient(hunting): get_auth_request con 0x7f74b806fa70 auth_method 0 2026-02-17T21:25:39.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.420+0000 7f74b6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.420+0000 7f74b6575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.420+0000 7f74b6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.421+0000 7f74b6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.421+0000 7f74b6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.421+0000 7f74b6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.422+0000 7f74b6575640 10 monclient(hunting): handle_auth_done global_id 4564 payload 824 2026-02-17T21:25:39.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.422+0000 7f74b6575640 1 -- 10.20.193.5:0/3197148754 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f74a4004900 msgr2=0x7f74b806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.422+0000 7f74b6575640 1 --2- 10.20.193.5:0/3197148754 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f74a4004900 0x7f74b806f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.422+0000 7f74b6575640 1 -- 10.20.193.5:0/3197148754 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f74b81f6420 msgr2=0x7f74b8151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.422+0000 7f74b6575640 1 --2- 10.20.193.5:0/3197148754 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f74b81f6420 0x7f74b8151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.422+0000 7f74b6575640 10 monclient: _finish_hunting 0 2026-02-17T21:25:39.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.422+0000 7f74b6575640 1 monclient: found mon.noname-b 2026-02-17T21:25:39.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.422+0000 7f74b6575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:39.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.422+0000 7f74b6575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.422+0000 7f74b6575640 1 -- 10.20.193.5:0/3197148754 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b81f4b60 con 0x7f74b806fa70 2026-02-17T21:25:39.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.423+0000 7f74b6575640 1 --2- 10.20.193.5:0/3197148754 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f74b806fa70 0x7f74b81f5ee0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f74a002ed90 tx=0x7f74a00048d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.423+0000 7f74977fe640 10 client.?.objecter ms_handle_connect 0x7f74b806fa70 2026-02-17T21:25:39.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.423+0000 7f74977fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:39.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.425+0000 7f74977fe640 1 -- 10.20.193.5:0/3197148754 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a003c070 con 0x7f74b806fa70 2026-02-17T21:25:39.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.425+0000 7f74977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.425+0000 7f74977fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:39.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.425+0000 7f74977fe640 10 monclient: dump: 2026-02-17T21:25:39.428 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.428 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.428 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.428 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.428 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.428 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.429 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.429 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.429 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.429 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.425+0000 7f74977fe640 10 monclient: _finish_auth 0 2026-02-17T21:25:39.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.425+0000 7f74977fe640 10 monclient: _check_auth_tickets 2026-02-17T21:25:39.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.425+0000 7f74977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:39.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.425+0000 7f74977fe640 1 -- 10.20.193.5:0/3197148754 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74a0046070 con 0x7f74b806fa70 2026-02-17T21:25:39.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.425+0000 7f74977fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:39.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.425+0000 7f74977fe640 1 -- 10.20.193.5:0/3197148754 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a0006e60 con 0x7f74b806fa70 2026-02-17T21:25:39.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.425+0000 7f74977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.425+0000 7f74977fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:39.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.425+0000 7f74977fe640 10 monclient: dump: 2026-02-17T21:25:39.429 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.429 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.429 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.429 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.429 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.430 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.430 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.430 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.430 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.430 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.425+0000 7f74b5573640 4 set_mon_vals no callback set 2026-02-17T21:25:39.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.425+0000 7f74bd23b640 5 monclient: authenticate success, global_id 4564 2026-02-17T21:25:39.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.425+0000 7f74bd23b640 10 monclient: _renew_subs 2026-02-17T21:25:39.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.425+0000 7f74bd23b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.425+0000 7f74bd23b640 1 -- 10.20.193.5:0/3197148754 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b81f4e40 con 0x7f74b806fa70 2026-02-17T21:25:39.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.425+0000 7f74bd23b640 10 client.4564.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:39.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.425+0000 7f74bd23b640 10 monclient: _renew_subs 2026-02-17T21:25:39.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.425+0000 7f74bd23b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.425+0000 7f74bd23b640 1 -- 10.20.193.5:0/3197148754 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b81f5400 con 0x7f74b806fa70 2026-02-17T21:25:39.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.425+0000 7f74bd23b640 1 librados: init done 2026-02-17T21:25:39.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.426+0000 7f74bd23b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.426+0000 7f74bd23b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.426+0000 7f74bd23b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.426+0000 7f74bd23b640 1 -- 10.20.193.5:0/3197148754 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74b80cbac0 con 0x7f74b806fa70 2026-02-17T21:25:39.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.439+0000 7f8f2effd640 1 -- 10.20.193.5:0/3939004317 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8f3c0621c0 con 0x7f8f480ccc50 2026-02-17T21:25:39.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.439+0000 7f8f2effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.439+0000 7f8f2effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:39.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.448+0000 7f64c595c640 1 --2- 10.20.193.5:0/3310169343 >> v2:10.20.193.135:3300/0 conn(0x7f64c015f570 0x7f64c015f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.448+0000 7f64c595c640 10 monclient(hunting): get_auth_request con 0x7f64c015f570 auth_method 0 2026-02-17T21:25:39.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.448+0000 7f64c595c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.448+0000 7f64c595c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.448+0000 7f64c595c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.449+0000 7f64c595c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.449+0000 7f64c595c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.449+0000 7f64c595c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.450+0000 7f64c595c640 10 monclient(hunting): handle_auth_done global_id 4607 payload 274 2026-02-17T21:25:39.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.450+0000 7f64c595c640 1 -- 10.20.193.5:0/3310169343 >> v1:10.20.193.135:6789/0 conn(0x7f64c0070fd0 legacy=0x7f64c0152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:39.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.450+0000 7f64c595c640 1 -- 10.20.193.5:0/3310169343 >> v1:10.20.193.5:6789/0 conn(0x7f64c015d200 legacy=0x7f64c00c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:39.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.450+0000 7f64c595c640 10 monclient: _finish_hunting 0 2026-02-17T21:25:39.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.450+0000 7f64c595c640 1 monclient: found mon.noname-c 2026-02-17T21:25:39.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.450+0000 7f64c595c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:39.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.450+0000 7f64c595c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.450+0000 7f64c595c640 1 -- 10.20.193.5:0/3310169343 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c00c8900 con 0x7f64c015f570 2026-02-17T21:25:39.455 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.454+0000 7f64c595c640 1 --2- 10.20.193.5:0/3310169343 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f64c015f570 0x7f64c015f950 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f64c00c93b0 tx=0x7f64b002ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a57e28396532e5f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.457+0000 7f64c495a640 1 -- 10.20.193.5:0/3310169343 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b003c070 con 0x7f64c015f570 2026-02-17T21:25:39.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.458+0000 7f64c495a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.458+0000 7f64c495a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:39.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.458+0000 7f64c495a640 10 monclient: dump: 2026-02-17T21:25:39.461 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.461 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.461 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.461 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.461 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.461 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.461 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.461 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.461 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.461 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.458+0000 7f64c495a640 10 monclient: _finish_auth 0 2026-02-17T21:25:39.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.458+0000 7f64c495a640 10 monclient: _check_auth_tickets 2026-02-17T21:25:39.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.458+0000 7f64c495a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:39.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.458+0000 7f64c495a640 1 -- 10.20.193.5:0/3310169343 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64b002fa80 con 0x7f64c015f570 2026-02-17T21:25:39.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.458+0000 7f64c7be7640 5 monclient: authenticate success, global_id 4607 2026-02-17T21:25:39.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.458+0000 7f64c7be7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:39.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.458+0000 7f64c495a640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:39.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.458+0000 7f64c495a640 1 -- 10.20.193.5:0/3310169343 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b002fe50 con 0x7f64c015f570 2026-02-17T21:25:39.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.458+0000 7f64c495a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.458+0000 7f64c495a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:39.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.458+0000 7f64c495a640 10 monclient: dump: 2026-02-17T21:25:39.462 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.462 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.463 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.463 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.463 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.463 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.463 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.463 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.463 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.463 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.458+0000 7f64c7be7640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:39.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.458+0000 7f64c7be7640 4 set_mon_vals no callback set 2026-02-17T21:25:39.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.458+0000 7f64c7be7640 10 monclient: shutdown 2026-02-17T21:25:39.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.458+0000 7f64c7be7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:39.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.458+0000 7f64c7be7640 1 -- 10.20.193.5:0/3310169343 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f64c015f570 msgr2=0x7f64c015f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.458+0000 7f64c7be7640 1 --2- 10.20.193.5:0/3310169343 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f64c015f570 0x7f64c015f950 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f64c00c93b0 tx=0x7f64b002ee10 comp rx=0 tx=0).stop 2026-02-17T21:25:39.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.458+0000 7f64c7be7640 1 -- 10.20.193.5:0/3310169343 shutdown_connections 2026-02-17T21:25:39.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.458+0000 7f64c7be7640 1 --2- 10.20.193.5:0/3310169343 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f64c015f570 0x7f64c015f950 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.458+0000 7f64c7be7640 1 -- 10.20.193.5:0/3310169343 >> 10.20.193.5:0/3310169343 conn(0x7f64c00cd820 msgr2=0x7f64c00cdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:39.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.458+0000 7f64c7be7640 1 -- 10.20.193.5:0/3310169343 shutdown_connections 2026-02-17T21:25:39.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.458+0000 7f64c7be7640 1 -- 10.20.193.5:0/3310169343 wait complete. 2026-02-17T21:25:39.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.459+0000 7f64c7be7640 10 monclient: build_initial_monmap 2026-02-17T21:25:39.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.459+0000 7f64c7be7640 10 monclient: monmap: 2026-02-17T21:25:39.464 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:39.464 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:39.464 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:39.464 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:39.464 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:39.464 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.465 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:39.465 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:39.465 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:39.465 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.459+0000 7f64c7be7640 1 librados: starting msgr at 2026-02-17T21:25:39.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.459+0000 7f64c7be7640 1 librados: starting objecter 2026-02-17T21:25:39.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.459+0000 7f64c7be7640 1 Processor -- start 2026-02-17T21:25:39.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.459+0000 7f64c7be7640 1 -- start start 2026-02-17T21:25:39.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.459+0000 7f64c7be7640 1 librados: setting wanted keys 2026-02-17T21:25:39.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.459+0000 7f64c7be7640 1 librados: calling monclient init 2026-02-17T21:25:39.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.459+0000 7f64c7be7640 10 monclient: init 2026-02-17T21:25:39.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.460+0000 7f64c7be7640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:39.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.460+0000 7f64c7be7640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:25:39.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.460+0000 7f64c7be7640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f64c0070fd0 0x7f64c014ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.460+0000 7f64c7be7640 10 monclient(hunting): picked mon.noname-a con 0x7f64c0070fd0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:39.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.460+0000 7f64c7be7640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f64c015d200 0x7f64c01f17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.460+0000 7f64c7be7640 10 monclient(hunting): picked mon.noname-c con 0x7f64c015d200 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:39.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.460+0000 7f64c7be7640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f64c015f570 0x7f64c01f4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.460+0000 7f64c7be7640 10 monclient(hunting): picked mon.noname-b con 0x7f64c015f570 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:39.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.460+0000 7f64c7be7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.460+0000 7f64c7be7640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f64c0071440 con 0x7f64c0070fd0 2026-02-17T21:25:39.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.460+0000 7f64c7be7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.460+0000 7f64c7be7640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f64c00c8ec0 con 0x7f64c015f570 2026-02-17T21:25:39.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.460+0000 7f64c7be7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.460+0000 7f64c7be7640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f64c0152940 con 0x7f64c015d200 2026-02-17T21:25:39.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.460+0000 7f64c7be7640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:39.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.460+0000 7f64c7be7640 10 monclient(hunting): authenticate will time out at 1045.025291s 2026-02-17T21:25:39.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.460+0000 7f64c515b640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f64c015d200 0x7f64c01f17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.460+0000 7f64c515b640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f64c015d200 0x7f64c01f17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:54586/0 (socket says 10.20.193.5:54586) 2026-02-17T21:25:39.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.460+0000 7f64c515b640 1 -- 10.20.193.5:0/1392426690 learned_addr learned my addr 10.20.193.5:0/1392426690 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:39.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.461+0000 7f64c515b640 10 monclient(hunting): get_auth_request con 0x7f64c015d200 auth_method 0 2026-02-17T21:25:39.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.461+0000 7f64c515b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.461+0000 7f64c515b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.461+0000 7f64c515b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.461+0000 7f64c515b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.461+0000 7f64c515b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.461+0000 7f64c515b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.462+0000 7f64c515b640 10 monclient(hunting): handle_auth_done global_id 4610 payload 824 2026-02-17T21:25:39.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.462+0000 7f64c515b640 1 -- 10.20.193.5:0/1392426690 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f64c015f570 msgr2=0x7f64c01f4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.462+0000 7f64c515b640 1 --2- 10.20.193.5:0/1392426690 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f64c015f570 0x7f64c01f4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.462+0000 7f64c515b640 1 -- 10.20.193.5:0/1392426690 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f64c0070fd0 msgr2=0x7f64c014ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.462+0000 7f64c515b640 1 --2- 10.20.193.5:0/1392426690 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f64c0070fd0 0x7f64c014ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.462+0000 7f64c515b640 10 monclient: _finish_hunting 0 2026-02-17T21:25:39.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.462+0000 7f64c515b640 1 monclient: found mon.noname-c 2026-02-17T21:25:39.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.462+0000 7f64c515b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:39.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.462+0000 7f64c515b640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.462+0000 7f64c515b640 1 -- 10.20.193.5:0/1392426690 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c01f5550 con 0x7f64c015d200 2026-02-17T21:25:39.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.463+0000 7f64c515b640 1 --2- 10.20.193.5:0/1392426690 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f64c015d200 0x7f64c01f17b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f64b400c560 tx=0x7f64b400ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.463+0000 7f64ae7fc640 10 client.?.objecter ms_handle_connect 0x7f64c015d200 2026-02-17T21:25:39.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.463+0000 7f64ae7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:39.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64ae7fc640 1 -- 10.20.193.5:0/1392426690 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b4005de0 con 0x7f64c015d200 2026-02-17T21:25:39.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64ae7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:39.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64ae7fc640 10 monclient: dump: 2026-02-17T21:25:39.472 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.472 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.472 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.472 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.472 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.472 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.472 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.472 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.472 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.473 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64ae7fc640 10 monclient: _finish_auth 0 2026-02-17T21:25:39.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64ae7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:25:39.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64ae7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:39.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64c7be7640 5 monclient: authenticate success, global_id 4610 2026-02-17T21:25:39.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64c7be7640 10 monclient: _renew_subs 2026-02-17T21:25:39.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64c7be7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64c7be7640 1 -- 10.20.193.5:0/1392426690 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64c01f5830 con 0x7f64c015d200 2026-02-17T21:25:39.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64c7be7640 10 client.4610.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:39.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64c7be7640 10 monclient: _renew_subs 2026-02-17T21:25:39.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64c7be7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64c7be7640 1 -- 10.20.193.5:0/1392426690 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64c01f5df0 con 0x7f64c015d200 2026-02-17T21:25:39.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64c7be7640 1 librados: init done 2026-02-17T21:25:39.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64ae7fc640 1 -- 10.20.193.5:0/1392426690 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64b4007070 con 0x7f64c015d200 2026-02-17T21:25:39.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64ae7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:39.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64affff640 4 set_mon_vals no callback set 2026-02-17T21:25:39.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64ae7fc640 1 -- 10.20.193.5:0/1392426690 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b4007420 con 0x7f64c015d200 2026-02-17T21:25:39.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64ae7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:39.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64ae7fc640 10 monclient: dump: 2026-02-17T21:25:39.474 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.474 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.474 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.474 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.474 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.474 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.474 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.474 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.474 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.474 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64c7be7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64c7be7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64c7be7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.465+0000 7f64c7be7640 1 -- 10.20.193.5:0/1392426690 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64c015f950 con 0x7f64c015d200 2026-02-17T21:25:39.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.476+0000 7f64ae7fc640 1 -- 10.20.193.5:0/1392426690 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f64b40075c0 con 0x7f64c015d200 2026-02-17T21:25:39.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.477+0000 7f64ae7fc640 1 --2- 10.20.193.5:0/1392426690 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f64900792b0 0x7f649007b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.477+0000 7f64c595c640 1 --2- 10.20.193.5:0/1392426690 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f64900792b0 0x7f649007b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.477+0000 7f64c595c640 10 monclient: get_auth_request con 0x7f64900792b0 auth_method 0 2026-02-17T21:25:39.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.477+0000 7f64ae7fc640 1 -- 10.20.193.5:0/1392426690 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f64b4019de0 con 0x7f64c015d200 2026-02-17T21:25:39.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.477+0000 7f64ae7fc640 10 client.4610.objecter ms_dispatch2 0x7f64c0000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:39.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.477+0000 7f64ae7fc640 3 client.4610.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:39.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.477+0000 7f64ae7fc640 3 client.4610.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:39.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.477+0000 7f64ae7fc640 20 client.4610.objecter dump_active .. 0 homeless 2026-02-17T21:25:39.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.478+0000 7f64ae7fc640 10 client.4610.objecter ms_handle_connect 0x7f64900792b0 2026-02-17T21:25:39.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.478+0000 7f64c595c640 1 --2- 10.20.193.5:0/1392426690 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f64900792b0 0x7f649007b770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f64b0039000 tx=0x7f64b0031000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.489+0000 7f38edb19640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T21:25:39.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.489+0000 7f38edb19640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T21:25:39.491 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.489+0000 7f38edb19640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.491 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.489+0000 7f38edb19640 1 -- 10.20.193.5:0/4091279194 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f38e81598e0 con 0x7f38e80ce5d0 2026-02-17T21:25:39.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.500+0000 7f2098ff9640 1 -- 10.20.193.5:0/2841672594 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2088062b90 con 0x7f209c155770 2026-02-17T21:25:39.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.500+0000 7f2098ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.500+0000 7f2098ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:39.523 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-17T21:25:39.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.527+0000 7f8f4cd03640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T21:25:39.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.527+0000 7f8f4cd03640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T21:25:39.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.527+0000 7f8f4cd03640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.527+0000 7f8f4cd03640 1 -- 10.20.193.5:0/3939004317 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8f4806f3c0 con 0x7f8f480ccc50 2026-02-17T21:25:39.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.530+0000 7f74977fe640 1 -- 10.20.193.5:0/3197148754 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f74a0002b10 con 0x7f74b806fa70 2026-02-17T21:25:39.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.530+0000 7f74977fe640 1 --2- 10.20.193.5:0/3197148754 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f74840792d0 0x7f748407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.530+0000 7f74b6d76640 1 --2- 10.20.193.5:0/3197148754 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f74840792d0 0x7f748407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.530+0000 7f74b6d76640 10 monclient: get_auth_request con 0x7f74840792d0 auth_method 0 2026-02-17T21:25:39.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.531+0000 7f74b6d76640 1 --2- 10.20.193.5:0/3197148754 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f74840792d0 0x7f748407b790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f74ac007ab0 tx=0x7f74ac002dd0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.531+0000 7f74977fe640 10 client.4564.objecter ms_handle_connect 0x7f74840792d0 2026-02-17T21:25:39.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.532+0000 7f74977fe640 1 -- 10.20.193.5:0/3197148754 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f74a0082f40 con 0x7f74b806fa70 2026-02-17T21:25:39.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.532+0000 7f74977fe640 10 client.4564.objecter ms_dispatch2 0x7f74b8000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:39.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.532+0000 7f74977fe640 3 client.4564.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:39.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.532+0000 7f74977fe640 3 client.4564.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:39.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.532+0000 7f74977fe640 20 client.4564.objecter dump_active .. 0 homeless 2026-02-17T21:25:39.536 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2026-02-17T21:25:39.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.539+0000 7f74977fe640 1 -- 10.20.193.5:0/3197148754 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f74a0087600 con 0x7f74b806fa70 2026-02-17T21:25:39.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.539+0000 7f74977fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.539+0000 7f74977fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:39.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.543+0000 7f38c3fff640 1 -- 10.20.193.5:0/4091279194 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f38d4066a90 con 0x7f38e80ce5d0 2026-02-17T21:25:39.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.543+0000 7f38c3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T21:25:39.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.543+0000 7f38c3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:39.545 INFO:teuthology.orchestra.run.trial005.stdout:103079215109 2026-02-17T21:25:39.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.545+0000 7f38edb19640 10 librados: watch_flush enter 2026-02-17T21:25:39.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.545+0000 7f38edb19640 10 librados: watch_flush exit 2026-02-17T21:25:39.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.545+0000 7f38edb19640 20 client.4558.objecter shutdown clearing up homeless session... 2026-02-17T21:25:39.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.545+0000 7f38edb19640 10 client.4558.objecter successfully canceled tick 2026-02-17T21:25:39.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.545+0000 7f38edb19640 1 -- 10.20.193.5:0/4091279194 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f38b80792b0 msgr2=0x7f38b807b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.545+0000 7f38edb19640 1 --2- 10.20.193.5:0/4091279194 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f38b80792b0 0x7f38b807b770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f38d8039000 tx=0x7f38d8033000 comp rx=0 tx=0).stop 2026-02-17T21:25:39.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.545+0000 7f38edb19640 10 monclient: shutdown 2026-02-17T21:25:39.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.545+0000 7f38edb19640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:39.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.545+0000 7f38edb19640 1 -- 10.20.193.5:0/4091279194 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f38e80ce5d0 msgr2=0x7f38e81f7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.545+0000 7f38edb19640 1 --2- 10.20.193.5:0/4091279194 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f38e80ce5d0 0x7f38e81f7900 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f38d400e890 tx=0x7f38d400ed60 comp rx=0 tx=0).stop 2026-02-17T21:25:39.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.545+0000 7f38edb19640 1 -- 10.20.193.5:0/4091279194 shutdown_connections 2026-02-17T21:25:39.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.545+0000 7f38edb19640 1 --2- 10.20.193.5:0/4091279194 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f38b80792b0 0x7f38b807b770 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.545+0000 7f38edb19640 1 --2- 10.20.193.5:0/4091279194 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f38e815bf30 0x7f38e80cfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.545+0000 7f38edb19640 1 --2- 10.20.193.5:0/4091279194 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f38e80ceef0 0x7f38e815b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.545+0000 7f38edb19640 1 --2- 10.20.193.5:0/4091279194 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f38e80ce5d0 0x7f38e81f7900 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.545+0000 7f38edb19640 1 -- 10.20.193.5:0/4091279194 >> 10.20.193.5:0/4091279194 conn(0x7f38e8073030 msgr2=0x7f38e8154340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:39.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.545+0000 7f38edb19640 1 -- 10.20.193.5:0/4091279194 shutdown_connections 2026-02-17T21:25:39.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.545+0000 7f38edb19640 1 -- 10.20.193.5:0/4091279194 wait complete. 2026-02-17T21:25:39.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.545+0000 7f38edb19640 1 librados: shutdown 2026-02-17T21:25:39.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215108 got 103079215109 for osd.0 2026-02-17T21:25:39.556 DEBUG:teuthology.parallel:result is None 2026-02-17T21:25:39.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.579+0000 7f64ae7fc640 1 -- 10.20.193.5:0/1392426690 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f64b4062c90 con 0x7f64c015d200 2026-02-17T21:25:39.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.579+0000 7f64ae7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.579+0000 7f64ae7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:39.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.585+0000 7f8f2effd640 1 -- 10.20.193.5:0/3939004317 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8f3c0664c0 con 0x7f8f480ccc50 2026-02-17T21:25:39.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.585+0000 7f8f2effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T21:25:39.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.585+0000 7f8f2effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:39.587 INFO:teuthology.orchestra.run.trial005.stdout:115964117001 2026-02-17T21:25:39.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.586+0000 7f20a28ea640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T21:25:39.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.586+0000 7f20a28ea640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T21:25:39.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.586+0000 7f20a28ea640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:39.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.586+0000 7f20a28ea640 1 -- 10.20.193.5:0/2841672594 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f209c160450 con 0x7f209c155770 2026-02-17T21:25:39.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.588+0000 7f8f4cd03640 10 librados: watch_flush enter 2026-02-17T21:25:39.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.588+0000 7f8f4cd03640 10 librados: watch_flush exit 2026-02-17T21:25:39.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.588+0000 7f8f4cd03640 20 client.4604.objecter shutdown clearing up homeless session... 2026-02-17T21:25:39.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.588+0000 7f8f4cd03640 10 client.4604.objecter successfully canceled tick 2026-02-17T21:25:39.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.588+0000 7f8f4cd03640 1 -- 10.20.193.5:0/3939004317 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8f14079280 msgr2=0x7f8f1407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.588+0000 7f8f4cd03640 1 --2- 10.20.193.5:0/3939004317 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8f14079280 0x7f8f1407b740 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8f30002770 tx=0x7f8f30007ab0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.588+0000 7f8f4cd03640 10 monclient: shutdown 2026-02-17T21:25:39.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.588+0000 7f8f4cd03640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:39.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.588+0000 7f8f4cd03640 1 -- 10.20.193.5:0/3939004317 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8f480ccc50 msgr2=0x7f8f48070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.588+0000 7f8f4cd03640 1 --2- 10.20.193.5:0/3939004317 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8f480ccc50 0x7f8f48070b40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00ebe0 tx=0x7f8f3c00c520 comp rx=0 tx=0).stop 2026-02-17T21:25:39.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.588+0000 7f8f4cd03640 1 -- 10.20.193.5:0/3939004317 shutdown_connections 2026-02-17T21:25:39.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.588+0000 7f8f4cd03640 1 --2- 10.20.193.5:0/3939004317 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8f14079280 0x7f8f1407b740 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.588+0000 7f8f4cd03640 1 --2- 10.20.193.5:0/3939004317 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8f4815fdf0 0x7f8f48158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.588+0000 7f8f4cd03640 1 --2- 10.20.193.5:0/3939004317 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8f48155b60 0x7f8f4806f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.588+0000 7f8f4cd03640 1 --2- 10.20.193.5:0/3939004317 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8f480ccc50 0x7f8f48070b40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.588+0000 7f8f4cd03640 1 -- 10.20.193.5:0/3939004317 >> 10.20.193.5:0/3939004317 conn(0x7f8f480cc130 msgr2=0x7f8f480cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:39.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.588+0000 7f8f4cd03640 1 -- 10.20.193.5:0/3939004317 shutdown_connections 2026-02-17T21:25:39.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.588+0000 7f8f4cd03640 1 -- 10.20.193.5:0/3939004317 wait complete. 2026-02-17T21:25:39.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.588+0000 7f8f4cd03640 1 librados: shutdown 2026-02-17T21:25:39.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.592+0000 7f8fa4daf640 10 monclient: get_monmap_and_config 2026-02-17T21:25:39.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.592+0000 7f8fa4daf640 10 monclient: build_initial_monmap 2026-02-17T21:25:39.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.592+0000 7f8fa4daf640 10 monclient: monmap: 2026-02-17T21:25:39.594 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:39.594 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.594 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:39.593599+0000 2026-02-17T21:25:39.594 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:39.593599+0000 2026-02-17T21:25:39.594 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:39.595 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.595 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:39.595 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:39.595 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:39.595 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:39.595 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:39.595 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:39.595 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.593+0000 7f8fa4daf640 1 Processor -- start 2026-02-17T21:25:39.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.593+0000 7f8fa4daf640 1 -- start start 2026-02-17T21:25:39.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.593+0000 7f8fa4daf640 10 monclient: init 2026-02-17T21:25:39.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.593+0000 7f8fa4daf640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:39.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.593+0000 7f8fa4daf640 10 monclient: _add_conns ranks=[5,3,4,2,0,1] 2026-02-17T21:25:39.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8fa4daf640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f8fa014f280 0x7f8fa00c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8fa4daf640 10 monclient(hunting): picked mon.noname-c con 0x7f8fa014f280 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:39.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8fa4daf640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f8fa014f660 0x7f8fa00c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8fa4daf640 10 monclient(hunting): picked mon.noname-a con 0x7f8fa014f660 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:39.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8fa4daf640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f8fa015abc0 0x7f8fa015afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8fa4daf640 10 monclient(hunting): picked mon.noname-b con 0x7f8fa015abc0 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:39.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8fa4daf640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8fa4daf640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f8fa00c7950 con 0x7f8fa014f660 2026-02-17T21:25:39.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8fa4daf640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8fa4daf640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f8fa015a730 con 0x7f8fa015abc0 2026-02-17T21:25:39.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8fa4daf640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8fa4daf640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f8fa00c7390 con 0x7f8fa014f280 2026-02-17T21:25:39.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8fa4daf640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:39.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8fa4daf640 10 monclient(hunting): authenticate will time out at 1045.159037s 2026-02-17T21:25:39.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8f9e575640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f8fa014f280 0x7f8fa00c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8f9e575640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f8fa014f280 0x7f8fa00c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:54590/0 (socket says 10.20.193.5:54590) 2026-02-17T21:25:39.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8f9e575640 1 -- 10.20.193.5:0/3171261152 learned_addr learned my addr 10.20.193.5:0/3171261152 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:39.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8f9e575640 10 monclient(hunting): get_auth_request con 0x7f8fa014f280 auth_method 0 2026-02-17T21:25:39.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8f9e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8f9e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8f9e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8f9ed76640 1 --2- 10.20.193.5:0/3171261152 >> v2:10.20.193.119:3300/0 conn(0x7f8fa015abc0 0x7f8fa015afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8f9ed76640 10 monclient(hunting): get_auth_request con 0x7f8fa015abc0 auth_method 0 2026-02-17T21:25:39.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8f9ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8f9ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8f9ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8f9e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8f9e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8f9e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8f9ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8f9ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.594+0000 7f8f9ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.595+0000 7f8f9e575640 10 monclient(hunting): handle_auth_done global_id 4613 payload 274 2026-02-17T21:25:39.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.595+0000 7f8f9e575640 1 -- 10.20.193.5:0/3171261152 >> v2:10.20.193.119:3300/0 conn(0x7f8fa015abc0 msgr2=0x7f8fa015afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:39.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.595+0000 7f8f9e575640 1 --2- 10.20.193.5:0/3171261152 >> v2:10.20.193.119:3300/0 conn(0x7f8fa015abc0 0x7f8fa015afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.595+0000 7f8f9e575640 1 -- 10.20.193.5:0/3171261152 >> v2:10.20.193.5:3300/0 conn(0x7f8fa014f660 msgr2=0x7f8fa00c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:39.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.595+0000 7f8f9e575640 1 --2- 10.20.193.5:0/3171261152 >> v2:10.20.193.5:3300/0 conn(0x7f8fa014f660 0x7f8fa00c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.595+0000 7f8f9e575640 10 monclient: _finish_hunting 0 2026-02-17T21:25:39.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.595+0000 7f8f9e575640 1 monclient: found mon.noname-c 2026-02-17T21:25:39.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.595+0000 7f8f9e575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:39.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.595+0000 7f8f9e575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.595+0000 7f8f9e575640 1 -- 10.20.193.5:0/3171261152 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa00c7670 con 0x7f8fa014f280 2026-02-17T21:25:39.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.596+0000 7f8f9e575640 1 --2- 10.20.193.5:0/3171261152 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8fa014f280 0x7f8fa00c7e20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00c4740 tx=0x7f8f94031790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=312209b59ecf64a9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8f9d573640 1 -- 10.20.193.5:0/3171261152 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f94036710 con 0x7f8fa014f280 2026-02-17T21:25:39.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8f9d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8f9d573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:39.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8f9d573640 10 monclient: dump: 2026-02-17T21:25:39.604 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.604 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.605 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.605 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.605 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.605 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.605 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.605 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.605 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.605 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8f9d573640 10 monclient: _finish_auth 0 2026-02-17T21:25:39.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8f9d573640 10 monclient: _check_auth_tickets 2026-02-17T21:25:39.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8f9d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:39.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8f9d573640 1 -- 10.20.193.5:0/3171261152 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f940368b0 con 0x7f8fa014f280 2026-02-17T21:25:39.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8fa4daf640 5 monclient: authenticate success, global_id 4613 2026-02-17T21:25:39.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8fa4daf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:39.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8f9d573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:39.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8fa4daf640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:39.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8f9d573640 1 -- 10.20.193.5:0/3171261152 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f94036c80 con 0x7f8fa014f280 2026-02-17T21:25:39.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8fa4daf640 4 set_mon_vals no callback set 2026-02-17T21:25:39.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8f9d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8f9d573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:39.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8f9d573640 10 monclient: dump: 2026-02-17T21:25:39.606 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.606 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.607 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.607 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.607 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.607 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.607 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.607 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.607 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.607 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8fa4daf640 10 monclient: shutdown 2026-02-17T21:25:39.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8fa4daf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:39.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8fa4daf640 1 -- 10.20.193.5:0/3171261152 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8fa014f280 msgr2=0x7f8fa00c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8fa4daf640 1 --2- 10.20.193.5:0/3171261152 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8fa014f280 0x7f8fa00c7e20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00c4740 tx=0x7f8f94031790 comp rx=0 tx=0).stop 2026-02-17T21:25:39.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8fa4daf640 1 -- 10.20.193.5:0/3171261152 shutdown_connections 2026-02-17T21:25:39.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8fa4daf640 1 --2- 10.20.193.5:0/3171261152 >> v2:10.20.193.119:3300/0 conn(0x7f8fa015abc0 0x7f8fa015afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8fa4daf640 1 --2- 10.20.193.5:0/3171261152 >> v2:10.20.193.5:3300/0 conn(0x7f8fa014f660 0x7f8fa00c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8fa4daf640 1 --2- 10.20.193.5:0/3171261152 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8fa014f280 0x7f8fa00c7e20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8fa4daf640 1 -- 10.20.193.5:0/3171261152 >> 10.20.193.5:0/3171261152 conn(0x7f8fa00c9f20 msgr2=0x7f8fa00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:39.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8fa4daf640 1 -- 10.20.193.5:0/3171261152 shutdown_connections 2026-02-17T21:25:39.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8fa4daf640 1 -- 10.20.193.5:0/3171261152 wait complete. 2026-02-17T21:25:39.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f2098ff9640 1 -- 10.20.193.5:0/2841672594 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f209c160450 con 0x7f209c155770 2026-02-17T21:25:39.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f2098ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T21:25:39.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f2098ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:39.609 INFO:teuthology.orchestra.run.trial005.stdout:120259084295 2026-02-17T21:25:39.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8fa4daf640 10 monclient: build_initial_monmap 2026-02-17T21:25:39.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.598+0000 7f8fa4daf640 10 monclient: monmap: 2026-02-17T21:25:39.610 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:39.610 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:39.610 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:39.610 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:39.611 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:39.611 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.611 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:39.611 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:39.611 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:39.611 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.599+0000 7f8fa4daf640 1 librados: starting msgr at 2026-02-17T21:25:39.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.599+0000 7f8fa4daf640 1 librados: starting objecter 2026-02-17T21:25:39.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.599+0000 7f8fa4daf640 1 Processor -- start 2026-02-17T21:25:39.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.599+0000 7f8fa4daf640 1 -- start start 2026-02-17T21:25:39.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.599+0000 7f8fa4daf640 1 librados: setting wanted keys 2026-02-17T21:25:39.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.599+0000 7f8fa4daf640 1 librados: calling monclient init 2026-02-17T21:25:39.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.599+0000 7f8fa4daf640 10 monclient: init 2026-02-17T21:25:39.613 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117001 got 115964117001 for osd.3 2026-02-17T21:25:39.613 DEBUG:teuthology.parallel:result is None 2026-02-17T21:25:39.615 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.599+0000 7f8fa4daf640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:39.615 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.599+0000 7f8fa4daf640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:25:39.615 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.599+0000 7f8fa4daf640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8fa014f280 0x7f8fa00cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.599+0000 7f8fa4daf640 10 monclient(hunting): picked mon.noname-b con 0x7f8fa014f280 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:39.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.599+0000 7f8fa4daf640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8fa014f660 0x7f8fa0073000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.599+0000 7f8fa4daf640 10 monclient(hunting): picked mon.noname-a con 0x7f8fa014f660 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:39.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.599+0000 7f8fa4daf640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8fa015abc0 0x7f8fa0073540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.599+0000 7f8fa4daf640 10 monclient(hunting): picked mon.noname-c con 0x7f8fa015abc0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:39.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.599+0000 7f8fa4daf640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.599+0000 7f8fa4daf640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa015b520 con 0x7f8fa014f660 2026-02-17T21:25:39.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.599+0000 7f8fa4daf640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.599+0000 7f8fa4daf640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa015a3c0 con 0x7f8fa014f280 2026-02-17T21:25:39.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.599+0000 7f8fa4daf640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.599+0000 7f8fa4daf640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa00c9b70 con 0x7f8fa015abc0 2026-02-17T21:25:39.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.599+0000 7f8fa4daf640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:39.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.599+0000 7f8fa4daf640 10 monclient(hunting): authenticate will time out at 1045.164621s 2026-02-17T21:25:39.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.599+0000 7f8f9ed76640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8fa015abc0 0x7f8fa0073540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.599+0000 7f8f9e575640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8fa014f280 0x7f8fa00cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.600+0000 7f8f9ed76640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8fa015abc0 0x7f8fa0073540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:54602/0 (socket says 10.20.193.5:54602) 2026-02-17T21:25:39.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.600+0000 7f8f9ed76640 1 -- 10.20.193.5:0/2694525632 learned_addr learned my addr 10.20.193.5:0/2694525632 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:39.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.600+0000 7f8f9ed76640 10 monclient(hunting): get_auth_request con 0x7f8fa015abc0 auth_method 0 2026-02-17T21:25:39.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.600+0000 7f8f9ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.600+0000 7f8f9ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.600+0000 7f8f9ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.600+0000 7f8f9e575640 10 monclient(hunting): get_auth_request con 0x7f8fa014f280 auth_method 0 2026-02-17T21:25:39.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.600+0000 7f8f9e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.600+0000 7f8f9e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.600+0000 7f8f9e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.600+0000 7f8f9ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.600+0000 7f8f9ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.600+0000 7f8f9ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.600+0000 7f8f9e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.600+0000 7f8f9e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.600+0000 7f8f9e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f20a28ea640 10 librados: watch_flush enter 2026-02-17T21:25:39.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f20a28ea640 10 librados: watch_flush exit 2026-02-17T21:25:39.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f20a28ea640 20 client.4548.objecter shutdown clearing up homeless session... 2026-02-17T21:25:39.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f20a28ea640 10 client.4548.objecter successfully canceled tick 2026-02-17T21:25:39.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f8f9dd74640 1 --2- 10.20.193.5:0/2694525632 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8fa014f660 0x7f8fa0073000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.619 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-17T21:25:39.621 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f20a28ea640 1 -- 10.20.193.5:0/2841672594 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f206c0792d0 msgr2=0x7f206c07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.621 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f20a28ea640 1 --2- 10.20.193.5:0/2841672594 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f206c0792d0 0x7f206c07b790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f209c0696f0 tx=0x7f208c031000 comp rx=0 tx=0).stop 2026-02-17T21:25:39.621 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f20a28ea640 10 monclient: shutdown 2026-02-17T21:25:39.621 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f20a28ea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:39.621 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f20a28ea640 1 -- 10.20.193.5:0/2841672594 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f209c155770 msgr2=0x7f209c06f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.621 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f20a28ea640 1 --2- 10.20.193.5:0/2841672594 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f209c155770 0x7f209c06f130 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f208800c5b0 tx=0x7f208800ca80 comp rx=0 tx=0).stop 2026-02-17T21:25:39.621 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f20a28ea640 1 -- 10.20.193.5:0/2841672594 shutdown_connections 2026-02-17T21:25:39.621 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f20a28ea640 1 --2- 10.20.193.5:0/2841672594 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f206c0792d0 0x7f206c07b790 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.621 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f20a28ea640 1 --2- 10.20.193.5:0/2841672594 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f209c15f950 0x7f209c0c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.621 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f20a28ea640 1 --2- 10.20.193.5:0/2841672594 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f209c15f570 0x7f209c0c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.621 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f20a28ea640 1 --2- 10.20.193.5:0/2841672594 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f209c155770 0x7f209c06f130 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.621 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f20a28ea640 1 -- 10.20.193.5:0/2841672594 >> 10.20.193.5:0/2841672594 conn(0x7f209c0c9f40 msgr2=0x7f209c153200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:39.621 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f20a28ea640 1 -- 10.20.193.5:0/2841672594 shutdown_connections 2026-02-17T21:25:39.622 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f20a28ea640 1 -- 10.20.193.5:0/2841672594 wait complete. 2026-02-17T21:25:39.622 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f20a28ea640 1 librados: shutdown 2026-02-17T21:25:39.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f8f9dd74640 10 monclient(hunting): get_auth_request con 0x7f8fa014f660 auth_method 0 2026-02-17T21:25:39.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f8f9dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f8f9dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f8f9dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f8f9ed76640 10 monclient(hunting): handle_auth_done global_id 4616 payload 824 2026-02-17T21:25:39.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f8f9ed76640 1 -- 10.20.193.5:0/2694525632 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8fa014f280 msgr2=0x7f8fa00cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f8f9ed76640 1 --2- 10.20.193.5:0/2694525632 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8fa014f280 0x7f8fa00cbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f8f9ed76640 1 -- 10.20.193.5:0/2694525632 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8fa014f660 msgr2=0x7f8fa0073000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f8f9ed76640 1 --2- 10.20.193.5:0/2694525632 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8fa014f660 0x7f8fa0073000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f8f9ed76640 10 monclient: _finish_hunting 0 2026-02-17T21:25:39.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f8f9ed76640 1 monclient: found mon.noname-c 2026-02-17T21:25:39.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f8f9ed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:39.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f8f9ed76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.601+0000 7f8f9ed76640 1 -- 10.20.193.5:0/2694525632 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa006efe0 con 0x7f8fa015abc0 2026-02-17T21:25:39.624 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.602+0000 7f8f9ed76640 1 --2- 10.20.193.5:0/2694525632 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8fa015abc0 0x7f8fa0073540 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8f90009dd0 tx=0x7f8f9000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.624 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.602+0000 7f8f86ffd640 10 client.?.objecter ms_handle_connect 0x7f8fa015abc0 2026-02-17T21:25:39.624 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.602+0000 7f8f86ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:39.624 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f41acb40640 10 monclient: get_monmap_and_config 2026-02-17T21:25:39.624 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f41acb40640 10 monclient: build_initial_monmap 2026-02-17T21:25:39.624 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f41acb40640 10 monclient: monmap: 2026-02-17T21:25:39.624 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:39.624 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.624 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:39.604940+0000 2026-02-17T21:25:39.624 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:39.604940+0000 2026-02-17T21:25:39.625 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:39.625 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.625 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:39.625 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:39.625 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:39.625 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:39.625 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:39.625 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:39.625 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f8f86ffd640 1 -- 10.20.193.5:0/2694525632 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f90018020 con 0x7f8fa015abc0 2026-02-17T21:25:39.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f8f86ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f8f86ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:39.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f8f86ffd640 10 monclient: dump: 2026-02-17T21:25:39.626 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.626 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.626 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.626 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.626 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.626 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.626 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.626 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.627 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.627 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f8f86ffd640 10 monclient: _finish_auth 0 2026-02-17T21:25:39.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f8f86ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:39.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f8f86ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:39.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f8f86ffd640 1 -- 10.20.193.5:0/2694525632 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f90014480 con 0x7f8fa015abc0 2026-02-17T21:25:39.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f8f86ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:39.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f8f86ffd640 1 -- 10.20.193.5:0/2694525632 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f90014870 con 0x7f8fa015abc0 2026-02-17T21:25:39.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f8f86ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f8f86ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:39.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f8f86ffd640 10 monclient: dump: 2026-02-17T21:25:39.627 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.627 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.627 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.627 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.627 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.627 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.627 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.628 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.628 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.628 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f8f9cd72640 4 set_mon_vals no callback set 2026-02-17T21:25:39.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f8fa4daf640 5 monclient: authenticate success, global_id 4616 2026-02-17T21:25:39.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f8fa4daf640 10 monclient: _renew_subs 2026-02-17T21:25:39.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f8fa4daf640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f8fa4daf640 1 -- 10.20.193.5:0/2694525632 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fa006f2c0 con 0x7f8fa015abc0 2026-02-17T21:25:39.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f8fa4daf640 10 client.4616.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:39.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f8fa4daf640 10 monclient: _renew_subs 2026-02-17T21:25:39.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f8fa4daf640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f8fa4daf640 1 -- 10.20.193.5:0/2694525632 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fa0072800 con 0x7f8fa015abc0 2026-02-17T21:25:39.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f8fa4daf640 1 librados: init done 2026-02-17T21:25:39.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f41acb40640 1 Processor -- start 2026-02-17T21:25:39.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f41acb40640 1 -- start start 2026-02-17T21:25:39.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.604+0000 7f41acb40640 10 monclient: init 2026-02-17T21:25:39.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f8fa4daf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f8fa4daf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f8fa4daf640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f8fa4daf640 1 -- 10.20.193.5:0/2694525632 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fa015afe0 con 0x7f8fa015abc0 2026-02-17T21:25:39.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f41acb40640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:39.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f41acb40640 10 monclient: _add_conns ranks=[5,4,0,3,2,1] 2026-02-17T21:25:39.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f41acb40640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f41a814f280 0x7f41a80c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f41acb40640 10 monclient(hunting): picked mon.noname-c con 0x7f41a814f280 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:39.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f41acb40640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f41a814f660 0x7f41a80c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f41acb40640 10 monclient(hunting): picked mon.noname-b con 0x7f41a814f660 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f41acb40640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f41a815abc0 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f41acb40640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41a80c7390 con 0x7f41a815abc0 2026-02-17T21:25:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f41acb40640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f41acb40640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f41a80c7950 con 0x7f41a814f660 2026-02-17T21:25:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f41acb40640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f41acb40640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f41a815a730 con 0x7f41a814f280 2026-02-17T21:25:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f41acb40640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f41acb40640 10 monclient(hunting): authenticate will time out at 1045.170355s 2026-02-17T21:25:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f41a5d74640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f41a814f660 0x7f41a80c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f41a6d76640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f41a815abc0 0x7f41a815afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:37624/0 (socket says 10.20.193.5:37624) 2026-02-17T21:25:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f41a6d76640 1 -- 10.20.193.5:0/343912416 learned_addr learned my addr 10.20.193.5:0/343912416 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:39.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f41a5d74640 10 monclient(hunting): get_auth_request con 0x7f41a814f660 auth_method 0 2026-02-17T21:25:39.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f41a5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f41a5d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f41a5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f41a5d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f41a5d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.605+0000 7f41a5d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.606+0000 7f41a5d74640 10 monclient(hunting): handle_auth_done global_id 4573 payload 274 2026-02-17T21:25:39.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.606+0000 7f41a5d74640 1 -- 10.20.193.5:0/343912416 >> v2:10.20.193.135:3300/0 conn(0x7f41a814f280 msgr2=0x7f41a80c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:39.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.606+0000 7f41a5d74640 1 --2- 10.20.193.5:0/343912416 >> v2:10.20.193.135:3300/0 conn(0x7f41a814f280 0x7f41a80c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.606+0000 7f41a5d74640 1 -- 10.20.193.5:0/343912416 >> v1:10.20.193.5:6789/0 conn(0x7f41a815abc0 legacy=0x7f41a815afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.606+0000 7f41a5d74640 10 monclient: _finish_hunting 0 2026-02-17T21:25:39.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.606+0000 7f41a5d74640 1 monclient: found mon.noname-b 2026-02-17T21:25:39.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.606+0000 7f41a5d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:39.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.606+0000 7f41a5d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.606+0000 7f41a5d74640 1 -- 10.20.193.5:0/343912416 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a80c7670 con 0x7f41a814f660 2026-02-17T21:25:39.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.607+0000 7f41a5d74640 1 --2- 10.20.193.5:0/343912416 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f41a814f660 0x7f41a80c6a00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f41a8069960 tx=0x7f419002eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f68cc0244b060716 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41a5573640 1 -- 10.20.193.5:0/343912416 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419003c070 con 0x7f41a814f660 2026-02-17T21:25:39.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41a5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41a5573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:39.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41a5573640 10 monclient: dump: 2026-02-17T21:25:39.636 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.636 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.636 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.636 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.637 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.637 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.637 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.637 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.637 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41a5573640 10 monclient: _finish_auth 0 2026-02-17T21:25:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41a5573640 10 monclient: _check_auth_tickets 2026-02-17T21:25:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41a5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41a5573640 1 -- 10.20.193.5:0/343912416 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f419002fb80 con 0x7f41a814f660 2026-02-17T21:25:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41a5573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41a5573640 1 -- 10.20.193.5:0/343912416 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4190037440 con 0x7f41a814f660 2026-02-17T21:25:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41acb40640 5 monclient: authenticate success, global_id 4573 2026-02-17T21:25:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41acb40640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41acb40640 4 set_mon_vals no callback set 2026-02-17T21:25:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41a5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41a5573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41a5573640 10 monclient: dump: 2026-02-17T21:25:39.637 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.638 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.638 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.638 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.638 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.638 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.638 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.638 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.638 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41acb40640 10 monclient: shutdown 2026-02-17T21:25:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41acb40640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41acb40640 1 -- 10.20.193.5:0/343912416 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f41a814f660 msgr2=0x7f41a80c6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41acb40640 1 --2- 10.20.193.5:0/343912416 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f41a814f660 0x7f41a80c6a00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f41a8069960 tx=0x7f419002eeb0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41acb40640 1 -- 10.20.193.5:0/343912416 shutdown_connections 2026-02-17T21:25:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41acb40640 1 --2- 10.20.193.5:0/343912416 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f41a814f660 0x7f41a80c6a00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41acb40640 1 --2- 10.20.193.5:0/343912416 >> v2:10.20.193.135:3300/0 conn(0x7f41a814f280 0x7f41a80c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41acb40640 1 -- 10.20.193.5:0/343912416 >> 10.20.193.5:0/343912416 conn(0x7f41a80c9f20 msgr2=0x7f41a80ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41acb40640 1 -- 10.20.193.5:0/343912416 shutdown_connections 2026-02-17T21:25:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.609+0000 7f41acb40640 1 -- 10.20.193.5:0/343912416 wait complete. 2026-02-17T21:25:39.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084295 got 120259084295 for osd.4 2026-02-17T21:25:39.639 DEBUG:teuthology.parallel:result is None 2026-02-17T21:25:39.642 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.610+0000 7f41acb40640 10 monclient: build_initial_monmap 2026-02-17T21:25:39.642 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.610+0000 7f41acb40640 10 monclient: monmap: 2026-02-17T21:25:39.642 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:39.642 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:39.642 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:39.642 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:39.642 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:39.642 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.642 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:39.642 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:39.642 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:39.642 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.642 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.610+0000 7f41acb40640 1 librados: starting msgr at 2026-02-17T21:25:39.642 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.610+0000 7f41acb40640 1 librados: starting objecter 2026-02-17T21:25:39.642 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.610+0000 7f41acb40640 1 Processor -- start 2026-02-17T21:25:39.642 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.610+0000 7f41acb40640 1 -- start start 2026-02-17T21:25:39.642 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.610+0000 7f41acb40640 1 librados: setting wanted keys 2026-02-17T21:25:39.642 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.610+0000 7f41acb40640 1 librados: calling monclient init 2026-02-17T21:25:39.642 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.610+0000 7f41acb40640 10 monclient: init 2026-02-17T21:25:39.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.610+0000 7f41acb40640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:39.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.610+0000 7f41acb40640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:25:39.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.610+0000 7f41acb40640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f41a814f280 0x7f41a8153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.610+0000 7f41acb40640 10 monclient(hunting): picked mon.noname-b con 0x7f41a814f280 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:39.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.610+0000 7f41acb40640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f41a814f660 0x7f41a8148be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.610+0000 7f41acb40640 10 monclient(hunting): picked mon.noname-c con 0x7f41a814f660 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:39.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.610+0000 7f41acb40640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f41a815abc0 0x7f41a8149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.610+0000 7f41acb40640 10 monclient(hunting): picked mon.noname-a con 0x7f41a815abc0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:39.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.610+0000 7f41acb40640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.610+0000 7f41acb40640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f41a80c9b70 con 0x7f41a815abc0 2026-02-17T21:25:39.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.610+0000 7f41acb40640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.610+0000 7f41acb40640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f41a815a3c0 con 0x7f41a814f280 2026-02-17T21:25:39.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.610+0000 7f41acb40640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.610+0000 7f41acb40640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f41a80c9cf0 con 0x7f41a814f660 2026-02-17T21:25:39.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.610+0000 7f41acb40640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:39.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.610+0000 7f41acb40640 10 monclient(hunting): authenticate will time out at 1045.175812s 2026-02-17T21:25:39.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.611+0000 7f41a6d76640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f41a815abc0 0x7f41a8149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.611+0000 7f41a6575640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f41a814f280 0x7f41a8153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.611+0000 7f41a6575640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f41a814f280 0x7f41a8153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:60248/0 (socket says 10.20.193.5:60248) 2026-02-17T21:25:39.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.611+0000 7f41a6575640 1 -- 10.20.193.5:0/258826948 learned_addr learned my addr 10.20.193.5:0/258826948 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:39.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.611+0000 7f41a6575640 10 monclient(hunting): get_auth_request con 0x7f41a814f280 auth_method 0 2026-02-17T21:25:39.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.611+0000 7f41a6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.611+0000 7f41a6575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.611+0000 7f41a6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.611+0000 7f41a6d76640 10 monclient(hunting): get_auth_request con 0x7f41a815abc0 auth_method 0 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.611+0000 7f41a6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.611+0000 7f41a6d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.611+0000 7f41a6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.611+0000 7f41a6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.611+0000 7f41a6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.611+0000 7f41a6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.611+0000 7f41a6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.611+0000 7f41a6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.611+0000 7f41a6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.612+0000 7f41a6575640 10 monclient(hunting): handle_auth_done global_id 4576 payload 824 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.612+0000 7f41a6575640 1 -- 10.20.193.5:0/258826948 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f41a814f660 msgr2=0x7f41a8148be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.612+0000 7f41a6575640 1 --2- 10.20.193.5:0/258826948 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f41a814f660 0x7f41a8148be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.612+0000 7f41a6575640 1 -- 10.20.193.5:0/258826948 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f41a815abc0 msgr2=0x7f41a8149120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.612+0000 7f41a6575640 1 --2- 10.20.193.5:0/258826948 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f41a815abc0 0x7f41a8149120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.612+0000 7f41a6575640 10 monclient: _finish_hunting 0 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.612+0000 7f41a6575640 1 monclient: found mon.noname-b 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.612+0000 7f41a6575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.612+0000 7f41a6575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.612+0000 7f41a6575640 1 -- 10.20.193.5:0/258826948 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a8155bb0 con 0x7f41a814f280 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.613+0000 7f41a6575640 1 --2- 10.20.193.5:0/258826948 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f41a814f280 0x7f41a8153340 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f419c00b530 tx=0x7f419c00ba00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.613+0000 7f418effd640 10 client.?.objecter ms_handle_connect 0x7f41a814f280 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.613+0000 7f418effd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.614+0000 7f418effd640 1 -- 10.20.193.5:0/258826948 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419c013020 con 0x7f41a814f280 2026-02-17T21:25:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f418effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f418effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f418effd640 10 monclient: dump: 2026-02-17T21:25:39.645 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.645 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.645 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.645 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.645 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.645 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.645 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.645 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.645 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f418effd640 10 monclient: _finish_auth 0 2026-02-17T21:25:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f418effd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f418effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f41acb40640 5 monclient: authenticate success, global_id 4576 2026-02-17T21:25:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f41acb40640 10 monclient: _renew_subs 2026-02-17T21:25:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f41acb40640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f41acb40640 1 -- 10.20.193.5:0/258826948 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a8155e90 con 0x7f41a814f280 2026-02-17T21:25:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f41acb40640 10 client.4576.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f41acb40640 10 monclient: _renew_subs 2026-02-17T21:25:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f41acb40640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f41acb40640 1 -- 10.20.193.5:0/258826948 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a81483e0 con 0x7f41a814f280 2026-02-17T21:25:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f41acb40640 1 librados: init done 2026-02-17T21:25:39.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f418effd640 1 -- 10.20.193.5:0/258826948 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f419c004480 con 0x7f41a814f280 2026-02-17T21:25:39.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f418effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:39.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f41a4d72640 4 set_mon_vals no callback set 2026-02-17T21:25:39.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f418effd640 1 -- 10.20.193.5:0/258826948 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419c0028e0 con 0x7f41a814f280 2026-02-17T21:25:39.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f418effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f418effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:39.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f418effd640 10 monclient: dump: 2026-02-17T21:25:39.646 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.646 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.646 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.646 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.646 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.646 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.646 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.646 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.646 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.646 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f41acb40640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f41acb40640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f41acb40640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.615+0000 7f41acb40640 1 -- 10.20.193.5:0/258826948 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a81481d0 con 0x7f41a814f280 2026-02-17T21:25:39.647 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-17T21:25:39.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.616+0000 7f8f86ffd640 1 -- 10.20.193.5:0/2694525632 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f8f90014a10 con 0x7f8fa015abc0 2026-02-17T21:25:39.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.616+0000 7f8f86ffd640 1 --2- 10.20.193.5:0/2694525632 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8f6c0792d0 0x7f8f6c07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.616+0000 7f8f9e575640 1 --2- 10.20.193.5:0/2694525632 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8f6c0792d0 0x7f8f6c07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.616+0000 7f8f9e575640 10 monclient: get_auth_request con 0x7f8f6c0792d0 auth_method 0 2026-02-17T21:25:39.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.617+0000 7f8f9e575640 1 --2- 10.20.193.5:0/2694525632 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8f6c0792d0 0x7f8f6c07b790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0153310 tx=0x7f8f94036000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.617+0000 7f8f86ffd640 10 client.4616.objecter ms_handle_connect 0x7f8f6c0792d0 2026-02-17T21:25:39.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.617+0000 7f8f86ffd640 1 -- 10.20.193.5:0/2694525632 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f8f9005f3a0 con 0x7f8fa015abc0 2026-02-17T21:25:39.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.617+0000 7f8f86ffd640 10 client.4616.objecter ms_dispatch2 0x7f8fa0000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:39.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.617+0000 7f8f86ffd640 3 client.4616.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:39.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.617+0000 7f8f86ffd640 3 client.4616.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:39.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.617+0000 7f8f86ffd640 20 client.4616.objecter dump_active .. 0 homeless 2026-02-17T21:25:39.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.627+0000 7f74bd23b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T21:25:39.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.627+0000 7f74bd23b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T21:25:39.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.627+0000 7f74bd23b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.627+0000 7f74bd23b640 1 -- 10.20.193.5:0/3197148754 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 15} v 0) -- 0x7f74b80c5fc0 con 0x7f74b806fa70 2026-02-17T21:25:39.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.666+0000 7f64c7be7640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T21:25:39.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.666+0000 7f64c7be7640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T21:25:39.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.666+0000 7f64c7be7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.666+0000 7f64c7be7640 1 -- 10.20.193.5:0/1392426690 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f64c00cc8f0 con 0x7f64c015d200 2026-02-17T21:25:39.681 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-17T21:25:39.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.718+0000 7f8f86ffd640 1 -- 10.20.193.5:0/2694525632 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8f90022030 con 0x7f8fa015abc0 2026-02-17T21:25:39.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.718+0000 7f8f86ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.718+0000 7f8f86ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:39.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.721+0000 7f64ae7fc640 1 -- 10.20.193.5:0/1392426690 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f64b4062590 con 0x7f64c015d200 2026-02-17T21:25:39.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.721+0000 7f64ae7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T21:25:39.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.721+0000 7f64ae7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:39.722 INFO:teuthology.orchestra.run.trial005.stdout:98784247813 2026-02-17T21:25:39.724 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.721+0000 7f418effd640 1 -- 10.20.193.5:0/258826948 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f419c002a80 con 0x7f41a814f280 2026-02-17T21:25:39.724 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.721+0000 7f418effd640 1 --2- 10.20.193.5:0/258826948 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4174079280 0x7f417407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.724 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.722+0000 7f41a5d74640 1 --2- 10.20.193.5:0/258826948 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4174079280 0x7f417407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.724 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.722+0000 7f41a5d74640 10 monclient: get_auth_request con 0x7f4174079280 auth_method 0 2026-02-17T21:25:39.724 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.722+0000 7f41a5d74640 1 -- 10.20.193.5:0/258826948 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4174079280 msgr2=0x7f417407b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T21:25:39.724 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.722+0000 7f41a5d74640 1 -- 10.20.193.5:0/258826948 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4174079280 msgr2=0x7f417407b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T21:25:39.724 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.722+0000 7f41a5d74640 1 --2- 10.20.193.5:0/258826948 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4174079280 0x7f417407b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:25:39.724 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.722+0000 7f41a5d74640 1 --2- 10.20.193.5:0/258826948 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4174079280 0x7f417407b740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:25:39.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.723+0000 7f418effd640 1 -- 10.20.193.5:0/258826948 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f419c097d90 con 0x7f41a814f280 2026-02-17T21:25:39.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.723+0000 7f418effd640 10 client.4576.objecter ms_dispatch2 0x7f41a8000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:39.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.723+0000 7f418effd640 3 client.4576.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:39.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.723+0000 7f418effd640 3 client.4576.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:39.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.723+0000 7f418effd640 20 client.4576.objecter dump_active .. 0 homeless 2026-02-17T21:25:39.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.723+0000 7f64c7be7640 10 librados: watch_flush enter 2026-02-17T21:25:39.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.723+0000 7f64c7be7640 10 librados: watch_flush exit 2026-02-17T21:25:39.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.723+0000 7f64c7be7640 20 client.4610.objecter shutdown clearing up homeless session... 2026-02-17T21:25:39.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.723+0000 7f64c7be7640 10 client.4610.objecter successfully canceled tick 2026-02-17T21:25:39.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.723+0000 7f64c7be7640 1 -- 10.20.193.5:0/1392426690 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f64900792b0 msgr2=0x7f649007b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.723+0000 7f64c7be7640 1 --2- 10.20.193.5:0/1392426690 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f64900792b0 0x7f649007b770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f64b0039000 tx=0x7f64b0031000 comp rx=0 tx=0).stop 2026-02-17T21:25:39.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.723+0000 7f64c7be7640 10 monclient: shutdown 2026-02-17T21:25:39.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.723+0000 7f64c7be7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:39.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.723+0000 7f64c7be7640 1 -- 10.20.193.5:0/1392426690 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f64c015d200 msgr2=0x7f64c01f17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.723+0000 7f64c7be7640 1 --2- 10.20.193.5:0/1392426690 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f64c015d200 0x7f64c01f17b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f64b400c560 tx=0x7f64b400ca30 comp rx=0 tx=0).stop 2026-02-17T21:25:39.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.723+0000 7f64c7be7640 1 -- 10.20.193.5:0/1392426690 shutdown_connections 2026-02-17T21:25:39.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.723+0000 7f64c7be7640 1 --2- 10.20.193.5:0/1392426690 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f64900792b0 0x7f649007b770 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.723+0000 7f64c7be7640 1 --2- 10.20.193.5:0/1392426690 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f64c015f570 0x7f64c01f4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.723+0000 7f64c7be7640 1 --2- 10.20.193.5:0/1392426690 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f64c015d200 0x7f64c01f17b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.723+0000 7f64c7be7640 1 --2- 10.20.193.5:0/1392426690 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f64c0070fd0 0x7f64c014ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.723+0000 7f64c7be7640 1 -- 10.20.193.5:0/1392426690 >> 10.20.193.5:0/1392426690 conn(0x7f64c00cd820 msgr2=0x7f64c00cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:39.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.723+0000 7f64c7be7640 1 -- 10.20.193.5:0/1392426690 shutdown_connections 2026-02-17T21:25:39.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.723+0000 7f64c7be7640 1 -- 10.20.193.5:0/1392426690 wait complete. 2026-02-17T21:25:39.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.723+0000 7f64c7be7640 1 librados: shutdown 2026-02-17T21:25:39.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.729+0000 7f418effd640 1 -- 10.20.193.5:0/258826948 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f419c01d020 con 0x7f41a814f280 2026-02-17T21:25:39.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.729+0000 7f418effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.729+0000 7f418effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:39.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.731+0000 7f74977fe640 1 -- 10.20.193.5:0/3197148754 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 15}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f74a0086f00 con 0x7f74b806fa70 2026-02-17T21:25:39.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.731+0000 7f74977fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T21:25:39.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.731+0000 7f74977fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:39.733 INFO:teuthology.orchestra.run.trial005.stdout:120259084295 2026-02-17T21:25:39.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247813 got 98784247813 for osd.7 2026-02-17T21:25:39.734 DEBUG:teuthology.parallel:result is None 2026-02-17T21:25:39.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.733+0000 7f74bd23b640 10 librados: watch_flush enter 2026-02-17T21:25:39.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.733+0000 7f74bd23b640 10 librados: watch_flush exit 2026-02-17T21:25:39.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.733+0000 7f74bd23b640 20 client.4564.objecter shutdown clearing up homeless session... 2026-02-17T21:25:39.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.733+0000 7f74bd23b640 10 client.4564.objecter successfully canceled tick 2026-02-17T21:25:39.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.733+0000 7f74bd23b640 1 -- 10.20.193.5:0/3197148754 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f74840792d0 msgr2=0x7f748407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.733+0000 7f74bd23b640 1 --2- 10.20.193.5:0/3197148754 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f74840792d0 0x7f748407b790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f74ac007ab0 tx=0x7f74ac002dd0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.733+0000 7f74bd23b640 10 monclient: shutdown 2026-02-17T21:25:39.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.733+0000 7f74bd23b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:39.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.733+0000 7f74bd23b640 1 -- 10.20.193.5:0/3197148754 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f74b806fa70 msgr2=0x7f74b81f5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.733+0000 7f74bd23b640 1 --2- 10.20.193.5:0/3197148754 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f74b806fa70 0x7f74b81f5ee0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f74a002ed90 tx=0x7f74a00048d0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.734+0000 7f74bd23b640 1 -- 10.20.193.5:0/3197148754 shutdown_connections 2026-02-17T21:25:39.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.734+0000 7f74bd23b640 1 --2- 10.20.193.5:0/3197148754 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f74840792d0 0x7f748407b790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.734+0000 7f74bd23b640 1 --2- 10.20.193.5:0/3197148754 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f74b81f6420 0x7f74b8151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.734+0000 7f74bd23b640 1 --2- 10.20.193.5:0/3197148754 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f74b806fa70 0x7f74b81f5ee0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.734+0000 7f74bd23b640 1 --2- 10.20.193.5:0/3197148754 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f74a4004900 0x7f74b806f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.734+0000 7f74bd23b640 1 -- 10.20.193.5:0/3197148754 >> 10.20.193.5:0/3197148754 conn(0x7f74b80cafa0 msgr2=0x7f74b81ea1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:39.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.734+0000 7f74bd23b640 1 -- 10.20.193.5:0/3197148754 shutdown_connections 2026-02-17T21:25:39.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.734+0000 7f74bd23b640 1 -- 10.20.193.5:0/3197148754 wait complete. 2026-02-17T21:25:39.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.734+0000 7f74bd23b640 1 librados: shutdown 2026-02-17T21:25:39.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.734+0000 7f9dfe253640 10 monclient: get_monmap_and_config 2026-02-17T21:25:39.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.734+0000 7f9dfe253640 10 monclient: build_initial_monmap 2026-02-17T21:25:39.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.734+0000 7f9dfe253640 10 monclient: monmap: 2026-02-17T21:25:39.740 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:39.740 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.740 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:39.735468+0000 2026-02-17T21:25:39.740 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:39.735468+0000 2026-02-17T21:25:39.740 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:39.740 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.740 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:39.740 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:39.740 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:39.740 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:39.740 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:39.741 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:39.741 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.735+0000 7f9dfe253640 1 Processor -- start 2026-02-17T21:25:39.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.735+0000 7f9dfe253640 1 -- start start 2026-02-17T21:25:39.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.735+0000 7f9dfe253640 10 monclient: init 2026-02-17T21:25:39.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.735+0000 7f9dfe253640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:39.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.735+0000 7f9dfe253640 10 monclient: _add_conns ranks=[4,3,1,0,2,5] 2026-02-17T21:25:39.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.735+0000 7f9dfe253640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f9df80d1b60 0x7f9df80d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.735+0000 7f9dfe253640 10 monclient(hunting): picked mon.noname-b con 0x7f9df80d1b60 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:39.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.735+0000 7f9dfe253640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f9df815c840 0x7f9df80c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.735+0000 7f9dfe253640 10 monclient(hunting): picked mon.noname-a con 0x7f9df815c840 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:39.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.735+0000 7f9dfe253640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f9df80c92a0 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:39.742 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.735+0000 7f9dfe253640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9df80c98e0 con 0x7f9df80c92a0 2026-02-17T21:25:39.742 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.735+0000 7f9dfe253640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.742 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.735+0000 7f9dfe253640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9df80ca460 con 0x7f9df815c840 2026-02-17T21:25:39.742 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.735+0000 7f9dfe253640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.742 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.735+0000 7f9dfe253640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f9df815d4c0 con 0x7f9df80d1b60 2026-02-17T21:25:39.742 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.735+0000 7f9dfe253640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:39.742 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.735+0000 7f9dfe253640 10 monclient(hunting): authenticate will time out at 1045.300851s 2026-02-17T21:25:39.742 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.736+0000 7f9df77fe640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f9df80d1b60 0x7f9df80d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.736+0000 7f3c1ccbd640 10 monclient: get_monmap_and_config 2026-02-17T21:25:39.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.736+0000 7f3c1ccbd640 10 monclient: build_initial_monmap 2026-02-17T21:25:39.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.736+0000 7f3c1ccbd640 10 monclient: monmap: 2026-02-17T21:25:39.743 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:39.743 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.743 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:39.737008+0000 2026-02-17T21:25:39.743 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:39.737008+0000 2026-02-17T21:25:39.743 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:39.743 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.743 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:39.744 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:39.744 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:39.744 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:39.744 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:39.744 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:39.744 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.736+0000 7f9df6ffd640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f9df815c840 0x7f9df80c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.736+0000 7f9df77fe640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f9df80d1b60 0x7f9df80d1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:60252/0 (socket says 10.20.193.5:60252) 2026-02-17T21:25:39.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.736+0000 7f9df77fe640 1 -- 10.20.193.5:0/3056674631 learned_addr learned my addr 10.20.193.5:0/3056674631 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:39.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.736+0000 7f9df77fe640 10 monclient(hunting): get_auth_request con 0x7f9df80d1b60 auth_method 0 2026-02-17T21:25:39.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.736+0000 7f9df77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.736+0000 7f9df77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.736+0000 7f9df77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.736+0000 7f9df6ffd640 10 monclient(hunting): get_auth_request con 0x7f9df815c840 auth_method 0 2026-02-17T21:25:39.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.736+0000 7f9df6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.736+0000 7f9df6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.736+0000 7f9df6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.736+0000 7f3c1ccbd640 1 Processor -- start 2026-02-17T21:25:39.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.736+0000 7f3c1ccbd640 1 -- start start 2026-02-17T21:25:39.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.736+0000 7f3c1ccbd640 10 monclient: init 2026-02-17T21:25:39.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.736+0000 7f9df6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.736+0000 7f9df6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.748 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.736+0000 7f9df6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.748 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.737+0000 7f9df77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.748 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.737+0000 7f9df77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.748 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.737+0000 7f9df77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.737+0000 7f3c1ccbd640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:39.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.737+0000 7f3c1ccbd640 10 monclient: _add_conns ranks=[1,3,4,2,5,0] 2026-02-17T21:25:39.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.737+0000 7f3c1ccbd640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f3c180d1b60 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:39.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.737+0000 7f3c1ccbd640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f3c180d1f40 0x7f3c1815c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.737+0000 7f3c1ccbd640 10 monclient(hunting): picked mon.noname-a con 0x7f3c180d1f40 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:39.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.737+0000 7f3c1ccbd640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f3c1815d950 0x7f3c1815dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.737+0000 7f3c1ccbd640 10 monclient(hunting): picked mon.noname-b con 0x7f3c1815d950 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:39.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.737+0000 7f3c1ccbd640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c1815e2d0 con 0x7f3c180d1b60 2026-02-17T21:25:39.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.737+0000 7f3c1ccbd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.737+0000 7f3c1ccbd640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f3c1815cd80 con 0x7f3c180d1f40 2026-02-17T21:25:39.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.737+0000 7f3c1ccbd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.737+0000 7f3c1ccbd640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f3c180ca460 con 0x7f3c1815d950 2026-02-17T21:25:39.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.737+0000 7f3c1ccbd640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:39.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.737+0000 7f3c1ccbd640 10 monclient(hunting): authenticate will time out at 1045.302421s 2026-02-17T21:25:39.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.737+0000 7f9df77fe640 10 monclient(hunting): handle_auth_done global_id 4579 payload 274 2026-02-17T21:25:39.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.737+0000 7f9df77fe640 1 -- 10.20.193.5:0/3056674631 >> v2:10.20.193.5:3300/0 conn(0x7f9df815c840 msgr2=0x7f9df80c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:39.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.737+0000 7f9df77fe640 1 --2- 10.20.193.5:0/3056674631 >> v2:10.20.193.5:3300/0 conn(0x7f9df815c840 0x7f9df80c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.738+0000 7f9df77fe640 1 -- 10.20.193.5:0/3056674631 >> v1:10.20.193.119:6789/0 conn(0x7f9df80c92a0 legacy=0x7f9df815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:39.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.738+0000 7f9df77fe640 10 monclient: _finish_hunting 0 2026-02-17T21:25:39.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.738+0000 7f9df77fe640 1 monclient: found mon.noname-b 2026-02-17T21:25:39.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.738+0000 7f9df77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:39.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.738+0000 7f9df77fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.752 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.738+0000 7f9df77fe640 1 -- 10.20.193.5:0/3056674631 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df80c9bc0 con 0x7f9df80d1b60 2026-02-17T21:25:39.752 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.739+0000 7f9df77fe640 1 --2- 10.20.193.5:0/3056674631 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9df80d1b60 0x7f9df80d1f40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9df80cf420 tx=0x7f9de402eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcdc16bdb745a26e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.739+0000 7f3c16d76640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f3c1815d950 0x7f3c1815dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.739+0000 7f3c15d74640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f3c180d1f40 0x7f3c1815c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.739+0000 7f3c15d74640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f3c180d1f40 0x7f3c1815c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:58784/0 (socket says 10.20.193.5:58784) 2026-02-17T21:25:39.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.739+0000 7f3c15d74640 1 -- 10.20.193.5:0/2419972064 learned_addr learned my addr 10.20.193.5:0/2419972064 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:39.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.739+0000 7f3c15d74640 10 monclient(hunting): get_auth_request con 0x7f3c180d1f40 auth_method 0 2026-02-17T21:25:39.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.739+0000 7f3c15d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.739+0000 7f3c15d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.739+0000 7f3c15d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.740+0000 7f3c15d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.740+0000 7f3c15d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.740+0000 7f3c15d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.740+0000 7f3c16d76640 10 monclient(hunting): get_auth_request con 0x7f3c1815d950 auth_method 0 2026-02-17T21:25:39.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.740+0000 7f3c16d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.740+0000 7f3c16d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.740+0000 7f3c16d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.740+0000 7f3c15d74640 10 monclient(hunting): handle_auth_done global_id 4563 payload 274 2026-02-17T21:25:39.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.741+0000 7f3c15d74640 1 -- 10.20.193.5:0/2419972064 >> v2:10.20.193.119:3300/0 conn(0x7f3c1815d950 msgr2=0x7f3c1815dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:39.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.741+0000 7f3c15d74640 1 --2- 10.20.193.5:0/2419972064 >> v2:10.20.193.119:3300/0 conn(0x7f3c1815d950 0x7f3c1815dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.741+0000 7f3c15d74640 1 -- 10.20.193.5:0/2419972064 >> v1:10.20.193.119:6789/0 conn(0x7f3c180d1b60 legacy=0x7f3c180c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:39.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.741+0000 7f3c15d74640 10 monclient: _finish_hunting 0 2026-02-17T21:25:39.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.741+0000 7f3c15d74640 1 monclient: found mon.noname-a 2026-02-17T21:25:39.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.741+0000 7f3c15d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:39.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.741+0000 7f3c15d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:39.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.741+0000 7f3c15d74640 1 -- 10.20.193.5:0/2419972064 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c180c98e0 con 0x7f3c180d1f40 2026-02-17T21:25:39.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.742+0000 7f3c15d74640 1 --2- 10.20.193.5:0/2419972064 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c180d1f40 0x7f3c1815c840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3c180751e0 tx=0x7f3c0002eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35317b93328aed00 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.756 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084295 got 120259084295 for osd.15 2026-02-17T21:25:39.757 DEBUG:teuthology.parallel:result is None 2026-02-17T21:25:39.757 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.743+0000 7f3c15573640 1 -- 10.20.193.5:0/2419972064 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0003c070 con 0x7f3c180d1f40 2026-02-17T21:25:39.758 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.743+0000 7f3c15573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.758 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.743+0000 7f3c15573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:39.758 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.743+0000 7f3c15573640 10 monclient: dump: 2026-02-17T21:25:39.758 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.758 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.758 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.758 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.758 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.758 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.758 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.758 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.758 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.759 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.743+0000 7f3c15573640 10 monclient: _finish_auth 0 2026-02-17T21:25:39.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.743+0000 7f3c15573640 10 monclient: _check_auth_tickets 2026-02-17T21:25:39.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.743+0000 7f3c15573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:39.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.743+0000 7f3c1ccbd640 5 monclient: authenticate success, global_id 4563 2026-02-17T21:25:39.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.743+0000 7f3c1ccbd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:39.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f3c15573640 1 -- 10.20.193.5:0/2419972064 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c0002fb40 con 0x7f3c180d1f40 2026-02-17T21:25:39.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f3c15573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:39.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f3c15573640 1 -- 10.20.193.5:0/2419972064 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c00037440 con 0x7f3c180d1f40 2026-02-17T21:25:39.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f3c15573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f3c15573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:39.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f3c15573640 10 monclient: dump: 2026-02-17T21:25:39.759 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.759 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.760 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.760 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.760 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.760 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.760 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.760 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.760 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.760 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.760 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f3c1ccbd640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:39.760 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f3c1ccbd640 4 set_mon_vals no callback set 2026-02-17T21:25:39.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f9df67fc640 1 -- 10.20.193.5:0/3056674631 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de403c070 con 0x7f9df80d1b60 2026-02-17T21:25:39.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f9df67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f9df67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:39.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f9df67fc640 10 monclient: dump: 2026-02-17T21:25:39.761 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.761 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.761 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.761 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.762 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.762 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.762 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.762 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.762 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.762 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f9df67fc640 10 monclient: _finish_auth 0 2026-02-17T21:25:39.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f9df67fc640 10 monclient: _check_auth_tickets 2026-02-17T21:25:39.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f9df67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:39.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f9df67fc640 1 -- 10.20.193.5:0/3056674631 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de402fb40 con 0x7f9df80d1b60 2026-02-17T21:25:39.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f9df67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:39.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f9df67fc640 1 -- 10.20.193.5:0/3056674631 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de4037440 con 0x7f9df80d1b60 2026-02-17T21:25:39.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f9df67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f9df67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:39.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f9df67fc640 10 monclient: dump: 2026-02-17T21:25:39.762 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.763 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.763 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.763 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.763 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.763 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.763 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.763 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.763 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.763 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f9dfe253640 5 monclient: authenticate success, global_id 4579 2026-02-17T21:25:39.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f9dfe253640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:39.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f9dfe253640 4 set_mon_vals no callback set 2026-02-17T21:25:39.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f3c1ccbd640 10 monclient: shutdown 2026-02-17T21:25:39.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f3c1ccbd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:39.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f3c1ccbd640 1 -- 10.20.193.5:0/2419972064 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c180d1f40 msgr2=0x7f3c1815c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f3c1ccbd640 1 --2- 10.20.193.5:0/2419972064 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c180d1f40 0x7f3c1815c840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3c180751e0 tx=0x7f3c0002eed0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f3c1ccbd640 1 -- 10.20.193.5:0/2419972064 shutdown_connections 2026-02-17T21:25:39.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f3c1ccbd640 1 --2- 10.20.193.5:0/2419972064 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c180d1f40 0x7f3c1815c840 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f3c1ccbd640 1 --2- 10.20.193.5:0/2419972064 >> v2:10.20.193.119:3300/0 conn(0x7f3c1815d950 0x7f3c1815dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f3c1ccbd640 1 -- 10.20.193.5:0/2419972064 >> 10.20.193.5:0/2419972064 conn(0x7f3c1806d9b0 msgr2=0x7f3c1806ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:39.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f3c1ccbd640 1 -- 10.20.193.5:0/2419972064 shutdown_connections 2026-02-17T21:25:39.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f3c1ccbd640 1 -- 10.20.193.5:0/2419972064 wait complete. 2026-02-17T21:25:39.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f9dfe253640 10 monclient: shutdown 2026-02-17T21:25:39.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f9dfe253640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:39.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f9dfe253640 1 -- 10.20.193.5:0/3056674631 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9df80d1b60 msgr2=0x7f9df80d1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f9dfe253640 1 --2- 10.20.193.5:0/3056674631 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9df80d1b60 0x7f9df80d1f40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9df80cf420 tx=0x7f9de402eed0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f9dfe253640 1 -- 10.20.193.5:0/3056674631 shutdown_connections 2026-02-17T21:25:39.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f9dfe253640 1 --2- 10.20.193.5:0/3056674631 >> v2:10.20.193.5:3300/0 conn(0x7f9df815c840 0x7f9df80c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f9dfe253640 1 --2- 10.20.193.5:0/3056674631 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9df80d1b60 0x7f9df80d1f40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.766 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f9dfe253640 1 -- 10.20.193.5:0/3056674631 >> 10.20.193.5:0/3056674631 conn(0x7f9df806d9b0 msgr2=0x7f9df806ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:39.766 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.744+0000 7f9dfe253640 1 -- 10.20.193.5:0/3056674631 shutdown_connections 2026-02-17T21:25:39.766 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f9dfe253640 1 -- 10.20.193.5:0/3056674631 wait complete. 2026-02-17T21:25:39.766 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f3c1ccbd640 10 monclient: build_initial_monmap 2026-02-17T21:25:39.766 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f3c1ccbd640 10 monclient: monmap: 2026-02-17T21:25:39.766 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:39.766 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:39.766 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:39.766 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:39.767 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:39.767 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.767 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:39.767 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:39.767 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:39.767 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f3c1ccbd640 1 librados: starting msgr at 2026-02-17T21:25:39.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f3c1ccbd640 1 librados: starting objecter 2026-02-17T21:25:39.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f3c1ccbd640 1 Processor -- start 2026-02-17T21:25:39.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f3c1ccbd640 1 -- start start 2026-02-17T21:25:39.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f3c1ccbd640 1 librados: setting wanted keys 2026-02-17T21:25:39.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f3c1ccbd640 1 librados: calling monclient init 2026-02-17T21:25:39.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f3c1ccbd640 10 monclient: init 2026-02-17T21:25:39.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f9dfe253640 10 monclient: build_initial_monmap 2026-02-17T21:25:39.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f9dfe253640 10 monclient: monmap: 2026-02-17T21:25:39.768 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:39.768 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:39.768 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:39.768 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:39.768 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:39.768 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.768 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:39.768 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:39.768 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:39.768 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f3c1ccbd640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:39.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f3c1ccbd640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:25:39.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f3c1ccbd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3c180d1b60 0x7f3c1814ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f3c1ccbd640 10 monclient(hunting): picked mon.noname-c con 0x7f3c180d1b60 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:39.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f3c1ccbd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c180d1f40 0x7f3c18144550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f3c1ccbd640 10 monclient(hunting): picked mon.noname-a con 0x7f3c180d1f40 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:39.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f3c1ccbd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c1815d950 0x7f3c1814d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f3c1ccbd640 10 monclient(hunting): picked mon.noname-b con 0x7f3c1815d950 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:39.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f3c1ccbd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f9dfe253640 1 librados: starting msgr at 2026-02-17T21:25:39.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f3c1ccbd640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3c180c9ea0 con 0x7f3c180d1f40 2026-02-17T21:25:39.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f3c1ccbd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f9dfe253640 1 librados: starting objecter 2026-02-17T21:25:39.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f3c1ccbd640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1815d4c0 con 0x7f3c1815d950 2026-02-17T21:25:39.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f3c1ccbd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f3c1ccbd640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3c180ca180 con 0x7f3c180d1b60 2026-02-17T21:25:39.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f3c1ccbd640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:39.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f3c1ccbd640 10 monclient(hunting): authenticate will time out at 1045.310870s 2026-02-17T21:25:39.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f9dfe253640 1 Processor -- start 2026-02-17T21:25:39.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f9dfe253640 1 -- start start 2026-02-17T21:25:39.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f9dfe253640 1 librados: setting wanted keys 2026-02-17T21:25:39.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f9dfe253640 1 librados: calling monclient init 2026-02-17T21:25:39.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.745+0000 7f9dfe253640 10 monclient: init 2026-02-17T21:25:39.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f3c16d76640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c1815d950 0x7f3c1814d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f3c15d74640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c180d1f40 0x7f3c18144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f3c16575640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3c180d1b60 0x7f3c1814ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f3c16d76640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c1815d950 0x7f3c1814d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:60272/0 (socket says 10.20.193.5:60272) 2026-02-17T21:25:39.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f3c16d76640 1 -- 10.20.193.5:0/1166566941 learned_addr learned my addr 10.20.193.5:0/1166566941 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:39.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f3c16d76640 10 monclient(hunting): get_auth_request con 0x7f3c1815d950 auth_method 0 2026-02-17T21:25:39.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f3c16d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f3c16d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f3c16d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f9dfe253640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:39.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f9dfe253640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:25:39.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f9dfe253640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9df80c92a0 0x7f9df8149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f9dfe253640 10 monclient(hunting): picked mon.noname-a con 0x7f9df80c92a0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:39.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f9dfe253640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9df80d1b60 0x7f9df81f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f9dfe253640 10 monclient(hunting): picked mon.noname-c con 0x7f9df80d1b60 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:39.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f9dfe253640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9df815c840 0x7f9df8148020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f9dfe253640 10 monclient(hunting): picked mon.noname-b con 0x7f9df815c840 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:39.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f9dfe253640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f9dfe253640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9df815cc90 con 0x7f9df80c92a0 2026-02-17T21:25:39.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f9dfe253640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f9dfe253640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9df80ca180 con 0x7f9df815c840 2026-02-17T21:25:39.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f9dfe253640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f9dfe253640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9df806e7b0 con 0x7f9df80d1b60 2026-02-17T21:25:39.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f9dfe253640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:39.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f9dfe253640 10 monclient(hunting): authenticate will time out at 1045.311458s 2026-02-17T21:25:39.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f3c15d74640 10 monclient(hunting): get_auth_request con 0x7f3c180d1f40 auth_method 0 2026-02-17T21:25:39.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f3c15d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f3c15d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f3c15d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f3c16575640 10 monclient(hunting): get_auth_request con 0x7f3c180d1b60 auth_method 0 2026-02-17T21:25:39.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f3c16575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f3c16575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f3c16575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f3c16d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f3c16d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f3c16d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f3c16575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.746+0000 7f3c16575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.747+0000 7f3c16575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.747+0000 7f3c15d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.747+0000 7f3c15d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.747+0000 7f3c15d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.747+0000 7f9df6ffd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9df80d1b60 0x7f9df81f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.748+0000 7f3c16d76640 10 monclient(hunting): handle_auth_done global_id 4585 payload 824 2026-02-17T21:25:39.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.748+0000 7f3c16d76640 1 -- 10.20.193.5:0/1166566941 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3c180d1b60 msgr2=0x7f3c1814ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.748+0000 7f3c16d76640 1 --2- 10.20.193.5:0/1166566941 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3c180d1b60 0x7f3c1814ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.748+0000 7f3c16d76640 1 -- 10.20.193.5:0/1166566941 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c180d1f40 msgr2=0x7f3c18144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.748+0000 7f3c16d76640 1 --2- 10.20.193.5:0/1166566941 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c180d1f40 0x7f3c18144550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.748+0000 7f3c16d76640 10 monclient: _finish_hunting 0 2026-02-17T21:25:39.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.748+0000 7f3c16d76640 1 monclient: found mon.noname-b 2026-02-17T21:25:39.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.748+0000 7f3c16d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:39.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.748+0000 7f3c16d76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.748+0000 7f3c16d76640 1 -- 10.20.193.5:0/1166566941 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c1814cf60 con 0x7f3c1815d950 2026-02-17T21:25:39.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.748+0000 7f9df77fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9df80c92a0 0x7f9df8149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.749+0000 7f9df7fff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9df815c840 0x7f9df8148020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.749+0000 7f3c16d76640 1 --2- 10.20.193.5:0/1166566941 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c1815d950 0x7f3c1814d410 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3c08007e40 tx=0x7f3c0800e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.749+0000 7f3bfeffd640 10 client.?.objecter ms_handle_connect 0x7f3c1815d950 2026-02-17T21:25:39.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.749+0000 7f3bfeffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:39.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.749+0000 7f9df7fff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9df815c840 0x7f9df8148020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:60288/0 (socket says 10.20.193.5:60288) 2026-02-17T21:25:39.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.749+0000 7f9df7fff640 1 -- 10.20.193.5:0/2293640241 learned_addr learned my addr 10.20.193.5:0/2293640241 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:39.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.749+0000 7f9df7fff640 10 monclient(hunting): get_auth_request con 0x7f9df815c840 auth_method 0 2026-02-17T21:25:39.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.749+0000 7f9df7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.749+0000 7f9df7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.749+0000 7f9df7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.749+0000 7f9df6ffd640 10 monclient(hunting): get_auth_request con 0x7f9df80d1b60 auth_method 0 2026-02-17T21:25:39.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.749+0000 7f9df6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.749+0000 7f9df6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.749+0000 7f9df6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.749+0000 7f9df7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.749+0000 7f9df7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.749+0000 7f9df7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.749+0000 7f9df6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.749+0000 7f9df6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.750+0000 7f9df6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.750+0000 7f9df77fe640 10 monclient(hunting): get_auth_request con 0x7f9df80c92a0 auth_method 0 2026-02-17T21:25:39.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.750+0000 7f9df77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.750+0000 7f9df77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.750+0000 7f9df77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.750+0000 7f9df77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.750+0000 7f9df77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.750+0000 7f9df77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.751+0000 7f9df6ffd640 10 monclient(hunting): handle_auth_done global_id 4622 payload 824 2026-02-17T21:25:39.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.751+0000 7f9df6ffd640 1 -- 10.20.193.5:0/2293640241 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9df815c840 msgr2=0x7f9df8148020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.751+0000 7f9df6ffd640 1 --2- 10.20.193.5:0/2293640241 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9df815c840 0x7f9df8148020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.751+0000 7f9df6ffd640 1 -- 10.20.193.5:0/2293640241 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9df80c92a0 msgr2=0x7f9df8149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.751+0000 7f9df6ffd640 1 --2- 10.20.193.5:0/2293640241 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9df80c92a0 0x7f9df8149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.751+0000 7f9df6ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:25:39.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.751+0000 7f9df6ffd640 1 monclient: found mon.noname-c 2026-02-17T21:25:39.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.751+0000 7f9df6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:39.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.751+0000 7f9df6ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.751+0000 7f9df6ffd640 1 -- 10.20.193.5:0/2293640241 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df8148a90 con 0x7f9df80d1b60 2026-02-17T21:25:39.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.752+0000 7f9df6ffd640 1 --2- 10.20.193.5:0/2293640241 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9df80d1b60 0x7f9df81f71a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9de800e9b0 tx=0x7f9de800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.752+0000 7f9dd3fff640 10 client.?.objecter ms_handle_connect 0x7f9df80d1b60 2026-02-17T21:25:39.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.752+0000 7f9dd3fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:39.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3bfeffd640 1 -- 10.20.193.5:0/1166566941 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c08014620 con 0x7f3c1815d950 2026-02-17T21:25:39.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3bfeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3bfeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:39.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3bfeffd640 10 monclient: dump: 2026-02-17T21:25:39.779 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.780 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.780 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.780 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.780 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.780 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.780 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.780 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.780 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.780 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3bfeffd640 10 monclient: _finish_auth 0 2026-02-17T21:25:39.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3bfeffd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:39.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3bfeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:39.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3bfeffd640 1 -- 10.20.193.5:0/1166566941 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c08019070 con 0x7f3c1815d950 2026-02-17T21:25:39.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3bfeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:39.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3bfeffd640 1 -- 10.20.193.5:0/1166566941 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c08014a20 con 0x7f3c1815d950 2026-02-17T21:25:39.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3bfeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3bfeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:39.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3c14d72640 4 set_mon_vals no callback set 2026-02-17T21:25:39.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3bfeffd640 10 monclient: dump: 2026-02-17T21:25:39.780 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.780 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.780 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.780 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.780 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.780 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.781 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.781 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.781 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.781 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3c1ccbd640 5 monclient: authenticate success, global_id 4585 2026-02-17T21:25:39.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3c1ccbd640 10 monclient: _renew_subs 2026-02-17T21:25:39.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3c1ccbd640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3c1ccbd640 1 -- 10.20.193.5:0/1166566941 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c1814e020 con 0x7f3c1815d950 2026-02-17T21:25:39.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3c1ccbd640 10 client.4585.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:39.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3c1ccbd640 10 monclient: _renew_subs 2026-02-17T21:25:39.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3c1ccbd640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3c1ccbd640 1 -- 10.20.193.5:0/1166566941 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c1814e5e0 con 0x7f3c1815d950 2026-02-17T21:25:39.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3c1ccbd640 1 librados: init done 2026-02-17T21:25:39.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3c1ccbd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3c1ccbd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3c1ccbd640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.753+0000 7f3c1ccbd640 1 -- 10.20.193.5:0/1166566941 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c1806e7b0 con 0x7f3c1815d950 2026-02-17T21:25:39.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dd3fff640 1 -- 10.20.193.5:0/2293640241 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de8017070 con 0x7f9df80d1b60 2026-02-17T21:25:39.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dd3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dd3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:39.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dd3fff640 10 monclient: dump: 2026-02-17T21:25:39.782 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.782 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.782 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.782 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.782 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.782 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.782 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.782 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.782 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.782 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dd3fff640 10 monclient: _finish_auth 0 2026-02-17T21:25:39.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dd3fff640 10 monclient: _check_auth_tickets 2026-02-17T21:25:39.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dd3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:39.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dd3fff640 1 -- 10.20.193.5:0/2293640241 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de800ca00 con 0x7f9df80d1b60 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dfe253640 5 monclient: authenticate success, global_id 4622 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dfe253640 10 monclient: _renew_subs 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dfe253640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dfe253640 1 -- 10.20.193.5:0/2293640241 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df81498f0 con 0x7f9df80d1b60 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dd3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dd3fff640 1 -- 10.20.193.5:0/2293640241 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de800cdf0 con 0x7f9df80d1b60 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dd3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dd3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dd3fff640 10 monclient: dump: 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9df5ffb640 4 set_mon_vals no callback set 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dfe253640 10 client.4622.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dfe253640 10 monclient: _renew_subs 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dfe253640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dfe253640 1 -- 10.20.193.5:0/2293640241 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df8149eb0 con 0x7f9df80d1b60 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dfe253640 1 librados: init done 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dfe253640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dfe253640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dfe253640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.754+0000 7f9dfe253640 1 -- 10.20.193.5:0/2293640241 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9df80d1f40 con 0x7f9df80d1b60 2026-02-17T21:25:39.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.765+0000 7f3bfeffd640 1 -- 10.20.193.5:0/1166566941 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f3c08014bc0 con 0x7f3c1815d950 2026-02-17T21:25:39.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.765+0000 7f9dd3fff640 1 -- 10.20.193.5:0/2293640241 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f9de8013470 con 0x7f9df80d1b60 2026-02-17T21:25:39.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.765+0000 7f3bfeffd640 1 --2- 10.20.193.5:0/1166566941 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3be4079280 0x7f3be407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.765+0000 7f3c16575640 1 --2- 10.20.193.5:0/1166566941 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3be4079280 0x7f3be407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.766+0000 7f3c16575640 10 monclient: get_auth_request con 0x7f3be4079280 auth_method 0 2026-02-17T21:25:39.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.766+0000 7f9dd3fff640 1 --2- 10.20.193.5:0/2293640241 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9dc8079280 0x7f9dc807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.766+0000 7f9df77fe640 1 --2- 10.20.193.5:0/2293640241 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9dc8079280 0x7f9dc807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.766+0000 7f9df77fe640 10 monclient: get_auth_request con 0x7f9dc8079280 auth_method 0 2026-02-17T21:25:39.785 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T21:25:39.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.766+0000 7f3bfeffd640 10 client.4585.objecter ms_handle_connect 0x7f3be4079280 2026-02-17T21:25:39.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.766+0000 7f3c16575640 1 --2- 10.20.193.5:0/1166566941 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3be4079280 0x7f3be407b740 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c004660 tx=0x7f3c0c009110 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.766+0000 7f3bfeffd640 1 -- 10.20.193.5:0/1166566941 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f3c0805f400 con 0x7f3c1815d950 2026-02-17T21:25:39.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.766+0000 7f3bfeffd640 10 client.4585.objecter ms_dispatch2 0x7f3c18000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:39.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.766+0000 7f3bfeffd640 3 client.4585.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:39.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.766+0000 7f3bfeffd640 3 client.4585.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:39.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.766+0000 7f9df77fe640 1 --2- 10.20.193.5:0/2293640241 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9dc8079280 0x7f9dc807b740 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9df80751e0 tx=0x7f9de4033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.766+0000 7f9dd3fff640 10 client.4622.objecter ms_handle_connect 0x7f9dc8079280 2026-02-17T21:25:39.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.766+0000 7f3bfeffd640 20 client.4585.objecter dump_active .. 0 homeless 2026-02-17T21:25:39.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.767+0000 7f9dd3fff640 1 -- 10.20.193.5:0/2293640241 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f9de805e840 con 0x7f9df80d1b60 2026-02-17T21:25:39.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.767+0000 7f9dd3fff640 10 client.4622.objecter ms_dispatch2 0x7f9df8000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:39.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.767+0000 7f9dd3fff640 3 client.4622.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:39.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.767+0000 7f9dd3fff640 3 client.4622.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:39.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.767+0000 7f9dd3fff640 20 client.4622.objecter dump_active .. 0 homeless 2026-02-17T21:25:39.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.776+0000 7f9e06585640 10 monclient: get_monmap_and_config 2026-02-17T21:25:39.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.776+0000 7f9e06585640 10 monclient: build_initial_monmap 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.776+0000 7f9e06585640 10 monclient: monmap: 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:39.776994+0000 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:39.776994+0000 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.776+0000 7f9e06585640 1 Processor -- start 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.776+0000 7f9e06585640 1 -- start start 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.776+0000 7f9e06585640 10 monclient: init 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.777+0000 7f9e06585640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.777+0000 7f9e06585640 10 monclient: _add_conns ranks=[1,4,2,3,5,0] 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.777+0000 7f9e06585640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f9e00152700 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.777+0000 7f9e06585640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f9e0015ef80 0x7f9e000c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.777+0000 7f9e06585640 10 monclient(hunting): picked mon.noname-b con 0x7f9e0015ef80 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.777+0000 7f9e06585640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9e00152ae0 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.777+0000 7f9e06585640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e0015d4f0 con 0x7f9e00152700 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.777+0000 7f9e06585640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e0015d7d0 con 0x7f9e00152ae0 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.777+0000 7f9e06585640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.777+0000 7f9e06585640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f9e0015dab0 con 0x7f9e0015ef80 2026-02-17T21:25:39.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.777+0000 7f9e06585640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:39.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.777+0000 7f9e06585640 10 monclient(hunting): authenticate will time out at 1045.342416s 2026-02-17T21:25:39.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.805+0000 7f8fa4daf640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T21:25:39.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.805+0000 7f8fa4daf640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T21:25:39.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.805+0000 7f8fa4daf640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.805+0000 7f8fa4daf640 1 -- 10.20.193.5:0/2694525632 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f8fa014cf20 con 0x7f8fa015abc0 2026-02-17T21:25:39.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.817+0000 7f41acb40640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T21:25:39.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.817+0000 7f41acb40640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T21:25:39.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.817+0000 7f41acb40640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.817+0000 7f41acb40640 1 -- 10.20.193.5:0/258826948 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 12} v 0) -- 0x7f41a815afe0 con 0x7f41a814f280 2026-02-17T21:25:39.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.854+0000 7fef6aed6640 10 monclient: get_monmap_and_config 2026-02-17T21:25:39.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.854+0000 7fef6aed6640 10 monclient: build_initial_monmap 2026-02-17T21:25:39.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.854+0000 7fef6aed6640 10 monclient: monmap: 2026-02-17T21:25:39.857 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:39.857 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.857 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:39.855644+0000 2026-02-17T21:25:39.857 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:39.855644+0000 2026-02-17T21:25:39.857 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:39.857 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.857 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:39.857 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:39.857 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:39.857 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:39.857 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:39.857 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:39.857 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.855+0000 7fef6aed6640 1 Processor -- start 2026-02-17T21:25:39.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.855+0000 7fef6aed6640 1 -- start start 2026-02-17T21:25:39.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.855+0000 7fef6aed6640 10 monclient: init 2026-02-17T21:25:39.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.856+0000 7fef6aed6640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:39.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.856+0000 7fef6aed6640 10 monclient: _add_conns ranks=[1,0,5,3,4,2] 2026-02-17T21:25:39.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.856+0000 7fef6aed6640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fef640c7170 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:39.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.856+0000 7fef6aed6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fef640c7550 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:39.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.856+0000 7fef6aed6640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fef640c89c0 0x7fef640c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.856+0000 7fef6aed6640 10 monclient(hunting): picked mon.noname-c con 0x7fef640c89c0 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:39.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.856+0000 7fef6aed6640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef640c4fd0 con 0x7fef640c7550 2026-02-17T21:25:39.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.856+0000 7fef6aed6640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef6415a9a0 con 0x7fef640c7170 2026-02-17T21:25:39.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.856+0000 7fef6aed6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.856+0000 7fef6aed6640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fef640c8530 con 0x7fef640c89c0 2026-02-17T21:25:39.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.856+0000 7fef6aed6640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:39.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.856+0000 7fef6aed6640 10 monclient(hunting): authenticate will time out at 1045.421237s 2026-02-17T21:25:39.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.856+0000 7fef5bfff640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7fef640c7550 0x7fef640749b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:37636/0 (socket says 10.20.193.5:37636) 2026-02-17T21:25:39.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.856+0000 7fef5bfff640 1 -- 10.20.193.5:0/1738746490 learned_addr learned my addr 10.20.193.5:0/1738746490 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:39.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.857+0000 7fef5b7fe640 1 -- 10.20.193.5:0/1738746490 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 679466836 0 0) 0x7fef640c4fd0 con 0x7fef640c7550 2026-02-17T21:25:39.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.857+0000 7fef5b7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:25:39.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.857+0000 7fef5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.857+0000 7fef5b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.857+0000 7fef5b7fe640 10 monclient(hunting): my global_id is 4572 2026-02-17T21:25:39.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.857+0000 7fef5b7fe640 1 -- 10.20.193.5:0/1738746490 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef50003620 con 0x7fef640c7550 2026-02-17T21:25:39.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 1 -- 10.20.193.5:0/1738746490 <== mon.0 v1:10.20.193.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 380062805 0 0) 0x7fef50003620 con 0x7fef640c7550 2026-02-17T21:25:39.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 1 -- 10.20.193.5:0/1738746490 >> v2:10.20.193.135:3300/0 conn(0x7fef640c89c0 msgr2=0x7fef640c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:39.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 1 --2- 10.20.193.5:0/1738746490 >> v2:10.20.193.135:3300/0 conn(0x7fef640c89c0 0x7fef640c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 1 -- 10.20.193.5:0/1738746490 >> v1:10.20.193.119:6789/0 conn(0x7fef640c7170 legacy=0x7fef640c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:39.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:25:39.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 1 monclient: found mon.noname-a-legacy 2026-02-17T21:25:39.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:39.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.5:6789/0 2026-02-17T21:25:39.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 1 -- 10.20.193.5:0/1738746490 --> v1:10.20.193.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef640c5270 con 0x7fef640c7550 2026-02-17T21:25:39.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 10 monclient: _finish_auth 0 2026-02-17T21:25:39.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:25:39.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:39.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 1 -- 10.20.193.5:0/1738746490 <== mon.0 v1:10.20.193.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3880376286 0 0) 0x7fef4c002f00 con 0x7fef640c7550 2026-02-17T21:25:39.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T21:25:39.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 10 monclient: dump: 2026-02-17T21:25:39.863 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.863 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.863 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.863 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.863 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.863 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.863 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.863 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.863 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.863 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] but i'm connected to v1:10.20.193.5:6789/0, reconnecting 2026-02-17T21:25:39.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:39.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 1 -- 10.20.193.5:0/1738746490 >> v1:10.20.193.5:6789/0 conn(0x7fef640c7550 legacy=0x7fef640749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:25:39.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 1 --2- 10.20.193.5:0/1738746490 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fef50003ba0 0x7fef50003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 10 monclient(hunting): picked mon.b con 0x7fef50003ba0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:39.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 1 --2- 10.20.193.5:0/1738746490 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fef50004900 0x7fef50004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 10 monclient(hunting): picked mon.c con 0x7fef50004900 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:39.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 1 --2- 10.20.193.5:0/1738746490 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fef50005510 0x7fef5000bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 10 monclient(hunting): picked mon.a con 0x7fef50005510 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:39.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 1 -- 10.20.193.5:0/1738746490 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fef640c8530 con 0x7fef50005510 2026-02-17T21:25:39.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 1 -- 10.20.193.5:0/1738746490 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fef5000c450 con 0x7fef50003ba0 2026-02-17T21:25:39.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 1 -- 10.20.193.5:0/1738746490 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fef5000c650 con 0x7fef50004900 2026-02-17T21:25:39.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:39.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.859+0000 7fef5b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:25:39.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.861+0000 7fef6944c640 1 --2- 10.20.193.5:0/1738746490 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fef50005510 0x7fef5000bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.861+0000 7fef6944c640 10 monclient(hunting): get_auth_request con 0x7fef50005510 auth_method 0 2026-02-17T21:25:39.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.861+0000 7fef6944c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.861+0000 7fef6944c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.861+0000 7fef6944c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:25:39.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.862+0000 7fef6944c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.862+0000 7fef6944c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.862+0000 7fef6944c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:25:39.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.863+0000 7fef6944c640 10 monclient(hunting): handle_auth_done global_id 4572 payload 293 2026-02-17T21:25:39.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.863+0000 7fef6944c640 1 -- 10.20.193.5:0/1738746490 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fef50004900 msgr2=0x7fef50004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:39.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.863+0000 7fef6944c640 1 --2- 10.20.193.5:0/1738746490 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fef50004900 0x7fef50004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.863+0000 7fef6944c640 1 -- 10.20.193.5:0/1738746490 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fef50003ba0 msgr2=0x7fef50003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:39.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.863+0000 7fef6944c640 1 --2- 10.20.193.5:0/1738746490 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fef50003ba0 0x7fef50003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.863+0000 7fef6944c640 10 monclient: _finish_hunting 0 2026-02-17T21:25:39.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.863+0000 7fef6944c640 1 monclient: found mon.a 2026-02-17T21:25:39.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.863+0000 7fef6944c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:39.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.863+0000 7fef6944c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:39.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.863+0000 7fef6944c640 1 -- 10.20.193.5:0/1738746490 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef50003620 con 0x7fef50005510 2026-02-17T21:25:39.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.863+0000 7fef6944c640 10 monclient: _finish_auth 0 2026-02-17T21:25:39.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.863+0000 7fef6944c640 10 monclient: _check_auth_tickets 2026-02-17T21:25:39.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.863+0000 7fef6944c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:39.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.863+0000 7fef6aed6640 5 monclient: authenticate success, global_id 4572 2026-02-17T21:25:39.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.863+0000 7fef6aed6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:39.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.863+0000 7fef6944c640 1 -- 10.20.193.5:0/1738746490 reap_dead start 2026-02-17T21:25:39.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.863+0000 7fef6944c640 1 --2- 10.20.193.5:0/1738746490 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fef50005510 0x7fef5000bb70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fef60009d90 tx=0x7fef6002f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1cdba2a2bcfc38 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.865+0000 7fef5b7fe640 1 -- 10.20.193.5:0/1738746490 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef60009a10 con 0x7fef50005510 2026-02-17T21:25:39.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.865+0000 7fef5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.865+0000 7fef5b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:39.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.865+0000 7fef5b7fe640 10 monclient: dump: 2026-02-17T21:25:39.868 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.868 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.868 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.868 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.868 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.868 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.868 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.868 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.868 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.868 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.865+0000 7fef5b7fe640 1 -- 10.20.193.5:0/1738746490 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef60003cb0 con 0x7fef50005510 2026-02-17T21:25:39.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.865+0000 7fef5b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:39.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.865+0000 7fef5b7fe640 1 -- 10.20.193.5:0/1738746490 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef60003e60 con 0x7fef50005510 2026-02-17T21:25:39.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.865+0000 7fef6aed6640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:39.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.865+0000 7fef6aed6640 4 set_mon_vals no callback set 2026-02-17T21:25:39.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.865+0000 7fef5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.865+0000 7fef5b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:39.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.865+0000 7fef5b7fe640 10 monclient: dump: 2026-02-17T21:25:39.869 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.869 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.869 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.869 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.869 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.869 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.869 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.869 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.869 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.869 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.865+0000 7f3bfeffd640 1 -- 10.20.193.5:0/1166566941 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3c080633c0 con 0x7f3c1815d950 2026-02-17T21:25:39.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.865+0000 7f3bfeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.865+0000 7f3bfeffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:39.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7fef6aed6640 10 monclient: shutdown 2026-02-17T21:25:39.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7fef6aed6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:39.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7fef6aed6640 1 -- 10.20.193.5:0/1738746490 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fef50005510 msgr2=0x7fef5000bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7fef6aed6640 1 --2- 10.20.193.5:0/1738746490 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fef50005510 0x7fef5000bb70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fef60009d90 tx=0x7fef6002f610 comp rx=0 tx=0).stop 2026-02-17T21:25:39.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7fef6aed6640 1 -- 10.20.193.5:0/1738746490 shutdown_connections 2026-02-17T21:25:39.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7fef6aed6640 1 --2- 10.20.193.5:0/1738746490 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fef50005510 0x7fef5000bb70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7fef6aed6640 1 -- 10.20.193.5:0/1738746490 >> 10.20.193.5:0/1738746490 conn(0x7fef640c9f40 msgr2=0x7fef640ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:39.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7fef6aed6640 1 -- 10.20.193.5:0/1738746490 shutdown_connections 2026-02-17T21:25:39.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7fef6aed6640 1 -- 10.20.193.5:0/1738746490 wait complete. 2026-02-17T21:25:39.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7f9dff7fe640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f9e0015ef80 0x7f9e000c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7f9dff7fe640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f9e0015ef80 0x7f9e000c9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:60296/0 (socket says 10.20.193.5:60296) 2026-02-17T21:25:39.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7f9dff7fe640 1 -- 10.20.193.5:0/3339044825 learned_addr learned my addr 10.20.193.5:0/3339044825 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:39.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7f9dff7fe640 10 monclient(hunting): get_auth_request con 0x7f9e0015ef80 auth_method 0 2026-02-17T21:25:39.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7f9dff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7f9dff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7fef6aed6640 10 monclient: build_initial_monmap 2026-02-17T21:25:39.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7fef6aed6640 10 monclient: monmap: 2026-02-17T21:25:39.872 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:39.872 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:39.872 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:39.872 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:39.872 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:39.873 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.873 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:39.873 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:39.873 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:39.873 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7f9dff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7fef6aed6640 1 librados: starting msgr at 2026-02-17T21:25:39.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7fef6aed6640 1 librados: starting objecter 2026-02-17T21:25:39.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7fef6aed6640 1 Processor -- start 2026-02-17T21:25:39.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7f9dff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7f9dff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7f9dff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7fef6aed6640 1 -- start start 2026-02-17T21:25:39.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7fef6aed6640 1 librados: setting wanted keys 2026-02-17T21:25:39.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7fef6aed6640 1 librados: calling monclient init 2026-02-17T21:25:39.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.866+0000 7fef6aed6640 10 monclient: init 2026-02-17T21:25:39.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7fef6aed6640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:39.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7fef6aed6640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:25:39.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7fef6aed6640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fef50005510 0x7fef6415c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7fef6aed6640 10 monclient(hunting): picked mon.noname-b con 0x7fef50005510 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:39.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7fef6aed6640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fef641f0970 0x7fef64073920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7fef6aed6640 10 monclient(hunting): picked mon.noname-a con 0x7fef641f0970 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:39.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7fef6aed6640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fef641f0df0 0x7fef641ef700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7fef6aed6640 10 monclient(hunting): picked mon.noname-c con 0x7fef641f0df0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:39.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7fef6aed6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7fef6aed6640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fef640c7ee0 con 0x7fef641f0970 2026-02-17T21:25:39.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7fef6aed6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7fef6aed6640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fef640c5830 con 0x7fef50005510 2026-02-17T21:25:39.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7fef6aed6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7fef6aed6640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fef640c81c0 con 0x7fef641f0df0 2026-02-17T21:25:39.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7fef6aed6640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:39.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7fef6aed6640 10 monclient(hunting): authenticate will time out at 1045.432390s 2026-02-17T21:25:39.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7f9dd3fff640 1 -- 10.20.193.5:0/2293640241 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9de8062800 con 0x7f9df80d1b60 2026-02-17T21:25:39.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7f9dd3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7f9dd3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:39.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7fef5bfff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fef641f0970 0x7fef64073920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7f9dff7fe640 10 monclient(hunting): handle_auth_done global_id 4591 payload 274 2026-02-17T21:25:39.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7f9dff7fe640 1 -- 10.20.193.5:0/3339044825 >> v1:10.20.193.135:6789/0 conn(0x7f9e00152ae0 legacy=0x7f9e000c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:39.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7f9dff7fe640 1 -- 10.20.193.5:0/3339044825 >> v1:10.20.193.119:6789/0 conn(0x7f9e00152700 legacy=0x7f9e0015e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:39.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7f9dff7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:25:39.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7f9dff7fe640 1 monclient: found mon.noname-b 2026-02-17T21:25:39.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7f9dff7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:39.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7f9dff7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7f9dff7fe640 1 -- 10.20.193.5:0/3339044825 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e0015dd90 con 0x7f9e0015ef80 2026-02-17T21:25:39.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7fef5bfff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fef641f0970 0x7fef64073920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:58818/0 (socket says 10.20.193.5:58818) 2026-02-17T21:25:39.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7fef5bfff640 1 -- 10.20.193.5:0/554697575 learned_addr learned my addr 10.20.193.5:0/554697575 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:39.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7fef5bfff640 10 monclient(hunting): get_auth_request con 0x7fef641f0970 auth_method 0 2026-02-17T21:25:39.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7fef5bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7fef5bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.867+0000 7fef5bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.868+0000 7fef5bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.868+0000 7fef5bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.868+0000 7fef5bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.869+0000 7fef5bfff640 10 monclient(hunting): handle_auth_done global_id 4575 payload 824 2026-02-17T21:25:39.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.869+0000 7fef5bfff640 1 -- 10.20.193.5:0/554697575 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fef641f0df0 msgr2=0x7fef641ef700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.869+0000 7fef5bfff640 1 --2- 10.20.193.5:0/554697575 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fef641f0df0 0x7fef641ef700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.869+0000 7fef5bfff640 1 -- 10.20.193.5:0/554697575 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fef50005510 msgr2=0x7fef6415c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.869+0000 7fef5bfff640 1 --2- 10.20.193.5:0/554697575 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fef50005510 0x7fef6415c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.869+0000 7fef5bfff640 10 monclient: _finish_hunting 0 2026-02-17T21:25:39.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.869+0000 7fef5bfff640 1 monclient: found mon.noname-a 2026-02-17T21:25:39.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.869+0000 7fef5bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:39.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.869+0000 7fef5bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:39.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.869+0000 7fef5bfff640 1 -- 10.20.193.5:0/554697575 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef6415c6f0 con 0x7fef641f0970 2026-02-17T21:25:39.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.869+0000 7f9dff7fe640 1 --2- 10.20.193.5:0/3339044825 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9e0015ef80 0x7f9e000c9730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9df0009970 tx=0x7f9df002eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=290a7b60ba2ab8ca server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.872+0000 7fef5bfff640 1 --2- 10.20.193.5:0/554697575 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fef641f0970 0x7fef64073920 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00ca70 tx=0x7fef4c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.872+0000 7fef597fa640 10 client.?.objecter ms_handle_connect 0x7fef641f0970 2026-02-17T21:25:39.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.872+0000 7fef597fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:39.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.872+0000 7f8f86ffd640 1 -- 10.20.193.5:0/2694525632 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8f90010040 con 0x7f8fa015abc0 2026-02-17T21:25:39.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.872+0000 7f8f86ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T21:25:39.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.872+0000 7f8f86ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:39.882 INFO:teuthology.orchestra.run.trial005.stdout:94489280518 2026-02-17T21:25:39.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.873+0000 7f9dfeffd640 1 -- 10.20.193.5:0/3339044825 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df003c070 con 0x7f9e0015ef80 2026-02-17T21:25:39.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.873+0000 7f9dfeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.873+0000 7f9dfeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:39.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.873+0000 7f9dfeffd640 10 monclient: dump: 2026-02-17T21:25:39.883 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.883 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.883 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.883 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.883 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.883 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.883 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.883 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.883 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.883 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.873+0000 7f9dfeffd640 10 monclient: _finish_auth 0 2026-02-17T21:25:39.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.873+0000 7f9dfeffd640 10 monclient: _check_auth_tickets 2026-02-17T21:25:39.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.873+0000 7f9dfeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:39.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.873+0000 7f9dfeffd640 1 -- 10.20.193.5:0/3339044825 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df002fb60 con 0x7f9e0015ef80 2026-02-17T21:25:39.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.873+0000 7f9dfeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:39.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.873+0000 7f9dfeffd640 1 -- 10.20.193.5:0/3339044825 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df0037440 con 0x7f9e0015ef80 2026-02-17T21:25:39.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.873+0000 7f9e06585640 5 monclient: authenticate success, global_id 4591 2026-02-17T21:25:39.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.873+0000 7f9e06585640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:39.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.873+0000 7f9e06585640 4 set_mon_vals no callback set 2026-02-17T21:25:39.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.873+0000 7f9dfeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.873+0000 7f9dfeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:39.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.873+0000 7f9dfeffd640 10 monclient: dump: 2026-02-17T21:25:39.884 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.884 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.884 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.884 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.884 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.884 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.885 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.885 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.885 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.885 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f9e06585640 10 monclient: shutdown 2026-02-17T21:25:39.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f9e06585640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:39.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f9e06585640 1 -- 10.20.193.5:0/3339044825 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9e0015ef80 msgr2=0x7f9e000c9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f9e06585640 1 --2- 10.20.193.5:0/3339044825 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9e0015ef80 0x7f9e000c9730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9df0009970 tx=0x7f9df002eef0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f9e06585640 1 -- 10.20.193.5:0/3339044825 shutdown_connections 2026-02-17T21:25:39.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f9e06585640 1 --2- 10.20.193.5:0/3339044825 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9e0015ef80 0x7f9e000c9730 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f9e06585640 1 -- 10.20.193.5:0/3339044825 >> 10.20.193.5:0/3339044825 conn(0x7f9e00073030 msgr2=0x7f9e00073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:39.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f9e06585640 1 -- 10.20.193.5:0/3339044825 shutdown_connections 2026-02-17T21:25:39.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f9e06585640 1 -- 10.20.193.5:0/3339044825 wait complete. 2026-02-17T21:25:39.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f8fa4daf640 10 librados: watch_flush enter 2026-02-17T21:25:39.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f8fa4daf640 10 librados: watch_flush exit 2026-02-17T21:25:39.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f8fa4daf640 20 client.4616.objecter shutdown clearing up homeless session... 2026-02-17T21:25:39.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f8fa4daf640 10 client.4616.objecter successfully canceled tick 2026-02-17T21:25:39.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f8fa4daf640 1 -- 10.20.193.5:0/2694525632 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8f6c0792d0 msgr2=0x7f8f6c07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f8fa4daf640 1 --2- 10.20.193.5:0/2694525632 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8f6c0792d0 0x7f8f6c07b790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0153310 tx=0x7f8f94036000 comp rx=0 tx=0).stop 2026-02-17T21:25:39.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f8fa4daf640 10 monclient: shutdown 2026-02-17T21:25:39.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f8fa4daf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:39.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f8fa4daf640 1 -- 10.20.193.5:0/2694525632 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8fa015abc0 msgr2=0x7f8fa0073540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f8fa4daf640 1 --2- 10.20.193.5:0/2694525632 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8fa015abc0 0x7f8fa0073540 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8f90009dd0 tx=0x7f8f9000c490 comp rx=0 tx=0).stop 2026-02-17T21:25:39.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f8fa4daf640 1 -- 10.20.193.5:0/2694525632 shutdown_connections 2026-02-17T21:25:39.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f8fa4daf640 1 --2- 10.20.193.5:0/2694525632 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8f6c0792d0 0x7f8f6c07b790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f8fa4daf640 1 --2- 10.20.193.5:0/2694525632 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8fa015abc0 0x7f8fa0073540 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f8fa4daf640 1 --2- 10.20.193.5:0/2694525632 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8fa014f660 0x7f8fa0073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f8fa4daf640 1 --2- 10.20.193.5:0/2694525632 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8fa014f280 0x7f8fa00cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f8fa4daf640 1 -- 10.20.193.5:0/2694525632 >> 10.20.193.5:0/2694525632 conn(0x7f8fa00c9f20 msgr2=0x7f8fa00c4990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:39.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f8fa4daf640 1 -- 10.20.193.5:0/2694525632 shutdown_connections 2026-02-17T21:25:39.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f8fa4daf640 1 -- 10.20.193.5:0/2694525632 wait complete. 2026-02-17T21:25:39.888 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f9e06585640 10 monclient: build_initial_monmap 2026-02-17T21:25:39.888 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f9e06585640 10 monclient: monmap: 2026-02-17T21:25:39.888 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:39.888 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:39.888 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:39.888 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:39.888 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:39.888 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.888 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:39.888 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:39.888 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:39.888 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.874+0000 7f8fa4daf640 1 librados: shutdown 2026-02-17T21:25:39.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f9e06585640 1 librados: starting msgr at 2026-02-17T21:25:39.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f9e06585640 1 librados: starting objecter 2026-02-17T21:25:39.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f9e06585640 1 Processor -- start 2026-02-17T21:25:39.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f9e06585640 1 -- start start 2026-02-17T21:25:39.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f9e06585640 1 librados: setting wanted keys 2026-02-17T21:25:39.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f9e06585640 1 librados: calling monclient init 2026-02-17T21:25:39.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f9e06585640 10 monclient: init 2026-02-17T21:25:39.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f418effd640 1 -- 10.20.193.5:0/258826948 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 12}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f419c062970 con 0x7f41a814f280 2026-02-17T21:25:39.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f418effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T21:25:39.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f418effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:39.890 INFO:teuthology.orchestra.run.trial005.stdout:103079215110 2026-02-17T21:25:39.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f9e06585640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:39.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f9e06585640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:25:39.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f9e06585640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9e00152700 0x7f9e00150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f9e06585640 10 monclient(hunting): picked mon.noname-a con 0x7f9e00152700 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:39.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f9e06585640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9e00152ae0 0x7f9e00158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f9e06585640 10 monclient(hunting): picked mon.noname-c con 0x7f9e00152ae0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:39.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f9e06585640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9e0015ef80 0x7f9e00159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f9e06585640 10 monclient(hunting): picked mon.noname-b con 0x7f9e0015ef80 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:39.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f9e06585640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f9e06585640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9e000ca380 con 0x7f9e00152700 2026-02-17T21:25:39.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f9e06585640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f9e06585640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0015e350 con 0x7f9e0015ef80 2026-02-17T21:25:39.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f9e06585640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:39.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f9e06585640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9e00166850 con 0x7f9e00152ae0 2026-02-17T21:25:39.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f9e06585640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:39.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.875+0000 7f9e06585640 10 monclient(hunting): authenticate will time out at 1045.440565s 2026-02-17T21:25:39.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.876+0000 7f9e04afb640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9e0015ef80 0x7f9e00159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.877+0000 7f9dff7fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9e00152ae0 0x7f9e00158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.877+0000 7f41acb40640 10 librados: watch_flush enter 2026-02-17T21:25:39.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f41acb40640 10 librados: watch_flush exit 2026-02-17T21:25:39.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f41acb40640 20 client.4576.objecter shutdown clearing up homeless session... 2026-02-17T21:25:39.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f41acb40640 10 client.4576.objecter successfully canceled tick 2026-02-17T21:25:39.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f41acb40640 1 -- 10.20.193.5:0/258826948 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4174079280 msgr2=0x7f417407b740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T21:25:39.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f41acb40640 1 --2- 10.20.193.5:0/258826948 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4174079280 0x7f417407b740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f41acb40640 10 monclient: shutdown 2026-02-17T21:25:39.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f41acb40640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:39.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f41acb40640 1 -- 10.20.193.5:0/258826948 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f41a814f280 msgr2=0x7f41a8153340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f41acb40640 1 --2- 10.20.193.5:0/258826948 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f41a814f280 0x7f41a8153340 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f419c00b530 tx=0x7f419c00ba00 comp rx=0 tx=0).stop 2026-02-17T21:25:39.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f9dff7fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9e00152ae0 0x7f9e00158d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:54652/0 (socket says 10.20.193.5:54652) 2026-02-17T21:25:39.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f9dff7fe640 1 -- 10.20.193.5:0/3032994914 learned_addr learned my addr 10.20.193.5:0/3032994914 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:39.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f9dff7fe640 10 monclient(hunting): get_auth_request con 0x7f9e00152ae0 auth_method 0 2026-02-17T21:25:39.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f9dff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f9dff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f9dff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f41acb40640 1 -- 10.20.193.5:0/258826948 shutdown_connections 2026-02-17T21:25:39.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f41acb40640 1 --2- 10.20.193.5:0/258826948 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4174079280 0x7f417407b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f41acb40640 1 --2- 10.20.193.5:0/258826948 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f41a815abc0 0x7f41a8149120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f41acb40640 1 --2- 10.20.193.5:0/258826948 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f41a814f660 0x7f41a8148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f41acb40640 1 --2- 10.20.193.5:0/258826948 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f41a814f280 0x7f41a8153340 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f41acb40640 1 -- 10.20.193.5:0/258826948 >> 10.20.193.5:0/258826948 conn(0x7f41a80c9f20 msgr2=0x7f41a8149d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:39.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f41acb40640 1 -- 10.20.193.5:0/258826948 shutdown_connections 2026-02-17T21:25:39.895 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f41acb40640 1 -- 10.20.193.5:0/258826948 wait complete. 2026-02-17T21:25:39.895 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f41acb40640 1 librados: shutdown 2026-02-17T21:25:39.895 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f9dff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:39.895 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f9dff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:39.895 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f9dff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:39.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7fef597fa640 1 -- 10.20.193.5:0/554697575 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c004cf0 con 0x7fef641f0970 2026-02-17T21:25:39.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7fef597fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7fef597fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:39.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7fef597fa640 10 monclient: dump: 2026-02-17T21:25:39.896 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.896 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.896 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.896 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.896 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.896 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.896 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.896 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.896 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.896 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7fef597fa640 10 monclient: _finish_auth 0 2026-02-17T21:25:39.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7fef597fa640 10 monclient: _check_auth_tickets 2026-02-17T21:25:39.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7fef597fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:39.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7fef597fa640 1 -- 10.20.193.5:0/554697575 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef4c007110 con 0x7fef641f0970 2026-02-17T21:25:39.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7fef6aed6640 5 monclient: authenticate success, global_id 4575 2026-02-17T21:25:39.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7fef6aed6640 10 monclient: _renew_subs 2026-02-17T21:25:39.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7fef6aed6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:39.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7fef6aed6640 1 -- 10.20.193.5:0/554697575 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef6415c9d0 con 0x7fef641f0970 2026-02-17T21:25:39.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7fef597fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:39.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7fef597fa640 1 -- 10.20.193.5:0/554697575 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c007500 con 0x7fef641f0970 2026-02-17T21:25:39.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7fef597fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7fef597fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:39.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7fef597fa640 10 monclient: dump: 2026-02-17T21:25:39.897 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.897 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.897 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.897 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.897 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.897 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.897 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.897 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.897 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.897 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7fef5affd640 4 set_mon_vals no callback set 2026-02-17T21:25:39.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7fef6aed6640 10 client.4575.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:39.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7fef6aed6640 10 monclient: _renew_subs 2026-02-17T21:25:39.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7fef6aed6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:39.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7fef6aed6640 1 -- 10.20.193.5:0/554697575 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef6415cf90 con 0x7fef641f0970 2026-02-17T21:25:39.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7fef6aed6640 1 librados: init done 2026-02-17T21:25:39.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f9e04afb640 10 monclient(hunting): get_auth_request con 0x7f9e0015ef80 auth_method 0 2026-02-17T21:25:39.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f9e04afb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:39.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f9e04afb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:39.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.878+0000 7f9e04afb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:39.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.879+0000 7fef6aed6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.879+0000 7fef6aed6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.879+0000 7fef6aed6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:39.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.879+0000 7fef6aed6640 1 -- 10.20.193.5:0/554697575 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef64076dc0 con 0x7fef641f0970 2026-02-17T21:25:39.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.879+0000 7f9dff7fe640 10 monclient(hunting): handle_auth_done global_id 4625 payload 824 2026-02-17T21:25:39.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.879+0000 7f9dff7fe640 1 -- 10.20.193.5:0/3032994914 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9e0015ef80 msgr2=0x7f9e00159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.879+0000 7f9dff7fe640 1 --2- 10.20.193.5:0/3032994914 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9e0015ef80 0x7f9e00159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.879+0000 7f9dff7fe640 1 -- 10.20.193.5:0/3032994914 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9e00152700 msgr2=0x7f9e00150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.879+0000 7f9dff7fe640 1 --2- 10.20.193.5:0/3032994914 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9e00152700 0x7f9e00150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.879+0000 7f9dff7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:25:39.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.879+0000 7f9dff7fe640 1 monclient: found mon.noname-c 2026-02-17T21:25:39.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.879+0000 7f9dff7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:39.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.879+0000 7f9dff7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.879+0000 7f9dff7fe640 1 -- 10.20.193.5:0/3032994914 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e001578c0 con 0x7f9e00152ae0 2026-02-17T21:25:39.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.881+0000 7f9dff7fe640 1 --2- 10.20.193.5:0/3032994914 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9e00152ae0 0x7f9e00158d50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9df0009970 tx=0x7f9df00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.881+0000 7f9dfcff9640 10 client.?.objecter ms_handle_connect 0x7f9e00152ae0 2026-02-17T21:25:39.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.881+0000 7f9dfcff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:39.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.883+0000 7f9dfcff9640 1 -- 10.20.193.5:0/3032994914 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df0044070 con 0x7f9e00152ae0 2026-02-17T21:25:39.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.883+0000 7f9dfcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.883+0000 7f9dfcff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:39.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.883+0000 7f9dfcff9640 10 monclient: dump: 2026-02-17T21:25:39.900 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.900 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.900 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.900 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.900 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.900 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.900 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.900 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.900 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.901 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.883+0000 7f9dfcff9640 10 monclient: _finish_auth 0 2026-02-17T21:25:39.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.883+0000 7f9dfcff9640 10 monclient: _check_auth_tickets 2026-02-17T21:25:39.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.883+0000 7f9dfcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:39.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.883+0000 7f9dfcff9640 1 -- 10.20.193.5:0/3032994914 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df0040610 con 0x7f9e00152ae0 2026-02-17T21:25:39.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.883+0000 7f9e06585640 5 monclient: authenticate success, global_id 4625 2026-02-17T21:25:39.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.883+0000 7f9e06585640 10 monclient: _renew_subs 2026-02-17T21:25:39.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.883+0000 7f9e06585640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.883+0000 7f9e06585640 1 -- 10.20.193.5:0/3032994914 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e00157cb0 con 0x7f9e00152ae0 2026-02-17T21:25:39.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.883+0000 7f9dfcff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:39.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.884+0000 7f9dfcff9640 1 -- 10.20.193.5:0/3032994914 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df003c040 con 0x7f9e00152ae0 2026-02-17T21:25:39.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.884+0000 7f9dfcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:39.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.884+0000 7f9dfcff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:39.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.884+0000 7f9dfcff9640 10 monclient: dump: 2026-02-17T21:25:39.901 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:39.901 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:39.901 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.901 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:39.901 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:39.901 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:39.901 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:39.901 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:39.901 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:39.901 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:39.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.884+0000 7f9e06585640 10 client.4625.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:39.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.884+0000 7f9e06585640 10 monclient: _renew_subs 2026-02-17T21:25:39.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.884+0000 7f9e06585640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.884+0000 7f9e06585640 1 -- 10.20.193.5:0/3032994914 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e00158270 con 0x7f9e00152ae0 2026-02-17T21:25:39.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.884+0000 7f9dfe7fc640 4 set_mon_vals no callback set 2026-02-17T21:25:39.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.884+0000 7f9e06585640 1 librados: init done 2026-02-17T21:25:39.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280518 for osd.5 2026-02-17T21:25:39.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.884+0000 7f9e06585640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.884+0000 7f9e06585640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:39.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.884+0000 7f9e06585640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.884+0000 7f9e06585640 1 -- 10.20.193.5:0/3032994914 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e0015e870 con 0x7f9e00152ae0 2026-02-17T21:25:39.903 DEBUG:teuthology.parallel:result is None 2026-02-17T21:25:39.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215109 got 103079215110 for osd.12 2026-02-17T21:25:39.904 DEBUG:teuthology.parallel:result is None 2026-02-17T21:25:39.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.895+0000 7f9dfcff9640 1 -- 10.20.193.5:0/3032994914 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f9df003f050 con 0x7f9e00152ae0 2026-02-17T21:25:39.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.895+0000 7f9dfcff9640 1 --2- 10.20.193.5:0/3032994914 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9dd0079280 0x7f9dd007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.895+0000 7f9dfffff640 1 --2- 10.20.193.5:0/3032994914 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9dd0079280 0x7f9dd007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.895+0000 7f9dfffff640 10 monclient: get_auth_request con 0x7f9dd0079280 auth_method 0 2026-02-17T21:25:39.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.896+0000 7f9dfcff9640 10 client.4625.objecter ms_handle_connect 0x7f9dd0079280 2026-02-17T21:25:39.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.896+0000 7f9dfffff640 1 --2- 10.20.193.5:0/3032994914 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9dd0079280 0x7f9dd007b740 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9e0014ba20 tx=0x7f9dec006cc0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.896+0000 7f9dfcff9640 1 -- 10.20.193.5:0/3032994914 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f9df0083330 con 0x7f9e00152ae0 2026-02-17T21:25:39.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.896+0000 7f9dfcff9640 10 client.4625.objecter ms_dispatch2 0x7f9e00000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:39.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.896+0000 7f9dfcff9640 3 client.4625.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:39.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.896+0000 7f9dfcff9640 3 client.4625.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:39.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.897+0000 7f9dfcff9640 20 client.4625.objecter dump_active .. 0 homeless 2026-02-17T21:25:39.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.952+0000 7f3c1ccbd640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T21:25:39.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.952+0000 7f3c1ccbd640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T21:25:39.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.952+0000 7f3c1ccbd640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:39.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.952+0000 7f3c1ccbd640 1 -- 10.20.193.5:0/1166566941 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f3c180d24a0 con 0x7f3c1815d950 2026-02-17T21:25:39.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.953+0000 7f9dfe253640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T21:25:39.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.953+0000 7f9dfe253640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T21:25:39.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.953+0000 7f9dfe253640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:39.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.953+0000 7f9dfe253640 1 -- 10.20.193.5:0/2293640241 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 13} v 0) -- 0x7f9df806a210 con 0x7f9df80d1b60 2026-02-17T21:25:39.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.954+0000 7f3bfeffd640 1 -- 10.20.193.5:0/1166566941 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f3c080676c0 con 0x7f3c1815d950 2026-02-17T21:25:39.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.954+0000 7f3bfeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T21:25:39.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.954+0000 7f3bfeffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:39.956 INFO:teuthology.orchestra.run.trial005.stdout:120259084296 2026-02-17T21:25:39.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.955+0000 7f3c1ccbd640 10 librados: watch_flush enter 2026-02-17T21:25:39.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.955+0000 7f3c1ccbd640 10 librados: watch_flush exit 2026-02-17T21:25:39.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.955+0000 7f3c1ccbd640 20 client.4585.objecter shutdown clearing up homeless session... 2026-02-17T21:25:39.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.955+0000 7f3c1ccbd640 10 client.4585.objecter successfully canceled tick 2026-02-17T21:25:39.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.955+0000 7f3c1ccbd640 1 -- 10.20.193.5:0/1166566941 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3be4079280 msgr2=0x7f3be407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.955+0000 7f3c1ccbd640 1 --2- 10.20.193.5:0/1166566941 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3be4079280 0x7f3be407b740 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c004660 tx=0x7f3c0c009110 comp rx=0 tx=0).stop 2026-02-17T21:25:39.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.955+0000 7f3c1ccbd640 10 monclient: shutdown 2026-02-17T21:25:39.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.955+0000 7f3c1ccbd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:39.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.955+0000 7f3c1ccbd640 1 -- 10.20.193.5:0/1166566941 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c1815d950 msgr2=0x7f3c1814d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:39.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.955+0000 7f3c1ccbd640 1 --2- 10.20.193.5:0/1166566941 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c1815d950 0x7f3c1814d410 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3c08007e40 tx=0x7f3c0800e4b0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.956+0000 7f3c1ccbd640 1 -- 10.20.193.5:0/1166566941 shutdown_connections 2026-02-17T21:25:39.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.956+0000 7f3c1ccbd640 1 --2- 10.20.193.5:0/1166566941 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3be4079280 0x7f3be407b740 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.956+0000 7f3c1ccbd640 1 --2- 10.20.193.5:0/1166566941 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c1815d950 0x7f3c1814d410 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.956+0000 7f3c1ccbd640 1 --2- 10.20.193.5:0/1166566941 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c180d1f40 0x7f3c18144550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.956+0000 7f3c1ccbd640 1 --2- 10.20.193.5:0/1166566941 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3c180d1b60 0x7f3c1814ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:39.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.956+0000 7f3c1ccbd640 1 -- 10.20.193.5:0/1166566941 >> 10.20.193.5:0/1166566941 conn(0x7f3c1806d9b0 msgr2=0x7f3c1814fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:39.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.956+0000 7f3c1ccbd640 1 -- 10.20.193.5:0/1166566941 shutdown_connections 2026-02-17T21:25:39.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.956+0000 7f3c1ccbd640 1 -- 10.20.193.5:0/1166566941 wait complete. 2026-02-17T21:25:39.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.956+0000 7f3c1ccbd640 1 librados: shutdown 2026-02-17T21:25:39.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084295 got 120259084296 for osd.10 2026-02-17T21:25:39.965 DEBUG:teuthology.parallel:result is None 2026-02-17T21:25:39.993 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.991+0000 7fef597fa640 1 -- 10.20.193.5:0/554697575 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fef4c00a640 con 0x7fef641f0970 2026-02-17T21:25:39.994 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.992+0000 7fef597fa640 1 --2- 10.20.193.5:0/554697575 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fef34079270 0x7fef3407b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:39.994 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.992+0000 7fef68c4b640 1 --2- 10.20.193.5:0/554697575 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fef34079270 0x7fef3407b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:39.994 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.992+0000 7fef68c4b640 10 monclient: get_auth_request con 0x7fef34079270 auth_method 0 2026-02-17T21:25:39.994 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.993+0000 7fef68c4b640 1 --2- 10.20.193.5:0/554697575 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fef34079270 0x7fef3407b730 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fef540097d0 tx=0x7fef54006db0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:39.994 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:39.993+0000 7fef597fa640 10 client.4575.objecter ms_handle_connect 0x7fef34079270 2026-02-17T21:25:40.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.000+0000 7f9dd3fff640 1 -- 10.20.193.5:0/2293640241 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 13}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f9de8066b00 con 0x7f9df80d1b60 2026-02-17T21:25:40.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.000+0000 7f9dd3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T21:25:40.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.000+0000 7f9dd3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:40.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.000+0000 7f9dfcff9640 1 -- 10.20.193.5:0/3032994914 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9df00879f0 con 0x7f9e00152ae0 2026-02-17T21:25:40.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.000+0000 7f9dfcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:40.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.000+0000 7f9dfcff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:40.002 INFO:teuthology.orchestra.run.trial005.stdout:111669149702 2026-02-17T21:25:40.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.001+0000 7fef597fa640 1 -- 10.20.193.5:0/554697575 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7fef4c0076a0 con 0x7fef641f0970 2026-02-17T21:25:40.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.001+0000 7fef597fa640 10 client.4575.objecter ms_dispatch2 0x7fef64000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:40.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.001+0000 7fef597fa640 3 client.4575.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:40.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.001+0000 7fef597fa640 3 client.4575.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:40.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.001+0000 7fef597fa640 20 client.4575.objecter dump_active .. 0 homeless 2026-02-17T21:25:40.004 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.001+0000 7fef597fa640 1 -- 10.20.193.5:0/554697575 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fef64076dc0 con 0x7fef641f0970 2026-02-17T21:25:40.004 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.001+0000 7fef597fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:40.004 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.001+0000 7fef597fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:40.006 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.002+0000 7f9dfe253640 10 librados: watch_flush enter 2026-02-17T21:25:40.006 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.002+0000 7f9dfe253640 10 librados: watch_flush exit 2026-02-17T21:25:40.006 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.002+0000 7f9dfe253640 20 client.4622.objecter shutdown clearing up homeless session... 2026-02-17T21:25:40.006 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.002+0000 7f9dfe253640 10 client.4622.objecter successfully canceled tick 2026-02-17T21:25:40.006 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.002+0000 7f9dfe253640 1 -- 10.20.193.5:0/2293640241 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9dc8079280 msgr2=0x7f9dc807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.006 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.002+0000 7f9dfe253640 1 --2- 10.20.193.5:0/2293640241 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9dc8079280 0x7f9dc807b740 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9df80751e0 tx=0x7f9de4033000 comp rx=0 tx=0).stop 2026-02-17T21:25:40.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.002+0000 7f9dfe253640 10 monclient: shutdown 2026-02-17T21:25:40.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.002+0000 7f9dfe253640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:40.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.002+0000 7f9dfe253640 1 -- 10.20.193.5:0/2293640241 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9df80d1b60 msgr2=0x7f9df81f71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.002+0000 7f9dfe253640 1 --2- 10.20.193.5:0/2293640241 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9df80d1b60 0x7f9df81f71a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9de800e9b0 tx=0x7f9de800ee80 comp rx=0 tx=0).stop 2026-02-17T21:25:40.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.002+0000 7f9dfe253640 1 -- 10.20.193.5:0/2293640241 shutdown_connections 2026-02-17T21:25:40.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.002+0000 7f9dfe253640 1 --2- 10.20.193.5:0/2293640241 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9dc8079280 0x7f9dc807b740 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.002+0000 7f9dfe253640 1 --2- 10.20.193.5:0/2293640241 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9df815c840 0x7f9df8148020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.002+0000 7f9dfe253640 1 --2- 10.20.193.5:0/2293640241 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9df80d1b60 0x7f9df81f71a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.002+0000 7f9dfe253640 1 --2- 10.20.193.5:0/2293640241 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9df80c92a0 0x7f9df8149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.002+0000 7f9dfe253640 1 -- 10.20.193.5:0/2293640241 >> 10.20.193.5:0/2293640241 conn(0x7f9df806d9b0 msgr2=0x7f9df814e450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:40.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.002+0000 7f9dfe253640 1 -- 10.20.193.5:0/2293640241 shutdown_connections 2026-02-17T21:25:40.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.002+0000 7f9dfe253640 1 -- 10.20.193.5:0/2293640241 wait complete. 2026-02-17T21:25:40.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.003+0000 7f9dfe253640 1 librados: shutdown 2026-02-17T21:25:40.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149702 got 111669149702 for osd.13 2026-02-17T21:25:40.013 DEBUG:teuthology.parallel:result is None 2026-02-17T21:25:40.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.086+0000 7fef6aed6640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T21:25:40.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.086+0000 7fef6aed6640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T21:25:40.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.086+0000 7fef6aed6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:40.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.087+0000 7fef6aed6640 1 -- 10.20.193.5:0/554697575 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fef640c8e70 con 0x7fef641f0970 2026-02-17T21:25:40.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.087+0000 7f9e06585640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T21:25:40.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.087+0000 7f9e06585640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T21:25:40.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.087+0000 7f9e06585640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:40.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.087+0000 7f9e06585640 1 -- 10.20.193.5:0/3032994914 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f9e0014ddc0 con 0x7f9e00152ae0 2026-02-17T21:25:40.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.090+0000 7f9dfcff9640 1 -- 10.20.193.5:0/3032994914 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9df00872f0 con 0x7f9e00152ae0 2026-02-17T21:25:40.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.090+0000 7f9dfcff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T21:25:40.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.090+0000 7f9dfcff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:40.092 INFO:teuthology.orchestra.run.trial005.stdout:111669149704 2026-02-17T21:25:40.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.090+0000 7fef597fa640 1 -- 10.20.193.5:0/554697575 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fef4c062b70 con 0x7fef641f0970 2026-02-17T21:25:40.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.090+0000 7fef597fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T21:25:40.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.090+0000 7fef597fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:40.093 INFO:teuthology.orchestra.run.trial005.stdout:94489280518 2026-02-17T21:25:40.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7f9e06585640 10 librados: watch_flush enter 2026-02-17T21:25:40.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7f9e06585640 10 librados: watch_flush exit 2026-02-17T21:25:40.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7f9e06585640 20 client.4625.objecter shutdown clearing up homeless session... 2026-02-17T21:25:40.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7f9e06585640 10 client.4625.objecter successfully canceled tick 2026-02-17T21:25:40.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7f9e06585640 1 -- 10.20.193.5:0/3032994914 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9dd0079280 msgr2=0x7f9dd007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7f9e06585640 1 --2- 10.20.193.5:0/3032994914 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9dd0079280 0x7f9dd007b740 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9e0014ba20 tx=0x7f9dec006cc0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7f9e06585640 10 monclient: shutdown 2026-02-17T21:25:40.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7f9e06585640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:40.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7f9e06585640 1 -- 10.20.193.5:0/3032994914 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9e00152ae0 msgr2=0x7f9e00158d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7f9e06585640 1 --2- 10.20.193.5:0/3032994914 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9e00152ae0 0x7f9e00158d50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9df0009970 tx=0x7f9df00047c0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7f9e06585640 1 -- 10.20.193.5:0/3032994914 shutdown_connections 2026-02-17T21:25:40.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7f9e06585640 1 --2- 10.20.193.5:0/3032994914 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9dd0079280 0x7f9dd007b740 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7f9e06585640 1 --2- 10.20.193.5:0/3032994914 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9e0015ef80 0x7f9e00159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7f9e06585640 1 --2- 10.20.193.5:0/3032994914 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9e00152ae0 0x7f9e00158d50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7f9e06585640 1 --2- 10.20.193.5:0/3032994914 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9e00152700 0x7f9e00150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7fef6aed6640 10 librados: watch_flush enter 2026-02-17T21:25:40.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7fef6aed6640 10 librados: watch_flush exit 2026-02-17T21:25:40.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7f9e06585640 1 -- 10.20.193.5:0/3032994914 >> 10.20.193.5:0/3032994914 conn(0x7f9e00073030 msgr2=0x7f9e001513f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:40.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7fef6aed6640 20 client.4575.objecter shutdown clearing up homeless session... 2026-02-17T21:25:40.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7fef6aed6640 10 client.4575.objecter successfully canceled tick 2026-02-17T21:25:40.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7f9e06585640 1 -- 10.20.193.5:0/3032994914 shutdown_connections 2026-02-17T21:25:40.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7f9e06585640 1 -- 10.20.193.5:0/3032994914 wait complete. 2026-02-17T21:25:40.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7fef6aed6640 1 -- 10.20.193.5:0/554697575 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fef34079270 msgr2=0x7fef3407b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7fef6aed6640 1 --2- 10.20.193.5:0/554697575 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fef34079270 0x7fef3407b730 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fef540097d0 tx=0x7fef54006db0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7fef6aed6640 10 monclient: shutdown 2026-02-17T21:25:40.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7fef6aed6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:40.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7fef6aed6640 1 -- 10.20.193.5:0/554697575 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fef641f0970 msgr2=0x7fef64073920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7fef6aed6640 1 --2- 10.20.193.5:0/554697575 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fef641f0970 0x7fef64073920 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00ca70 tx=0x7fef4c00cf40 comp rx=0 tx=0).stop 2026-02-17T21:25:40.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7f9e06585640 1 librados: shutdown 2026-02-17T21:25:40.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7fef6aed6640 1 -- 10.20.193.5:0/554697575 shutdown_connections 2026-02-17T21:25:40.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7fef6aed6640 1 --2- 10.20.193.5:0/554697575 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fef34079270 0x7fef3407b730 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7fef6aed6640 1 --2- 10.20.193.5:0/554697575 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fef641f0df0 0x7fef641ef700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7fef6aed6640 1 --2- 10.20.193.5:0/554697575 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fef641f0970 0x7fef64073920 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7fef6aed6640 1 --2- 10.20.193.5:0/554697575 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fef50005510 0x7fef6415c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7fef6aed6640 1 -- 10.20.193.5:0/554697575 >> 10.20.193.5:0/554697575 conn(0x7fef640c9f40 msgr2=0x7fef640cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:40.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7fef6aed6640 1 -- 10.20.193.5:0/554697575 shutdown_connections 2026-02-17T21:25:40.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7fef6aed6640 1 -- 10.20.193.5:0/554697575 wait complete. 2026-02-17T21:25:40.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.092+0000 7fef6aed6640 1 librados: shutdown 2026-02-17T21:25:40.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280518 for osd.1 2026-02-17T21:25:40.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149704 got 111669149704 for osd.9 2026-02-17T21:25:40.104 DEBUG:teuthology.parallel:result is None 2026-02-17T21:25:40.104 DEBUG:teuthology.parallel:result is None 2026-02-17T21:25:40.104 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T21:25:40.104 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T21:25:40.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.172+0000 7f55aba5b640 10 monclient: get_monmap_and_config 2026-02-17T21:25:40.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.172+0000 7f55aba5b640 10 monclient: build_initial_monmap 2026-02-17T21:25:40.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.172+0000 7f55aba5b640 10 monclient: monmap: 2026-02-17T21:25:40.174 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:40.174 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:40.174 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:40.173034+0000 2026-02-17T21:25:40.174 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:40.173034+0000 2026-02-17T21:25:40.174 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:40.174 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:40.175 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:40.175 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:40.175 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:40.175 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:40.175 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:40.175 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:40.175 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:40.177 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.172+0000 7f55aba5b640 1 Processor -- start 2026-02-17T21:25:40.177 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.172+0000 7f55aba5b640 1 -- start start 2026-02-17T21:25:40.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.172+0000 7f55aba5b640 10 monclient: init 2026-02-17T21:25:40.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.173+0000 7f55aba5b640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:40.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.173+0000 7f55aba5b640 10 monclient: _add_conns ranks=[1,2,0,4,5,3] 2026-02-17T21:25:40.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.173+0000 7f55aba5b640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f55a40c7170 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:40.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.173+0000 7f55aba5b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f55a40c7550 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:40.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.173+0000 7f55aba5b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f55a40c89c0 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:40.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.173+0000 7f55aba5b640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55a40c4fd0 con 0x7f55a40c89c0 2026-02-17T21:25:40.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.173+0000 7f55aba5b640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55a415a9a0 con 0x7f55a40c7170 2026-02-17T21:25:40.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.173+0000 7f55aba5b640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55a40c5270 con 0x7f55a40c7550 2026-02-17T21:25:40.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.173+0000 7f55aba5b640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:40.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.173+0000 7f55aba5b640 10 monclient(hunting): authenticate will time out at 1045.738433s 2026-02-17T21:25:40.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.173+0000 7f55a97d0640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f55a40c7170 0x7f55a40c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:56948/0 (socket says 10.20.193.5:56948) 2026-02-17T21:25:40.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.173+0000 7f55a97d0640 1 -- 10.20.193.5:0/1111460164 learned_addr learned my addr 10.20.193.5:0/1111460164 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:40.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.175+0000 7f5593fff640 1 -- 10.20.193.5:0/1111460164 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3919328948 0 0) 0x7f55a40c5270 con 0x7f55a40c7550 2026-02-17T21:25:40.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.175+0000 7f5593fff640 10 monclient(hunting): _negotiate 2026-02-17T21:25:40.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.175+0000 7f5593fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:40.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.175+0000 7f5593fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:40.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.175+0000 7f5593fff640 10 monclient(hunting): my global_id is 4628 2026-02-17T21:25:40.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.175+0000 7f5593fff640 1 -- 10.20.193.5:0/1111460164 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f558c003620 con 0x7f55a40c7550 2026-02-17T21:25:40.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.175+0000 7f5593fff640 1 -- 10.20.193.5:0/1111460164 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 770878394 0 0) 0x7f55a415a9a0 con 0x7f55a40c7170 2026-02-17T21:25:40.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.175+0000 7f5593fff640 10 monclient(hunting): _negotiate 2026-02-17T21:25:40.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.175+0000 7f5593fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:40.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.175+0000 7f5593fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:40.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.175+0000 7f5593fff640 10 monclient(hunting): my global_id is 4597 2026-02-17T21:25:40.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.175+0000 7f5593fff640 1 -- 10.20.193.5:0/1111460164 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55a40c5270 con 0x7f55a40c7170 2026-02-17T21:25:40.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.175+0000 7f5593fff640 1 -- 10.20.193.5:0/1111460164 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1844386306 0 0) 0x7f55a40c4fd0 con 0x7f55a40c89c0 2026-02-17T21:25:40.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.175+0000 7f5593fff640 10 monclient(hunting): _negotiate 2026-02-17T21:25:40.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.175+0000 7f5593fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:40.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.175+0000 7f5593fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:40.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.175+0000 7f5593fff640 10 monclient(hunting): my global_id is 4578 2026-02-17T21:25:40.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.175+0000 7f5593fff640 1 -- 10.20.193.5:0/1111460164 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55a415a9a0 con 0x7f55a40c89c0 2026-02-17T21:25:40.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 1 -- 10.20.193.5:0/1111460164 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 791438478 0 0) 0x7f55a40c5270 con 0x7f55a40c7170 2026-02-17T21:25:40.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 1 -- 10.20.193.5:0/1111460164 >> v1:10.20.193.135:6789/0 conn(0x7f55a40c7550 legacy=0x7f55a40749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 1 -- 10.20.193.5:0/1111460164 >> v1:10.20.193.5:6789/0 conn(0x7f55a40c89c0 legacy=0x7f55a41646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 10 monclient: _finish_hunting 0 2026-02-17T21:25:40.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 1 monclient: found mon.noname-b-legacy 2026-02-17T21:25:40.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:40.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.119:6789/0 2026-02-17T21:25:40.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 1 -- 10.20.193.5:0/1111460164 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a40c5550 con 0x7f55a40c7170 2026-02-17T21:25:40.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 10 monclient: _finish_auth 0 2026-02-17T21:25:40.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 10 monclient: _check_auth_tickets 2026-02-17T21:25:40.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:40.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 1 -- 10.20.193.5:0/1111460164 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3880376286 0 0) 0x7f5594002ee0 con 0x7f55a40c7170 2026-02-17T21:25:40.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f55aba5b640 5 monclient: authenticate success, global_id 4597 2026-02-17T21:25:40.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f55aba5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:40.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:40.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T21:25:40.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 10 monclient: dump: 2026-02-17T21:25:40.193 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:40.193 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:40.194 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.194 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.194 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:40.194 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:40.194 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:40.194 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:40.194 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:40.194 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:40.194 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] but i'm connected to v1:10.20.193.119:6789/0, reconnecting 2026-02-17T21:25:40.194 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:40.194 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 1 -- 10.20.193.5:0/1111460164 >> v1:10.20.193.119:6789/0 conn(0x7f55a40c7170 legacy=0x7f55a40c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.194 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:25:40.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 1 --2- 10.20.193.5:0/1111460164 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f558c005040 0x7f558c0038a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:40.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 10 monclient(hunting): picked mon.c con 0x7f558c005040 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:40.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 1 --2- 10.20.193.5:0/1111460164 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f558c003de0 0x7f558c004260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:40.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 10 monclient(hunting): picked mon.b con 0x7f558c003de0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:40.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 1 --2- 10.20.193.5:0/1111460164 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f558c009ab0 0x7f558c00bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:40.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 10 monclient(hunting): picked mon.a con 0x7f558c009ab0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:40.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:40.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 1 -- 10.20.193.5:0/1111460164 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f558c00c570 con 0x7f558c009ab0 2026-02-17T21:25:40.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:40.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 1 -- 10.20.193.5:0/1111460164 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f558c00c6f0 con 0x7f558c003de0 2026-02-17T21:25:40.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:40.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 1 -- 10.20.193.5:0/1111460164 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f558c00c8f0 con 0x7f558c005040 2026-02-17T21:25:40.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:40.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f5593fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:25:40.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.176+0000 7f55aba5b640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:40.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.177+0000 7f55a97d0640 1 --2- 10.20.193.5:0/1111460164 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f558c005040 0x7f558c0038a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:40.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.177+0000 7f55a97d0640 10 monclient(hunting): get_auth_request con 0x7f558c005040 auth_method 0 2026-02-17T21:25:40.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.177+0000 7f55a97d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:40.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.177+0000 7f55a97d0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:40.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.177+0000 7f55a97d0640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:25:40.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a97d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:40.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a97d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:40.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a97d0640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:25:40.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a9fd1640 1 --2- 10.20.193.5:0/1111460164 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f558c009ab0 0x7f558c00bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:40.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a8fcf640 1 --2- 10.20.193.5:0/1111460164 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f558c003de0 0x7f558c004260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:40.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a8fcf640 10 monclient(hunting): get_auth_request con 0x7f558c003de0 auth_method 0 2026-02-17T21:25:40.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a8fcf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:40.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a8fcf640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:40.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a8fcf640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:25:40.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a9fd1640 10 monclient(hunting): get_auth_request con 0x7f558c009ab0 auth_method 0 2026-02-17T21:25:40.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a9fd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:40.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a9fd1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:40.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a9fd1640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:25:40.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a8fcf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:40.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a8fcf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:40.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a8fcf640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:25:40.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a9fd1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:40.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a9fd1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:40.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a9fd1640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:25:40.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a97d0640 10 monclient(hunting): handle_auth_done global_id 4597 payload 293 2026-02-17T21:25:40.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a97d0640 1 -- 10.20.193.5:0/1111460164 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f558c003de0 msgr2=0x7f558c004260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:40.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a97d0640 1 --2- 10.20.193.5:0/1111460164 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f558c003de0 0x7f558c004260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a97d0640 1 -- 10.20.193.5:0/1111460164 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f558c009ab0 msgr2=0x7f558c00bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:40.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a97d0640 1 --2- 10.20.193.5:0/1111460164 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f558c009ab0 0x7f558c00bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a97d0640 10 monclient: _finish_hunting 0 2026-02-17T21:25:40.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a97d0640 1 monclient: found mon.c 2026-02-17T21:25:40.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a97d0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:40.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a97d0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:40.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a97d0640 1 -- 10.20.193.5:0/1111460164 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a40c5270 con 0x7f558c005040 2026-02-17T21:25:40.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a97d0640 10 monclient: _finish_auth 0 2026-02-17T21:25:40.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a97d0640 10 monclient: _check_auth_tickets 2026-02-17T21:25:40.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a9fd1640 1 -- 10.20.193.5:0/1111460164 reap_dead start 2026-02-17T21:25:40.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.178+0000 7f55a97d0640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:40.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.179+0000 7f55a97d0640 1 --2- 10.20.193.5:0/1111460164 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f558c005040 0x7f558c0038a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f559400c160 tx=0x7f559402f480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30cca3ad52e9ce02 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:40.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.181+0000 7f5593fff640 1 -- 10.20.193.5:0/1111460164 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5594007ca0 con 0x7f558c005040 2026-02-17T21:25:40.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.181+0000 7f5593fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:40.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.181+0000 7f5593fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:40.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.181+0000 7f5593fff640 10 monclient: dump: 2026-02-17T21:25:40.200 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:40.200 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:40.200 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.200 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.200 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:40.200 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:40.200 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:40.200 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:40.200 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:40.200 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:40.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.181+0000 7f5593fff640 1 -- 10.20.193.5:0/1111460164 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5594033030 con 0x7f558c005040 2026-02-17T21:25:40.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.181+0000 7f55aba5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:40.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.181+0000 7f5593fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:40.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.181+0000 7f5593fff640 1 -- 10.20.193.5:0/1111460164 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5594005bd0 con 0x7f558c005040 2026-02-17T21:25:40.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.181+0000 7f55aba5b640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:40.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.181+0000 7f55aba5b640 4 set_mon_vals no callback set 2026-02-17T21:25:40.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.181+0000 7f5593fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:40.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.181+0000 7f5593fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:40.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.181+0000 7f5593fff640 10 monclient: dump: 2026-02-17T21:25:40.201 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:40.201 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:40.201 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.201 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.201 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:40.202 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:40.202 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:40.202 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:40.202 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:40.202 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:40.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.181+0000 7f55aba5b640 10 monclient: shutdown 2026-02-17T21:25:40.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.181+0000 7f55aba5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:40.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.181+0000 7f55aba5b640 1 -- 10.20.193.5:0/1111460164 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f558c005040 msgr2=0x7f558c0038a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.181+0000 7f55aba5b640 1 --2- 10.20.193.5:0/1111460164 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f558c005040 0x7f558c0038a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f559400c160 tx=0x7f559402f480 comp rx=0 tx=0).stop 2026-02-17T21:25:40.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.182+0000 7f55aba5b640 1 -- 10.20.193.5:0/1111460164 shutdown_connections 2026-02-17T21:25:40.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.182+0000 7f55aba5b640 1 --2- 10.20.193.5:0/1111460164 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f558c005040 0x7f558c0038a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.182+0000 7f55aba5b640 1 -- 10.20.193.5:0/1111460164 >> 10.20.193.5:0/1111460164 conn(0x7f55a40c9f40 msgr2=0x7f55a40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:40.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.182+0000 7f55aba5b640 1 -- 10.20.193.5:0/1111460164 shutdown_connections 2026-02-17T21:25:40.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.182+0000 7f55aba5b640 1 -- 10.20.193.5:0/1111460164 wait complete. 2026-02-17T21:25:40.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.182+0000 7f55aba5b640 10 monclient: build_initial_monmap 2026-02-17T21:25:40.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.182+0000 7f55aba5b640 10 monclient: monmap: 2026-02-17T21:25:40.203 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:40.203 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:40.203 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:40.203 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:40.203 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:40.203 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:40.203 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:40.203 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:40.204 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:40.204 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:40.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.182+0000 7f55aba5b640 1 librados: starting msgr at 2026-02-17T21:25:40.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.182+0000 7f55aba5b640 1 librados: starting objecter 2026-02-17T21:25:40.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.182+0000 7f55aba5b640 1 Processor -- start 2026-02-17T21:25:40.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.182+0000 7f55aba5b640 1 -- start start 2026-02-17T21:25:40.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.182+0000 7f55aba5b640 1 librados: setting wanted keys 2026-02-17T21:25:40.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.182+0000 7f55aba5b640 1 librados: calling monclient init 2026-02-17T21:25:40.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.182+0000 7f55aba5b640 10 monclient: init 2026-02-17T21:25:40.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55aba5b640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:40.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55aba5b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:25:40.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55aba5b640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f558c005040 0x7f55a41f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:40.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55aba5b640 10 monclient(hunting): picked mon.noname-c con 0x7f558c005040 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:40.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55aba5b640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f55a41f5360 0x7f55a40c3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:40.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55aba5b640 10 monclient(hunting): picked mon.noname-a con 0x7f55a41f5360 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:40.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55aba5b640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f55a40c39a0 0x7f55a41f1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:40.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55aba5b640 10 monclient(hunting): picked mon.noname-b con 0x7f55a40c39a0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:40.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55aba5b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:40.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55aba5b640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f55a40c7ee0 con 0x7f55a41f5360 2026-02-17T21:25:40.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55aba5b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:40.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55aba5b640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f55a40c8530 con 0x7f55a40c39a0 2026-02-17T21:25:40.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55aba5b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:40.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55aba5b640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f55a40c81c0 con 0x7f558c005040 2026-02-17T21:25:40.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55aba5b640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:40.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55aba5b640 10 monclient(hunting): authenticate will time out at 1045.748392s 2026-02-17T21:25:40.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55a97d0640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f558c005040 0x7f55a41f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:40.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55a97d0640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f558c005040 0x7f55a41f4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:54670/0 (socket says 10.20.193.5:54670) 2026-02-17T21:25:40.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55a97d0640 1 -- 10.20.193.5:0/2178634897 learned_addr learned my addr 10.20.193.5:0/2178634897 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:40.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55a9fd1640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f55a40c39a0 0x7f55a41f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:40.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55a97d0640 10 monclient(hunting): get_auth_request con 0x7f558c005040 auth_method 0 2026-02-17T21:25:40.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55a97d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:40.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55a97d0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:40.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55a8fcf640 1 --2- 10.20.193.5:0/2178634897 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f55a41f5360 0x7f55a40c3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:40.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55a97d0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:40.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55a8fcf640 10 monclient(hunting): get_auth_request con 0x7f55a41f5360 auth_method 0 2026-02-17T21:25:40.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55a8fcf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:40.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55a8fcf640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:40.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55a8fcf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:40.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55a9fd1640 10 monclient(hunting): get_auth_request con 0x7f55a40c39a0 auth_method 0 2026-02-17T21:25:40.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55a9fd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:40.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55a9fd1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:40.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55a9fd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:40.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55a97d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:40.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55a97d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:40.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.183+0000 7f55a97d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:40.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.184+0000 7f55a8fcf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:40.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.184+0000 7f55a8fcf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:40.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.184+0000 7f55a8fcf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:40.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.184+0000 7f55a9fd1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:40.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.184+0000 7f55a9fd1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:40.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.184+0000 7f55a9fd1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:40.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.185+0000 7f55a97d0640 10 monclient(hunting): handle_auth_done global_id 4631 payload 824 2026-02-17T21:25:40.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.185+0000 7f55a97d0640 1 -- 10.20.193.5:0/2178634897 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f55a40c39a0 msgr2=0x7f55a41f1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.185+0000 7f55a97d0640 1 --2- 10.20.193.5:0/2178634897 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f55a40c39a0 0x7f55a41f1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.185+0000 7f55a97d0640 1 -- 10.20.193.5:0/2178634897 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f55a41f5360 msgr2=0x7f55a40c3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.185+0000 7f55a97d0640 1 --2- 10.20.193.5:0/2178634897 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f55a41f5360 0x7f55a40c3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.185+0000 7f55a97d0640 10 monclient: _finish_hunting 0 2026-02-17T21:25:40.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.185+0000 7f55a97d0640 1 monclient: found mon.noname-c 2026-02-17T21:25:40.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.185+0000 7f55a97d0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:40.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.185+0000 7f55a97d0640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:40.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.185+0000 7f55a97d0640 1 -- 10.20.193.5:0/2178634897 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a40c2710 con 0x7f558c005040 2026-02-17T21:25:40.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.186+0000 7f55a97d0640 1 --2- 10.20.193.5:0/2178634897 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f558c005040 0x7f55a41f4e20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f559400c260 tx=0x7f55a40c5720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:40.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.186+0000 7f5591ffb640 10 client.?.objecter ms_handle_connect 0x7f558c005040 2026-02-17T21:25:40.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.186+0000 7f5591ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:40.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.187+0000 7f5591ffb640 1 -- 10.20.193.5:0/2178634897 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55940032f0 con 0x7f558c005040 2026-02-17T21:25:40.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.187+0000 7f5591ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:40.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.187+0000 7f5591ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:40.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.187+0000 7f5591ffb640 10 monclient: dump: 2026-02-17T21:25:40.209 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:40.209 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:40.209 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.209 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.209 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:40.209 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:40.209 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:40.209 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:40.209 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:40.209 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:40.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.187+0000 7f5591ffb640 10 monclient: _finish_auth 0 2026-02-17T21:25:40.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.187+0000 7f5591ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:25:40.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.187+0000 7f5591ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:40.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.187+0000 7f5591ffb640 1 -- 10.20.193.5:0/2178634897 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5594007070 con 0x7f558c005040 2026-02-17T21:25:40.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.187+0000 7f55aba5b640 5 monclient: authenticate success, global_id 4631 2026-02-17T21:25:40.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.187+0000 7f55aba5b640 10 monclient: _renew_subs 2026-02-17T21:25:40.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.187+0000 7f55aba5b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:40.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.187+0000 7f55aba5b640 1 -- 10.20.193.5:0/2178634897 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55a4155bf0 con 0x7f558c005040 2026-02-17T21:25:40.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.187+0000 7f5591ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:40.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.187+0000 7f5591ffb640 1 -- 10.20.193.5:0/2178634897 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5594007440 con 0x7f558c005040 2026-02-17T21:25:40.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.187+0000 7f5591ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:40.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.187+0000 7f5591ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:40.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.187+0000 7f55937fe640 4 set_mon_vals no callback set 2026-02-17T21:25:40.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.187+0000 7f5591ffb640 10 monclient: dump: 2026-02-17T21:25:40.210 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:40.210 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:40.210 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.210 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.210 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:40.211 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:40.211 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:40.211 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:40.211 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:40.211 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:40.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.187+0000 7f55aba5b640 10 client.4631.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:40.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.187+0000 7f55aba5b640 10 monclient: _renew_subs 2026-02-17T21:25:40.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.187+0000 7f55aba5b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:40.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.187+0000 7f55aba5b640 1 -- 10.20.193.5:0/2178634897 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55a40c2c60 con 0x7f558c005040 2026-02-17T21:25:40.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.187+0000 7f55aba5b640 1 librados: init done 2026-02-17T21:25:40.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.188+0000 7f55aba5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:40.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.188+0000 7f55aba5b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:40.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.188+0000 7f55aba5b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:40.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.188+0000 7f55aba5b640 1 -- 10.20.193.5:0/2178634897 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55a40c8e70 con 0x7f558c005040 2026-02-17T21:25:40.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.199+0000 7f5591ffb640 1 -- 10.20.193.5:0/2178634897 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f55940075e0 con 0x7f558c005040 2026-02-17T21:25:40.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.199+0000 7f5591ffb640 1 --2- 10.20.193.5:0/2178634897 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f55740792d0 0x7f557407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:40.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.199+0000 7f55a8fcf640 1 --2- 10.20.193.5:0/2178634897 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f55740792d0 0x7f557407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:40.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.200+0000 7f55a8fcf640 10 monclient: get_auth_request con 0x7f55740792d0 auth_method 0 2026-02-17T21:25:40.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.200+0000 7f5591ffb640 10 client.4631.objecter ms_handle_connect 0x7f55740792d0 2026-02-17T21:25:40.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.200+0000 7f55a8fcf640 1 --2- 10.20.193.5:0/2178634897 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f55740792d0 0x7f557407b790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f55a4074570 tx=0x7f5598007dc0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:40.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.200+0000 7f5591ffb640 1 -- 10.20.193.5:0/2178634897 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f559404adb0 con 0x7f558c005040 2026-02-17T21:25:40.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.200+0000 7f5591ffb640 10 client.4631.objecter ms_dispatch2 0x7f55a4000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:40.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.200+0000 7f5591ffb640 3 client.4631.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:40.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.200+0000 7f5591ffb640 3 client.4631.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:40.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.200+0000 7f5591ffb640 20 client.4631.objecter dump_active .. 0 homeless 2026-02-17T21:25:40.303 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.301+0000 7f5591ffb640 1 -- 10.20.193.5:0/2178634897 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5594086e30 con 0x7f558c005040 2026-02-17T21:25:40.303 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.301+0000 7f5591ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:40.303 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.301+0000 7f5591ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:40.387 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.386+0000 7f55aba5b640 1 -- 10.20.193.5:0/2178634897 --> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f55a40cd160 con 0x7f55740792d0 2026-02-17T21:25:40.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.387+0000 7f5591ffb640 1 -- 10.20.193.5:0/2178634897 <== mgr.4131 v2:10.20.193.176:6800/2898618020 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+44199 (secure 0 0 0) 0x7f55a40cd160 con 0x7f55740792d0 2026-02-17T21:25:40.389 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:25:40.391 INFO:teuthology.orchestra.run.trial005.stderr:dumped all 2026-02-17T21:25:40.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.388+0000 7f55aba5b640 10 librados: watch_flush enter 2026-02-17T21:25:40.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.388+0000 7f55aba5b640 10 librados: watch_flush exit 2026-02-17T21:25:40.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.388+0000 7f55aba5b640 20 client.4631.objecter shutdown clearing up homeless session... 2026-02-17T21:25:40.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.388+0000 7f55aba5b640 10 client.4631.objecter successfully canceled tick 2026-02-17T21:25:40.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.388+0000 7f55aba5b640 1 -- 10.20.193.5:0/2178634897 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f55740792d0 msgr2=0x7f557407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.388+0000 7f55aba5b640 1 --2- 10.20.193.5:0/2178634897 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f55740792d0 0x7f557407b790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f55a4074570 tx=0x7f5598007dc0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.388+0000 7f55aba5b640 10 monclient: shutdown 2026-02-17T21:25:40.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.388+0000 7f55aba5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:40.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.388+0000 7f55aba5b640 1 -- 10.20.193.5:0/2178634897 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f558c005040 msgr2=0x7f55a41f4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.388+0000 7f55aba5b640 1 --2- 10.20.193.5:0/2178634897 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f558c005040 0x7f55a41f4e20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f559400c260 tx=0x7f55a40c5720 comp rx=0 tx=0).stop 2026-02-17T21:25:40.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.388+0000 7f55aba5b640 1 -- 10.20.193.5:0/2178634897 shutdown_connections 2026-02-17T21:25:40.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.388+0000 7f55aba5b640 1 --2- 10.20.193.5:0/2178634897 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f55740792d0 0x7f557407b790 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.388+0000 7f55aba5b640 1 --2- 10.20.193.5:0/2178634897 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f55a40c39a0 0x7f55a41f1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.388+0000 7f55aba5b640 1 --2- 10.20.193.5:0/2178634897 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f55a41f5360 0x7f55a40c3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.388+0000 7f55aba5b640 1 --2- 10.20.193.5:0/2178634897 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f558c005040 0x7f55a41f4e20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.388+0000 7f55aba5b640 1 -- 10.20.193.5:0/2178634897 >> 10.20.193.5:0/2178634897 conn(0x7f55a40c9f40 msgr2=0x7f55a40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:40.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.388+0000 7f55aba5b640 1 -- 10.20.193.5:0/2178634897 shutdown_connections 2026-02-17T21:25:40.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.388+0000 7f55aba5b640 1 -- 10.20.193.5:0/2178634897 wait complete. 2026-02-17T21:25:40.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.388+0000 7f55aba5b640 1 librados: shutdown 2026-02-17T21:25:40.398 INFO:teuthology.orchestra.run.trial005.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2026-02-17T21:25:39.512018+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":10,"kb":1509949440,"kb_used":438208,"kb_used_data":6488,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511232,"statfs":{"total":1546188226560,"available":1545739501568,"internally_reserved":0,"allocated":6643712,"data_stored":3281382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25504,"internal_metadata":441424992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":131107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":18,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.729705"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T21:25:34.688050+0000","last_change":"2026-02-17T21:25:34.688050+0000","last_active":"2026-02-17T21:25:34.688050+0000","last_peered":"2026-02-17T21:25:34.688050+0000","last_clean":"2026-02-17T21:25:34.688050+0000","last_became_active":"2026-02-17T21:25:32.292871+0000","last_became_peered":"2026-02-17T21:25:32.292871+0000","last_unstale":"2026-02-17T21:25:34.688050+0000","last_undegraded":"2026-02-17T21:25:34.688050+0000","last_fullsized":"2026-02-17T21:25:34.688050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T01:55:40.877834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038010112999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T21:25:34.941994+0000","last_change":"2026-02-17T21:25:34.963519+0000","last_active":"2026-02-17T21:25:34.941994+0000","last_peered":"2026-02-17T21:25:34.941994+0000","last_clean":"2026-02-17T21:25:34.941994+0000","last_became_active":"2026-02-17T21:25:31.984749+0000","last_became_peered":"2026-02-17T21:25:31.984749+0000","last_unstale":"2026-02-17T21:25:34.941994+0000","last_undegraded":"2026-02-17T21:25:34.941994+0000","last_fullsized":"2026-02-17T21:25:34.941994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:03:42.411486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037066832000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T21:25:35.008224+0000","last_change":"2026-02-17T21:25:35.008224+0000","last_active":"2026-02-17T21:25:35.008224+0000","last_peered":"2026-02-17T21:25:35.008224+0000","last_clean":"2026-02-17T21:25:35.008224+0000","last_became_active":"2026-02-17T21:25:32.229048+0000","last_became_peered":"2026-02-17T21:25:32.229048+0000","last_unstale":"2026-02-17T21:25:35.008224+0000","last_undegraded":"2026-02-17T21:25:35.008224+0000","last_fullsized":"2026-02-17T21:25:35.008224+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T09:14:11.573578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.041957774000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T21:25:36.600643+0000","last_change":"2026-02-17T21:25:36.620455+0000","last_active":"2026-02-17T21:25:36.600643+0000","last_peered":"2026-02-17T21:25:36.600643+0000","last_clean":"2026-02-17T21:25:36.600643+0000","last_became_active":"2026-02-17T21:25:32.009122+0000","last_became_peered":"2026-02-17T21:25:32.009122+0000","last_unstale":"2026-02-17T21:25:36.600643+0000","last_undegraded":"2026-02-17T21:25:36.600643+0000","last_fullsized":"2026-02-17T21:25:36.600643+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:02:56.485559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032898110000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T21:25:34.968868+0000","last_change":"2026-02-17T21:25:34.887379+0000","last_active":"2026-02-17T21:25:34.968868+0000","last_peered":"2026-02-17T21:25:34.968868+0000","last_clean":"2026-02-17T21:25:34.968868+0000","last_became_active":"2026-02-17T21:25:32.016451+0000","last_became_peered":"2026-02-17T21:25:32.016451+0000","last_unstale":"2026-02-17T21:25:34.968868+0000","last_undegraded":"2026-02-17T21:25:34.968868+0000","last_fullsized":"2026-02-17T21:25:34.968868+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:05:51.937857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046646930000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T21:25:34.719483+0000","last_change":"2026-02-17T21:25:34.719483+0000","last_active":"2026-02-17T21:25:34.719483+0000","last_peered":"2026-02-17T21:25:34.719483+0000","last_clean":"2026-02-17T21:25:34.719483+0000","last_became_active":"2026-02-17T21:25:31.944529+0000","last_became_peered":"2026-02-17T21:25:31.944529+0000","last_unstale":"2026-02-17T21:25:34.719483+0000","last_undegraded":"2026-02-17T21:25:34.719483+0000","last_fullsized":"2026-02-17T21:25:34.719483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T02:38:03.529141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030826864999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T21:25:34.893210+0000","last_change":"2026-02-17T21:25:34.893210+0000","last_active":"2026-02-17T21:25:34.893210+0000","last_peered":"2026-02-17T21:25:34.893210+0000","last_clean":"2026-02-17T21:25:34.893210+0000","last_became_active":"2026-02-17T21:25:31.969947+0000","last_became_peered":"2026-02-17T21:25:31.969947+0000","last_unstale":"2026-02-17T21:25:34.893210+0000","last_undegraded":"2026-02-17T21:25:34.893210+0000","last_fullsized":"2026-02-17T21:25:34.893210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:26:53.468392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063724551000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"32'1","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T21:25:34.347523+0000","last_change":"2026-02-17T21:25:34.347523+0000","last_active":"2026-02-17T21:25:34.347523+0000","last_peered":"2026-02-17T21:25:34.347523+0000","last_clean":"2026-02-17T21:25:34.347523+0000","last_became_active":"2026-02-17T21:25:31.956011+0000","last_became_peered":"2026-02-17T21:25:31.956011+0000","last_unstale":"2026-02-17T21:25:34.347523+0000","last_undegraded":"2026-02-17T21:25:34.347523+0000","last_fullsized":"2026-02-17T21:25:34.347523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:12:18.319913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036103899000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,15],"acting":[4,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"34'32","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T21:25:34.971220+0000","last_change":"2026-02-17T21:25:26.799130+0000","last_active":"2026-02-17T21:25:34.971220+0000","last_peered":"2026-02-17T21:25:34.971220+0000","last_clean":"2026-02-17T21:25:34.971220+0000","last_became_active":"2026-02-17T21:25:26.779982+0000","last_became_peered":"2026-02-17T21:25:26.779982+0000","last_unstale":"2026-02-17T21:25:34.971220+0000","last_undegraded":"2026-02-17T21:25:34.971220+0000","last_fullsized":"2026-02-17T21:25:34.971220+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:19.732550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:19.732550+0000","last_clean_scrub_stamp":"2026-02-17T21:25:19.732550+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T02:49:12.060591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":28,"seq":120259084295,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":364544,"data_stored":155354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":28,"seq":120259084296,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27324,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":364544,"data_stored":155354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27589058},"hb_peers":[0,1,3,4,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":28,"seq":120259084295,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":765952,"data_stored":553194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[2,4,5,6,7,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":364544,"data_stored":155354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[" osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":24,"seq":103079215110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27324,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":364544,"data_stored":155354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,4,5,6,7,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":5,"up_from":22,"seq":94489280519,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":364544,"data_stored":155354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,4,6,7,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27324,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":364544,"data_stored":155354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27589068},"hb_peers":[3,4,5,6,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":11,"up_from":23,"seq":98784247814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":364544,"data_stored":155354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27589061},"hb_peers":[0,2,5,6,7,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":24,"seq":103079215109,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":364544,"data_stored":155354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,5,6,7,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":26,"seq":111669149703,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":364544,"data_stored":155354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,4,5,6,7,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":12,"up_from":24,"seq":103079215110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":364544,"data_stored":155354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,5,6,7,9,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":26,"seq":111669149705,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":368640,"data_stored":155373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[3,5,6,7,8,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117001,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":368640,"data_stored":155373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[2,4,5,6,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":27,"seq":115964117001,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":364544,"data_stored":155354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,4,5,7,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":28,"seq":120259084296,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":765952,"data_stored":553194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,4,5,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084295,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":364544,"data_stored":155354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T21:25:40.400 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T21:25:40.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.467+0000 7f390f15b640 10 monclient: get_monmap_and_config 2026-02-17T21:25:40.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.467+0000 7f390f15b640 10 monclient: build_initial_monmap 2026-02-17T21:25:40.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.467+0000 7f390f15b640 10 monclient: monmap: 2026-02-17T21:25:40.474 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:40.474 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:40.475 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:40.468292+0000 2026-02-17T21:25:40.475 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:40.468292+0000 2026-02-17T21:25:40.475 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:40.475 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:40.475 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:40.475 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:40.475 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:40.476 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:40.476 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:40.476 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:40.476 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:40.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.468+0000 7f390f15b640 1 Processor -- start 2026-02-17T21:25:40.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.468+0000 7f390f15b640 1 -- start start 2026-02-17T21:25:40.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.468+0000 7f390f15b640 10 monclient: init 2026-02-17T21:25:40.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.468+0000 7f390f15b640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:40.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.468+0000 7f390f15b640 10 monclient: _add_conns ranks=[2,4,0,5,1,3] 2026-02-17T21:25:40.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.468+0000 7f390f15b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f390814f280 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:40.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.468+0000 7f390f15b640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f390814f660 0x7f39080c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:40.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.468+0000 7f390f15b640 10 monclient(hunting): picked mon.noname-b con 0x7f390814f660 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:40.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.468+0000 7f390f15b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f390815abc0 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:40.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.468+0000 7f390f15b640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39080c7390 con 0x7f390815abc0 2026-02-17T21:25:40.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.468+0000 7f390f15b640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39080c7670 con 0x7f390814f280 2026-02-17T21:25:40.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.468+0000 7f390f15b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:40.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.468+0000 7f390f15b640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f39080c7950 con 0x7f390814f660 2026-02-17T21:25:40.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.468+0000 7f390f15b640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:40.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.468+0000 7f390f15b640 10 monclient(hunting): authenticate will time out at 1046.033715s 2026-02-17T21:25:40.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.469+0000 7f390d6d1640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f390815abc0 0x7f390815afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:37658/0 (socket says 10.20.193.5:37658) 2026-02-17T21:25:40.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.469+0000 7f390ced0640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f390814f280 0x7f39080c7e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:47756/0 (socket says 10.20.193.5:47756) 2026-02-17T21:25:40.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.469+0000 7f390d6d1640 1 -- 10.20.193.5:0/1670540484 learned_addr learned my addr 10.20.193.5:0/1670540484 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:40.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.469+0000 7f38fffff640 1 --2- 10.20.193.5:0/1670540484 >> v2:10.20.193.119:3300/0 conn(0x7f390814f660 0x7f39080c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:40.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.469+0000 7f38fffff640 10 monclient(hunting): get_auth_request con 0x7f390814f660 auth_method 0 2026-02-17T21:25:40.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.469+0000 7f38fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:40.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.469+0000 7f38fffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:40.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.469+0000 7f38fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:40.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.469+0000 7f38fffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:40.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.469+0000 7f38fffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:40.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.469+0000 7f38fffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:40.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.470+0000 7f38ff7fe640 1 -- 10.20.193.5:0/1670540484 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 992305668 0 0) 0x7f39080c7390 con 0x7f390815abc0 2026-02-17T21:25:40.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.470+0000 7f38ff7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:25:40.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.470+0000 7f38ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:40.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.470+0000 7f38ff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:40.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.470+0000 7f38ff7fe640 10 monclient(hunting): my global_id is 4584 2026-02-17T21:25:40.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.470+0000 7f38ff7fe640 1 -- 10.20.193.5:0/1670540484 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38f40058b0 con 0x7f390815abc0 2026-02-17T21:25:40.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.470+0000 7f38ff7fe640 1 -- 10.20.193.5:0/1670540484 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2393297315 0 0) 0x7f39080c7670 con 0x7f390814f280 2026-02-17T21:25:40.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.470+0000 7f38ff7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:25:40.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.470+0000 7f38ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:40.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.470+0000 7f38ff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:40.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.470+0000 7f38ff7fe640 10 monclient(hunting): my global_id is 4634 2026-02-17T21:25:40.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.470+0000 7f38ff7fe640 1 -- 10.20.193.5:0/1670540484 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39080c7390 con 0x7f390814f280 2026-02-17T21:25:40.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.470+0000 7f38fffff640 10 monclient(hunting): handle_auth_done global_id 4603 payload 274 2026-02-17T21:25:40.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.470+0000 7f38fffff640 1 -- 10.20.193.5:0/1670540484 >> v1:10.20.193.135:6789/0 conn(0x7f390814f280 legacy=0x7f39080c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.470+0000 7f38fffff640 1 -- 10.20.193.5:0/1670540484 >> v1:10.20.193.5:6789/0 conn(0x7f390815abc0 legacy=0x7f390815afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.470+0000 7f38fffff640 10 monclient: _finish_hunting 0 2026-02-17T21:25:40.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.470+0000 7f38fffff640 1 monclient: found mon.noname-b 2026-02-17T21:25:40.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.470+0000 7f38fffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:40.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.470+0000 7f38fffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:40.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.470+0000 7f38fffff640 1 -- 10.20.193.5:0/1670540484 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390815a0e0 con 0x7f390814f660 2026-02-17T21:25:40.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.471+0000 7f38fffff640 1 --2- 10.20.193.5:0/1670540484 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f390814f660 0x7f39080c6a00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f38f00098a0 tx=0x7f38f002ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0bbf99a2713ad2c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:40.494 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.473+0000 7f38ff7fe640 1 -- 10.20.193.5:0/1670540484 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f003c070 con 0x7f390814f660 2026-02-17T21:25:40.494 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.473+0000 7f38ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:40.495 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.473+0000 7f38ff7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:40.495 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.473+0000 7f38ff7fe640 10 monclient: dump: 2026-02-17T21:25:40.495 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:40.495 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:40.495 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.495 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.495 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:40.495 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:40.495 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:40.496 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:40.496 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:40.496 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:40.496 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.473+0000 7f38ff7fe640 10 monclient: _finish_auth 0 2026-02-17T21:25:40.496 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.473+0000 7f38ff7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:25:40.496 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.473+0000 7f38ff7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:40.496 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.473+0000 7f38ff7fe640 1 -- 10.20.193.5:0/1670540484 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f002fc10 con 0x7f390814f660 2026-02-17T21:25:40.496 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.473+0000 7f38ff7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:40.496 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.473+0000 7f390f15b640 5 monclient: authenticate success, global_id 4603 2026-02-17T21:25:40.496 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.473+0000 7f38ff7fe640 1 -- 10.20.193.5:0/1670540484 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f0037440 con 0x7f390814f660 2026-02-17T21:25:40.496 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.473+0000 7f390f15b640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:40.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.473+0000 7f390f15b640 4 set_mon_vals no callback set 2026-02-17T21:25:40.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.473+0000 7f38ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:40.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.473+0000 7f38ff7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:40.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.473+0000 7f38ff7fe640 10 monclient: dump: 2026-02-17T21:25:40.497 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:40.497 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:40.497 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.497 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.497 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:40.497 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:40.497 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:40.498 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:40.498 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:40.498 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:40.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.473+0000 7f390f15b640 10 monclient: shutdown 2026-02-17T21:25:40.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.473+0000 7f390f15b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:40.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.473+0000 7f390f15b640 1 -- 10.20.193.5:0/1670540484 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f390814f660 msgr2=0x7f39080c6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.473+0000 7f390f15b640 1 --2- 10.20.193.5:0/1670540484 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f390814f660 0x7f39080c6a00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f38f00098a0 tx=0x7f38f002ef00 comp rx=0 tx=0).stop 2026-02-17T21:25:40.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.473+0000 7f390f15b640 1 -- 10.20.193.5:0/1670540484 shutdown_connections 2026-02-17T21:25:40.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.473+0000 7f390f15b640 1 --2- 10.20.193.5:0/1670540484 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f390814f660 0x7f39080c6a00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.473+0000 7f390f15b640 1 -- 10.20.193.5:0/1670540484 >> 10.20.193.5:0/1670540484 conn(0x7f39080c9f20 msgr2=0x7f39080ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:40.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.473+0000 7f390f15b640 1 -- 10.20.193.5:0/1670540484 shutdown_connections 2026-02-17T21:25:40.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.473+0000 7f390f15b640 1 -- 10.20.193.5:0/1670540484 wait complete. 2026-02-17T21:25:40.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.474+0000 7f390f15b640 10 monclient: build_initial_monmap 2026-02-17T21:25:40.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.474+0000 7f390f15b640 10 monclient: monmap: 2026-02-17T21:25:40.499 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:40.499 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:40.499 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:40.499 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:40.499 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:40.499 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:40.500 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:40.500 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:40.500 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:40.500 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:40.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.474+0000 7f390f15b640 1 librados: starting msgr at 2026-02-17T21:25:40.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.474+0000 7f390f15b640 1 librados: starting objecter 2026-02-17T21:25:40.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.474+0000 7f390f15b640 1 Processor -- start 2026-02-17T21:25:40.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.474+0000 7f390f15b640 1 -- start start 2026-02-17T21:25:40.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.474+0000 7f390f15b640 1 librados: setting wanted keys 2026-02-17T21:25:40.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.474+0000 7f390f15b640 1 librados: calling monclient init 2026-02-17T21:25:40.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.474+0000 7f390f15b640 10 monclient: init 2026-02-17T21:25:40.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390f15b640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:40.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390f15b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:25:40.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390f15b640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f390814f280 0x7f39080c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:40.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390f15b640 10 monclient(hunting): picked mon.noname-b con 0x7f390814f280 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:40.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390f15b640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f390814f660 0x7f39081549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:40.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390f15b640 10 monclient(hunting): picked mon.noname-c con 0x7f390814f660 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:40.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390f15b640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f390815abc0 0x7f390814cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:40.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390f15b640 10 monclient(hunting): picked mon.noname-a con 0x7f390815abc0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:40.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390f15b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:40.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390f15b640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f39080c9b70 con 0x7f390815abc0 2026-02-17T21:25:40.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390f15b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:40.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390f15b640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f390815a730 con 0x7f390814f280 2026-02-17T21:25:40.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390f15b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:40.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390f15b640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f39080c9cf0 con 0x7f390814f660 2026-02-17T21:25:40.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390f15b640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:40.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390f15b640 10 monclient(hunting): authenticate will time out at 1046.040282s 2026-02-17T21:25:40.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390ced0640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f390814f280 0x7f39080c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:40.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390d6d1640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f390815abc0 0x7f390814cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:40.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f38fffff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f390814f660 0x7f39081549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:40.503 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390ced0640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f390814f280 0x7f39080c3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:60362/0 (socket says 10.20.193.5:60362) 2026-02-17T21:25:40.503 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390ced0640 1 -- 10.20.193.5:0/732309555 learned_addr learned my addr 10.20.193.5:0/732309555 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:40.503 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390ced0640 10 monclient(hunting): get_auth_request con 0x7f390814f280 auth_method 0 2026-02-17T21:25:40.503 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390ced0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:40.503 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390ced0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:40.503 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390ced0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:40.503 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390d6d1640 10 monclient(hunting): get_auth_request con 0x7f390815abc0 auth_method 0 2026-02-17T21:25:40.503 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390d6d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:40.503 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390d6d1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:40.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390d6d1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:40.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f38fffff640 10 monclient(hunting): get_auth_request con 0x7f390814f660 auth_method 0 2026-02-17T21:25:40.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f38fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:40.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f38fffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:40.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f38fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:40.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390ced0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:40.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390ced0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:40.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.475+0000 7f390ced0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:40.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.476+0000 7f390d6d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:40.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.476+0000 7f390d6d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:40.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.476+0000 7f390d6d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:40.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.476+0000 7f38fffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:40.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.476+0000 7f38fffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:40.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.476+0000 7f38fffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:40.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.477+0000 7f390ced0640 10 monclient(hunting): handle_auth_done global_id 4606 payload 824 2026-02-17T21:25:40.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.477+0000 7f390ced0640 1 -- 10.20.193.5:0/732309555 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f390814f660 msgr2=0x7f39081549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.477+0000 7f390ced0640 1 --2- 10.20.193.5:0/732309555 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f390814f660 0x7f39081549b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.477+0000 7f390ced0640 1 -- 10.20.193.5:0/732309555 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f390815abc0 msgr2=0x7f390814cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.477+0000 7f390ced0640 1 --2- 10.20.193.5:0/732309555 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f390815abc0 0x7f390814cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.477+0000 7f390ced0640 10 monclient: _finish_hunting 0 2026-02-17T21:25:40.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.477+0000 7f390ced0640 1 monclient: found mon.noname-b 2026-02-17T21:25:40.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.477+0000 7f390ced0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:40.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.477+0000 7f390ced0640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:40.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.477+0000 7f390ced0640 1 -- 10.20.193.5:0/732309555 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39080730b0 con 0x7f390814f280 2026-02-17T21:25:40.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.478+0000 7f390ced0640 1 --2- 10.20.193.5:0/732309555 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f390814f280 0x7f39080c3e00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f38f800c500 tx=0x7f38f800c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:40.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.478+0000 7f38fd7fa640 10 client.?.objecter ms_handle_connect 0x7f390814f280 2026-02-17T21:25:40.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.478+0000 7f38fd7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:40.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.479+0000 7f38fd7fa640 1 -- 10.20.193.5:0/732309555 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f8017070 con 0x7f390814f280 2026-02-17T21:25:40.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.479+0000 7f38fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:40.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.479+0000 7f38fd7fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:40.507 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.479+0000 7f38fd7fa640 10 monclient: dump: 2026-02-17T21:25:40.507 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:40.507 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:40.507 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.507 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.507 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:40.507 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:40.507 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:40.507 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:40.507 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:40.508 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:40.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.479+0000 7f38fd7fa640 10 monclient: _finish_auth 0 2026-02-17T21:25:40.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.479+0000 7f38fd7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:25:40.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.479+0000 7f38fd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:40.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.479+0000 7f390f15b640 5 monclient: authenticate success, global_id 4606 2026-02-17T21:25:40.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.479+0000 7f390f15b640 10 monclient: _renew_subs 2026-02-17T21:25:40.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.479+0000 7f390f15b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:40.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.479+0000 7f390f15b640 1 -- 10.20.193.5:0/732309555 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3908073370 con 0x7f390814f280 2026-02-17T21:25:40.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.479+0000 7f390f15b640 10 client.4606.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:40.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.479+0000 7f390f15b640 10 monclient: _renew_subs 2026-02-17T21:25:40.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.479+0000 7f390f15b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:40.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.479+0000 7f390f15b640 1 -- 10.20.193.5:0/732309555 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3908073930 con 0x7f390814f280 2026-02-17T21:25:40.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.479+0000 7f390f15b640 1 librados: init done 2026-02-17T21:25:40.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.479+0000 7f38fd7fa640 1 -- 10.20.193.5:0/732309555 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f8005d20 con 0x7f390814f280 2026-02-17T21:25:40.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.479+0000 7f38fd7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:40.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.479+0000 7f38fd7fa640 1 -- 10.20.193.5:0/732309555 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f8021060 con 0x7f390814f280 2026-02-17T21:25:40.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.479+0000 7f38fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:40.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.479+0000 7f38fd7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:40.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.479+0000 7f38feffd640 4 set_mon_vals no callback set 2026-02-17T21:25:40.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.479+0000 7f38fd7fa640 10 monclient: dump: 2026-02-17T21:25:40.509 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:40.509 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:40.509 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.510 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.510 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:40.510 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:40.510 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:40.510 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:40.510 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:40.510 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:40.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.480+0000 7f390f15b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:40.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.480+0000 7f390f15b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:40.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.480+0000 7f390f15b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:40.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.480+0000 7f390f15b640 1 -- 10.20.193.5:0/732309555 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f390815afe0 con 0x7f390814f280 2026-02-17T21:25:40.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.585+0000 7f38fd7fa640 1 -- 10.20.193.5:0/732309555 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f38f8024080 con 0x7f390814f280 2026-02-17T21:25:40.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.585+0000 7f38fd7fa640 1 --2- 10.20.193.5:0/732309555 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f38d8079280 0x7f38d807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:40.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.585+0000 7f38fffff640 1 --2- 10.20.193.5:0/732309555 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f38d8079280 0x7f38d807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:40.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.585+0000 7f38fffff640 10 monclient: get_auth_request con 0x7f38d8079280 auth_method 0 2026-02-17T21:25:40.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.586+0000 7f38fffff640 1 --2- 10.20.193.5:0/732309555 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f38d8079280 0x7f38d807b740 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f38f0039000 tx=0x7f38f0033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:40.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.586+0000 7f38fd7fa640 10 client.4606.objecter ms_handle_connect 0x7f38d8079280 2026-02-17T21:25:40.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.586+0000 7f38fd7fa640 1 -- 10.20.193.5:0/732309555 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f38f805d850 con 0x7f390814f280 2026-02-17T21:25:40.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.586+0000 7f38fd7fa640 10 client.4606.objecter ms_dispatch2 0x7f3908000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:40.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.586+0000 7f38fd7fa640 3 client.4606.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:40.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.586+0000 7f38fd7fa640 3 client.4606.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:40.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.586+0000 7f38fd7fa640 20 client.4606.objecter dump_active .. 0 homeless 2026-02-17T21:25:40.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.592+0000 7f38fd7fa640 1 -- 10.20.193.5:0/732309555 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f38f8061810 con 0x7f390814f280 2026-02-17T21:25:40.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.592+0000 7f38fd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:40.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.592+0000 7f38fd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:40.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.676+0000 7f390f15b640 1 -- 10.20.193.5:0/732309555 --> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f39080c6810 con 0x7f38d8079280 2026-02-17T21:25:40.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.678+0000 7f38fd7fa640 1 -- 10.20.193.5:0/732309555 <== mgr.4131 v2:10.20.193.176:6800/2898618020 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+44199 (secure 0 0 0) 0x7f38f0051cc0 con 0x7f38d8079280 2026-02-17T21:25:40.679 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:25:40.679 INFO:teuthology.orchestra.run.trial005.stderr:dumped all 2026-02-17T21:25:40.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.679+0000 7f390f15b640 10 librados: watch_flush enter 2026-02-17T21:25:40.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.679+0000 7f390f15b640 10 librados: watch_flush exit 2026-02-17T21:25:40.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.679+0000 7f390f15b640 20 client.4606.objecter shutdown clearing up homeless session... 2026-02-17T21:25:40.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.679+0000 7f390f15b640 10 client.4606.objecter successfully canceled tick 2026-02-17T21:25:40.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.679+0000 7f390f15b640 1 -- 10.20.193.5:0/732309555 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f38d8079280 msgr2=0x7f38d807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.679+0000 7f390f15b640 1 --2- 10.20.193.5:0/732309555 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f38d8079280 0x7f38d807b740 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f38f0039000 tx=0x7f38f0033000 comp rx=0 tx=0).stop 2026-02-17T21:25:40.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.679+0000 7f390f15b640 10 monclient: shutdown 2026-02-17T21:25:40.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.679+0000 7f390f15b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:40.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.679+0000 7f390f15b640 1 -- 10.20.193.5:0/732309555 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f390814f280 msgr2=0x7f39080c3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.679+0000 7f390f15b640 1 --2- 10.20.193.5:0/732309555 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f390814f280 0x7f39080c3e00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f38f800c500 tx=0x7f38f800c9d0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.679+0000 7f390f15b640 1 -- 10.20.193.5:0/732309555 shutdown_connections 2026-02-17T21:25:40.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.679+0000 7f390f15b640 1 --2- 10.20.193.5:0/732309555 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f38d8079280 0x7f38d807b740 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.679+0000 7f390f15b640 1 --2- 10.20.193.5:0/732309555 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f390815abc0 0x7f390814cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.679+0000 7f390f15b640 1 --2- 10.20.193.5:0/732309555 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f390814f660 0x7f39081549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.679+0000 7f390f15b640 1 --2- 10.20.193.5:0/732309555 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f390814f280 0x7f39080c3e00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.679+0000 7f390f15b640 1 -- 10.20.193.5:0/732309555 >> 10.20.193.5:0/732309555 conn(0x7f39080c9f20 msgr2=0x7f390814d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:40.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.679+0000 7f390f15b640 1 -- 10.20.193.5:0/732309555 shutdown_connections 2026-02-17T21:25:40.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.679+0000 7f390f15b640 1 -- 10.20.193.5:0/732309555 wait complete. 2026-02-17T21:25:40.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.679+0000 7f390f15b640 1 librados: shutdown 2026-02-17T21:25:40.689 INFO:teuthology.orchestra.run.trial005.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2026-02-17T21:25:39.512018+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":10,"kb":1509949440,"kb_used":438208,"kb_used_data":6488,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511232,"statfs":{"total":1546188226560,"available":1545739501568,"internally_reserved":0,"allocated":6643712,"data_stored":3281382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25504,"internal_metadata":441424992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":131107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":18,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.729705"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T21:25:34.688050+0000","last_change":"2026-02-17T21:25:34.688050+0000","last_active":"2026-02-17T21:25:34.688050+0000","last_peered":"2026-02-17T21:25:34.688050+0000","last_clean":"2026-02-17T21:25:34.688050+0000","last_became_active":"2026-02-17T21:25:32.292871+0000","last_became_peered":"2026-02-17T21:25:32.292871+0000","last_unstale":"2026-02-17T21:25:34.688050+0000","last_undegraded":"2026-02-17T21:25:34.688050+0000","last_fullsized":"2026-02-17T21:25:34.688050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T01:55:40.877834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038010112999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T21:25:34.941994+0000","last_change":"2026-02-17T21:25:34.963519+0000","last_active":"2026-02-17T21:25:34.941994+0000","last_peered":"2026-02-17T21:25:34.941994+0000","last_clean":"2026-02-17T21:25:34.941994+0000","last_became_active":"2026-02-17T21:25:31.984749+0000","last_became_peered":"2026-02-17T21:25:31.984749+0000","last_unstale":"2026-02-17T21:25:34.941994+0000","last_undegraded":"2026-02-17T21:25:34.941994+0000","last_fullsized":"2026-02-17T21:25:34.941994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:03:42.411486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037066832000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T21:25:35.008224+0000","last_change":"2026-02-17T21:25:35.008224+0000","last_active":"2026-02-17T21:25:35.008224+0000","last_peered":"2026-02-17T21:25:35.008224+0000","last_clean":"2026-02-17T21:25:35.008224+0000","last_became_active":"2026-02-17T21:25:32.229048+0000","last_became_peered":"2026-02-17T21:25:32.229048+0000","last_unstale":"2026-02-17T21:25:35.008224+0000","last_undegraded":"2026-02-17T21:25:35.008224+0000","last_fullsized":"2026-02-17T21:25:35.008224+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T09:14:11.573578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.041957774000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T21:25:36.600643+0000","last_change":"2026-02-17T21:25:36.620455+0000","last_active":"2026-02-17T21:25:36.600643+0000","last_peered":"2026-02-17T21:25:36.600643+0000","last_clean":"2026-02-17T21:25:36.600643+0000","last_became_active":"2026-02-17T21:25:32.009122+0000","last_became_peered":"2026-02-17T21:25:32.009122+0000","last_unstale":"2026-02-17T21:25:36.600643+0000","last_undegraded":"2026-02-17T21:25:36.600643+0000","last_fullsized":"2026-02-17T21:25:36.600643+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:02:56.485559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032898110000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T21:25:34.968868+0000","last_change":"2026-02-17T21:25:34.887379+0000","last_active":"2026-02-17T21:25:34.968868+0000","last_peered":"2026-02-17T21:25:34.968868+0000","last_clean":"2026-02-17T21:25:34.968868+0000","last_became_active":"2026-02-17T21:25:32.016451+0000","last_became_peered":"2026-02-17T21:25:32.016451+0000","last_unstale":"2026-02-17T21:25:34.968868+0000","last_undegraded":"2026-02-17T21:25:34.968868+0000","last_fullsized":"2026-02-17T21:25:34.968868+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:05:51.937857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046646930000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T21:25:34.719483+0000","last_change":"2026-02-17T21:25:34.719483+0000","last_active":"2026-02-17T21:25:34.719483+0000","last_peered":"2026-02-17T21:25:34.719483+0000","last_clean":"2026-02-17T21:25:34.719483+0000","last_became_active":"2026-02-17T21:25:31.944529+0000","last_became_peered":"2026-02-17T21:25:31.944529+0000","last_unstale":"2026-02-17T21:25:34.719483+0000","last_undegraded":"2026-02-17T21:25:34.719483+0000","last_fullsized":"2026-02-17T21:25:34.719483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T02:38:03.529141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030826864999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T21:25:34.893210+0000","last_change":"2026-02-17T21:25:34.893210+0000","last_active":"2026-02-17T21:25:34.893210+0000","last_peered":"2026-02-17T21:25:34.893210+0000","last_clean":"2026-02-17T21:25:34.893210+0000","last_became_active":"2026-02-17T21:25:31.969947+0000","last_became_peered":"2026-02-17T21:25:31.969947+0000","last_unstale":"2026-02-17T21:25:34.893210+0000","last_undegraded":"2026-02-17T21:25:34.893210+0000","last_fullsized":"2026-02-17T21:25:34.893210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:26:53.468392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063724551000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"32'1","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T21:25:34.347523+0000","last_change":"2026-02-17T21:25:34.347523+0000","last_active":"2026-02-17T21:25:34.347523+0000","last_peered":"2026-02-17T21:25:34.347523+0000","last_clean":"2026-02-17T21:25:34.347523+0000","last_became_active":"2026-02-17T21:25:31.956011+0000","last_became_peered":"2026-02-17T21:25:31.956011+0000","last_unstale":"2026-02-17T21:25:34.347523+0000","last_undegraded":"2026-02-17T21:25:34.347523+0000","last_fullsized":"2026-02-17T21:25:34.347523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:12:18.319913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036103899000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,15],"acting":[4,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"34'32","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T21:25:34.971220+0000","last_change":"2026-02-17T21:25:26.799130+0000","last_active":"2026-02-17T21:25:34.971220+0000","last_peered":"2026-02-17T21:25:34.971220+0000","last_clean":"2026-02-17T21:25:34.971220+0000","last_became_active":"2026-02-17T21:25:26.779982+0000","last_became_peered":"2026-02-17T21:25:26.779982+0000","last_unstale":"2026-02-17T21:25:34.971220+0000","last_undegraded":"2026-02-17T21:25:34.971220+0000","last_fullsized":"2026-02-17T21:25:34.971220+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:19.732550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:19.732550+0000","last_clean_scrub_stamp":"2026-02-17T21:25:19.732550+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T02:49:12.060591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":28,"seq":120259084295,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":364544,"data_stored":155354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":28,"seq":120259084296,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27324,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":364544,"data_stored":155354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27589058},"hb_peers":[0,1,3,4,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":28,"seq":120259084295,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":765952,"data_stored":553194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[2,4,5,6,7,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":364544,"data_stored":155354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[" osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":24,"seq":103079215110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27324,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":364544,"data_stored":155354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,4,5,6,7,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":5,"up_from":22,"seq":94489280519,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":364544,"data_stored":155354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,4,6,7,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27324,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":364544,"data_stored":155354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27589068},"hb_peers":[3,4,5,6,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":11,"up_from":23,"seq":98784247814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":364544,"data_stored":155354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27589061},"hb_peers":[0,2,5,6,7,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":24,"seq":103079215109,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":364544,"data_stored":155354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,5,6,7,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":26,"seq":111669149703,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":364544,"data_stored":155354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,4,5,6,7,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":12,"up_from":24,"seq":103079215110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":364544,"data_stored":155354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,5,6,7,9,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":26,"seq":111669149705,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":368640,"data_stored":155373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[3,5,6,7,8,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117001,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":368640,"data_stored":155373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[2,4,5,6,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":27,"seq":115964117001,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":364544,"data_stored":155354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,4,5,7,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":28,"seq":120259084296,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":765952,"data_stored":553194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,4,5,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084295,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":364544,"data_stored":155354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T21:25:40.691 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T21:25:40.691 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T21:25:40.692 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-17T21:25:40.692 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:25:40.760 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.758+0000 7f210ec6d640 10 monclient: get_monmap_and_config 2026-02-17T21:25:40.760 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.758+0000 7f210ec6d640 10 monclient: build_initial_monmap 2026-02-17T21:25:40.760 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.758+0000 7f210ec6d640 10 monclient: monmap: 2026-02-17T21:25:40.760 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:40.760 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:40.760 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:40.758856+0000 2026-02-17T21:25:40.760 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:40.758856+0000 2026-02-17T21:25:40.760 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:40.761 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:40.761 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:40.761 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:40.761 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:40.761 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:40.761 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:40.761 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:40.761 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:40.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.758+0000 7f210ec6d640 1 Processor -- start 2026-02-17T21:25:40.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.758+0000 7f210ec6d640 1 -- start start 2026-02-17T21:25:40.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.758+0000 7f210ec6d640 10 monclient: init 2026-02-17T21:25:40.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210ec6d640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:40.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210ec6d640 10 monclient: _add_conns ranks=[3,4,5,0,1,2] 2026-02-17T21:25:40.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210ec6d640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f210815d370 0x7f210815d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:40.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210ec6d640 10 monclient(hunting): picked mon.noname-a con 0x7f210815d370 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:40.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210ec6d640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f21080c7e20 0x7f21080c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:40.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210ec6d640 10 monclient(hunting): picked mon.noname-b con 0x7f21080c7e20 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:40.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210ec6d640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f210815b000 0x7f21080c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:40.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210ec6d640 10 monclient(hunting): picked mon.noname-c con 0x7f210815b000 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:40.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210ec6d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:40.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210ec6d640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f21080c9240 con 0x7f210815d370 2026-02-17T21:25:40.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210ec6d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:40.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210ec6d640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f21080c8350 con 0x7f21080c7e20 2026-02-17T21:25:40.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210ec6d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:40.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210ec6d640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f21080c8630 con 0x7f210815b000 2026-02-17T21:25:40.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210ec6d640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:40.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210ec6d640 10 monclient(hunting): authenticate will time out at 1046.324174s 2026-02-17T21:25:40.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f20fffff640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f21080c7e20 0x7f21080c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:40.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210d1e3640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f210815b000 0x7f21080c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:40.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210c9e2640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f210815d370 0x7f210815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:40.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f20fffff640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f21080c7e20 0x7f21080c74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:60366/0 (socket says 10.20.193.5:60366) 2026-02-17T21:25:40.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f20fffff640 1 -- 10.20.193.5:0/602386193 learned_addr learned my addr 10.20.193.5:0/602386193 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:40.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f20fffff640 10 monclient(hunting): get_auth_request con 0x7f21080c7e20 auth_method 0 2026-02-17T21:25:40.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f20fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:40.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f20fffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:40.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f20fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:40.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210d1e3640 10 monclient(hunting): get_auth_request con 0x7f210815b000 auth_method 0 2026-02-17T21:25:40.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210d1e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:40.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210d1e3640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:40.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210d1e3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:40.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210c9e2640 10 monclient(hunting): get_auth_request con 0x7f210815d370 auth_method 0 2026-02-17T21:25:40.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210c9e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:40.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210c9e2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:40.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.759+0000 7f210c9e2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:40.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.760+0000 7f20fffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:40.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.760+0000 7f20fffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:40.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.760+0000 7f20fffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:40.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.760+0000 7f210c9e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:40.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.760+0000 7f210c9e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:40.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.760+0000 7f210c9e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:40.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.760+0000 7f210d1e3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:40.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.760+0000 7f210d1e3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:40.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.760+0000 7f210d1e3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:40.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.760+0000 7f20fffff640 10 monclient(hunting): handle_auth_done global_id 4609 payload 274 2026-02-17T21:25:40.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.760+0000 7f20fffff640 1 -- 10.20.193.5:0/602386193 >> v2:10.20.193.135:3300/0 conn(0x7f210815b000 msgr2=0x7f21080c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:40.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.760+0000 7f20fffff640 1 --2- 10.20.193.5:0/602386193 >> v2:10.20.193.135:3300/0 conn(0x7f210815b000 0x7f21080c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.760+0000 7f20fffff640 1 -- 10.20.193.5:0/602386193 >> v2:10.20.193.5:3300/0 conn(0x7f210815d370 msgr2=0x7f210815d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:40.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.760+0000 7f20fffff640 1 --2- 10.20.193.5:0/602386193 >> v2:10.20.193.5:3300/0 conn(0x7f210815d370 0x7f210815d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.760+0000 7f20fffff640 10 monclient: _finish_hunting 0 2026-02-17T21:25:40.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.760+0000 7f20fffff640 1 monclient: found mon.noname-b 2026-02-17T21:25:40.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.760+0000 7f20fffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:40.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.760+0000 7f20fffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:40.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.760+0000 7f20fffff640 1 -- 10.20.193.5:0/602386193 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21080c8910 con 0x7f21080c7e20 2026-02-17T21:25:40.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.761+0000 7f20fffff640 1 --2- 10.20.193.5:0/602386193 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f21080c7e20 0x7f21080c74c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f210815d060 tx=0x7f20f002ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4afc78675e9917ef server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:40.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f20ff7fe640 1 -- 10.20.193.5:0/602386193 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f003c070 con 0x7f21080c7e20 2026-02-17T21:25:40.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f20ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:40.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f20ff7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:40.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f20ff7fe640 10 monclient: dump: 2026-02-17T21:25:40.774 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:40.774 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:40.774 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.775 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.775 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:40.775 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:40.775 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:40.775 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:40.775 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:40.775 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:40.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f20ff7fe640 10 monclient: _finish_auth 0 2026-02-17T21:25:40.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f20ff7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:25:40.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f20ff7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:40.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f20ff7fe640 1 -- 10.20.193.5:0/602386193 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f002fb50 con 0x7f21080c7e20 2026-02-17T21:25:40.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f20ff7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:40.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f20ff7fe640 1 -- 10.20.193.5:0/602386193 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0037440 con 0x7f21080c7e20 2026-02-17T21:25:40.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f20ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:40.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f20ff7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:40.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f20ff7fe640 10 monclient: dump: 2026-02-17T21:25:40.776 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:40.776 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:40.776 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.776 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.776 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:40.776 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:40.777 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:40.777 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:40.777 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:40.777 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:40.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f210ec6d640 5 monclient: authenticate success, global_id 4609 2026-02-17T21:25:40.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f210ec6d640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:40.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f210ec6d640 4 set_mon_vals no callback set 2026-02-17T21:25:40.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f210ec6d640 10 monclient: shutdown 2026-02-17T21:25:40.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f210ec6d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:40.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f210ec6d640 1 -- 10.20.193.5:0/602386193 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f21080c7e20 msgr2=0x7f21080c74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f210ec6d640 1 --2- 10.20.193.5:0/602386193 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f21080c7e20 0x7f21080c74c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f210815d060 tx=0x7f20f002ee90 comp rx=0 tx=0).stop 2026-02-17T21:25:40.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f210ec6d640 1 -- 10.20.193.5:0/602386193 shutdown_connections 2026-02-17T21:25:40.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f210ec6d640 1 --2- 10.20.193.5:0/602386193 >> v2:10.20.193.135:3300/0 conn(0x7f210815b000 0x7f21080c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f210ec6d640 1 --2- 10.20.193.5:0/602386193 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f21080c7e20 0x7f21080c74c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f210ec6d640 1 --2- 10.20.193.5:0/602386193 >> v2:10.20.193.5:3300/0 conn(0x7f210815d370 0x7f210815d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f210ec6d640 1 -- 10.20.193.5:0/602386193 >> 10.20.193.5:0/602386193 conn(0x7f21080c9f20 msgr2=0x7f21080ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:40.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f210ec6d640 1 -- 10.20.193.5:0/602386193 shutdown_connections 2026-02-17T21:25:40.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.763+0000 7f210ec6d640 1 -- 10.20.193.5:0/602386193 wait complete. 2026-02-17T21:25:40.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.764+0000 7f210ec6d640 10 monclient: build_initial_monmap 2026-02-17T21:25:40.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.764+0000 7f210ec6d640 10 monclient: monmap: 2026-02-17T21:25:40.778 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:40.778 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:40.778 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:40.779 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:40.779 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:40.779 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:40.779 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:40.779 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:40.779 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:40.779 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:40.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.764+0000 7f210ec6d640 1 librados: starting msgr at 2026-02-17T21:25:40.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.764+0000 7f210ec6d640 1 librados: starting objecter 2026-02-17T21:25:40.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.764+0000 7f210ec6d640 1 Processor -- start 2026-02-17T21:25:40.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.764+0000 7f210ec6d640 1 -- start start 2026-02-17T21:25:40.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.764+0000 7f210ec6d640 1 librados: setting wanted keys 2026-02-17T21:25:40.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.764+0000 7f210ec6d640 1 librados: calling monclient init 2026-02-17T21:25:40.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.764+0000 7f210ec6d640 10 monclient: init 2026-02-17T21:25:40.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210ec6d640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:40.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210ec6d640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:25:40.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210ec6d640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f21080c7e20 0x7f210814ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:40.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210ec6d640 10 monclient(hunting): picked mon.noname-c con 0x7f21080c7e20 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:40.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210ec6d640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f210815b000 0x7f2108073d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:40.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210ec6d640 10 monclient(hunting): picked mon.noname-b con 0x7f210815b000 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:40.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210ec6d640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f210815d370 0x7f210814c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:40.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210ec6d640 10 monclient(hunting): picked mon.noname-a con 0x7f210815d370 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:40.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210ec6d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:40.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210ec6d640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f21080c96d0 con 0x7f210815d370 2026-02-17T21:25:40.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210ec6d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:40.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210ec6d640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f21080c8ed0 con 0x7f210815b000 2026-02-17T21:25:40.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210ec6d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:40.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210ec6d640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f210806d280 con 0x7f21080c7e20 2026-02-17T21:25:40.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210ec6d640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:40.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210ec6d640 10 monclient(hunting): authenticate will time out at 1046.330095s 2026-02-17T21:25:40.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210d1e3640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f210815d370 0x7f210814c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:40.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f20fffff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f210815b000 0x7f2108073d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:40.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210c9e2640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f21080c7e20 0x7f210814ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:40.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f20fffff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f210815b000 0x7f2108073d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:60380/0 (socket says 10.20.193.5:60380) 2026-02-17T21:25:40.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f20fffff640 1 -- 10.20.193.5:0/2795040328 learned_addr learned my addr 10.20.193.5:0/2795040328 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:40.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f20fffff640 10 monclient(hunting): get_auth_request con 0x7f210815b000 auth_method 0 2026-02-17T21:25:40.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f20fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:40.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f20fffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:40.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f20fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:40.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210d1e3640 10 monclient(hunting): get_auth_request con 0x7f210815d370 auth_method 0 2026-02-17T21:25:40.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210d1e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:40.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210d1e3640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:40.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210d1e3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:40.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210c9e2640 10 monclient(hunting): get_auth_request con 0x7f21080c7e20 auth_method 0 2026-02-17T21:25:40.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210c9e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:40.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210c9e2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:40.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210c9e2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:40.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f20fffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:40.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f20fffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:40.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f20fffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:40.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210d1e3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:40.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210d1e3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:40.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210d1e3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:40.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210c9e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:40.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210c9e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:40.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.765+0000 7f210c9e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:40.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.767+0000 7f20fffff640 10 monclient(hunting): handle_auth_done global_id 4612 payload 824 2026-02-17T21:25:40.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.767+0000 7f20fffff640 1 -- 10.20.193.5:0/2795040328 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f21080c7e20 msgr2=0x7f210814ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.767+0000 7f20fffff640 1 --2- 10.20.193.5:0/2795040328 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f21080c7e20 0x7f210814ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.767+0000 7f20fffff640 1 -- 10.20.193.5:0/2795040328 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f210815d370 msgr2=0x7f210814c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.767+0000 7f20fffff640 1 --2- 10.20.193.5:0/2795040328 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f210815d370 0x7f210814c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.767+0000 7f20fffff640 10 monclient: _finish_hunting 0 2026-02-17T21:25:40.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.767+0000 7f20fffff640 1 monclient: found mon.noname-b 2026-02-17T21:25:40.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.767+0000 7f20fffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:40.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.767+0000 7f20fffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:40.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.767+0000 7f20fffff640 1 -- 10.20.193.5:0/2795040328 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f210806d4d0 con 0x7f210815b000 2026-02-17T21:25:40.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.768+0000 7f20fffff640 1 --2- 10.20.193.5:0/2795040328 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f210815b000 0x7f2108073d20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f20f002f3f0 tx=0x7f20f00047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:40.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.768+0000 7f20fd7fa640 10 client.?.objecter ms_handle_connect 0x7f210815b000 2026-02-17T21:25:40.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.768+0000 7f20fd7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:40.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f20fd7fa640 1 -- 10.20.193.5:0/2795040328 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f003c040 con 0x7f210815b000 2026-02-17T21:25:40.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f20fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:40.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f20fd7fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:40.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f20fd7fa640 10 monclient: dump: 2026-02-17T21:25:40.787 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:40.787 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:40.788 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.788 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.788 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:40.788 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:40.788 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:40.788 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:40.788 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:40.788 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:40.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f20fd7fa640 10 monclient: _finish_auth 0 2026-02-17T21:25:40.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f20fd7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:25:40.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f20fd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:40.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f210ec6d640 5 monclient: authenticate success, global_id 4612 2026-02-17T21:25:40.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f210ec6d640 10 monclient: _renew_subs 2026-02-17T21:25:40.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f210ec6d640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:40.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f210ec6d640 1 -- 10.20.193.5:0/2795040328 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f210806d7b0 con 0x7f210815b000 2026-02-17T21:25:40.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f210ec6d640 10 client.4612.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:40.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f210ec6d640 10 monclient: _renew_subs 2026-02-17T21:25:40.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f210ec6d640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:40.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f210ec6d640 1 -- 10.20.193.5:0/2795040328 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f210806dd70 con 0x7f210815b000 2026-02-17T21:25:40.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f210ec6d640 1 librados: init done 2026-02-17T21:25:40.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f20fd7fa640 1 -- 10.20.193.5:0/2795040328 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f002fb50 con 0x7f210815b000 2026-02-17T21:25:40.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f20fd7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:40.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f20fd7fa640 1 -- 10.20.193.5:0/2795040328 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0042630 con 0x7f210815b000 2026-02-17T21:25:40.790 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f20fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:40.790 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f20fd7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:40.790 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f20fd7fa640 10 monclient: dump: 2026-02-17T21:25:40.790 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:40.790 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:40.790 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.790 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:40.790 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:40.790 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:40.790 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:40.790 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:40.790 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:40.790 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:40.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f20feffd640 4 set_mon_vals no callback set 2026-02-17T21:25:40.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f210ec6d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:40.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f210ec6d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:40.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f210ec6d640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:40.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.769+0000 7f210ec6d640 1 -- 10.20.193.5:0/2795040328 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f210815b490 con 0x7f210815b000 2026-02-17T21:25:40.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.780+0000 7f20fd7fa640 1 -- 10.20.193.5:0/2795040328 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f20f00427d0 con 0x7f210815b000 2026-02-17T21:25:40.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.781+0000 7f20fd7fa640 1 --2- 10.20.193.5:0/2795040328 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f20d8079280 0x7f20d807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:40.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.781+0000 7f210c9e2640 1 --2- 10.20.193.5:0/2795040328 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f20d8079280 0x7f20d807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:40.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.781+0000 7f210c9e2640 10 monclient: get_auth_request con 0x7f20d8079280 auth_method 0 2026-02-17T21:25:40.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.781+0000 7f210c9e2640 1 --2- 10.20.193.5:0/2795040328 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f20d8079280 0x7f20d807b740 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f20f8009ba0 tx=0x7f20f8009290 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:40.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.781+0000 7f20fd7fa640 10 client.4612.objecter ms_handle_connect 0x7f20d8079280 2026-02-17T21:25:40.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.782+0000 7f20fd7fa640 1 -- 10.20.193.5:0/2795040328 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8972+0+0 (secure 0 0 0) 0x7f20f00bd3d0 con 0x7f210815b000 2026-02-17T21:25:40.792 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.782+0000 7f20fd7fa640 10 client.4612.objecter ms_dispatch2 0x7f2108000b90 osd_map(34..34 src has 1..34) 2026-02-17T21:25:40.792 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.782+0000 7f20fd7fa640 3 client.4612.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T21:25:40.792 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.782+0000 7f20fd7fa640 3 client.4612.objecter handle_osd_map decoding full epoch 34 2026-02-17T21:25:40.792 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.782+0000 7f20fd7fa640 20 client.4612.objecter dump_active .. 0 homeless 2026-02-17T21:25:40.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.880+0000 7f20fd7fa640 1 -- 10.20.193.5:0/2795040328 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f20f0087a70 con 0x7f210815b000 2026-02-17T21:25:40.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.880+0000 7f20fd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:40.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.880+0000 7f20fd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:40.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.979+0000 7f210ec6d640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:25:40.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.979+0000 7f210ec6d640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:25:40.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.979+0000 7f210ec6d640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:40.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.979+0000 7f210ec6d640 1 -- 10.20.193.5:0/2795040328 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f210815cc10 con 0x7f210815b000 2026-02-17T21:25:40.985 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.984+0000 7f20fd7fa640 1 -- 10.20.193.5:0/2795040328 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f20f008bd70 con 0x7f210815b000 2026-02-17T21:25:40.985 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.984+0000 7f20fd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:25:40.985 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.984+0000 7f20fd7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:40.985 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:25:40.986 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:25:40.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.985+0000 7f210ec6d640 10 librados: watch_flush enter 2026-02-17T21:25:40.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.985+0000 7f210ec6d640 10 librados: watch_flush exit 2026-02-17T21:25:40.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.985+0000 7f210ec6d640 20 client.4612.objecter shutdown clearing up homeless session... 2026-02-17T21:25:40.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.985+0000 7f210ec6d640 10 client.4612.objecter successfully canceled tick 2026-02-17T21:25:40.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.985+0000 7f210ec6d640 1 -- 10.20.193.5:0/2795040328 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f20d8079280 msgr2=0x7f20d807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.985+0000 7f210ec6d640 1 --2- 10.20.193.5:0/2795040328 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f20d8079280 0x7f20d807b740 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f20f8009ba0 tx=0x7f20f8009290 comp rx=0 tx=0).stop 2026-02-17T21:25:40.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.985+0000 7f210ec6d640 10 monclient: shutdown 2026-02-17T21:25:40.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.985+0000 7f210ec6d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:40.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.985+0000 7f210ec6d640 1 -- 10.20.193.5:0/2795040328 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f210815b000 msgr2=0x7f2108073d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:40.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.985+0000 7f210ec6d640 1 --2- 10.20.193.5:0/2795040328 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f210815b000 0x7f2108073d20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f20f002f3f0 tx=0x7f20f00047c0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.985+0000 7f210ec6d640 1 -- 10.20.193.5:0/2795040328 shutdown_connections 2026-02-17T21:25:40.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.985+0000 7f210ec6d640 1 --2- 10.20.193.5:0/2795040328 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f20d8079280 0x7f20d807b740 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.985+0000 7f210ec6d640 1 --2- 10.20.193.5:0/2795040328 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f210815d370 0x7f210814c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.985+0000 7f210ec6d640 1 --2- 10.20.193.5:0/2795040328 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f210815b000 0x7f2108073d20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.985+0000 7f210ec6d640 1 --2- 10.20.193.5:0/2795040328 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f21080c7e20 0x7f210814ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:40.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.985+0000 7f210ec6d640 1 -- 10.20.193.5:0/2795040328 >> 10.20.193.5:0/2795040328 conn(0x7f21080c9f20 msgr2=0x7f2108150f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:40.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.985+0000 7f210ec6d640 1 -- 10.20.193.5:0/2795040328 shutdown_connections 2026-02-17T21:25:40.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.985+0000 7f210ec6d640 1 -- 10.20.193.5:0/2795040328 wait complete. 2026-02-17T21:25:40.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:40.985+0000 7f210ec6d640 1 librados: shutdown 2026-02-17T21:25:43.996 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:25:44.066 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.064+0000 7fc2fede7640 10 monclient: get_monmap_and_config 2026-02-17T21:25:44.066 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.064+0000 7fc2fede7640 10 monclient: build_initial_monmap 2026-02-17T21:25:44.066 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.064+0000 7fc2fede7640 10 monclient: monmap: 2026-02-17T21:25:44.066 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:44.066 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:44.066 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:44.064779+0000 2026-02-17T21:25:44.066 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:44.064779+0000 2026-02-17T21:25:44.066 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:44.067 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:44.067 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:44.067 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:44.067 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:44.067 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:44.067 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:44.067 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:44.067 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:44.067 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.064+0000 7fc2fede7640 1 Processor -- start 2026-02-17T21:25:44.067 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.064+0000 7fc2fede7640 1 -- start start 2026-02-17T21:25:44.067 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.064+0000 7fc2fede7640 10 monclient: init 2026-02-17T21:25:44.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2fede7640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:44.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2fede7640 10 monclient: _add_conns ranks=[3,4,2,5,0,1] 2026-02-17T21:25:44.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2fede7640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fc2f80c7170 0x7fc2f80c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:44.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2fede7640 10 monclient(hunting): picked mon.noname-a con 0x7fc2f80c7170 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:44.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2fede7640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fc2f80c48c0 0x7fc2f80749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:44.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2fede7640 10 monclient(hunting): picked mon.noname-b con 0x7fc2f80c48c0 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:44.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2fede7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc2f8074ef0 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:44.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2fede7640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2f815a9a0 con 0x7fc2f8074ef0 2026-02-17T21:25:44.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2fede7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:44.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2fede7640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc2f80c8530 con 0x7fc2f80c7170 2026-02-17T21:25:44.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2fede7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:44.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2fede7640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fc2f80c5270 con 0x7fc2f80c48c0 2026-02-17T21:25:44.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2fede7640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:44.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2fede7640 10 monclient(hunting): authenticate will time out at 1049.630098s 2026-02-17T21:25:44.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2fd35d640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7fc2f8074ef0 0x7fc2f80c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:47764/0 (socket says 10.20.193.5:47764) 2026-02-17T21:25:44.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2fd35d640 1 -- 10.20.193.5:0/1287852745 learned_addr learned my addr 10.20.193.5:0/1287852745 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:44.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2fcb5c640 1 --2- 10.20.193.5:0/1287852745 >> v2:10.20.193.5:3300/0 conn(0x7fc2f80c7170 0x7fc2f80c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:44.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2effff640 1 --2- 10.20.193.5:0/1287852745 >> v2:10.20.193.119:3300/0 conn(0x7fc2f80c48c0 0x7fc2f80749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:44.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2fcb5c640 10 monclient(hunting): get_auth_request con 0x7fc2f80c7170 auth_method 0 2026-02-17T21:25:44.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2fcb5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:44.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2fcb5c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:44.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2fcb5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:44.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2effff640 10 monclient(hunting): get_auth_request con 0x7fc2f80c48c0 auth_method 0 2026-02-17T21:25:44.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:44.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2effff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:44.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.065+0000 7fc2effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:44.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.066+0000 7fc2fcb5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:44.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.066+0000 7fc2fcb5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:44.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.066+0000 7fc2fcb5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:44.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.066+0000 7fc2effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:44.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.066+0000 7fc2effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:44.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.066+0000 7fc2effff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:44.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.067+0000 7fc2ef7fe640 1 -- 10.20.193.5:0/1287852745 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2395293534 0 0) 0x7fc2f815a9a0 con 0x7fc2f8074ef0 2026-02-17T21:25:44.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.067+0000 7fc2ef7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:25:44.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.067+0000 7fc2ef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:44.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.067+0000 7fc2ef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:44.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.067+0000 7fc2ef7fe640 10 monclient(hunting): my global_id is 4646 2026-02-17T21:25:44.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.067+0000 7fc2ef7fe640 1 -- 10.20.193.5:0/1287852745 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2e4003620 con 0x7fc2f8074ef0 2026-02-17T21:25:44.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.067+0000 7fc2fcb5c640 10 monclient(hunting): handle_auth_done global_id 4596 payload 274 2026-02-17T21:25:44.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.067+0000 7fc2fcb5c640 1 -- 10.20.193.5:0/1287852745 >> v2:10.20.193.119:3300/0 conn(0x7fc2f80c48c0 msgr2=0x7fc2f80749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:44.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.067+0000 7fc2fcb5c640 1 --2- 10.20.193.5:0/1287852745 >> v2:10.20.193.119:3300/0 conn(0x7fc2f80c48c0 0x7fc2f80749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:44.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.067+0000 7fc2fcb5c640 1 -- 10.20.193.5:0/1287852745 >> v1:10.20.193.135:6789/0 conn(0x7fc2f8074ef0 legacy=0x7fc2f80c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:44.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.067+0000 7fc2fcb5c640 10 monclient: _finish_hunting 0 2026-02-17T21:25:44.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.067+0000 7fc2fcb5c640 1 monclient: found mon.noname-a 2026-02-17T21:25:44.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.067+0000 7fc2fcb5c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:44.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.067+0000 7fc2fcb5c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:44.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.067+0000 7fc2fcb5c640 1 -- 10.20.193.5:0/1287852745 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f80c5550 con 0x7fc2f80c7170 2026-02-17T21:25:44.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.067+0000 7fc2fcb5c640 1 --2- 10.20.193.5:0/1287852745 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc2f80c7170 0x7fc2f80c7550 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80c7a90 tx=0x7fc2e802ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33838f18b641e05e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:44.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.069+0000 7fc2ef7fe640 1 -- 10.20.193.5:0/1287852745 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e803c070 con 0x7fc2f80c7170 2026-02-17T21:25:44.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.069+0000 7fc2ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:44.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.069+0000 7fc2ef7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:44.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.069+0000 7fc2ef7fe640 10 monclient: dump: 2026-02-17T21:25:44.080 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:44.080 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:44.080 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:44.080 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:44.081 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:44.081 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:44.081 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:44.081 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:44.081 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:44.081 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:44.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.069+0000 7fc2ef7fe640 10 monclient: _finish_auth 0 2026-02-17T21:25:44.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.069+0000 7fc2ef7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:25:44.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.069+0000 7fc2ef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:44.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.069+0000 7fc2ef7fe640 1 -- 10.20.193.5:0/1287852745 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2e802faf0 con 0x7fc2f80c7170 2026-02-17T21:25:44.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.069+0000 7fc2fede7640 5 monclient: authenticate success, global_id 4596 2026-02-17T21:25:44.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.069+0000 7fc2ef7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:44.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.069+0000 7fc2ef7fe640 1 -- 10.20.193.5:0/1287852745 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8037440 con 0x7fc2f80c7170 2026-02-17T21:25:44.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.069+0000 7fc2fede7640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:44.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.069+0000 7fc2fede7640 4 set_mon_vals no callback set 2026-02-17T21:25:44.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.069+0000 7fc2ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:44.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.069+0000 7fc2ef7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:44.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.069+0000 7fc2ef7fe640 10 monclient: dump: 2026-02-17T21:25:44.082 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:44.082 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:44.082 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:44.082 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:44.082 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:44.083 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:44.083 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:44.083 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:44.083 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:44.083 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:44.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.069+0000 7fc2fede7640 10 monclient: shutdown 2026-02-17T21:25:44.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.069+0000 7fc2fede7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:44.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.069+0000 7fc2fede7640 1 -- 10.20.193.5:0/1287852745 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc2f80c7170 msgr2=0x7fc2f80c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:44.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.069+0000 7fc2fede7640 1 --2- 10.20.193.5:0/1287852745 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc2f80c7170 0x7fc2f80c7550 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80c7a90 tx=0x7fc2e802ede0 comp rx=0 tx=0).stop 2026-02-17T21:25:44.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.070+0000 7fc2fede7640 1 -- 10.20.193.5:0/1287852745 shutdown_connections 2026-02-17T21:25:44.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.070+0000 7fc2fede7640 1 --2- 10.20.193.5:0/1287852745 >> v2:10.20.193.119:3300/0 conn(0x7fc2f80c48c0 0x7fc2f80749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:44.084 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.070+0000 7fc2fede7640 1 --2- 10.20.193.5:0/1287852745 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc2f80c7170 0x7fc2f80c7550 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:44.084 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.070+0000 7fc2fede7640 1 -- 10.20.193.5:0/1287852745 >> 10.20.193.5:0/1287852745 conn(0x7fc2f80c9f40 msgr2=0x7fc2f80ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:44.084 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.070+0000 7fc2fede7640 1 -- 10.20.193.5:0/1287852745 shutdown_connections 2026-02-17T21:25:44.084 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.070+0000 7fc2fede7640 1 -- 10.20.193.5:0/1287852745 wait complete. 2026-02-17T21:25:44.084 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.070+0000 7fc2fede7640 10 monclient: build_initial_monmap 2026-02-17T21:25:44.084 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.070+0000 7fc2fede7640 10 monclient: monmap: 2026-02-17T21:25:44.084 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:44.084 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:44.084 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:44.084 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:44.084 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:44.084 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:44.085 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:44.085 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:44.085 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:44.085 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:44.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.070+0000 7fc2fede7640 1 librados: starting msgr at 2026-02-17T21:25:44.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.070+0000 7fc2fede7640 1 librados: starting objecter 2026-02-17T21:25:44.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.070+0000 7fc2fede7640 1 Processor -- start 2026-02-17T21:25:44.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.070+0000 7fc2fede7640 1 -- start start 2026-02-17T21:25:44.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.070+0000 7fc2fede7640 1 librados: setting wanted keys 2026-02-17T21:25:44.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.070+0000 7fc2fede7640 1 librados: calling monclient init 2026-02-17T21:25:44.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.070+0000 7fc2fede7640 10 monclient: init 2026-02-17T21:25:44.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fede7640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:44.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fede7640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:25:44.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fede7640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc2f8074ef0 0x7fc2f806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:44.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fede7640 10 monclient(hunting): picked mon.noname-b con 0x7fc2f8074ef0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:44.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fede7640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc2f80c48c0 0x7fc2f81f1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:44.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fede7640 10 monclient(hunting): picked mon.noname-a con 0x7fc2f80c48c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:44.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fede7640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc2f80c7170 0x7fc2f81f2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:44.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fede7640 10 monclient(hunting): picked mon.noname-c con 0x7fc2f80c7170 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:44.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fede7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:44.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fede7640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f80c81c0 con 0x7fc2f80c48c0 2026-02-17T21:25:44.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fede7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:44.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fede7640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f80c7ee0 con 0x7fc2f8074ef0 2026-02-17T21:25:44.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fede7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:44.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fede7640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f80c90d0 con 0x7fc2f80c7170 2026-02-17T21:25:44.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fede7640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:44.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fede7640 10 monclient(hunting): authenticate will time out at 1049.636211s 2026-02-17T21:25:44.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fd35d640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc2f80c7170 0x7fc2f81f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:44.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fcb5c640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc2f8074ef0 0x7fc2f806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:44.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2effff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc2f80c48c0 0x7fc2f81f1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:44.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fd35d640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc2f80c7170 0x7fc2f81f2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:54708/0 (socket says 10.20.193.5:54708) 2026-02-17T21:25:44.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fd35d640 1 -- 10.20.193.5:0/3371286573 learned_addr learned my addr 10.20.193.5:0/3371286573 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:44.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fd35d640 10 monclient(hunting): get_auth_request con 0x7fc2f80c7170 auth_method 0 2026-02-17T21:25:44.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fd35d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:44.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fd35d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:44.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fd35d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:44.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2effff640 10 monclient(hunting): get_auth_request con 0x7fc2f80c48c0 auth_method 0 2026-02-17T21:25:44.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:44.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2effff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:44.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:44.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fcb5c640 10 monclient(hunting): get_auth_request con 0x7fc2f8074ef0 auth_method 0 2026-02-17T21:25:44.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fcb5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:44.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fcb5c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:44.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fcb5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:44.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fd35d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:44.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fd35d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:44.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.071+0000 7fc2fd35d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:44.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.072+0000 7fc2fcb5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:44.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.072+0000 7fc2fcb5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:44.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.072+0000 7fc2fcb5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:44.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.072+0000 7fc2effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:44.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.072+0000 7fc2effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:44.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.072+0000 7fc2effff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:44.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.073+0000 7fc2fd35d640 10 monclient(hunting): handle_auth_done global_id 4649 payload 824 2026-02-17T21:25:44.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.073+0000 7fc2fd35d640 1 -- 10.20.193.5:0/3371286573 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc2f8074ef0 msgr2=0x7fc2f806e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:44.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.073+0000 7fc2fd35d640 1 --2- 10.20.193.5:0/3371286573 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc2f8074ef0 0x7fc2f806e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:44.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.073+0000 7fc2fd35d640 1 -- 10.20.193.5:0/3371286573 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc2f80c48c0 msgr2=0x7fc2f81f1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:44.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.073+0000 7fc2fd35d640 1 --2- 10.20.193.5:0/3371286573 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc2f80c48c0 0x7fc2f81f1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:44.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.073+0000 7fc2fd35d640 10 monclient: _finish_hunting 0 2026-02-17T21:25:44.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.073+0000 7fc2fd35d640 1 monclient: found mon.noname-c 2026-02-17T21:25:44.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.073+0000 7fc2fd35d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:44.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.073+0000 7fc2fd35d640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:44.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.073+0000 7fc2fd35d640 1 -- 10.20.193.5:0/3371286573 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f81f6650 con 0x7fc2f80c7170 2026-02-17T21:25:44.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.074+0000 7fc2fd35d640 1 --2- 10.20.193.5:0/3371286573 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc2f80c7170 0x7fc2f81f2030 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400cb70 tx=0x7fc2f400a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:44.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.074+0000 7fc2ed7fa640 10 client.?.objecter ms_handle_connect 0x7fc2f80c7170 2026-02-17T21:25:44.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.074+0000 7fc2ed7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:44.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.075+0000 7fc2ed7fa640 1 -- 10.20.193.5:0/3371286573 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f400ad50 con 0x7fc2f80c7170 2026-02-17T21:25:44.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.075+0000 7fc2ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:44.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.075+0000 7fc2ed7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:44.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.075+0000 7fc2ed7fa640 10 monclient: dump: 2026-02-17T21:25:44.092 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:44.092 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:44.092 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:44.092 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:44.092 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:44.092 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:44.093 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:44.093 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:44.093 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:44.093 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:44.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.075+0000 7fc2ed7fa640 10 monclient: _finish_auth 0 2026-02-17T21:25:44.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.075+0000 7fc2ed7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:25:44.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.075+0000 7fc2ed7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:44.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.075+0000 7fc2fede7640 5 monclient: authenticate success, global_id 4649 2026-02-17T21:25:44.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.075+0000 7fc2fede7640 10 monclient: _renew_subs 2026-02-17T21:25:44.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.075+0000 7fc2fede7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:44.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.075+0000 7fc2fede7640 1 -- 10.20.193.5:0/3371286573 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f81f5db0 con 0x7fc2f80c7170 2026-02-17T21:25:44.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.075+0000 7fc2fede7640 10 client.4649.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:44.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.075+0000 7fc2fede7640 10 monclient: _renew_subs 2026-02-17T21:25:44.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.075+0000 7fc2fede7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:44.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.075+0000 7fc2fede7640 1 -- 10.20.193.5:0/3371286573 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f81f6370 con 0x7fc2f80c7170 2026-02-17T21:25:44.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.075+0000 7fc2fede7640 1 librados: init done 2026-02-17T21:25:44.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.075+0000 7fc2fede7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:44.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.075+0000 7fc2fede7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:44.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.075+0000 7fc2fede7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:44.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.075+0000 7fc2fede7640 1 -- 10.20.193.5:0/3371286573 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2f80c4d10 con 0x7fc2f80c7170 2026-02-17T21:25:44.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.181+0000 7fc2ed7fa640 1 -- 10.20.193.5:0/3371286573 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f4025430 con 0x7fc2f80c7170 2026-02-17T21:25:44.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.181+0000 7fc2ed7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:44.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.181+0000 7fc2ed7fa640 1 -- 10.20.193.5:0/3371286573 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f40257e0 con 0x7fc2f80c7170 2026-02-17T21:25:44.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.181+0000 7fc2ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:44.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.181+0000 7fc2eeffd640 4 set_mon_vals no callback set 2026-02-17T21:25:44.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.181+0000 7fc2ed7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:44.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.181+0000 7fc2ed7fa640 10 monclient: dump: 2026-02-17T21:25:44.183 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:44.183 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:44.183 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:44.183 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:44.183 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:44.183 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:44.183 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:44.184 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:44.184 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:44.184 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:44.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.181+0000 7fc2ed7fa640 1 -- 10.20.193.5:0/3371286573 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fc2f4025a00 con 0x7fc2f80c7170 2026-02-17T21:25:44.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.182+0000 7fc2ed7fa640 1 --2- 10.20.193.5:0/3371286573 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc2c8079280 0x7fc2c807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:44.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.182+0000 7fc2fcb5c640 1 --2- 10.20.193.5:0/3371286573 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc2c8079280 0x7fc2c807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:44.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.182+0000 7fc2fcb5c640 10 monclient: get_auth_request con 0x7fc2c8079280 auth_method 0 2026-02-17T21:25:44.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.183+0000 7fc2fcb5c640 1 --2- 10.20.193.5:0/3371286573 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc2c8079280 0x7fc2c807b740 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8039000 tx=0x7fc2e8033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:44.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.183+0000 7fc2ed7fa640 10 client.4649.objecter ms_handle_connect 0x7fc2c8079280 2026-02-17T21:25:44.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.183+0000 7fc2ed7fa640 1 -- 10.20.193.5:0/3371286573 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fc2f4025d20 con 0x7fc2f80c7170 2026-02-17T21:25:44.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.183+0000 7fc2ed7fa640 10 client.4649.objecter ms_dispatch2 0x7fc2f8000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:25:44.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.183+0000 7fc2ed7fa640 3 client.4649.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:25:44.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.183+0000 7fc2ed7fa640 3 client.4649.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:25:44.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.183+0000 7fc2ed7fa640 20 client.4649.objecter dump_active .. 0 homeless 2026-02-17T21:25:44.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.189+0000 7fc2ed7fa640 1 -- 10.20.193.5:0/3371286573 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc2f4062c30 con 0x7fc2f80c7170 2026-02-17T21:25:44.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.189+0000 7fc2ed7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:44.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.189+0000 7fc2ed7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:44.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.288+0000 7fc2fede7640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:25:44.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.288+0000 7fc2fede7640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:25:44.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.288+0000 7fc2fede7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:44.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.288+0000 7fc2fede7640 1 -- 10.20.193.5:0/3371286573 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc2f815ac60 con 0x7fc2f80c7170 2026-02-17T21:25:44.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.292+0000 7fc2ed7fa640 1 -- 10.20.193.5:0/3371286573 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fc2f4066f30 con 0x7fc2f80c7170 2026-02-17T21:25:44.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.292+0000 7fc2ed7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:25:44.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.292+0000 7fc2ed7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:44.294 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:25:44.294 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:25:44.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.293+0000 7fc2fede7640 10 librados: watch_flush enter 2026-02-17T21:25:44.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.293+0000 7fc2fede7640 10 librados: watch_flush exit 2026-02-17T21:25:44.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.293+0000 7fc2fede7640 20 client.4649.objecter shutdown clearing up homeless session... 2026-02-17T21:25:44.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.293+0000 7fc2fede7640 10 client.4649.objecter successfully canceled tick 2026-02-17T21:25:44.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.293+0000 7fc2fede7640 1 -- 10.20.193.5:0/3371286573 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc2c8079280 msgr2=0x7fc2c807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:44.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.293+0000 7fc2fede7640 1 --2- 10.20.193.5:0/3371286573 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc2c8079280 0x7fc2c807b740 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8039000 tx=0x7fc2e8033000 comp rx=0 tx=0).stop 2026-02-17T21:25:44.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.293+0000 7fc2fede7640 10 monclient: shutdown 2026-02-17T21:25:44.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.293+0000 7fc2fede7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:44.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.293+0000 7fc2fede7640 1 -- 10.20.193.5:0/3371286573 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc2f80c7170 msgr2=0x7fc2f81f2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:44.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.293+0000 7fc2fede7640 1 --2- 10.20.193.5:0/3371286573 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc2f80c7170 0x7fc2f81f2030 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400cb70 tx=0x7fc2f400a430 comp rx=0 tx=0).stop 2026-02-17T21:25:44.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.293+0000 7fc2fede7640 1 -- 10.20.193.5:0/3371286573 shutdown_connections 2026-02-17T21:25:44.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.293+0000 7fc2fede7640 1 --2- 10.20.193.5:0/3371286573 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc2c8079280 0x7fc2c807b740 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:44.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.293+0000 7fc2fede7640 1 --2- 10.20.193.5:0/3371286573 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc2f80c7170 0x7fc2f81f2030 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:44.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.293+0000 7fc2fede7640 1 --2- 10.20.193.5:0/3371286573 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc2f80c48c0 0x7fc2f81f1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:44.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.293+0000 7fc2fede7640 1 --2- 10.20.193.5:0/3371286573 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc2f8074ef0 0x7fc2f806e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:44.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.293+0000 7fc2fede7640 1 -- 10.20.193.5:0/3371286573 >> 10.20.193.5:0/3371286573 conn(0x7fc2f80c9f40 msgr2=0x7fc2f80ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:44.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.293+0000 7fc2fede7640 1 -- 10.20.193.5:0/3371286573 shutdown_connections 2026-02-17T21:25:44.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.293+0000 7fc2fede7640 1 -- 10.20.193.5:0/3371286573 wait complete. 2026-02-17T21:25:44.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:44.293+0000 7fc2fede7640 1 librados: shutdown 2026-02-17T21:25:47.304 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:25:47.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.372+0000 7fb73752c640 10 monclient: get_monmap_and_config 2026-02-17T21:25:47.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.372+0000 7fb73752c640 10 monclient: build_initial_monmap 2026-02-17T21:25:47.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.372+0000 7fb73752c640 10 monclient: monmap: 2026-02-17T21:25:47.374 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:47.374 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:47.374 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:47.372861+0000 2026-02-17T21:25:47.374 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:47.372861+0000 2026-02-17T21:25:47.374 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:47.374 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:47.374 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:47.374 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:47.374 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:47.375 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:47.375 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:47.375 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:47.375 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:47.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.372+0000 7fb73752c640 1 Processor -- start 2026-02-17T21:25:47.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.372+0000 7fb73752c640 1 -- start start 2026-02-17T21:25:47.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.372+0000 7fb73752c640 10 monclient: init 2026-02-17T21:25:47.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.373+0000 7fb73752c640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:47.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.373+0000 7fb73752c640 10 monclient: _add_conns ranks=[3,5,4,1,2,0] 2026-02-17T21:25:47.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.373+0000 7fb73752c640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fb73015d370 0x7fb73015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:47.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.373+0000 7fb73752c640 10 monclient(hunting): picked mon.noname-a con 0x7fb73015d370 addr v2:10.20.193.5:3300/0 2026-02-17T21:25:47.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.373+0000 7fb73752c640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fb7300c7e20 0x7fb7300c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:47.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.373+0000 7fb73752c640 10 monclient(hunting): picked mon.noname-c con 0x7fb7300c7e20 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:47.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.373+0000 7fb73752c640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fb73015b000 0x7fb7300c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:47.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.373+0000 7fb73752c640 10 monclient(hunting): picked mon.noname-b con 0x7fb73015b000 addr v2:10.20.193.119:3300/0 2026-02-17T21:25:47.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.373+0000 7fb73752c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:47.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.373+0000 7fb73752c640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb7300c9240 con 0x7fb73015d370 2026-02-17T21:25:47.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.373+0000 7fb73752c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:47.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.373+0000 7fb73752c640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fb7300c8350 con 0x7fb73015b000 2026-02-17T21:25:47.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.373+0000 7fb73752c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:47.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.373+0000 7fb73752c640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb7300c8630 con 0x7fb7300c7e20 2026-02-17T21:25:47.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.373+0000 7fb73752c640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:47.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.373+0000 7fb73752c640 10 monclient(hunting): authenticate will time out at 1052.938272s 2026-02-17T21:25:47.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.373+0000 7fb7352a1640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fb73015d370 0x7fb73015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:47.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.373+0000 7fb7352a1640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fb73015d370 0x7fb73015d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:47730/0 (socket says 10.20.193.5:47730) 2026-02-17T21:25:47.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.373+0000 7fb7352a1640 1 -- 10.20.193.5:0/3228598786 learned_addr learned my addr 10.20.193.5:0/3228598786 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:47.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.373+0000 7fb7352a1640 10 monclient(hunting): get_auth_request con 0x7fb73015d370 auth_method 0 2026-02-17T21:25:47.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.373+0000 7fb7352a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:47.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.373+0000 7fb7352a1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:47.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.373+0000 7fb7352a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:47.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.374+0000 7fb7352a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:47.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.374+0000 7fb7352a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:47.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.374+0000 7fb735aa2640 1 --2- 10.20.193.5:0/3228598786 >> v2:10.20.193.119:3300/0 conn(0x7fb73015b000 0x7fb7300c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:47.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.374+0000 7fb7352a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:47.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.374+0000 7fb734aa0640 1 --2- 10.20.193.5:0/3228598786 >> v2:10.20.193.135:3300/0 conn(0x7fb7300c7e20 0x7fb7300c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:47.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.374+0000 7fb734aa0640 10 monclient(hunting): get_auth_request con 0x7fb7300c7e20 auth_method 0 2026-02-17T21:25:47.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.374+0000 7fb734aa0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:47.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.374+0000 7fb734aa0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:47.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.374+0000 7fb734aa0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:47.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.374+0000 7fb735aa2640 10 monclient(hunting): get_auth_request con 0x7fb73015b000 auth_method 0 2026-02-17T21:25:47.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.374+0000 7fb735aa2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:47.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.374+0000 7fb735aa2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:47.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.374+0000 7fb735aa2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:47.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.374+0000 7fb734aa0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:47.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.374+0000 7fb734aa0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:47.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.374+0000 7fb734aa0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:47.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.374+0000 7fb735aa2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:47.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.374+0000 7fb735aa2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:47.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.374+0000 7fb735aa2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:47.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.375+0000 7fb735aa2640 10 monclient(hunting): handle_auth_done global_id 4621 payload 274 2026-02-17T21:25:47.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.375+0000 7fb735aa2640 1 -- 10.20.193.5:0/3228598786 >> v2:10.20.193.135:3300/0 conn(0x7fb7300c7e20 msgr2=0x7fb7300c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:47.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.375+0000 7fb735aa2640 1 --2- 10.20.193.5:0/3228598786 >> v2:10.20.193.135:3300/0 conn(0x7fb7300c7e20 0x7fb7300c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:47.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.375+0000 7fb735aa2640 1 -- 10.20.193.5:0/3228598786 >> v2:10.20.193.5:3300/0 conn(0x7fb73015d370 msgr2=0x7fb73015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:47.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.375+0000 7fb735aa2640 1 --2- 10.20.193.5:0/3228598786 >> v2:10.20.193.5:3300/0 conn(0x7fb73015d370 0x7fb73015d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:47.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.375+0000 7fb735aa2640 10 monclient: _finish_hunting 0 2026-02-17T21:25:47.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.375+0000 7fb735aa2640 1 monclient: found mon.noname-b 2026-02-17T21:25:47.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.375+0000 7fb735aa2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:47.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.375+0000 7fb735aa2640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:47.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.375+0000 7fb735aa2640 1 -- 10.20.193.5:0/3228598786 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7300c8910 con 0x7fb73015b000 2026-02-17T21:25:47.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.375+0000 7fb734aa0640 1 --2- 10.20.193.5:0/3228598786 >> v2:10.20.193.135:3300/0 conn(0x7fb7300c7e20 0x7fb7300c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T21:25:47.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.376+0000 7fb735aa2640 1 --2- 10.20.193.5:0/3228598786 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb73015b000 0x7fb7300c52b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb73015dcf0 tx=0x7fb72c02f1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=179460b83e62b8ac server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:47.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb71ffff640 1 -- 10.20.193.5:0/3228598786 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c03c070 con 0x7fb73015b000 2026-02-17T21:25:47.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb71ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:47.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb71ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:47.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb71ffff640 10 monclient: dump: 2026-02-17T21:25:47.390 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:47.390 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:47.390 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:47.390 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:47.390 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:47.390 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:47.390 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:47.390 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:47.390 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:47.390 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:47.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb71ffff640 10 monclient: _finish_auth 0 2026-02-17T21:25:47.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb71ffff640 10 monclient: _check_auth_tickets 2026-02-17T21:25:47.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb71ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:47.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb71ffff640 1 -- 10.20.193.5:0/3228598786 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb72c02fe40 con 0x7fb73015b000 2026-02-17T21:25:47.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb73752c640 5 monclient: authenticate success, global_id 4621 2026-02-17T21:25:47.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb73752c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:47.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb71ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:47.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb71ffff640 1 -- 10.20.193.5:0/3228598786 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c037660 con 0x7fb73015b000 2026-02-17T21:25:47.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb73752c640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:47.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb73752c640 4 set_mon_vals no callback set 2026-02-17T21:25:47.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb71ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:47.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb71ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:47.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb71ffff640 10 monclient: dump: 2026-02-17T21:25:47.392 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:47.392 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:47.392 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:47.392 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:47.392 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:47.392 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:47.392 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:47.392 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:47.392 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:47.392 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:47.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb73752c640 10 monclient: shutdown 2026-02-17T21:25:47.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb73752c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:47.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb73752c640 1 -- 10.20.193.5:0/3228598786 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb73015b000 msgr2=0x7fb7300c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:47.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb73752c640 1 --2- 10.20.193.5:0/3228598786 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb73015b000 0x7fb7300c52b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb73015dcf0 tx=0x7fb72c02f1c0 comp rx=0 tx=0).stop 2026-02-17T21:25:47.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb73752c640 1 -- 10.20.193.5:0/3228598786 shutdown_connections 2026-02-17T21:25:47.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb73752c640 1 --2- 10.20.193.5:0/3228598786 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb73015b000 0x7fb7300c52b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:47.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb73752c640 1 --2- 10.20.193.5:0/3228598786 >> v2:10.20.193.135:3300/0 conn(0x7fb7300c7e20 0x7fb7300c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:47.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb73752c640 1 --2- 10.20.193.5:0/3228598786 >> v2:10.20.193.5:3300/0 conn(0x7fb73015d370 0x7fb73015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:47.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb73752c640 1 -- 10.20.193.5:0/3228598786 >> 10.20.193.5:0/3228598786 conn(0x7fb7300c9f20 msgr2=0x7fb7300ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:47.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb73752c640 1 -- 10.20.193.5:0/3228598786 shutdown_connections 2026-02-17T21:25:47.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.378+0000 7fb73752c640 1 -- 10.20.193.5:0/3228598786 wait complete. 2026-02-17T21:25:47.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.379+0000 7fb73752c640 10 monclient: build_initial_monmap 2026-02-17T21:25:47.394 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.379+0000 7fb73752c640 10 monclient: monmap: 2026-02-17T21:25:47.394 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:47.394 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:47.394 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:47.394 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:47.394 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:47.394 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:47.394 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:47.394 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:47.394 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:47.394 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:47.394 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.379+0000 7fb73752c640 1 librados: starting msgr at 2026-02-17T21:25:47.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.379+0000 7fb73752c640 1 librados: starting objecter 2026-02-17T21:25:47.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.379+0000 7fb73752c640 1 Processor -- start 2026-02-17T21:25:47.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.379+0000 7fb73752c640 1 -- start start 2026-02-17T21:25:47.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.379+0000 7fb73752c640 1 librados: setting wanted keys 2026-02-17T21:25:47.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.379+0000 7fb73752c640 1 librados: calling monclient init 2026-02-17T21:25:47.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.379+0000 7fb73752c640 10 monclient: init 2026-02-17T21:25:47.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.379+0000 7fb73752c640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:47.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.379+0000 7fb73752c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:25:47.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.379+0000 7fb73752c640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb7300c7e20 0x7fb7301f7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:47.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.379+0000 7fb73752c640 10 monclient(hunting): picked mon.noname-b con 0x7fb7300c7e20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:47.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.379+0000 7fb73752c640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb73015b000 0x7fb730158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:47.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.379+0000 7fb73752c640 10 monclient(hunting): picked mon.noname-c con 0x7fb73015b000 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:47.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.379+0000 7fb73752c640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb73015d370 0x7fb7300c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:47.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.379+0000 7fb73752c640 10 monclient(hunting): picked mon.noname-a con 0x7fb73015d370 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:47.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.379+0000 7fb73752c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:47.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.379+0000 7fb73752c640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb7300c96d0 con 0x7fb73015d370 2026-02-17T21:25:47.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.379+0000 7fb73752c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:47.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.379+0000 7fb73752c640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb7300c8ed0 con 0x7fb7300c7e20 2026-02-17T21:25:47.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.379+0000 7fb73752c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:47.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.379+0000 7fb73752c640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb7301f7740 con 0x7fb73015b000 2026-02-17T21:25:47.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.379+0000 7fb73752c640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:47.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.379+0000 7fb73752c640 10 monclient(hunting): authenticate will time out at 1052.944813s 2026-02-17T21:25:47.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.380+0000 7fb7352a1640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb7300c7e20 0x7fb7301f7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:47.397 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.380+0000 7fb734aa0640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb73015b000 0x7fb730158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:47.397 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.380+0000 7fb7352a1640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb7300c7e20 0x7fb7301f7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:37478/0 (socket says 10.20.193.5:37478) 2026-02-17T21:25:47.397 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.380+0000 7fb7352a1640 1 -- 10.20.193.5:0/3254851052 learned_addr learned my addr 10.20.193.5:0/3254851052 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:47.397 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.380+0000 7fb7352a1640 10 monclient(hunting): get_auth_request con 0x7fb7300c7e20 auth_method 0 2026-02-17T21:25:47.397 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.380+0000 7fb7352a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:47.397 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.380+0000 7fb7352a1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:47.397 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.380+0000 7fb7352a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:47.397 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.380+0000 7fb734aa0640 10 monclient(hunting): get_auth_request con 0x7fb73015b000 auth_method 0 2026-02-17T21:25:47.397 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.380+0000 7fb734aa0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:47.397 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.380+0000 7fb734aa0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:47.397 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.380+0000 7fb734aa0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:47.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.380+0000 7fb7352a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:47.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.380+0000 7fb7352a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:47.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.380+0000 7fb7352a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:47.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.380+0000 7fb734aa0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:47.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.380+0000 7fb734aa0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:47.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.380+0000 7fb734aa0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:47.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.381+0000 7fb7352a1640 10 monclient(hunting): handle_auth_done global_id 4624 payload 824 2026-02-17T21:25:47.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.381+0000 7fb7352a1640 1 -- 10.20.193.5:0/3254851052 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb73015b000 msgr2=0x7fb730158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:47.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.381+0000 7fb7352a1640 1 --2- 10.20.193.5:0/3254851052 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb73015b000 0x7fb730158fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:47.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.381+0000 7fb7352a1640 1 -- 10.20.193.5:0/3254851052 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb73015d370 msgr2=0x7fb7300c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:47.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.381+0000 7fb7352a1640 1 --2- 10.20.193.5:0/3254851052 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb73015d370 0x7fb7300c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:47.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.381+0000 7fb7352a1640 10 monclient: _finish_hunting 0 2026-02-17T21:25:47.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.381+0000 7fb7352a1640 1 monclient: found mon.noname-b 2026-02-17T21:25:47.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.381+0000 7fb7352a1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:47.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.381+0000 7fb7352a1640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:47.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.381+0000 7fb7352a1640 1 -- 10.20.193.5:0/3254851052 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7301f3cb0 con 0x7fb7300c7e20 2026-02-17T21:25:47.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.383+0000 7fb7352a1640 1 --2- 10.20.193.5:0/3254851052 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb7300c7e20 0x7fb7301f7200 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb72000e890 tx=0x7fb72000ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:47.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.383+0000 7fb71dffb640 10 client.?.objecter ms_handle_connect 0x7fb7300c7e20 2026-02-17T21:25:47.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.383+0000 7fb71dffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:47.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.384+0000 7fb71dffb640 1 -- 10.20.193.5:0/3254851052 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb720017070 con 0x7fb7300c7e20 2026-02-17T21:25:47.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.384+0000 7fb71dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:47.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.384+0000 7fb71dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:47.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.384+0000 7fb71dffb640 10 monclient: dump: 2026-02-17T21:25:47.400 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:47.400 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:47.400 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:47.400 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:47.400 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:47.400 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:47.400 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:47.400 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:47.400 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:47.400 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:47.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.384+0000 7fb71dffb640 10 monclient: _finish_auth 0 2026-02-17T21:25:47.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.384+0000 7fb71dffb640 10 monclient: _check_auth_tickets 2026-02-17T21:25:47.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.384+0000 7fb71dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:47.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.384+0000 7fb71dffb640 1 -- 10.20.193.5:0/3254851052 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb72000c940 con 0x7fb7300c7e20 2026-02-17T21:25:47.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.384+0000 7fb73752c640 5 monclient: authenticate success, global_id 4624 2026-02-17T21:25:47.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.384+0000 7fb73752c640 10 monclient: _renew_subs 2026-02-17T21:25:47.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.384+0000 7fb73752c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:47.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.384+0000 7fb73752c640 1 -- 10.20.193.5:0/3254851052 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7301f3f90 con 0x7fb7300c7e20 2026-02-17T21:25:47.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.384+0000 7fb71dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:47.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.384+0000 7fb71dffb640 1 -- 10.20.193.5:0/3254851052 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72000cd10 con 0x7fb7300c7e20 2026-02-17T21:25:47.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.384+0000 7fb71dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:47.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.384+0000 7fb71dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:47.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.384+0000 7fb71dffb640 10 monclient: dump: 2026-02-17T21:25:47.401 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:47.401 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:47.402 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:47.402 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:47.402 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:47.402 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:47.402 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:47.402 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:47.402 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:47.402 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:47.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.384+0000 7fb71f7fe640 4 set_mon_vals no callback set 2026-02-17T21:25:47.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.384+0000 7fb73752c640 10 client.4624.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:47.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.384+0000 7fb73752c640 10 monclient: _renew_subs 2026-02-17T21:25:47.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.384+0000 7fb73752c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:47.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.384+0000 7fb73752c640 1 -- 10.20.193.5:0/3254851052 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7301587e0 con 0x7fb7300c7e20 2026-02-17T21:25:47.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.384+0000 7fb73752c640 1 librados: init done 2026-02-17T21:25:47.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.385+0000 7fb73752c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:47.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.385+0000 7fb73752c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:47.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.385+0000 7fb73752c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:47.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.385+0000 7fb73752c640 1 -- 10.20.193.5:0/3254851052 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb73015b490 con 0x7fb7300c7e20 2026-02-17T21:25:47.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.396+0000 7fb71dffb640 1 -- 10.20.193.5:0/3254851052 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fb720024060 con 0x7fb7300c7e20 2026-02-17T21:25:47.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.397+0000 7fb71dffb640 1 --2- 10.20.193.5:0/3254851052 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb700079280 0x7fb70007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:47.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.397+0000 7fb734aa0640 1 --2- 10.20.193.5:0/3254851052 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb700079280 0x7fb70007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:47.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.397+0000 7fb734aa0640 10 monclient: get_auth_request con 0x7fb700079280 auth_method 0 2026-02-17T21:25:47.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.398+0000 7fb71dffb640 10 client.4624.objecter ms_handle_connect 0x7fb700079280 2026-02-17T21:25:47.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.398+0000 7fb734aa0640 1 --2- 10.20.193.5:0/3254851052 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb700079280 0x7fb70007b740 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb724009660 tx=0x7fb724009290 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:47.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.398+0000 7fb71dffb640 1 -- 10.20.193.5:0/3254851052 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fb72005e450 con 0x7fb7300c7e20 2026-02-17T21:25:47.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.398+0000 7fb71dffb640 10 client.4624.objecter ms_dispatch2 0x7fb730000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:25:47.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.398+0000 7fb71dffb640 3 client.4624.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:25:47.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.398+0000 7fb71dffb640 3 client.4624.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:25:47.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.398+0000 7fb71dffb640 20 client.4624.objecter dump_active .. 0 homeless 2026-02-17T21:25:47.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.499+0000 7fb71dffb640 1 -- 10.20.193.5:0/3254851052 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb720062410 con 0x7fb7300c7e20 2026-02-17T21:25:47.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.499+0000 7fb71dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:47.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.499+0000 7fb71dffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:47.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.599+0000 7fb73752c640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:25:47.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.599+0000 7fb73752c640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:25:47.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.599+0000 7fb73752c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:47.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.599+0000 7fb73752c640 1 -- 10.20.193.5:0/3254851052 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb73006ff90 con 0x7fb7300c7e20 2026-02-17T21:25:47.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.603+0000 7fb71dffb640 1 -- 10.20.193.5:0/3254851052 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fb720066710 con 0x7fb7300c7e20 2026-02-17T21:25:47.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.603+0000 7fb71dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:25:47.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.603+0000 7fb71dffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:47.604 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:25:47.605 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:25:47.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.604+0000 7fb73752c640 10 librados: watch_flush enter 2026-02-17T21:25:47.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.604+0000 7fb73752c640 10 librados: watch_flush exit 2026-02-17T21:25:47.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.604+0000 7fb73752c640 20 client.4624.objecter shutdown clearing up homeless session... 2026-02-17T21:25:47.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.604+0000 7fb73752c640 10 client.4624.objecter successfully canceled tick 2026-02-17T21:25:47.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.604+0000 7fb73752c640 1 -- 10.20.193.5:0/3254851052 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb700079280 msgr2=0x7fb70007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:47.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.604+0000 7fb73752c640 1 --2- 10.20.193.5:0/3254851052 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb700079280 0x7fb70007b740 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb724009660 tx=0x7fb724009290 comp rx=0 tx=0).stop 2026-02-17T21:25:47.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.604+0000 7fb73752c640 10 monclient: shutdown 2026-02-17T21:25:47.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.604+0000 7fb73752c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:47.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.604+0000 7fb73752c640 1 -- 10.20.193.5:0/3254851052 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb7300c7e20 msgr2=0x7fb7301f7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:47.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.604+0000 7fb73752c640 1 --2- 10.20.193.5:0/3254851052 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb7300c7e20 0x7fb7301f7200 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb72000e890 tx=0x7fb72000ed60 comp rx=0 tx=0).stop 2026-02-17T21:25:47.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.604+0000 7fb73752c640 1 -- 10.20.193.5:0/3254851052 shutdown_connections 2026-02-17T21:25:47.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.604+0000 7fb73752c640 1 --2- 10.20.193.5:0/3254851052 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb700079280 0x7fb70007b740 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:47.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.604+0000 7fb73752c640 1 --2- 10.20.193.5:0/3254851052 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb73015d370 0x7fb7300c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:47.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.604+0000 7fb73752c640 1 --2- 10.20.193.5:0/3254851052 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb73015b000 0x7fb730158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:47.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.604+0000 7fb73752c640 1 --2- 10.20.193.5:0/3254851052 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb7300c7e20 0x7fb7301f7200 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:47.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.604+0000 7fb73752c640 1 -- 10.20.193.5:0/3254851052 >> 10.20.193.5:0/3254851052 conn(0x7fb7300c9f20 msgr2=0x7fb730151d40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:47.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.604+0000 7fb73752c640 1 -- 10.20.193.5:0/3254851052 shutdown_connections 2026-02-17T21:25:47.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.604+0000 7fb73752c640 1 -- 10.20.193.5:0/3254851052 wait complete. 2026-02-17T21:25:47.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:47.604+0000 7fb73752c640 1 librados: shutdown 2026-02-17T21:25:50.614 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:25:50.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.682+0000 7f77e2114640 10 monclient: get_monmap_and_config 2026-02-17T21:25:50.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.682+0000 7f77e2114640 10 monclient: build_initial_monmap 2026-02-17T21:25:50.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.682+0000 7f77e2114640 10 monclient: monmap: 2026-02-17T21:25:50.684 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:50.684 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:50.684 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:50.682965+0000 2026-02-17T21:25:50.684 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:50.682965+0000 2026-02-17T21:25:50.685 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:50.685 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:50.685 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:50.685 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:50.685 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:50.685 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:50.685 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:50.685 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:50.685 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:50.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.682+0000 7f77e2114640 1 Processor -- start 2026-02-17T21:25:50.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.682+0000 7f77e2114640 1 -- start start 2026-02-17T21:25:50.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.682+0000 7f77e2114640 10 monclient: init 2026-02-17T21:25:50.689 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.683+0000 7f77e2114640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:50.689 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.683+0000 7f77e2114640 10 monclient: _add_conns ranks=[1,5,0,4,3,2] 2026-02-17T21:25:50.689 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.683+0000 7f77e2114640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f77dc0c7170 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:50.689 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.683+0000 7f77e2114640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f77dc0c7550 0x7f77dc0749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:50.689 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.683+0000 7f77e2114640 10 monclient(hunting): picked mon.noname-c con 0x7f77dc0c7550 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:50.689 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.683+0000 7f77e2114640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f77dc074ef0 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:50.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.683+0000 7f77e2114640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77dc0c4fd0 con 0x7f77dc074ef0 2026-02-17T21:25:50.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.683+0000 7f77e2114640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77dc15a9a0 con 0x7f77dc0c7170 2026-02-17T21:25:50.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.683+0000 7f77e2114640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:50.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.683+0000 7f77e2114640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f77dc0c8530 con 0x7f77dc0c7550 2026-02-17T21:25:50.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.683+0000 7f77e2114640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:50.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.683+0000 7f77e2114640 10 monclient(hunting): authenticate will time out at 1056.248262s 2026-02-17T21:25:50.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.683+0000 7f77dbfff640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f77dc074ef0 0x7f77dc0c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:52204/0 (socket says 10.20.193.5:52204) 2026-02-17T21:25:50.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.683+0000 7f77dbfff640 1 -- 10.20.193.5:0/3074562373 learned_addr learned my addr 10.20.193.5:0/3074562373 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:50.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.683+0000 7f77daffd640 1 --2- 10.20.193.5:0/3074562373 >> v2:10.20.193.135:3300/0 conn(0x7f77dc0c7550 0x7f77dc0749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:50.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.684+0000 7f77daffd640 10 monclient(hunting): get_auth_request con 0x7f77dc0c7550 auth_method 0 2026-02-17T21:25:50.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.684+0000 7f77daffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:50.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.684+0000 7f77daffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:50.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.684+0000 7f77daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:50.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.684+0000 7f77daffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:50.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.684+0000 7f77daffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:50.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.684+0000 7f77daffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:50.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.685+0000 7f77da7fc640 1 -- 10.20.193.5:0/3074562373 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3806743661 0 0) 0x7f77dc15a9a0 con 0x7f77dc0c7170 2026-02-17T21:25:50.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.685+0000 7f77da7fc640 10 monclient(hunting): _negotiate 2026-02-17T21:25:50.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.685+0000 7f77da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:50.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.685+0000 7f77da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:50.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.685+0000 7f77da7fc640 10 monclient(hunting): my global_id is 4627 2026-02-17T21:25:50.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.685+0000 7f77da7fc640 1 -- 10.20.193.5:0/3074562373 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77c0003620 con 0x7f77dc0c7170 2026-02-17T21:25:50.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.685+0000 7f77da7fc640 1 -- 10.20.193.5:0/3074562373 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 806427601 0 0) 0x7f77dc0c4fd0 con 0x7f77dc074ef0 2026-02-17T21:25:50.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.685+0000 7f77da7fc640 10 monclient(hunting): _negotiate 2026-02-17T21:25:50.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.685+0000 7f77da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:50.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.685+0000 7f77da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:50.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.685+0000 7f77da7fc640 10 monclient(hunting): my global_id is 4605 2026-02-17T21:25:50.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.685+0000 7f77da7fc640 1 -- 10.20.193.5:0/3074562373 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77dc15a9a0 con 0x7f77dc074ef0 2026-02-17T21:25:50.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.685+0000 7f77daffd640 10 monclient(hunting): handle_auth_done global_id 4658 payload 274 2026-02-17T21:25:50.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.685+0000 7f77daffd640 1 -- 10.20.193.5:0/3074562373 >> v1:10.20.193.119:6789/0 conn(0x7f77dc0c7170 legacy=0x7f77dc0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:50.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.685+0000 7f77daffd640 1 -- 10.20.193.5:0/3074562373 >> v1:10.20.193.5:6789/0 conn(0x7f77dc074ef0 legacy=0x7f77dc0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:50.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.685+0000 7f77daffd640 10 monclient: _finish_hunting 0 2026-02-17T21:25:50.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.685+0000 7f77daffd640 1 monclient: found mon.noname-c 2026-02-17T21:25:50.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.685+0000 7f77daffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:50.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.685+0000 7f77daffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:50.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.685+0000 7f77daffd640 1 -- 10.20.193.5:0/3074562373 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77dc0c5270 con 0x7f77dc0c7550 2026-02-17T21:25:50.693 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.686+0000 7f77daffd640 1 --2- 10.20.193.5:0/3074562373 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f77dc0c7550 0x7f77dc0749b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f77cc0098a0 tx=0x7f77cc02ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=284965aeb4405c90 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:50.693 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.687+0000 7f77da7fc640 1 -- 10.20.193.5:0/3074562373 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc03c070 con 0x7f77dc0c7550 2026-02-17T21:25:50.693 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.687+0000 7f77da7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:50.693 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.687+0000 7f77da7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:50.693 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.687+0000 7f77da7fc640 10 monclient: dump: 2026-02-17T21:25:50.693 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:50.693 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:50.693 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:50.693 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:50.693 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:50.693 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:50.693 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:50.694 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:50.694 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:50.694 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:50.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.687+0000 7f77da7fc640 10 monclient: _finish_auth 0 2026-02-17T21:25:50.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.687+0000 7f77da7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:25:50.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.687+0000 7f77da7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:50.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.687+0000 7f77e2114640 5 monclient: authenticate success, global_id 4658 2026-02-17T21:25:50.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.687+0000 7f77e2114640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:50.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.689+0000 7f77da7fc640 1 -- 10.20.193.5:0/3074562373 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77cc02fb70 con 0x7f77dc0c7550 2026-02-17T21:25:50.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.689+0000 7f77da7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:50.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.689+0000 7f77da7fc640 1 -- 10.20.193.5:0/3074562373 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc037440 con 0x7f77dc0c7550 2026-02-17T21:25:50.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.689+0000 7f77da7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:50.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.689+0000 7f77da7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:50.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.689+0000 7f77da7fc640 10 monclient: dump: 2026-02-17T21:25:50.701 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:50.701 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:50.701 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:50.701 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:50.701 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:50.701 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:50.701 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:50.701 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:50.702 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:50.702 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:50.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.689+0000 7f77e2114640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:50.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.689+0000 7f77e2114640 4 set_mon_vals no callback set 2026-02-17T21:25:50.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.689+0000 7f77e2114640 10 monclient: shutdown 2026-02-17T21:25:50.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.689+0000 7f77e2114640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:50.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.689+0000 7f77e2114640 1 -- 10.20.193.5:0/3074562373 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f77dc0c7550 msgr2=0x7f77dc0749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:50.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.689+0000 7f77e2114640 1 --2- 10.20.193.5:0/3074562373 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f77dc0c7550 0x7f77dc0749b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f77cc0098a0 tx=0x7f77cc02ee60 comp rx=0 tx=0).stop 2026-02-17T21:25:50.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.689+0000 7f77e2114640 1 -- 10.20.193.5:0/3074562373 shutdown_connections 2026-02-17T21:25:50.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.689+0000 7f77e2114640 1 --2- 10.20.193.5:0/3074562373 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f77dc0c7550 0x7f77dc0749b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:50.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.689+0000 7f77e2114640 1 -- 10.20.193.5:0/3074562373 >> 10.20.193.5:0/3074562373 conn(0x7f77dc0c9f40 msgr2=0x7f77dc0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:50.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.689+0000 7f77e2114640 1 -- 10.20.193.5:0/3074562373 shutdown_connections 2026-02-17T21:25:50.703 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.689+0000 7f77e2114640 1 -- 10.20.193.5:0/3074562373 wait complete. 2026-02-17T21:25:50.703 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.689+0000 7f77e2114640 10 monclient: build_initial_monmap 2026-02-17T21:25:50.703 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.689+0000 7f77e2114640 10 monclient: monmap: 2026-02-17T21:25:50.703 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:50.703 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:50.703 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:50.703 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:50.703 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:50.703 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:50.703 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:50.703 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:50.703 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:50.704 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:50.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.690+0000 7f77e2114640 1 librados: starting msgr at 2026-02-17T21:25:50.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.690+0000 7f77e2114640 1 librados: starting objecter 2026-02-17T21:25:50.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.690+0000 7f77e2114640 1 Processor -- start 2026-02-17T21:25:50.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.690+0000 7f77e2114640 1 -- start start 2026-02-17T21:25:50.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.690+0000 7f77e2114640 1 librados: setting wanted keys 2026-02-17T21:25:50.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.690+0000 7f77e2114640 1 librados: calling monclient init 2026-02-17T21:25:50.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.690+0000 7f77e2114640 10 monclient: init 2026-02-17T21:25:50.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.690+0000 7f77e2114640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:50.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.690+0000 7f77e2114640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:25:50.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.690+0000 7f77e2114640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f77dc074ef0 0x7f77dc1571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:50.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.690+0000 7f77e2114640 10 monclient(hunting): picked mon.noname-a con 0x7f77dc074ef0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:50.705 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.690+0000 7f77e2114640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f77dc0c7170 0x7f77dc14a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:50.705 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.690+0000 7f77e2114640 10 monclient(hunting): picked mon.noname-c con 0x7f77dc0c7170 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:50.705 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.690+0000 7f77e2114640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f77dc0c7550 0x7f77dc1f33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:50.705 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.690+0000 7f77e2114640 10 monclient(hunting): picked mon.noname-b con 0x7f77dc0c7550 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:50.705 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.690+0000 7f77e2114640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:50.705 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.690+0000 7f77e2114640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc0c7ee0 con 0x7f77dc074ef0 2026-02-17T21:25:50.705 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.690+0000 7f77e2114640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:50.705 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.690+0000 7f77e2114640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc0c5830 con 0x7f77dc0c7550 2026-02-17T21:25:50.705 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.690+0000 7f77e2114640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:50.705 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.690+0000 7f77e2114640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc0c81c0 con 0x7f77dc0c7170 2026-02-17T21:25:50.705 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.690+0000 7f77e2114640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:50.705 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.690+0000 7f77e2114640 10 monclient(hunting): authenticate will time out at 1056.255745s 2026-02-17T21:25:50.705 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77db7fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f77dc074ef0 0x7f77dc1571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:50.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77daffd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f77dc0c7170 0x7f77dc14a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:50.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77dbfff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f77dc0c7550 0x7f77dc1f33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:50.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77daffd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f77dc0c7170 0x7f77dc14a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:56846/0 (socket says 10.20.193.5:56846) 2026-02-17T21:25:50.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77daffd640 1 -- 10.20.193.5:0/2036201664 learned_addr learned my addr 10.20.193.5:0/2036201664 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:50.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77daffd640 10 monclient(hunting): get_auth_request con 0x7f77dc0c7170 auth_method 0 2026-02-17T21:25:50.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77daffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:50.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77daffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:50.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:50.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77db7fe640 10 monclient(hunting): get_auth_request con 0x7f77dc074ef0 auth_method 0 2026-02-17T21:25:50.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:50.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:50.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:50.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77dbfff640 10 monclient(hunting): get_auth_request con 0x7f77dc0c7550 auth_method 0 2026-02-17T21:25:50.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:50.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:50.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:50.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77db7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:50.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77db7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:50.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77db7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:50.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77daffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:50.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77daffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:50.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77daffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:50.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77dbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:50.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77dbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:50.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.691+0000 7f77dbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:50.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.693+0000 7f77daffd640 10 monclient(hunting): handle_auth_done global_id 4661 payload 824 2026-02-17T21:25:50.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.693+0000 7f77daffd640 1 -- 10.20.193.5:0/2036201664 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f77dc0c7550 msgr2=0x7f77dc1f33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:50.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.693+0000 7f77daffd640 1 --2- 10.20.193.5:0/2036201664 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f77dc0c7550 0x7f77dc1f33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:50.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.693+0000 7f77daffd640 1 -- 10.20.193.5:0/2036201664 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f77dc074ef0 msgr2=0x7f77dc1571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:50.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.693+0000 7f77daffd640 1 --2- 10.20.193.5:0/2036201664 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f77dc074ef0 0x7f77dc1571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:50.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.693+0000 7f77daffd640 10 monclient: _finish_hunting 0 2026-02-17T21:25:50.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.693+0000 7f77daffd640 1 monclient: found mon.noname-c 2026-02-17T21:25:50.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.693+0000 7f77daffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:50.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.693+0000 7f77daffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:50.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.693+0000 7f77daffd640 1 -- 10.20.193.5:0/2036201664 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77dc14faa0 con 0x7f77dc0c7170 2026-02-17T21:25:50.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.694+0000 7f77daffd640 1 --2- 10.20.193.5:0/2036201664 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f77dc0c7170 0x7f77dc14a8e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f77cc016e30 tx=0x7f77cc0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:50.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.694+0000 7f77b7fff640 10 client.?.objecter ms_handle_connect 0x7f77dc0c7170 2026-02-17T21:25:50.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.694+0000 7f77b7fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:50.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.695+0000 7f77b7fff640 1 -- 10.20.193.5:0/2036201664 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc046020 con 0x7f77dc0c7170 2026-02-17T21:25:50.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.695+0000 7f77b7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:50.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.695+0000 7f77b7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:50.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.695+0000 7f77b7fff640 10 monclient: dump: 2026-02-17T21:25:50.709 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:50.709 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:50.709 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:50.709 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:50.709 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:50.709 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:50.710 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:50.710 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:50.710 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:50.710 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:50.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.695+0000 7f77b7fff640 10 monclient: _finish_auth 0 2026-02-17T21:25:50.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.695+0000 7f77b7fff640 10 monclient: _check_auth_tickets 2026-02-17T21:25:50.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.695+0000 7f77b7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:50.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.695+0000 7f77b7fff640 1 -- 10.20.193.5:0/2036201664 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77cc003910 con 0x7f77dc0c7170 2026-02-17T21:25:50.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.695+0000 7f77b7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:50.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.696+0000 7f77b7fff640 1 -- 10.20.193.5:0/2036201664 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc03c040 con 0x7f77dc0c7170 2026-02-17T21:25:50.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.696+0000 7f77b7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:50.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.696+0000 7f77b7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:50.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.696+0000 7f77b7fff640 10 monclient: dump: 2026-02-17T21:25:50.711 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:50.711 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:50.711 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:50.711 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:50.711 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:50.711 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:50.711 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:50.711 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:50.711 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:50.711 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:50.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.696+0000 7f77d9ffb640 4 set_mon_vals no callback set 2026-02-17T21:25:50.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.696+0000 7f77e2114640 5 monclient: authenticate success, global_id 4661 2026-02-17T21:25:50.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.696+0000 7f77e2114640 10 monclient: _renew_subs 2026-02-17T21:25:50.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.696+0000 7f77e2114640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:50.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.696+0000 7f77e2114640 1 -- 10.20.193.5:0/2036201664 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77dc157710 con 0x7f77dc0c7170 2026-02-17T21:25:50.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.696+0000 7f77e2114640 10 client.4661.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:50.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.696+0000 7f77e2114640 10 monclient: _renew_subs 2026-02-17T21:25:50.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.696+0000 7f77e2114640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:50.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.696+0000 7f77e2114640 1 -- 10.20.193.5:0/2036201664 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77dc156cf0 con 0x7f77dc0c7170 2026-02-17T21:25:50.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.696+0000 7f77e2114640 1 librados: init done 2026-02-17T21:25:50.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.696+0000 7f77e2114640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:50.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.696+0000 7f77e2114640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:50.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.696+0000 7f77e2114640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:50.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.696+0000 7f77e2114640 1 -- 10.20.193.5:0/2036201664 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77dc0749b0 con 0x7f77dc0c7170 2026-02-17T21:25:50.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.708+0000 7f77b7fff640 1 -- 10.20.193.5:0/2036201664 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f77cc003cc0 con 0x7f77dc0c7170 2026-02-17T21:25:50.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.708+0000 7f77b7fff640 1 --2- 10.20.193.5:0/2036201664 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f77ac079280 0x7f77ac07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:50.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.708+0000 7f77db7fe640 1 --2- 10.20.193.5:0/2036201664 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f77ac079280 0x7f77ac07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:50.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.709+0000 7f77db7fe640 10 monclient: get_auth_request con 0x7f77ac079280 auth_method 0 2026-02-17T21:25:50.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.709+0000 7f77db7fe640 1 --2- 10.20.193.5:0/2036201664 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f77ac079280 0x7f77ac07b740 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f77c80052b0 tx=0x7f77c8003d70 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:50.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.709+0000 7f77b7fff640 10 client.4661.objecter ms_handle_connect 0x7f77ac079280 2026-02-17T21:25:50.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.710+0000 7f77b7fff640 1 -- 10.20.193.5:0/2036201664 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f77cc082690 con 0x7f77dc0c7170 2026-02-17T21:25:50.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.710+0000 7f77b7fff640 10 client.4661.objecter ms_dispatch2 0x7f77dc000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:25:50.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.710+0000 7f77b7fff640 3 client.4661.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:25:50.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.710+0000 7f77b7fff640 3 client.4661.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:25:50.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.710+0000 7f77b7fff640 20 client.4661.objecter dump_active .. 0 homeless 2026-02-17T21:25:50.813 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.812+0000 7f77b7fff640 1 -- 10.20.193.5:0/2036201664 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f77cc086650 con 0x7f77dc0c7170 2026-02-17T21:25:50.813 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.812+0000 7f77b7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:50.814 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.812+0000 7f77b7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:50.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.909+0000 7f77e2114640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:25:50.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.910+0000 7f77e2114640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:25:50.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.910+0000 7f77e2114640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:25:50.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.910+0000 7f77e2114640 1 -- 10.20.193.5:0/2036201664 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f77dc070d70 con 0x7f77dc0c7170 2026-02-17T21:25:50.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.913+0000 7f77b7fff640 1 -- 10.20.193.5:0/2036201664 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f77cc08a950 con 0x7f77dc0c7170 2026-02-17T21:25:50.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.913+0000 7f77b7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:25:50.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.913+0000 7f77b7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:50.915 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:25:50.915 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:25:50.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.914+0000 7f77e2114640 10 librados: watch_flush enter 2026-02-17T21:25:50.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.914+0000 7f77e2114640 10 librados: watch_flush exit 2026-02-17T21:25:50.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.914+0000 7f77e2114640 20 client.4661.objecter shutdown clearing up homeless session... 2026-02-17T21:25:50.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.914+0000 7f77e2114640 10 client.4661.objecter successfully canceled tick 2026-02-17T21:25:50.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.914+0000 7f77e2114640 1 -- 10.20.193.5:0/2036201664 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f77ac079280 msgr2=0x7f77ac07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:50.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.914+0000 7f77e2114640 1 --2- 10.20.193.5:0/2036201664 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f77ac079280 0x7f77ac07b740 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f77c80052b0 tx=0x7f77c8003d70 comp rx=0 tx=0).stop 2026-02-17T21:25:50.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.914+0000 7f77e2114640 10 monclient: shutdown 2026-02-17T21:25:50.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.914+0000 7f77e2114640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:50.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.914+0000 7f77e2114640 1 -- 10.20.193.5:0/2036201664 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f77dc0c7170 msgr2=0x7f77dc14a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:50.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.914+0000 7f77e2114640 1 --2- 10.20.193.5:0/2036201664 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f77dc0c7170 0x7f77dc14a8e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f77cc016e30 tx=0x7f77cc0047c0 comp rx=0 tx=0).stop 2026-02-17T21:25:50.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.914+0000 7f77e2114640 1 -- 10.20.193.5:0/2036201664 shutdown_connections 2026-02-17T21:25:50.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.914+0000 7f77e2114640 1 --2- 10.20.193.5:0/2036201664 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f77ac079280 0x7f77ac07b740 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:50.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.914+0000 7f77e2114640 1 --2- 10.20.193.5:0/2036201664 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f77dc0c7550 0x7f77dc1f33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:50.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.914+0000 7f77e2114640 1 --2- 10.20.193.5:0/2036201664 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f77dc0c7170 0x7f77dc14a8e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:50.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.914+0000 7f77e2114640 1 --2- 10.20.193.5:0/2036201664 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f77dc074ef0 0x7f77dc1571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:50.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.914+0000 7f77e2114640 1 -- 10.20.193.5:0/2036201664 >> 10.20.193.5:0/2036201664 conn(0x7f77dc0c9f40 msgr2=0x7f77dc158b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:50.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.914+0000 7f77e2114640 1 -- 10.20.193.5:0/2036201664 shutdown_connections 2026-02-17T21:25:50.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.914+0000 7f77e2114640 1 -- 10.20.193.5:0/2036201664 wait complete. 2026-02-17T21:25:50.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:50.914+0000 7f77e2114640 1 librados: shutdown 2026-02-17T21:25:53.925 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:25:53.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.993+0000 7fe5bd56a640 10 monclient: get_monmap_and_config 2026-02-17T21:25:53.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.993+0000 7fe5bd56a640 10 monclient: build_initial_monmap 2026-02-17T21:25:53.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.993+0000 7fe5bd56a640 10 monclient: monmap: 2026-02-17T21:25:53.995 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:53.995 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:53.995 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:53.994318+0000 2026-02-17T21:25:53.995 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:53.994318+0000 2026-02-17T21:25:53.996 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:53.996 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:53.996 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:53.996 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:53.996 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:53.996 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:53.996 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:53.996 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:53.996 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:53.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.994+0000 7fe5bd56a640 1 Processor -- start 2026-02-17T21:25:53.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.994+0000 7fe5bd56a640 1 -- start start 2026-02-17T21:25:53.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.994+0000 7fe5bd56a640 10 monclient: init 2026-02-17T21:25:54.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.994+0000 7fe5bd56a640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:54.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.994+0000 7fe5bd56a640 10 monclient: _add_conns ranks=[0,5,2,4,1,3] 2026-02-17T21:25:54.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.994+0000 7fe5bd56a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe5b80c7170 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:54.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.994+0000 7fe5bd56a640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fe5b80c7550 0x7fe5b80749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:54.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.994+0000 7fe5bd56a640 10 monclient(hunting): picked mon.noname-c con 0x7fe5b80c7550 addr v2:10.20.193.135:3300/0 2026-02-17T21:25:54.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.994+0000 7fe5bd56a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe5b8074ef0 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:54.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.994+0000 7fe5bd56a640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5b80c4fd0 con 0x7fe5b80c7170 2026-02-17T21:25:54.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.994+0000 7fe5bd56a640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5b815a9a0 con 0x7fe5b8074ef0 2026-02-17T21:25:54.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.994+0000 7fe5bd56a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:54.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.994+0000 7fe5bd56a640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe5b80c8530 con 0x7fe5b80c7550 2026-02-17T21:25:54.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.994+0000 7fe5bd56a640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:54.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.994+0000 7fe5bd56a640 10 monclient(hunting): authenticate will time out at 1059.559727s 2026-02-17T21:25:54.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.995+0000 7fe5b6ffd640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7fe5b80c7170 0x7fe5b80c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:52212/0 (socket says 10.20.193.5:52212) 2026-02-17T21:25:54.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.995+0000 7fe5b6ffd640 1 -- 10.20.193.5:0/492223266 learned_addr learned my addr 10.20.193.5:0/492223266 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:54.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.995+0000 7fe5b67fc640 1 --2- 10.20.193.5:0/492223266 >> v2:10.20.193.135:3300/0 conn(0x7fe5b80c7550 0x7fe5b80749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:54.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.995+0000 7fe5b67fc640 10 monclient(hunting): get_auth_request con 0x7fe5b80c7550 auth_method 0 2026-02-17T21:25:54.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.995+0000 7fe5b67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:54.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.995+0000 7fe5b67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:54.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.995+0000 7fe5b67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:54.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.996+0000 7fe5b67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:54.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.996+0000 7fe5b67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:54.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.996+0000 7fe5b67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:54.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.996+0000 7fe5b5ffb640 1 -- 10.20.193.5:0/492223266 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3551462930 0 0) 0x7fe5b80c4fd0 con 0x7fe5b80c7170 2026-02-17T21:25:54.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.996+0000 7fe5b5ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:25:54.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.996+0000 7fe5b5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:54.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.996+0000 7fe5b5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:54.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.996+0000 7fe5b5ffb640 10 monclient(hunting): my global_id is 4611 2026-02-17T21:25:54.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.996+0000 7fe5b5ffb640 1 -- 10.20.193.5:0/492223266 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5a4003620 con 0x7fe5b80c7170 2026-02-17T21:25:54.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.997+0000 7fe5b67fc640 10 monclient(hunting): handle_auth_done global_id 4664 payload 274 2026-02-17T21:25:54.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.997+0000 7fe5b67fc640 1 -- 10.20.193.5:0/492223266 >> v1:10.20.193.135:6789/0 conn(0x7fe5b8074ef0 legacy=0x7fe5b80c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:54.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.997+0000 7fe5b67fc640 1 -- 10.20.193.5:0/492223266 >> v1:10.20.193.5:6789/0 conn(0x7fe5b80c7170 legacy=0x7fe5b80c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:54.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.997+0000 7fe5b67fc640 10 monclient: _finish_hunting 0 2026-02-17T21:25:54.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.997+0000 7fe5b67fc640 1 monclient: found mon.noname-c 2026-02-17T21:25:54.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.997+0000 7fe5b67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:54.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.997+0000 7fe5b67fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:25:54.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.997+0000 7fe5b67fc640 1 -- 10.20.193.5:0/492223266 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b80c5270 con 0x7fe5b80c7550 2026-02-17T21:25:54.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:53.998+0000 7fe5b67fc640 1 --2- 10.20.193.5:0/492223266 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe5b80c7550 0x7fe5b80749b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00098a0 tx=0x7fe5a002ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=891e22130e27eaaf server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:54.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5b5ffb640 1 -- 10.20.193.5:0/492223266 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a003c070 con 0x7fe5b80c7550 2026-02-17T21:25:54.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:54.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5b5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:25:54.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5b5ffb640 10 monclient: dump: 2026-02-17T21:25:54.009 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:54.009 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:54.009 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:54.009 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:54.009 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:54.009 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:54.009 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:54.009 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:54.010 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:54.010 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:54.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5b5ffb640 10 monclient: _finish_auth 0 2026-02-17T21:25:54.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5b5ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:25:54.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5b5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:54.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5bd56a640 5 monclient: authenticate success, global_id 4664 2026-02-17T21:25:54.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5bd56a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:54.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5b5ffb640 1 -- 10.20.193.5:0/492223266 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5a002fad0 con 0x7fe5b80c7550 2026-02-17T21:25:54.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5b5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:54.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5bd56a640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:54.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5b5ffb640 1 -- 10.20.193.5:0/492223266 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0037440 con 0x7fe5b80c7550 2026-02-17T21:25:54.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5bd56a640 4 set_mon_vals no callback set 2026-02-17T21:25:54.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:54.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5b5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:25:54.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5b5ffb640 10 monclient: dump: 2026-02-17T21:25:54.011 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:54.011 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:54.011 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:54.011 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:54.011 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:54.011 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:54.012 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:54.012 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:54.012 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:54.012 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:54.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5bd56a640 10 monclient: shutdown 2026-02-17T21:25:54.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5bd56a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:54.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5bd56a640 1 -- 10.20.193.5:0/492223266 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe5b80c7550 msgr2=0x7fe5b80749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:54.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5bd56a640 1 --2- 10.20.193.5:0/492223266 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe5b80c7550 0x7fe5b80749b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00098a0 tx=0x7fe5a002ee10 comp rx=0 tx=0).stop 2026-02-17T21:25:54.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5bd56a640 1 -- 10.20.193.5:0/492223266 shutdown_connections 2026-02-17T21:25:54.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5bd56a640 1 --2- 10.20.193.5:0/492223266 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe5b80c7550 0x7fe5b80749b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:54.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5bd56a640 1 -- 10.20.193.5:0/492223266 >> 10.20.193.5:0/492223266 conn(0x7fe5b80c9f40 msgr2=0x7fe5b80ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:54.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5bd56a640 1 -- 10.20.193.5:0/492223266 shutdown_connections 2026-02-17T21:25:54.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.002+0000 7fe5bd56a640 1 -- 10.20.193.5:0/492223266 wait complete. 2026-02-17T21:25:54.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.003+0000 7fe5bd56a640 10 monclient: build_initial_monmap 2026-02-17T21:25:54.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.003+0000 7fe5bd56a640 10 monclient: monmap: 2026-02-17T21:25:54.013 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:54.013 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:54.013 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:54.013 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:54.013 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:54.013 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:54.013 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:54.013 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:54.014 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:54.014 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:54.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.003+0000 7fe5bd56a640 1 librados: starting msgr at 2026-02-17T21:25:54.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.003+0000 7fe5bd56a640 1 librados: starting objecter 2026-02-17T21:25:54.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.003+0000 7fe5bd56a640 1 Processor -- start 2026-02-17T21:25:54.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.003+0000 7fe5bd56a640 1 -- start start 2026-02-17T21:25:54.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.003+0000 7fe5bd56a640 1 librados: setting wanted keys 2026-02-17T21:25:54.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.003+0000 7fe5bd56a640 1 librados: calling monclient init 2026-02-17T21:25:54.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.003+0000 7fe5bd56a640 10 monclient: init 2026-02-17T21:25:54.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5bd56a640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:54.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5bd56a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:25:54.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5bd56a640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe5b8074ef0 0x7fe5b80c0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:54.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5bd56a640 10 monclient(hunting): picked mon.noname-c con 0x7fe5b8074ef0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:54.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5bd56a640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe5b80c7170 0x7fe5b80c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:54.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5bd56a640 10 monclient(hunting): picked mon.noname-a con 0x7fe5b80c7170 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:54.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5bd56a640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe5b80c7550 0x7fe5b80c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:54.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5bd56a640 10 monclient(hunting): picked mon.noname-b con 0x7fe5b80c7550 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:54.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5bd56a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:54.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5bd56a640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b80c7ee0 con 0x7fe5b80c7170 2026-02-17T21:25:54.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5bd56a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:54.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5bd56a640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b80c5830 con 0x7fe5b80c7550 2026-02-17T21:25:54.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5bd56a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:54.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5bd56a640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b80c81c0 con 0x7fe5b8074ef0 2026-02-17T21:25:54.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5bd56a640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:54.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5bd56a640 10 monclient(hunting): authenticate will time out at 1059.569124s 2026-02-17T21:25:54.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5b6ffd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe5b8074ef0 0x7fe5b80c0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:54.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5b67fc640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe5b80c7170 0x7fe5b80c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:54.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5b6ffd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe5b8074ef0 0x7fe5b80c0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:56856/0 (socket says 10.20.193.5:56856) 2026-02-17T21:25:54.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5b6ffd640 1 -- 10.20.193.5:0/180491901 learned_addr learned my addr 10.20.193.5:0/180491901 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:54.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5b6ffd640 10 monclient(hunting): get_auth_request con 0x7fe5b8074ef0 auth_method 0 2026-02-17T21:25:54.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:54.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:54.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:54.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5b67fc640 10 monclient(hunting): get_auth_request con 0x7fe5b80c7170 auth_method 0 2026-02-17T21:25:54.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5b67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:54.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5b67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:54.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5b67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:54.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5b77fe640 1 --2- 10.20.193.5:0/180491901 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe5b80c7550 0x7fe5b80c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:54.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5b6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:54.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5b6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:54.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.004+0000 7fe5b6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:54.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.005+0000 7fe5b77fe640 10 monclient(hunting): get_auth_request con 0x7fe5b80c7550 auth_method 0 2026-02-17T21:25:54.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.005+0000 7fe5b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:54.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.005+0000 7fe5b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:54.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.005+0000 7fe5b77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:54.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.005+0000 7fe5b67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:54.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.005+0000 7fe5b67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:54.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.005+0000 7fe5b67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:54.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.005+0000 7fe5b77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:54.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.005+0000 7fe5b77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:54.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.005+0000 7fe5b77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:54.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.006+0000 7fe5b67fc640 10 monclient(hunting): handle_auth_done global_id 4614 payload 824 2026-02-17T21:25:54.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.006+0000 7fe5b67fc640 1 -- 10.20.193.5:0/180491901 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe5b8074ef0 msgr2=0x7fe5b80c0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:54.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.006+0000 7fe5b67fc640 1 --2- 10.20.193.5:0/180491901 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe5b8074ef0 0x7fe5b80c0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:54.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.006+0000 7fe5b67fc640 1 -- 10.20.193.5:0/180491901 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe5b80c7550 msgr2=0x7fe5b80c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:54.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.006+0000 7fe5b67fc640 1 --2- 10.20.193.5:0/180491901 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe5b80c7550 0x7fe5b80c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:54.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.006+0000 7fe5b67fc640 10 monclient: _finish_hunting 0 2026-02-17T21:25:54.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.006+0000 7fe5b67fc640 1 monclient: found mon.noname-a 2026-02-17T21:25:54.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.006+0000 7fe5b67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:54.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.006+0000 7fe5b67fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:25:54.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.006+0000 7fe5b67fc640 1 -- 10.20.193.5:0/180491901 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b81f5950 con 0x7fe5b80c7170 2026-02-17T21:25:54.021 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.007+0000 7fe5b67fc640 1 --2- 10.20.193.5:0/180491901 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe5b80c7170 0x7fe5b80c3ca0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0036000 tx=0x7fe5a00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:54.021 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.007+0000 7fe5977fe640 10 client.?.objecter ms_handle_connect 0x7fe5b80c7170 2026-02-17T21:25:54.021 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.007+0000 7fe5977fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:54.021 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.008+0000 7fe5977fe640 1 -- 10.20.193.5:0/180491901 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a003c040 con 0x7fe5b80c7170 2026-02-17T21:25:54.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.008+0000 7fe5977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:54.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.008+0000 7fe5977fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:25:54.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.008+0000 7fe5977fe640 10 monclient: dump: 2026-02-17T21:25:54.022 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:54.022 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:54.022 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:54.022 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:54.022 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:54.022 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:54.023 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:54.023 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:54.023 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:54.023 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:54.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.008+0000 7fe5977fe640 10 monclient: _finish_auth 0 2026-02-17T21:25:54.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.008+0000 7fe5977fe640 10 monclient: _check_auth_tickets 2026-02-17T21:25:54.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.008+0000 7fe5977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:54.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.008+0000 7fe5bd56a640 5 monclient: authenticate success, global_id 4614 2026-02-17T21:25:54.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.008+0000 7fe5bd56a640 10 monclient: _renew_subs 2026-02-17T21:25:54.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.008+0000 7fe5bd56a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:54.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.008+0000 7fe5bd56a640 1 -- 10.20.193.5:0/180491901 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5b81f2340 con 0x7fe5b80c7170 2026-02-17T21:25:54.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.008+0000 7fe5bd56a640 10 client.4614.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:54.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.008+0000 7fe5bd56a640 10 monclient: _renew_subs 2026-02-17T21:25:54.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.008+0000 7fe5bd56a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:54.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.008+0000 7fe5bd56a640 1 -- 10.20.193.5:0/180491901 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5b81f1580 con 0x7fe5b80c7170 2026-02-17T21:25:54.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.008+0000 7fe5bd56a640 1 librados: init done 2026-02-17T21:25:54.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.009+0000 7fe5bd56a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:54.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.009+0000 7fe5bd56a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:54.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.009+0000 7fe5bd56a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:54.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.009+0000 7fe5bd56a640 1 -- 10.20.193.5:0/180491901 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5b80c63a0 con 0x7fe5b80c7170 2026-02-17T21:25:54.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.009+0000 7fe5977fe640 1 -- 10.20.193.5:0/180491901 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5a002fa30 con 0x7fe5b80c7170 2026-02-17T21:25:54.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.009+0000 7fe5977fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:54.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.009+0000 7fe5977fe640 1 -- 10.20.193.5:0/180491901 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0042650 con 0x7fe5b80c7170 2026-02-17T21:25:54.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.009+0000 7fe5977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:54.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.009+0000 7fe5977fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:25:54.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.009+0000 7fe5977fe640 10 monclient: dump: 2026-02-17T21:25:54.025 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:54.025 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:54.025 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:54.025 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:54.025 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:54.025 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:54.025 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:54.025 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:54.026 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:54.026 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:54.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.009+0000 7fe5b57fa640 4 set_mon_vals no callback set 2026-02-17T21:25:54.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.115+0000 7fe5977fe640 1 -- 10.20.193.5:0/180491901 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fe5a00427f0 con 0x7fe5b80c7170 2026-02-17T21:25:54.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.116+0000 7fe5977fe640 1 --2- 10.20.193.5:0/180491901 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe584079280 0x7fe58407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:54.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.116+0000 7fe5b6ffd640 1 --2- 10.20.193.5:0/180491901 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe584079280 0x7fe58407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:54.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.116+0000 7fe5b6ffd640 10 monclient: get_auth_request con 0x7fe584079280 auth_method 0 2026-02-17T21:25:54.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.116+0000 7fe5b6ffd640 1 --2- 10.20.193.5:0/180491901 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe584079280 0x7fe58407b740 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac005980 tx=0x7fe5ac009040 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:54.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.116+0000 7fe5977fe640 10 client.4614.objecter ms_handle_connect 0x7fe584079280 2026-02-17T21:25:54.125 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.123+0000 7fe5977fe640 1 -- 10.20.193.5:0/180491901 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fe5a00bd3d0 con 0x7fe5b80c7170 2026-02-17T21:25:54.125 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.123+0000 7fe5977fe640 10 client.4614.objecter ms_dispatch2 0x7fe5b8000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:25:54.125 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.123+0000 7fe5977fe640 3 client.4614.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:25:54.125 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.123+0000 7fe5977fe640 3 client.4614.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:25:54.125 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.123+0000 7fe5977fe640 20 client.4614.objecter dump_active .. 0 homeless 2026-02-17T21:25:54.125 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.123+0000 7fe5977fe640 1 -- 10.20.193.5:0/180491901 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe5a0087960 con 0x7fe5b80c7170 2026-02-17T21:25:54.126 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.123+0000 7fe5977fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:54.126 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.123+0000 7fe5977fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:54.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.223+0000 7fe5bd56a640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:25:54.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.223+0000 7fe5bd56a640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:25:54.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.223+0000 7fe5bd56a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:25:54.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.223+0000 7fe5bd56a640 1 -- 10.20.193.5:0/180491901 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe5b80c7b10 con 0x7fe5b80c7170 2026-02-17T21:25:54.229 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.228+0000 7fe5977fe640 1 -- 10.20.193.5:0/180491901 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fe5b80c7b10 con 0x7fe5b80c7170 2026-02-17T21:25:54.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.228+0000 7fe5977fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:25:54.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.228+0000 7fe5977fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:54.230 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:25:54.230 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:25:54.232 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.229+0000 7fe5bd56a640 10 librados: watch_flush enter 2026-02-17T21:25:54.232 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.229+0000 7fe5bd56a640 10 librados: watch_flush exit 2026-02-17T21:25:54.233 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.229+0000 7fe5bd56a640 20 client.4614.objecter shutdown clearing up homeless session... 2026-02-17T21:25:54.233 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.229+0000 7fe5bd56a640 10 client.4614.objecter successfully canceled tick 2026-02-17T21:25:54.233 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.229+0000 7fe5bd56a640 1 -- 10.20.193.5:0/180491901 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe584079280 msgr2=0x7fe58407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:54.233 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.229+0000 7fe5bd56a640 1 --2- 10.20.193.5:0/180491901 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe584079280 0x7fe58407b740 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac005980 tx=0x7fe5ac009040 comp rx=0 tx=0).stop 2026-02-17T21:25:54.233 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.229+0000 7fe5bd56a640 10 monclient: shutdown 2026-02-17T21:25:54.233 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.229+0000 7fe5bd56a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:54.233 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.229+0000 7fe5bd56a640 1 -- 10.20.193.5:0/180491901 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe5b80c7170 msgr2=0x7fe5b80c3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:54.233 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.229+0000 7fe5bd56a640 1 --2- 10.20.193.5:0/180491901 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe5b80c7170 0x7fe5b80c3ca0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0036000 tx=0x7fe5a00047c0 comp rx=0 tx=0).stop 2026-02-17T21:25:54.233 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.229+0000 7fe5bd56a640 1 -- 10.20.193.5:0/180491901 shutdown_connections 2026-02-17T21:25:54.233 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.229+0000 7fe5bd56a640 1 --2- 10.20.193.5:0/180491901 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe584079280 0x7fe58407b740 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:54.234 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.230+0000 7fe5bd56a640 1 --2- 10.20.193.5:0/180491901 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe5b80c7550 0x7fe5b80c2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:54.234 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.230+0000 7fe5bd56a640 1 --2- 10.20.193.5:0/180491901 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe5b80c7170 0x7fe5b80c3ca0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:54.234 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.230+0000 7fe5bd56a640 1 --2- 10.20.193.5:0/180491901 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe5b8074ef0 0x7fe5b80c0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:54.234 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.230+0000 7fe5bd56a640 1 -- 10.20.193.5:0/180491901 >> 10.20.193.5:0/180491901 conn(0x7fe5b80c9f40 msgr2=0x7fe5b814d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:54.234 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.230+0000 7fe5bd56a640 1 -- 10.20.193.5:0/180491901 shutdown_connections 2026-02-17T21:25:54.234 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.230+0000 7fe5bd56a640 1 -- 10.20.193.5:0/180491901 wait complete. 2026-02-17T21:25:54.234 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:54.230+0000 7fe5bd56a640 1 librados: shutdown 2026-02-17T21:25:57.241 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:25:57.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.311+0000 7f0da25eb640 10 monclient: get_monmap_and_config 2026-02-17T21:25:57.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.311+0000 7f0da25eb640 10 monclient: build_initial_monmap 2026-02-17T21:25:57.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.311+0000 7f0da25eb640 10 monclient: monmap: 2026-02-17T21:25:57.313 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:57.314 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:57.314 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:25:57.312316+0000 2026-02-17T21:25:57.314 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:25:57.312316+0000 2026-02-17T21:25:57.314 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:57.314 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:57.314 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:25:57.314 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:25:57.314 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:25:57.314 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:25:57.314 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:25:57.314 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:25:57.315 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:57.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.312+0000 7f0da25eb640 1 Processor -- start 2026-02-17T21:25:57.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.312+0000 7f0da25eb640 1 -- start start 2026-02-17T21:25:57.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.312+0000 7f0da25eb640 10 monclient: init 2026-02-17T21:25:57.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.312+0000 7f0da25eb640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:57.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.312+0000 7f0da25eb640 10 monclient: _add_conns ranks=[0,1,2,5,3,4] 2026-02-17T21:25:57.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.312+0000 7f0da25eb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0d9c0740d0 addr v1:10.20.193.5:6789/0 2026-02-17T21:25:57.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.312+0000 7f0da25eb640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f0d9c15ed60 addr v1:10.20.193.119:6789/0 2026-02-17T21:25:57.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.312+0000 7f0da25eb640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0d9c0744b0 addr v1:10.20.193.135:6789/0 2026-02-17T21:25:57.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.312+0000 7f0da25eb640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d9c15d9e0 con 0x7f0d9c0740d0 2026-02-17T21:25:57.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.312+0000 7f0da25eb640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d9c15dcc0 con 0x7f0d9c15ed60 2026-02-17T21:25:57.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.312+0000 7f0da25eb640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d9c15dfa0 con 0x7f0d9c0744b0 2026-02-17T21:25:57.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.312+0000 7f0da25eb640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:57.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.312+0000 7f0da25eb640 10 monclient(hunting): authenticate will time out at 1062.877851s 2026-02-17T21:25:57.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.313+0000 7f0da0de8640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f0d9c15ed60 0x7f0d9c152080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:47316/0 (socket says 10.20.193.5:47316) 2026-02-17T21:25:57.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.313+0000 7f0da1dea640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f0d9c0744b0 0x7f0d9c15c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:60450/0 (socket says 10.20.193.5:60450) 2026-02-17T21:25:57.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.313+0000 7f0da0de8640 1 -- 10.20.193.5:0/1518176899 learned_addr learned my addr 10.20.193.5:0/1518176899 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:25:57.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.314+0000 7f0d8bfff640 1 -- 10.20.193.5:0/1518176899 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2267464720 0 0) 0x7f0d9c15dcc0 con 0x7f0d9c15ed60 2026-02-17T21:25:57.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.314+0000 7f0d8bfff640 10 monclient(hunting): _negotiate 2026-02-17T21:25:57.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.314+0000 7f0d8bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:57.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.314+0000 7f0d8bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:57.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.314+0000 7f0d8bfff640 10 monclient(hunting): my global_id is 4636 2026-02-17T21:25:57.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.314+0000 7f0d8bfff640 1 -- 10.20.193.5:0/1518176899 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d84003620 con 0x7f0d9c15ed60 2026-02-17T21:25:57.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.314+0000 7f0d8bfff640 1 -- 10.20.193.5:0/1518176899 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2872822154 0 0) 0x7f0d9c15dfa0 con 0x7f0d9c0744b0 2026-02-17T21:25:57.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.314+0000 7f0d8bfff640 10 monclient(hunting): _negotiate 2026-02-17T21:25:57.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.314+0000 7f0d8bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:57.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.314+0000 7f0d8bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:57.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.314+0000 7f0d8bfff640 10 monclient(hunting): my global_id is 4670 2026-02-17T21:25:57.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.314+0000 7f0d8bfff640 1 -- 10.20.193.5:0/1518176899 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d9c15dcc0 con 0x7f0d9c0744b0 2026-02-17T21:25:57.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 1 -- 10.20.193.5:0/1518176899 <== mon.2 v1:10.20.193.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1020160105 0 0) 0x7f0d9c15dcc0 con 0x7f0d9c0744b0 2026-02-17T21:25:57.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 1 -- 10.20.193.5:0/1518176899 >> v1:10.20.193.119:6789/0 conn(0x7f0d9c15ed60 legacy=0x7f0d9c152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:57.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 1 -- 10.20.193.5:0/1518176899 >> v1:10.20.193.5:6789/0 conn(0x7f0d9c0740d0 legacy=0x7f0d9c15d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:57.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 10 monclient: _finish_hunting 0 2026-02-17T21:25:57.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 1 monclient: found mon.noname-c-legacy 2026-02-17T21:25:57.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:57.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.135:6789/0 2026-02-17T21:25:57.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 1 -- 10.20.193.5:0/1518176899 --> v1:10.20.193.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9c15e280 con 0x7f0d9c0744b0 2026-02-17T21:25:57.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 10 monclient: _finish_auth 0 2026-02-17T21:25:57.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 10 monclient: _check_auth_tickets 2026-02-17T21:25:57.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:57.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 1 -- 10.20.193.5:0/1518176899 <== mon.2 v1:10.20.193.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3880376286 0 0) 0x7f0d98003260 con 0x7f0d9c0744b0 2026-02-17T21:25:57.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:57.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T21:25:57.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 10 monclient: dump: 2026-02-17T21:25:57.324 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:57.325 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:57.325 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:57.325 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:57.325 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:57.325 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:57.325 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:57.325 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:57.325 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:57.325 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:57.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 1 monclient: mon.c has (v2) addrs [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] but i'm connected to v1:10.20.193.135:6789/0, reconnecting 2026-02-17T21:25:57.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:57.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 1 -- 10.20.193.5:0/1518176899 >> v1:10.20.193.135:6789/0 conn(0x7f0d9c0744b0 legacy=0x7f0d9c15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:57.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:25:57.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 1 --2- 10.20.193.5:0/1518176899 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0d84004de0 0x7f0d840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:57.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 10 monclient(hunting): picked mon.c con 0x7f0d84004de0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:57.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 1 --2- 10.20.193.5:0/1518176899 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0d840038a0 0x7f0d84003d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:57.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 10 monclient(hunting): picked mon.a con 0x7f0d840038a0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:57.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 1 --2- 10.20.193.5:0/1518176899 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0d84004440 0x7f0d8400bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:57.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 10 monclient(hunting): picked mon.b con 0x7f0d84004440 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:57.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:57.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 1 -- 10.20.193.5:0/1518176899 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8400c3b0 con 0x7f0d840038a0 2026-02-17T21:25:57.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:57.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 1 -- 10.20.193.5:0/1518176899 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8400c560 con 0x7f0d84004440 2026-02-17T21:25:57.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:57.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 1 -- 10.20.193.5:0/1518176899 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8400c760 con 0x7f0d84004de0 2026-02-17T21:25:57.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:57.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.316+0000 7f0d8bfff640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:25:57.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.317+0000 7f0da1dea640 1 --2- 10.20.193.5:0/1518176899 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0d84004440 0x7f0d8400bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:57.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.317+0000 7f0da1dea640 10 monclient(hunting): get_auth_request con 0x7f0d84004440 auth_method 0 2026-02-17T21:25:57.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.317+0000 7f0da1dea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:57.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.317+0000 7f0da1dea640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:57.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.317+0000 7f0da1dea640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:25:57.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.317+0000 7f0da15e9640 1 --2- 10.20.193.5:0/1518176899 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0d84004de0 0x7f0d840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:57.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.317+0000 7f0da1dea640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:57.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.317+0000 7f0da1dea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:57.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.317+0000 7f0da1dea640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:25:57.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.318+0000 7f0da15e9640 10 monclient(hunting): get_auth_request con 0x7f0d84004de0 auth_method 0 2026-02-17T21:25:57.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.318+0000 7f0da15e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:57.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.318+0000 7f0da15e9640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:57.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.318+0000 7f0da15e9640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:25:57.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.318+0000 7f0da1dea640 10 monclient(hunting): handle_auth_done global_id 4670 payload 293 2026-02-17T21:25:57.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.318+0000 7f0da1dea640 1 -- 10.20.193.5:0/1518176899 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0d84004de0 msgr2=0x7f0d840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:57.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.318+0000 7f0da1dea640 1 --2- 10.20.193.5:0/1518176899 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0d84004de0 0x7f0d840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:57.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.318+0000 7f0da1dea640 1 -- 10.20.193.5:0/1518176899 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0d840038a0 msgr2=0x7f0d84003d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:25:57.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.318+0000 7f0da1dea640 1 --2- 10.20.193.5:0/1518176899 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0d840038a0 0x7f0d84003d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:57.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.318+0000 7f0da1dea640 10 monclient: _finish_hunting 0 2026-02-17T21:25:57.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.318+0000 7f0da1dea640 1 monclient: found mon.b 2026-02-17T21:25:57.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.318+0000 7f0da1dea640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:57.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.318+0000 7f0da1dea640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:57.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.318+0000 7f0da1dea640 1 -- 10.20.193.5:0/1518176899 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9c15dcc0 con 0x7f0d84004440 2026-02-17T21:25:57.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.318+0000 7f0da1dea640 10 monclient: _finish_auth 0 2026-02-17T21:25:57.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.318+0000 7f0da1dea640 10 monclient: _check_auth_tickets 2026-02-17T21:25:57.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.318+0000 7f0da1dea640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:57.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.318+0000 7f0da25eb640 5 monclient: authenticate success, global_id 4670 2026-02-17T21:25:57.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.318+0000 7f0da25eb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:25:57.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.319+0000 7f0da1dea640 1 -- 10.20.193.5:0/1518176899 reap_dead start 2026-02-17T21:25:57.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.320+0000 7f0da1dea640 1 --2- 10.20.193.5:0/1518176899 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0d84004440 0x7f0d8400bb00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800a710 tx=0x7f0d9802fac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca32afd2e2a32be3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:57.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.321+0000 7f0d8bfff640 1 -- 10.20.193.5:0/1518176899 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d98039070 con 0x7f0d84004440 2026-02-17T21:25:57.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.321+0000 7f0d8bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:57.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.321+0000 7f0d8bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:57.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.321+0000 7f0d8bfff640 10 monclient: dump: 2026-02-17T21:25:57.330 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:57.330 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:57.330 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:57.330 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:57.330 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:57.330 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:57.330 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:57.330 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:57.330 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:57.331 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:57.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.321+0000 7f0d8bfff640 1 -- 10.20.193.5:0/1518176899 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d980072f0 con 0x7f0d84004440 2026-02-17T21:25:57.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.321+0000 7f0d8bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:57.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.321+0000 7f0d8bfff640 1 -- 10.20.193.5:0/1518176899 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9800a330 con 0x7f0d84004440 2026-02-17T21:25:57.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.321+0000 7f0d8bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:57.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.321+0000 7f0d8bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:57.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.321+0000 7f0d8bfff640 10 monclient: dump: 2026-02-17T21:25:57.332 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:57.332 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:57.332 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:57.332 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:57.332 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:57.332 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:57.332 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:57.332 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:57.332 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:57.332 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:57.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.321+0000 7f0da25eb640 10 monclient: get_monmap_and_config success 2026-02-17T21:25:57.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.321+0000 7f0da25eb640 4 set_mon_vals no callback set 2026-02-17T21:25:57.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.322+0000 7f0da25eb640 10 monclient: shutdown 2026-02-17T21:25:57.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.322+0000 7f0da25eb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:57.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.322+0000 7f0da25eb640 1 -- 10.20.193.5:0/1518176899 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0d84004440 msgr2=0x7f0d8400bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:57.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.322+0000 7f0da25eb640 1 --2- 10.20.193.5:0/1518176899 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0d84004440 0x7f0d8400bb00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800a710 tx=0x7f0d9802fac0 comp rx=0 tx=0).stop 2026-02-17T21:25:57.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.322+0000 7f0da25eb640 1 -- 10.20.193.5:0/1518176899 shutdown_connections 2026-02-17T21:25:57.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.322+0000 7f0da25eb640 1 --2- 10.20.193.5:0/1518176899 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0d84004440 0x7f0d8400bb00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:57.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.322+0000 7f0da25eb640 1 -- 10.20.193.5:0/1518176899 >> 10.20.193.5:0/1518176899 conn(0x7f0d9c0d1d80 msgr2=0x7f0d9c0ce1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:57.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.322+0000 7f0da25eb640 1 -- 10.20.193.5:0/1518176899 shutdown_connections 2026-02-17T21:25:57.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.322+0000 7f0da25eb640 1 -- 10.20.193.5:0/1518176899 wait complete. 2026-02-17T21:25:57.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.323+0000 7f0da25eb640 10 monclient: build_initial_monmap 2026-02-17T21:25:57.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.323+0000 7f0da25eb640 10 monclient: monmap: 2026-02-17T21:25:57.341 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:25:57.341 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:25:57.342 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:25:57.342 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:25:57.342 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:25:57.342 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:57.342 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:25:57.342 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:25:57.342 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:25:57.343 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:57.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.323+0000 7f0da25eb640 1 librados: starting msgr at 2026-02-17T21:25:57.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.323+0000 7f0da25eb640 1 librados: starting objecter 2026-02-17T21:25:57.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.323+0000 7f0da25eb640 1 Processor -- start 2026-02-17T21:25:57.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.323+0000 7f0da25eb640 1 -- start start 2026-02-17T21:25:57.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.323+0000 7f0da25eb640 1 librados: setting wanted keys 2026-02-17T21:25:57.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.323+0000 7f0da25eb640 1 librados: calling monclient init 2026-02-17T21:25:57.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.323+0000 7f0da25eb640 10 monclient: init 2026-02-17T21:25:57.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.323+0000 7f0da25eb640 10 monclient: _reopen_session rank -1 2026-02-17T21:25:57.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.323+0000 7f0da25eb640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:25:57.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.323+0000 7f0da25eb640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0d84004440 0x7f0d9c1533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:57.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.323+0000 7f0da25eb640 10 monclient(hunting): picked mon.noname-b con 0x7f0d84004440 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:25:57.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.323+0000 7f0da25eb640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0d9c1f44e0 0x7f0d9c14e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:57.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.323+0000 7f0da25eb640 10 monclient(hunting): picked mon.noname-a con 0x7f0d9c1f44e0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:25:57.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.323+0000 7f0da25eb640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0d9c14e5b0 0x7f0d9c14ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:57.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.323+0000 7f0da25eb640 10 monclient(hunting): picked mon.noname-c con 0x7f0d9c14e5b0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:25:57.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.323+0000 7f0da25eb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:57.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.323+0000 7f0da25eb640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c159c00 con 0x7f0d9c1f44e0 2026-02-17T21:25:57.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.323+0000 7f0da25eb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:57.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.323+0000 7f0da25eb640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c15e840 con 0x7f0d84004440 2026-02-17T21:25:57.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.323+0000 7f0da25eb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:25:57.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.323+0000 7f0da25eb640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c159d80 con 0x7f0d9c14e5b0 2026-02-17T21:25:57.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.323+0000 7f0da25eb640 10 monclient(hunting): _renew_subs 2026-02-17T21:25:57.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.323+0000 7f0da25eb640 10 monclient(hunting): authenticate will time out at 1062.888743s 2026-02-17T21:25:57.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.324+0000 7f0da15e9640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0d84004440 0x7f0d9c1533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:57.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.324+0000 7f0da1dea640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0d9c14e5b0 0x7f0d9c14ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:57.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.324+0000 7f0da15e9640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0d84004440 0x7f0d9c1533c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:40540/0 (socket says 10.20.193.5:40540) 2026-02-17T21:25:57.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.324+0000 7f0da15e9640 1 -- 10.20.193.5:0/1253854688 learned_addr learned my addr 10.20.193.5:0/1253854688 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:25:57.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.324+0000 7f0da15e9640 10 monclient(hunting): get_auth_request con 0x7f0d84004440 auth_method 0 2026-02-17T21:25:57.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.324+0000 7f0da15e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:57.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.324+0000 7f0da15e9640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:57.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.324+0000 7f0da15e9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:57.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.324+0000 7f0da1dea640 10 monclient(hunting): get_auth_request con 0x7f0d9c14e5b0 auth_method 0 2026-02-17T21:25:57.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.324+0000 7f0da1dea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:25:57.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.324+0000 7f0da1dea640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:25:57.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.324+0000 7f0da1dea640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:25:57.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.324+0000 7f0da15e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:57.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.324+0000 7f0da15e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:57.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.324+0000 7f0da15e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:57.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.324+0000 7f0da1dea640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:25:57.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.324+0000 7f0da1dea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:25:57.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.324+0000 7f0da1dea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:25:57.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.325+0000 7f0da15e9640 10 monclient(hunting): handle_auth_done global_id 4639 payload 824 2026-02-17T21:25:57.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.325+0000 7f0da15e9640 1 -- 10.20.193.5:0/1253854688 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0d9c14e5b0 msgr2=0x7f0d9c14ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:57.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.325+0000 7f0da15e9640 1 --2- 10.20.193.5:0/1253854688 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0d9c14e5b0 0x7f0d9c14ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:57.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.325+0000 7f0da15e9640 1 -- 10.20.193.5:0/1253854688 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0d9c1f44e0 msgr2=0x7f0d9c14e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:57.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.325+0000 7f0da15e9640 1 --2- 10.20.193.5:0/1253854688 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0d9c1f44e0 0x7f0d9c14e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:57.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.325+0000 7f0da15e9640 10 monclient: _finish_hunting 0 2026-02-17T21:25:57.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.325+0000 7f0da15e9640 1 monclient: found mon.noname-b 2026-02-17T21:25:57.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.325+0000 7f0da15e9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:25:57.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.325+0000 7f0da15e9640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:25:57.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.325+0000 7f0da15e9640 1 -- 10.20.193.5:0/1253854688 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9c1f33e0 con 0x7f0d84004440 2026-02-17T21:25:57.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.326+0000 7f0da15e9640 1 --2- 10.20.193.5:0/1253854688 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0d84004440 0x7f0d9c1533c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00e580 tx=0x7f0d8c00ea50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:57.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.326+0000 7f0d89ffb640 10 client.?.objecter ms_handle_connect 0x7f0d84004440 2026-02-17T21:25:57.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.326+0000 7f0d89ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:25:57.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.327+0000 7f0d89ffb640 1 -- 10.20.193.5:0/1253854688 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c0135f0 con 0x7f0d84004440 2026-02-17T21:25:57.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.327+0000 7f0d89ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:57.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.327+0000 7f0d89ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:25:57.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.327+0000 7f0d89ffb640 10 monclient: dump: 2026-02-17T21:25:57.348 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:57.348 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:57.348 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:57.348 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:57.348 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:57.348 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:57.348 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:57.348 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:57.348 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:57.348 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:57.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.327+0000 7f0d89ffb640 10 monclient: _finish_auth 0 2026-02-17T21:25:57.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.327+0000 7f0d89ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:25:57.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.327+0000 7f0d89ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:25:57.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.327+0000 7f0da25eb640 5 monclient: authenticate success, global_id 4639 2026-02-17T21:25:57.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.327+0000 7f0da25eb640 10 monclient: _renew_subs 2026-02-17T21:25:57.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.327+0000 7f0da25eb640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:57.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.327+0000 7f0da25eb640 1 -- 10.20.193.5:0/1253854688 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d9c152040 con 0x7f0d84004440 2026-02-17T21:25:57.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.327+0000 7f0da25eb640 10 client.4639.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:25:57.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.327+0000 7f0da25eb640 10 monclient: _renew_subs 2026-02-17T21:25:57.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.327+0000 7f0da25eb640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:57.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.327+0000 7f0da25eb640 1 -- 10.20.193.5:0/1253854688 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d9c152600 con 0x7f0d84004440 2026-02-17T21:25:57.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.327+0000 7f0da25eb640 1 librados: init done 2026-02-17T21:25:57.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.328+0000 7f0da25eb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:57.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.328+0000 7f0da25eb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:57.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.328+0000 7f0da25eb640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:57.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.328+0000 7f0da25eb640 1 -- 10.20.193.5:0/1253854688 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d9c15d180 con 0x7f0d84004440 2026-02-17T21:25:57.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.328+0000 7f0d89ffb640 1 -- 10.20.193.5:0/1253854688 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d8c01a070 con 0x7f0d84004440 2026-02-17T21:25:57.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.328+0000 7f0d89ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:25:57.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.328+0000 7f0d89ffb640 1 -- 10.20.193.5:0/1253854688 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c013990 con 0x7f0d84004440 2026-02-17T21:25:57.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.328+0000 7f0d89ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:25:57.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.328+0000 7f0d89ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:25:57.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.328+0000 7f0d89ffb640 10 monclient: dump: 2026-02-17T21:25:57.351 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:25:57.351 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:25:57.351 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:57.351 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:25:57.351 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:25:57.351 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:25:57.351 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:25:57.351 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:25:57.351 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:25:57.351 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:25:57.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.328+0000 7f0d8b7fe640 4 set_mon_vals no callback set 2026-02-17T21:25:57.352 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:02:36.975 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:57.353 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:02:36.978 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:57.363 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:02:36.988 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:57.379 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:02:36.965 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:57.391 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:02:36.977 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:57.402 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:02:36.988 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:57.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.435+0000 7f0d89ffb640 1 -- 10.20.193.5:0/1253854688 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f0d8c014070 con 0x7f0d84004440 2026-02-17T21:25:57.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.436+0000 7f0d89ffb640 1 --2- 10.20.193.5:0/1253854688 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0d6c0792b0 0x7f0d6c07b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:25:57.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.436+0000 7f0da0de8640 1 --2- 10.20.193.5:0/1253854688 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0d6c0792b0 0x7f0d6c07b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:25:57.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.436+0000 7f0da0de8640 10 monclient: get_auth_request con 0x7f0d6c0792b0 auth_method 0 2026-02-17T21:25:57.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.437+0000 7f0d89ffb640 10 client.4639.objecter ms_handle_connect 0x7f0d6c0792b0 2026-02-17T21:25:57.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.437+0000 7f0da0de8640 1 --2- 10.20.193.5:0/1253854688 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0d6c0792b0 0x7f0d6c07b770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0d90005980 tx=0x7f0d90007a80 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:25:57.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.438+0000 7f0d89ffb640 1 -- 10.20.193.5:0/1253854688 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f0d8c05e750 con 0x7f0d84004440 2026-02-17T21:25:57.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.438+0000 7f0d89ffb640 10 client.4639.objecter ms_dispatch2 0x7f0d9c000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:25:57.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.438+0000 7f0d89ffb640 3 client.4639.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:25:57.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.438+0000 7f0d89ffb640 3 client.4639.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:25:57.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.438+0000 7f0d89ffb640 20 client.4639.objecter dump_active .. 0 homeless 2026-02-17T21:25:57.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.444+0000 7f0d89ffb640 1 -- 10.20.193.5:0/1253854688 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0d8c062e10 con 0x7f0d84004440 2026-02-17T21:25:57.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.444+0000 7f0d89ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:25:57.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.444+0000 7f0d89ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:25:57.476 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:02:37.100 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:57.477 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:02:37.101 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:57.488 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:02:37.111 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:25:57.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.547+0000 7f0da25eb640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:25:57.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.547+0000 7f0da25eb640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:25:57.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.547+0000 7f0da25eb640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:25:57.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.547+0000 7f0da25eb640 1 -- 10.20.193.5:0/1253854688 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0d9c0d01b0 con 0x7f0d84004440 2026-02-17T21:25:57.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.558+0000 7f0d89ffb640 1 -- 10.20.193.5:0/1253854688 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f0d8c062710 con 0x7f0d84004440 2026-02-17T21:25:57.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.558+0000 7f0d89ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:25:57.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.558+0000 7f0d89ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:25:57.559 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:25:57.559 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:25:57.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.558+0000 7f0da25eb640 10 librados: watch_flush enter 2026-02-17T21:25:57.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.558+0000 7f0da25eb640 10 librados: watch_flush exit 2026-02-17T21:25:57.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.558+0000 7f0da25eb640 20 client.4639.objecter shutdown clearing up homeless session... 2026-02-17T21:25:57.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.558+0000 7f0da25eb640 10 client.4639.objecter successfully canceled tick 2026-02-17T21:25:57.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.558+0000 7f0da25eb640 1 -- 10.20.193.5:0/1253854688 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0d6c0792b0 msgr2=0x7f0d6c07b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:57.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.558+0000 7f0da25eb640 1 --2- 10.20.193.5:0/1253854688 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0d6c0792b0 0x7f0d6c07b770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0d90005980 tx=0x7f0d90007a80 comp rx=0 tx=0).stop 2026-02-17T21:25:57.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.558+0000 7f0da25eb640 10 monclient: shutdown 2026-02-17T21:25:57.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.558+0000 7f0da25eb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:25:57.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.558+0000 7f0da25eb640 1 -- 10.20.193.5:0/1253854688 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0d84004440 msgr2=0x7f0d9c1533c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:25:57.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.558+0000 7f0da25eb640 1 --2- 10.20.193.5:0/1253854688 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0d84004440 0x7f0d9c1533c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00e580 tx=0x7f0d8c00ea50 comp rx=0 tx=0).stop 2026-02-17T21:25:57.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.558+0000 7f0da25eb640 1 -- 10.20.193.5:0/1253854688 shutdown_connections 2026-02-17T21:25:57.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.558+0000 7f0da25eb640 1 --2- 10.20.193.5:0/1253854688 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0d6c0792b0 0x7f0d6c07b770 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:57.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.558+0000 7f0da25eb640 1 --2- 10.20.193.5:0/1253854688 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0d9c14e5b0 0x7f0d9c14ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:57.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.558+0000 7f0da25eb640 1 --2- 10.20.193.5:0/1253854688 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0d9c1f44e0 0x7f0d9c14e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:57.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.558+0000 7f0da25eb640 1 --2- 10.20.193.5:0/1253854688 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0d84004440 0x7f0d9c1533c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:25:57.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.558+0000 7f0da25eb640 1 -- 10.20.193.5:0/1253854688 >> 10.20.193.5:0/1253854688 conn(0x7f0d9c0d1d80 msgr2=0x7f0d9c14f690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:25:57.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.558+0000 7f0da25eb640 1 -- 10.20.193.5:0/1253854688 shutdown_connections 2026-02-17T21:25:57.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.558+0000 7f0da25eb640 1 -- 10.20.193.5:0/1253854688 wait complete. 2026-02-17T21:25:57.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:25:57.558+0000 7f0da25eb640 1 librados: shutdown 2026-02-17T21:26:00.571 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:26:00.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.638+0000 7f2e87bce640 10 monclient: get_monmap_and_config 2026-02-17T21:26:00.641 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.638+0000 7f2e87bce640 10 monclient: build_initial_monmap 2026-02-17T21:26:00.641 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.638+0000 7f2e87bce640 10 monclient: monmap: 2026-02-17T21:26:00.641 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:00.641 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:00.641 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:26:00.639842+0000 2026-02-17T21:26:00.641 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:26:00.639842+0000 2026-02-17T21:26:00.641 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:00.641 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:00.641 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:26:00.642 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:26:00.642 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:26:00.642 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:26:00.642 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:26:00.642 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:26:00.642 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:00.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.638+0000 7f2e87bce640 1 Processor -- start 2026-02-17T21:26:00.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.638+0000 7f2e87bce640 1 -- start start 2026-02-17T21:26:00.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.638+0000 7f2e87bce640 10 monclient: init 2026-02-17T21:26:00.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.639+0000 7f2e87bce640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:00.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.639+0000 7f2e87bce640 10 monclient: _add_conns ranks=[2,3,1,4,0,5] 2026-02-17T21:26:00.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.639+0000 7f2e87bce640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2e8015d370 addr v1:10.20.193.135:6789/0 2026-02-17T21:26:00.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.639+0000 7f2e87bce640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f2e800c7e20 0x7f2e8015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:00.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.639+0000 7f2e87bce640 10 monclient(hunting): picked mon.noname-a con 0x7f2e800c7e20 addr v2:10.20.193.5:3300/0 2026-02-17T21:26:00.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.639+0000 7f2e87bce640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f2e800c74c0 addr v1:10.20.193.119:6789/0 2026-02-17T21:26:00.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.639+0000 7f2e87bce640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e800c8350 con 0x7f2e800c74c0 2026-02-17T21:26:00.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.639+0000 7f2e87bce640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e800c8630 con 0x7f2e8015d370 2026-02-17T21:26:00.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.639+0000 7f2e87bce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:00.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.639+0000 7f2e87bce640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2e8015b710 con 0x7f2e800c7e20 2026-02-17T21:26:00.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.639+0000 7f2e87bce640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:00.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.639+0000 7f2e87bce640 10 monclient(hunting): authenticate will time out at 1066.205258s 2026-02-17T21:26:00.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.639+0000 7f2e85142640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f2e800c7e20 0x7f2e8015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:00.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.639+0000 7f2e85943640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f2e8015d370 0x7f2e8015b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:60466/0 (socket says 10.20.193.5:60466) 2026-02-17T21:26:00.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.639+0000 7f2e85943640 1 -- 10.20.193.5:0/535636826 learned_addr learned my addr 10.20.193.5:0/535636826 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:26:00.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.639+0000 7f2e85142640 10 monclient(hunting): get_auth_request con 0x7f2e800c7e20 auth_method 0 2026-02-17T21:26:00.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.639+0000 7f2e85142640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:00.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.639+0000 7f2e85142640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:00.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.639+0000 7f2e85142640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:00.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.640+0000 7f2e85142640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:00.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.640+0000 7f2e85142640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:00.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.640+0000 7f2e85142640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:00.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.641+0000 7f2e84941640 1 -- 10.20.193.5:0/535636826 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 22290144 0 0) 0x7f2e800c8630 con 0x7f2e8015d370 2026-02-17T21:26:00.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.641+0000 7f2e84941640 10 monclient(hunting): _negotiate 2026-02-17T21:26:00.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.641+0000 7f2e84941640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:00.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.641+0000 7f2e84941640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:00.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.641+0000 7f2e84941640 10 monclient(hunting): my global_id is 4676 2026-02-17T21:26:00.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.641+0000 7f2e84941640 1 -- 10.20.193.5:0/535636826 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e68003620 con 0x7f2e8015d370 2026-02-17T21:26:00.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.641+0000 7f2e85142640 10 monclient(hunting): handle_auth_done global_id 4617 payload 274 2026-02-17T21:26:00.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.641+0000 7f2e85142640 1 -- 10.20.193.5:0/535636826 >> v1:10.20.193.135:6789/0 conn(0x7f2e8015d370 legacy=0x7f2e8015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:00.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.641+0000 7f2e85142640 1 -- 10.20.193.5:0/535636826 >> v1:10.20.193.119:6789/0 conn(0x7f2e800c74c0 legacy=0x7f2e800c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:00.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.641+0000 7f2e85142640 10 monclient: _finish_hunting 0 2026-02-17T21:26:00.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.641+0000 7f2e85142640 1 monclient: found mon.noname-a 2026-02-17T21:26:00.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.641+0000 7f2e85142640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:00.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.641+0000 7f2e85142640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:26:00.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.641+0000 7f2e85142640 1 -- 10.20.193.5:0/535636826 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e800c8910 con 0x7f2e800c7e20 2026-02-17T21:26:00.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.642+0000 7f2e85142640 1 --2- 10.20.193.5:0/535636826 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2e800c7e20 0x7f2e8015d750 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2e740098a0 tx=0x7f2e7402ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee6c20733fe000f0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:00.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.644+0000 7f2e84941640 1 -- 10.20.193.5:0/535636826 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7403c070 con 0x7f2e800c7e20 2026-02-17T21:26:00.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.644+0000 7f2e84941640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:00.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.644+0000 7f2e84941640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:26:00.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.644+0000 7f2e84941640 10 monclient: dump: 2026-02-17T21:26:00.658 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:00.658 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:00.658 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:00.658 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:00.658 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:00.658 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:00.658 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:00.658 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:00.658 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:00.658 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:00.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.644+0000 7f2e84941640 10 monclient: _finish_auth 0 2026-02-17T21:26:00.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.644+0000 7f2e84941640 10 monclient: _check_auth_tickets 2026-02-17T21:26:00.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.644+0000 7f2e84941640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:00.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.644+0000 7f2e84941640 1 -- 10.20.193.5:0/535636826 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7402fb70 con 0x7f2e800c7e20 2026-02-17T21:26:00.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.644+0000 7f2e84941640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:00.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.644+0000 7f2e84941640 1 -- 10.20.193.5:0/535636826 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e74037440 con 0x7f2e800c7e20 2026-02-17T21:26:00.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.644+0000 7f2e84941640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:00.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.644+0000 7f2e84941640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:26:00.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.644+0000 7f2e84941640 10 monclient: dump: 2026-02-17T21:26:00.659 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:00.659 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:00.660 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:00.660 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:00.660 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:00.660 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:00.660 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:00.660 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:00.660 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:00.660 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:00.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.644+0000 7f2e87bce640 5 monclient: authenticate success, global_id 4617 2026-02-17T21:26:00.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.644+0000 7f2e87bce640 10 monclient: get_monmap_and_config success 2026-02-17T21:26:00.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.644+0000 7f2e87bce640 4 set_mon_vals no callback set 2026-02-17T21:26:00.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.644+0000 7f2e87bce640 10 monclient: shutdown 2026-02-17T21:26:00.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.644+0000 7f2e87bce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:00.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.644+0000 7f2e87bce640 1 -- 10.20.193.5:0/535636826 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2e800c7e20 msgr2=0x7f2e8015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:00.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.644+0000 7f2e87bce640 1 --2- 10.20.193.5:0/535636826 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2e800c7e20 0x7f2e8015d750 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2e740098a0 tx=0x7f2e7402ee60 comp rx=0 tx=0).stop 2026-02-17T21:26:00.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.644+0000 7f2e87bce640 1 -- 10.20.193.5:0/535636826 shutdown_connections 2026-02-17T21:26:00.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.644+0000 7f2e87bce640 1 --2- 10.20.193.5:0/535636826 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2e800c7e20 0x7f2e8015d750 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:00.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.644+0000 7f2e87bce640 1 -- 10.20.193.5:0/535636826 >> 10.20.193.5:0/535636826 conn(0x7f2e800c9f20 msgr2=0x7f2e800ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:00.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.644+0000 7f2e87bce640 1 -- 10.20.193.5:0/535636826 shutdown_connections 2026-02-17T21:26:00.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.644+0000 7f2e87bce640 1 -- 10.20.193.5:0/535636826 wait complete. 2026-02-17T21:26:00.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.645+0000 7f2e87bce640 10 monclient: build_initial_monmap 2026-02-17T21:26:00.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.645+0000 7f2e87bce640 10 monclient: monmap: 2026-02-17T21:26:00.662 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:00.662 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:26:00.662 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:26:00.662 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:26:00.662 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:00.662 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:00.662 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:26:00.662 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:26:00.662 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:26:00.663 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:00.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.645+0000 7f2e87bce640 1 librados: starting msgr at 2026-02-17T21:26:00.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.645+0000 7f2e87bce640 1 librados: starting objecter 2026-02-17T21:26:00.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.645+0000 7f2e87bce640 1 Processor -- start 2026-02-17T21:26:00.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.645+0000 7f2e87bce640 1 -- start start 2026-02-17T21:26:00.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.645+0000 7f2e87bce640 1 librados: setting wanted keys 2026-02-17T21:26:00.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.645+0000 7f2e87bce640 1 librados: calling monclient init 2026-02-17T21:26:00.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.645+0000 7f2e87bce640 10 monclient: init 2026-02-17T21:26:00.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.645+0000 7f2e87bce640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:00.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.645+0000 7f2e87bce640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:26:00.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.645+0000 7f2e87bce640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2e800c74c0 0x7f2e80073c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:00.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.645+0000 7f2e87bce640 10 monclient(hunting): picked mon.noname-c con 0x7f2e800c74c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:26:00.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.645+0000 7f2e87bce640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2e800c7e20 0x7f2e8014d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:00.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.645+0000 7f2e87bce640 10 monclient(hunting): picked mon.noname-a con 0x7f2e800c7e20 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:26:00.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.645+0000 7f2e87bce640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e8015d370 0x7f2e80159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:00.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.645+0000 7f2e87bce640 10 monclient(hunting): picked mon.noname-b con 0x7f2e8015d370 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:26:00.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.645+0000 7f2e87bce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:00.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.645+0000 7f2e87bce640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2e800c8ed0 con 0x7f2e800c7e20 2026-02-17T21:26:00.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.645+0000 7f2e87bce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:00.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.645+0000 7f2e87bce640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2e800c9240 con 0x7f2e8015d370 2026-02-17T21:26:00.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.645+0000 7f2e87bce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:00.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.645+0000 7f2e87bce640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2e800c96d0 con 0x7f2e800c74c0 2026-02-17T21:26:00.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.645+0000 7f2e87bce640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:00.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.645+0000 7f2e87bce640 10 monclient(hunting): authenticate will time out at 1066.211772s 2026-02-17T21:26:00.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e85142640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2e800c7e20 0x7f2e8014d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:00.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e86144640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e8015d370 0x7f2e80159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:00.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e85943640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2e800c74c0 0x7f2e80073c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:00.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e85142640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2e800c7e20 0x7f2e8014d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:44394/0 (socket says 10.20.193.5:44394) 2026-02-17T21:26:00.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e85142640 1 -- 10.20.193.5:0/4199668461 learned_addr learned my addr 10.20.193.5:0/4199668461 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:26:00.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e85142640 10 monclient(hunting): get_auth_request con 0x7f2e800c7e20 auth_method 0 2026-02-17T21:26:00.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e85142640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:00.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e85142640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:00.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e85142640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:00.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e86144640 10 monclient(hunting): get_auth_request con 0x7f2e8015d370 auth_method 0 2026-02-17T21:26:00.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e86144640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:00.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e86144640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:00.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e86144640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:00.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e85943640 10 monclient(hunting): get_auth_request con 0x7f2e800c74c0 auth_method 0 2026-02-17T21:26:00.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e85943640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:00.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e85943640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:00.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e85943640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:00.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e85142640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:00.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e85142640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:00.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e85142640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:00.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e86144640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:00.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e86144640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:00.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e86144640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:00.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e85943640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:00.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e85943640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:00.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.646+0000 7f2e85943640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:00.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.647+0000 7f2e86144640 10 monclient(hunting): handle_auth_done global_id 4645 payload 824 2026-02-17T21:26:00.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.647+0000 7f2e86144640 1 -- 10.20.193.5:0/4199668461 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2e800c74c0 msgr2=0x7f2e80073c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:00.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.647+0000 7f2e86144640 1 --2- 10.20.193.5:0/4199668461 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2e800c74c0 0x7f2e80073c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:00.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.647+0000 7f2e86144640 1 -- 10.20.193.5:0/4199668461 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2e800c7e20 msgr2=0x7f2e8014d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:00.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.647+0000 7f2e86144640 1 --2- 10.20.193.5:0/4199668461 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2e800c7e20 0x7f2e8014d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:00.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.647+0000 7f2e86144640 10 monclient: _finish_hunting 0 2026-02-17T21:26:00.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.647+0000 7f2e86144640 1 monclient: found mon.noname-b 2026-02-17T21:26:00.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.647+0000 7f2e86144640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:00.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.647+0000 7f2e86144640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:26:00.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.647+0000 7f2e86144640 1 -- 10.20.193.5:0/4199668461 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e80074270 con 0x7f2e8015d370 2026-02-17T21:26:00.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.649+0000 7f2e86144640 1 --2- 10.20.193.5:0/4199668461 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e8015d370 0x7f2e80159340 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c00cbc0 tx=0x7f2e7c00a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:00.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.649+0000 7f2e6e7fc640 10 client.?.objecter ms_handle_connect 0x7f2e8015d370 2026-02-17T21:26:00.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.649+0000 7f2e6e7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:26:00.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.650+0000 7f2e6e7fc640 1 -- 10.20.193.5:0/4199668461 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c00ad50 con 0x7f2e8015d370 2026-02-17T21:26:00.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.650+0000 7f2e6e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:00.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.650+0000 7f2e6e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:26:00.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.650+0000 7f2e6e7fc640 10 monclient: dump: 2026-02-17T21:26:00.669 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:00.669 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:00.669 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:00.669 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:00.669 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:00.669 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:00.669 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:00.669 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:00.669 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:00.669 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:00.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.650+0000 7f2e6e7fc640 10 monclient: _finish_auth 0 2026-02-17T21:26:00.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.650+0000 7f2e6e7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:26:00.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.650+0000 7f2e6e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:00.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.650+0000 7f2e6e7fc640 1 -- 10.20.193.5:0/4199668461 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7c003a30 con 0x7f2e8015d370 2026-02-17T21:26:00.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.650+0000 7f2e87bce640 5 monclient: authenticate success, global_id 4645 2026-02-17T21:26:00.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.650+0000 7f2e87bce640 10 monclient: _renew_subs 2026-02-17T21:26:00.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.650+0000 7f2e87bce640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:26:00.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.650+0000 7f2e87bce640 1 -- 10.20.193.5:0/4199668461 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e80074550 con 0x7f2e8015d370 2026-02-17T21:26:00.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.650+0000 7f2e6e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:00.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.650+0000 7f2e6e7fc640 1 -- 10.20.193.5:0/4199668461 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c003e40 con 0x7f2e8015d370 2026-02-17T21:26:00.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.650+0000 7f2e6e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:00.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.650+0000 7f2e6e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:26:00.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.650+0000 7f2e6e7fc640 10 monclient: dump: 2026-02-17T21:26:00.671 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:00.671 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:00.671 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:00.671 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:00.671 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:00.671 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:00.671 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:00.671 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:00.672 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:00.672 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:00.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.650+0000 7f2e6ffff640 4 set_mon_vals no callback set 2026-02-17T21:26:00.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.650+0000 7f2e87bce640 10 client.4645.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:26:00.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.650+0000 7f2e87bce640 10 monclient: _renew_subs 2026-02-17T21:26:00.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.650+0000 7f2e87bce640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:26:00.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.650+0000 7f2e87bce640 1 -- 10.20.193.5:0/4199668461 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e80074b10 con 0x7f2e8015d370 2026-02-17T21:26:00.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.650+0000 7f2e87bce640 1 librados: init done 2026-02-17T21:26:00.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.651+0000 7f2e87bce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:00.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.651+0000 7f2e87bce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:00.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.651+0000 7f2e87bce640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:26:00.673 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.651+0000 7f2e87bce640 1 -- 10.20.193.5:0/4199668461 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e800c7af0 con 0x7f2e8015d370 2026-02-17T21:26:00.674 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.663+0000 7f2e6e7fc640 1 -- 10.20.193.5:0/4199668461 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f2e7c0052e0 con 0x7f2e8015d370 2026-02-17T21:26:00.674 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.663+0000 7f2e6e7fc640 1 --2- 10.20.193.5:0/4199668461 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2e50079280 0x7f2e5007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:00.674 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.663+0000 7f2e85943640 1 --2- 10.20.193.5:0/4199668461 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2e50079280 0x7f2e5007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:00.674 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.663+0000 7f2e85943640 10 monclient: get_auth_request con 0x7f2e50079280 auth_method 0 2026-02-17T21:26:00.675 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.664+0000 7f2e85943640 1 --2- 10.20.193.5:0/4199668461 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2e50079280 0x7f2e5007b740 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2e70007b60 tx=0x7f2e70007ab0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:00.675 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.664+0000 7f2e6e7fc640 10 client.4645.objecter ms_handle_connect 0x7f2e50079280 2026-02-17T21:26:00.675 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.665+0000 7f2e6e7fc640 1 -- 10.20.193.5:0/4199668461 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f2e7c05ec90 con 0x7f2e8015d370 2026-02-17T21:26:00.675 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.665+0000 7f2e6e7fc640 10 client.4645.objecter ms_dispatch2 0x7f2e80000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:26:00.675 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.665+0000 7f2e6e7fc640 3 client.4645.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:26:00.675 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.665+0000 7f2e6e7fc640 3 client.4645.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:26:00.675 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.665+0000 7f2e6e7fc640 20 client.4645.objecter dump_active .. 0 homeless 2026-02-17T21:26:00.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.765+0000 7f2e6e7fc640 1 -- 10.20.193.5:0/4199668461 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2e800c7af0 con 0x7f2e8015d370 2026-02-17T21:26:00.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.765+0000 7f2e6e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:00.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.765+0000 7f2e6e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:26:00.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.863+0000 7f2e87bce640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:26:00.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.863+0000 7f2e87bce640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:00.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.863+0000 7f2e87bce640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:26:00.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.863+0000 7f2e87bce640 1 -- 10.20.193.5:0/4199668461 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2e80150b00 con 0x7f2e8015d370 2026-02-17T21:26:00.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.866+0000 7f2e6e7fc640 1 -- 10.20.193.5:0/4199668461 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f2e80150b00 con 0x7f2e8015d370 2026-02-17T21:26:00.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.866+0000 7f2e6e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:00.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.866+0000 7f2e6e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:26:00.869 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:26:00.869 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:26:00.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.867+0000 7f2e87bce640 10 librados: watch_flush enter 2026-02-17T21:26:00.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.867+0000 7f2e87bce640 10 librados: watch_flush exit 2026-02-17T21:26:00.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.867+0000 7f2e87bce640 20 client.4645.objecter shutdown clearing up homeless session... 2026-02-17T21:26:00.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.867+0000 7f2e87bce640 10 client.4645.objecter successfully canceled tick 2026-02-17T21:26:00.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.867+0000 7f2e87bce640 1 -- 10.20.193.5:0/4199668461 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2e50079280 msgr2=0x7f2e5007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:00.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.867+0000 7f2e87bce640 1 --2- 10.20.193.5:0/4199668461 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2e50079280 0x7f2e5007b740 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2e70007b60 tx=0x7f2e70007ab0 comp rx=0 tx=0).stop 2026-02-17T21:26:00.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.867+0000 7f2e87bce640 10 monclient: shutdown 2026-02-17T21:26:00.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.867+0000 7f2e87bce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:00.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.867+0000 7f2e87bce640 1 -- 10.20.193.5:0/4199668461 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e8015d370 msgr2=0x7f2e80159340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:00.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.867+0000 7f2e87bce640 1 --2- 10.20.193.5:0/4199668461 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e8015d370 0x7f2e80159340 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c00cbc0 tx=0x7f2e7c00a430 comp rx=0 tx=0).stop 2026-02-17T21:26:00.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.867+0000 7f2e87bce640 1 -- 10.20.193.5:0/4199668461 shutdown_connections 2026-02-17T21:26:00.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.867+0000 7f2e87bce640 1 --2- 10.20.193.5:0/4199668461 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2e50079280 0x7f2e5007b740 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:00.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.867+0000 7f2e87bce640 1 --2- 10.20.193.5:0/4199668461 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e8015d370 0x7f2e80159340 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:00.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.867+0000 7f2e87bce640 1 --2- 10.20.193.5:0/4199668461 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2e800c7e20 0x7f2e8014d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:00.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.867+0000 7f2e87bce640 1 --2- 10.20.193.5:0/4199668461 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2e800c74c0 0x7f2e80073c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:00.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.867+0000 7f2e87bce640 1 -- 10.20.193.5:0/4199668461 >> 10.20.193.5:0/4199668461 conn(0x7f2e800c9f20 msgr2=0x7f2e800ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:00.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.867+0000 7f2e87bce640 1 -- 10.20.193.5:0/4199668461 shutdown_connections 2026-02-17T21:26:00.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.867+0000 7f2e87bce640 1 -- 10.20.193.5:0/4199668461 wait complete. 2026-02-17T21:26:00.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:00.867+0000 7f2e87bce640 1 librados: shutdown 2026-02-17T21:26:03.879 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:26:03.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.945+0000 7f7ae6ada640 10 monclient: get_monmap_and_config 2026-02-17T21:26:03.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.945+0000 7f7ae6ada640 10 monclient: build_initial_monmap 2026-02-17T21:26:03.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.945+0000 7f7ae6ada640 10 monclient: monmap: 2026-02-17T21:26:03.949 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:03.949 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:03.949 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:26:03.947591+0000 2026-02-17T21:26:03.949 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:26:03.947591+0000 2026-02-17T21:26:03.949 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:03.949 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:03.949 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:26:03.949 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:26:03.949 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:26:03.949 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:26:03.949 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:26:03.950 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:26:03.950 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:03.953 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.946+0000 7f7ae6ada640 1 Processor -- start 2026-02-17T21:26:03.953 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.946+0000 7f7ae6ada640 1 -- start start 2026-02-17T21:26:03.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.946+0000 7f7ae6ada640 10 monclient: init 2026-02-17T21:26:03.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.946+0000 7f7ae6ada640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:03.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.946+0000 7f7ae6ada640 10 monclient: _add_conns ranks=[2,3,4,0,1,5] 2026-02-17T21:26:03.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.946+0000 7f7ae6ada640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7ae015d370 addr v1:10.20.193.135:6789/0 2026-02-17T21:26:03.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.946+0000 7f7ae6ada640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f7ae00c7e20 0x7f7ae015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:03.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.946+0000 7f7ae6ada640 10 monclient(hunting): picked mon.noname-a con 0x7f7ae00c7e20 addr v2:10.20.193.5:3300/0 2026-02-17T21:26:03.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.946+0000 7f7ae6ada640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f7ae00c74c0 0x7f7ae00c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:03.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.946+0000 7f7ae6ada640 10 monclient(hunting): picked mon.noname-b con 0x7f7ae00c74c0 addr v2:10.20.193.119:3300/0 2026-02-17T21:26:03.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.946+0000 7f7ae6ada640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ae00c8350 con 0x7f7ae015d370 2026-02-17T21:26:03.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.946+0000 7f7ae6ada640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:03.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.946+0000 7f7ae6ada640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7ae015b710 con 0x7f7ae00c7e20 2026-02-17T21:26:03.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.946+0000 7f7ae6ada640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:03.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.946+0000 7f7ae6ada640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f7ae00c9240 con 0x7f7ae00c74c0 2026-02-17T21:26:03.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.946+0000 7f7ae6ada640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:03.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.946+0000 7f7ae6ada640 10 monclient(hunting): authenticate will time out at 1069.512982s 2026-02-17T21:26:03.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.947+0000 7f7ae484f640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f7ae015d370 0x7f7ae015b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:60470/0 (socket says 10.20.193.5:60470) 2026-02-17T21:26:03.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.947+0000 7f7ae484f640 1 -- 10.20.193.5:0/173076558 learned_addr learned my addr 10.20.193.5:0/173076558 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:26:03.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.947+0000 7f7ad7fff640 1 --2- 10.20.193.5:0/173076558 >> v2:10.20.193.5:3300/0 conn(0x7f7ae00c7e20 0x7f7ae015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:03.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.947+0000 7f7ae5050640 1 --2- 10.20.193.5:0/173076558 >> v2:10.20.193.119:3300/0 conn(0x7f7ae00c74c0 0x7f7ae00c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:03.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.947+0000 7f7ad7fff640 10 monclient(hunting): get_auth_request con 0x7f7ae00c7e20 auth_method 0 2026-02-17T21:26:03.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.947+0000 7f7ad7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:03.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.947+0000 7f7ad7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:03.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.947+0000 7f7ad7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:03.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.947+0000 7f7ae5050640 10 monclient(hunting): get_auth_request con 0x7f7ae00c74c0 auth_method 0 2026-02-17T21:26:03.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.947+0000 7f7ae5050640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:03.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.947+0000 7f7ae5050640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:03.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.947+0000 7f7ae5050640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:03.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.948+0000 7f7ad7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:03.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.948+0000 7f7ad7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:03.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.948+0000 7f7ad7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:03.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.948+0000 7f7ae5050640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:03.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.948+0000 7f7ae5050640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:03.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.948+0000 7f7ae5050640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:03.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.948+0000 7f7ad77fe640 1 -- 10.20.193.5:0/173076558 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 113903390 0 0) 0x7f7ae00c8350 con 0x7f7ae015d370 2026-02-17T21:26:03.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.948+0000 7f7ad77fe640 10 monclient(hunting): _negotiate 2026-02-17T21:26:03.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.948+0000 7f7ad77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:03.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.948+0000 7f7ad77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:03.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.948+0000 7f7ad77fe640 10 monclient(hunting): my global_id is 4682 2026-02-17T21:26:03.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.948+0000 7f7ad77fe640 1 -- 10.20.193.5:0/173076558 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7acc003620 con 0x7f7ae015d370 2026-02-17T21:26:03.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.949+0000 7f7ae5050640 10 monclient(hunting): handle_auth_done global_id 4648 payload 274 2026-02-17T21:26:03.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.949+0000 7f7ae5050640 1 -- 10.20.193.5:0/173076558 >> v2:10.20.193.5:3300/0 conn(0x7f7ae00c7e20 msgr2=0x7f7ae015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:26:03.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.949+0000 7f7ae5050640 1 --2- 10.20.193.5:0/173076558 >> v2:10.20.193.5:3300/0 conn(0x7f7ae00c7e20 0x7f7ae015d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:03.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.949+0000 7f7ae5050640 1 -- 10.20.193.5:0/173076558 >> v1:10.20.193.135:6789/0 conn(0x7f7ae015d370 legacy=0x7f7ae015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:03.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.949+0000 7f7ae5050640 10 monclient: _finish_hunting 0 2026-02-17T21:26:03.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.949+0000 7f7ae5050640 1 monclient: found mon.noname-b 2026-02-17T21:26:03.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.949+0000 7f7ae5050640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:03.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.949+0000 7f7ae5050640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:26:03.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.949+0000 7f7ae5050640 1 -- 10.20.193.5:0/173076558 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae00c8630 con 0x7f7ae00c74c0 2026-02-17T21:26:03.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.950+0000 7f7ae5050640 1 --2- 10.20.193.5:0/173076558 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7ae00c74c0 0x7f7ae00c52b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7ae015dcf0 tx=0x7f7adc02f1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3c5392003413c8d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:03.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.951+0000 7f7ad77fe640 1 -- 10.20.193.5:0/173076558 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7adc03c070 con 0x7f7ae00c74c0 2026-02-17T21:26:03.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.951+0000 7f7ad77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:03.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.951+0000 7f7ad77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:26:03.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.951+0000 7f7ad77fe640 10 monclient: dump: 2026-02-17T21:26:03.965 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:03.966 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:03.966 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:03.966 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:03.966 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:03.966 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:03.966 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:03.966 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:03.966 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:03.966 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:03.966 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.951+0000 7f7ad77fe640 10 monclient: _finish_auth 0 2026-02-17T21:26:03.966 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.951+0000 7f7ad77fe640 10 monclient: _check_auth_tickets 2026-02-17T21:26:03.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.951+0000 7f7ad77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:03.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.951+0000 7f7ad77fe640 1 -- 10.20.193.5:0/173076558 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7adc037440 con 0x7f7ae00c74c0 2026-02-17T21:26:03.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.951+0000 7f7ae6ada640 5 monclient: authenticate success, global_id 4648 2026-02-17T21:26:03.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.951+0000 7f7ae6ada640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:26:03.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.951+0000 7f7ad77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:03.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.951+0000 7f7ae6ada640 10 monclient: get_monmap_and_config success 2026-02-17T21:26:03.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.951+0000 7f7ad77fe640 1 -- 10.20.193.5:0/173076558 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7adc037810 con 0x7f7ae00c74c0 2026-02-17T21:26:03.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.951+0000 7f7ad77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:03.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.951+0000 7f7ae6ada640 4 set_mon_vals no callback set 2026-02-17T21:26:03.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.951+0000 7f7ad77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:26:03.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.951+0000 7f7ad77fe640 10 monclient: dump: 2026-02-17T21:26:03.968 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:03.968 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:03.968 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:03.968 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:03.968 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:03.968 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:03.968 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:03.968 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:03.968 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:03.968 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:03.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.952+0000 7f7ae6ada640 10 monclient: shutdown 2026-02-17T21:26:03.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.952+0000 7f7ae6ada640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:03.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.952+0000 7f7ae6ada640 1 -- 10.20.193.5:0/173076558 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7ae00c74c0 msgr2=0x7f7ae00c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:03.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.952+0000 7f7ae6ada640 1 --2- 10.20.193.5:0/173076558 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7ae00c74c0 0x7f7ae00c52b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7ae015dcf0 tx=0x7f7adc02f1c0 comp rx=0 tx=0).stop 2026-02-17T21:26:03.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.952+0000 7f7ae6ada640 1 -- 10.20.193.5:0/173076558 shutdown_connections 2026-02-17T21:26:03.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.952+0000 7f7ae6ada640 1 --2- 10.20.193.5:0/173076558 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7ae00c74c0 0x7f7ae00c52b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:03.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.952+0000 7f7ae6ada640 1 --2- 10.20.193.5:0/173076558 >> v2:10.20.193.5:3300/0 conn(0x7f7ae00c7e20 0x7f7ae015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:03.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.952+0000 7f7ae6ada640 1 -- 10.20.193.5:0/173076558 >> 10.20.193.5:0/173076558 conn(0x7f7ae00c9f20 msgr2=0x7f7ae00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:03.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.952+0000 7f7ae6ada640 1 -- 10.20.193.5:0/173076558 shutdown_connections 2026-02-17T21:26:03.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.952+0000 7f7ae6ada640 1 -- 10.20.193.5:0/173076558 wait complete. 2026-02-17T21:26:03.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.952+0000 7f7ae6ada640 10 monclient: build_initial_monmap 2026-02-17T21:26:03.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.952+0000 7f7ae6ada640 10 monclient: monmap: 2026-02-17T21:26:03.969 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:03.969 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:26:03.970 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:26:03.970 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:26:03.970 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:03.970 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:03.970 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:26:03.970 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:26:03.970 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:26:03.970 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:03.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.952+0000 7f7ae6ada640 1 librados: starting msgr at 2026-02-17T21:26:03.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.952+0000 7f7ae6ada640 1 librados: starting objecter 2026-02-17T21:26:03.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.952+0000 7f7ae6ada640 1 Processor -- start 2026-02-17T21:26:03.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.952+0000 7f7ae6ada640 1 -- start start 2026-02-17T21:26:03.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.952+0000 7f7ae6ada640 1 librados: setting wanted keys 2026-02-17T21:26:03.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.952+0000 7f7ae6ada640 1 librados: calling monclient init 2026-02-17T21:26:03.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.952+0000 7f7ae6ada640 10 monclient: init 2026-02-17T21:26:03.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ae6ada640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:03.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ae6ada640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:26:03.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ae6ada640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7ae00c74c0 0x7f7ae0159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:03.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ae6ada640 10 monclient(hunting): picked mon.noname-b con 0x7f7ae00c74c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:26:03.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ae6ada640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7ae00c7e20 0x7f7ae01f6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:03.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ae6ada640 10 monclient(hunting): picked mon.noname-a con 0x7f7ae00c7e20 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:26:03.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ae6ada640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7ae015d370 0x7f7ae006e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:03.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ae6ada640 10 monclient(hunting): picked mon.noname-c con 0x7f7ae015d370 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:26:03.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ae6ada640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:03.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ae6ada640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae00c8ed0 con 0x7f7ae00c7e20 2026-02-17T21:26:03.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ae6ada640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:03.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ae6ada640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae00c8bf0 con 0x7f7ae00c74c0 2026-02-17T21:26:03.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ae6ada640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:03.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ae6ada640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae00c96d0 con 0x7f7ae015d370 2026-02-17T21:26:03.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ae6ada640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:03.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ae6ada640 10 monclient(hunting): authenticate will time out at 1069.519435s 2026-02-17T21:26:03.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ae484f640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7ae00c74c0 0x7f7ae0159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:03.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ad7fff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7ae00c7e20 0x7f7ae01f6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:03.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ae5050640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7ae015d370 0x7f7ae006e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:03.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ae484f640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7ae00c74c0 0x7f7ae0159140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:40552/0 (socket says 10.20.193.5:40552) 2026-02-17T21:26:03.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ae484f640 1 -- 10.20.193.5:0/3899710342 learned_addr learned my addr 10.20.193.5:0/3899710342 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:26:03.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ae484f640 10 monclient(hunting): get_auth_request con 0x7f7ae00c74c0 auth_method 0 2026-02-17T21:26:03.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ae484f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:03.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ae484f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:03.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ae484f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:03.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ad7fff640 10 monclient(hunting): get_auth_request con 0x7f7ae00c7e20 auth_method 0 2026-02-17T21:26:03.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ad7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:03.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ad7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:03.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.953+0000 7f7ad7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:03.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.954+0000 7f7ae5050640 10 monclient(hunting): get_auth_request con 0x7f7ae015d370 auth_method 0 2026-02-17T21:26:03.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.954+0000 7f7ae5050640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:03.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.954+0000 7f7ae5050640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:03.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.954+0000 7f7ae5050640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:03.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.954+0000 7f7ae484f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:03.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.954+0000 7f7ae484f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:03.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.954+0000 7f7ae484f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:03.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.954+0000 7f7ae5050640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:03.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.954+0000 7f7ae5050640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:03.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.954+0000 7f7ae5050640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:03.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.954+0000 7f7ad7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:03.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.954+0000 7f7ad7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:03.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.954+0000 7f7ad7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:03.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.955+0000 7f7ae484f640 10 monclient(hunting): handle_auth_done global_id 4651 payload 824 2026-02-17T21:26:03.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.955+0000 7f7ae484f640 1 -- 10.20.193.5:0/3899710342 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7ae015d370 msgr2=0x7f7ae006e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:03.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.955+0000 7f7ae484f640 1 --2- 10.20.193.5:0/3899710342 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7ae015d370 0x7f7ae006e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:03.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.955+0000 7f7ae484f640 1 -- 10.20.193.5:0/3899710342 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7ae00c7e20 msgr2=0x7f7ae01f6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:03.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.955+0000 7f7ae484f640 1 --2- 10.20.193.5:0/3899710342 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7ae00c7e20 0x7f7ae01f6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:03.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.955+0000 7f7ae484f640 10 monclient: _finish_hunting 0 2026-02-17T21:26:03.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.955+0000 7f7ae484f640 1 monclient: found mon.noname-b 2026-02-17T21:26:03.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.955+0000 7f7ae484f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:03.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.955+0000 7f7ae484f640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:26:03.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.955+0000 7f7ae484f640 1 -- 10.20.193.5:0/3899710342 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae0157dc0 con 0x7f7ae00c74c0 2026-02-17T21:26:03.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.956+0000 7f7ae484f640 1 --2- 10.20.193.5:0/3899710342 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7ae00c74c0 0x7f7ae0159140 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7ad000c730 tx=0x7f7ad000cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:03.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.956+0000 7f7ad57fa640 10 client.?.objecter ms_handle_connect 0x7f7ae00c74c0 2026-02-17T21:26:03.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.956+0000 7f7ad57fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:26:03.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.957+0000 7f7ad57fa640 1 -- 10.20.193.5:0/3899710342 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0017070 con 0x7f7ae00c74c0 2026-02-17T21:26:03.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.957+0000 7f7ad57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:03.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.957+0000 7f7ad57fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:26:03.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.957+0000 7f7ad57fa640 10 monclient: dump: 2026-02-17T21:26:03.976 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:03.976 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:03.976 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:03.976 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:03.976 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:03.976 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:03.977 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:03.977 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:03.977 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:03.977 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:03.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.957+0000 7f7ad57fa640 10 monclient: _finish_auth 0 2026-02-17T21:26:03.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.957+0000 7f7ad57fa640 10 monclient: _check_auth_tickets 2026-02-17T21:26:03.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.957+0000 7f7ad57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:03.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.957+0000 7f7ae6ada640 5 monclient: authenticate success, global_id 4651 2026-02-17T21:26:03.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.957+0000 7f7ae6ada640 10 monclient: _renew_subs 2026-02-17T21:26:03.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.957+0000 7f7ae6ada640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:26:03.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.957+0000 7f7ae6ada640 1 -- 10.20.193.5:0/3899710342 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae01580a0 con 0x7f7ae00c74c0 2026-02-17T21:26:03.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.957+0000 7f7ae6ada640 10 client.4651.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:26:03.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.957+0000 7f7ae6ada640 10 monclient: _renew_subs 2026-02-17T21:26:03.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.957+0000 7f7ae6ada640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:26:03.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.957+0000 7f7ae6ada640 1 -- 10.20.193.5:0/3899710342 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae0158660 con 0x7f7ae00c74c0 2026-02-17T21:26:03.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.957+0000 7f7ae6ada640 1 librados: init done 2026-02-17T21:26:03.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.958+0000 7f7ad57fa640 1 -- 10.20.193.5:0/3899710342 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad0005bb0 con 0x7f7ae00c74c0 2026-02-17T21:26:03.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.958+0000 7f7ad57fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:03.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.958+0000 7f7ad57fa640 1 -- 10.20.193.5:0/3899710342 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0007070 con 0x7f7ae00c74c0 2026-02-17T21:26:03.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.958+0000 7f7ad57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:03.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.958+0000 7f7ad57fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:26:03.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.958+0000 7f7ad6ffd640 4 set_mon_vals no callback set 2026-02-17T21:26:03.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.958+0000 7f7ad57fa640 10 monclient: dump: 2026-02-17T21:26:03.978 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:03.979 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:03.979 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:03.979 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:03.979 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:03.979 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:03.979 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:03.979 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:03.979 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:03.979 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:03.979 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.958+0000 7f7ae6ada640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:03.979 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.958+0000 7f7ae6ada640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:03.980 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.958+0000 7f7ae6ada640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:26:03.980 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.958+0000 7f7ae6ada640 1 -- 10.20.193.5:0/3899710342 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ae0158d70 con 0x7f7ae00c74c0 2026-02-17T21:26:03.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.970+0000 7f7ad57fa640 1 -- 10.20.193.5:0/3899710342 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f7ad0007210 con 0x7f7ae00c74c0 2026-02-17T21:26:03.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.971+0000 7f7ad57fa640 1 --2- 10.20.193.5:0/3899710342 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7ab00792b0 0x7f7ab007b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:03.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.971+0000 7f7ad7fff640 1 --2- 10.20.193.5:0/3899710342 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7ab00792b0 0x7f7ab007b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:03.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.971+0000 7f7ad7fff640 10 monclient: get_auth_request con 0x7f7ab00792b0 auth_method 0 2026-02-17T21:26:03.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.971+0000 7f7ad57fa640 10 client.4651.objecter ms_handle_connect 0x7f7ab00792b0 2026-02-17T21:26:03.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:03.971+0000 7f7ad7fff640 1 --2- 10.20.193.5:0/3899710342 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7ab00792b0 0x7f7ab007b770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7ae006f500 tx=0x7f7ac8009290 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:04.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.066+0000 7f7ad57fa640 1 -- 10.20.193.5:0/3899710342 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f7ad0097660 con 0x7f7ae00c74c0 2026-02-17T21:26:04.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.066+0000 7f7ad57fa640 10 client.4651.objecter ms_dispatch2 0x7f7ae0000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:26:04.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.066+0000 7f7ad57fa640 3 client.4651.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:26:04.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.066+0000 7f7ad57fa640 3 client.4651.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:26:04.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.066+0000 7f7ad57fa640 20 client.4651.objecter dump_active .. 0 homeless 2026-02-17T21:26:04.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.073+0000 7f7ad57fa640 1 -- 10.20.193.5:0/3899710342 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7ad0022070 con 0x7f7ae00c74c0 2026-02-17T21:26:04.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.073+0000 7f7ad57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:04.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.073+0000 7f7ad57fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:26:04.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.174+0000 7f7ae6ada640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:26:04.177 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.174+0000 7f7ae6ada640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:04.177 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.174+0000 7f7ae6ada640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:26:04.177 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.174+0000 7f7ae6ada640 1 -- 10.20.193.5:0/3899710342 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7ae015d750 con 0x7f7ae00c74c0 2026-02-17T21:26:04.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.177+0000 7f7ad57fa640 1 -- 10.20.193.5:0/3899710342 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f7ad0061ae0 con 0x7f7ae00c74c0 2026-02-17T21:26:04.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.177+0000 7f7ad57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:04.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.177+0000 7f7ad57fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:26:04.180 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:26:04.180 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:26:04.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.179+0000 7f7ae6ada640 10 librados: watch_flush enter 2026-02-17T21:26:04.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.179+0000 7f7ae6ada640 10 librados: watch_flush exit 2026-02-17T21:26:04.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.179+0000 7f7ae6ada640 20 client.4651.objecter shutdown clearing up homeless session... 2026-02-17T21:26:04.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.179+0000 7f7ae6ada640 10 client.4651.objecter successfully canceled tick 2026-02-17T21:26:04.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.179+0000 7f7ae6ada640 1 -- 10.20.193.5:0/3899710342 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7ab00792b0 msgr2=0x7f7ab007b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:04.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.179+0000 7f7ae6ada640 1 --2- 10.20.193.5:0/3899710342 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7ab00792b0 0x7f7ab007b770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7ae006f500 tx=0x7f7ac8009290 comp rx=0 tx=0).stop 2026-02-17T21:26:04.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.179+0000 7f7ae6ada640 10 monclient: shutdown 2026-02-17T21:26:04.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.179+0000 7f7ae6ada640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:04.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.179+0000 7f7ae6ada640 1 -- 10.20.193.5:0/3899710342 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7ae00c74c0 msgr2=0x7f7ae0159140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:04.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.179+0000 7f7ae6ada640 1 --2- 10.20.193.5:0/3899710342 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7ae00c74c0 0x7f7ae0159140 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7ad000c730 tx=0x7f7ad000cc00 comp rx=0 tx=0).stop 2026-02-17T21:26:04.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.179+0000 7f7ae6ada640 1 -- 10.20.193.5:0/3899710342 shutdown_connections 2026-02-17T21:26:04.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.179+0000 7f7ae6ada640 1 --2- 10.20.193.5:0/3899710342 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7ab00792b0 0x7f7ab007b770 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:04.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.179+0000 7f7ae6ada640 1 --2- 10.20.193.5:0/3899710342 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7ae015d370 0x7f7ae006e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:04.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.179+0000 7f7ae6ada640 1 --2- 10.20.193.5:0/3899710342 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7ae00c7e20 0x7f7ae01f6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:04.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.179+0000 7f7ae6ada640 1 --2- 10.20.193.5:0/3899710342 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7ae00c74c0 0x7f7ae0159140 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:04.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.179+0000 7f7ae6ada640 1 -- 10.20.193.5:0/3899710342 >> 10.20.193.5:0/3899710342 conn(0x7f7ae00c9f20 msgr2=0x7f7ae00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:04.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.179+0000 7f7ae6ada640 1 -- 10.20.193.5:0/3899710342 shutdown_connections 2026-02-17T21:26:04.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.179+0000 7f7ae6ada640 1 -- 10.20.193.5:0/3899710342 wait complete. 2026-02-17T21:26:04.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:04.179+0000 7f7ae6ada640 1 librados: shutdown 2026-02-17T21:26:07.192 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:26:07.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.260+0000 7f76fa9bc640 10 monclient: get_monmap_and_config 2026-02-17T21:26:07.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.260+0000 7f76fa9bc640 10 monclient: build_initial_monmap 2026-02-17T21:26:07.263 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.260+0000 7f76fa9bc640 10 monclient: monmap: 2026-02-17T21:26:07.263 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:07.263 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:07.263 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:26:07.261777+0000 2026-02-17T21:26:07.263 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:26:07.261777+0000 2026-02-17T21:26:07.263 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:07.263 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:07.263 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:26:07.263 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:26:07.263 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:26:07.264 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:26:07.264 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:26:07.264 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:26:07.264 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:07.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.260+0000 7f76fa9bc640 1 Processor -- start 2026-02-17T21:26:07.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.260+0000 7f76fa9bc640 1 -- start start 2026-02-17T21:26:07.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.260+0000 7f76fa9bc640 10 monclient: init 2026-02-17T21:26:07.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.261+0000 7f76fa9bc640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:07.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.261+0000 7f76fa9bc640 10 monclient: _add_conns ranks=[0,3,1,5,4,2] 2026-02-17T21:26:07.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.261+0000 7f76fa9bc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f76f41527c0 addr v1:10.20.193.5:6789/0 2026-02-17T21:26:07.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.261+0000 7f76fa9bc640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f76f40c8cf0 0x7f76f40c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:07.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.261+0000 7f76fa9bc640 10 monclient(hunting): picked mon.noname-a con 0x7f76f40c8cf0 addr v2:10.20.193.5:3300/0 2026-02-17T21:26:07.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.261+0000 7f76fa9bc640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f76f415d810 addr v1:10.20.193.119:6789/0 2026-02-17T21:26:07.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.261+0000 7f76fa9bc640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76f40c97e0 con 0x7f76f41527c0 2026-02-17T21:26:07.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.261+0000 7f76fa9bc640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76f40c9ac0 con 0x7f76f415d810 2026-02-17T21:26:07.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.261+0000 7f76fa9bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:07.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.261+0000 7f76fa9bc640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f76f40ca360 con 0x7f76f40c8cf0 2026-02-17T21:26:07.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.261+0000 7f76fa9bc640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:07.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.261+0000 7f76fa9bc640 10 monclient(hunting): authenticate will time out at 1072.827226s 2026-02-17T21:26:07.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.261+0000 7f76f37fe640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f76f40c8cf0 0x7f76f40c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:07.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.261+0000 7f76f8f32640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f76f415d810 0x7f76f415dbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:51690/0 (socket says 10.20.193.5:51690) 2026-02-17T21:26:07.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.261+0000 7f76f8f32640 1 -- 10.20.193.5:0/313089315 learned_addr learned my addr 10.20.193.5:0/313089315 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:26:07.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.262+0000 7f76f37fe640 10 monclient(hunting): get_auth_request con 0x7f76f40c8cf0 auth_method 0 2026-02-17T21:26:07.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.262+0000 7f76f37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:07.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.262+0000 7f76f37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:07.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.262+0000 7f76f37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:07.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.262+0000 7f76f37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:07.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.262+0000 7f76f37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:07.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.262+0000 7f76f37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:07.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.263+0000 7f76f2ffd640 1 -- 10.20.193.5:0/313089315 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1511965077 0 0) 0x7f76f40c9ac0 con 0x7f76f415d810 2026-02-17T21:26:07.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.263+0000 7f76f2ffd640 10 monclient(hunting): _negotiate 2026-02-17T21:26:07.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.263+0000 7f76f2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:07.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.263+0000 7f76f2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:07.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.263+0000 7f76f2ffd640 10 monclient(hunting): my global_id is 4654 2026-02-17T21:26:07.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.263+0000 7f76f2ffd640 1 -- 10.20.193.5:0/313089315 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76d8003620 con 0x7f76f415d810 2026-02-17T21:26:07.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.264+0000 7f76f37fe640 10 monclient(hunting): handle_auth_done global_id 4629 payload 274 2026-02-17T21:26:07.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.264+0000 7f76f37fe640 1 -- 10.20.193.5:0/313089315 >> v1:10.20.193.119:6789/0 conn(0x7f76f415d810 legacy=0x7f76f415dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:07.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.264+0000 7f76f37fe640 1 -- 10.20.193.5:0/313089315 >> v1:10.20.193.5:6789/0 conn(0x7f76f41527c0 legacy=0x7f76f40d2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:07.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.264+0000 7f76f37fe640 10 monclient: _finish_hunting 0 2026-02-17T21:26:07.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.264+0000 7f76f37fe640 1 monclient: found mon.noname-a 2026-02-17T21:26:07.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.264+0000 7f76f37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:07.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.264+0000 7f76f37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:26:07.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.264+0000 7f76f37fe640 1 -- 10.20.193.5:0/313089315 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f40c9da0 con 0x7f76f40c8cf0 2026-02-17T21:26:07.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.266+0000 7f76f37fe640 1 --2- 10.20.193.5:0/313089315 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f76f40c8cf0 0x7f76f40c9180 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f76e40098a0 tx=0x7f76e402edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93fdab9a1625cbdc server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:07.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.267+0000 7f76f2ffd640 1 -- 10.20.193.5:0/313089315 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e403c070 con 0x7f76f40c8cf0 2026-02-17T21:26:07.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.267+0000 7f76f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:07.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.267+0000 7f76f2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:26:07.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.267+0000 7f76f2ffd640 10 monclient: dump: 2026-02-17T21:26:07.276 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:07.276 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:07.276 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:07.276 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:07.277 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:07.277 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:07.277 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:07.277 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:07.277 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:07.277 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:07.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.267+0000 7f76f2ffd640 10 monclient: _finish_auth 0 2026-02-17T21:26:07.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.267+0000 7f76f2ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:26:07.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.267+0000 7f76f2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:07.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.267+0000 7f76fa9bc640 5 monclient: authenticate success, global_id 4629 2026-02-17T21:26:07.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.267+0000 7f76fa9bc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:26:07.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.268+0000 7f76f2ffd640 1 -- 10.20.193.5:0/313089315 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e402fae0 con 0x7f76f40c8cf0 2026-02-17T21:26:07.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.268+0000 7f76f2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:07.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.268+0000 7f76f2ffd640 1 -- 10.20.193.5:0/313089315 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e4037440 con 0x7f76f40c8cf0 2026-02-17T21:26:07.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.268+0000 7f76f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:07.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.268+0000 7f76f2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:26:07.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.268+0000 7f76f2ffd640 10 monclient: dump: 2026-02-17T21:26:07.278 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:07.278 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:07.278 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:07.278 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:07.278 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:07.279 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:07.279 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:07.279 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:07.279 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:07.279 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:07.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.268+0000 7f76fa9bc640 10 monclient: get_monmap_and_config success 2026-02-17T21:26:07.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.268+0000 7f76fa9bc640 4 set_mon_vals no callback set 2026-02-17T21:26:07.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.268+0000 7f76fa9bc640 10 monclient: shutdown 2026-02-17T21:26:07.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.268+0000 7f76fa9bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:07.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.268+0000 7f76fa9bc640 1 -- 10.20.193.5:0/313089315 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f76f40c8cf0 msgr2=0x7f76f40c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:07.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.268+0000 7f76fa9bc640 1 --2- 10.20.193.5:0/313089315 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f76f40c8cf0 0x7f76f40c9180 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f76e40098a0 tx=0x7f76e402edd0 comp rx=0 tx=0).stop 2026-02-17T21:26:07.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.268+0000 7f76fa9bc640 1 -- 10.20.193.5:0/313089315 shutdown_connections 2026-02-17T21:26:07.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.268+0000 7f76fa9bc640 1 --2- 10.20.193.5:0/313089315 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f76f40c8cf0 0x7f76f40c9180 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:07.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.268+0000 7f76fa9bc640 1 -- 10.20.193.5:0/313089315 >> 10.20.193.5:0/313089315 conn(0x7f76f4073030 msgr2=0x7f76f4073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:07.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.268+0000 7f76fa9bc640 1 -- 10.20.193.5:0/313089315 shutdown_connections 2026-02-17T21:26:07.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.268+0000 7f76fa9bc640 1 -- 10.20.193.5:0/313089315 wait complete. 2026-02-17T21:26:07.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.269+0000 7f76fa9bc640 10 monclient: build_initial_monmap 2026-02-17T21:26:07.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.269+0000 7f76fa9bc640 10 monclient: monmap: 2026-02-17T21:26:07.280 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:07.280 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:26:07.280 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:26:07.280 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:26:07.281 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:07.281 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:07.281 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:26:07.281 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:26:07.281 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:26:07.281 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:07.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.269+0000 7f76fa9bc640 1 librados: starting msgr at 2026-02-17T21:26:07.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.269+0000 7f76fa9bc640 1 librados: starting objecter 2026-02-17T21:26:07.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.269+0000 7f76fa9bc640 1 Processor -- start 2026-02-17T21:26:07.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.269+0000 7f76fa9bc640 1 -- start start 2026-02-17T21:26:07.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.269+0000 7f76fa9bc640 1 librados: setting wanted keys 2026-02-17T21:26:07.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.269+0000 7f76fa9bc640 1 librados: calling monclient init 2026-02-17T21:26:07.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.269+0000 7f76fa9bc640 10 monclient: init 2026-02-17T21:26:07.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.269+0000 7f76fa9bc640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:07.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.269+0000 7f76fa9bc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:26:07.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.269+0000 7f76fa9bc640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f76f40c8cf0 0x7f76f41f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:07.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.269+0000 7f76fa9bc640 10 monclient(hunting): picked mon.noname-b con 0x7f76f40c8cf0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:26:07.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.269+0000 7f76fa9bc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f76f41527c0 0x7f76f4147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:07.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76fa9bc640 10 monclient(hunting): picked mon.noname-c con 0x7f76f41527c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:26:07.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76fa9bc640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f76f415d810 0x7f76f414a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:07.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76fa9bc640 10 monclient(hunting): picked mon.noname-a con 0x7f76f415d810 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:26:07.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76fa9bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:07.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76fa9bc640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f76f4152ba0 con 0x7f76f415d810 2026-02-17T21:26:07.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76fa9bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:07.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76fa9bc640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f76f415d2f0 con 0x7f76f40c8cf0 2026-02-17T21:26:07.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76fa9bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:07.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76fa9bc640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f76f4160100 con 0x7f76f41527c0 2026-02-17T21:26:07.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76fa9bc640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:07.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76fa9bc640 10 monclient(hunting): authenticate will time out at 1072.836019s 2026-02-17T21:26:07.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76f3fff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f76f40c8cf0 0x7f76f41f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:07.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76f3fff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f76f40c8cf0 0x7f76f41f4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:51906/0 (socket says 10.20.193.5:51906) 2026-02-17T21:26:07.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76f3fff640 1 -- 10.20.193.5:0/3059603082 learned_addr learned my addr 10.20.193.5:0/3059603082 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:26:07.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76f3fff640 10 monclient(hunting): get_auth_request con 0x7f76f40c8cf0 auth_method 0 2026-02-17T21:26:07.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:07.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:07.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:07.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76f8f32640 1 --2- 10.20.193.5:0/3059603082 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f76f415d810 0x7f76f414a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:07.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76f3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:07.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76f3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:07.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76f3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:07.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76f8f32640 10 monclient(hunting): get_auth_request con 0x7f76f415d810 auth_method 0 2026-02-17T21:26:07.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76f8f32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:07.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76f8f32640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:07.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.270+0000 7f76f8f32640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:07.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.271+0000 7f76f8f32640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:07.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.271+0000 7f76f8f32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:07.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.271+0000 7f76f8f32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:07.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.271+0000 7f76f37fe640 1 --2- 10.20.193.5:0/3059603082 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f76f41527c0 0x7f76f4147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:07.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.271+0000 7f76f37fe640 10 monclient(hunting): get_auth_request con 0x7f76f41527c0 auth_method 0 2026-02-17T21:26:07.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.271+0000 7f76f37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:07.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.271+0000 7f76f37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:07.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.271+0000 7f76f37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:07.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.272+0000 7f76f37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:07.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.272+0000 7f76f37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:07.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.272+0000 7f76f37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:07.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.272+0000 7f76f3fff640 10 monclient(hunting): handle_auth_done global_id 4657 payload 824 2026-02-17T21:26:07.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.272+0000 7f76f3fff640 1 -- 10.20.193.5:0/3059603082 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f76f41527c0 msgr2=0x7f76f4147c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:07.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.272+0000 7f76f3fff640 1 --2- 10.20.193.5:0/3059603082 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f76f41527c0 0x7f76f4147c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:07.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.272+0000 7f76f3fff640 1 -- 10.20.193.5:0/3059603082 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f76f415d810 msgr2=0x7f76f414a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:07.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.272+0000 7f76f3fff640 1 --2- 10.20.193.5:0/3059603082 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f76f415d810 0x7f76f414a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:07.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.272+0000 7f76f3fff640 10 monclient: _finish_hunting 0 2026-02-17T21:26:07.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.272+0000 7f76f3fff640 1 monclient: found mon.noname-b 2026-02-17T21:26:07.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.272+0000 7f76f3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:07.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.272+0000 7f76f3fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:26:07.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.272+0000 7f76f3fff640 1 -- 10.20.193.5:0/3059603082 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f4146230 con 0x7f76f40c8cf0 2026-02-17T21:26:07.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.274+0000 7f76f3fff640 1 --2- 10.20.193.5:0/3059603082 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f76f40c8cf0 0x7f76f41f4500 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f76e000c700 tx=0x7f76e000cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:07.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.274+0000 7f76f0ff9640 10 client.?.objecter ms_handle_connect 0x7f76f40c8cf0 2026-02-17T21:26:07.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.274+0000 7f76f0ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:26:07.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.276+0000 7f76f0ff9640 1 -- 10.20.193.5:0/3059603082 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e00052d0 con 0x7f76f40c8cf0 2026-02-17T21:26:07.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.276+0000 7f76f0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:07.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.276+0000 7f76f0ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:26:07.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.276+0000 7f76f0ff9640 10 monclient: dump: 2026-02-17T21:26:07.289 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:07.289 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:07.289 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:07.289 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:07.289 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:07.289 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:07.289 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:07.290 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:07.290 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:07.290 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:07.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.276+0000 7f76f0ff9640 10 monclient: _finish_auth 0 2026-02-17T21:26:07.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.276+0000 7f76f0ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:26:07.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.276+0000 7f76f0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:07.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.276+0000 7f76f0ff9640 1 -- 10.20.193.5:0/3059603082 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e0005470 con 0x7f76f40c8cf0 2026-02-17T21:26:07.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.276+0000 7f76f0ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:07.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.276+0000 7f76f0ff9640 1 -- 10.20.193.5:0/3059603082 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e000a860 con 0x7f76f40c8cf0 2026-02-17T21:26:07.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.276+0000 7f76fa9bc640 5 monclient: authenticate success, global_id 4657 2026-02-17T21:26:07.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.276+0000 7f76f27fc640 4 set_mon_vals no callback set 2026-02-17T21:26:07.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.276+0000 7f76fa9bc640 10 monclient: _renew_subs 2026-02-17T21:26:07.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.276+0000 7f76fa9bc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:26:07.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.276+0000 7f76fa9bc640 1 -- 10.20.193.5:0/3059603082 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76f4149250 con 0x7f76f40c8cf0 2026-02-17T21:26:07.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.276+0000 7f76f0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:07.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.276+0000 7f76f0ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:26:07.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.276+0000 7f76f0ff9640 10 monclient: dump: 2026-02-17T21:26:07.291 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:07.291 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:07.291 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:07.291 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:07.291 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:07.291 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:07.292 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:07.292 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:07.292 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:07.292 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:07.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.276+0000 7f76fa9bc640 10 client.4657.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:26:07.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.276+0000 7f76fa9bc640 10 monclient: _renew_subs 2026-02-17T21:26:07.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.276+0000 7f76fa9bc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:26:07.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.276+0000 7f76fa9bc640 1 -- 10.20.193.5:0/3059603082 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76f4149810 con 0x7f76f40c8cf0 2026-02-17T21:26:07.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.276+0000 7f76fa9bc640 1 librados: init done 2026-02-17T21:26:07.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.277+0000 7f76fa9bc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:07.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.277+0000 7f76fa9bc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:07.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.277+0000 7f76fa9bc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:26:07.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.277+0000 7f76fa9bc640 1 -- 10.20.193.5:0/3059603082 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76f40c9180 con 0x7f76f40c8cf0 2026-02-17T21:26:07.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.288+0000 7f76f0ff9640 1 -- 10.20.193.5:0/3059603082 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f76e000aa00 con 0x7f76f40c8cf0 2026-02-17T21:26:07.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.289+0000 7f76f0ff9640 1 --2- 10.20.193.5:0/3059603082 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f76c40792d0 0x7f76c407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:07.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.289+0000 7f76f37fe640 1 --2- 10.20.193.5:0/3059603082 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f76c40792d0 0x7f76c407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:07.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.289+0000 7f76f37fe640 10 monclient: get_auth_request con 0x7f76c40792d0 auth_method 0 2026-02-17T21:26:07.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.289+0000 7f76f37fe640 1 --2- 10.20.193.5:0/3059603082 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f76c40792d0 0x7f76c407b790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f76e4039000 tx=0x7f76e4033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:07.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.289+0000 7f76f0ff9640 10 client.4657.objecter ms_handle_connect 0x7f76c40792d0 2026-02-17T21:26:07.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.290+0000 7f76f0ff9640 1 -- 10.20.193.5:0/3059603082 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f76e000ad20 con 0x7f76f40c8cf0 2026-02-17T21:26:07.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.290+0000 7f76f0ff9640 10 client.4657.objecter ms_dispatch2 0x7f76f4000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:26:07.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.290+0000 7f76f0ff9640 3 client.4657.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:26:07.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.290+0000 7f76f0ff9640 3 client.4657.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:26:07.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.290+0000 7f76f0ff9640 20 client.4657.objecter dump_active .. 0 homeless 2026-02-17T21:26:07.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.400+0000 7f76f0ff9640 1 -- 10.20.193.5:0/3059603082 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f76e0062380 con 0x7f76f40c8cf0 2026-02-17T21:26:07.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.400+0000 7f76f0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:07.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.400+0000 7f76f0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:26:07.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.502+0000 7f76fa9bc640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:26:07.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.502+0000 7f76fa9bc640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:07.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.502+0000 7f76fa9bc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:26:07.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.502+0000 7f76fa9bc640 1 -- 10.20.193.5:0/3059603082 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f76f40c8ad0 con 0x7f76f40c8cf0 2026-02-17T21:26:07.507 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.506+0000 7f76f0ff9640 1 -- 10.20.193.5:0/3059603082 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f76e0066680 con 0x7f76f40c8cf0 2026-02-17T21:26:07.507 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.506+0000 7f76f0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:07.507 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.506+0000 7f76f0ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:26:07.508 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:26:07.508 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:26:07.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.506+0000 7f76fa9bc640 10 librados: watch_flush enter 2026-02-17T21:26:07.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.506+0000 7f76fa9bc640 10 librados: watch_flush exit 2026-02-17T21:26:07.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.506+0000 7f76fa9bc640 20 client.4657.objecter shutdown clearing up homeless session... 2026-02-17T21:26:07.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.506+0000 7f76fa9bc640 10 client.4657.objecter successfully canceled tick 2026-02-17T21:26:07.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.506+0000 7f76fa9bc640 1 -- 10.20.193.5:0/3059603082 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f76c40792d0 msgr2=0x7f76c407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:07.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.506+0000 7f76fa9bc640 1 --2- 10.20.193.5:0/3059603082 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f76c40792d0 0x7f76c407b790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f76e4039000 tx=0x7f76e4033000 comp rx=0 tx=0).stop 2026-02-17T21:26:07.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.506+0000 7f76fa9bc640 10 monclient: shutdown 2026-02-17T21:26:07.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.506+0000 7f76fa9bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:07.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.506+0000 7f76fa9bc640 1 -- 10.20.193.5:0/3059603082 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f76f40c8cf0 msgr2=0x7f76f41f4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:07.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.506+0000 7f76fa9bc640 1 --2- 10.20.193.5:0/3059603082 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f76f40c8cf0 0x7f76f41f4500 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f76e000c700 tx=0x7f76e000cbd0 comp rx=0 tx=0).stop 2026-02-17T21:26:07.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.506+0000 7f76fa9bc640 1 -- 10.20.193.5:0/3059603082 shutdown_connections 2026-02-17T21:26:07.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.506+0000 7f76fa9bc640 1 --2- 10.20.193.5:0/3059603082 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f76c40792d0 0x7f76c407b790 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:07.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.506+0000 7f76fa9bc640 1 --2- 10.20.193.5:0/3059603082 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f76f415d810 0x7f76f414a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:07.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.506+0000 7f76fa9bc640 1 --2- 10.20.193.5:0/3059603082 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f76f41527c0 0x7f76f4147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:07.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.506+0000 7f76fa9bc640 1 --2- 10.20.193.5:0/3059603082 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f76f40c8cf0 0x7f76f41f4500 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:07.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.506+0000 7f76fa9bc640 1 -- 10.20.193.5:0/3059603082 >> 10.20.193.5:0/3059603082 conn(0x7f76f4073030 msgr2=0x7f76f415dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:07.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.506+0000 7f76fa9bc640 1 -- 10.20.193.5:0/3059603082 shutdown_connections 2026-02-17T21:26:07.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.506+0000 7f76fa9bc640 1 -- 10.20.193.5:0/3059603082 wait complete. 2026-02-17T21:26:07.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:07.506+0000 7f76fa9bc640 1 librados: shutdown 2026-02-17T21:26:10.519 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:26:10.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.587+0000 7fa745c36640 10 monclient: get_monmap_and_config 2026-02-17T21:26:10.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.587+0000 7fa745c36640 10 monclient: build_initial_monmap 2026-02-17T21:26:10.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.587+0000 7fa745c36640 10 monclient: monmap: 2026-02-17T21:26:10.591 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:10.591 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:10.591 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:26:10.589338+0000 2026-02-17T21:26:10.591 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:26:10.589338+0000 2026-02-17T21:26:10.591 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:10.591 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:10.592 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:26:10.592 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:26:10.592 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:26:10.592 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:26:10.592 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:26:10.592 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:26:10.592 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:10.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.588+0000 7fa745c36640 1 Processor -- start 2026-02-17T21:26:10.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.588+0000 7fa745c36640 1 -- start start 2026-02-17T21:26:10.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.588+0000 7fa745c36640 10 monclient: init 2026-02-17T21:26:10.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.588+0000 7fa745c36640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:10.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.588+0000 7fa745c36640 10 monclient: _add_conns ranks=[4,3,1,5,2,0] 2026-02-17T21:26:10.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.588+0000 7fa745c36640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fa74015d370 0x7fa74015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:10.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.588+0000 7fa745c36640 10 monclient(hunting): picked mon.noname-b con 0x7fa74015d370 addr v2:10.20.193.119:3300/0 2026-02-17T21:26:10.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.588+0000 7fa745c36640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fa7400c7e20 0x7fa7400c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:10.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.588+0000 7fa745c36640 10 monclient(hunting): picked mon.noname-a con 0x7fa7400c7e20 addr v2:10.20.193.5:3300/0 2026-02-17T21:26:10.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.588+0000 7fa745c36640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fa74015b000 addr v1:10.20.193.119:6789/0 2026-02-17T21:26:10.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.588+0000 7fa745c36640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7400c8350 con 0x7fa74015b000 2026-02-17T21:26:10.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.588+0000 7fa745c36640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:10.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.588+0000 7fa745c36640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa7400c9240 con 0x7fa7400c7e20 2026-02-17T21:26:10.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.588+0000 7fa745c36640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:10.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.588+0000 7fa745c36640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fa7400c8630 con 0x7fa74015d370 2026-02-17T21:26:10.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.588+0000 7fa745c36640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:10.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.588+0000 7fa745c36640 10 monclient(hunting): authenticate will time out at 1076.154661s 2026-02-17T21:26:10.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.588+0000 7fa73effd640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fa7400c7e20 0x7fa7400c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:10.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.589+0000 7fa73effd640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fa7400c7e20 0x7fa7400c74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:46386/0 (socket says 10.20.193.5:46386) 2026-02-17T21:26:10.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.589+0000 7fa73effd640 1 -- 10.20.193.5:0/1586742432 learned_addr learned my addr 10.20.193.5:0/1586742432 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:26:10.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.589+0000 7fa73effd640 10 monclient(hunting): get_auth_request con 0x7fa7400c7e20 auth_method 0 2026-02-17T21:26:10.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.589+0000 7fa73effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:10.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.589+0000 7fa73effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:10.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.589+0000 7fa73effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:10.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.589+0000 7fa73f7fe640 1 --2- 10.20.193.5:0/1586742432 >> v2:10.20.193.119:3300/0 conn(0x7fa74015d370 0x7fa74015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:10.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.589+0000 7fa73effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:10.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.589+0000 7fa73effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:10.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.589+0000 7fa73effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:10.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.589+0000 7fa73f7fe640 10 monclient(hunting): get_auth_request con 0x7fa74015d370 auth_method 0 2026-02-17T21:26:10.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.589+0000 7fa73f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:10.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.589+0000 7fa73f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:10.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.589+0000 7fa73f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:10.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.590+0000 7fa73f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:10.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.590+0000 7fa73f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:10.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.590+0000 7fa73f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:10.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.590+0000 7fa73effd640 10 monclient(hunting): handle_auth_done global_id 4638 payload 274 2026-02-17T21:26:10.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.590+0000 7fa73effd640 1 -- 10.20.193.5:0/1586742432 >> v2:10.20.193.119:3300/0 conn(0x7fa74015d370 msgr2=0x7fa74015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:26:10.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.590+0000 7fa73effd640 1 --2- 10.20.193.5:0/1586742432 >> v2:10.20.193.119:3300/0 conn(0x7fa74015d370 0x7fa74015d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:10.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.590+0000 7fa73effd640 1 -- 10.20.193.5:0/1586742432 >> v1:10.20.193.119:6789/0 conn(0x7fa74015b000 legacy=0x7fa7400c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:10.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.590+0000 7fa73effd640 10 monclient: _finish_hunting 0 2026-02-17T21:26:10.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.590+0000 7fa73effd640 1 monclient: found mon.noname-a 2026-02-17T21:26:10.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.590+0000 7fa73effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:10.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.590+0000 7fa73effd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:26:10.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.590+0000 7fa73effd640 1 -- 10.20.193.5:0/1586742432 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7400c8910 con 0x7fa7400c7e20 2026-02-17T21:26:10.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.591+0000 7fa73effd640 1 --2- 10.20.193.5:0/1586742432 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa7400c7e20 0x7fa7400c74c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa7400698d0 tx=0x7fa73002eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23747da8dbfa33df server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:10.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa73e7fc640 1 -- 10.20.193.5:0/1586742432 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73003c070 con 0x7fa7400c7e20 2026-02-17T21:26:10.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa73e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:10.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa73e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:26:10.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa73e7fc640 10 monclient: dump: 2026-02-17T21:26:10.603 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:10.603 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:10.604 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:10.604 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:10.604 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:10.604 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:10.604 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:10.604 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:10.604 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:10.604 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:10.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa73e7fc640 10 monclient: _finish_auth 0 2026-02-17T21:26:10.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa73e7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:26:10.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa73e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:10.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa745c36640 5 monclient: authenticate success, global_id 4638 2026-02-17T21:26:10.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa73e7fc640 1 -- 10.20.193.5:0/1586742432 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa73002fbe0 con 0x7fa7400c7e20 2026-02-17T21:26:10.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa745c36640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:26:10.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa73e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:10.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa73e7fc640 1 -- 10.20.193.5:0/1586742432 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa730037440 con 0x7fa7400c7e20 2026-02-17T21:26:10.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa745c36640 10 monclient: get_monmap_and_config success 2026-02-17T21:26:10.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa745c36640 4 set_mon_vals no callback set 2026-02-17T21:26:10.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa73e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:10.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa73e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:26:10.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa73e7fc640 10 monclient: dump: 2026-02-17T21:26:10.605 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:10.605 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:10.605 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:10.606 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:10.606 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:10.606 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:10.606 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:10.606 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:10.606 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:10.606 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:10.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa745c36640 10 monclient: shutdown 2026-02-17T21:26:10.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa745c36640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:10.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa745c36640 1 -- 10.20.193.5:0/1586742432 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa7400c7e20 msgr2=0x7fa7400c74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:10.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa745c36640 1 --2- 10.20.193.5:0/1586742432 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa7400c7e20 0x7fa7400c74c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa7400698d0 tx=0x7fa73002eed0 comp rx=0 tx=0).stop 2026-02-17T21:26:10.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa745c36640 1 -- 10.20.193.5:0/1586742432 shutdown_connections 2026-02-17T21:26:10.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa745c36640 1 --2- 10.20.193.5:0/1586742432 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa7400c7e20 0x7fa7400c74c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:10.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa745c36640 1 --2- 10.20.193.5:0/1586742432 >> v2:10.20.193.119:3300/0 conn(0x7fa74015d370 0x7fa74015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:10.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa745c36640 1 -- 10.20.193.5:0/1586742432 >> 10.20.193.5:0/1586742432 conn(0x7fa7400c9f20 msgr2=0x7fa7400ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:10.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa745c36640 1 -- 10.20.193.5:0/1586742432 shutdown_connections 2026-02-17T21:26:10.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.593+0000 7fa745c36640 1 -- 10.20.193.5:0/1586742432 wait complete. 2026-02-17T21:26:10.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.594+0000 7fa745c36640 10 monclient: build_initial_monmap 2026-02-17T21:26:10.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.594+0000 7fa745c36640 10 monclient: monmap: 2026-02-17T21:26:10.607 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:10.607 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:26:10.607 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:26:10.607 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:26:10.607 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:10.608 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:10.608 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:26:10.608 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:26:10.608 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:26:10.608 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:10.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.594+0000 7fa745c36640 1 librados: starting msgr at 2026-02-17T21:26:10.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.594+0000 7fa745c36640 1 librados: starting objecter 2026-02-17T21:26:10.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.594+0000 7fa745c36640 1 Processor -- start 2026-02-17T21:26:10.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.594+0000 7fa745c36640 1 -- start start 2026-02-17T21:26:10.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.594+0000 7fa745c36640 1 librados: setting wanted keys 2026-02-17T21:26:10.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.594+0000 7fa745c36640 1 librados: calling monclient init 2026-02-17T21:26:10.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.594+0000 7fa745c36640 10 monclient: init 2026-02-17T21:26:10.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.594+0000 7fa745c36640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:10.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.594+0000 7fa745c36640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:26:10.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.594+0000 7fa745c36640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa7400c7e20 0x7fa74014be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:10.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.594+0000 7fa745c36640 10 monclient(hunting): picked mon.noname-c con 0x7fa7400c7e20 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:26:10.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.594+0000 7fa745c36640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa74015b000 0x7fa74014c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:10.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.594+0000 7fa745c36640 10 monclient(hunting): picked mon.noname-a con 0x7fa74015b000 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:26:10.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.594+0000 7fa745c36640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa74015d370 0x7fa740148f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:10.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.594+0000 7fa745c36640 10 monclient(hunting): picked mon.noname-b con 0x7fa74015d370 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:26:10.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.594+0000 7fa745c36640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:10.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.594+0000 7fa745c36640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa7400c96d0 con 0x7fa74015b000 2026-02-17T21:26:10.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.594+0000 7fa745c36640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:10.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.594+0000 7fa745c36640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa7400c8ed0 con 0x7fa74015d370 2026-02-17T21:26:10.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.594+0000 7fa745c36640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:10.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.594+0000 7fa745c36640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa74006ed80 con 0x7fa7400c7e20 2026-02-17T21:26:10.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.594+0000 7fa745c36640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:10.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.594+0000 7fa745c36640 10 monclient(hunting): authenticate will time out at 1076.160809s 2026-02-17T21:26:10.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73effd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa74015b000 0x7fa74014c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:10.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73ffff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa74015d370 0x7fa740148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:10.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73f7fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa7400c7e20 0x7fa74014be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:10.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73effd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa74015b000 0x7fa74014c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:46390/0 (socket says 10.20.193.5:46390) 2026-02-17T21:26:10.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73effd640 1 -- 10.20.193.5:0/2229643518 learned_addr learned my addr 10.20.193.5:0/2229643518 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:26:10.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73effd640 10 monclient(hunting): get_auth_request con 0x7fa74015b000 auth_method 0 2026-02-17T21:26:10.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:10.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:10.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:10.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73f7fe640 10 monclient(hunting): get_auth_request con 0x7fa7400c7e20 auth_method 0 2026-02-17T21:26:10.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:10.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:10.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:10.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73ffff640 10 monclient(hunting): get_auth_request con 0x7fa74015d370 auth_method 0 2026-02-17T21:26:10.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:10.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:10.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:10.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:10.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:10.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:10.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:10.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:10.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:10.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:10.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:10.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.595+0000 7fa73ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:10.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.596+0000 7fa73effd640 10 monclient(hunting): handle_auth_done global_id 4641 payload 824 2026-02-17T21:26:10.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.596+0000 7fa73effd640 1 -- 10.20.193.5:0/2229643518 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa7400c7e20 msgr2=0x7fa74014be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:10.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.596+0000 7fa73effd640 1 --2- 10.20.193.5:0/2229643518 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa7400c7e20 0x7fa74014be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:10.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.596+0000 7fa73effd640 1 -- 10.20.193.5:0/2229643518 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa74015d370 msgr2=0x7fa740148f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:10.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.596+0000 7fa73effd640 1 --2- 10.20.193.5:0/2229643518 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa74015d370 0x7fa740148f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:10.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.596+0000 7fa73effd640 10 monclient: _finish_hunting 0 2026-02-17T21:26:10.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.596+0000 7fa73effd640 1 monclient: found mon.noname-a 2026-02-17T21:26:10.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.596+0000 7fa73effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:10.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.596+0000 7fa73effd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:26:10.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.596+0000 7fa73effd640 1 -- 10.20.193.5:0/2229643518 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74014adb0 con 0x7fa74015b000 2026-02-17T21:26:10.615 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.597+0000 7fa73effd640 1 --2- 10.20.193.5:0/2229643518 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa74015b000 0x7fa74014c390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa730009a70 tx=0x7fa7300047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:10.615 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.597+0000 7fa71bfff640 10 client.?.objecter ms_handle_connect 0x7fa74015b000 2026-02-17T21:26:10.615 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.597+0000 7fa71bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:26:10.615 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.599+0000 7fa71bfff640 1 -- 10.20.193.5:0/2229643518 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73003c040 con 0x7fa74015b000 2026-02-17T21:26:10.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.599+0000 7fa71bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:10.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.599+0000 7fa71bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:26:10.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.599+0000 7fa71bfff640 10 monclient: dump: 2026-02-17T21:26:10.616 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:10.616 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:10.616 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:10.616 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:10.616 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:10.616 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:10.616 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:10.616 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:10.617 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:10.617 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:10.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.599+0000 7fa71bfff640 10 monclient: _finish_auth 0 2026-02-17T21:26:10.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.599+0000 7fa71bfff640 10 monclient: _check_auth_tickets 2026-02-17T21:26:10.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.599+0000 7fa71bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:10.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.599+0000 7fa71bfff640 1 -- 10.20.193.5:0/2229643518 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa730042630 con 0x7fa74015b000 2026-02-17T21:26:10.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.599+0000 7fa71bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:10.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.599+0000 7fa71bfff640 1 -- 10.20.193.5:0/2229643518 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa730042a20 con 0x7fa74015b000 2026-02-17T21:26:10.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.599+0000 7fa71bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:10.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.599+0000 7fa71bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:26:10.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.599+0000 7fa73dffb640 4 set_mon_vals no callback set 2026-02-17T21:26:10.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.599+0000 7fa71bfff640 10 monclient: dump: 2026-02-17T21:26:10.618 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:10.618 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:10.618 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:10.618 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:10.618 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:10.618 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:10.618 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:10.618 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:10.618 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:10.618 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:10.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.599+0000 7fa745c36640 5 monclient: authenticate success, global_id 4641 2026-02-17T21:26:10.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.599+0000 7fa745c36640 10 monclient: _renew_subs 2026-02-17T21:26:10.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.599+0000 7fa745c36640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:10.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.599+0000 7fa745c36640 1 -- 10.20.193.5:0/2229643518 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa74014b090 con 0x7fa74015b000 2026-02-17T21:26:10.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.599+0000 7fa745c36640 10 client.4641.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:26:10.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.599+0000 7fa745c36640 10 monclient: _renew_subs 2026-02-17T21:26:10.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.599+0000 7fa745c36640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:10.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.599+0000 7fa745c36640 1 -- 10.20.193.5:0/2229643518 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa74014b650 con 0x7fa74015b000 2026-02-17T21:26:10.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.599+0000 7fa745c36640 1 librados: init done 2026-02-17T21:26:10.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.600+0000 7fa745c36640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:10.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.600+0000 7fa745c36640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:10.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.600+0000 7fa745c36640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:10.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.600+0000 7fa745c36640 1 -- 10.20.193.5:0/2229643518 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa74015b490 con 0x7fa74015b000 2026-02-17T21:26:10.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.611+0000 7fa71bfff640 1 -- 10.20.193.5:0/2229643518 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fa730042bc0 con 0x7fa74015b000 2026-02-17T21:26:10.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.612+0000 7fa71bfff640 1 --2- 10.20.193.5:0/2229643518 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa710079280 0x7fa71007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:10.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.612+0000 7fa73f7fe640 1 --2- 10.20.193.5:0/2229643518 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa710079280 0x7fa71007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:10.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.612+0000 7fa73f7fe640 10 monclient: get_auth_request con 0x7fa710079280 auth_method 0 2026-02-17T21:26:10.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.613+0000 7fa73f7fe640 1 --2- 10.20.193.5:0/2229643518 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa710079280 0x7fa71007b740 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa74014a3a0 tx=0x7fa72c009290 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:10.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.613+0000 7fa71bfff640 10 client.4641.objecter ms_handle_connect 0x7fa710079280 2026-02-17T21:26:10.621 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.614+0000 7fa71bfff640 1 -- 10.20.193.5:0/2229643518 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fa73002faa0 con 0x7fa74015b000 2026-02-17T21:26:10.621 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.614+0000 7fa71bfff640 10 client.4641.objecter ms_dispatch2 0x7fa740000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:26:10.621 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.614+0000 7fa71bfff640 3 client.4641.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:26:10.621 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.614+0000 7fa71bfff640 3 client.4641.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:26:10.621 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.614+0000 7fa71bfff640 20 client.4641.objecter dump_active .. 0 homeless 2026-02-17T21:26:10.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.714+0000 7fa71bfff640 1 -- 10.20.193.5:0/2229643518 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa730087a90 con 0x7fa74015b000 2026-02-17T21:26:10.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.714+0000 7fa71bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:10.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.714+0000 7fa71bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:26:10.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.815+0000 7fa745c36640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:26:10.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.815+0000 7fa745c36640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:10.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.815+0000 7fa745c36640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:10.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.815+0000 7fa745c36640 1 -- 10.20.193.5:0/2229643518 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa740070430 con 0x7fa74015b000 2026-02-17T21:26:10.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.817+0000 7fa71bfff640 1 -- 10.20.193.5:0/2229643518 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fa73008bd90 con 0x7fa74015b000 2026-02-17T21:26:10.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.817+0000 7fa71bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:10.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.817+0000 7fa71bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:26:10.819 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:26:10.819 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:26:10.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.818+0000 7fa745c36640 10 librados: watch_flush enter 2026-02-17T21:26:10.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.818+0000 7fa745c36640 10 librados: watch_flush exit 2026-02-17T21:26:10.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.818+0000 7fa745c36640 20 client.4641.objecter shutdown clearing up homeless session... 2026-02-17T21:26:10.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.818+0000 7fa745c36640 10 client.4641.objecter successfully canceled tick 2026-02-17T21:26:10.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.818+0000 7fa745c36640 1 -- 10.20.193.5:0/2229643518 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa710079280 msgr2=0x7fa71007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:10.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.818+0000 7fa745c36640 1 --2- 10.20.193.5:0/2229643518 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa710079280 0x7fa71007b740 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa74014a3a0 tx=0x7fa72c009290 comp rx=0 tx=0).stop 2026-02-17T21:26:10.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.818+0000 7fa745c36640 10 monclient: shutdown 2026-02-17T21:26:10.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.818+0000 7fa745c36640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:10.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.818+0000 7fa745c36640 1 -- 10.20.193.5:0/2229643518 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa74015b000 msgr2=0x7fa74014c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:10.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.818+0000 7fa745c36640 1 --2- 10.20.193.5:0/2229643518 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa74015b000 0x7fa74014c390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa730009a70 tx=0x7fa7300047c0 comp rx=0 tx=0).stop 2026-02-17T21:26:10.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.818+0000 7fa745c36640 1 -- 10.20.193.5:0/2229643518 shutdown_connections 2026-02-17T21:26:10.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.818+0000 7fa745c36640 1 --2- 10.20.193.5:0/2229643518 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa710079280 0x7fa71007b740 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:10.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.818+0000 7fa745c36640 1 --2- 10.20.193.5:0/2229643518 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa74015d370 0x7fa740148f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:10.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.818+0000 7fa745c36640 1 --2- 10.20.193.5:0/2229643518 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa74015b000 0x7fa74014c390 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:10.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.818+0000 7fa745c36640 1 --2- 10.20.193.5:0/2229643518 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa7400c7e20 0x7fa74014be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:10.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.818+0000 7fa745c36640 1 -- 10.20.193.5:0/2229643518 >> 10.20.193.5:0/2229643518 conn(0x7fa7400c9f20 msgr2=0x7fa7400ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:10.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.818+0000 7fa745c36640 1 -- 10.20.193.5:0/2229643518 shutdown_connections 2026-02-17T21:26:10.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.818+0000 7fa745c36640 1 -- 10.20.193.5:0/2229643518 wait complete. 2026-02-17T21:26:10.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:10.818+0000 7fa745c36640 1 librados: shutdown 2026-02-17T21:26:13.830 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:26:13.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.899+0000 7ff532d22640 10 monclient: get_monmap_and_config 2026-02-17T21:26:13.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.899+0000 7ff532d22640 10 monclient: build_initial_monmap 2026-02-17T21:26:13.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.899+0000 7ff532d22640 10 monclient: monmap: 2026-02-17T21:26:13.902 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:13.902 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:13.902 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:26:13.900837+0000 2026-02-17T21:26:13.902 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:26:13.900837+0000 2026-02-17T21:26:13.902 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:13.902 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:13.902 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:26:13.902 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:26:13.903 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:26:13.903 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:26:13.903 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:26:13.903 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:26:13.903 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:13.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.899+0000 7ff532d22640 1 Processor -- start 2026-02-17T21:26:13.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.899+0000 7ff532d22640 1 -- start start 2026-02-17T21:26:13.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.899+0000 7ff532d22640 10 monclient: init 2026-02-17T21:26:13.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.900+0000 7ff532d22640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:13.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.900+0000 7ff532d22640 10 monclient: _add_conns ranks=[1,2,4,5,0,3] 2026-02-17T21:26:13.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.900+0000 7ff532d22640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7ff52c0c7170 addr v1:10.20.193.119:6789/0 2026-02-17T21:26:13.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.900+0000 7ff532d22640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff52c0c7550 addr v1:10.20.193.135:6789/0 2026-02-17T21:26:13.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.900+0000 7ff532d22640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7ff52c0c89c0 0x7ff52c0c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:13.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.900+0000 7ff532d22640 10 monclient(hunting): picked mon.noname-b con 0x7ff52c0c89c0 addr v2:10.20.193.119:3300/0 2026-02-17T21:26:13.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.900+0000 7ff532d22640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff52c0c4fd0 con 0x7ff52c0c7170 2026-02-17T21:26:13.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.900+0000 7ff532d22640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff52c15a9a0 con 0x7ff52c0c7550 2026-02-17T21:26:13.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.900+0000 7ff532d22640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:13.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.900+0000 7ff532d22640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7ff52c0c8530 con 0x7ff52c0c89c0 2026-02-17T21:26:13.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.900+0000 7ff532d22640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:13.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.900+0000 7ff532d22640 10 monclient(hunting): authenticate will time out at 1079.466285s 2026-02-17T21:26:13.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.900+0000 7ff531298640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7ff52c0c89c0 0x7ff52c0c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:13.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.900+0000 7ff523fff640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7ff52c0c7550 0x7ff52c0749b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:47406/0 (socket says 10.20.193.5:47406) 2026-02-17T21:26:13.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.900+0000 7ff523fff640 1 -- 10.20.193.5:0/67725601 learned_addr learned my addr 10.20.193.5:0/67725601 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:26:13.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.900+0000 7ff531298640 10 monclient(hunting): get_auth_request con 0x7ff52c0c89c0 auth_method 0 2026-02-17T21:26:13.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.900+0000 7ff531298640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:13.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.900+0000 7ff531298640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:13.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.900+0000 7ff531298640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:13.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.901+0000 7ff531298640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:13.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.901+0000 7ff531298640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:13.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.901+0000 7ff531298640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:13.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.902+0000 7ff531298640 10 monclient(hunting): handle_auth_done global_id 4666 payload 274 2026-02-17T21:26:13.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.902+0000 7ff531298640 1 -- 10.20.193.5:0/67725601 >> v1:10.20.193.135:6789/0 conn(0x7ff52c0c7550 legacy=0x7ff52c0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:13.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.902+0000 7ff531298640 1 -- 10.20.193.5:0/67725601 >> v1:10.20.193.119:6789/0 conn(0x7ff52c0c7170 legacy=0x7ff52c0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:13.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.902+0000 7ff531298640 10 monclient: _finish_hunting 0 2026-02-17T21:26:13.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.902+0000 7ff531298640 1 monclient: found mon.noname-b 2026-02-17T21:26:13.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.902+0000 7ff531298640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:13.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.902+0000 7ff531298640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:26:13.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.902+0000 7ff531298640 1 -- 10.20.193.5:0/67725601 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff52c0c5270 con 0x7ff52c0c89c0 2026-02-17T21:26:13.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.904+0000 7ff531298640 1 --2- 10.20.193.5:0/67725601 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff52c0c89c0 0x7ff52c0c8e70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff528009d90 tx=0x7ff52802f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efda742c9e9c2287 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:13.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff5237fe640 1 -- 10.20.193.5:0/67725601 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52803c070 con 0x7ff52c0c89c0 2026-02-17T21:26:13.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff5237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:13.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff5237fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:26:13.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff5237fe640 10 monclient: dump: 2026-02-17T21:26:13.914 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:13.914 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:13.915 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:13.915 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:13.915 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:13.915 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:13.915 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:13.915 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:13.915 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:13.915 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:13.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff5237fe640 10 monclient: _finish_auth 0 2026-02-17T21:26:13.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff5237fe640 10 monclient: _check_auth_tickets 2026-02-17T21:26:13.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff5237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:13.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff532d22640 5 monclient: authenticate success, global_id 4666 2026-02-17T21:26:13.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff532d22640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:26:13.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff5237fe640 1 -- 10.20.193.5:0/67725601 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff528037440 con 0x7ff52c0c89c0 2026-02-17T21:26:13.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff5237fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:13.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff5237fe640 1 -- 10.20.193.5:0/67725601 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff528037810 con 0x7ff52c0c89c0 2026-02-17T21:26:13.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff532d22640 10 monclient: get_monmap_and_config success 2026-02-17T21:26:13.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff532d22640 4 set_mon_vals no callback set 2026-02-17T21:26:13.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff5237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:13.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff5237fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:26:13.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff5237fe640 10 monclient: dump: 2026-02-17T21:26:13.916 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:13.916 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:13.917 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:13.917 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:13.917 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:13.917 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:13.917 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:13.917 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:13.917 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:13.917 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:13.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff532d22640 10 monclient: shutdown 2026-02-17T21:26:13.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff532d22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:13.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff532d22640 1 -- 10.20.193.5:0/67725601 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff52c0c89c0 msgr2=0x7ff52c0c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:13.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff532d22640 1 --2- 10.20.193.5:0/67725601 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff52c0c89c0 0x7ff52c0c8e70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff528009d90 tx=0x7ff52802f230 comp rx=0 tx=0).stop 2026-02-17T21:26:13.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff532d22640 1 -- 10.20.193.5:0/67725601 shutdown_connections 2026-02-17T21:26:13.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff532d22640 1 --2- 10.20.193.5:0/67725601 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff52c0c89c0 0x7ff52c0c8e70 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:13.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff532d22640 1 -- 10.20.193.5:0/67725601 >> 10.20.193.5:0/67725601 conn(0x7ff52c0c9f40 msgr2=0x7ff52c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:13.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff532d22640 1 -- 10.20.193.5:0/67725601 shutdown_connections 2026-02-17T21:26:13.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.906+0000 7ff532d22640 1 -- 10.20.193.5:0/67725601 wait complete. 2026-02-17T21:26:13.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.907+0000 7ff532d22640 10 monclient: build_initial_monmap 2026-02-17T21:26:13.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.907+0000 7ff532d22640 10 monclient: monmap: 2026-02-17T21:26:13.918 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:13.918 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:26:13.918 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:26:13.918 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:26:13.918 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:13.918 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:13.919 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:26:13.919 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:26:13.919 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:26:13.919 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:13.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.907+0000 7ff532d22640 1 librados: starting msgr at 2026-02-17T21:26:13.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.907+0000 7ff532d22640 1 librados: starting objecter 2026-02-17T21:26:13.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.907+0000 7ff532d22640 1 Processor -- start 2026-02-17T21:26:13.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.907+0000 7ff532d22640 1 -- start start 2026-02-17T21:26:13.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.907+0000 7ff532d22640 1 librados: setting wanted keys 2026-02-17T21:26:13.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.907+0000 7ff532d22640 1 librados: calling monclient init 2026-02-17T21:26:13.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.907+0000 7ff532d22640 10 monclient: init 2026-02-17T21:26:13.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff532d22640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:13.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff532d22640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:26:13.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff532d22640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff52c0c7170 0x7ff52c0c6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:13.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff532d22640 10 monclient(hunting): picked mon.noname-c con 0x7ff52c0c7170 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:26:13.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff532d22640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff52c0c7550 0x7ff52c1f6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:13.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff532d22640 10 monclient(hunting): picked mon.noname-b con 0x7ff52c0c7550 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:26:13.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff532d22640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff52c0c89c0 0x7ff52c0c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:13.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff532d22640 10 monclient(hunting): picked mon.noname-a con 0x7ff52c0c89c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:26:13.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff532d22640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:13.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff532d22640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff52c0c5830 con 0x7ff52c0c89c0 2026-02-17T21:26:13.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff532d22640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:13.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff532d22640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff52c0c93b0 con 0x7ff52c0c7550 2026-02-17T21:26:13.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff532d22640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:13.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff532d22640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff52c0c7ee0 con 0x7ff52c0c7170 2026-02-17T21:26:13.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff532d22640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:13.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff532d22640 10 monclient(hunting): authenticate will time out at 1079.474140s 2026-02-17T21:26:13.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff530a97640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff52c0c7170 0x7ff52c0c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:13.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff531298640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff52c0c89c0 0x7ff52c0c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:13.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff523fff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff52c0c7550 0x7ff52c1f6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:13.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff531298640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff52c0c89c0 0x7ff52c0c37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:46406/0 (socket says 10.20.193.5:46406) 2026-02-17T21:26:13.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff531298640 1 -- 10.20.193.5:0/1688846982 learned_addr learned my addr 10.20.193.5:0/1688846982 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:26:13.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff531298640 10 monclient(hunting): get_auth_request con 0x7ff52c0c89c0 auth_method 0 2026-02-17T21:26:13.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff531298640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:13.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff531298640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:13.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff531298640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:13.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff530a97640 10 monclient(hunting): get_auth_request con 0x7ff52c0c7170 auth_method 0 2026-02-17T21:26:13.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff530a97640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:13.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff530a97640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:13.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff530a97640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:13.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff523fff640 10 monclient(hunting): get_auth_request con 0x7ff52c0c7550 auth_method 0 2026-02-17T21:26:13.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff523fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:13.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff523fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:13.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff523fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:13.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff531298640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:13.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff531298640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:13.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff531298640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:13.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff530a97640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:13.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff530a97640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:13.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.908+0000 7ff530a97640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:13.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.909+0000 7ff523fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:13.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.909+0000 7ff523fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:13.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.909+0000 7ff523fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:13.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.910+0000 7ff530a97640 10 monclient(hunting): handle_auth_done global_id 4697 payload 824 2026-02-17T21:26:13.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.910+0000 7ff530a97640 1 -- 10.20.193.5:0/1688846982 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff52c0c7550 msgr2=0x7ff52c1f6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:13.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.910+0000 7ff530a97640 1 --2- 10.20.193.5:0/1688846982 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff52c0c7550 0x7ff52c1f6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:13.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.910+0000 7ff530a97640 1 -- 10.20.193.5:0/1688846982 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff52c0c89c0 msgr2=0x7ff52c0c37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:13.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.910+0000 7ff530a97640 1 --2- 10.20.193.5:0/1688846982 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff52c0c89c0 0x7ff52c0c37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:13.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.910+0000 7ff530a97640 10 monclient: _finish_hunting 0 2026-02-17T21:26:13.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.910+0000 7ff530a97640 1 monclient: found mon.noname-c 2026-02-17T21:26:13.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.910+0000 7ff530a97640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:13.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.910+0000 7ff530a97640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:26:13.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.910+0000 7ff530a97640 1 -- 10.20.193.5:0/1688846982 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff52c0c2470 con 0x7ff52c0c7170 2026-02-17T21:26:13.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.911+0000 7ff530a97640 1 --2- 10.20.193.5:0/1688846982 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff52c0c7170 0x7ff52c0c6400 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00c450 tx=0x7ff51c00c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:13.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.911+0000 7ff5217fa640 10 client.?.objecter ms_handle_connect 0x7ff52c0c7170 2026-02-17T21:26:13.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.911+0000 7ff5217fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:26:13.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.913+0000 7ff5217fa640 1 -- 10.20.193.5:0/1688846982 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51c0052d0 con 0x7ff52c0c7170 2026-02-17T21:26:13.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.913+0000 7ff5217fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:13.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.913+0000 7ff5217fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:26:13.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.913+0000 7ff5217fa640 10 monclient: dump: 2026-02-17T21:26:13.926 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:13.927 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:13.927 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:13.927 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:13.927 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:13.927 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:13.927 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:13.927 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:13.927 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:13.927 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:13.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.913+0000 7ff5217fa640 10 monclient: _finish_auth 0 2026-02-17T21:26:13.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.913+0000 7ff5217fa640 10 monclient: _check_auth_tickets 2026-02-17T21:26:13.928 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.913+0000 7ff5217fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:13.928 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.913+0000 7ff5217fa640 1 -- 10.20.193.5:0/1688846982 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff51c005470 con 0x7ff52c0c7170 2026-02-17T21:26:13.928 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.913+0000 7ff5217fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:13.928 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.913+0000 7ff5217fa640 1 -- 10.20.193.5:0/1688846982 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51c0038f0 con 0x7ff52c0c7170 2026-02-17T21:26:13.928 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.913+0000 7ff5217fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:13.928 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.913+0000 7ff5217fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:26:13.928 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.913+0000 7ff5217fa640 10 monclient: dump: 2026-02-17T21:26:13.928 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:13.928 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:13.928 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:13.928 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:13.929 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:13.929 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:13.929 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:13.929 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:13.929 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:13.929 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:13.929 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.913+0000 7ff532d22640 5 monclient: authenticate success, global_id 4697 2026-02-17T21:26:13.929 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.913+0000 7ff522ffd640 4 set_mon_vals no callback set 2026-02-17T21:26:13.929 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.913+0000 7ff532d22640 10 monclient: _renew_subs 2026-02-17T21:26:13.929 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.913+0000 7ff532d22640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:26:13.929 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.913+0000 7ff532d22640 1 -- 10.20.193.5:0/1688846982 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff52c0c2750 con 0x7ff52c0c7170 2026-02-17T21:26:13.929 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.913+0000 7ff532d22640 10 client.4697.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:26:13.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.913+0000 7ff532d22640 10 monclient: _renew_subs 2026-02-17T21:26:13.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.913+0000 7ff532d22640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:26:13.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.913+0000 7ff532d22640 1 -- 10.20.193.5:0/1688846982 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff52c0c2d10 con 0x7ff52c0c7170 2026-02-17T21:26:13.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.913+0000 7ff532d22640 1 librados: init done 2026-02-17T21:26:13.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.914+0000 7ff532d22640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:13.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.914+0000 7ff532d22640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:13.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.914+0000 7ff532d22640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:26:13.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.914+0000 7ff532d22640 1 -- 10.20.193.5:0/1688846982 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff52c0c3320 con 0x7ff52c0c7170 2026-02-17T21:26:13.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.925+0000 7ff5217fa640 1 -- 10.20.193.5:0/1688846982 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7ff51c003a90 con 0x7ff52c0c7170 2026-02-17T21:26:13.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.925+0000 7ff5217fa640 1 --2- 10.20.193.5:0/1688846982 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff4fc0792b0 0x7ff4fc07b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:13.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.926+0000 7ff523fff640 1 --2- 10.20.193.5:0/1688846982 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff4fc0792b0 0x7ff4fc07b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:13.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.926+0000 7ff523fff640 10 monclient: get_auth_request con 0x7ff4fc0792b0 auth_method 0 2026-02-17T21:26:13.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.926+0000 7ff523fff640 1 --2- 10.20.193.5:0/1688846982 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff4fc0792b0 0x7ff4fc07b770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff52c157650 tx=0x7ff514009040 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:13.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:13.926+0000 7ff5217fa640 10 client.4697.objecter ms_handle_connect 0x7ff4fc0792b0 2026-02-17T21:26:14.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.022+0000 7ff5217fa640 1 -- 10.20.193.5:0/1688846982 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7ff51c05e2a0 con 0x7ff52c0c7170 2026-02-17T21:26:14.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.022+0000 7ff5217fa640 10 client.4697.objecter ms_dispatch2 0x7ff52c000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:26:14.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.022+0000 7ff5217fa640 3 client.4697.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:26:14.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.022+0000 7ff5217fa640 3 client.4697.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:26:14.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.022+0000 7ff5217fa640 20 client.4697.objecter dump_active .. 0 homeless 2026-02-17T21:26:14.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.029+0000 7ff5217fa640 1 -- 10.20.193.5:0/1688846982 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff51c062260 con 0x7ff52c0c7170 2026-02-17T21:26:14.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.029+0000 7ff5217fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:14.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.029+0000 7ff5217fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:26:14.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.133+0000 7ff532d22640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:26:14.136 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.133+0000 7ff532d22640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:14.136 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.133+0000 7ff532d22640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:26:14.136 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.133+0000 7ff532d22640 1 -- 10.20.193.5:0/1688846982 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff52c0c7b10 con 0x7ff52c0c7170 2026-02-17T21:26:14.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.136+0000 7ff5217fa640 1 -- 10.20.193.5:0/1688846982 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7ff52c0c7b10 con 0x7ff52c0c7170 2026-02-17T21:26:14.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.136+0000 7ff5217fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:14.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.136+0000 7ff5217fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:26:14.138 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:26:14.139 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:26:14.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.136+0000 7ff532d22640 10 librados: watch_flush enter 2026-02-17T21:26:14.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.136+0000 7ff532d22640 10 librados: watch_flush exit 2026-02-17T21:26:14.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.136+0000 7ff532d22640 20 client.4697.objecter shutdown clearing up homeless session... 2026-02-17T21:26:14.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.136+0000 7ff532d22640 10 client.4697.objecter successfully canceled tick 2026-02-17T21:26:14.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.136+0000 7ff532d22640 1 -- 10.20.193.5:0/1688846982 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff4fc0792b0 msgr2=0x7ff4fc07b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:14.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.136+0000 7ff532d22640 1 --2- 10.20.193.5:0/1688846982 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff4fc0792b0 0x7ff4fc07b770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff52c157650 tx=0x7ff514009040 comp rx=0 tx=0).stop 2026-02-17T21:26:14.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.136+0000 7ff532d22640 10 monclient: shutdown 2026-02-17T21:26:14.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.136+0000 7ff532d22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:14.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.136+0000 7ff532d22640 1 -- 10.20.193.5:0/1688846982 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff52c0c7170 msgr2=0x7ff52c0c6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:14.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.136+0000 7ff532d22640 1 --2- 10.20.193.5:0/1688846982 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff52c0c7170 0x7ff52c0c6400 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00c450 tx=0x7ff51c00c920 comp rx=0 tx=0).stop 2026-02-17T21:26:14.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.136+0000 7ff532d22640 1 -- 10.20.193.5:0/1688846982 shutdown_connections 2026-02-17T21:26:14.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.136+0000 7ff532d22640 1 --2- 10.20.193.5:0/1688846982 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff4fc0792b0 0x7ff4fc07b770 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:14.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.136+0000 7ff532d22640 1 --2- 10.20.193.5:0/1688846982 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff52c0c89c0 0x7ff52c0c37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:14.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.136+0000 7ff532d22640 1 --2- 10.20.193.5:0/1688846982 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff52c0c7550 0x7ff52c1f6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:14.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.136+0000 7ff532d22640 1 --2- 10.20.193.5:0/1688846982 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff52c0c7170 0x7ff52c0c6400 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:14.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.136+0000 7ff532d22640 1 -- 10.20.193.5:0/1688846982 >> 10.20.193.5:0/1688846982 conn(0x7ff52c0c9f40 msgr2=0x7ff52c152db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:14.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.137+0000 7ff532d22640 1 -- 10.20.193.5:0/1688846982 shutdown_connections 2026-02-17T21:26:14.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.137+0000 7ff532d22640 1 -- 10.20.193.5:0/1688846982 wait complete. 2026-02-17T21:26:14.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:14.137+0000 7ff532d22640 1 librados: shutdown 2026-02-17T21:26:17.149 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:26:17.219 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.217+0000 7f0b8521b640 10 monclient: get_monmap_and_config 2026-02-17T21:26:17.219 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.217+0000 7f0b8521b640 10 monclient: build_initial_monmap 2026-02-17T21:26:17.219 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.217+0000 7f0b8521b640 10 monclient: monmap: 2026-02-17T21:26:17.219 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:17.219 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:17.219 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:26:17.217922+0000 2026-02-17T21:26:17.219 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:26:17.217922+0000 2026-02-17T21:26:17.219 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:17.220 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:17.220 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:26:17.220 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:26:17.220 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:26:17.220 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:26:17.220 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:26:17.220 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:26:17.220 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:17.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.217+0000 7f0b8521b640 1 Processor -- start 2026-02-17T21:26:17.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.217+0000 7f0b8521b640 1 -- start start 2026-02-17T21:26:17.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.217+0000 7f0b8521b640 10 monclient: init 2026-02-17T21:26:17.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.218+0000 7f0b8521b640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:17.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.218+0000 7f0b8521b640 10 monclient: _add_conns ranks=[4,1,3,0,2,5] 2026-02-17T21:26:17.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.218+0000 7f0b8521b640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0b8015d370 0x7f0b8015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:17.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.218+0000 7f0b8521b640 10 monclient(hunting): picked mon.noname-b con 0x7f0b8015d370 addr v2:10.20.193.119:3300/0 2026-02-17T21:26:17.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.218+0000 7f0b8521b640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f0b800c7e20 addr v1:10.20.193.119:6789/0 2026-02-17T21:26:17.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.218+0000 7f0b8521b640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f0b800c74c0 0x7f0b800c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:17.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.218+0000 7f0b8521b640 10 monclient(hunting): picked mon.noname-a con 0x7f0b800c74c0 addr v2:10.20.193.5:3300/0 2026-02-17T21:26:17.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.218+0000 7f0b8521b640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b800c8350 con 0x7f0b800c7e20 2026-02-17T21:26:17.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.218+0000 7f0b8521b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:17.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.218+0000 7f0b8521b640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0b8015b710 con 0x7f0b800c74c0 2026-02-17T21:26:17.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.218+0000 7f0b8521b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:17.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.218+0000 7f0b8521b640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f0b800c9240 con 0x7f0b8015d370 2026-02-17T21:26:17.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.218+0000 7f0b8521b640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:17.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.218+0000 7f0b8521b640 10 monclient(hunting): authenticate will time out at 1082.783249s 2026-02-17T21:26:17.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.218+0000 7f0b7f577640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f0b800c74c0 0x7f0b800c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:17.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.218+0000 7f0b7ed76640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0b8015d370 0x7f0b8015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:17.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.218+0000 7f0b7f577640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f0b800c74c0 0x7f0b800c52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:37410/0 (socket says 10.20.193.5:37410) 2026-02-17T21:26:17.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.218+0000 7f0b7f577640 1 -- 10.20.193.5:0/298248766 learned_addr learned my addr 10.20.193.5:0/298248766 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:26:17.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.218+0000 7f0b7f577640 10 monclient(hunting): get_auth_request con 0x7f0b800c74c0 auth_method 0 2026-02-17T21:26:17.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.218+0000 7f0b7f577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:17.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.218+0000 7f0b7f577640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:17.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.218+0000 7f0b7f577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:17.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.219+0000 7f0b7f577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:17.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.219+0000 7f0b7f577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:17.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.219+0000 7f0b7f577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:17.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.219+0000 7f0b7ed76640 10 monclient(hunting): get_auth_request con 0x7f0b8015d370 auth_method 0 2026-02-17T21:26:17.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.219+0000 7f0b7ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:17.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.219+0000 7f0b7ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:17.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.219+0000 7f0b7ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:17.226 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.219+0000 7f0b7ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:17.226 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.219+0000 7f0b7ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:17.226 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.219+0000 7f0b7ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:17.226 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.220+0000 7f0b7f577640 10 monclient(hunting): handle_auth_done global_id 4647 payload 274 2026-02-17T21:26:17.226 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.220+0000 7f0b7f577640 1 -- 10.20.193.5:0/298248766 >> v2:10.20.193.119:3300/0 conn(0x7f0b8015d370 msgr2=0x7f0b8015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:26:17.226 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.220+0000 7f0b7f577640 1 --2- 10.20.193.5:0/298248766 >> v2:10.20.193.119:3300/0 conn(0x7f0b8015d370 0x7f0b8015d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:17.226 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.220+0000 7f0b7f577640 1 -- 10.20.193.5:0/298248766 >> v1:10.20.193.119:6789/0 conn(0x7f0b800c7e20 legacy=0x7f0b8015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:17.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.220+0000 7f0b7f577640 10 monclient: _finish_hunting 0 2026-02-17T21:26:17.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.220+0000 7f0b7f577640 1 monclient: found mon.noname-a 2026-02-17T21:26:17.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.220+0000 7f0b7f577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:17.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.220+0000 7f0b7f577640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:26:17.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.220+0000 7f0b7f577640 1 -- 10.20.193.5:0/298248766 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b800c8630 con 0x7f0b800c74c0 2026-02-17T21:26:17.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.221+0000 7f0b7f577640 1 --2- 10.20.193.5:0/298248766 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0b800c74c0 0x7f0b800c52b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0b800698d0 tx=0x7f0b7002f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171a97b849539e2f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:17.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b7dd74640 1 -- 10.20.193.5:0/298248766 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7002fd70 con 0x7f0b800c74c0 2026-02-17T21:26:17.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b7dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:17.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b7dd74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:26:17.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b7dd74640 10 monclient: dump: 2026-02-17T21:26:17.237 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:17.237 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:17.237 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:17.237 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:17.238 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:17.238 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:17.238 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:17.238 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:17.238 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:17.238 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:17.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b7dd74640 10 monclient: _finish_auth 0 2026-02-17T21:26:17.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b7dd74640 10 monclient: _check_auth_tickets 2026-02-17T21:26:17.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b7dd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:17.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b7dd74640 1 -- 10.20.193.5:0/298248766 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b700373f0 con 0x7f0b800c74c0 2026-02-17T21:26:17.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b8521b640 5 monclient: authenticate success, global_id 4647 2026-02-17T21:26:17.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b8521b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:26:17.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b7dd74640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:17.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b7dd74640 1 -- 10.20.193.5:0/298248766 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b700377c0 con 0x7f0b800c74c0 2026-02-17T21:26:17.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b8521b640 10 monclient: get_monmap_and_config success 2026-02-17T21:26:17.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b8521b640 4 set_mon_vals no callback set 2026-02-17T21:26:17.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b7dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:17.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b7dd74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:26:17.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b7dd74640 10 monclient: dump: 2026-02-17T21:26:17.239 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:17.240 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:17.240 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:17.240 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:17.240 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:17.240 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:17.240 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:17.240 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:17.240 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:17.240 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:17.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b8521b640 10 monclient: shutdown 2026-02-17T21:26:17.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b8521b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:17.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b8521b640 1 -- 10.20.193.5:0/298248766 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0b800c74c0 msgr2=0x7f0b800c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:17.241 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b8521b640 1 --2- 10.20.193.5:0/298248766 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0b800c74c0 0x7f0b800c52b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0b800698d0 tx=0x7f0b7002f270 comp rx=0 tx=0).stop 2026-02-17T21:26:17.241 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b8521b640 1 -- 10.20.193.5:0/298248766 shutdown_connections 2026-02-17T21:26:17.241 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b8521b640 1 --2- 10.20.193.5:0/298248766 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0b800c74c0 0x7f0b800c52b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:17.241 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b8521b640 1 --2- 10.20.193.5:0/298248766 >> v2:10.20.193.119:3300/0 conn(0x7f0b8015d370 0x7f0b8015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:17.241 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b8521b640 1 -- 10.20.193.5:0/298248766 >> 10.20.193.5:0/298248766 conn(0x7f0b800c9f20 msgr2=0x7f0b800ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:17.241 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b8521b640 1 -- 10.20.193.5:0/298248766 shutdown_connections 2026-02-17T21:26:17.241 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b8521b640 1 -- 10.20.193.5:0/298248766 wait complete. 2026-02-17T21:26:17.241 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b8521b640 10 monclient: build_initial_monmap 2026-02-17T21:26:17.241 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.223+0000 7f0b8521b640 10 monclient: monmap: 2026-02-17T21:26:17.241 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:17.241 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:26:17.241 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:26:17.242 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:26:17.242 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:17.242 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:17.242 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:26:17.242 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:26:17.242 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:26:17.242 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:17.242 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.224+0000 7f0b8521b640 1 librados: starting msgr at 2026-02-17T21:26:17.242 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.224+0000 7f0b8521b640 1 librados: starting objecter 2026-02-17T21:26:17.242 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.224+0000 7f0b8521b640 1 Processor -- start 2026-02-17T21:26:17.242 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.224+0000 7f0b8521b640 1 -- start start 2026-02-17T21:26:17.242 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.224+0000 7f0b8521b640 1 librados: setting wanted keys 2026-02-17T21:26:17.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.224+0000 7f0b8521b640 1 librados: calling monclient init 2026-02-17T21:26:17.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.224+0000 7f0b8521b640 10 monclient: init 2026-02-17T21:26:17.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.224+0000 7f0b8521b640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:17.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.224+0000 7f0b8521b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:26:17.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.224+0000 7f0b8521b640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0b800c74c0 0x7f0b800c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:17.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.224+0000 7f0b8521b640 10 monclient(hunting): picked mon.noname-b con 0x7f0b800c74c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:26:17.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.224+0000 7f0b8521b640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0b800c7e20 0x7f0b801595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:17.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.224+0000 7f0b8521b640 10 monclient(hunting): picked mon.noname-a con 0x7f0b800c7e20 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:26:17.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.224+0000 7f0b8521b640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0b8015d370 0x7f0b80159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:17.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.224+0000 7f0b8521b640 10 monclient(hunting): picked mon.noname-c con 0x7f0b8015d370 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:26:17.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.224+0000 7f0b8521b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:17.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.224+0000 7f0b8521b640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0b800c8ed0 con 0x7f0b800c7e20 2026-02-17T21:26:17.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.224+0000 7f0b8521b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:17.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.224+0000 7f0b8521b640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0b800c8bf0 con 0x7f0b800c74c0 2026-02-17T21:26:17.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.224+0000 7f0b8521b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:17.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.224+0000 7f0b8521b640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0b800c96d0 con 0x7f0b8015d370 2026-02-17T21:26:17.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.224+0000 7f0b8521b640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:17.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.224+0000 7f0b8521b640 10 monclient(hunting): authenticate will time out at 1082.789566s 2026-02-17T21:26:17.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.224+0000 7f0b7e575640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0b800c7e20 0x7f0b801595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:17.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.224+0000 7f0b7ed76640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0b800c74c0 0x7f0b800c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:17.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.225+0000 7f0b7e575640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0b800c7e20 0x7f0b801595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:37412/0 (socket says 10.20.193.5:37412) 2026-02-17T21:26:17.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.225+0000 7f0b7e575640 1 -- 10.20.193.5:0/798107692 learned_addr learned my addr 10.20.193.5:0/798107692 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:26:17.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.225+0000 7f0b7e575640 10 monclient(hunting): get_auth_request con 0x7f0b800c7e20 auth_method 0 2026-02-17T21:26:17.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.225+0000 7f0b7e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:17.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.225+0000 7f0b7e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:17.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.225+0000 7f0b7e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:17.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.225+0000 7f0b7f577640 1 --2- 10.20.193.5:0/798107692 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0b8015d370 0x7f0b80159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:17.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.225+0000 7f0b7ed76640 10 monclient(hunting): get_auth_request con 0x7f0b800c74c0 auth_method 0 2026-02-17T21:26:17.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.225+0000 7f0b7ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:17.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.225+0000 7f0b7ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:17.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.225+0000 7f0b7ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:17.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.225+0000 7f0b7f577640 10 monclient(hunting): get_auth_request con 0x7f0b8015d370 auth_method 0 2026-02-17T21:26:17.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.225+0000 7f0b7f577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:17.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.225+0000 7f0b7f577640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:17.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.225+0000 7f0b7f577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:17.245 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.225+0000 7f0b7e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:17.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.225+0000 7f0b7e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:17.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.225+0000 7f0b7e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:17.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.225+0000 7f0b7ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:17.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.225+0000 7f0b7ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:17.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.225+0000 7f0b7ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:17.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.225+0000 7f0b7f577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:17.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.225+0000 7f0b7f577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:17.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.225+0000 7f0b7f577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:17.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.226+0000 7f0b7e575640 10 monclient(hunting): handle_auth_done global_id 4650 payload 824 2026-02-17T21:26:17.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.226+0000 7f0b7e575640 1 -- 10.20.193.5:0/798107692 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0b8015d370 msgr2=0x7f0b80159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:17.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.226+0000 7f0b7e575640 1 --2- 10.20.193.5:0/798107692 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0b8015d370 0x7f0b80159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:17.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.226+0000 7f0b7e575640 1 -- 10.20.193.5:0/798107692 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0b800c74c0 msgr2=0x7f0b800c3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:17.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.226+0000 7f0b7e575640 1 --2- 10.20.193.5:0/798107692 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0b800c74c0 0x7f0b800c3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:17.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.226+0000 7f0b7e575640 10 monclient: _finish_hunting 0 2026-02-17T21:26:17.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.226+0000 7f0b7e575640 1 monclient: found mon.noname-a 2026-02-17T21:26:17.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.226+0000 7f0b7e575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:17.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.226+0000 7f0b7e575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:26:17.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.226+0000 7f0b7e575640 1 -- 10.20.193.5:0/798107692 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b8006ed20 con 0x7f0b800c7e20 2026-02-17T21:26:17.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.226+0000 7f0b7ed76640 1 --2- 10.20.193.5:0/798107692 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0b800c74c0 0x7f0b800c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T21:26:17.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.227+0000 7f0b7e575640 1 --2- 10.20.193.5:0/798107692 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0b800c7e20 0x7f0b801595a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800c5b0 tx=0x7f0b6800ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:17.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.227+0000 7f0b5f7fe640 10 client.?.objecter ms_handle_connect 0x7f0b800c7e20 2026-02-17T21:26:17.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.227+0000 7f0b5f7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:26:17.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.229+0000 7f0b5f7fe640 1 -- 10.20.193.5:0/798107692 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b680052d0 con 0x7f0b800c7e20 2026-02-17T21:26:17.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.229+0000 7f0b5f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:17.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.229+0000 7f0b5f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:26:17.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.229+0000 7f0b5f7fe640 10 monclient: dump: 2026-02-17T21:26:17.248 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:17.248 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:17.248 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:17.248 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:17.248 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:17.248 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:17.248 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:17.249 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:17.249 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:17.249 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:17.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.229+0000 7f0b5f7fe640 10 monclient: _finish_auth 0 2026-02-17T21:26:17.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.229+0000 7f0b5f7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:26:17.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.229+0000 7f0b5f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:17.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.229+0000 7f0b5f7fe640 1 -- 10.20.193.5:0/798107692 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b68005470 con 0x7f0b800c7e20 2026-02-17T21:26:17.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.229+0000 7f0b8521b640 5 monclient: authenticate success, global_id 4650 2026-02-17T21:26:17.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.229+0000 7f0b8521b640 10 monclient: _renew_subs 2026-02-17T21:26:17.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.229+0000 7f0b8521b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:17.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.229+0000 7f0b8521b640 1 -- 10.20.193.5:0/798107692 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b8006f000 con 0x7f0b800c7e20 2026-02-17T21:26:17.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.229+0000 7f0b5f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:17.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.229+0000 7f0b5f7fe640 1 -- 10.20.193.5:0/798107692 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b680038f0 con 0x7f0b800c7e20 2026-02-17T21:26:17.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.229+0000 7f0b5f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:17.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.229+0000 7f0b5f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:26:17.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.229+0000 7f0b7d573640 4 set_mon_vals no callback set 2026-02-17T21:26:17.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.229+0000 7f0b5f7fe640 10 monclient: dump: 2026-02-17T21:26:17.250 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:17.250 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:17.250 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:17.250 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:17.250 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:17.250 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:17.250 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:17.250 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:17.251 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:17.251 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:17.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.229+0000 7f0b8521b640 10 client.4650.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:26:17.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.229+0000 7f0b8521b640 10 monclient: _renew_subs 2026-02-17T21:26:17.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.229+0000 7f0b8521b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:17.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.229+0000 7f0b8521b640 1 -- 10.20.193.5:0/798107692 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b80158da0 con 0x7f0b800c7e20 2026-02-17T21:26:17.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.229+0000 7f0b8521b640 1 librados: init done 2026-02-17T21:26:17.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.230+0000 7f0b8521b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:17.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.230+0000 7f0b8521b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:17.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.230+0000 7f0b8521b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:17.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.230+0000 7f0b8521b640 1 -- 10.20.193.5:0/798107692 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b8015d750 con 0x7f0b800c7e20 2026-02-17T21:26:17.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.242+0000 7f0b5f7fe640 1 -- 10.20.193.5:0/798107692 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f0b68003a90 con 0x7f0b800c7e20 2026-02-17T21:26:17.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.243+0000 7f0b5f7fe640 1 --2- 10.20.193.5:0/798107692 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0b4c079280 0x7f0b4c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:17.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.243+0000 7f0b7ed76640 1 --2- 10.20.193.5:0/798107692 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0b4c079280 0x7f0b4c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:17.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.243+0000 7f0b7ed76640 10 monclient: get_auth_request con 0x7f0b4c079280 auth_method 0 2026-02-17T21:26:17.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.244+0000 7f0b7ed76640 1 --2- 10.20.193.5:0/798107692 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0b4c079280 0x7f0b4c07b740 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0b74011310 tx=0x7f0b74009290 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:17.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.244+0000 7f0b5f7fe640 10 client.4650.objecter ms_handle_connect 0x7f0b4c079280 2026-02-17T21:26:17.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.254+0000 7f0b5f7fe640 1 -- 10.20.193.5:0/798107692 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f0b6805e3c0 con 0x7f0b800c7e20 2026-02-17T21:26:17.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.254+0000 7f0b5f7fe640 10 client.4650.objecter ms_dispatch2 0x7f0b80000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:26:17.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.254+0000 7f0b5f7fe640 3 client.4650.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:26:17.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.254+0000 7f0b5f7fe640 3 client.4650.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:26:17.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.254+0000 7f0b5f7fe640 20 client.4650.objecter dump_active .. 0 homeless 2026-02-17T21:26:17.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.346+0000 7f0b5f7fe640 1 -- 10.20.193.5:0/798107692 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0b68062380 con 0x7f0b800c7e20 2026-02-17T21:26:17.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.346+0000 7f0b5f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:17.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.346+0000 7f0b5f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:26:17.394 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:02:57.019 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:17.398 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:02:57.023 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:17.407 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:02:57.032 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:17.426 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:02:57.050 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:17.427 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:02:57.051 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:17.429 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:02:57.015 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:17.430 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:02:57.016 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:17.435 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:02:57.059 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:17.438 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:02:57.024 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:17.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.446+0000 7f0b8521b640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:26:17.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.446+0000 7f0b8521b640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:17.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.446+0000 7f0b8521b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:17.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.446+0000 7f0b8521b640 1 -- 10.20.193.5:0/798107692 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0b8006ffb0 con 0x7f0b800c7e20 2026-02-17T21:26:17.454 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.453+0000 7f0b5f7fe640 1 -- 10.20.193.5:0/798107692 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f0b68066680 con 0x7f0b800c7e20 2026-02-17T21:26:17.454 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.453+0000 7f0b5f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:17.454 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.453+0000 7f0b5f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:26:17.455 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:26:17.455 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:26:17.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.454+0000 7f0b8521b640 10 librados: watch_flush enter 2026-02-17T21:26:17.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.454+0000 7f0b8521b640 10 librados: watch_flush exit 2026-02-17T21:26:17.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.454+0000 7f0b8521b640 20 client.4650.objecter shutdown clearing up homeless session... 2026-02-17T21:26:17.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.454+0000 7f0b8521b640 10 client.4650.objecter successfully canceled tick 2026-02-17T21:26:17.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.454+0000 7f0b8521b640 1 -- 10.20.193.5:0/798107692 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0b4c079280 msgr2=0x7f0b4c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:17.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.454+0000 7f0b8521b640 1 --2- 10.20.193.5:0/798107692 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0b4c079280 0x7f0b4c07b740 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0b74011310 tx=0x7f0b74009290 comp rx=0 tx=0).stop 2026-02-17T21:26:17.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.454+0000 7f0b8521b640 10 monclient: shutdown 2026-02-17T21:26:17.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.454+0000 7f0b8521b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:17.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.454+0000 7f0b8521b640 1 -- 10.20.193.5:0/798107692 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0b800c7e20 msgr2=0x7f0b801595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:17.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.454+0000 7f0b8521b640 1 --2- 10.20.193.5:0/798107692 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0b800c7e20 0x7f0b801595a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800c5b0 tx=0x7f0b6800ca80 comp rx=0 tx=0).stop 2026-02-17T21:26:17.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.454+0000 7f0b8521b640 1 -- 10.20.193.5:0/798107692 shutdown_connections 2026-02-17T21:26:17.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.454+0000 7f0b8521b640 1 --2- 10.20.193.5:0/798107692 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0b4c079280 0x7f0b4c07b740 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:17.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.454+0000 7f0b8521b640 1 --2- 10.20.193.5:0/798107692 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0b8015d370 0x7f0b80159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:17.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.454+0000 7f0b8521b640 1 --2- 10.20.193.5:0/798107692 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0b800c7e20 0x7f0b801595a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:17.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.454+0000 7f0b8521b640 1 --2- 10.20.193.5:0/798107692 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0b800c74c0 0x7f0b800c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:17.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.454+0000 7f0b8521b640 1 -- 10.20.193.5:0/798107692 >> 10.20.193.5:0/798107692 conn(0x7f0b800c9f20 msgr2=0x7f0b800ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:17.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.454+0000 7f0b8521b640 1 -- 10.20.193.5:0/798107692 shutdown_connections 2026-02-17T21:26:17.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.454+0000 7f0b8521b640 1 -- 10.20.193.5:0/798107692 wait complete. 2026-02-17T21:26:17.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:17.454+0000 7f0b8521b640 1 librados: shutdown 2026-02-17T21:26:20.467 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:26:20.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.534+0000 7f74ca8bd640 10 monclient: get_monmap_and_config 2026-02-17T21:26:20.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.534+0000 7f74ca8bd640 10 monclient: build_initial_monmap 2026-02-17T21:26:20.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.534+0000 7f74ca8bd640 10 monclient: monmap: 2026-02-17T21:26:20.536 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:20.536 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:20.537 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:26:20.535173+0000 2026-02-17T21:26:20.537 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:26:20.535173+0000 2026-02-17T21:26:20.537 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:20.537 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:20.537 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:26:20.537 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:26:20.537 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:26:20.537 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:26:20.537 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:26:20.537 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:26:20.537 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:20.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.534+0000 7f74ca8bd640 1 Processor -- start 2026-02-17T21:26:20.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.534+0000 7f74ca8bd640 1 -- start start 2026-02-17T21:26:20.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.534+0000 7f74ca8bd640 10 monclient: init 2026-02-17T21:26:20.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.535+0000 7f74ca8bd640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:20.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.535+0000 7f74ca8bd640 10 monclient: _add_conns ranks=[4,2,1,0,3,5] 2026-02-17T21:26:20.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.535+0000 7f74ca8bd640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f74c40c7170 0x7f74c40c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:20.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.535+0000 7f74ca8bd640 10 monclient(hunting): picked mon.noname-b con 0x7f74c40c7170 addr v2:10.20.193.119:3300/0 2026-02-17T21:26:20.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.535+0000 7f74ca8bd640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f74c40c48c0 addr v1:10.20.193.135:6789/0 2026-02-17T21:26:20.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.535+0000 7f74ca8bd640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f74c40c4d10 addr v1:10.20.193.119:6789/0 2026-02-17T21:26:20.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.535+0000 7f74ca8bd640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74c415a9a0 con 0x7f74c40c4d10 2026-02-17T21:26:20.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.535+0000 7f74ca8bd640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74c40c5270 con 0x7f74c40c48c0 2026-02-17T21:26:20.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.535+0000 7f74ca8bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:20.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.535+0000 7f74ca8bd640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f74c40c8530 con 0x7f74c40c7170 2026-02-17T21:26:20.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.535+0000 7f74ca8bd640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:20.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.535+0000 7f74ca8bd640 10 monclient(hunting): authenticate will time out at 1086.100759s 2026-02-17T21:26:20.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.536+0000 7f74c3fff640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f74c40c7170 0x7f74c40c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:20.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.536+0000 7f74c37fe640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f74c40c48c0 0x7f74c40749b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:33084/0 (socket says 10.20.193.5:33084) 2026-02-17T21:26:20.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.536+0000 7f74c37fe640 1 -- 10.20.193.5:0/1045592357 learned_addr learned my addr 10.20.193.5:0/1045592357 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:26:20.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.536+0000 7f74c3fff640 10 monclient(hunting): get_auth_request con 0x7f74c40c7170 auth_method 0 2026-02-17T21:26:20.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.536+0000 7f74c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:20.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.536+0000 7f74c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:20.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.536+0000 7f74c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:20.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.536+0000 7f74c3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:20.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.536+0000 7f74c3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:20.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.536+0000 7f74c3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:20.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.537+0000 7f74c2ffd640 1 -- 10.20.193.5:0/1045592357 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1436957925 0 0) 0x7f74c40c5270 con 0x7f74c40c48c0 2026-02-17T21:26:20.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.537+0000 7f74c2ffd640 10 monclient(hunting): _negotiate 2026-02-17T21:26:20.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.537+0000 7f74c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:20.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.537+0000 7f74c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:20.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.537+0000 7f74c2ffd640 10 monclient(hunting): my global_id is 4703 2026-02-17T21:26:20.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.537+0000 7f74c2ffd640 1 -- 10.20.193.5:0/1045592357 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74a8003620 con 0x7f74c40c48c0 2026-02-17T21:26:20.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.537+0000 7f74c3fff640 10 monclient(hunting): handle_auth_done global_id 4681 payload 274 2026-02-17T21:26:20.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.537+0000 7f74c3fff640 1 -- 10.20.193.5:0/1045592357 >> v1:10.20.193.135:6789/0 conn(0x7f74c40c48c0 legacy=0x7f74c40749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:20.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.537+0000 7f74c3fff640 1 -- 10.20.193.5:0/1045592357 >> v1:10.20.193.119:6789/0 conn(0x7f74c40c4d10 legacy=0x7f74c40c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:20.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.537+0000 7f74c3fff640 10 monclient: _finish_hunting 0 2026-02-17T21:26:20.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.537+0000 7f74c3fff640 1 monclient: found mon.noname-b 2026-02-17T21:26:20.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.537+0000 7f74c3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:20.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.537+0000 7f74c3fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:26:20.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.537+0000 7f74c3fff640 1 -- 10.20.193.5:0/1045592357 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c40c5550 con 0x7f74c40c7170 2026-02-17T21:26:20.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.540+0000 7f74c3fff640 1 --2- 10.20.193.5:0/1045592357 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f74c40c7170 0x7f74c40c7550 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f74b00098a0 tx=0x7f74b002ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae2c15d1e7eb848d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:20.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.541+0000 7f74c2ffd640 1 -- 10.20.193.5:0/1045592357 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b003c070 con 0x7f74c40c7170 2026-02-17T21:26:20.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.541+0000 7f74c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:20.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.541+0000 7f74c2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:26:20.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.541+0000 7f74c2ffd640 10 monclient: dump: 2026-02-17T21:26:20.549 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:20.549 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:20.549 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:20.549 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:20.549 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:20.549 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:20.549 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:20.549 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:20.550 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:20.550 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:20.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.541+0000 7f74c2ffd640 10 monclient: _finish_auth 0 2026-02-17T21:26:20.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.541+0000 7f74c2ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:26:20.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.541+0000 7f74c2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:20.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.541+0000 7f74ca8bd640 5 monclient: authenticate success, global_id 4681 2026-02-17T21:26:20.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.541+0000 7f74c2ffd640 1 -- 10.20.193.5:0/1045592357 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74b002fb70 con 0x7f74c40c7170 2026-02-17T21:26:20.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.541+0000 7f74ca8bd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:26:20.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.541+0000 7f74c2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:20.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.541+0000 7f74c2ffd640 1 -- 10.20.193.5:0/1045592357 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b0037440 con 0x7f74c40c7170 2026-02-17T21:26:20.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.541+0000 7f74ca8bd640 10 monclient: get_monmap_and_config success 2026-02-17T21:26:20.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.541+0000 7f74ca8bd640 4 set_mon_vals no callback set 2026-02-17T21:26:20.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.541+0000 7f74c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:20.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.541+0000 7f74c2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:26:20.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.541+0000 7f74c2ffd640 10 monclient: dump: 2026-02-17T21:26:20.551 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:20.551 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:20.551 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:20.551 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:20.551 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:20.551 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:20.551 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:20.551 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:20.551 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:20.552 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:20.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.542+0000 7f74ca8bd640 10 monclient: shutdown 2026-02-17T21:26:20.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.542+0000 7f74ca8bd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:20.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.542+0000 7f74ca8bd640 1 -- 10.20.193.5:0/1045592357 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f74c40c7170 msgr2=0x7f74c40c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:20.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.542+0000 7f74ca8bd640 1 --2- 10.20.193.5:0/1045592357 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f74c40c7170 0x7f74c40c7550 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f74b00098a0 tx=0x7f74b002ee60 comp rx=0 tx=0).stop 2026-02-17T21:26:20.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.542+0000 7f74ca8bd640 1 -- 10.20.193.5:0/1045592357 shutdown_connections 2026-02-17T21:26:20.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.542+0000 7f74ca8bd640 1 --2- 10.20.193.5:0/1045592357 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f74c40c7170 0x7f74c40c7550 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:20.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.542+0000 7f74ca8bd640 1 -- 10.20.193.5:0/1045592357 >> 10.20.193.5:0/1045592357 conn(0x7f74c40c9f40 msgr2=0x7f74c40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:20.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.542+0000 7f74ca8bd640 1 -- 10.20.193.5:0/1045592357 shutdown_connections 2026-02-17T21:26:20.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.542+0000 7f74ca8bd640 1 -- 10.20.193.5:0/1045592357 wait complete. 2026-02-17T21:26:20.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.542+0000 7f74ca8bd640 10 monclient: build_initial_monmap 2026-02-17T21:26:20.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.542+0000 7f74ca8bd640 10 monclient: monmap: 2026-02-17T21:26:20.553 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:20.553 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:26:20.553 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:26:20.553 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:26:20.553 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:20.553 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:20.553 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:26:20.553 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:26:20.553 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:26:20.553 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:20.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74ca8bd640 1 librados: starting msgr at 2026-02-17T21:26:20.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74ca8bd640 1 librados: starting objecter 2026-02-17T21:26:20.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74ca8bd640 1 Processor -- start 2026-02-17T21:26:20.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74ca8bd640 1 -- start start 2026-02-17T21:26:20.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74ca8bd640 1 librados: setting wanted keys 2026-02-17T21:26:20.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74ca8bd640 1 librados: calling monclient init 2026-02-17T21:26:20.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74ca8bd640 10 monclient: init 2026-02-17T21:26:20.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74ca8bd640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:20.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74ca8bd640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:26:20.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74ca8bd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f74c40c48c0 0x7f74c40bb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:20.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74ca8bd640 10 monclient(hunting): picked mon.noname-c con 0x7f74c40c48c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:26:20.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74ca8bd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f74c40c4d10 0x7f74c4155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:20.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74ca8bd640 10 monclient(hunting): picked mon.noname-b con 0x7f74c40c4d10 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:26:20.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74ca8bd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f74c40c7170 0x7f74c4153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:20.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74ca8bd640 10 monclient(hunting): picked mon.noname-a con 0x7f74c40c7170 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:26:20.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74ca8bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:20.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74ca8bd640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f74c40c81c0 con 0x7f74c40c7170 2026-02-17T21:26:20.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74ca8bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:20.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74ca8bd640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f74c40c7ee0 con 0x7f74c40c4d10 2026-02-17T21:26:20.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74ca8bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:20.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74ca8bd640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f74c40750c0 con 0x7f74c40c48c0 2026-02-17T21:26:20.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74ca8bd640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:20.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74ca8bd640 10 monclient(hunting): authenticate will time out at 1086.108513s 2026-02-17T21:26:20.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74c37fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f74c40c4d10 0x7f74c4155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:20.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74c8e33640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f74c40c7170 0x7f74c4153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:20.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.543+0000 7f74c3fff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f74c40c48c0 0x7f74c40bb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:20.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.544+0000 7f74c37fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f74c40c4d10 0x7f74c4155410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:39422/0 (socket says 10.20.193.5:39422) 2026-02-17T21:26:20.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.544+0000 7f74c37fe640 1 -- 10.20.193.5:0/85993598 learned_addr learned my addr 10.20.193.5:0/85993598 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:26:20.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.544+0000 7f74c37fe640 10 monclient(hunting): get_auth_request con 0x7f74c40c4d10 auth_method 0 2026-02-17T21:26:20.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.544+0000 7f74c37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:20.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.544+0000 7f74c37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:20.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.544+0000 7f74c37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:20.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.544+0000 7f74c3fff640 10 monclient(hunting): get_auth_request con 0x7f74c40c48c0 auth_method 0 2026-02-17T21:26:20.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.544+0000 7f74c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:20.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.544+0000 7f74c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:20.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.544+0000 7f74c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:20.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.544+0000 7f74c8e33640 10 monclient(hunting): get_auth_request con 0x7f74c40c7170 auth_method 0 2026-02-17T21:26:20.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.544+0000 7f74c8e33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:20.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.544+0000 7f74c8e33640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:20.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.544+0000 7f74c8e33640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:20.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.544+0000 7f74c37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:20.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.544+0000 7f74c37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:20.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.544+0000 7f74c37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:20.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.544+0000 7f74c3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:20.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.544+0000 7f74c3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:20.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.544+0000 7f74c3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:20.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.544+0000 7f74c8e33640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:20.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.544+0000 7f74c8e33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:20.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.544+0000 7f74c8e33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:20.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.545+0000 7f74c37fe640 10 monclient(hunting): handle_auth_done global_id 4687 payload 824 2026-02-17T21:26:20.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.545+0000 7f74c37fe640 1 -- 10.20.193.5:0/85993598 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f74c40c48c0 msgr2=0x7f74c40bb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:20.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.545+0000 7f74c37fe640 1 --2- 10.20.193.5:0/85993598 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f74c40c48c0 0x7f74c40bb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:20.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.545+0000 7f74c37fe640 1 -- 10.20.193.5:0/85993598 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f74c40c7170 msgr2=0x7f74c4153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:20.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.545+0000 7f74c37fe640 1 --2- 10.20.193.5:0/85993598 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f74c40c7170 0x7f74c4153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:20.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.545+0000 7f74c37fe640 10 monclient: _finish_hunting 0 2026-02-17T21:26:20.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.545+0000 7f74c37fe640 1 monclient: found mon.noname-b 2026-02-17T21:26:20.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.545+0000 7f74c37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:20.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.545+0000 7f74c37fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:26:20.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.545+0000 7f74c37fe640 1 -- 10.20.193.5:0/85993598 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c41f57a0 con 0x7f74c40c4d10 2026-02-17T21:26:20.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.546+0000 7f74c37fe640 1 --2- 10.20.193.5:0/85993598 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f74c40c4d10 0x7f74c4155410 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f74b400c500 tx=0x7f74b400c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:20.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.546+0000 7f74c0ff9640 10 client.?.objecter ms_handle_connect 0x7f74c40c4d10 2026-02-17T21:26:20.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.546+0000 7f74c0ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:26:20.560 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.548+0000 7f74c0ff9640 1 -- 10.20.193.5:0/85993598 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b4017070 con 0x7f74c40c4d10 2026-02-17T21:26:20.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.548+0000 7f74c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:20.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.548+0000 7f74c0ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:26:20.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.548+0000 7f74c0ff9640 10 monclient: dump: 2026-02-17T21:26:20.561 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:20.561 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:20.561 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:20.561 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:20.561 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:20.561 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:20.561 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:20.562 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:20.562 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:20.562 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:20.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.548+0000 7f74c0ff9640 10 monclient: _finish_auth 0 2026-02-17T21:26:20.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.548+0000 7f74c0ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:26:20.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.548+0000 7f74c0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:20.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.548+0000 7f74c0ff9640 1 -- 10.20.193.5:0/85993598 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74b4005de0 con 0x7f74c40c4d10 2026-02-17T21:26:20.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.548+0000 7f74ca8bd640 5 monclient: authenticate success, global_id 4687 2026-02-17T21:26:20.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.548+0000 7f74ca8bd640 10 monclient: _renew_subs 2026-02-17T21:26:20.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.548+0000 7f74ca8bd640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:26:20.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.548+0000 7f74ca8bd640 1 -- 10.20.193.5:0/85993598 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74c4155d50 con 0x7f74c40c4d10 2026-02-17T21:26:20.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.548+0000 7f74c0ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:20.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.548+0000 7f74c0ff9640 1 -- 10.20.193.5:0/85993598 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b40072b0 con 0x7f74c40c4d10 2026-02-17T21:26:20.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.548+0000 7f74c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:20.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.548+0000 7f74c0ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:26:20.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.548+0000 7f74c0ff9640 10 monclient: dump: 2026-02-17T21:26:20.563 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:20.563 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:20.563 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:20.563 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:20.563 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:20.563 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:20.564 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:20.564 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:20.564 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:20.564 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:20.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.548+0000 7f74c27fc640 4 set_mon_vals no callback set 2026-02-17T21:26:20.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.548+0000 7f74ca8bd640 10 client.4687.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:26:20.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.548+0000 7f74ca8bd640 10 monclient: _renew_subs 2026-02-17T21:26:20.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.548+0000 7f74ca8bd640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:26:20.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.548+0000 7f74ca8bd640 1 -- 10.20.193.5:0/85993598 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74c4156310 con 0x7f74c40c4d10 2026-02-17T21:26:20.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.548+0000 7f74ca8bd640 1 librados: init done 2026-02-17T21:26:20.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.548+0000 7f74ca8bd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:20.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.549+0000 7f74ca8bd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:20.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.549+0000 7f74ca8bd640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:26:20.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.549+0000 7f74ca8bd640 1 -- 10.20.193.5:0/85993598 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74c40c7550 con 0x7f74c40c4d10 2026-02-17T21:26:20.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.560+0000 7f74c0ff9640 1 -- 10.20.193.5:0/85993598 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f74b4007450 con 0x7f74c40c4d10 2026-02-17T21:26:20.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.560+0000 7f74c0ff9640 1 --2- 10.20.193.5:0/85993598 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7494079280 0x7f749407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:20.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.560+0000 7f74c3fff640 1 --2- 10.20.193.5:0/85993598 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7494079280 0x7f749407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:20.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.560+0000 7f74c3fff640 10 monclient: get_auth_request con 0x7f7494079280 auth_method 0 2026-02-17T21:26:20.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.561+0000 7f74c3fff640 1 --2- 10.20.193.5:0/85993598 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7494079280 0x7f749407b740 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f74b0039000 tx=0x7f74b0033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:20.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.561+0000 7f74c0ff9640 10 client.4687.objecter ms_handle_connect 0x7f7494079280 2026-02-17T21:26:20.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.562+0000 7f74c0ff9640 1 -- 10.20.193.5:0/85993598 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f74b4007770 con 0x7f74c40c4d10 2026-02-17T21:26:20.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.562+0000 7f74c0ff9640 10 client.4687.objecter ms_dispatch2 0x7f74c4000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:26:20.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.562+0000 7f74c0ff9640 3 client.4687.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:26:20.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.562+0000 7f74c0ff9640 3 client.4687.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:26:20.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.562+0000 7f74c0ff9640 20 client.4687.objecter dump_active .. 0 homeless 2026-02-17T21:26:20.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.662+0000 7f74c0ff9640 1 -- 10.20.193.5:0/85993598 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f74b4021020 con 0x7f74c40c4d10 2026-02-17T21:26:20.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.662+0000 7f74c0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:20.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.662+0000 7f74c0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:26:20.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.762+0000 7f74ca8bd640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:26:20.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.762+0000 7f74ca8bd640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:20.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.762+0000 7f74ca8bd640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:26:20.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.762+0000 7f74ca8bd640 1 -- 10.20.193.5:0/85993598 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f74c4073ad0 con 0x7f74c40c4d10 2026-02-17T21:26:20.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.765+0000 7f74c0ff9640 1 -- 10.20.193.5:0/85993598 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f74b4061770 con 0x7f74c40c4d10 2026-02-17T21:26:20.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.765+0000 7f74c0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:20.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.765+0000 7f74c0ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:26:20.767 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:26:20.767 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:26:20.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.766+0000 7f74ca8bd640 10 librados: watch_flush enter 2026-02-17T21:26:20.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.766+0000 7f74ca8bd640 10 librados: watch_flush exit 2026-02-17T21:26:20.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.766+0000 7f74ca8bd640 20 client.4687.objecter shutdown clearing up homeless session... 2026-02-17T21:26:20.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.766+0000 7f74ca8bd640 10 client.4687.objecter successfully canceled tick 2026-02-17T21:26:20.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.766+0000 7f74ca8bd640 1 -- 10.20.193.5:0/85993598 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7494079280 msgr2=0x7f749407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:20.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.766+0000 7f74ca8bd640 1 --2- 10.20.193.5:0/85993598 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7494079280 0x7f749407b740 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f74b0039000 tx=0x7f74b0033000 comp rx=0 tx=0).stop 2026-02-17T21:26:20.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.766+0000 7f74ca8bd640 10 monclient: shutdown 2026-02-17T21:26:20.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.766+0000 7f74ca8bd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:20.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.766+0000 7f74ca8bd640 1 -- 10.20.193.5:0/85993598 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f74c40c4d10 msgr2=0x7f74c4155410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:20.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.766+0000 7f74ca8bd640 1 --2- 10.20.193.5:0/85993598 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f74c40c4d10 0x7f74c4155410 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f74b400c500 tx=0x7f74b400c9d0 comp rx=0 tx=0).stop 2026-02-17T21:26:20.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.767+0000 7f74ca8bd640 1 -- 10.20.193.5:0/85993598 shutdown_connections 2026-02-17T21:26:20.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.767+0000 7f74ca8bd640 1 --2- 10.20.193.5:0/85993598 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7494079280 0x7f749407b740 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:20.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.767+0000 7f74ca8bd640 1 --2- 10.20.193.5:0/85993598 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f74c40c7170 0x7f74c4153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:20.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.767+0000 7f74ca8bd640 1 --2- 10.20.193.5:0/85993598 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f74c40c4d10 0x7f74c4155410 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:20.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.767+0000 7f74ca8bd640 1 --2- 10.20.193.5:0/85993598 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f74c40c48c0 0x7f74c40bb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:20.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.767+0000 7f74ca8bd640 1 -- 10.20.193.5:0/85993598 >> 10.20.193.5:0/85993598 conn(0x7f74c40c9f40 msgr2=0x7f74c40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:20.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.767+0000 7f74ca8bd640 1 -- 10.20.193.5:0/85993598 shutdown_connections 2026-02-17T21:26:20.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.767+0000 7f74ca8bd640 1 -- 10.20.193.5:0/85993598 wait complete. 2026-02-17T21:26:20.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:20.767+0000 7f74ca8bd640 1 librados: shutdown 2026-02-17T21:26:23.778 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:26:23.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.847+0000 7f4b91d5b640 10 monclient: get_monmap_and_config 2026-02-17T21:26:23.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.847+0000 7f4b91d5b640 10 monclient: build_initial_monmap 2026-02-17T21:26:23.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.847+0000 7f4b91d5b640 10 monclient: monmap: 2026-02-17T21:26:23.849 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:23.849 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:23.849 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:26:23.847867+0000 2026-02-17T21:26:23.849 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:26:23.847867+0000 2026-02-17T21:26:23.849 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:23.849 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:23.850 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:26:23.850 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:26:23.850 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:26:23.850 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:26:23.850 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:26:23.850 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:26:23.850 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:23.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.847+0000 7f4b91d5b640 1 Processor -- start 2026-02-17T21:26:23.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.847+0000 7f4b91d5b640 1 -- start start 2026-02-17T21:26:23.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.847+0000 7f4b91d5b640 10 monclient: init 2026-02-17T21:26:23.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.848+0000 7f4b91d5b640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:23.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.848+0000 7f4b91d5b640 10 monclient: _add_conns ranks=[0,4,2,3,1,5] 2026-02-17T21:26:23.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.848+0000 7f4b91d5b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4b8c0c7170 addr v1:10.20.193.5:6789/0 2026-02-17T21:26:23.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.848+0000 7f4b91d5b640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f4b8c0c7550 0x7f4b8c0749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:23.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.848+0000 7f4b91d5b640 10 monclient(hunting): picked mon.noname-b con 0x7f4b8c0c7550 addr v2:10.20.193.119:3300/0 2026-02-17T21:26:23.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.848+0000 7f4b91d5b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4b8c074ef0 addr v1:10.20.193.135:6789/0 2026-02-17T21:26:23.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.848+0000 7f4b91d5b640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b8c0c4fd0 con 0x7f4b8c0c7170 2026-02-17T21:26:23.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.848+0000 7f4b91d5b640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b8c15a9a0 con 0x7f4b8c074ef0 2026-02-17T21:26:23.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.848+0000 7f4b91d5b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:23.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.848+0000 7f4b91d5b640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f4b8c0c8530 con 0x7f4b8c0c7550 2026-02-17T21:26:23.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.848+0000 7f4b91d5b640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:23.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.848+0000 7f4b91d5b640 10 monclient(hunting): authenticate will time out at 1089.413153s 2026-02-17T21:26:23.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.848+0000 7f4b8b7fe640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f4b8c0c7170 0x7f4b8c0c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:43258/0 (socket says 10.20.193.5:43258) 2026-02-17T21:26:23.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.848+0000 7f4b8b7fe640 1 -- 10.20.193.5:0/473016879 learned_addr learned my addr 10.20.193.5:0/473016879 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:26:23.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.848+0000 7f4b8affd640 1 --2- 10.20.193.5:0/473016879 >> v2:10.20.193.119:3300/0 conn(0x7f4b8c0c7550 0x7f4b8c0749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:23.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.848+0000 7f4b8affd640 10 monclient(hunting): get_auth_request con 0x7f4b8c0c7550 auth_method 0 2026-02-17T21:26:23.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.848+0000 7f4b8affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:23.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.848+0000 7f4b8affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:23.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.848+0000 7f4b8affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:23.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.849+0000 7f4b8affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:23.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.849+0000 7f4b8affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:23.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.849+0000 7f4b8affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:23.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.849+0000 7f4b8a7fc640 1 -- 10.20.193.5:0/473016879 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2546495082 0 0) 0x7f4b8c15a9a0 con 0x7f4b8c074ef0 2026-02-17T21:26:23.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.849+0000 7f4b8a7fc640 10 monclient(hunting): _negotiate 2026-02-17T21:26:23.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.849+0000 7f4b8a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:23.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.849+0000 7f4b8a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:23.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.849+0000 7f4b8a7fc640 10 monclient(hunting): my global_id is 4709 2026-02-17T21:26:23.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.850+0000 7f4b8a7fc640 1 -- 10.20.193.5:0/473016879 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b70003620 con 0x7f4b8c074ef0 2026-02-17T21:26:23.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.850+0000 7f4b8a7fc640 1 -- 10.20.193.5:0/473016879 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3153689777 0 0) 0x7f4b8c0c4fd0 con 0x7f4b8c0c7170 2026-02-17T21:26:23.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.850+0000 7f4b8a7fc640 10 monclient(hunting): _negotiate 2026-02-17T21:26:23.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.850+0000 7f4b8a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:23.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.850+0000 7f4b8a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:23.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.850+0000 7f4b8a7fc640 10 monclient(hunting): my global_id is 4656 2026-02-17T21:26:23.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.850+0000 7f4b8a7fc640 1 -- 10.20.193.5:0/473016879 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b8c15a9a0 con 0x7f4b8c0c7170 2026-02-17T21:26:23.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.850+0000 7f4b8affd640 10 monclient(hunting): handle_auth_done global_id 4690 payload 274 2026-02-17T21:26:23.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.850+0000 7f4b8affd640 1 -- 10.20.193.5:0/473016879 >> v1:10.20.193.135:6789/0 conn(0x7f4b8c074ef0 legacy=0x7f4b8c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:23.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.850+0000 7f4b8affd640 1 -- 10.20.193.5:0/473016879 >> v1:10.20.193.5:6789/0 conn(0x7f4b8c0c7170 legacy=0x7f4b8c0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:23.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.850+0000 7f4b8affd640 10 monclient: _finish_hunting 0 2026-02-17T21:26:23.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.850+0000 7f4b8affd640 1 monclient: found mon.noname-b 2026-02-17T21:26:23.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.850+0000 7f4b8affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:23.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.850+0000 7f4b8affd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:26:23.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.850+0000 7f4b8affd640 1 -- 10.20.193.5:0/473016879 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8c0c5270 con 0x7f4b8c0c7550 2026-02-17T21:26:23.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.851+0000 7f4b8affd640 1 --2- 10.20.193.5:0/473016879 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4b8c0c7550 0x7f4b8c0749b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c0098a0 tx=0x7f4b7c02ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11e2eb714a13774f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:23.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b8a7fc640 1 -- 10.20.193.5:0/473016879 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c03c070 con 0x7f4b8c0c7550 2026-02-17T21:26:23.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b8a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:23.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b8a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:26:23.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b8a7fc640 10 monclient: dump: 2026-02-17T21:26:23.864 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:23.864 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:23.864 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:23.864 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:23.864 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:23.864 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:23.864 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:23.864 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:23.865 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:23.865 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:23.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b8a7fc640 10 monclient: _finish_auth 0 2026-02-17T21:26:23.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b8a7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:26:23.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b8a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:23.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b8a7fc640 1 -- 10.20.193.5:0/473016879 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b7c02fb70 con 0x7f4b8c0c7550 2026-02-17T21:26:23.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b91d5b640 5 monclient: authenticate success, global_id 4690 2026-02-17T21:26:23.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b91d5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:26:23.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b8a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:23.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b8a7fc640 1 -- 10.20.193.5:0/473016879 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c037440 con 0x7f4b8c0c7550 2026-02-17T21:26:23.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b8a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:23.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b8a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:26:23.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b8a7fc640 10 monclient: dump: 2026-02-17T21:26:23.866 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:23.866 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:23.866 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:23.866 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:23.866 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:23.866 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:23.866 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:23.867 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:23.867 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:23.867 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:23.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b91d5b640 10 monclient: get_monmap_and_config success 2026-02-17T21:26:23.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b91d5b640 4 set_mon_vals no callback set 2026-02-17T21:26:23.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b91d5b640 10 monclient: shutdown 2026-02-17T21:26:23.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b91d5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:23.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b91d5b640 1 -- 10.20.193.5:0/473016879 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4b8c0c7550 msgr2=0x7f4b8c0749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:23.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b91d5b640 1 --2- 10.20.193.5:0/473016879 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4b8c0c7550 0x7f4b8c0749b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c0098a0 tx=0x7f4b7c02ee60 comp rx=0 tx=0).stop 2026-02-17T21:26:23.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b91d5b640 1 -- 10.20.193.5:0/473016879 shutdown_connections 2026-02-17T21:26:23.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b91d5b640 1 --2- 10.20.193.5:0/473016879 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4b8c0c7550 0x7f4b8c0749b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:23.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b91d5b640 1 -- 10.20.193.5:0/473016879 >> 10.20.193.5:0/473016879 conn(0x7f4b8c0c9f40 msgr2=0x7f4b8c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:23.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b91d5b640 1 -- 10.20.193.5:0/473016879 shutdown_connections 2026-02-17T21:26:23.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.853+0000 7f4b91d5b640 1 -- 10.20.193.5:0/473016879 wait complete. 2026-02-17T21:26:23.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.854+0000 7f4b91d5b640 10 monclient: build_initial_monmap 2026-02-17T21:26:23.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.854+0000 7f4b91d5b640 10 monclient: monmap: 2026-02-17T21:26:23.868 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:23.868 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:26:23.868 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:26:23.868 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:26:23.868 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:23.868 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:23.868 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:26:23.868 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:26:23.869 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:26:23.869 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:23.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.854+0000 7f4b91d5b640 1 librados: starting msgr at 2026-02-17T21:26:23.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.854+0000 7f4b91d5b640 1 librados: starting objecter 2026-02-17T21:26:23.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.854+0000 7f4b91d5b640 1 Processor -- start 2026-02-17T21:26:23.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.854+0000 7f4b91d5b640 1 -- start start 2026-02-17T21:26:23.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.854+0000 7f4b91d5b640 1 librados: setting wanted keys 2026-02-17T21:26:23.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.854+0000 7f4b91d5b640 1 librados: calling monclient init 2026-02-17T21:26:23.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.854+0000 7f4b91d5b640 10 monclient: init 2026-02-17T21:26:23.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.854+0000 7f4b91d5b640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:23.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.854+0000 7f4b91d5b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:26:23.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.854+0000 7f4b91d5b640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4b8c074ef0 0x7f4b8c15bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:23.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.854+0000 7f4b91d5b640 10 monclient(hunting): picked mon.noname-b con 0x7f4b8c074ef0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:26:23.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.854+0000 7f4b91d5b640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f4b8c0c7170 0x7f4b8c1593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:23.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.854+0000 7f4b91d5b640 10 monclient(hunting): picked mon.noname-a con 0x7f4b8c0c7170 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:26:23.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.854+0000 7f4b91d5b640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f4b8c0c7550 0x7f4b8c15da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:23.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.854+0000 7f4b91d5b640 10 monclient(hunting): picked mon.noname-c con 0x7f4b8c0c7550 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:26:23.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.854+0000 7f4b91d5b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:23.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.854+0000 7f4b91d5b640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8c0c7ee0 con 0x7f4b8c0c7170 2026-02-17T21:26:23.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.854+0000 7f4b91d5b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:23.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.854+0000 7f4b91d5b640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8c0c5830 con 0x7f4b8c074ef0 2026-02-17T21:26:23.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.854+0000 7f4b91d5b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:23.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.854+0000 7f4b91d5b640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8c0c81c0 con 0x7f4b8c0c7550 2026-02-17T21:26:23.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.854+0000 7f4b91d5b640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:23.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.854+0000 7f4b91d5b640 10 monclient(hunting): authenticate will time out at 1089.419914s 2026-02-17T21:26:23.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.855+0000 7f4b8affd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f4b8c0c7170 0x7f4b8c1593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:23.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.855+0000 7f4b8bfff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f4b8c0c7550 0x7f4b8c15da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:23.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.855+0000 7f4b8bfff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f4b8c0c7550 0x7f4b8c15da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:58890/0 (socket says 10.20.193.5:58890) 2026-02-17T21:26:23.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.855+0000 7f4b8bfff640 1 -- 10.20.193.5:0/1609052392 learned_addr learned my addr 10.20.193.5:0/1609052392 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:26:23.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.855+0000 7f4b8bfff640 10 monclient(hunting): get_auth_request con 0x7f4b8c0c7550 auth_method 0 2026-02-17T21:26:23.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.855+0000 7f4b8bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:23.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.855+0000 7f4b8bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:23.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.855+0000 7f4b8bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:23.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.855+0000 7f4b8affd640 10 monclient(hunting): get_auth_request con 0x7f4b8c0c7170 auth_method 0 2026-02-17T21:26:23.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.855+0000 7f4b8affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:23.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.855+0000 7f4b8affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:23.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.855+0000 7f4b8affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:23.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.855+0000 7f4b8b7fe640 1 --2- 10.20.193.5:0/1609052392 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4b8c074ef0 0x7f4b8c15bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:23.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.855+0000 7f4b8bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:23.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.855+0000 7f4b8bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:23.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.855+0000 7f4b8bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:23.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.855+0000 7f4b8affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:23.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.855+0000 7f4b8affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:23.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.855+0000 7f4b8affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:23.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.855+0000 7f4b8b7fe640 10 monclient(hunting): get_auth_request con 0x7f4b8c074ef0 auth_method 0 2026-02-17T21:26:23.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.855+0000 7f4b8b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:23.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.855+0000 7f4b8b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:23.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.855+0000 7f4b8b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:23.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.856+0000 7f4b8b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:23.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.856+0000 7f4b8b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:23.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.856+0000 7f4b8b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:23.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.856+0000 7f4b8bfff640 10 monclient(hunting): handle_auth_done global_id 4712 payload 824 2026-02-17T21:26:23.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.856+0000 7f4b8bfff640 1 -- 10.20.193.5:0/1609052392 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4b8c074ef0 msgr2=0x7f4b8c15bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:23.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.856+0000 7f4b8bfff640 1 --2- 10.20.193.5:0/1609052392 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4b8c074ef0 0x7f4b8c15bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:23.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.856+0000 7f4b8bfff640 1 -- 10.20.193.5:0/1609052392 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f4b8c0c7170 msgr2=0x7f4b8c1593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:23.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.856+0000 7f4b8bfff640 1 --2- 10.20.193.5:0/1609052392 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f4b8c0c7170 0x7f4b8c1593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:23.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.856+0000 7f4b8bfff640 10 monclient: _finish_hunting 0 2026-02-17T21:26:23.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.856+0000 7f4b8bfff640 1 monclient: found mon.noname-c 2026-02-17T21:26:23.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.856+0000 7f4b8bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:23.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.856+0000 7f4b8bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:26:23.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.856+0000 7f4b8bfff640 1 -- 10.20.193.5:0/1609052392 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8c1f3ff0 con 0x7f4b8c0c7550 2026-02-17T21:26:23.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.858+0000 7f4b8bfff640 1 --2- 10.20.193.5:0/1609052392 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f4b8c0c7550 0x7f4b8c15da50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000cc30 tx=0x7f4b8000a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:23.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.858+0000 7f4b67fff640 10 client.?.objecter ms_handle_connect 0x7f4b8c0c7550 2026-02-17T21:26:23.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.858+0000 7f4b67fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:26:23.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b67fff640 1 -- 10.20.193.5:0/1609052392 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8000ce50 con 0x7f4b8c0c7550 2026-02-17T21:26:23.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b67fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:23.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b67fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:26:23.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b67fff640 10 monclient: dump: 2026-02-17T21:26:23.874 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:23.874 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:23.874 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:23.874 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:23.874 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:23.874 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:23.875 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:23.875 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:23.875 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:23.875 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:23.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b67fff640 10 monclient: _finish_auth 0 2026-02-17T21:26:23.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b67fff640 10 monclient: _check_auth_tickets 2026-02-17T21:26:23.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b67fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:23.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b91d5b640 5 monclient: authenticate success, global_id 4712 2026-02-17T21:26:23.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b91d5b640 10 monclient: _renew_subs 2026-02-17T21:26:23.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b91d5b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:26:23.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b91d5b640 1 -- 10.20.193.5:0/1609052392 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b8c1f42d0 con 0x7f4b8c0c7550 2026-02-17T21:26:23.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b91d5b640 10 client.4712.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:26:23.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b91d5b640 10 monclient: _renew_subs 2026-02-17T21:26:23.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b91d5b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:26:23.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b91d5b640 1 -- 10.20.193.5:0/1609052392 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b8c15b1a0 con 0x7f4b8c0c7550 2026-02-17T21:26:23.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b91d5b640 1 librados: init done 2026-02-17T21:26:23.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b67fff640 1 -- 10.20.193.5:0/1609052392 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b80003a70 con 0x7f4b8c0c7550 2026-02-17T21:26:23.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b67fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:23.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b67fff640 1 -- 10.20.193.5:0/1609052392 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b800050d0 con 0x7f4b8c0c7550 2026-02-17T21:26:23.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b67fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:23.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b67fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:26:23.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b67fff640 10 monclient: dump: 2026-02-17T21:26:23.876 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:23.876 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:23.876 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:23.877 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:23.877 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:23.877 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:23.877 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:23.877 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:23.877 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:23.877 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:23.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b89ffb640 4 set_mon_vals no callback set 2026-02-17T21:26:23.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b91d5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:23.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b91d5b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:23.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b91d5b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:26:23.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.859+0000 7f4b91d5b640 1 -- 10.20.193.5:0/1609052392 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b8c14c770 con 0x7f4b8c0c7550 2026-02-17T21:26:23.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.963+0000 7f4b67fff640 1 -- 10.20.193.5:0/1609052392 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f4b80005270 con 0x7f4b8c0c7550 2026-02-17T21:26:23.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.963+0000 7f4b67fff640 1 --2- 10.20.193.5:0/1609052392 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4b5c079420 0x7f4b5c07b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:23.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.964+0000 7f4b8b7fe640 1 --2- 10.20.193.5:0/1609052392 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4b5c079420 0x7f4b5c07b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:23.966 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.964+0000 7f4b8b7fe640 10 monclient: get_auth_request con 0x7f4b5c079420 auth_method 0 2026-02-17T21:26:23.966 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.964+0000 7f4b8b7fe640 1 --2- 10.20.193.5:0/1609052392 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4b5c079420 0x7f4b5c07b8e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4b78005980 tx=0x7f4b78009040 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:23.966 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.964+0000 7f4b67fff640 10 client.4712.objecter ms_handle_connect 0x7f4b5c079420 2026-02-17T21:26:23.966 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.964+0000 7f4b67fff640 1 -- 10.20.193.5:0/1609052392 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f4b80098650 con 0x7f4b8c0c7550 2026-02-17T21:26:23.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.964+0000 7f4b67fff640 10 client.4712.objecter ms_dispatch2 0x7f4b8c000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:26:23.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.964+0000 7f4b67fff640 3 client.4712.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:26:23.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.964+0000 7f4b67fff640 3 client.4712.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:26:23.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.964+0000 7f4b67fff640 20 client.4712.objecter dump_active .. 0 homeless 2026-02-17T21:26:23.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.970+0000 7f4b67fff640 1 -- 10.20.193.5:0/1609052392 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4b80062ad0 con 0x7f4b8c0c7550 2026-02-17T21:26:23.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.970+0000 7f4b67fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:23.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:23.970+0000 7f4b67fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:26:24.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.072+0000 7f4b91d5b640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:26:24.074 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.072+0000 7f4b91d5b640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:24.074 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.072+0000 7f4b91d5b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:26:24.074 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.072+0000 7f4b91d5b640 1 -- 10.20.193.5:0/1609052392 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4b8c0ca6a0 con 0x7f4b8c0c7550 2026-02-17T21:26:24.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.075+0000 7f4b67fff640 1 -- 10.20.193.5:0/1609052392 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f4b80066dd0 con 0x7f4b8c0c7550 2026-02-17T21:26:24.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.075+0000 7f4b67fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:24.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.075+0000 7f4b67fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:26:24.077 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:26:24.077 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:26:24.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.076+0000 7f4b91d5b640 10 librados: watch_flush enter 2026-02-17T21:26:24.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.076+0000 7f4b91d5b640 10 librados: watch_flush exit 2026-02-17T21:26:24.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.076+0000 7f4b91d5b640 20 client.4712.objecter shutdown clearing up homeless session... 2026-02-17T21:26:24.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.076+0000 7f4b91d5b640 10 client.4712.objecter successfully canceled tick 2026-02-17T21:26:24.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.076+0000 7f4b91d5b640 1 -- 10.20.193.5:0/1609052392 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4b5c079420 msgr2=0x7f4b5c07b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:24.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.076+0000 7f4b91d5b640 1 --2- 10.20.193.5:0/1609052392 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4b5c079420 0x7f4b5c07b8e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4b78005980 tx=0x7f4b78009040 comp rx=0 tx=0).stop 2026-02-17T21:26:24.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.076+0000 7f4b91d5b640 10 monclient: shutdown 2026-02-17T21:26:24.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.076+0000 7f4b91d5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:24.079 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.076+0000 7f4b91d5b640 1 -- 10.20.193.5:0/1609052392 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f4b8c0c7550 msgr2=0x7f4b8c15da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:24.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.076+0000 7f4b91d5b640 1 --2- 10.20.193.5:0/1609052392 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f4b8c0c7550 0x7f4b8c15da50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000cc30 tx=0x7f4b8000a430 comp rx=0 tx=0).stop 2026-02-17T21:26:24.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.076+0000 7f4b91d5b640 1 -- 10.20.193.5:0/1609052392 shutdown_connections 2026-02-17T21:26:24.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.076+0000 7f4b91d5b640 1 --2- 10.20.193.5:0/1609052392 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4b5c079420 0x7f4b5c07b8e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:24.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.076+0000 7f4b91d5b640 1 --2- 10.20.193.5:0/1609052392 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f4b8c0c7550 0x7f4b8c15da50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:24.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.076+0000 7f4b91d5b640 1 --2- 10.20.193.5:0/1609052392 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f4b8c0c7170 0x7f4b8c1593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:24.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.076+0000 7f4b91d5b640 1 --2- 10.20.193.5:0/1609052392 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4b8c074ef0 0x7f4b8c15bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:24.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.076+0000 7f4b91d5b640 1 -- 10.20.193.5:0/1609052392 >> 10.20.193.5:0/1609052392 conn(0x7f4b8c0c9f40 msgr2=0x7f4b8c158330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:24.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.076+0000 7f4b91d5b640 1 -- 10.20.193.5:0/1609052392 shutdown_connections 2026-02-17T21:26:24.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.076+0000 7f4b91d5b640 1 -- 10.20.193.5:0/1609052392 wait complete. 2026-02-17T21:26:24.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:24.076+0000 7f4b91d5b640 1 librados: shutdown 2026-02-17T21:26:27.087 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:26:27.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.158+0000 7f32f67ed640 10 monclient: get_monmap_and_config 2026-02-17T21:26:27.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.158+0000 7f32f67ed640 10 monclient: build_initial_monmap 2026-02-17T21:26:27.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.158+0000 7f32f67ed640 10 monclient: monmap: 2026-02-17T21:26:27.160 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:27.160 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:27.160 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:26:27.158950+0000 2026-02-17T21:26:27.160 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:26:27.158950+0000 2026-02-17T21:26:27.160 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:27.160 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:27.160 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:26:27.160 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:26:27.160 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:26:27.161 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:26:27.161 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:26:27.161 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:26:27.161 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:27.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.158+0000 7f32f67ed640 1 Processor -- start 2026-02-17T21:26:27.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.158+0000 7f32f67ed640 1 -- start start 2026-02-17T21:26:27.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.158+0000 7f32f67ed640 10 monclient: init 2026-02-17T21:26:27.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.159+0000 7f32f67ed640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:27.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.159+0000 7f32f67ed640 10 monclient: _add_conns ranks=[1,0,3,2,4,5] 2026-02-17T21:26:27.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.159+0000 7f32f67ed640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f32f015d370 addr v1:10.20.193.119:6789/0 2026-02-17T21:26:27.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.159+0000 7f32f67ed640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f32f00c7e20 addr v1:10.20.193.5:6789/0 2026-02-17T21:26:27.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.159+0000 7f32f67ed640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f32f00c59c0 0x7f32f015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:27.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.159+0000 7f32f67ed640 10 monclient(hunting): picked mon.noname-a con 0x7f32f00c59c0 addr v2:10.20.193.5:3300/0 2026-02-17T21:26:27.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.159+0000 7f32f67ed640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32f00c8350 con 0x7f32f00c7e20 2026-02-17T21:26:27.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.159+0000 7f32f67ed640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32f00c8630 con 0x7f32f015d370 2026-02-17T21:26:27.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.159+0000 7f32f67ed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:27.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.159+0000 7f32f67ed640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f32f015b710 con 0x7f32f00c59c0 2026-02-17T21:26:27.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.159+0000 7f32f67ed640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:27.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.159+0000 7f32f67ed640 10 monclient(hunting): authenticate will time out at 1092.724289s 2026-02-17T21:26:27.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.159+0000 7f32f4d63640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f32f00c59c0 0x7f32f015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:27.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.159+0000 7f32effff640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f32f015d370 0x7f32f015b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:38442/0 (socket says 10.20.193.5:38442) 2026-02-17T21:26:27.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.159+0000 7f32effff640 1 -- 10.20.193.5:0/2367617196 learned_addr learned my addr 10.20.193.5:0/2367617196 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:26:27.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.160+0000 7f32f4d63640 10 monclient(hunting): get_auth_request con 0x7f32f00c59c0 auth_method 0 2026-02-17T21:26:27.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.160+0000 7f32f4d63640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:27.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.160+0000 7f32f4d63640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:27.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.160+0000 7f32f4d63640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:27.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.160+0000 7f32f4d63640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:27.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.160+0000 7f32f4d63640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:27.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.160+0000 7f32f4d63640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:27.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.161+0000 7f32eeffd640 1 -- 10.20.193.5:0/2367617196 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3930388876 0 0) 0x7f32f00c8630 con 0x7f32f015d370 2026-02-17T21:26:27.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.161+0000 7f32eeffd640 10 monclient(hunting): _negotiate 2026-02-17T21:26:27.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.161+0000 7f32eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:27.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.161+0000 7f32eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:27.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.161+0000 7f32eeffd640 10 monclient(hunting): my global_id is 4696 2026-02-17T21:26:27.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.161+0000 7f32eeffd640 1 -- 10.20.193.5:0/2367617196 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32d4003620 con 0x7f32f015d370 2026-02-17T21:26:27.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.161+0000 7f32f4d63640 10 monclient(hunting): handle_auth_done global_id 4662 payload 274 2026-02-17T21:26:27.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.161+0000 7f32f4d63640 1 -- 10.20.193.5:0/2367617196 >> v1:10.20.193.119:6789/0 conn(0x7f32f015d370 legacy=0x7f32f015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:27.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.161+0000 7f32f4d63640 1 -- 10.20.193.5:0/2367617196 >> v1:10.20.193.5:6789/0 conn(0x7f32f00c7e20 legacy=0x7f32f00c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:27.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.161+0000 7f32f4d63640 10 monclient: _finish_hunting 0 2026-02-17T21:26:27.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.161+0000 7f32f4d63640 1 monclient: found mon.noname-a 2026-02-17T21:26:27.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.161+0000 7f32f4d63640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:27.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.161+0000 7f32f4d63640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:26:27.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.161+0000 7f32f4d63640 1 -- 10.20.193.5:0/2367617196 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f00c8910 con 0x7f32f00c59c0 2026-02-17T21:26:27.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.163+0000 7f32f4d63640 1 --2- 10.20.193.5:0/2367617196 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f32f00c59c0 0x7f32f015d750 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009d90 tx=0x7f32e402f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1254f08ac65aa9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:27.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.165+0000 7f32eeffd640 1 -- 10.20.193.5:0/2367617196 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e403c070 con 0x7f32f00c59c0 2026-02-17T21:26:27.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.165+0000 7f32eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:27.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.165+0000 7f32eeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:26:27.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.165+0000 7f32eeffd640 10 monclient: dump: 2026-02-17T21:26:27.173 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:27.173 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:27.173 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:27.173 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:27.173 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:27.173 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:27.173 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:27.173 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:27.173 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:27.174 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:27.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.165+0000 7f32eeffd640 10 monclient: _finish_auth 0 2026-02-17T21:26:27.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.165+0000 7f32eeffd640 10 monclient: _check_auth_tickets 2026-02-17T21:26:27.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.165+0000 7f32eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:27.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.165+0000 7f32eeffd640 1 -- 10.20.193.5:0/2367617196 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e4037440 con 0x7f32f00c59c0 2026-02-17T21:26:27.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.165+0000 7f32eeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:27.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.165+0000 7f32eeffd640 1 -- 10.20.193.5:0/2367617196 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e4037810 con 0x7f32f00c59c0 2026-02-17T21:26:27.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.165+0000 7f32eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:27.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.165+0000 7f32eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:26:27.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.165+0000 7f32eeffd640 10 monclient: dump: 2026-02-17T21:26:27.175 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:27.175 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:27.175 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:27.175 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:27.175 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:27.175 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:27.175 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:27.175 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:27.175 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:27.175 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:27.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.165+0000 7f32f67ed640 5 monclient: authenticate success, global_id 4662 2026-02-17T21:26:27.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.165+0000 7f32f67ed640 10 monclient: get_monmap_and_config success 2026-02-17T21:26:27.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.165+0000 7f32f67ed640 4 set_mon_vals no callback set 2026-02-17T21:26:27.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.166+0000 7f32f67ed640 10 monclient: shutdown 2026-02-17T21:26:27.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.166+0000 7f32f67ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:27.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.166+0000 7f32f67ed640 1 -- 10.20.193.5:0/2367617196 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f32f00c59c0 msgr2=0x7f32f015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:27.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.166+0000 7f32f67ed640 1 --2- 10.20.193.5:0/2367617196 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f32f00c59c0 0x7f32f015d750 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009d90 tx=0x7f32e402f230 comp rx=0 tx=0).stop 2026-02-17T21:26:27.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.166+0000 7f32f67ed640 1 -- 10.20.193.5:0/2367617196 shutdown_connections 2026-02-17T21:26:27.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.166+0000 7f32f67ed640 1 --2- 10.20.193.5:0/2367617196 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f32f00c59c0 0x7f32f015d750 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:27.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.166+0000 7f32f67ed640 1 -- 10.20.193.5:0/2367617196 >> 10.20.193.5:0/2367617196 conn(0x7f32f00c9f20 msgr2=0x7f32f00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:27.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.166+0000 7f32f67ed640 1 -- 10.20.193.5:0/2367617196 shutdown_connections 2026-02-17T21:26:27.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.166+0000 7f32f67ed640 1 -- 10.20.193.5:0/2367617196 wait complete. 2026-02-17T21:26:27.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.166+0000 7f32f67ed640 10 monclient: build_initial_monmap 2026-02-17T21:26:27.177 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.166+0000 7f32f67ed640 10 monclient: monmap: 2026-02-17T21:26:27.177 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:27.177 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:26:27.177 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:26:27.177 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:26:27.177 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:27.177 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:27.177 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:26:27.177 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:26:27.177 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:26:27.177 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:27.177 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.166+0000 7f32f67ed640 1 librados: starting msgr at 2026-02-17T21:26:27.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.166+0000 7f32f67ed640 1 librados: starting objecter 2026-02-17T21:26:27.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.166+0000 7f32f67ed640 1 Processor -- start 2026-02-17T21:26:27.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.166+0000 7f32f67ed640 1 -- start start 2026-02-17T21:26:27.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.166+0000 7f32f67ed640 1 librados: setting wanted keys 2026-02-17T21:26:27.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.166+0000 7f32f67ed640 1 librados: calling monclient init 2026-02-17T21:26:27.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.166+0000 7f32f67ed640 10 monclient: init 2026-02-17T21:26:27.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f67ed640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:27.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f67ed640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:26:27.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f67ed640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f32f00c59c0 0x7f32f0149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:27.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f67ed640 10 monclient(hunting): picked mon.noname-b con 0x7f32f00c59c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:26:27.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f67ed640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f32f00c7e20 0x7f32f00726d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:27.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f67ed640 10 monclient(hunting): picked mon.noname-c con 0x7f32f00c7e20 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:26:27.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f67ed640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f32f015d370 0x7f32f01488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:27.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f67ed640 10 monclient(hunting): picked mon.noname-a con 0x7f32f015d370 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:26:27.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f67ed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:27.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f67ed640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f32f00c8ed0 con 0x7f32f015d370 2026-02-17T21:26:27.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f67ed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:27.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f67ed640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f32f00c9240 con 0x7f32f00c59c0 2026-02-17T21:26:27.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f67ed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:27.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f67ed640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f32f00c96d0 con 0x7f32f00c7e20 2026-02-17T21:26:27.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f67ed640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:27.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f67ed640 10 monclient(hunting): authenticate will time out at 1092.732213s 2026-02-17T21:26:27.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f4d63640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f32f015d370 0x7f32f01488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:27.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32effff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f32f00c59c0 0x7f32f0149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:27.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f4d63640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f32f015d370 0x7f32f01488a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:37446/0 (socket says 10.20.193.5:37446) 2026-02-17T21:26:27.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f4d63640 1 -- 10.20.193.5:0/1421694122 learned_addr learned my addr 10.20.193.5:0/1421694122 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:26:27.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f4d63640 10 monclient(hunting): get_auth_request con 0x7f32f015d370 auth_method 0 2026-02-17T21:26:27.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f4d63640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:27.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f4d63640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:27.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f4d63640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:27.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32ef7fe640 1 --2- 10.20.193.5:0/1421694122 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f32f00c7e20 0x7f32f00726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:27.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f4d63640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:27.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f4d63640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:27.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32f4d63640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:27.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32effff640 10 monclient(hunting): get_auth_request con 0x7f32f00c59c0 auth_method 0 2026-02-17T21:26:27.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:27.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32effff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:27.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.167+0000 7f32effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:27.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.168+0000 7f32ef7fe640 10 monclient(hunting): get_auth_request con 0x7f32f00c7e20 auth_method 0 2026-02-17T21:26:27.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.168+0000 7f32ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:27.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.168+0000 7f32ef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:27.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.168+0000 7f32ef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:27.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.168+0000 7f32effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:27.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.168+0000 7f32effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:27.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.168+0000 7f32effff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:27.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.168+0000 7f32ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:27.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.168+0000 7f32ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:27.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.168+0000 7f32ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:27.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.169+0000 7f32f4d63640 10 monclient(hunting): handle_auth_done global_id 4668 payload 824 2026-02-17T21:26:27.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.169+0000 7f32f4d63640 1 -- 10.20.193.5:0/1421694122 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f32f00c7e20 msgr2=0x7f32f00726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:27.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.169+0000 7f32f4d63640 1 --2- 10.20.193.5:0/1421694122 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f32f00c7e20 0x7f32f00726d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:27.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.169+0000 7f32f4d63640 1 -- 10.20.193.5:0/1421694122 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f32f00c59c0 msgr2=0x7f32f0149bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:27.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.169+0000 7f32f4d63640 1 --2- 10.20.193.5:0/1421694122 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f32f00c59c0 0x7f32f0149bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:27.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.169+0000 7f32f4d63640 10 monclient: _finish_hunting 0 2026-02-17T21:26:27.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.169+0000 7f32f4d63640 1 monclient: found mon.noname-a 2026-02-17T21:26:27.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.169+0000 7f32f4d63640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:27.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.169+0000 7f32f4d63640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:26:27.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.169+0000 7f32f4d63640 1 -- 10.20.193.5:0/1421694122 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f0157c70 con 0x7f32f015d370 2026-02-17T21:26:27.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.170+0000 7f32f4d63640 1 --2- 10.20.193.5:0/1421694122 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f32f015d370 0x7f32f01488a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f32e403a040 tx=0x7f32e4004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:27.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.170+0000 7f32ecff9640 10 client.?.objecter ms_handle_connect 0x7f32f015d370 2026-02-17T21:26:27.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.170+0000 7f32ecff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:26:27.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.171+0000 7f32ecff9640 1 -- 10.20.193.5:0/1421694122 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e403c050 con 0x7f32f015d370 2026-02-17T21:26:27.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.171+0000 7f32ecff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:27.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.171+0000 7f32ecff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:26:27.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.171+0000 7f32ecff9640 10 monclient: dump: 2026-02-17T21:26:27.185 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:27.185 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:27.185 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:27.185 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:27.185 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:27.185 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:27.185 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:27.185 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:27.186 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:27.186 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:27.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.171+0000 7f32ecff9640 10 monclient: _finish_auth 0 2026-02-17T21:26:27.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.171+0000 7f32ecff9640 10 monclient: _check_auth_tickets 2026-02-17T21:26:27.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.171+0000 7f32ecff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:27.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.171+0000 7f32ecff9640 1 -- 10.20.193.5:0/1421694122 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e4048070 con 0x7f32f015d370 2026-02-17T21:26:27.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.171+0000 7f32ecff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:27.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.171+0000 7f32ecff9640 1 -- 10.20.193.5:0/1421694122 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e4041a30 con 0x7f32f015d370 2026-02-17T21:26:27.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.171+0000 7f32f67ed640 5 monclient: authenticate success, global_id 4668 2026-02-17T21:26:27.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.171+0000 7f32ecff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:27.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.171+0000 7f32ecff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:26:27.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.171+0000 7f32ee7fc640 4 set_mon_vals no callback set 2026-02-17T21:26:27.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.171+0000 7f32ecff9640 10 monclient: dump: 2026-02-17T21:26:27.187 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:27.187 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:27.187 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:27.187 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:27.187 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:27.187 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:27.187 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:27.187 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:27.187 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:27.187 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:27.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.171+0000 7f32f67ed640 10 monclient: _renew_subs 2026-02-17T21:26:27.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.171+0000 7f32f67ed640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:27.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.171+0000 7f32f67ed640 1 -- 10.20.193.5:0/1421694122 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f0074930 con 0x7f32f015d370 2026-02-17T21:26:27.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.171+0000 7f32f67ed640 10 client.4668.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:26:27.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.171+0000 7f32f67ed640 10 monclient: _renew_subs 2026-02-17T21:26:27.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.171+0000 7f32f67ed640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:27.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.171+0000 7f32f67ed640 1 -- 10.20.193.5:0/1421694122 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f0157f10 con 0x7f32f015d370 2026-02-17T21:26:27.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.171+0000 7f32f67ed640 1 librados: init done 2026-02-17T21:26:27.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.172+0000 7f32f67ed640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:27.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.172+0000 7f32f67ed640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:27.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.172+0000 7f32f67ed640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:27.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.172+0000 7f32f67ed640 1 -- 10.20.193.5:0/1421694122 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32f015d750 con 0x7f32f015d370 2026-02-17T21:26:27.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.281+0000 7f32ecff9640 1 -- 10.20.193.5:0/1421694122 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f32e4041bd0 con 0x7f32f015d370 2026-02-17T21:26:27.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.281+0000 7f32ecff9640 1 --2- 10.20.193.5:0/1421694122 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f32c00792d0 0x7f32c007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:27.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.281+0000 7f32effff640 1 --2- 10.20.193.5:0/1421694122 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f32c00792d0 0x7f32c007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:27.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.281+0000 7f32effff640 10 monclient: get_auth_request con 0x7f32c00792d0 auth_method 0 2026-02-17T21:26:27.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.282+0000 7f32effff640 1 --2- 10.20.193.5:0/1421694122 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f32c00792d0 0x7f32c007b790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f32dc005980 tx=0x7f32dc007dd0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:27.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.282+0000 7f32ecff9640 10 client.4668.objecter ms_handle_connect 0x7f32c00792d0 2026-02-17T21:26:27.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.290+0000 7f32ecff9640 1 -- 10.20.193.5:0/1421694122 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f32e4084730 con 0x7f32f015d370 2026-02-17T21:26:27.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.290+0000 7f32ecff9640 10 client.4668.objecter ms_dispatch2 0x7f32f0000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:26:27.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.290+0000 7f32ecff9640 3 client.4668.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:26:27.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.290+0000 7f32ecff9640 3 client.4668.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:26:27.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.290+0000 7f32ecff9640 20 client.4668.objecter dump_active .. 0 homeless 2026-02-17T21:26:27.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.290+0000 7f32ecff9640 1 -- 10.20.193.5:0/1421694122 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f32e40886f0 con 0x7f32f015d370 2026-02-17T21:26:27.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.290+0000 7f32ecff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:27.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.290+0000 7f32ecff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:26:27.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.390+0000 7f32f67ed640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:26:27.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.390+0000 7f32f67ed640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:27.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.390+0000 7f32f67ed640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:27.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.390+0000 7f32f67ed640 1 -- 10.20.193.5:0/1421694122 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f32f015b310 con 0x7f32f015d370 2026-02-17T21:26:27.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.397+0000 7f32ecff9640 1 -- 10.20.193.5:0/1421694122 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f32e408c9f0 con 0x7f32f015d370 2026-02-17T21:26:27.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.397+0000 7f32ecff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:27.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.397+0000 7f32ecff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:26:27.399 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:26:27.399 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:26:27.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.398+0000 7f32f67ed640 10 librados: watch_flush enter 2026-02-17T21:26:27.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.398+0000 7f32f67ed640 10 librados: watch_flush exit 2026-02-17T21:26:27.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.398+0000 7f32f67ed640 20 client.4668.objecter shutdown clearing up homeless session... 2026-02-17T21:26:27.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.398+0000 7f32f67ed640 10 client.4668.objecter successfully canceled tick 2026-02-17T21:26:27.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.398+0000 7f32f67ed640 1 -- 10.20.193.5:0/1421694122 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f32c00792d0 msgr2=0x7f32c007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:27.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.398+0000 7f32f67ed640 1 --2- 10.20.193.5:0/1421694122 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f32c00792d0 0x7f32c007b790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f32dc005980 tx=0x7f32dc007dd0 comp rx=0 tx=0).stop 2026-02-17T21:26:27.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.398+0000 7f32f67ed640 10 monclient: shutdown 2026-02-17T21:26:27.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.398+0000 7f32f67ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:27.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.398+0000 7f32f67ed640 1 -- 10.20.193.5:0/1421694122 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f32f015d370 msgr2=0x7f32f01488a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:27.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.398+0000 7f32f67ed640 1 --2- 10.20.193.5:0/1421694122 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f32f015d370 0x7f32f01488a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f32e403a040 tx=0x7f32e4004b40 comp rx=0 tx=0).stop 2026-02-17T21:26:27.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.398+0000 7f32f67ed640 1 -- 10.20.193.5:0/1421694122 shutdown_connections 2026-02-17T21:26:27.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.398+0000 7f32f67ed640 1 --2- 10.20.193.5:0/1421694122 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f32c00792d0 0x7f32c007b790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:27.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.398+0000 7f32f67ed640 1 --2- 10.20.193.5:0/1421694122 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f32f015d370 0x7f32f01488a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:27.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.398+0000 7f32f67ed640 1 --2- 10.20.193.5:0/1421694122 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f32f00c7e20 0x7f32f00726d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:27.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.398+0000 7f32f67ed640 1 --2- 10.20.193.5:0/1421694122 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f32f00c59c0 0x7f32f0149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:27.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.398+0000 7f32f67ed640 1 -- 10.20.193.5:0/1421694122 >> 10.20.193.5:0/1421694122 conn(0x7f32f00c9f20 msgr2=0x7f32f0152960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:27.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.398+0000 7f32f67ed640 1 -- 10.20.193.5:0/1421694122 shutdown_connections 2026-02-17T21:26:27.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.398+0000 7f32f67ed640 1 -- 10.20.193.5:0/1421694122 wait complete. 2026-02-17T21:26:27.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:27.399+0000 7f32f67ed640 1 librados: shutdown 2026-02-17T21:26:30.410 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:26:30.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.479+0000 7fcc85e32640 10 monclient: get_monmap_and_config 2026-02-17T21:26:30.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.479+0000 7fcc85e32640 10 monclient: build_initial_monmap 2026-02-17T21:26:30.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.479+0000 7fcc85e32640 10 monclient: monmap: 2026-02-17T21:26:30.481 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:30.481 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:30.481 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:26:30.479901+0000 2026-02-17T21:26:30.481 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:26:30.479901+0000 2026-02-17T21:26:30.481 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:30.481 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:30.481 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:26:30.481 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:26:30.481 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:26:30.481 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:26:30.482 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:26:30.482 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:26:30.482 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:30.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.479+0000 7fcc85e32640 1 Processor -- start 2026-02-17T21:26:30.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.479+0000 7fcc85e32640 1 -- start start 2026-02-17T21:26:30.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.479+0000 7fcc85e32640 10 monclient: init 2026-02-17T21:26:30.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.480+0000 7fcc85e32640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:30.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.480+0000 7fcc85e32640 10 monclient: _add_conns ranks=[2,1,3,5,0,4] 2026-02-17T21:26:30.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.480+0000 7fcc85e32640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fcc8015d370 addr v1:10.20.193.135:6789/0 2026-02-17T21:26:30.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.480+0000 7fcc85e32640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fcc800c7e20 addr v1:10.20.193.119:6789/0 2026-02-17T21:26:30.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.480+0000 7fcc85e32640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fcc800c59c0 0x7fcc8015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:30.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.480+0000 7fcc85e32640 10 monclient(hunting): picked mon.noname-a con 0x7fcc800c59c0 addr v2:10.20.193.5:3300/0 2026-02-17T21:26:30.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.480+0000 7fcc85e32640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc800c8350 con 0x7fcc800c7e20 2026-02-17T21:26:30.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.480+0000 7fcc85e32640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc800c8630 con 0x7fcc8015d370 2026-02-17T21:26:30.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.480+0000 7fcc85e32640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:30.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.480+0000 7fcc85e32640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fcc8015b710 con 0x7fcc800c59c0 2026-02-17T21:26:30.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.480+0000 7fcc85e32640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:30.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.480+0000 7fcc85e32640 10 monclient(hunting): authenticate will time out at 1096.045357s 2026-02-17T21:26:30.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.480+0000 7fcc7ffff640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fcc800c59c0 0x7fcc8015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:30.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.480+0000 7fcc7f7fe640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7fcc8015d370 0x7fcc8015b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:58348/0 (socket says 10.20.193.5:58348) 2026-02-17T21:26:30.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.480+0000 7fcc7f7fe640 1 -- 10.20.193.5:0/3230927238 learned_addr learned my addr 10.20.193.5:0/3230927238 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:26:30.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.481+0000 7fcc7ffff640 10 monclient(hunting): get_auth_request con 0x7fcc800c59c0 auth_method 0 2026-02-17T21:26:30.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.481+0000 7fcc7ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:30.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.481+0000 7fcc7ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:30.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.481+0000 7fcc7ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:30.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.481+0000 7fcc7ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:30.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.481+0000 7fcc7ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:30.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.481+0000 7fcc7ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:30.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.482+0000 7fcc7e7fc640 1 -- 10.20.193.5:0/3230927238 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 7037343 0 0) 0x7fcc800c8630 con 0x7fcc8015d370 2026-02-17T21:26:30.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.482+0000 7fcc7e7fc640 10 monclient(hunting): _negotiate 2026-02-17T21:26:30.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.482+0000 7fcc7e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:30.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.482+0000 7fcc7e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:30.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.482+0000 7fcc7e7fc640 10 monclient(hunting): my global_id is 4718 2026-02-17T21:26:30.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.482+0000 7fcc7e7fc640 1 -- 10.20.193.5:0/3230927238 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc64003620 con 0x7fcc8015d370 2026-02-17T21:26:30.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.482+0000 7fcc7ffff640 10 monclient(hunting): handle_auth_done global_id 4671 payload 274 2026-02-17T21:26:30.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.482+0000 7fcc7ffff640 1 -- 10.20.193.5:0/3230927238 >> v1:10.20.193.135:6789/0 conn(0x7fcc8015d370 legacy=0x7fcc8015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:30.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.482+0000 7fcc7ffff640 1 -- 10.20.193.5:0/3230927238 >> v1:10.20.193.119:6789/0 conn(0x7fcc800c7e20 legacy=0x7fcc800c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:30.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.482+0000 7fcc7ffff640 10 monclient: _finish_hunting 0 2026-02-17T21:26:30.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.482+0000 7fcc7ffff640 1 monclient: found mon.noname-a 2026-02-17T21:26:30.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.482+0000 7fcc7ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:30.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.482+0000 7fcc7ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:26:30.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.482+0000 7fcc7ffff640 1 -- 10.20.193.5:0/3230927238 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc800c8910 con 0x7fcc800c59c0 2026-02-17T21:26:30.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.483+0000 7fcc7ffff640 1 --2- 10.20.193.5:0/3230927238 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fcc800c59c0 0x7fcc8015d750 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcc74009d90 tx=0x7fcc7402f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1f66915292d84e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:30.495 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc7e7fc640 1 -- 10.20.193.5:0/3230927238 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7403c070 con 0x7fcc800c59c0 2026-02-17T21:26:30.495 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc7e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:30.495 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc7e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:26:30.495 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc7e7fc640 10 monclient: dump: 2026-02-17T21:26:30.495 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:30.495 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:30.496 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:30.496 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:30.496 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:30.496 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:30.496 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:30.496 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:30.496 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:30.496 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:30.496 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc7e7fc640 10 monclient: _finish_auth 0 2026-02-17T21:26:30.496 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc7e7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:26:30.496 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc7e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:30.496 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc7e7fc640 1 -- 10.20.193.5:0/3230927238 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc74037440 con 0x7fcc800c59c0 2026-02-17T21:26:30.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc85e32640 5 monclient: authenticate success, global_id 4671 2026-02-17T21:26:30.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc85e32640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:26:30.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc7e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:30.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc7e7fc640 1 -- 10.20.193.5:0/3230927238 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc74037810 con 0x7fcc800c59c0 2026-02-17T21:26:30.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc85e32640 10 monclient: get_monmap_and_config success 2026-02-17T21:26:30.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc85e32640 4 set_mon_vals no callback set 2026-02-17T21:26:30.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc7e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:30.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc7e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:26:30.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc7e7fc640 10 monclient: dump: 2026-02-17T21:26:30.497 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:30.497 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:30.497 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:30.498 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:30.498 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:30.498 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:30.498 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:30.498 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:30.498 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:30.498 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:30.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc85e32640 10 monclient: shutdown 2026-02-17T21:26:30.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc85e32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:30.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc85e32640 1 -- 10.20.193.5:0/3230927238 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fcc800c59c0 msgr2=0x7fcc8015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:30.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc85e32640 1 --2- 10.20.193.5:0/3230927238 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fcc800c59c0 0x7fcc8015d750 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcc74009d90 tx=0x7fcc7402f230 comp rx=0 tx=0).stop 2026-02-17T21:26:30.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc85e32640 1 -- 10.20.193.5:0/3230927238 shutdown_connections 2026-02-17T21:26:30.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc85e32640 1 --2- 10.20.193.5:0/3230927238 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fcc800c59c0 0x7fcc8015d750 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:30.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc85e32640 1 -- 10.20.193.5:0/3230927238 >> 10.20.193.5:0/3230927238 conn(0x7fcc800c9f20 msgr2=0x7fcc800ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:30.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc85e32640 1 -- 10.20.193.5:0/3230927238 shutdown_connections 2026-02-17T21:26:30.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.485+0000 7fcc85e32640 1 -- 10.20.193.5:0/3230927238 wait complete. 2026-02-17T21:26:30.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.486+0000 7fcc85e32640 10 monclient: build_initial_monmap 2026-02-17T21:26:30.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.486+0000 7fcc85e32640 10 monclient: monmap: 2026-02-17T21:26:30.499 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:30.499 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:26:30.499 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:26:30.499 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:26:30.499 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:30.499 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:30.500 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:26:30.500 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:26:30.500 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:26:30.500 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:30.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.486+0000 7fcc85e32640 1 librados: starting msgr at 2026-02-17T21:26:30.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.486+0000 7fcc85e32640 1 librados: starting objecter 2026-02-17T21:26:30.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.486+0000 7fcc85e32640 1 Processor -- start 2026-02-17T21:26:30.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.486+0000 7fcc85e32640 1 -- start start 2026-02-17T21:26:30.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.486+0000 7fcc85e32640 1 librados: setting wanted keys 2026-02-17T21:26:30.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.486+0000 7fcc85e32640 1 librados: calling monclient init 2026-02-17T21:26:30.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.486+0000 7fcc85e32640 10 monclient: init 2026-02-17T21:26:30.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.486+0000 7fcc85e32640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:30.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.486+0000 7fcc85e32640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:26:30.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.486+0000 7fcc85e32640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fcc800c59c0 0x7fcc80074140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:30.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.486+0000 7fcc85e32640 10 monclient(hunting): picked mon.noname-b con 0x7fcc800c59c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:26:30.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.486+0000 7fcc85e32640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fcc800c7e20 0x7fcc801f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:30.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.486+0000 7fcc85e32640 10 monclient(hunting): picked mon.noname-c con 0x7fcc800c7e20 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:26:30.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.486+0000 7fcc85e32640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fcc8015d370 0x7fcc800726d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:30.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.486+0000 7fcc85e32640 10 monclient(hunting): picked mon.noname-a con 0x7fcc8015d370 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:26:30.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.486+0000 7fcc85e32640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:30.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.486+0000 7fcc85e32640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcc800c8ed0 con 0x7fcc8015d370 2026-02-17T21:26:30.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.486+0000 7fcc85e32640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:30.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.486+0000 7fcc85e32640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcc800c9240 con 0x7fcc800c59c0 2026-02-17T21:26:30.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.486+0000 7fcc85e32640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:30.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.486+0000 7fcc85e32640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcc800c96d0 con 0x7fcc800c7e20 2026-02-17T21:26:30.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.486+0000 7fcc85e32640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:30.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.486+0000 7fcc85e32640 10 monclient(hunting): authenticate will time out at 1096.051736s 2026-02-17T21:26:30.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.487+0000 7fcc7ffff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fcc8015d370 0x7fcc800726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:30.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.487+0000 7fcc7effd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fcc800c7e20 0x7fcc801f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:30.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.487+0000 7fcc7effd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fcc800c7e20 0x7fcc801f46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:45412/0 (socket says 10.20.193.5:45412) 2026-02-17T21:26:30.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.487+0000 7fcc7effd640 1 -- 10.20.193.5:0/2728782682 learned_addr learned my addr 10.20.193.5:0/2728782682 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:26:30.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.487+0000 7fcc7ffff640 10 monclient(hunting): get_auth_request con 0x7fcc8015d370 auth_method 0 2026-02-17T21:26:30.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.487+0000 7fcc7ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:30.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.487+0000 7fcc7ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:30.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.487+0000 7fcc7ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:30.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.487+0000 7fcc7effd640 10 monclient(hunting): get_auth_request con 0x7fcc800c7e20 auth_method 0 2026-02-17T21:26:30.503 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.487+0000 7fcc7effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:30.503 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.487+0000 7fcc7effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:30.503 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.487+0000 7fcc7effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:30.503 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.487+0000 7fcc7effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:30.503 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.487+0000 7fcc7effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:30.503 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.487+0000 7fcc7effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:30.503 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.487+0000 7fcc7ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:30.503 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.487+0000 7fcc7ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:30.503 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.487+0000 7fcc7ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:30.503 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.487+0000 7fcc7f7fe640 1 --2- 10.20.193.5:0/2728782682 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fcc800c59c0 0x7fcc80074140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:30.503 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.488+0000 7fcc7f7fe640 10 monclient(hunting): get_auth_request con 0x7fcc800c59c0 auth_method 0 2026-02-17T21:26:30.503 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.488+0000 7fcc7f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:30.503 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.488+0000 7fcc7f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:30.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.488+0000 7fcc7f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:30.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.488+0000 7fcc7f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:30.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.488+0000 7fcc7f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:30.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.488+0000 7fcc7f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:30.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.488+0000 7fcc7effd640 10 monclient(hunting): handle_auth_done global_id 4721 payload 824 2026-02-17T21:26:30.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.488+0000 7fcc7effd640 1 -- 10.20.193.5:0/2728782682 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fcc800c59c0 msgr2=0x7fcc80074140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:30.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.488+0000 7fcc7effd640 1 --2- 10.20.193.5:0/2728782682 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fcc800c59c0 0x7fcc80074140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:30.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.488+0000 7fcc7effd640 1 -- 10.20.193.5:0/2728782682 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fcc8015d370 msgr2=0x7fcc800726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:30.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.488+0000 7fcc7effd640 1 --2- 10.20.193.5:0/2728782682 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fcc8015d370 0x7fcc800726d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:30.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.488+0000 7fcc7effd640 10 monclient: _finish_hunting 0 2026-02-17T21:26:30.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.488+0000 7fcc7effd640 1 monclient: found mon.noname-c 2026-02-17T21:26:30.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.488+0000 7fcc7effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:30.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.488+0000 7fcc7effd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:26:30.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.488+0000 7fcc7effd640 1 -- 10.20.193.5:0/2728782682 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc80072dc0 con 0x7fcc800c7e20 2026-02-17T21:26:30.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.489+0000 7fcc7effd640 1 --2- 10.20.193.5:0/2728782682 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fcc800c7e20 0x7fcc801f46f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcc7000c730 tx=0x7fcc7000cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:30.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.489+0000 7fcc5bfff640 10 client.?.objecter ms_handle_connect 0x7fcc800c7e20 2026-02-17T21:26:30.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.490+0000 7fcc5bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:26:30.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.491+0000 7fcc5bfff640 1 -- 10.20.193.5:0/2728782682 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc700052d0 con 0x7fcc800c7e20 2026-02-17T21:26:30.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.491+0000 7fcc5bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:30.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.491+0000 7fcc5bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:26:30.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.491+0000 7fcc5bfff640 10 monclient: dump: 2026-02-17T21:26:30.505 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:30.505 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:30.505 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:30.505 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:30.506 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:30.506 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:30.506 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:30.506 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:30.506 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:30.506 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:30.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.491+0000 7fcc5bfff640 10 monclient: _finish_auth 0 2026-02-17T21:26:30.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.491+0000 7fcc5bfff640 10 monclient: _check_auth_tickets 2026-02-17T21:26:30.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.491+0000 7fcc5bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:30.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.491+0000 7fcc85e32640 5 monclient: authenticate success, global_id 4721 2026-02-17T21:26:30.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.491+0000 7fcc5bfff640 1 -- 10.20.193.5:0/2728782682 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc70005470 con 0x7fcc800c7e20 2026-02-17T21:26:30.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.491+0000 7fcc5bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:30.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.491+0000 7fcc5bfff640 1 -- 10.20.193.5:0/2728782682 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc700038d0 con 0x7fcc800c7e20 2026-02-17T21:26:30.507 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.491+0000 7fcc5bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:30.507 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.491+0000 7fcc5bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:26:30.507 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.491+0000 7fcc7dffb640 4 set_mon_vals no callback set 2026-02-17T21:26:30.507 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.491+0000 7fcc5bfff640 10 monclient: dump: 2026-02-17T21:26:30.507 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:30.507 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:30.507 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:30.507 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:30.507 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:30.507 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:30.507 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:30.507 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:30.507 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:30.508 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:30.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.491+0000 7fcc85e32640 10 monclient: _renew_subs 2026-02-17T21:26:30.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.491+0000 7fcc85e32640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:26:30.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.491+0000 7fcc85e32640 1 -- 10.20.193.5:0/2728782682 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc800730a0 con 0x7fcc800c7e20 2026-02-17T21:26:30.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.491+0000 7fcc85e32640 10 client.4721.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:26:30.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.491+0000 7fcc85e32640 10 monclient: _renew_subs 2026-02-17T21:26:30.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.491+0000 7fcc85e32640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:26:30.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.491+0000 7fcc85e32640 1 -- 10.20.193.5:0/2728782682 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc80073660 con 0x7fcc800c7e20 2026-02-17T21:26:30.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.491+0000 7fcc85e32640 1 librados: init done 2026-02-17T21:26:30.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.492+0000 7fcc85e32640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:30.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.492+0000 7fcc85e32640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:30.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.492+0000 7fcc85e32640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:26:30.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.492+0000 7fcc85e32640 1 -- 10.20.193.5:0/2728782682 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc8015d750 con 0x7fcc800c7e20 2026-02-17T21:26:30.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.598+0000 7fcc5bfff640 1 -- 10.20.193.5:0/2728782682 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fcc70003a70 con 0x7fcc800c7e20 2026-02-17T21:26:30.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.598+0000 7fcc5bfff640 1 --2- 10.20.193.5:0/2728782682 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fcc50079300 0x7fcc5007b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:30.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.598+0000 7fcc7f7fe640 1 --2- 10.20.193.5:0/2728782682 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fcc50079300 0x7fcc5007b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:30.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.598+0000 7fcc7f7fe640 10 monclient: get_auth_request con 0x7fcc50079300 auth_method 0 2026-02-17T21:26:30.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.599+0000 7fcc5bfff640 10 client.4721.objecter ms_handle_connect 0x7fcc50079300 2026-02-17T21:26:30.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.599+0000 7fcc7f7fe640 1 --2- 10.20.193.5:0/2728782682 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fcc50079300 0x7fcc5007b7c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c007b60 tx=0x7fcc6c007ab0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:30.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.600+0000 7fcc5bfff640 1 -- 10.20.193.5:0/2728782682 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fcc7005e430 con 0x7fcc800c7e20 2026-02-17T21:26:30.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.600+0000 7fcc5bfff640 10 client.4721.objecter ms_dispatch2 0x7fcc80000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:26:30.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.600+0000 7fcc5bfff640 3 client.4721.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:26:30.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.600+0000 7fcc5bfff640 3 client.4721.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:26:30.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.600+0000 7fcc5bfff640 20 client.4721.objecter dump_active .. 0 homeless 2026-02-17T21:26:30.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.607+0000 7fcc5bfff640 1 -- 10.20.193.5:0/2728782682 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcc700623f0 con 0x7fcc800c7e20 2026-02-17T21:26:30.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.607+0000 7fcc5bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:30.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.607+0000 7fcc5bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:26:30.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.708+0000 7fcc85e32640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:26:30.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.708+0000 7fcc85e32640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:30.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.708+0000 7fcc85e32640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:26:30.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.708+0000 7fcc85e32640 1 -- 10.20.193.5:0/2728782682 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcc8015b280 con 0x7fcc800c7e20 2026-02-17T21:26:30.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.712+0000 7fcc5bfff640 1 -- 10.20.193.5:0/2728782682 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fcc700666f0 con 0x7fcc800c7e20 2026-02-17T21:26:30.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.712+0000 7fcc5bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:30.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.712+0000 7fcc5bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:26:30.713 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:26:30.714 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:26:30.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.713+0000 7fcc85e32640 10 librados: watch_flush enter 2026-02-17T21:26:30.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.713+0000 7fcc85e32640 10 librados: watch_flush exit 2026-02-17T21:26:30.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.713+0000 7fcc85e32640 20 client.4721.objecter shutdown clearing up homeless session... 2026-02-17T21:26:30.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.713+0000 7fcc85e32640 10 client.4721.objecter successfully canceled tick 2026-02-17T21:26:30.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.713+0000 7fcc85e32640 1 -- 10.20.193.5:0/2728782682 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fcc50079300 msgr2=0x7fcc5007b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:30.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.713+0000 7fcc85e32640 1 --2- 10.20.193.5:0/2728782682 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fcc50079300 0x7fcc5007b7c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c007b60 tx=0x7fcc6c007ab0 comp rx=0 tx=0).stop 2026-02-17T21:26:30.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.713+0000 7fcc85e32640 10 monclient: shutdown 2026-02-17T21:26:30.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.713+0000 7fcc85e32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:30.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.713+0000 7fcc85e32640 1 -- 10.20.193.5:0/2728782682 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fcc800c7e20 msgr2=0x7fcc801f46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:30.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.713+0000 7fcc85e32640 1 --2- 10.20.193.5:0/2728782682 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fcc800c7e20 0x7fcc801f46f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcc7000c730 tx=0x7fcc7000cc00 comp rx=0 tx=0).stop 2026-02-17T21:26:30.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.713+0000 7fcc85e32640 1 -- 10.20.193.5:0/2728782682 shutdown_connections 2026-02-17T21:26:30.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.713+0000 7fcc85e32640 1 --2- 10.20.193.5:0/2728782682 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fcc50079300 0x7fcc5007b7c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:30.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.713+0000 7fcc85e32640 1 --2- 10.20.193.5:0/2728782682 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fcc8015d370 0x7fcc800726d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:30.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.713+0000 7fcc85e32640 1 --2- 10.20.193.5:0/2728782682 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fcc800c7e20 0x7fcc801f46f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:30.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.713+0000 7fcc85e32640 1 --2- 10.20.193.5:0/2728782682 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fcc800c59c0 0x7fcc80074140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:30.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.713+0000 7fcc85e32640 1 -- 10.20.193.5:0/2728782682 >> 10.20.193.5:0/2728782682 conn(0x7fcc800c9f20 msgr2=0x7fcc8015c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:30.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.713+0000 7fcc85e32640 1 -- 10.20.193.5:0/2728782682 shutdown_connections 2026-02-17T21:26:30.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.713+0000 7fcc85e32640 1 -- 10.20.193.5:0/2728782682 wait complete. 2026-02-17T21:26:30.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:30.713+0000 7fcc85e32640 1 librados: shutdown 2026-02-17T21:26:33.724 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:26:33.793 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.791+0000 7f4977bbc640 10 monclient: get_monmap_and_config 2026-02-17T21:26:33.793 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.791+0000 7f4977bbc640 10 monclient: build_initial_monmap 2026-02-17T21:26:33.793 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.791+0000 7f4977bbc640 10 monclient: monmap: 2026-02-17T21:26:33.794 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:33.794 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:33.794 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:26:33.792619+0000 2026-02-17T21:26:33.794 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:26:33.792619+0000 2026-02-17T21:26:33.794 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:33.794 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:33.794 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:26:33.794 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:26:33.794 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:26:33.794 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:26:33.794 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:26:33.795 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:26:33.795 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:33.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.792+0000 7f4977bbc640 1 Processor -- start 2026-02-17T21:26:33.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.792+0000 7f4977bbc640 1 -- start start 2026-02-17T21:26:33.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.792+0000 7f4977bbc640 10 monclient: init 2026-02-17T21:26:33.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.792+0000 7f4977bbc640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:33.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.793+0000 7f4977bbc640 10 monclient: _add_conns ranks=[3,0,5,1,4,2] 2026-02-17T21:26:33.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.793+0000 7f4977bbc640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f497015f690 0x7f497015fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:33.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.793+0000 7f4977bbc640 10 monclient(hunting): picked mon.noname-a con 0x7f497015f690 addr v2:10.20.193.5:3300/0 2026-02-17T21:26:33.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.793+0000 7f4977bbc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f49700c9050 addr v1:10.20.193.5:6789/0 2026-02-17T21:26:33.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.793+0000 7f4977bbc640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f4970072de0 0x7f497015d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:33.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.793+0000 7f4977bbc640 10 monclient(hunting): picked mon.noname-c con 0x7f4970072de0 addr v2:10.20.193.135:3300/0 2026-02-17T21:26:33.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.793+0000 7f4977bbc640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49700732e0 con 0x7f49700c9050 2026-02-17T21:26:33.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.793+0000 7f4977bbc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:33.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.793+0000 7f4977bbc640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f49700735c0 con 0x7f497015f690 2026-02-17T21:26:33.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.793+0000 7f4977bbc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:33.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.793+0000 7f4977bbc640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f49700738a0 con 0x7f4970072de0 2026-02-17T21:26:33.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.793+0000 7f4977bbc640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:33.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.793+0000 7f4977bbc640 10 monclient(hunting): authenticate will time out at 1099.358061s 2026-02-17T21:26:33.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.793+0000 7f4975931640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f497015f690 0x7f497015fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:33.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.793+0000 7f4975130640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f49700c9050 0x7f49700726d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:60908/0 (socket says 10.20.193.5:60908) 2026-02-17T21:26:33.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.793+0000 7f4975130640 1 -- 10.20.193.5:0/22296212 learned_addr learned my addr 10.20.193.5:0/22296212 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:26:33.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.793+0000 7f4975931640 10 monclient(hunting): get_auth_request con 0x7f497015f690 auth_method 0 2026-02-17T21:26:33.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.793+0000 7f4975931640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:33.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.793+0000 7f4975931640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:33.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.793+0000 7f4975931640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:33.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.794+0000 7f4975931640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:33.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.794+0000 7f4975931640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:33.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.794+0000 7f4975931640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:33.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.796+0000 7f4975931640 10 monclient(hunting): handle_auth_done global_id 4677 payload 274 2026-02-17T21:26:33.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.796+0000 7f4975931640 1 -- 10.20.193.5:0/22296212 >> v2:10.20.193.135:3300/0 conn(0x7f4970072de0 msgr2=0x7f497015d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:26:33.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.796+0000 7f4975931640 1 --2- 10.20.193.5:0/22296212 >> v2:10.20.193.135:3300/0 conn(0x7f4970072de0 0x7f497015d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:33.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.796+0000 7f4975931640 1 -- 10.20.193.5:0/22296212 >> v1:10.20.193.5:6789/0 conn(0x7f49700c9050 legacy=0x7f49700726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:33.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.796+0000 7f4975931640 10 monclient: _finish_hunting 0 2026-02-17T21:26:33.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.796+0000 7f4975931640 1 monclient: found mon.noname-a 2026-02-17T21:26:33.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.796+0000 7f4975931640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:33.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.796+0000 7f4975931640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:26:33.801 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.796+0000 7f4975931640 1 -- 10.20.193.5:0/22296212 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4970073b80 con 0x7f497015f690 2026-02-17T21:26:33.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.797+0000 7f4975931640 1 --2- 10.20.193.5:0/22296212 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f497015f690 0x7f497015fa70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f497015ffb0 tx=0x7f496002ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4790096964750500 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:33.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f497492f640 1 -- 10.20.193.5:0/22296212 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496003c070 con 0x7f497015f690 2026-02-17T21:26:33.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f497492f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:33.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f497492f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:26:33.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f497492f640 10 monclient: dump: 2026-02-17T21:26:33.804 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:33.805 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:33.805 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:33.805 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:33.805 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:33.805 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:33.805 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:33.805 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:33.805 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:33.805 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:33.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f497492f640 10 monclient: _finish_auth 0 2026-02-17T21:26:33.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f497492f640 10 monclient: _check_auth_tickets 2026-02-17T21:26:33.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f497492f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:33.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f4977bbc640 5 monclient: authenticate success, global_id 4677 2026-02-17T21:26:33.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f497492f640 1 -- 10.20.193.5:0/22296212 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f496002fa60 con 0x7f497015f690 2026-02-17T21:26:33.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f4977bbc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:26:33.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f497492f640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:33.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f497492f640 1 -- 10.20.193.5:0/22296212 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496002fe30 con 0x7f497015f690 2026-02-17T21:26:33.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f4977bbc640 10 monclient: get_monmap_and_config success 2026-02-17T21:26:33.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f4977bbc640 4 set_mon_vals no callback set 2026-02-17T21:26:33.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f497492f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:33.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f497492f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:26:33.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f497492f640 10 monclient: dump: 2026-02-17T21:26:33.806 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:33.806 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:33.807 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:33.807 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:33.807 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:33.807 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:33.807 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:33.807 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:33.807 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:33.807 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:33.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f4977bbc640 10 monclient: shutdown 2026-02-17T21:26:33.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f4977bbc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:33.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f4977bbc640 1 -- 10.20.193.5:0/22296212 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f497015f690 msgr2=0x7f497015fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:33.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f4977bbc640 1 --2- 10.20.193.5:0/22296212 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f497015f690 0x7f497015fa70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f497015ffb0 tx=0x7f496002ed50 comp rx=0 tx=0).stop 2026-02-17T21:26:33.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f4977bbc640 1 -- 10.20.193.5:0/22296212 shutdown_connections 2026-02-17T21:26:33.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f4977bbc640 1 --2- 10.20.193.5:0/22296212 >> v2:10.20.193.135:3300/0 conn(0x7f4970072de0 0x7f497015d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:33.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f4977bbc640 1 --2- 10.20.193.5:0/22296212 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f497015f690 0x7f497015fa70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:33.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f4977bbc640 1 -- 10.20.193.5:0/22296212 >> 10.20.193.5:0/22296212 conn(0x7f49700c9f20 msgr2=0x7f49700ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:33.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f4977bbc640 1 -- 10.20.193.5:0/22296212 shutdown_connections 2026-02-17T21:26:33.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.799+0000 7f4977bbc640 1 -- 10.20.193.5:0/22296212 wait complete. 2026-02-17T21:26:33.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.800+0000 7f4977bbc640 10 monclient: build_initial_monmap 2026-02-17T21:26:33.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.800+0000 7f4977bbc640 10 monclient: monmap: 2026-02-17T21:26:33.808 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:33.808 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:26:33.809 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:26:33.809 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:26:33.809 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:33.809 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:33.809 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:26:33.809 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:26:33.809 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:26:33.809 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:33.809 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.800+0000 7f4977bbc640 1 librados: starting msgr at 2026-02-17T21:26:33.809 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.800+0000 7f4977bbc640 1 librados: starting objecter 2026-02-17T21:26:33.809 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.800+0000 7f4977bbc640 1 Processor -- start 2026-02-17T21:26:33.809 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.800+0000 7f4977bbc640 1 -- start start 2026-02-17T21:26:33.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.800+0000 7f4977bbc640 1 librados: setting wanted keys 2026-02-17T21:26:33.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.800+0000 7f4977bbc640 1 librados: calling monclient init 2026-02-17T21:26:33.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.800+0000 7f4977bbc640 10 monclient: init 2026-02-17T21:26:33.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.800+0000 7f4977bbc640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:33.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.800+0000 7f4977bbc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:26:33.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.800+0000 7f4977bbc640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f4970072de0 0x7f4970156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:33.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.800+0000 7f4977bbc640 10 monclient(hunting): picked mon.noname-a con 0x7f4970072de0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:26:33.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.800+0000 7f4977bbc640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f49700c9050 0x7f497015e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:33.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.800+0000 7f4977bbc640 10 monclient(hunting): picked mon.noname-b con 0x7f49700c9050 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:26:33.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.800+0000 7f4977bbc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f497015f690 0x7f4970158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:33.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.800+0000 7f4977bbc640 10 monclient(hunting): picked mon.noname-c con 0x7f497015f690 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:26:33.810 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.800+0000 7f4977bbc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:33.811 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.800+0000 7f4977bbc640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f49700c9640 con 0x7f4970072de0 2026-02-17T21:26:33.811 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.800+0000 7f4977bbc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:33.811 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.800+0000 7f4977bbc640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f49700c94c0 con 0x7f49700c9050 2026-02-17T21:26:33.811 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.800+0000 7f4977bbc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:33.811 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.800+0000 7f4977bbc640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f49700c97c0 con 0x7f497015f690 2026-02-17T21:26:33.811 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.800+0000 7f4977bbc640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:33.811 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.800+0000 7f4977bbc640 10 monclient(hunting): authenticate will time out at 1099.365910s 2026-02-17T21:26:33.811 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.801+0000 7f4975931640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f4970072de0 0x7f4970156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:33.811 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.801+0000 7f4975931640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f4970072de0 0x7f4970156bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:54206/0 (socket says 10.20.193.5:54206) 2026-02-17T21:26:33.811 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.801+0000 7f4975931640 1 -- 10.20.193.5:0/3546657011 learned_addr learned my addr 10.20.193.5:0/3546657011 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:26:33.811 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.801+0000 7f4975931640 10 monclient(hunting): get_auth_request con 0x7f4970072de0 auth_method 0 2026-02-17T21:26:33.811 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.801+0000 7f4975931640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:33.812 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.801+0000 7f4975931640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:33.812 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.801+0000 7f4975931640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:33.812 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.801+0000 7f4975931640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:33.812 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.801+0000 7f4975931640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:33.812 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.801+0000 7f4975931640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:33.814 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.803+0000 7f4975931640 10 monclient(hunting): handle_auth_done global_id 4683 payload 824 2026-02-17T21:26:33.814 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.803+0000 7f4975931640 1 -- 10.20.193.5:0/3546657011 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f497015f690 msgr2=0x7f4970158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:33.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.803+0000 7f4975931640 1 --2- 10.20.193.5:0/3546657011 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f497015f690 0x7f4970158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:33.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.803+0000 7f4975931640 1 -- 10.20.193.5:0/3546657011 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f49700c9050 msgr2=0x7f497015e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:33.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.803+0000 7f4975931640 1 --2- 10.20.193.5:0/3546657011 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f49700c9050 0x7f497015e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:33.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.803+0000 7f4975931640 10 monclient: _finish_hunting 0 2026-02-17T21:26:33.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.803+0000 7f4975931640 1 monclient: found mon.noname-a 2026-02-17T21:26:33.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.803+0000 7f4975931640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:33.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.803+0000 7f4975931640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:26:33.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.803+0000 7f4975931640 1 -- 10.20.193.5:0/3546657011 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49701585f0 con 0x7f4970072de0 2026-02-17T21:26:33.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.804+0000 7f4975931640 1 --2- 10.20.193.5:0/3546657011 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f4970072de0 0x7f4970156bd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f496002f280 tx=0x7f49600047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:33.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.804+0000 7f495e7fc640 10 client.?.objecter ms_handle_connect 0x7f4970072de0 2026-02-17T21:26:33.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.804+0000 7f495e7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:26:33.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.806+0000 7f495e7fc640 1 -- 10.20.193.5:0/3546657011 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4960046020 con 0x7f4970072de0 2026-02-17T21:26:33.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.806+0000 7f495e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:33.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.806+0000 7f495e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:26:33.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.806+0000 7f495e7fc640 10 monclient: dump: 2026-02-17T21:26:33.816 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:33.816 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:33.817 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:33.817 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:33.817 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:33.817 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:33.817 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:33.817 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:33.817 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:33.817 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:33.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.806+0000 7f495e7fc640 10 monclient: _finish_auth 0 2026-02-17T21:26:33.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.806+0000 7f495e7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:26:33.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.806+0000 7f495e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:33.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.806+0000 7f495e7fc640 1 -- 10.20.193.5:0/3546657011 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4960035700 con 0x7f4970072de0 2026-02-17T21:26:33.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.806+0000 7f495e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:33.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.806+0000 7f495e7fc640 1 -- 10.20.193.5:0/3546657011 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496003c040 con 0x7f4970072de0 2026-02-17T21:26:33.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.806+0000 7f495e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:33.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.806+0000 7f495e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:26:33.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.806+0000 7f495e7fc640 10 monclient: dump: 2026-02-17T21:26:33.818 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:33.818 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:33.818 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:33.818 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:33.818 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:33.818 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:33.818 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:33.819 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:33.819 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:33.819 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:33.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.806+0000 7f495ffff640 4 set_mon_vals no callback set 2026-02-17T21:26:33.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.806+0000 7f4977bbc640 5 monclient: authenticate success, global_id 4683 2026-02-17T21:26:33.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.806+0000 7f4977bbc640 10 monclient: _renew_subs 2026-02-17T21:26:33.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.806+0000 7f4977bbc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:33.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.806+0000 7f4977bbc640 1 -- 10.20.193.5:0/3546657011 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49701f35c0 con 0x7f4970072de0 2026-02-17T21:26:33.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.806+0000 7f4977bbc640 10 client.4683.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:26:33.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.806+0000 7f4977bbc640 10 monclient: _renew_subs 2026-02-17T21:26:33.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.806+0000 7f4977bbc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:33.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.806+0000 7f4977bbc640 1 -- 10.20.193.5:0/3546657011 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49701f3b80 con 0x7f4970072de0 2026-02-17T21:26:33.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.806+0000 7f4977bbc640 1 librados: init done 2026-02-17T21:26:33.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.807+0000 7f4977bbc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:33.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.807+0000 7f4977bbc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:33.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.807+0000 7f4977bbc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:33.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.807+0000 7f4977bbc640 1 -- 10.20.193.5:0/3546657011 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f497015fa70 con 0x7f4970072de0 2026-02-17T21:26:33.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.819+0000 7f495e7fc640 1 -- 10.20.193.5:0/3546657011 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f496003f030 con 0x7f4970072de0 2026-02-17T21:26:33.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.819+0000 7f495e7fc640 1 --2- 10.20.193.5:0/3546657011 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4940079280 0x7f494007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:33.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.820+0000 7f4975130640 1 --2- 10.20.193.5:0/3546657011 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4940079280 0x7f494007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:33.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.820+0000 7f4975130640 10 monclient: get_auth_request con 0x7f4940079280 auth_method 0 2026-02-17T21:26:33.822 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.820+0000 7f4975130640 1 --2- 10.20.193.5:0/3546657011 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4940079280 0x7f494007b740 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4964007fd0 tx=0x7f4964007b40 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:33.822 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.820+0000 7f495e7fc640 10 client.4683.objecter ms_handle_connect 0x7f4940079280 2026-02-17T21:26:33.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.821+0000 7f495e7fc640 1 -- 10.20.193.5:0/3546657011 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f4960083910 con 0x7f4970072de0 2026-02-17T21:26:33.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.821+0000 7f495e7fc640 10 client.4683.objecter ms_dispatch2 0x7f4970000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:26:33.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.821+0000 7f495e7fc640 3 client.4683.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:26:33.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.821+0000 7f495e7fc640 3 client.4683.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:26:33.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.821+0000 7f495e7fc640 20 client.4683.objecter dump_active .. 0 homeless 2026-02-17T21:26:33.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.921+0000 7f495e7fc640 1 -- 10.20.193.5:0/3546657011 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4960050030 con 0x7f4970072de0 2026-02-17T21:26:33.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.921+0000 7f495e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:33.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:33.921+0000 7f495e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:26:34.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.023+0000 7f4977bbc640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:26:34.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.023+0000 7f4977bbc640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:34.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.023+0000 7f4977bbc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:34.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.023+0000 7f4977bbc640 1 -- 10.20.193.5:0/3546657011 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f49700cb920 con 0x7f4970072de0 2026-02-17T21:26:34.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.025+0000 7f495e7fc640 1 -- 10.20.193.5:0/3546657011 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f49600363a0 con 0x7f4970072de0 2026-02-17T21:26:34.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.025+0000 7f495e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:34.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.025+0000 7f495e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:26:34.027 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:26:34.027 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:26:34.029 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.027+0000 7f4977bbc640 10 librados: watch_flush enter 2026-02-17T21:26:34.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.027+0000 7f4977bbc640 10 librados: watch_flush exit 2026-02-17T21:26:34.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.027+0000 7f4977bbc640 20 client.4683.objecter shutdown clearing up homeless session... 2026-02-17T21:26:34.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.027+0000 7f4977bbc640 10 client.4683.objecter successfully canceled tick 2026-02-17T21:26:34.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.027+0000 7f4977bbc640 1 -- 10.20.193.5:0/3546657011 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4940079280 msgr2=0x7f494007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:34.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.027+0000 7f4977bbc640 1 --2- 10.20.193.5:0/3546657011 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4940079280 0x7f494007b740 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4964007fd0 tx=0x7f4964007b40 comp rx=0 tx=0).stop 2026-02-17T21:26:34.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.027+0000 7f4977bbc640 10 monclient: shutdown 2026-02-17T21:26:34.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.027+0000 7f4977bbc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:34.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.027+0000 7f4977bbc640 1 -- 10.20.193.5:0/3546657011 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f4970072de0 msgr2=0x7f4970156bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:34.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.027+0000 7f4977bbc640 1 --2- 10.20.193.5:0/3546657011 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f4970072de0 0x7f4970156bd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f496002f280 tx=0x7f49600047c0 comp rx=0 tx=0).stop 2026-02-17T21:26:34.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.027+0000 7f4977bbc640 1 -- 10.20.193.5:0/3546657011 shutdown_connections 2026-02-17T21:26:34.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.027+0000 7f4977bbc640 1 --2- 10.20.193.5:0/3546657011 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4940079280 0x7f494007b740 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:34.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.027+0000 7f4977bbc640 1 --2- 10.20.193.5:0/3546657011 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f497015f690 0x7f4970158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:34.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.027+0000 7f4977bbc640 1 --2- 10.20.193.5:0/3546657011 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f49700c9050 0x7f497015e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:34.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.027+0000 7f4977bbc640 1 --2- 10.20.193.5:0/3546657011 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f4970072de0 0x7f4970156bd0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:34.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.027+0000 7f4977bbc640 1 -- 10.20.193.5:0/3546657011 >> 10.20.193.5:0/3546657011 conn(0x7f49700c9f20 msgr2=0x7f49700c7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:34.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.027+0000 7f4977bbc640 1 -- 10.20.193.5:0/3546657011 shutdown_connections 2026-02-17T21:26:34.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.027+0000 7f4977bbc640 1 -- 10.20.193.5:0/3546657011 wait complete. 2026-02-17T21:26:34.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:34.027+0000 7f4977bbc640 1 librados: shutdown 2026-02-17T21:26:37.038 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:26:37.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.105+0000 7f6e321f7640 10 monclient: get_monmap_and_config 2026-02-17T21:26:37.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.105+0000 7f6e321f7640 10 monclient: build_initial_monmap 2026-02-17T21:26:37.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.105+0000 7f6e321f7640 10 monclient: monmap: 2026-02-17T21:26:37.107 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:37.107 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:37.107 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:26:37.106516+0000 2026-02-17T21:26:37.107 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:26:37.106516+0000 2026-02-17T21:26:37.107 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:37.107 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:37.107 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:26:37.107 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:26:37.107 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:26:37.107 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:26:37.107 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:26:37.107 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:26:37.107 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:37.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.106+0000 7f6e321f7640 1 Processor -- start 2026-02-17T21:26:37.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.106+0000 7f6e321f7640 1 -- start start 2026-02-17T21:26:37.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.106+0000 7f6e321f7640 10 monclient: init 2026-02-17T21:26:37.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.106+0000 7f6e321f7640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:37.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.106+0000 7f6e321f7640 10 monclient: _add_conns ranks=[2,1,4,5,3,0] 2026-02-17T21:26:37.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.106+0000 7f6e321f7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6e2c0c7170 addr v1:10.20.193.135:6789/0 2026-02-17T21:26:37.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.106+0000 7f6e321f7640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f6e2c0c7550 addr v1:10.20.193.119:6789/0 2026-02-17T21:26:37.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.106+0000 7f6e321f7640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f6e2c0c89c0 0x7f6e2c0c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:37.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.106+0000 7f6e321f7640 10 monclient(hunting): picked mon.noname-b con 0x7f6e2c0c89c0 addr v2:10.20.193.119:3300/0 2026-02-17T21:26:37.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.106+0000 7f6e321f7640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e2c0c4fd0 con 0x7f6e2c0c7550 2026-02-17T21:26:37.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.106+0000 7f6e321f7640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e2c15a9a0 con 0x7f6e2c0c7170 2026-02-17T21:26:37.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.106+0000 7f6e321f7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:37.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.106+0000 7f6e321f7640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f6e2c0c8530 con 0x7f6e2c0c89c0 2026-02-17T21:26:37.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.106+0000 7f6e321f7640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:37.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.106+0000 7f6e321f7640 10 monclient(hunting): authenticate will time out at 1102.671944s 2026-02-17T21:26:37.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.107+0000 7f6e2b7fe640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f6e2c0c7170 0x7f6e2c0c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:58354/0 (socket says 10.20.193.5:58354) 2026-02-17T21:26:37.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.107+0000 7f6e2b7fe640 1 -- 10.20.193.5:0/505440273 learned_addr learned my addr 10.20.193.5:0/505440273 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:26:37.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.107+0000 7f6e2bfff640 1 --2- 10.20.193.5:0/505440273 >> v2:10.20.193.119:3300/0 conn(0x7f6e2c0c89c0 0x7f6e2c0c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:37.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.107+0000 7f6e2bfff640 10 monclient(hunting): get_auth_request con 0x7f6e2c0c89c0 auth_method 0 2026-02-17T21:26:37.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.107+0000 7f6e2bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:37.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.107+0000 7f6e2bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:37.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.107+0000 7f6e2bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:37.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.108+0000 7f6e2bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:37.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.108+0000 7f6e2bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:37.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.108+0000 7f6e2bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:37.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.109+0000 7f6e2a7fc640 1 -- 10.20.193.5:0/505440273 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1728455994 0 0) 0x7f6e2c15a9a0 con 0x7f6e2c0c7170 2026-02-17T21:26:37.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.109+0000 7f6e2a7fc640 10 monclient(hunting): _negotiate 2026-02-17T21:26:37.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.109+0000 7f6e2a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:37.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.109+0000 7f6e2a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:37.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.109+0000 7f6e2a7fc640 10 monclient(hunting): my global_id is 4724 2026-02-17T21:26:37.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.109+0000 7f6e2a7fc640 1 -- 10.20.193.5:0/505440273 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e10003620 con 0x7f6e2c0c7170 2026-02-17T21:26:37.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.109+0000 7f6e2bfff640 10 monclient(hunting): handle_auth_done global_id 4708 payload 274 2026-02-17T21:26:37.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.109+0000 7f6e2bfff640 1 -- 10.20.193.5:0/505440273 >> v1:10.20.193.135:6789/0 conn(0x7f6e2c0c7170 legacy=0x7f6e2c0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:37.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.109+0000 7f6e2bfff640 1 -- 10.20.193.5:0/505440273 >> v1:10.20.193.119:6789/0 conn(0x7f6e2c0c7550 legacy=0x7f6e2c0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:37.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.109+0000 7f6e2bfff640 10 monclient: _finish_hunting 0 2026-02-17T21:26:37.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.109+0000 7f6e2bfff640 1 monclient: found mon.noname-b 2026-02-17T21:26:37.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.109+0000 7f6e2bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:37.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.109+0000 7f6e2bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:26:37.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.109+0000 7f6e2bfff640 1 -- 10.20.193.5:0/505440273 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e2c0c5270 con 0x7f6e2c0c89c0 2026-02-17T21:26:37.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.110+0000 7f6e2bfff640 1 -- 10.20.193.5:0/505440273 >> v2:10.20.193.119:3300/0 conn(0x7f6e2c0c89c0 msgr2=0x7f6e2c0c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T21:26:37.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.110+0000 7f6e2bfff640 1 -- 10.20.193.5:0/505440273 >> v2:10.20.193.119:3300/0 conn(0x7f6e2c0c89c0 msgr2=0x7f6e2c0c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T21:26:37.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.110+0000 7f6e2bfff640 1 --2- 10.20.193.5:0/505440273 >> v2:10.20.193.119:3300/0 conn(0x7f6e2c0c89c0 0x7f6e2c0c8e70 secure :-1 s=COMPRESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0x7f6e20009d90 tx=0x7f6e2002f230 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:26:37.114 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.110+0000 7f6e2bfff640 1 --2- 10.20.193.5:0/505440273 >> v2:10.20.193.119:3300/0 conn(0x7f6e2c0c89c0 0x7f6e2c0c8e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:26:37.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.313+0000 7f6e2bfff640 1 --2- 10.20.193.5:0/505440273 >> v2:10.20.193.119:3300/0 conn(0x7f6e2c0c89c0 0x7f6e2c0c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:37.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.313+0000 7f6e2bfff640 10 monclient: get_auth_request con 0x7f6e2c0c89c0 auth_method 0 2026-02-17T21:26:37.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.313+0000 7f6e2bfff640 0 --2- 10.20.193.5:0/505440273 >> v2:10.20.193.119:3300/0 conn(0x7f6e2c0c89c0 0x7f6e2c0c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2026-02-17T21:26:37.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.313+0000 7f6e2bfff640 1 --2- 10.20.193.5:0/505440273 >> v2:10.20.193.119:3300/0 conn(0x7f6e2c0c89c0 0x7f6e2c0c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:37.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.313+0000 7f6e2a7fc640 10 monclient: ms_handle_reset current mon v2:10.20.193.119:3300/0 2026-02-17T21:26:37.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.313+0000 7f6e2a7fc640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:37.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.313+0000 7f6e2a7fc640 1 -- 10.20.193.5:0/505440273 >> v2:10.20.193.119:3300/0 conn(0x7f6e2c0c89c0 msgr2=0x7f6e2c0c8e70 unknown :-1 s=STATE_CLOSED l=0).mark_down 2026-02-17T21:26:37.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.313+0000 7f6e2a7fc640 1 --2- 10.20.193.5:0/505440273 >> v2:10.20.193.119:3300/0 conn(0x7f6e2c0c89c0 0x7f6e2c0c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:37.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.313+0000 7f6e2a7fc640 10 monclient: _add_conns ranks=[3,5,0] 2026-02-17T21:26:37.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.313+0000 7f6e2a7fc640 1 --2- 10.20.193.5:0/505440273 >> v2:10.20.193.5:3300/0 conn(0x7f6e10003930 0x7f6e10003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:37.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.313+0000 7f6e2a7fc640 10 monclient(hunting): picked mon.noname-a con 0x7f6e10003930 addr v2:10.20.193.5:3300/0 2026-02-17T21:26:37.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.313+0000 7f6e2a7fc640 1 --2- 10.20.193.5:0/505440273 >> v2:10.20.193.135:3300/0 conn(0x7f6e10004900 0x7f6e10004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:37.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.313+0000 7f6e2a7fc640 10 monclient(hunting): picked mon.noname-c con 0x7f6e10004900 addr v2:10.20.193.135:3300/0 2026-02-17T21:26:37.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.313+0000 7f6e2a7fc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6e10005350 addr v1:10.20.193.5:6789/0 2026-02-17T21:26:37.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.313+0000 7f6e2a7fc640 1 -- 10.20.193.5:0/505440273 --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e2c15a9a0 con 0x7f6e10005350 2026-02-17T21:26:37.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.313+0000 7f6e2a7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:37.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.313+0000 7f6e2a7fc640 1 -- 10.20.193.5:0/505440273 --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6e1000e490 con 0x7f6e10003930 2026-02-17T21:26:37.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.313+0000 7f6e2a7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:37.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.313+0000 7f6e2a7fc640 1 -- 10.20.193.5:0/505440273 --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f6e1000e640 con 0x7f6e10004900 2026-02-17T21:26:37.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.313+0000 7f6e2a7fc640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:37.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.313+0000 7f6e2a7fc640 10 monclient(hunting): ms_handle_reset stray mon v2:10.20.193.119:3300/0 2026-02-17T21:26:37.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.313+0000 7f6e2affd640 1 --2- 10.20.193.5:0/505440273 >> v2:10.20.193.135:3300/0 conn(0x7f6e10004900 0x7f6e10004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:37.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.314+0000 7f6e2affd640 10 monclient(hunting): get_auth_request con 0x7f6e10004900 auth_method 0 2026-02-17T21:26:37.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.314+0000 7f6e2affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:37.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.314+0000 7f6e2affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:37.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.314+0000 7f6e2affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:26:37.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.314+0000 7f6e2affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:37.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.314+0000 7f6e2affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:37.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.314+0000 7f6e2affd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:26:37.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.315+0000 7f6e2affd640 10 monclient(hunting): handle_auth_done global_id 4708 payload 293 2026-02-17T21:26:37.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.315+0000 7f6e2affd640 1 -- 10.20.193.5:0/505440273 >> v2:10.20.193.5:3300/0 conn(0x7f6e10003930 msgr2=0x7f6e10003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:26:37.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.315+0000 7f6e2affd640 1 --2- 10.20.193.5:0/505440273 >> v2:10.20.193.5:3300/0 conn(0x7f6e10003930 0x7f6e10003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:37.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.315+0000 7f6e2affd640 1 -- 10.20.193.5:0/505440273 >> v1:10.20.193.5:6789/0 conn(0x7f6e10005350 legacy=0x7f6e1000bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:26:37.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.315+0000 7f6e2affd640 10 monclient: _finish_hunting 0 2026-02-17T21:26:37.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.315+0000 7f6e2affd640 1 monclient: found mon.noname-c 2026-02-17T21:26:37.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.315+0000 7f6e2affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:37.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.315+0000 7f6e2bfff640 1 -- 10.20.193.5:0/505440273 reap_dead start 2026-02-17T21:26:37.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.315+0000 7f6e2affd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:26:37.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.315+0000 7f6e2affd640 1 -- 10.20.193.5:0/505440273 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e1000e900 con 0x7f6e10004900 2026-02-17T21:26:37.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.316+0000 7f6e2affd640 1 --2- 10.20.193.5:0/505440273 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6e10004900 0x7f6e10004db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6e10004580 tx=0x7f6e20009750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c22fb7028c7485e6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:37.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.317+0000 7f6e2a7fc640 1 -- 10.20.193.5:0/505440273 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c002cc0 con 0x7f6e10004900 2026-02-17T21:26:37.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.317+0000 7f6e2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:37.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.318+0000 7f6e2a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:26:37.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.318+0000 7f6e2a7fc640 10 monclient: dump: 2026-02-17T21:26:37.326 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:37.326 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:37.326 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:37.326 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:37.326 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:37.327 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:37.327 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:37.327 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:37.327 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:37.327 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:37.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.318+0000 7f6e2a7fc640 10 monclient: _finish_auth 0 2026-02-17T21:26:37.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.318+0000 7f6e2a7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:26:37.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.318+0000 7f6e2a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:37.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.318+0000 7f6e321f7640 5 monclient: authenticate success, global_id 4708 2026-02-17T21:26:37.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.318+0000 7f6e321f7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:26:37.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.318+0000 7f6e2a7fc640 1 -- 10.20.193.5:0/505440273 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e1c0052d0 con 0x7f6e10004900 2026-02-17T21:26:37.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.318+0000 7f6e2a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:37.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.318+0000 7f6e2a7fc640 1 -- 10.20.193.5:0/505440273 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c0068d0 con 0x7f6e10004900 2026-02-17T21:26:37.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.318+0000 7f6e321f7640 10 monclient: get_monmap_and_config success 2026-02-17T21:26:37.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.318+0000 7f6e321f7640 4 set_mon_vals no callback set 2026-02-17T21:26:37.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.318+0000 7f6e2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:37.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.318+0000 7f6e2a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:26:37.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.318+0000 7f6e2a7fc640 10 monclient: dump: 2026-02-17T21:26:37.328 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:37.328 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:37.328 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:37.328 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:37.328 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:37.328 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:37.329 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:37.329 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:37.329 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:37.329 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:37.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.319+0000 7f6e321f7640 10 monclient: shutdown 2026-02-17T21:26:37.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.319+0000 7f6e321f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:37.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.319+0000 7f6e321f7640 1 -- 10.20.193.5:0/505440273 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6e10004900 msgr2=0x7f6e10004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:37.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.319+0000 7f6e321f7640 1 --2- 10.20.193.5:0/505440273 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6e10004900 0x7f6e10004db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6e10004580 tx=0x7f6e20009750 comp rx=0 tx=0).stop 2026-02-17T21:26:37.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.319+0000 7f6e321f7640 1 -- 10.20.193.5:0/505440273 shutdown_connections 2026-02-17T21:26:37.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.319+0000 7f6e321f7640 1 --2- 10.20.193.5:0/505440273 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6e10004900 0x7f6e10004db0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:37.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.319+0000 7f6e321f7640 1 -- 10.20.193.5:0/505440273 >> 10.20.193.5:0/505440273 conn(0x7f6e2c0c9f40 msgr2=0x7f6e2c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:37.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.319+0000 7f6e321f7640 1 -- 10.20.193.5:0/505440273 shutdown_connections 2026-02-17T21:26:37.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.319+0000 7f6e321f7640 1 -- 10.20.193.5:0/505440273 wait complete. 2026-02-17T21:26:37.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.319+0000 7f6e321f7640 10 monclient: build_initial_monmap 2026-02-17T21:26:37.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.319+0000 7f6e321f7640 10 monclient: monmap: 2026-02-17T21:26:37.330 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:37.330 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:26:37.330 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:26:37.330 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:26:37.330 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:37.330 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:37.330 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:26:37.330 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:26:37.331 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:26:37.331 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:37.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.319+0000 7f6e321f7640 1 librados: starting msgr at 2026-02-17T21:26:37.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.319+0000 7f6e321f7640 1 librados: starting objecter 2026-02-17T21:26:37.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.319+0000 7f6e321f7640 1 Processor -- start 2026-02-17T21:26:37.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e321f7640 1 -- start start 2026-02-17T21:26:37.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e321f7640 1 librados: setting wanted keys 2026-02-17T21:26:37.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e321f7640 1 librados: calling monclient init 2026-02-17T21:26:37.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e321f7640 10 monclient: init 2026-02-17T21:26:37.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e321f7640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:37.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e321f7640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:26:37.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e321f7640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6e10004900 0x7f6e2c14db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:37.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e321f7640 10 monclient(hunting): picked mon.noname-b con 0x7f6e10004900 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:26:37.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e321f7640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6e2c1f3380 0x7f6e2c1f3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:37.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e321f7640 10 monclient(hunting): picked mon.noname-a con 0x7f6e2c1f3380 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:26:37.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e321f7640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6e2c0c0fb0 0x7f6e2c0c1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:37.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e321f7640 10 monclient(hunting): picked mon.noname-c con 0x7f6e2c0c0fb0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:26:37.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e321f7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:37.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e321f7640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2c0c7ee0 con 0x7f6e2c1f3380 2026-02-17T21:26:37.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e321f7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:37.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e321f7640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2c0c5830 con 0x7f6e10004900 2026-02-17T21:26:37.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e321f7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:37.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e321f7640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2c0c81c0 con 0x7f6e2c0c0fb0 2026-02-17T21:26:37.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e321f7640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:37.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e321f7640 10 monclient(hunting): authenticate will time out at 1102.885417s 2026-02-17T21:26:37.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e2b7fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6e10004900 0x7f6e2c14db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:37.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e2bfff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6e2c0c0fb0 0x7f6e2c0c1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:37.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e2bfff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6e2c0c0fb0 0x7f6e2c0c1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:46406/0 (socket says 10.20.193.5:46406) 2026-02-17T21:26:37.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e2bfff640 1 -- 10.20.193.5:0/1614985119 learned_addr learned my addr 10.20.193.5:0/1614985119 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:26:37.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e2bfff640 10 monclient(hunting): get_auth_request con 0x7f6e2c0c0fb0 auth_method 0 2026-02-17T21:26:37.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e2bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:37.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e2bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:37.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.320+0000 7f6e2bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:37.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.321+0000 7f6e2b7fe640 10 monclient(hunting): get_auth_request con 0x7f6e10004900 auth_method 0 2026-02-17T21:26:37.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.321+0000 7f6e2b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:37.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.321+0000 7f6e2b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:37.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.321+0000 7f6e2b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:37.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.321+0000 7f6e2bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:37.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.321+0000 7f6e2bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:37.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.321+0000 7f6e2bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:37.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.321+0000 7f6e2b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:37.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.321+0000 7f6e2b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:37.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.321+0000 7f6e2b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:37.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.322+0000 7f6e2affd640 1 --2- 10.20.193.5:0/1614985119 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6e2c1f3380 0x7f6e2c1f3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:37.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.322+0000 7f6e2bfff640 10 monclient(hunting): handle_auth_done global_id 4727 payload 824 2026-02-17T21:26:37.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.322+0000 7f6e2bfff640 1 -- 10.20.193.5:0/1614985119 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6e10004900 msgr2=0x7f6e2c14db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:37.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.322+0000 7f6e2bfff640 1 --2- 10.20.193.5:0/1614985119 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6e10004900 0x7f6e2c14db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:37.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.322+0000 7f6e2bfff640 1 -- 10.20.193.5:0/1614985119 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6e2c1f3380 msgr2=0x7f6e2c1f3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:37.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.322+0000 7f6e2bfff640 1 --2- 10.20.193.5:0/1614985119 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6e2c1f3380 0x7f6e2c1f3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:37.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.322+0000 7f6e2bfff640 10 monclient: _finish_hunting 0 2026-02-17T21:26:37.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.322+0000 7f6e2bfff640 1 monclient: found mon.noname-c 2026-02-17T21:26:37.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.322+0000 7f6e2bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:37.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.322+0000 7f6e2bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:26:37.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.322+0000 7f6e2bfff640 1 -- 10.20.193.5:0/1614985119 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e2c1f3d40 con 0x7f6e2c0c0fb0 2026-02-17T21:26:37.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.323+0000 7f6e2bfff640 1 --2- 10.20.193.5:0/1614985119 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6e2c0c0fb0 0x7f6e2c0c1430 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009e90 tx=0x7f6e20004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:37.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.323+0000 7f6e07fff640 10 client.?.objecter ms_handle_connect 0x7f6e2c0c0fb0 2026-02-17T21:26:37.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.323+0000 7f6e07fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:26:37.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.324+0000 7f6e07fff640 1 -- 10.20.193.5:0/1614985119 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2003e030 con 0x7f6e2c0c0fb0 2026-02-17T21:26:37.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.324+0000 7f6e07fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:37.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.324+0000 7f6e07fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:26:37.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.324+0000 7f6e07fff640 10 monclient: dump: 2026-02-17T21:26:37.338 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:37.338 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:37.338 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:37.338 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:37.338 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:37.338 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:37.338 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:37.338 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:37.339 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:37.339 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:37.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.324+0000 7f6e07fff640 10 monclient: _finish_auth 0 2026-02-17T21:26:37.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.324+0000 7f6e07fff640 10 monclient: _check_auth_tickets 2026-02-17T21:26:37.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.324+0000 7f6e07fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:37.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.324+0000 7f6e321f7640 5 monclient: authenticate success, global_id 4727 2026-02-17T21:26:37.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.324+0000 7f6e321f7640 10 monclient: _renew_subs 2026-02-17T21:26:37.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.324+0000 7f6e321f7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:26:37.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.324+0000 7f6e321f7640 1 -- 10.20.193.5:0/1614985119 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e2c0c1e50 con 0x7f6e2c0c0fb0 2026-02-17T21:26:37.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.324+0000 7f6e321f7640 10 client.4727.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:26:37.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.324+0000 7f6e321f7640 10 monclient: _renew_subs 2026-02-17T21:26:37.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.324+0000 7f6e321f7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:26:37.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.324+0000 7f6e321f7640 1 -- 10.20.193.5:0/1614985119 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e2c0c2410 con 0x7f6e2c0c0fb0 2026-02-17T21:26:37.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.324+0000 7f6e321f7640 1 librados: init done 2026-02-17T21:26:37.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.325+0000 7f6e321f7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:37.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.325+0000 7f6e321f7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:37.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.325+0000 7f6e321f7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:26:37.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.325+0000 7f6e321f7640 1 -- 10.20.193.5:0/1614985119 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e2c0c8e70 con 0x7f6e2c0c0fb0 2026-02-17T21:26:37.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.325+0000 7f6e07fff640 1 -- 10.20.193.5:0/1614985119 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e2002fe00 con 0x7f6e2c0c0fb0 2026-02-17T21:26:37.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.325+0000 7f6e07fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:37.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.325+0000 7f6e07fff640 1 -- 10.20.193.5:0/1614985119 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2003a890 con 0x7f6e2c0c0fb0 2026-02-17T21:26:37.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.325+0000 7f6e07fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:37.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.325+0000 7f6e07fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:26:37.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.325+0000 7f6e07fff640 10 monclient: dump: 2026-02-17T21:26:37.341 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:37.341 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:37.341 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:37.341 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:37.341 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:37.341 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:37.341 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:37.341 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:37.341 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:37.341 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:37.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.325+0000 7f6e29ffb640 4 set_mon_vals no callback set 2026-02-17T21:26:37.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.432+0000 7f6e07fff640 1 -- 10.20.193.5:0/1614985119 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f6e20037050 con 0x7f6e2c0c0fb0 2026-02-17T21:26:37.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.433+0000 7f6e07fff640 1 --2- 10.20.193.5:0/1614985119 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6dfc0792b0 0x7f6dfc07b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:37.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.433+0000 7f6e2b7fe640 1 --2- 10.20.193.5:0/1614985119 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6dfc0792b0 0x7f6dfc07b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:37.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.433+0000 7f6e2b7fe640 10 monclient: get_auth_request con 0x7f6dfc0792b0 auth_method 0 2026-02-17T21:26:37.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.434+0000 7f6e2b7fe640 1 --2- 10.20.193.5:0/1614985119 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6dfc0792b0 0x7f6dfc07b770 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6e18002770 tx=0x7f6e18009040 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:37.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.434+0000 7f6e07fff640 10 client.4727.objecter ms_handle_connect 0x7f6dfc0792b0 2026-02-17T21:26:37.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.436+0000 7f6e07fff640 1 -- 10.20.193.5:0/1614985119 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f6e200bcdf0 con 0x7f6e2c0c0fb0 2026-02-17T21:26:37.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.436+0000 7f6e07fff640 10 client.4727.objecter ms_dispatch2 0x7f6e2c000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:26:37.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.436+0000 7f6e07fff640 3 client.4727.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:26:37.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.436+0000 7f6e07fff640 3 client.4727.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:26:37.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.436+0000 7f6e07fff640 20 client.4727.objecter dump_active .. 0 homeless 2026-02-17T21:26:37.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.448+0000 7f6e07fff640 1 -- 10.20.193.5:0/1614985119 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6e20048030 con 0x7f6e2c0c0fb0 2026-02-17T21:26:37.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.448+0000 7f6e07fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:37.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.448+0000 7f6e07fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:26:37.481 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:03:17.106 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:37.484 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:03:17.108 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:37.484 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:03:17.109 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:37.486 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:03:17.110 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:37.495 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:03:17.120 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:37.495 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:03:17.119 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:37.512 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:03:17.098 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:37.515 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:03:17.101 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:37.523 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:03:17.109 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:37.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.548+0000 7f6e321f7640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:26:37.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.548+0000 7f6e321f7640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:37.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.548+0000 7f6e321f7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:26:37.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.548+0000 7f6e321f7640 1 -- 10.20.193.5:0/1614985119 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6e2c15ac60 con 0x7f6e2c0c0fb0 2026-02-17T21:26:37.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.563+0000 7f6e07fff640 1 -- 10.20.193.5:0/1614985119 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f6e2c1f3d40 con 0x7f6e2c0c0fb0 2026-02-17T21:26:37.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.563+0000 7f6e07fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:37.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.563+0000 7f6e07fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:26:37.564 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:26:37.565 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:26:37.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.565+0000 7f6e321f7640 10 librados: watch_flush enter 2026-02-17T21:26:37.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.565+0000 7f6e321f7640 10 librados: watch_flush exit 2026-02-17T21:26:37.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.565+0000 7f6e321f7640 20 client.4727.objecter shutdown clearing up homeless session... 2026-02-17T21:26:37.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.565+0000 7f6e321f7640 10 client.4727.objecter successfully canceled tick 2026-02-17T21:26:37.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.565+0000 7f6e321f7640 1 -- 10.20.193.5:0/1614985119 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6dfc0792b0 msgr2=0x7f6dfc07b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:37.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.565+0000 7f6e321f7640 1 --2- 10.20.193.5:0/1614985119 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6dfc0792b0 0x7f6dfc07b770 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6e18002770 tx=0x7f6e18009040 comp rx=0 tx=0).stop 2026-02-17T21:26:37.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.565+0000 7f6e321f7640 10 monclient: shutdown 2026-02-17T21:26:37.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.565+0000 7f6e321f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:37.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.565+0000 7f6e321f7640 1 -- 10.20.193.5:0/1614985119 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6e2c0c0fb0 msgr2=0x7f6e2c0c1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:37.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.565+0000 7f6e321f7640 1 --2- 10.20.193.5:0/1614985119 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6e2c0c0fb0 0x7f6e2c0c1430 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009e90 tx=0x7f6e20004b40 comp rx=0 tx=0).stop 2026-02-17T21:26:37.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.565+0000 7f6e321f7640 1 -- 10.20.193.5:0/1614985119 shutdown_connections 2026-02-17T21:26:37.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.565+0000 7f6e321f7640 1 --2- 10.20.193.5:0/1614985119 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6dfc0792b0 0x7f6dfc07b770 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:37.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.565+0000 7f6e321f7640 1 --2- 10.20.193.5:0/1614985119 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6e2c0c0fb0 0x7f6e2c0c1430 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:37.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.565+0000 7f6e321f7640 1 --2- 10.20.193.5:0/1614985119 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6e2c1f3380 0x7f6e2c1f3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:37.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.565+0000 7f6e321f7640 1 --2- 10.20.193.5:0/1614985119 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6e10004900 0x7f6e2c14db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:37.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.565+0000 7f6e321f7640 1 -- 10.20.193.5:0/1614985119 >> 10.20.193.5:0/1614985119 conn(0x7f6e2c0c9f40 msgr2=0x7f6e2c0c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:37.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.565+0000 7f6e321f7640 1 -- 10.20.193.5:0/1614985119 shutdown_connections 2026-02-17T21:26:37.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.565+0000 7f6e321f7640 1 -- 10.20.193.5:0/1614985119 wait complete. 2026-02-17T21:26:37.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:37.565+0000 7f6e321f7640 1 librados: shutdown 2026-02-17T21:26:40.577 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:26:40.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.644+0000 7f505d23c640 10 monclient: get_monmap_and_config 2026-02-17T21:26:40.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.644+0000 7f505d23c640 10 monclient: build_initial_monmap 2026-02-17T21:26:40.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.644+0000 7f505d23c640 10 monclient: monmap: 2026-02-17T21:26:40.647 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:40.647 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:40.647 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:26:40.645283+0000 2026-02-17T21:26:40.647 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:26:40.645283+0000 2026-02-17T21:26:40.647 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:40.647 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:40.647 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:26:40.647 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:26:40.648 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:26:40.648 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:26:40.648 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:26:40.648 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:26:40.648 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:40.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.645+0000 7f505d23c640 1 Processor -- start 2026-02-17T21:26:40.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.645+0000 7f505d23c640 1 -- start start 2026-02-17T21:26:40.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.645+0000 7f505d23c640 10 monclient: init 2026-02-17T21:26:40.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.645+0000 7f505d23c640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:40.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.645+0000 7f505d23c640 10 monclient: _add_conns ranks=[3,2,1,4,0,5] 2026-02-17T21:26:40.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.645+0000 7f505d23c640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f50580c7170 0x7f50580c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:40.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.645+0000 7f505d23c640 10 monclient(hunting): picked mon.noname-a con 0x7f50580c7170 addr v2:10.20.193.5:3300/0 2026-02-17T21:26:40.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.645+0000 7f505d23c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f50580c48c0 addr v1:10.20.193.135:6789/0 2026-02-17T21:26:40.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.645+0000 7f505d23c640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f50580c4d10 addr v1:10.20.193.119:6789/0 2026-02-17T21:26:40.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.645+0000 7f505d23c640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f505815a9a0 con 0x7f50580c4d10 2026-02-17T21:26:40.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.645+0000 7f505d23c640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50580c5270 con 0x7f50580c48c0 2026-02-17T21:26:40.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.645+0000 7f505d23c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:40.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.645+0000 7f505d23c640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f50580c8530 con 0x7f50580c7170 2026-02-17T21:26:40.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.645+0000 7f505d23c640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:40.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.645+0000 7f505d23c640 10 monclient(hunting): authenticate will time out at 1106.210601s 2026-02-17T21:26:40.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.645+0000 7f5056d76640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f50580c7170 0x7f50580c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:40.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.646+0000 7f5057577640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f50580c4d10 0x7f50580c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:35786/0 (socket says 10.20.193.5:35786) 2026-02-17T21:26:40.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.646+0000 7f5057577640 1 -- 10.20.193.5:0/1070078028 learned_addr learned my addr 10.20.193.5:0/1070078028 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:26:40.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.646+0000 7f5056d76640 10 monclient(hunting): get_auth_request con 0x7f50580c7170 auth_method 0 2026-02-17T21:26:40.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.646+0000 7f5056d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:40.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.646+0000 7f5056d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:40.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.646+0000 7f5056d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:40.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.646+0000 7f5056d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:40.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.646+0000 7f5056d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:40.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.646+0000 7f5056d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:40.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.647+0000 7f5056d76640 10 monclient(hunting): handle_auth_done global_id 4686 payload 274 2026-02-17T21:26:40.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.647+0000 7f5056d76640 1 -- 10.20.193.5:0/1070078028 >> v1:10.20.193.135:6789/0 conn(0x7f50580c48c0 legacy=0x7f50580749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:40.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.647+0000 7f5056d76640 1 -- 10.20.193.5:0/1070078028 >> v1:10.20.193.119:6789/0 conn(0x7f50580c4d10 legacy=0x7f50580c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:40.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.647+0000 7f5056d76640 10 monclient: _finish_hunting 0 2026-02-17T21:26:40.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.647+0000 7f5056d76640 1 monclient: found mon.noname-a 2026-02-17T21:26:40.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.647+0000 7f5055d74640 1 -- 10.20.193.5:0/1070078028 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2550233896 0 0) 0x7f505815a9a0 con 0x7f50580c4d10 2026-02-17T21:26:40.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.647+0000 7f5056d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:40.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.647+0000 7f5056d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:26:40.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.647+0000 7f5056d76640 1 -- 10.20.193.5:0/1070078028 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50580c5550 con 0x7f50580c7170 2026-02-17T21:26:40.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.647+0000 7f5055d74640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-17T21:26:40.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.648+0000 7f5056d76640 1 --2- 10.20.193.5:0/1070078028 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f50580c7170 0x7f50580c7550 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f504c0098a0 tx=0x7f504c02ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d6f9d519fdeb61 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:40.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.649+0000 7f5055d74640 1 -- 10.20.193.5:0/1070078028 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504c03c070 con 0x7f50580c7170 2026-02-17T21:26:40.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.649+0000 7f5055d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:40.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f5055d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:26:40.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f5055d74640 10 monclient: dump: 2026-02-17T21:26:40.663 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:40.663 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:40.663 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:40.663 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:40.663 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:40.663 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:40.664 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:40.664 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:40.664 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:40.664 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:40.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f5055d74640 10 monclient: _finish_auth 0 2026-02-17T21:26:40.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f5055d74640 10 monclient: _check_auth_tickets 2026-02-17T21:26:40.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f5055d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:40.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f505d23c640 5 monclient: authenticate success, global_id 4686 2026-02-17T21:26:40.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f5055d74640 1 -- 10.20.193.5:0/1070078028 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f504c02fb70 con 0x7f50580c7170 2026-02-17T21:26:40.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f505d23c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:26:40.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f5055d74640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:40.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f5055d74640 1 -- 10.20.193.5:0/1070078028 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504c037440 con 0x7f50580c7170 2026-02-17T21:26:40.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f505d23c640 10 monclient: get_monmap_and_config success 2026-02-17T21:26:40.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f505d23c640 4 set_mon_vals no callback set 2026-02-17T21:26:40.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f5055d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:40.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f5055d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:26:40.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f5055d74640 10 monclient: dump: 2026-02-17T21:26:40.665 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:40.665 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:40.665 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:40.665 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:40.665 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:40.665 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:40.665 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:40.666 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:40.666 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:40.666 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:40.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f505d23c640 10 monclient: shutdown 2026-02-17T21:26:40.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f505d23c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:40.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f505d23c640 1 -- 10.20.193.5:0/1070078028 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f50580c7170 msgr2=0x7f50580c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:40.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f505d23c640 1 --2- 10.20.193.5:0/1070078028 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f50580c7170 0x7f50580c7550 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f504c0098a0 tx=0x7f504c02ee60 comp rx=0 tx=0).stop 2026-02-17T21:26:40.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f505d23c640 1 -- 10.20.193.5:0/1070078028 shutdown_connections 2026-02-17T21:26:40.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f505d23c640 1 --2- 10.20.193.5:0/1070078028 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f50580c7170 0x7f50580c7550 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:40.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f505d23c640 1 -- 10.20.193.5:0/1070078028 >> 10.20.193.5:0/1070078028 conn(0x7f50580c9f40 msgr2=0x7f50580ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:40.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f505d23c640 1 -- 10.20.193.5:0/1070078028 shutdown_connections 2026-02-17T21:26:40.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f505d23c640 1 -- 10.20.193.5:0/1070078028 wait complete. 2026-02-17T21:26:40.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f505d23c640 10 monclient: build_initial_monmap 2026-02-17T21:26:40.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f505d23c640 10 monclient: monmap: 2026-02-17T21:26:40.667 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:40.667 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:26:40.667 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:26:40.667 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:26:40.667 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:40.667 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:40.667 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:26:40.667 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:26:40.667 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:26:40.667 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:40.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f505d23c640 1 librados: starting msgr at 2026-02-17T21:26:40.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f505d23c640 1 librados: starting objecter 2026-02-17T21:26:40.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f505d23c640 1 Processor -- start 2026-02-17T21:26:40.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f505d23c640 1 -- start start 2026-02-17T21:26:40.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f505d23c640 1 librados: setting wanted keys 2026-02-17T21:26:40.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f505d23c640 1 librados: calling monclient init 2026-02-17T21:26:40.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.650+0000 7f505d23c640 10 monclient: init 2026-02-17T21:26:40.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f505d23c640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:40.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f505d23c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:26:40.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f505d23c640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f50580c48c0 0x7f5058157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:40.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f505d23c640 10 monclient(hunting): picked mon.noname-c con 0x7f50580c48c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:26:40.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f505d23c640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f50580c4d10 0x7f505806ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:40.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f505d23c640 10 monclient(hunting): picked mon.noname-b con 0x7f50580c4d10 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:26:40.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f505d23c640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f50580c7170 0x7f505806f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:40.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f505d23c640 10 monclient(hunting): picked mon.noname-a con 0x7f50580c7170 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:26:40.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f505d23c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:40.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f505d23c640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f50580c81c0 con 0x7f50580c7170 2026-02-17T21:26:40.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f505d23c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:40.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f505d23c640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f50580c7ee0 con 0x7f50580c4d10 2026-02-17T21:26:40.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f505d23c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:40.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f505d23c640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f50580750c0 con 0x7f50580c48c0 2026-02-17T21:26:40.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f505d23c640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:40.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f505d23c640 10 monclient(hunting): authenticate will time out at 1106.216393s 2026-02-17T21:26:40.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f5057577640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f50580c7170 0x7f505806f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:40.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f5056d76640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f50580c48c0 0x7f5058157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:40.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f5056575640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f50580c4d10 0x7f505806ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:40.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f5057577640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f50580c7170 0x7f505806f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:49532/0 (socket says 10.20.193.5:49532) 2026-02-17T21:26:40.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f5057577640 1 -- 10.20.193.5:0/784176130 learned_addr learned my addr 10.20.193.5:0/784176130 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:26:40.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f5057577640 10 monclient(hunting): get_auth_request con 0x7f50580c7170 auth_method 0 2026-02-17T21:26:40.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f5057577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:40.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f5057577640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:40.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f5057577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:40.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f5056d76640 10 monclient(hunting): get_auth_request con 0x7f50580c48c0 auth_method 0 2026-02-17T21:26:40.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f5056d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:40.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f5056d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:40.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f5056d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:40.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f5056575640 10 monclient(hunting): get_auth_request con 0x7f50580c4d10 auth_method 0 2026-02-17T21:26:40.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f5056575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:40.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f5056575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:40.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.651+0000 7f5056575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:40.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.652+0000 7f5057577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:40.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.652+0000 7f5057577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:40.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.652+0000 7f5057577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:40.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.652+0000 7f5056575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:40.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.652+0000 7f5056575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:40.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.652+0000 7f5056575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:40.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.652+0000 7f5056d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:40.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.652+0000 7f5056d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:40.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.652+0000 7f5056d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:40.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.653+0000 7f5057577640 10 monclient(hunting): handle_auth_done global_id 4689 payload 824 2026-02-17T21:26:40.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.653+0000 7f5057577640 1 -- 10.20.193.5:0/784176130 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f50580c48c0 msgr2=0x7f5058157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:40.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.653+0000 7f5057577640 1 --2- 10.20.193.5:0/784176130 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f50580c48c0 0x7f5058157fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:40.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.653+0000 7f5057577640 1 -- 10.20.193.5:0/784176130 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f50580c4d10 msgr2=0x7f505806ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:40.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.653+0000 7f5057577640 1 --2- 10.20.193.5:0/784176130 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f50580c4d10 0x7f505806ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:40.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.653+0000 7f5057577640 10 monclient: _finish_hunting 0 2026-02-17T21:26:40.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.653+0000 7f5057577640 1 monclient: found mon.noname-a 2026-02-17T21:26:40.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.653+0000 7f5057577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:40.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.653+0000 7f5057577640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:26:40.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.653+0000 7f5057577640 1 -- 10.20.193.5:0/784176130 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50581f3a90 con 0x7f50580c7170 2026-02-17T21:26:40.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.654+0000 7f5057577640 1 --2- 10.20.193.5:0/784176130 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f50580c7170 0x7f505806f240 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f504800cbc0 tx=0x7f504800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:40.673 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.654+0000 7f50377fe640 10 client.?.objecter ms_handle_connect 0x7f50580c7170 2026-02-17T21:26:40.673 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.654+0000 7f50377fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:26:40.673 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f50377fe640 1 -- 10.20.193.5:0/784176130 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048018070 con 0x7f50580c7170 2026-02-17T21:26:40.673 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f50377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:40.673 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f50377fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:26:40.673 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f50377fe640 10 monclient: dump: 2026-02-17T21:26:40.673 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:40.673 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:40.673 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:40.673 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:40.673 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:40.673 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:40.673 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:40.674 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:40.674 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:40.674 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:40.674 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f50377fe640 10 monclient: _finish_auth 0 2026-02-17T21:26:40.674 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f50377fe640 10 monclient: _check_auth_tickets 2026-02-17T21:26:40.674 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f50377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:40.674 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f505d23c640 5 monclient: authenticate success, global_id 4689 2026-02-17T21:26:40.674 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f505d23c640 10 monclient: _renew_subs 2026-02-17T21:26:40.674 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f505d23c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:40.674 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f505d23c640 1 -- 10.20.193.5:0/784176130 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50581f3d70 con 0x7f50580c7170 2026-02-17T21:26:40.674 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f505d23c640 10 client.4689.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:26:40.674 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f505d23c640 10 monclient: _renew_subs 2026-02-17T21:26:40.675 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f505d23c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:40.675 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f505d23c640 1 -- 10.20.193.5:0/784176130 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f505815cf10 con 0x7f50580c7170 2026-02-17T21:26:40.675 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f505d23c640 1 librados: init done 2026-02-17T21:26:40.675 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f505d23c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:40.675 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f505d23c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:40.675 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f505d23c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:40.675 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f505d23c640 1 -- 10.20.193.5:0/784176130 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50580c7550 con 0x7f50580c7170 2026-02-17T21:26:40.675 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f50377fe640 1 -- 10.20.193.5:0/784176130 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f504800acf0 con 0x7f50580c7170 2026-02-17T21:26:40.675 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f50377fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:40.675 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f50377fe640 1 -- 10.20.193.5:0/784176130 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048022060 con 0x7f50580c7170 2026-02-17T21:26:40.675 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f50377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:40.675 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f5055573640 4 set_mon_vals no callback set 2026-02-17T21:26:40.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f50377fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:26:40.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.655+0000 7f50377fe640 10 monclient: dump: 2026-02-17T21:26:40.676 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:40.676 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:40.676 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:40.676 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:40.676 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:40.676 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:40.676 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:40.676 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:40.676 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:40.676 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:40.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.760+0000 7f50377fe640 1 -- 10.20.193.5:0/784176130 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f5048025080 con 0x7f50580c7170 2026-02-17T21:26:40.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.760+0000 7f50377fe640 1 --2- 10.20.193.5:0/784176130 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f50240792b0 0x7f502407b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:40.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.760+0000 7f5056d76640 1 --2- 10.20.193.5:0/784176130 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f50240792b0 0x7f502407b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:40.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.760+0000 7f5056d76640 10 monclient: get_auth_request con 0x7f50240792b0 auth_method 0 2026-02-17T21:26:40.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.761+0000 7f5056d76640 1 --2- 10.20.193.5:0/784176130 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f50240792b0 0x7f502407b770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f504c039000 tx=0x7f504c033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:40.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.761+0000 7f50377fe640 10 client.4689.objecter ms_handle_connect 0x7f50240792b0 2026-02-17T21:26:40.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.767+0000 7f50377fe640 1 -- 10.20.193.5:0/784176130 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f504805e310 con 0x7f50580c7170 2026-02-17T21:26:40.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.767+0000 7f50377fe640 10 client.4689.objecter ms_dispatch2 0x7f5058000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:26:40.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.767+0000 7f50377fe640 3 client.4689.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:26:40.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.767+0000 7f50377fe640 3 client.4689.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:26:40.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.767+0000 7f50377fe640 20 client.4689.objecter dump_active .. 0 homeless 2026-02-17T21:26:40.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.767+0000 7f50377fe640 1 -- 10.20.193.5:0/784176130 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f50480622d0 con 0x7f50580c7170 2026-02-17T21:26:40.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.767+0000 7f50377fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:40.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.767+0000 7f50377fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:26:40.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.866+0000 7f505d23c640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:26:40.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.866+0000 7f505d23c640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:40.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.866+0000 7f505d23c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:40.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.866+0000 7f505d23c640 1 -- 10.20.193.5:0/784176130 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f505814e950 con 0x7f50580c7170 2026-02-17T21:26:40.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.869+0000 7f50377fe640 1 -- 10.20.193.5:0/784176130 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f50480665d0 con 0x7f50580c7170 2026-02-17T21:26:40.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.869+0000 7f50377fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:40.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.869+0000 7f50377fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:26:40.871 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:26:40.871 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:26:40.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.870+0000 7f505d23c640 10 librados: watch_flush enter 2026-02-17T21:26:40.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.870+0000 7f505d23c640 10 librados: watch_flush exit 2026-02-17T21:26:40.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.870+0000 7f505d23c640 20 client.4689.objecter shutdown clearing up homeless session... 2026-02-17T21:26:40.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.870+0000 7f505d23c640 10 client.4689.objecter successfully canceled tick 2026-02-17T21:26:40.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.870+0000 7f505d23c640 1 -- 10.20.193.5:0/784176130 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f50240792b0 msgr2=0x7f502407b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:40.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.870+0000 7f505d23c640 1 --2- 10.20.193.5:0/784176130 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f50240792b0 0x7f502407b770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f504c039000 tx=0x7f504c033000 comp rx=0 tx=0).stop 2026-02-17T21:26:40.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.870+0000 7f505d23c640 10 monclient: shutdown 2026-02-17T21:26:40.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.870+0000 7f505d23c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:40.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.870+0000 7f505d23c640 1 -- 10.20.193.5:0/784176130 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f50580c7170 msgr2=0x7f505806f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:40.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.870+0000 7f505d23c640 1 --2- 10.20.193.5:0/784176130 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f50580c7170 0x7f505806f240 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f504800cbc0 tx=0x7f504800a430 comp rx=0 tx=0).stop 2026-02-17T21:26:40.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.870+0000 7f505d23c640 1 -- 10.20.193.5:0/784176130 shutdown_connections 2026-02-17T21:26:40.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.870+0000 7f505d23c640 1 --2- 10.20.193.5:0/784176130 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f50240792b0 0x7f502407b770 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:40.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.870+0000 7f505d23c640 1 --2- 10.20.193.5:0/784176130 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f50580c7170 0x7f505806f240 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:40.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.870+0000 7f505d23c640 1 --2- 10.20.193.5:0/784176130 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f50580c4d10 0x7f505806ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:40.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.870+0000 7f505d23c640 1 --2- 10.20.193.5:0/784176130 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f50580c48c0 0x7f5058157fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:40.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.870+0000 7f505d23c640 1 -- 10.20.193.5:0/784176130 >> 10.20.193.5:0/784176130 conn(0x7f50580c9f40 msgr2=0x7f50580ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:40.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.870+0000 7f505d23c640 1 -- 10.20.193.5:0/784176130 shutdown_connections 2026-02-17T21:26:40.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.870+0000 7f505d23c640 1 -- 10.20.193.5:0/784176130 wait complete. 2026-02-17T21:26:40.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:40.870+0000 7f505d23c640 1 librados: shutdown 2026-02-17T21:26:43.881 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:26:43.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.948+0000 7f2707f3e640 10 monclient: get_monmap_and_config 2026-02-17T21:26:43.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.948+0000 7f2707f3e640 10 monclient: build_initial_monmap 2026-02-17T21:26:43.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.948+0000 7f2707f3e640 10 monclient: monmap: 2026-02-17T21:26:43.950 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:43.950 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:43.950 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:26:43.948884+0000 2026-02-17T21:26:43.950 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:26:43.948884+0000 2026-02-17T21:26:43.950 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:43.951 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:43.951 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:26:43.951 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:26:43.951 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:26:43.951 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:26:43.951 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:26:43.951 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:26:43.951 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:43.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.948+0000 7f2707f3e640 1 Processor -- start 2026-02-17T21:26:43.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.948+0000 7f2707f3e640 1 -- start start 2026-02-17T21:26:43.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.948+0000 7f2707f3e640 10 monclient: init 2026-02-17T21:26:43.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.949+0000 7f2707f3e640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:43.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.949+0000 7f2707f3e640 10 monclient: _add_conns ranks=[5,0,3,2,4,1] 2026-02-17T21:26:43.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.949+0000 7f2707f3e640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f27000ce5d0 0x7f27000d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:43.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.949+0000 7f2707f3e640 10 monclient(hunting): picked mon.noname-c con 0x7f27000ce5d0 addr v2:10.20.193.135:3300/0 2026-02-17T21:26:43.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.949+0000 7f2707f3e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f270015bf30 addr v1:10.20.193.5:6789/0 2026-02-17T21:26:43.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.949+0000 7f2707f3e640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f27000c9780 0x7f27000c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:43.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.949+0000 7f2707f3e640 10 monclient(hunting): picked mon.noname-a con 0x7f27000c9780 addr v2:10.20.193.5:3300/0 2026-02-17T21:26:43.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.949+0000 7f2707f3e640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27000d1e00 con 0x7f270015bf30 2026-02-17T21:26:43.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.949+0000 7f2707f3e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:43.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.949+0000 7f2707f3e640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f27000d20d0 con 0x7f27000c9780 2026-02-17T21:26:43.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.949+0000 7f2707f3e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:43.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.949+0000 7f2707f3e640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f27000d23b0 con 0x7f27000ce5d0 2026-02-17T21:26:43.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.949+0000 7f2707f3e640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:43.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.949+0000 7f2707f3e640 10 monclient(hunting): authenticate will time out at 1109.514327s 2026-02-17T21:26:43.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.949+0000 7f27064b4640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f27000c9780 0x7f27000c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:43.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.949+0000 7f2705cb3640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f27000ce5d0 0x7f27000d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:43.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.950+0000 7f2705cb3640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f27000ce5d0 0x7f27000d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:46410/0 (socket says 10.20.193.5:46410) 2026-02-17T21:26:43.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.950+0000 7f2705cb3640 1 -- 10.20.193.5:0/1867138636 learned_addr learned my addr 10.20.193.5:0/1867138636 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:26:43.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.950+0000 7f2705cb3640 10 monclient(hunting): get_auth_request con 0x7f27000ce5d0 auth_method 0 2026-02-17T21:26:43.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.950+0000 7f2705cb3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:43.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.950+0000 7f2705cb3640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:43.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.950+0000 7f2705cb3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:43.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.950+0000 7f27064b4640 10 monclient(hunting): get_auth_request con 0x7f27000c9780 auth_method 0 2026-02-17T21:26:43.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.950+0000 7f27064b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:43.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.950+0000 7f27064b4640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:43.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.950+0000 7f27064b4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:43.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.950+0000 7f2705cb3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:43.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.950+0000 7f2705cb3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:43.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.950+0000 7f2705cb3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:43.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.950+0000 7f27064b4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:43.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.950+0000 7f27064b4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:43.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.950+0000 7f27064b4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:43.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.951+0000 7f2705cb3640 10 monclient(hunting): handle_auth_done global_id 4736 payload 274 2026-02-17T21:26:43.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.951+0000 7f2705cb3640 1 -- 10.20.193.5:0/1867138636 >> v2:10.20.193.5:3300/0 conn(0x7f27000c9780 msgr2=0x7f27000c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:26:43.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.951+0000 7f2705cb3640 1 --2- 10.20.193.5:0/1867138636 >> v2:10.20.193.5:3300/0 conn(0x7f27000c9780 0x7f27000c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:43.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.951+0000 7f2705cb3640 1 -- 10.20.193.5:0/1867138636 >> v1:10.20.193.5:6789/0 conn(0x7f270015bf30 legacy=0x7f27000ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:43.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.951+0000 7f2705cb3640 10 monclient: _finish_hunting 0 2026-02-17T21:26:43.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.951+0000 7f2705cb3640 1 monclient: found mon.noname-c 2026-02-17T21:26:43.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.951+0000 7f2705cb3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:43.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.951+0000 7f2705cb3640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:26:43.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.951+0000 7f2705cb3640 1 -- 10.20.193.5:0/1867138636 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27000d2690 con 0x7f27000ce5d0 2026-02-17T21:26:43.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.952+0000 7f2705cb3640 1 --2- 10.20.193.5:0/1867138636 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f27000ce5d0 0x7f27000d18c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f27000cf4c0 tx=0x7f26f002eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7935f8e327f820d7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:43.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.953+0000 7f2704cb1640 1 -- 10.20.193.5:0/1867138636 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f003c070 con 0x7f27000ce5d0 2026-02-17T21:26:43.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.953+0000 7f2704cb1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:43.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.953+0000 7f2704cb1640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:26:43.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.953+0000 7f2704cb1640 10 monclient: dump: 2026-02-17T21:26:43.964 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:43.964 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:43.964 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:43.964 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:43.964 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:43.964 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:43.964 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:43.965 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:43.965 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:43.965 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:43.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.953+0000 7f2704cb1640 10 monclient: _finish_auth 0 2026-02-17T21:26:43.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.953+0000 7f2704cb1640 10 monclient: _check_auth_tickets 2026-02-17T21:26:43.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.953+0000 7f2704cb1640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:43.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.953+0000 7f2707f3e640 5 monclient: authenticate success, global_id 4736 2026-02-17T21:26:43.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.953+0000 7f2707f3e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:26:43.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.954+0000 7f2704cb1640 1 -- 10.20.193.5:0/1867138636 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f002fbe0 con 0x7f27000ce5d0 2026-02-17T21:26:43.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.954+0000 7f2704cb1640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:43.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.954+0000 7f2704cb1640 1 -- 10.20.193.5:0/1867138636 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f0037440 con 0x7f27000ce5d0 2026-02-17T21:26:43.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.954+0000 7f2704cb1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:43.966 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.954+0000 7f2704cb1640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:26:43.966 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.954+0000 7f2704cb1640 10 monclient: dump: 2026-02-17T21:26:43.966 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:43.966 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:43.966 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:43.966 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:43.966 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:43.966 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:43.966 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:43.966 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:43.966 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:43.966 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:43.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.954+0000 7f2707f3e640 10 monclient: get_monmap_and_config success 2026-02-17T21:26:43.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.954+0000 7f2707f3e640 4 set_mon_vals no callback set 2026-02-17T21:26:43.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.954+0000 7f2707f3e640 10 monclient: shutdown 2026-02-17T21:26:43.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.955+0000 7f2707f3e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:43.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.955+0000 7f2707f3e640 1 -- 10.20.193.5:0/1867138636 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f27000ce5d0 msgr2=0x7f27000d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:43.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.955+0000 7f2707f3e640 1 --2- 10.20.193.5:0/1867138636 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f27000ce5d0 0x7f27000d18c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f27000cf4c0 tx=0x7f26f002eed0 comp rx=0 tx=0).stop 2026-02-17T21:26:43.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.955+0000 7f2707f3e640 1 -- 10.20.193.5:0/1867138636 shutdown_connections 2026-02-17T21:26:43.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.955+0000 7f2707f3e640 1 --2- 10.20.193.5:0/1867138636 >> v2:10.20.193.5:3300/0 conn(0x7f27000c9780 0x7f27000c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:43.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.955+0000 7f2707f3e640 1 --2- 10.20.193.5:0/1867138636 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f27000ce5d0 0x7f27000d18c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:43.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.955+0000 7f2707f3e640 1 -- 10.20.193.5:0/1867138636 >> 10.20.193.5:0/1867138636 conn(0x7f2700073030 msgr2=0x7f2700073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:43.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.955+0000 7f2707f3e640 1 -- 10.20.193.5:0/1867138636 shutdown_connections 2026-02-17T21:26:43.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.955+0000 7f2707f3e640 1 -- 10.20.193.5:0/1867138636 wait complete. 2026-02-17T21:26:43.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.955+0000 7f2707f3e640 10 monclient: build_initial_monmap 2026-02-17T21:26:43.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.955+0000 7f2707f3e640 10 monclient: monmap: 2026-02-17T21:26:43.968 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:43.968 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:26:43.968 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:26:43.968 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:26:43.968 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:43.968 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:43.968 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:26:43.968 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:26:43.968 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:26:43.968 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:43.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.955+0000 7f2707f3e640 1 librados: starting msgr at 2026-02-17T21:26:43.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.955+0000 7f2707f3e640 1 librados: starting objecter 2026-02-17T21:26:43.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.955+0000 7f2707f3e640 1 Processor -- start 2026-02-17T21:26:43.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.955+0000 7f2707f3e640 1 -- start start 2026-02-17T21:26:43.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.955+0000 7f2707f3e640 1 librados: setting wanted keys 2026-02-17T21:26:43.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.955+0000 7f2707f3e640 1 librados: calling monclient init 2026-02-17T21:26:43.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.955+0000 7f2707f3e640 10 monclient: init 2026-02-17T21:26:43.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f2707f3e640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:43.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f2707f3e640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:26:43.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f2707f3e640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f27000c9780 0x7f270014a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:43.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f2707f3e640 10 monclient(hunting): picked mon.noname-c con 0x7f27000c9780 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:26:43.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f2707f3e640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f27000ce5d0 0x7f270015f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:43.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f2707f3e640 10 monclient(hunting): picked mon.noname-a con 0x7f27000ce5d0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:26:43.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f2707f3e640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f270015bf30 0x7f270015fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:43.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f2707f3e640 10 monclient(hunting): picked mon.noname-b con 0x7f270015bf30 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:26:43.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f2707f3e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:43.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f2707f3e640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f27000ca0d0 con 0x7f27000ce5d0 2026-02-17T21:26:43.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f2707f3e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:43.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f2707f3e640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f27000c9260 con 0x7f270015bf30 2026-02-17T21:26:43.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f2707f3e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:43.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f2707f3e640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f27000cbc30 con 0x7f27000c9780 2026-02-17T21:26:43.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f2707f3e640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:43.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f2707f3e640 10 monclient(hunting): authenticate will time out at 1109.521367s 2026-02-17T21:26:43.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f27054b2640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f27000ce5d0 0x7f270015f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:43.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f2705cb3640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f27000c9780 0x7f270014a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:43.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f27054b2640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f27000ce5d0 0x7f270015f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:49548/0 (socket says 10.20.193.5:49548) 2026-02-17T21:26:43.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f27054b2640 1 -- 10.20.193.5:0/271365108 learned_addr learned my addr 10.20.193.5:0/271365108 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:26:43.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f27054b2640 10 monclient(hunting): get_auth_request con 0x7f27000ce5d0 auth_method 0 2026-02-17T21:26:43.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f27054b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:43.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f27054b2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:43.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f27054b2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:43.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f27064b4640 1 --2- 10.20.193.5:0/271365108 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f270015bf30 0x7f270015fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:43.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f2705cb3640 10 monclient(hunting): get_auth_request con 0x7f27000c9780 auth_method 0 2026-02-17T21:26:43.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f2705cb3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:43.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f2705cb3640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:43.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.956+0000 7f2705cb3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:43.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.957+0000 7f27064b4640 10 monclient(hunting): get_auth_request con 0x7f270015bf30 auth_method 0 2026-02-17T21:26:43.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.957+0000 7f27064b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:43.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.957+0000 7f27064b4640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:43.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.957+0000 7f27064b4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:43.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.957+0000 7f27054b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:43.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.957+0000 7f27054b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:43.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.957+0000 7f27054b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:43.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.957+0000 7f2705cb3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:43.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.957+0000 7f2705cb3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:43.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.957+0000 7f2705cb3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:43.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.957+0000 7f27064b4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:43.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.957+0000 7f27064b4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:43.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.957+0000 7f27064b4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:43.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.958+0000 7f27054b2640 10 monclient(hunting): handle_auth_done global_id 4698 payload 824 2026-02-17T21:26:43.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.958+0000 7f27054b2640 1 -- 10.20.193.5:0/271365108 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f27000c9780 msgr2=0x7f270014a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:43.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.958+0000 7f27054b2640 1 --2- 10.20.193.5:0/271365108 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f27000c9780 0x7f270014a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:43.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.958+0000 7f27054b2640 1 -- 10.20.193.5:0/271365108 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f270015bf30 msgr2=0x7f270015fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:43.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.958+0000 7f27054b2640 1 --2- 10.20.193.5:0/271365108 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f270015bf30 0x7f270015fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:43.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.958+0000 7f27054b2640 10 monclient: _finish_hunting 0 2026-02-17T21:26:43.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.958+0000 7f27054b2640 1 monclient: found mon.noname-a 2026-02-17T21:26:43.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.958+0000 7f27054b2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:43.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.958+0000 7f27054b2640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:26:43.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.958+0000 7f27054b2640 1 -- 10.20.193.5:0/271365108 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27001f3c20 con 0x7f27000ce5d0 2026-02-17T21:26:43.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.959+0000 7f27054b2640 1 --2- 10.20.193.5:0/271365108 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f27000ce5d0 0x7f270015f510 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f26f400c580 tx=0x7f26f400ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:43.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.959+0000 7f26ee7fc640 10 client.?.objecter ms_handle_connect 0x7f27000ce5d0 2026-02-17T21:26:43.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.959+0000 7f26ee7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:26:43.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f26ee7fc640 1 -- 10.20.193.5:0/271365108 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f4017070 con 0x7f27000ce5d0 2026-02-17T21:26:43.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f26ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:43.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f26ee7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:26:43.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f26ee7fc640 10 monclient: dump: 2026-02-17T21:26:43.974 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:43.974 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:43.974 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:43.974 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:43.974 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:43.974 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:43.974 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:43.974 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:43.975 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:43.975 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:43.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f26ee7fc640 10 monclient: _finish_auth 0 2026-02-17T21:26:43.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f26ee7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:26:43.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f26ee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:43.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f26ee7fc640 1 -- 10.20.193.5:0/271365108 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f40052d0 con 0x7f27000ce5d0 2026-02-17T21:26:43.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f26ee7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:43.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f26ee7fc640 1 -- 10.20.193.5:0/271365108 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f40036b0 con 0x7f27000ce5d0 2026-02-17T21:26:43.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f26ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:43.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f26ee7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:26:43.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f26effff640 4 set_mon_vals no callback set 2026-02-17T21:26:43.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f26ee7fc640 10 monclient: dump: 2026-02-17T21:26:43.976 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:43.976 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:43.976 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:43.976 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:43.976 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:43.976 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:43.976 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:43.976 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:43.976 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:43.976 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:43.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f2707f3e640 5 monclient: authenticate success, global_id 4698 2026-02-17T21:26:43.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f2707f3e640 10 monclient: _renew_subs 2026-02-17T21:26:43.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f2707f3e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:43.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f2707f3e640 1 -- 10.20.193.5:0/271365108 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27001f3f00 con 0x7f27000ce5d0 2026-02-17T21:26:43.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f2707f3e640 10 client.4698.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:26:43.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f2707f3e640 10 monclient: _renew_subs 2026-02-17T21:26:43.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f2707f3e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:43.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f2707f3e640 1 -- 10.20.193.5:0/271365108 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f270015ed10 con 0x7f27000ce5d0 2026-02-17T21:26:43.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f2707f3e640 1 librados: init done 2026-02-17T21:26:43.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f2707f3e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:43.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f2707f3e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:43.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f2707f3e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:43.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.961+0000 7f2707f3e640 1 -- 10.20.193.5:0/271365108 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27000c9b90 con 0x7f27000ce5d0 2026-02-17T21:26:43.979 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.973+0000 7f26ee7fc640 1 -- 10.20.193.5:0/271365108 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f26f4003850 con 0x7f27000ce5d0 2026-02-17T21:26:43.979 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.974+0000 7f26ee7fc640 1 --2- 10.20.193.5:0/271365108 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f26d00792b0 0x7f26d007b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:43.979 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.974+0000 7f2705cb3640 1 --2- 10.20.193.5:0/271365108 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f26d00792b0 0x7f26d007b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:43.979 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.974+0000 7f2705cb3640 10 monclient: get_auth_request con 0x7f26d00792b0 auth_method 0 2026-02-17T21:26:43.979 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.975+0000 7f26ee7fc640 10 client.4698.objecter ms_handle_connect 0x7f26d00792b0 2026-02-17T21:26:43.979 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:43.975+0000 7f2705cb3640 1 --2- 10.20.193.5:0/271365108 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f26d00792b0 0x7f26d007b770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f270015d030 tx=0x7f26f0039040 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:44.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.007+0000 7f26ee7fc640 1 -- 10.20.193.5:0/271365108 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f26f405d7f0 con 0x7f27000ce5d0 2026-02-17T21:26:44.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.007+0000 7f26ee7fc640 10 client.4698.objecter ms_dispatch2 0x7f2700000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:26:44.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.007+0000 7f26ee7fc640 3 client.4698.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:26:44.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.007+0000 7f26ee7fc640 3 client.4698.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:26:44.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.007+0000 7f26ee7fc640 20 client.4698.objecter dump_active .. 0 homeless 2026-02-17T21:26:44.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.079+0000 7f26ee7fc640 1 -- 10.20.193.5:0/271365108 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f26f4021020 con 0x7f27000ce5d0 2026-02-17T21:26:44.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.079+0000 7f26ee7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:44.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.079+0000 7f26ee7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:26:44.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.177+0000 7f2707f3e640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:26:44.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.177+0000 7f2707f3e640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:44.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.177+0000 7f2707f3e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:44.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.177+0000 7f2707f3e640 1 -- 10.20.193.5:0/271365108 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2700152c10 con 0x7f27000ce5d0 2026-02-17T21:26:44.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.180+0000 7f26ee7fc640 1 -- 10.20.193.5:0/271365108 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f26f40617b0 con 0x7f27000ce5d0 2026-02-17T21:26:44.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.180+0000 7f26ee7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:44.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.180+0000 7f26ee7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:26:44.182 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:26:44.183 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:26:44.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.181+0000 7f2707f3e640 10 librados: watch_flush enter 2026-02-17T21:26:44.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.181+0000 7f2707f3e640 10 librados: watch_flush exit 2026-02-17T21:26:44.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.181+0000 7f2707f3e640 20 client.4698.objecter shutdown clearing up homeless session... 2026-02-17T21:26:44.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.181+0000 7f2707f3e640 10 client.4698.objecter successfully canceled tick 2026-02-17T21:26:44.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.181+0000 7f2707f3e640 1 -- 10.20.193.5:0/271365108 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f26d00792b0 msgr2=0x7f26d007b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:44.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.181+0000 7f2707f3e640 1 --2- 10.20.193.5:0/271365108 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f26d00792b0 0x7f26d007b770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f270015d030 tx=0x7f26f0039040 comp rx=0 tx=0).stop 2026-02-17T21:26:44.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.181+0000 7f2707f3e640 10 monclient: shutdown 2026-02-17T21:26:44.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.181+0000 7f2707f3e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:44.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.181+0000 7f2707f3e640 1 -- 10.20.193.5:0/271365108 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f27000ce5d0 msgr2=0x7f270015f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:44.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.181+0000 7f2707f3e640 1 --2- 10.20.193.5:0/271365108 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f27000ce5d0 0x7f270015f510 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f26f400c580 tx=0x7f26f400ca50 comp rx=0 tx=0).stop 2026-02-17T21:26:44.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.181+0000 7f2707f3e640 1 -- 10.20.193.5:0/271365108 shutdown_connections 2026-02-17T21:26:44.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.181+0000 7f2707f3e640 1 --2- 10.20.193.5:0/271365108 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f26d00792b0 0x7f26d007b770 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:44.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.181+0000 7f2707f3e640 1 --2- 10.20.193.5:0/271365108 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f270015bf30 0x7f270015fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:44.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.181+0000 7f2707f3e640 1 --2- 10.20.193.5:0/271365108 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f27000ce5d0 0x7f270015f510 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:44.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.181+0000 7f2707f3e640 1 --2- 10.20.193.5:0/271365108 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f27000c9780 0x7f270014a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:44.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.181+0000 7f2707f3e640 1 -- 10.20.193.5:0/271365108 >> 10.20.193.5:0/271365108 conn(0x7f2700073030 msgr2=0x7f2700154990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:44.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.181+0000 7f2707f3e640 1 -- 10.20.193.5:0/271365108 shutdown_connections 2026-02-17T21:26:44.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.181+0000 7f2707f3e640 1 -- 10.20.193.5:0/271365108 wait complete. 2026-02-17T21:26:44.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:44.181+0000 7f2707f3e640 1 librados: shutdown 2026-02-17T21:26:47.192 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:26:47.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.259+0000 7fbbe34f1640 10 monclient: get_monmap_and_config 2026-02-17T21:26:47.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.259+0000 7fbbe34f1640 10 monclient: build_initial_monmap 2026-02-17T21:26:47.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.259+0000 7fbbe34f1640 10 monclient: monmap: 2026-02-17T21:26:47.262 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:47.262 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:47.262 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:26:47.261152+0000 2026-02-17T21:26:47.262 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:26:47.261152+0000 2026-02-17T21:26:47.262 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:47.263 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:47.263 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:26:47.263 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:26:47.263 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:26:47.263 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:26:47.263 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:26:47.263 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:26:47.263 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:47.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.259+0000 7fbbe34f1640 1 Processor -- start 2026-02-17T21:26:47.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.259+0000 7fbbe34f1640 1 -- start start 2026-02-17T21:26:47.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.259+0000 7fbbe34f1640 10 monclient: init 2026-02-17T21:26:47.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.260+0000 7fbbe34f1640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:47.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.260+0000 7fbbe34f1640 10 monclient: _add_conns ranks=[0,3,5,4,2,1] 2026-02-17T21:26:47.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.260+0000 7fbbe34f1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbbdc0c7170 addr v1:10.20.193.5:6789/0 2026-02-17T21:26:47.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.260+0000 7fbbe34f1640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fbbdc0c7550 0x7fbbdc0749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:47.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.260+0000 7fbbe34f1640 10 monclient(hunting): picked mon.noname-a con 0x7fbbdc0c7550 addr v2:10.20.193.5:3300/0 2026-02-17T21:26:47.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.260+0000 7fbbe34f1640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fbbdc074ef0 0x7fbbdc0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:47.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.260+0000 7fbbe34f1640 10 monclient(hunting): picked mon.noname-c con 0x7fbbdc074ef0 addr v2:10.20.193.135:3300/0 2026-02-17T21:26:47.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.260+0000 7fbbe34f1640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbdc0c4fd0 con 0x7fbbdc0c7170 2026-02-17T21:26:47.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.260+0000 7fbbe34f1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:47.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.260+0000 7fbbe34f1640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fbbdc0c8530 con 0x7fbbdc0c7550 2026-02-17T21:26:47.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.260+0000 7fbbe34f1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:47.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.260+0000 7fbbe34f1640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fbbdc15a9a0 con 0x7fbbdc074ef0 2026-02-17T21:26:47.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.260+0000 7fbbe34f1640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:47.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.260+0000 7fbbe34f1640 10 monclient(hunting): authenticate will time out at 1112.826470s 2026-02-17T21:26:47.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.260+0000 7fbbe0a65640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fbbdc0c7550 0x7fbbdc0749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:47.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.261+0000 7fbbe1a67640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fbbdc074ef0 0x7fbbdc0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:47.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.261+0000 7fbbe1266640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7fbbdc0c7170 0x7fbbdc0c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:49612/0 (socket says 10.20.193.5:49612) 2026-02-17T21:26:47.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.261+0000 7fbbe1266640 1 -- 10.20.193.5:0/3819259186 learned_addr learned my addr 10.20.193.5:0/3819259186 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:26:47.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.261+0000 7fbbe0a65640 10 monclient(hunting): get_auth_request con 0x7fbbdc0c7550 auth_method 0 2026-02-17T21:26:47.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.261+0000 7fbbe0a65640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:47.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.261+0000 7fbbe0a65640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:47.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.261+0000 7fbbe0a65640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:47.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.261+0000 7fbbe1a67640 10 monclient(hunting): get_auth_request con 0x7fbbdc074ef0 auth_method 0 2026-02-17T21:26:47.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.261+0000 7fbbe1a67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:47.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.261+0000 7fbbe1a67640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:47.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.261+0000 7fbbe1a67640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:47.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.261+0000 7fbbe1a67640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:47.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.261+0000 7fbbe1a67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:47.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.261+0000 7fbbe1a67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:47.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.261+0000 7fbbe0a65640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:47.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.261+0000 7fbbe0a65640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:47.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.261+0000 7fbbe0a65640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:47.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.263+0000 7fbbe1a67640 10 monclient(hunting): handle_auth_done global_id 4742 payload 274 2026-02-17T21:26:47.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.263+0000 7fbbe1a67640 1 -- 10.20.193.5:0/3819259186 >> v2:10.20.193.5:3300/0 conn(0x7fbbdc0c7550 msgr2=0x7fbbdc0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:26:47.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.263+0000 7fbbe1a67640 1 --2- 10.20.193.5:0/3819259186 >> v2:10.20.193.5:3300/0 conn(0x7fbbdc0c7550 0x7fbbdc0749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:47.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.263+0000 7fbbe1a67640 1 -- 10.20.193.5:0/3819259186 >> v1:10.20.193.5:6789/0 conn(0x7fbbdc0c7170 legacy=0x7fbbdc0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:47.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.263+0000 7fbbe1a67640 10 monclient: _finish_hunting 0 2026-02-17T21:26:47.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.263+0000 7fbbe1a67640 1 monclient: found mon.noname-c 2026-02-17T21:26:47.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.263+0000 7fbbe1a67640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:47.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.263+0000 7fbbe1a67640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:26:47.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.263+0000 7fbbe1a67640 1 -- 10.20.193.5:0/3819259186 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbdc0c5270 con 0x7fbbdc074ef0 2026-02-17T21:26:47.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.264+0000 7fbbe1a67640 1 --2- 10.20.193.5:0/3819259186 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbbdc074ef0 0x7fbbdc0c89c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0c84a0 tx=0x7fbbd802f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=208820888fffe5a0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:47.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.265+0000 7fbbcbfff640 1 -- 10.20.193.5:0/3819259186 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd803c070 con 0x7fbbdc074ef0 2026-02-17T21:26:47.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.265+0000 7fbbcbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:47.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.265+0000 7fbbcbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:26:47.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.265+0000 7fbbcbfff640 10 monclient: dump: 2026-02-17T21:26:47.276 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:47.277 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:47.277 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:47.277 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:47.277 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:47.277 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:47.277 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:47.277 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:47.277 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:47.277 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:47.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.265+0000 7fbbcbfff640 10 monclient: _finish_auth 0 2026-02-17T21:26:47.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.265+0000 7fbbcbfff640 10 monclient: _check_auth_tickets 2026-02-17T21:26:47.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.265+0000 7fbbcbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:47.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.265+0000 7fbbe34f1640 5 monclient: authenticate success, global_id 4742 2026-02-17T21:26:47.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.265+0000 7fbbe34f1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:26:47.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.266+0000 7fbbcbfff640 1 -- 10.20.193.5:0/3819259186 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbd8037440 con 0x7fbbdc074ef0 2026-02-17T21:26:47.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.266+0000 7fbbcbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:47.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.266+0000 7fbbcbfff640 1 -- 10.20.193.5:0/3819259186 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8037810 con 0x7fbbdc074ef0 2026-02-17T21:26:47.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.266+0000 7fbbe34f1640 10 monclient: get_monmap_and_config success 2026-02-17T21:26:47.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.266+0000 7fbbe34f1640 4 set_mon_vals no callback set 2026-02-17T21:26:47.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.266+0000 7fbbcbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:47.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.266+0000 7fbbcbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:26:47.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.266+0000 7fbbcbfff640 10 monclient: dump: 2026-02-17T21:26:47.278 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:47.278 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:47.278 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:47.278 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:47.278 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:47.279 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:47.279 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:47.279 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:47.279 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:47.279 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:47.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.266+0000 7fbbe34f1640 10 monclient: shutdown 2026-02-17T21:26:47.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.266+0000 7fbbe34f1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:47.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.266+0000 7fbbe34f1640 1 -- 10.20.193.5:0/3819259186 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbbdc074ef0 msgr2=0x7fbbdc0c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:47.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.266+0000 7fbbe34f1640 1 --2- 10.20.193.5:0/3819259186 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbbdc074ef0 0x7fbbdc0c89c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0c84a0 tx=0x7fbbd802f1c0 comp rx=0 tx=0).stop 2026-02-17T21:26:47.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.266+0000 7fbbe34f1640 1 -- 10.20.193.5:0/3819259186 shutdown_connections 2026-02-17T21:26:47.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.266+0000 7fbbe34f1640 1 --2- 10.20.193.5:0/3819259186 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbbdc074ef0 0x7fbbdc0c89c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:47.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.266+0000 7fbbe34f1640 1 --2- 10.20.193.5:0/3819259186 >> v2:10.20.193.5:3300/0 conn(0x7fbbdc0c7550 0x7fbbdc0749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:47.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.266+0000 7fbbe34f1640 1 -- 10.20.193.5:0/3819259186 >> 10.20.193.5:0/3819259186 conn(0x7fbbdc0c9f40 msgr2=0x7fbbdc0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:47.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.266+0000 7fbbe34f1640 1 -- 10.20.193.5:0/3819259186 shutdown_connections 2026-02-17T21:26:47.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.266+0000 7fbbe34f1640 1 -- 10.20.193.5:0/3819259186 wait complete. 2026-02-17T21:26:47.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.267+0000 7fbbe34f1640 10 monclient: build_initial_monmap 2026-02-17T21:26:47.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.267+0000 7fbbe34f1640 10 monclient: monmap: 2026-02-17T21:26:47.280 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:47.280 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:26:47.280 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:26:47.280 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:26:47.280 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:47.280 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:47.280 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:26:47.280 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:26:47.280 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:26:47.280 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:47.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.267+0000 7fbbe34f1640 1 librados: starting msgr at 2026-02-17T21:26:47.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.267+0000 7fbbe34f1640 1 librados: starting objecter 2026-02-17T21:26:47.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.267+0000 7fbbe34f1640 1 Processor -- start 2026-02-17T21:26:47.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.267+0000 7fbbe34f1640 1 -- start start 2026-02-17T21:26:47.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.267+0000 7fbbe34f1640 1 librados: setting wanted keys 2026-02-17T21:26:47.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.267+0000 7fbbe34f1640 1 librados: calling monclient init 2026-02-17T21:26:47.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.267+0000 7fbbe34f1640 10 monclient: init 2026-02-17T21:26:47.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.267+0000 7fbbe34f1640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:47.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.267+0000 7fbbe34f1640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:26:47.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.267+0000 7fbbe34f1640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbbdc074ef0 0x7fbbdc0bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:47.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.267+0000 7fbbe34f1640 10 monclient(hunting): picked mon.noname-c con 0x7fbbdc074ef0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:26:47.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.267+0000 7fbbe34f1640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbbdc0c7170 0x7fbbdc1f45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:47.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.267+0000 7fbbe34f1640 10 monclient(hunting): picked mon.noname-a con 0x7fbbdc0c7170 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:26:47.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.267+0000 7fbbe34f1640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbbdc0c7550 0x7fbbdc156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:47.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.267+0000 7fbbe34f1640 10 monclient(hunting): picked mon.noname-b con 0x7fbbdc0c7550 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:26:47.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.267+0000 7fbbe34f1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:47.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.267+0000 7fbbe34f1640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbbdc0c7ee0 con 0x7fbbdc0c7170 2026-02-17T21:26:47.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.267+0000 7fbbe34f1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:47.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.267+0000 7fbbe34f1640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbbdc0c5830 con 0x7fbbdc0c7550 2026-02-17T21:26:47.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.267+0000 7fbbe34f1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:47.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.267+0000 7fbbe34f1640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbbdc0c81c0 con 0x7fbbdc074ef0 2026-02-17T21:26:47.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.267+0000 7fbbe34f1640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:47.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.267+0000 7fbbe34f1640 10 monclient(hunting): authenticate will time out at 1112.833832s 2026-02-17T21:26:47.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe0a65640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbbdc0c7170 0x7fbbdc1f45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:47.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe1266640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbbdc074ef0 0x7fbbdc0bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:47.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe1266640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbbdc074ef0 0x7fbbdc0bfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:37168/0 (socket says 10.20.193.5:37168) 2026-02-17T21:26:47.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe1266640 1 -- 10.20.193.5:0/1014067116 learned_addr learned my addr 10.20.193.5:0/1014067116 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:26:47.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe1266640 10 monclient(hunting): get_auth_request con 0x7fbbdc074ef0 auth_method 0 2026-02-17T21:26:47.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe1266640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:47.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe1266640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:47.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe1266640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:47.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe0a65640 10 monclient(hunting): get_auth_request con 0x7fbbdc0c7170 auth_method 0 2026-02-17T21:26:47.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe0a65640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:47.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe0a65640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:47.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe0a65640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:47.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe1a67640 1 --2- 10.20.193.5:0/1014067116 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbbdc0c7550 0x7fbbdc156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:47.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe1a67640 10 monclient(hunting): get_auth_request con 0x7fbbdc0c7550 auth_method 0 2026-02-17T21:26:47.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe1a67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:47.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe1a67640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:47.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe1a67640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:47.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe0a65640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:47.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe0a65640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:47.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe0a65640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:47.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe1266640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:47.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe1266640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:47.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe1266640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:47.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe1a67640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:47.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe1a67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:47.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.268+0000 7fbbe1a67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:47.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.269+0000 7fbbe0a65640 10 monclient(hunting): handle_auth_done global_id 4707 payload 824 2026-02-17T21:26:47.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.269+0000 7fbbe0a65640 1 -- 10.20.193.5:0/1014067116 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbbdc074ef0 msgr2=0x7fbbdc0bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:47.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.269+0000 7fbbe0a65640 1 --2- 10.20.193.5:0/1014067116 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbbdc074ef0 0x7fbbdc0bfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:47.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.269+0000 7fbbe0a65640 1 -- 10.20.193.5:0/1014067116 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbbdc0c7550 msgr2=0x7fbbdc156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:47.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.269+0000 7fbbe0a65640 1 --2- 10.20.193.5:0/1014067116 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbbdc0c7550 0x7fbbdc156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:47.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.269+0000 7fbbe0a65640 10 monclient: _finish_hunting 0 2026-02-17T21:26:47.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.269+0000 7fbbe0a65640 1 monclient: found mon.noname-a 2026-02-17T21:26:47.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.269+0000 7fbbe0a65640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:47.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.269+0000 7fbbe0a65640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:26:47.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.269+0000 7fbbe0a65640 1 -- 10.20.193.5:0/1014067116 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbdc14c120 con 0x7fbbdc0c7170 2026-02-17T21:26:47.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.270+0000 7fbbe0a65640 1 --2- 10.20.193.5:0/1014067116 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbbdc0c7170 0x7fbbdc1f45b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000e9b0 tx=0x7fbbd000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:47.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.270+0000 7fbbc9ffb640 10 client.?.objecter ms_handle_connect 0x7fbbdc0c7170 2026-02-17T21:26:47.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.270+0000 7fbbc9ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:26:47.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.272+0000 7fbbc9ffb640 1 -- 10.20.193.5:0/1014067116 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0017070 con 0x7fbbdc0c7170 2026-02-17T21:26:47.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.272+0000 7fbbc9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:47.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.272+0000 7fbbc9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:26:47.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.272+0000 7fbbc9ffb640 10 monclient: dump: 2026-02-17T21:26:47.285 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:47.285 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:47.285 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:47.285 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:47.285 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:47.285 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:47.285 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:47.285 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:47.285 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:47.285 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:47.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.272+0000 7fbbc9ffb640 10 monclient: _finish_auth 0 2026-02-17T21:26:47.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.272+0000 7fbbc9ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:26:47.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.272+0000 7fbbc9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:47.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.272+0000 7fbbc9ffb640 1 -- 10.20.193.5:0/1014067116 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbd000ca00 con 0x7fbbdc0c7170 2026-02-17T21:26:47.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.272+0000 7fbbe34f1640 5 monclient: authenticate success, global_id 4707 2026-02-17T21:26:47.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.272+0000 7fbbe34f1640 10 monclient: _renew_subs 2026-02-17T21:26:47.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.272+0000 7fbbe34f1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:47.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.272+0000 7fbbe34f1640 1 -- 10.20.193.5:0/1014067116 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbdc14b080 con 0x7fbbdc0c7170 2026-02-17T21:26:47.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.272+0000 7fbbc9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:47.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.272+0000 7fbbc9ffb640 1 -- 10.20.193.5:0/1014067116 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd000cdf0 con 0x7fbbdc0c7170 2026-02-17T21:26:47.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.272+0000 7fbbc9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:47.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.272+0000 7fbbc9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:26:47.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.272+0000 7fbbcb7fe640 4 set_mon_vals no callback set 2026-02-17T21:26:47.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.272+0000 7fbbc9ffb640 10 monclient: dump: 2026-02-17T21:26:47.286 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:47.286 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:47.286 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:47.286 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:47.286 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:47.287 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:47.287 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:47.287 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:47.287 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:47.287 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:47.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.272+0000 7fbbe34f1640 10 client.4707.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:26:47.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.272+0000 7fbbe34f1640 10 monclient: _renew_subs 2026-02-17T21:26:47.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.272+0000 7fbbe34f1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:47.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.272+0000 7fbbe34f1640 1 -- 10.20.193.5:0/1014067116 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbdc14b640 con 0x7fbbdc0c7170 2026-02-17T21:26:47.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.272+0000 7fbbe34f1640 1 librados: init done 2026-02-17T21:26:47.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.273+0000 7fbbe34f1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:47.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.273+0000 7fbbe34f1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:47.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.273+0000 7fbbe34f1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:47.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.273+0000 7fbbe34f1640 1 -- 10.20.193.5:0/1014067116 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbdc0ca850 con 0x7fbbdc0c7170 2026-02-17T21:26:47.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.285+0000 7fbbc9ffb640 1 -- 10.20.193.5:0/1014067116 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fbbd0024060 con 0x7fbbdc0c7170 2026-02-17T21:26:47.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.285+0000 7fbbc9ffb640 1 --2- 10.20.193.5:0/1014067116 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbbac0792d0 0x7fbbac07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:47.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.285+0000 7fbbe1266640 1 --2- 10.20.193.5:0/1014067116 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbbac0792d0 0x7fbbac07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:47.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.285+0000 7fbbe1266640 10 monclient: get_auth_request con 0x7fbbac0792d0 auth_method 0 2026-02-17T21:26:47.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.286+0000 7fbbe1266640 1 --2- 10.20.193.5:0/1014067116 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbbac0792d0 0x7fbbac07b790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc006f60 tx=0x7fbbcc0029b0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:47.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.286+0000 7fbbc9ffb640 10 client.4707.objecter ms_handle_connect 0x7fbbac0792d0 2026-02-17T21:26:47.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.287+0000 7fbbc9ffb640 1 -- 10.20.193.5:0/1014067116 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fbbd005e110 con 0x7fbbdc0c7170 2026-02-17T21:26:47.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.287+0000 7fbbc9ffb640 10 client.4707.objecter ms_dispatch2 0x7fbbdc000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:26:47.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.287+0000 7fbbc9ffb640 3 client.4707.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:26:47.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.287+0000 7fbbc9ffb640 3 client.4707.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:26:47.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.287+0000 7fbbc9ffb640 20 client.4707.objecter dump_active .. 0 homeless 2026-02-17T21:26:47.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.386+0000 7fbbc9ffb640 1 -- 10.20.193.5:0/1014067116 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbbdc0ca850 con 0x7fbbdc0c7170 2026-02-17T21:26:47.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.386+0000 7fbbc9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:47.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.386+0000 7fbbc9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:26:47.491 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.489+0000 7fbbe34f1640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:26:47.492 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.489+0000 7fbbe34f1640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:47.492 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.489+0000 7fbbe34f1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:47.492 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.489+0000 7fbbe34f1640 1 -- 10.20.193.5:0/1014067116 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbbdc0749b0 con 0x7fbbdc0c7170 2026-02-17T21:26:47.494 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.492+0000 7fbbc9ffb640 1 -- 10.20.193.5:0/1014067116 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fbbd00620d0 con 0x7fbbdc0c7170 2026-02-17T21:26:47.494 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.492+0000 7fbbc9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:47.494 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.492+0000 7fbbc9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:26:47.495 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:26:47.495 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:26:47.496 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.493+0000 7fbbe34f1640 10 librados: watch_flush enter 2026-02-17T21:26:47.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.493+0000 7fbbe34f1640 10 librados: watch_flush exit 2026-02-17T21:26:47.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.493+0000 7fbbe34f1640 20 client.4707.objecter shutdown clearing up homeless session... 2026-02-17T21:26:47.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.493+0000 7fbbe34f1640 10 client.4707.objecter successfully canceled tick 2026-02-17T21:26:47.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.493+0000 7fbbe34f1640 1 -- 10.20.193.5:0/1014067116 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbbac0792d0 msgr2=0x7fbbac07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:47.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.493+0000 7fbbe34f1640 1 --2- 10.20.193.5:0/1014067116 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbbac0792d0 0x7fbbac07b790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc006f60 tx=0x7fbbcc0029b0 comp rx=0 tx=0).stop 2026-02-17T21:26:47.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.493+0000 7fbbe34f1640 10 monclient: shutdown 2026-02-17T21:26:47.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.493+0000 7fbbe34f1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:47.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.493+0000 7fbbe34f1640 1 -- 10.20.193.5:0/1014067116 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbbdc0c7170 msgr2=0x7fbbdc1f45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:47.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.493+0000 7fbbe34f1640 1 --2- 10.20.193.5:0/1014067116 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbbdc0c7170 0x7fbbdc1f45b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000e9b0 tx=0x7fbbd000ee80 comp rx=0 tx=0).stop 2026-02-17T21:26:47.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.493+0000 7fbbe34f1640 1 -- 10.20.193.5:0/1014067116 shutdown_connections 2026-02-17T21:26:47.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.493+0000 7fbbe34f1640 1 --2- 10.20.193.5:0/1014067116 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbbac0792d0 0x7fbbac07b790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:47.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.493+0000 7fbbe34f1640 1 --2- 10.20.193.5:0/1014067116 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbbdc0c7550 0x7fbbdc156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:47.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.493+0000 7fbbe34f1640 1 --2- 10.20.193.5:0/1014067116 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbbdc0c7170 0x7fbbdc1f45b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:47.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.493+0000 7fbbe34f1640 1 --2- 10.20.193.5:0/1014067116 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbbdc074ef0 0x7fbbdc0bfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:47.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.493+0000 7fbbe34f1640 1 -- 10.20.193.5:0/1014067116 >> 10.20.193.5:0/1014067116 conn(0x7fbbdc0c9f40 msgr2=0x7fbbdc0cb310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:47.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.493+0000 7fbbe34f1640 1 -- 10.20.193.5:0/1014067116 shutdown_connections 2026-02-17T21:26:47.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.493+0000 7fbbe34f1640 1 -- 10.20.193.5:0/1014067116 wait complete. 2026-02-17T21:26:47.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:47.493+0000 7fbbe34f1640 1 librados: shutdown 2026-02-17T21:26:50.506 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:26:50.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.571+0000 7f64bd2bd640 10 monclient: get_monmap_and_config 2026-02-17T21:26:50.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.571+0000 7f64bd2bd640 10 monclient: build_initial_monmap 2026-02-17T21:26:50.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.571+0000 7f64bd2bd640 10 monclient: monmap: 2026-02-17T21:26:50.575 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:50.575 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:50.575 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:26:50.573556+0000 2026-02-17T21:26:50.575 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:26:50.573556+0000 2026-02-17T21:26:50.575 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:50.575 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:50.575 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:26:50.576 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:26:50.576 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:26:50.576 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:26:50.576 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:26:50.576 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:26:50.576 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:50.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.572+0000 7f64bd2bd640 1 Processor -- start 2026-02-17T21:26:50.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.572+0000 7f64bd2bd640 1 -- start start 2026-02-17T21:26:50.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.572+0000 7f64bd2bd640 10 monclient: init 2026-02-17T21:26:50.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.572+0000 7f64bd2bd640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:50.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.573+0000 7f64bd2bd640 10 monclient: _add_conns ranks=[2,5,3,0,1,4] 2026-02-17T21:26:50.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.573+0000 7f64bd2bd640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f64b80c7170 addr v1:10.20.193.135:6789/0 2026-02-17T21:26:50.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.573+0000 7f64bd2bd640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f64b80c7550 0x7f64b80749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:50.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.573+0000 7f64bd2bd640 10 monclient(hunting): picked mon.noname-c con 0x7f64b80c7550 addr v2:10.20.193.135:3300/0 2026-02-17T21:26:50.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.573+0000 7f64bd2bd640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f64b8074ef0 0x7f64b80c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:50.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.573+0000 7f64bd2bd640 10 monclient(hunting): picked mon.noname-a con 0x7f64b8074ef0 addr v2:10.20.193.5:3300/0 2026-02-17T21:26:50.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.573+0000 7f64bd2bd640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64b80c4fd0 con 0x7f64b80c7170 2026-02-17T21:26:50.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.573+0000 7f64bd2bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:50.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.573+0000 7f64bd2bd640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f64b80c8530 con 0x7f64b8074ef0 2026-02-17T21:26:50.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.573+0000 7f64bd2bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:50.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.573+0000 7f64bd2bd640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f64b815a9a0 con 0x7f64b80c7550 2026-02-17T21:26:50.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.573+0000 7f64bd2bd640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:50.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.573+0000 7f64bd2bd640 10 monclient(hunting): authenticate will time out at 1116.139071s 2026-02-17T21:26:50.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.573+0000 7f64b77fe640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f64b8074ef0 0x7f64b80c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:50.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.573+0000 7f64b77fe640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f64b8074ef0 0x7f64b80c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:50650/0 (socket says 10.20.193.5:50650) 2026-02-17T21:26:50.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.573+0000 7f64b77fe640 1 -- 10.20.193.5:0/1447786446 learned_addr learned my addr 10.20.193.5:0/1447786446 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:26:50.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.573+0000 7f64b77fe640 10 monclient(hunting): get_auth_request con 0x7f64b8074ef0 auth_method 0 2026-02-17T21:26:50.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.573+0000 7f64b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:50.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.573+0000 7f64b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:50.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.573+0000 7f64b77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:50.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.573+0000 7f64b77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:50.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.573+0000 7f64b77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:50.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.573+0000 7f64b77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:50.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.574+0000 7f64b67fc640 1 --2- 10.20.193.5:0/1447786446 >> v2:10.20.193.135:3300/0 conn(0x7f64b80c7550 0x7f64b80749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:50.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.574+0000 7f64b67fc640 10 monclient(hunting): get_auth_request con 0x7f64b80c7550 auth_method 0 2026-02-17T21:26:50.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.574+0000 7f64b67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:50.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.574+0000 7f64b67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:50.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.574+0000 7f64b67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:50.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.574+0000 7f64b77fe640 10 monclient(hunting): handle_auth_done global_id 4710 payload 274 2026-02-17T21:26:50.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.574+0000 7f64b77fe640 1 -- 10.20.193.5:0/1447786446 >> v2:10.20.193.135:3300/0 conn(0x7f64b80c7550 msgr2=0x7f64b80749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:26:50.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.574+0000 7f64b77fe640 1 --2- 10.20.193.5:0/1447786446 >> v2:10.20.193.135:3300/0 conn(0x7f64b80c7550 0x7f64b80749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:50.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.574+0000 7f64b77fe640 1 -- 10.20.193.5:0/1447786446 >> v1:10.20.193.135:6789/0 conn(0x7f64b80c7170 legacy=0x7f64b80c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:50.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.574+0000 7f64b77fe640 10 monclient: _finish_hunting 0 2026-02-17T21:26:50.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.574+0000 7f64b77fe640 1 monclient: found mon.noname-a 2026-02-17T21:26:50.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.574+0000 7f64b77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:50.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.574+0000 7f64b77fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:26:50.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.574+0000 7f64b77fe640 1 -- 10.20.193.5:0/1447786446 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b80c5270 con 0x7f64b8074ef0 2026-02-17T21:26:50.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.576+0000 7f64b77fe640 1 --2- 10.20.193.5:0/1447786446 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f64b8074ef0 0x7f64b80c89c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f64b80c6e90 tx=0x7f64a802f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb87c6b29021c76 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:50.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64b5ffb640 1 -- 10.20.193.5:0/1447786446 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a802fd70 con 0x7f64b8074ef0 2026-02-17T21:26:50.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:50.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64b5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:26:50.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64b5ffb640 10 monclient: dump: 2026-02-17T21:26:50.590 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:50.590 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:50.590 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:50.590 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:50.590 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:50.590 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:50.590 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:50.590 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:50.590 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:50.590 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:50.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64b5ffb640 10 monclient: _finish_auth 0 2026-02-17T21:26:50.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64b5ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:26:50.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64b5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:50.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64b5ffb640 1 -- 10.20.193.5:0/1447786446 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a80373f0 con 0x7f64b8074ef0 2026-02-17T21:26:50.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64b5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:50.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64b5ffb640 1 -- 10.20.193.5:0/1447786446 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a80377c0 con 0x7f64b8074ef0 2026-02-17T21:26:50.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64bd2bd640 5 monclient: authenticate success, global_id 4710 2026-02-17T21:26:50.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64bd2bd640 10 monclient: get_monmap_and_config success 2026-02-17T21:26:50.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64bd2bd640 4 set_mon_vals no callback set 2026-02-17T21:26:50.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:50.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64b5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:26:50.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64b5ffb640 10 monclient: dump: 2026-02-17T21:26:50.591 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:50.591 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:50.592 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:50.592 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:50.592 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:50.592 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:50.592 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:50.592 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:50.592 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:50.592 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:50.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64bd2bd640 10 monclient: shutdown 2026-02-17T21:26:50.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64bd2bd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:50.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64bd2bd640 1 -- 10.20.193.5:0/1447786446 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f64b8074ef0 msgr2=0x7f64b80c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:50.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64bd2bd640 1 --2- 10.20.193.5:0/1447786446 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f64b8074ef0 0x7f64b80c89c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f64b80c6e90 tx=0x7f64a802f270 comp rx=0 tx=0).stop 2026-02-17T21:26:50.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64bd2bd640 1 -- 10.20.193.5:0/1447786446 shutdown_connections 2026-02-17T21:26:50.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64bd2bd640 1 --2- 10.20.193.5:0/1447786446 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f64b8074ef0 0x7f64b80c89c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:50.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64bd2bd640 1 --2- 10.20.193.5:0/1447786446 >> v2:10.20.193.135:3300/0 conn(0x7f64b80c7550 0x7f64b80749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:50.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64bd2bd640 1 -- 10.20.193.5:0/1447786446 >> 10.20.193.5:0/1447786446 conn(0x7f64b80c9f40 msgr2=0x7f64b80ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:50.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64bd2bd640 1 -- 10.20.193.5:0/1447786446 shutdown_connections 2026-02-17T21:26:50.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.578+0000 7f64bd2bd640 1 -- 10.20.193.5:0/1447786446 wait complete. 2026-02-17T21:26:50.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.579+0000 7f64bd2bd640 10 monclient: build_initial_monmap 2026-02-17T21:26:50.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.579+0000 7f64bd2bd640 10 monclient: monmap: 2026-02-17T21:26:50.593 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:50.593 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:26:50.593 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:26:50.593 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:26:50.594 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:50.594 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:50.594 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:26:50.594 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:26:50.594 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:26:50.594 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:50.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.579+0000 7f64bd2bd640 1 librados: starting msgr at 2026-02-17T21:26:50.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.579+0000 7f64bd2bd640 1 librados: starting objecter 2026-02-17T21:26:50.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.579+0000 7f64bd2bd640 1 Processor -- start 2026-02-17T21:26:50.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.579+0000 7f64bd2bd640 1 -- start start 2026-02-17T21:26:50.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.579+0000 7f64bd2bd640 1 librados: setting wanted keys 2026-02-17T21:26:50.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.579+0000 7f64bd2bd640 1 librados: calling monclient init 2026-02-17T21:26:50.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.579+0000 7f64bd2bd640 10 monclient: init 2026-02-17T21:26:50.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64bd2bd640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:50.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64bd2bd640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:26:50.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64bd2bd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f64b8074ef0 0x7f64b8155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:50.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64bd2bd640 10 monclient(hunting): picked mon.noname-c con 0x7f64b8074ef0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:26:50.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64bd2bd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f64b80c7170 0x7f64b80ba300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:50.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64bd2bd640 10 monclient(hunting): picked mon.noname-a con 0x7f64b80c7170 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:26:50.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64bd2bd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f64b80c7550 0x7f64b81f2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:50.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64bd2bd640 10 monclient(hunting): picked mon.noname-b con 0x7f64b80c7550 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:26:50.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64bd2bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:50.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64bd2bd640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f64b80c7ee0 con 0x7f64b80c7170 2026-02-17T21:26:50.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64bd2bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:50.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64bd2bd640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f64b80c5830 con 0x7f64b80c7550 2026-02-17T21:26:50.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64bd2bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:50.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64bd2bd640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f64b80c81c0 con 0x7f64b8074ef0 2026-02-17T21:26:50.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64bd2bd640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:50.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64bd2bd640 10 monclient(hunting): authenticate will time out at 1116.146210s 2026-02-17T21:26:50.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64b67fc640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f64b80c7170 0x7f64b80ba300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:50.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64b67fc640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f64b80c7170 0x7f64b80ba300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:50652/0 (socket says 10.20.193.5:50652) 2026-02-17T21:26:50.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64b67fc640 1 -- 10.20.193.5:0/3051483142 learned_addr learned my addr 10.20.193.5:0/3051483142 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:26:50.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64b67fc640 10 monclient(hunting): get_auth_request con 0x7f64b80c7170 auth_method 0 2026-02-17T21:26:50.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64b67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:50.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64b67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:50.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64b67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:50.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64b6ffd640 1 --2- 10.20.193.5:0/3051483142 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f64b8074ef0 0x7f64b8155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:50.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64b77fe640 1 --2- 10.20.193.5:0/3051483142 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f64b80c7550 0x7f64b81f2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:50.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64b67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:50.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64b67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:50.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64b67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:50.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64b6ffd640 10 monclient(hunting): get_auth_request con 0x7f64b8074ef0 auth_method 0 2026-02-17T21:26:50.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:50.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:50.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:50.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64b77fe640 10 monclient(hunting): get_auth_request con 0x7f64b80c7550 auth_method 0 2026-02-17T21:26:50.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:50.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:50.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.580+0000 7f64b77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:50.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.581+0000 7f64b6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:50.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.581+0000 7f64b6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:50.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.581+0000 7f64b6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:50.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.581+0000 7f64b77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:50.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.581+0000 7f64b77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:50.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.581+0000 7f64b77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:50.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.582+0000 7f64b67fc640 10 monclient(hunting): handle_auth_done global_id 4713 payload 824 2026-02-17T21:26:50.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.582+0000 7f64b67fc640 1 -- 10.20.193.5:0/3051483142 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f64b8074ef0 msgr2=0x7f64b8155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:50.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.582+0000 7f64b67fc640 1 --2- 10.20.193.5:0/3051483142 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f64b8074ef0 0x7f64b8155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:50.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.582+0000 7f64b67fc640 1 -- 10.20.193.5:0/3051483142 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f64b80c7550 msgr2=0x7f64b81f2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:50.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.582+0000 7f64b67fc640 1 --2- 10.20.193.5:0/3051483142 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f64b80c7550 0x7f64b81f2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:50.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.582+0000 7f64b67fc640 10 monclient: _finish_hunting 0 2026-02-17T21:26:50.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.582+0000 7f64b67fc640 1 monclient: found mon.noname-a 2026-02-17T21:26:50.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.582+0000 7f64b67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:50.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.582+0000 7f64b67fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:26:50.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.582+0000 7f64b67fc640 1 -- 10.20.193.5:0/3051483142 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b81f2750 con 0x7f64b80c7170 2026-02-17T21:26:50.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.583+0000 7f64b67fc640 1 --2- 10.20.193.5:0/3051483142 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f64b80c7170 0x7f64b80ba300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f64a000e7c0 tx=0x7f64a000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:50.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.583+0000 7f64977fe640 10 client.?.objecter ms_handle_connect 0x7f64b80c7170 2026-02-17T21:26:50.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.583+0000 7f64977fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:26:50.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.584+0000 7f64977fe640 1 -- 10.20.193.5:0/3051483142 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a0017070 con 0x7f64b80c7170 2026-02-17T21:26:50.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.584+0000 7f64977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:50.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.584+0000 7f64977fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:26:50.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.584+0000 7f64977fe640 10 monclient: dump: 2026-02-17T21:26:50.599 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:50.599 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:50.600 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:50.600 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:50.600 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:50.600 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:50.600 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:50.600 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:50.600 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:50.600 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:50.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.584+0000 7f64977fe640 10 monclient: _finish_auth 0 2026-02-17T21:26:50.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.584+0000 7f64977fe640 10 monclient: _check_auth_tickets 2026-02-17T21:26:50.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.584+0000 7f64977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:50.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.584+0000 7f64977fe640 1 -- 10.20.193.5:0/3051483142 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a000c8d0 con 0x7f64b80c7170 2026-02-17T21:26:50.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.584+0000 7f64977fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:50.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.584+0000 7f64977fe640 1 -- 10.20.193.5:0/3051483142 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a000f040 con 0x7f64b80c7170 2026-02-17T21:26:50.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.584+0000 7f64977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:50.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.584+0000 7f64977fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:26:50.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.584+0000 7f64977fe640 10 monclient: dump: 2026-02-17T21:26:50.601 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:50.601 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:50.601 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:50.601 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:50.601 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:50.601 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:50.601 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:50.601 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:50.601 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:50.602 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:50.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.584+0000 7f64b57fa640 4 set_mon_vals no callback set 2026-02-17T21:26:50.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.584+0000 7f64bd2bd640 5 monclient: authenticate success, global_id 4713 2026-02-17T21:26:50.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.584+0000 7f64bd2bd640 10 monclient: _renew_subs 2026-02-17T21:26:50.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.584+0000 7f64bd2bd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:50.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.584+0000 7f64bd2bd640 1 -- 10.20.193.5:0/3051483142 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64b8156480 con 0x7f64b80c7170 2026-02-17T21:26:50.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.584+0000 7f64bd2bd640 10 client.4713.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:26:50.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.584+0000 7f64bd2bd640 10 monclient: _renew_subs 2026-02-17T21:26:50.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.584+0000 7f64bd2bd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:50.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.584+0000 7f64bd2bd640 1 -- 10.20.193.5:0/3051483142 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64b8156a40 con 0x7f64b80c7170 2026-02-17T21:26:50.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.584+0000 7f64bd2bd640 1 librados: init done 2026-02-17T21:26:50.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.585+0000 7f64bd2bd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:50.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.585+0000 7f64bd2bd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:50.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.585+0000 7f64bd2bd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:50.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.585+0000 7f64bd2bd640 1 -- 10.20.193.5:0/3051483142 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64b80c6780 con 0x7f64b80c7170 2026-02-17T21:26:50.693 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.690+0000 7f64977fe640 1 -- 10.20.193.5:0/3051483142 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f64a0012050 con 0x7f64b80c7170 2026-02-17T21:26:50.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.691+0000 7f64977fe640 1 --2- 10.20.193.5:0/3051483142 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f64840792d0 0x7f648407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:50.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.691+0000 7f64b6ffd640 1 --2- 10.20.193.5:0/3051483142 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f64840792d0 0x7f648407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:50.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.691+0000 7f64b6ffd640 10 monclient: get_auth_request con 0x7f64840792d0 auth_method 0 2026-02-17T21:26:50.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.692+0000 7f64b6ffd640 1 --2- 10.20.193.5:0/3051483142 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f64840792d0 0x7f648407b790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f64b80c51a0 tx=0x7f64ac007f50 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:50.695 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.692+0000 7f64977fe640 10 client.4713.objecter ms_handle_connect 0x7f64840792d0 2026-02-17T21:26:50.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.698+0000 7f64977fe640 1 -- 10.20.193.5:0/3051483142 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f64a005dec0 con 0x7f64b80c7170 2026-02-17T21:26:50.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.698+0000 7f64977fe640 10 client.4713.objecter ms_dispatch2 0x7f64b8000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:26:50.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.698+0000 7f64977fe640 3 client.4713.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:26:50.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.698+0000 7f64977fe640 3 client.4713.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:26:50.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.698+0000 7f64977fe640 20 client.4713.objecter dump_active .. 0 homeless 2026-02-17T21:26:50.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.698+0000 7f64977fe640 1 -- 10.20.193.5:0/3051483142 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f64b80c6780 con 0x7f64b80c7170 2026-02-17T21:26:50.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.698+0000 7f64977fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:50.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.698+0000 7f64977fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:26:50.802 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.799+0000 7f64bd2bd640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:26:50.802 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.799+0000 7f64bd2bd640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:50.802 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.799+0000 7f64bd2bd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:50.803 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.799+0000 7f64bd2bd640 1 -- 10.20.193.5:0/3051483142 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f64b80749b0 con 0x7f64b80c7170 2026-02-17T21:26:50.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.802+0000 7f64977fe640 1 -- 10.20.193.5:0/3051483142 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f64a0061e80 con 0x7f64b80c7170 2026-02-17T21:26:50.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.803+0000 7f64977fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:50.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.803+0000 7f64977fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:26:50.806 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:26:50.806 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:26:50.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.804+0000 7f64bd2bd640 10 librados: watch_flush enter 2026-02-17T21:26:50.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.804+0000 7f64bd2bd640 10 librados: watch_flush exit 2026-02-17T21:26:50.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.804+0000 7f64bd2bd640 20 client.4713.objecter shutdown clearing up homeless session... 2026-02-17T21:26:50.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.804+0000 7f64bd2bd640 10 client.4713.objecter successfully canceled tick 2026-02-17T21:26:50.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.804+0000 7f64bd2bd640 1 -- 10.20.193.5:0/3051483142 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f64840792d0 msgr2=0x7f648407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:50.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.804+0000 7f64bd2bd640 1 --2- 10.20.193.5:0/3051483142 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f64840792d0 0x7f648407b790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f64b80c51a0 tx=0x7f64ac007f50 comp rx=0 tx=0).stop 2026-02-17T21:26:50.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.804+0000 7f64bd2bd640 10 monclient: shutdown 2026-02-17T21:26:50.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.804+0000 7f64bd2bd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:50.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.804+0000 7f64bd2bd640 1 -- 10.20.193.5:0/3051483142 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f64b80c7170 msgr2=0x7f64b80ba300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:50.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.804+0000 7f64bd2bd640 1 --2- 10.20.193.5:0/3051483142 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f64b80c7170 0x7f64b80ba300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f64a000e7c0 tx=0x7f64a000ec90 comp rx=0 tx=0).stop 2026-02-17T21:26:50.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.804+0000 7f64bd2bd640 1 -- 10.20.193.5:0/3051483142 shutdown_connections 2026-02-17T21:26:50.809 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.804+0000 7f64bd2bd640 1 --2- 10.20.193.5:0/3051483142 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f64840792d0 0x7f648407b790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:50.809 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.804+0000 7f64bd2bd640 1 --2- 10.20.193.5:0/3051483142 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f64b80c7550 0x7f64b81f2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:50.809 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.804+0000 7f64bd2bd640 1 --2- 10.20.193.5:0/3051483142 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f64b80c7170 0x7f64b80ba300 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:50.809 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.804+0000 7f64bd2bd640 1 --2- 10.20.193.5:0/3051483142 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f64b8074ef0 0x7f64b8155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:50.809 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.804+0000 7f64bd2bd640 1 -- 10.20.193.5:0/3051483142 >> 10.20.193.5:0/3051483142 conn(0x7f64b80c9f40 msgr2=0x7f64b81591e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:50.809 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.804+0000 7f64bd2bd640 1 -- 10.20.193.5:0/3051483142 shutdown_connections 2026-02-17T21:26:50.809 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.804+0000 7f64bd2bd640 1 -- 10.20.193.5:0/3051483142 wait complete. 2026-02-17T21:26:50.809 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:50.804+0000 7f64bd2bd640 1 librados: shutdown 2026-02-17T21:26:53.816 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:26:53.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.882+0000 7fd3786c9640 10 monclient: get_monmap_and_config 2026-02-17T21:26:53.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.882+0000 7fd3786c9640 10 monclient: build_initial_monmap 2026-02-17T21:26:53.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.882+0000 7fd3786c9640 10 monclient: monmap: 2026-02-17T21:26:53.886 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:53.886 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:53.886 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:26:53.884591+0000 2026-02-17T21:26:53.887 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:26:53.884591+0000 2026-02-17T21:26:53.887 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:53.887 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:53.887 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:26:53.887 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:26:53.887 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:26:53.888 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:26:53.888 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:26:53.888 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:26:53.888 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:53.888 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.883+0000 7fd3786c9640 1 Processor -- start 2026-02-17T21:26:53.888 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.883+0000 7fd3786c9640 1 -- start start 2026-02-17T21:26:53.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.883+0000 7fd3786c9640 10 monclient: init 2026-02-17T21:26:53.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.883+0000 7fd3786c9640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:53.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.883+0000 7fd3786c9640 10 monclient: _add_conns ranks=[3,0,4,2,5,1] 2026-02-17T21:26:53.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.883+0000 7fd3786c9640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fd37015d370 0x7fd37015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:53.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.883+0000 7fd3786c9640 10 monclient(hunting): picked mon.noname-a con 0x7fd37015d370 addr v2:10.20.193.5:3300/0 2026-02-17T21:26:53.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.883+0000 7fd3786c9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd3700c7e20 addr v1:10.20.193.5:6789/0 2026-02-17T21:26:53.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.883+0000 7fd3786c9640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fd3700c74c0 0x7fd3700c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:53.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.883+0000 7fd3786c9640 10 monclient(hunting): picked mon.noname-b con 0x7fd3700c74c0 addr v2:10.20.193.119:3300/0 2026-02-17T21:26:53.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.883+0000 7fd3786c9640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3700c8350 con 0x7fd3700c7e20 2026-02-17T21:26:53.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.883+0000 7fd3786c9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:53.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.883+0000 7fd3786c9640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd37015b710 con 0x7fd37015d370 2026-02-17T21:26:53.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.883+0000 7fd3786c9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:53.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.883+0000 7fd3786c9640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fd3700c9240 con 0x7fd3700c74c0 2026-02-17T21:26:53.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.883+0000 7fd3786c9640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:53.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.883+0000 7fd3786c9640 10 monclient(hunting): authenticate will time out at 1119.449901s 2026-02-17T21:26:53.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.884+0000 7fd37643e640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fd37015d370 0x7fd37015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:53.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.884+0000 7fd376c3f640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fd3700c74c0 0x7fd3700c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:53.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.884+0000 7fd376c3f640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fd3700c74c0 0x7fd3700c52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:50170/0 (socket says 10.20.193.5:50170) 2026-02-17T21:26:53.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.884+0000 7fd376c3f640 1 -- 10.20.193.5:0/1716312743 learned_addr learned my addr 10.20.193.5:0/1716312743 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:26:53.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.884+0000 7fd376c3f640 10 monclient(hunting): get_auth_request con 0x7fd3700c74c0 auth_method 0 2026-02-17T21:26:53.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.884+0000 7fd376c3f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:53.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.884+0000 7fd376c3f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:53.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.884+0000 7fd376c3f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:53.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.884+0000 7fd37643e640 10 monclient(hunting): get_auth_request con 0x7fd37015d370 auth_method 0 2026-02-17T21:26:53.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.884+0000 7fd37643e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:53.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.884+0000 7fd37643e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:53.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.884+0000 7fd37643e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:53.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.884+0000 7fd376c3f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:53.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.884+0000 7fd376c3f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:53.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.884+0000 7fd376c3f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:53.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.884+0000 7fd37643e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:53.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.884+0000 7fd37643e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:53.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.884+0000 7fd37643e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:53.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.885+0000 7fd376c3f640 10 monclient(hunting): handle_auth_done global_id 4732 payload 274 2026-02-17T21:26:53.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.885+0000 7fd376c3f640 1 -- 10.20.193.5:0/1716312743 >> v2:10.20.193.5:3300/0 conn(0x7fd37015d370 msgr2=0x7fd37015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:26:53.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.885+0000 7fd376c3f640 1 --2- 10.20.193.5:0/1716312743 >> v2:10.20.193.5:3300/0 conn(0x7fd37015d370 0x7fd37015d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:53.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.885+0000 7fd376c3f640 1 -- 10.20.193.5:0/1716312743 >> v1:10.20.193.5:6789/0 conn(0x7fd3700c7e20 legacy=0x7fd37015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:53.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.885+0000 7fd376c3f640 10 monclient: _finish_hunting 0 2026-02-17T21:26:53.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.885+0000 7fd376c3f640 1 monclient: found mon.noname-b 2026-02-17T21:26:53.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.885+0000 7fd376c3f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:53.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.885+0000 7fd376c3f640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:26:53.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.885+0000 7fd376c3f640 1 -- 10.20.193.5:0/1716312743 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3700c8630 con 0x7fd3700c74c0 2026-02-17T21:26:53.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.886+0000 7fd376c3f640 1 --2- 10.20.193.5:0/1716312743 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd3700c74c0 0x7fd3700c52b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd37015dcf0 tx=0x7fd36c02f270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acdf3d8fb50af87e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:53.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd37543c640 1 -- 10.20.193.5:0/1716312743 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c02fd70 con 0x7fd3700c74c0 2026-02-17T21:26:53.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd37543c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:53.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd37543c640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:26:53.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd37543c640 10 monclient: dump: 2026-02-17T21:26:53.901 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:53.901 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:53.901 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:53.901 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:53.901 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:53.901 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:53.901 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:53.901 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:53.901 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:53.901 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:53.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd37543c640 10 monclient: _finish_auth 0 2026-02-17T21:26:53.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd37543c640 10 monclient: _check_auth_tickets 2026-02-17T21:26:53.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd37543c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:53.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd37543c640 1 -- 10.20.193.5:0/1716312743 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd36c0373f0 con 0x7fd3700c74c0 2026-02-17T21:26:53.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd3786c9640 5 monclient: authenticate success, global_id 4732 2026-02-17T21:26:53.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd3786c9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:26:53.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd37543c640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:53.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd37543c640 1 -- 10.20.193.5:0/1716312743 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c0377c0 con 0x7fd3700c74c0 2026-02-17T21:26:53.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd3786c9640 10 monclient: get_monmap_and_config success 2026-02-17T21:26:53.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd3786c9640 4 set_mon_vals no callback set 2026-02-17T21:26:53.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd37543c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:53.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd37543c640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:26:53.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd37543c640 10 monclient: dump: 2026-02-17T21:26:53.902 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:53.903 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:53.903 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:53.903 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:53.903 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:53.903 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:53.903 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:53.903 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:53.903 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:53.903 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:53.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd3786c9640 10 monclient: shutdown 2026-02-17T21:26:53.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd3786c9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:53.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd3786c9640 1 -- 10.20.193.5:0/1716312743 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd3700c74c0 msgr2=0x7fd3700c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:53.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd3786c9640 1 --2- 10.20.193.5:0/1716312743 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd3700c74c0 0x7fd3700c52b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd37015dcf0 tx=0x7fd36c02f270 comp rx=0 tx=0).stop 2026-02-17T21:26:53.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd3786c9640 1 -- 10.20.193.5:0/1716312743 shutdown_connections 2026-02-17T21:26:53.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd3786c9640 1 --2- 10.20.193.5:0/1716312743 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd3700c74c0 0x7fd3700c52b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:53.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd3786c9640 1 --2- 10.20.193.5:0/1716312743 >> v2:10.20.193.5:3300/0 conn(0x7fd37015d370 0x7fd37015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:53.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd3786c9640 1 -- 10.20.193.5:0/1716312743 >> 10.20.193.5:0/1716312743 conn(0x7fd3700c9f20 msgr2=0x7fd3700ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:53.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd3786c9640 1 -- 10.20.193.5:0/1716312743 shutdown_connections 2026-02-17T21:26:53.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.888+0000 7fd3786c9640 1 -- 10.20.193.5:0/1716312743 wait complete. 2026-02-17T21:26:53.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.889+0000 7fd3786c9640 10 monclient: build_initial_monmap 2026-02-17T21:26:53.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.889+0000 7fd3786c9640 10 monclient: monmap: 2026-02-17T21:26:53.904 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:53.904 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:26:53.905 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:26:53.905 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:26:53.905 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:53.905 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:53.905 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:26:53.905 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:26:53.905 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:26:53.905 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:53.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.889+0000 7fd3786c9640 1 librados: starting msgr at 2026-02-17T21:26:53.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.889+0000 7fd3786c9640 1 librados: starting objecter 2026-02-17T21:26:53.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.889+0000 7fd3786c9640 1 Processor -- start 2026-02-17T21:26:53.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.889+0000 7fd3786c9640 1 -- start start 2026-02-17T21:26:53.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.889+0000 7fd3786c9640 1 librados: setting wanted keys 2026-02-17T21:26:53.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.889+0000 7fd3786c9640 1 librados: calling monclient init 2026-02-17T21:26:53.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.889+0000 7fd3786c9640 10 monclient: init 2026-02-17T21:26:53.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.889+0000 7fd3786c9640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:53.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.889+0000 7fd3786c9640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:26:53.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.889+0000 7fd3786c9640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd3700c74c0 0x7fd3701f61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:53.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.889+0000 7fd3786c9640 10 monclient(hunting): picked mon.noname-c con 0x7fd3700c74c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:26:53.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.889+0000 7fd3786c9640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd3700c7e20 0x7fd370158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:53.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.889+0000 7fd3786c9640 10 monclient(hunting): picked mon.noname-a con 0x7fd3700c7e20 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:26:53.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.889+0000 7fd3786c9640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd37015d370 0x7fd3701f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:53.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.889+0000 7fd3786c9640 10 monclient(hunting): picked mon.noname-b con 0x7fd37015d370 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:26:53.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.889+0000 7fd3786c9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:53.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.889+0000 7fd3786c9640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd3700c8ed0 con 0x7fd3700c7e20 2026-02-17T21:26:53.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.889+0000 7fd3786c9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:53.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.889+0000 7fd3786c9640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd3700c8bf0 con 0x7fd37015d370 2026-02-17T21:26:53.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.889+0000 7fd3786c9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:53.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.889+0000 7fd3786c9640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd3700c96d0 con 0x7fd3700c74c0 2026-02-17T21:26:53.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.889+0000 7fd3786c9640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:53.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.889+0000 7fd3786c9640 10 monclient(hunting): authenticate will time out at 1119.455998s 2026-02-17T21:26:53.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd376c3f640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd37015d370 0x7fd3701f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:53.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd375c3d640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd3700c7e20 0x7fd370158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:53.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd37643e640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd3700c74c0 0x7fd3701f61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:53.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd376c3f640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd37015d370 0x7fd3701f46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:50180/0 (socket says 10.20.193.5:50180) 2026-02-17T21:26:53.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd376c3f640 1 -- 10.20.193.5:0/3496799877 learned_addr learned my addr 10.20.193.5:0/3496799877 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:26:53.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd376c3f640 10 monclient(hunting): get_auth_request con 0x7fd37015d370 auth_method 0 2026-02-17T21:26:53.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd376c3f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:53.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd376c3f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:53.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd376c3f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:53.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd375c3d640 10 monclient(hunting): get_auth_request con 0x7fd3700c7e20 auth_method 0 2026-02-17T21:26:53.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd375c3d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:53.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd375c3d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:53.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd375c3d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:53.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd37643e640 10 monclient(hunting): get_auth_request con 0x7fd3700c74c0 auth_method 0 2026-02-17T21:26:53.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd37643e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:53.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd37643e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:53.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd37643e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:53.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd376c3f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:53.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd376c3f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:53.909 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd376c3f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:53.909 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd375c3d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:53.909 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd375c3d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:53.909 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd375c3d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:53.909 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd37643e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:53.909 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd37643e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:53.909 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.890+0000 7fd37643e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:53.909 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.892+0000 7fd375c3d640 10 monclient(hunting): handle_auth_done global_id 4722 payload 824 2026-02-17T21:26:53.909 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.892+0000 7fd375c3d640 1 -- 10.20.193.5:0/3496799877 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd3700c74c0 msgr2=0x7fd3701f61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:53.909 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.892+0000 7fd375c3d640 1 --2- 10.20.193.5:0/3496799877 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd3700c74c0 0x7fd3701f61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:53.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.892+0000 7fd375c3d640 1 -- 10.20.193.5:0/3496799877 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd37015d370 msgr2=0x7fd3701f46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:53.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.892+0000 7fd375c3d640 1 --2- 10.20.193.5:0/3496799877 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd37015d370 0x7fd3701f46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:53.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.892+0000 7fd375c3d640 10 monclient: _finish_hunting 0 2026-02-17T21:26:53.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.892+0000 7fd375c3d640 1 monclient: found mon.noname-a 2026-02-17T21:26:53.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.892+0000 7fd375c3d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:53.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.892+0000 7fd375c3d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:26:53.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.892+0000 7fd375c3d640 1 -- 10.20.193.5:0/3496799877 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3701f4e50 con 0x7fd3700c7e20 2026-02-17T21:26:53.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.893+0000 7fd375c3d640 1 --2- 10.20.193.5:0/3496799877 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd3700c7e20 0x7fd370158900 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd36400c4b0 tx=0x7fd36400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:53.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.893+0000 7fd356ffd640 10 client.?.objecter ms_handle_connect 0x7fd3700c7e20 2026-02-17T21:26:53.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.893+0000 7fd356ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:26:53.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.894+0000 7fd356ffd640 1 -- 10.20.193.5:0/3496799877 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3640052d0 con 0x7fd3700c7e20 2026-02-17T21:26:53.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.894+0000 7fd356ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:53.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.894+0000 7fd356ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:26:53.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.894+0000 7fd356ffd640 10 monclient: dump: 2026-02-17T21:26:53.914 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:53.914 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:53.914 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:53.914 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:53.914 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:53.914 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:53.914 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:53.914 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:53.914 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:53.915 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:53.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.894+0000 7fd356ffd640 10 monclient: _finish_auth 0 2026-02-17T21:26:53.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.894+0000 7fd356ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:26:53.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.894+0000 7fd356ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:53.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.894+0000 7fd356ffd640 1 -- 10.20.193.5:0/3496799877 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd364005470 con 0x7fd3700c7e20 2026-02-17T21:26:53.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.894+0000 7fd356ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:53.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.894+0000 7fd356ffd640 1 -- 10.20.193.5:0/3496799877 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd364003910 con 0x7fd3700c7e20 2026-02-17T21:26:53.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.894+0000 7fd356ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:53.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.894+0000 7fd356ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:26:53.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.894+0000 7fd356ffd640 10 monclient: dump: 2026-02-17T21:26:53.915 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:53.916 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:53.916 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:53.916 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:53.916 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:53.916 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:53.916 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:53.916 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:53.916 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:53.916 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:53.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.894+0000 7fd374c3b640 4 set_mon_vals no callback set 2026-02-17T21:26:53.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.894+0000 7fd3786c9640 5 monclient: authenticate success, global_id 4722 2026-02-17T21:26:53.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.894+0000 7fd3786c9640 10 monclient: _renew_subs 2026-02-17T21:26:53.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.894+0000 7fd3786c9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:53.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.894+0000 7fd3786c9640 1 -- 10.20.193.5:0/3496799877 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3701f5130 con 0x7fd3700c7e20 2026-02-17T21:26:53.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.894+0000 7fd3786c9640 10 client.4722.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:26:53.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.894+0000 7fd3786c9640 10 monclient: _renew_subs 2026-02-17T21:26:53.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.894+0000 7fd3786c9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:53.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.894+0000 7fd3786c9640 1 -- 10.20.193.5:0/3496799877 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3701f56f0 con 0x7fd3700c7e20 2026-02-17T21:26:53.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.894+0000 7fd3786c9640 1 librados: init done 2026-02-17T21:26:53.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.895+0000 7fd3786c9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:53.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.895+0000 7fd3786c9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:53.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.895+0000 7fd3786c9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:53.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.895+0000 7fd3786c9640 1 -- 10.20.193.5:0/3496799877 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd37015d750 con 0x7fd3700c7e20 2026-02-17T21:26:53.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.907+0000 7fd356ffd640 1 -- 10.20.193.5:0/3496799877 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fd364003ab0 con 0x7fd3700c7e20 2026-02-17T21:26:53.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.907+0000 7fd356ffd640 1 --2- 10.20.193.5:0/3496799877 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd3400792b0 0x7fd34007b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:53.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.908+0000 7fd37643e640 1 --2- 10.20.193.5:0/3496799877 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd3400792b0 0x7fd34007b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:53.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.908+0000 7fd37643e640 10 monclient: get_auth_request con 0x7fd3400792b0 auth_method 0 2026-02-17T21:26:53.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.908+0000 7fd37643e640 1 --2- 10.20.193.5:0/3496799877 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd3400792b0 0x7fd34007b770 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd360009c40 tx=0x7fd360009290 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:53.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.908+0000 7fd356ffd640 10 client.4722.objecter ms_handle_connect 0x7fd3400792b0 2026-02-17T21:26:53.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.909+0000 7fd356ffd640 1 -- 10.20.193.5:0/3496799877 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fd36405e2e0 con 0x7fd3700c7e20 2026-02-17T21:26:53.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.909+0000 7fd356ffd640 10 client.4722.objecter ms_dispatch2 0x7fd370000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:26:53.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.909+0000 7fd356ffd640 3 client.4722.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:26:53.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.909+0000 7fd356ffd640 3 client.4722.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:26:53.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:53.909+0000 7fd356ffd640 20 client.4722.objecter dump_active .. 0 homeless 2026-02-17T21:26:54.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.011+0000 7fd356ffd640 1 -- 10.20.193.5:0/3496799877 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd364097e20 con 0x7fd3700c7e20 2026-02-17T21:26:54.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.011+0000 7fd356ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:54.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.011+0000 7fd356ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:26:54.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.109+0000 7fd3786c9640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:26:54.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.109+0000 7fd3786c9640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:54.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.109+0000 7fd3786c9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:54.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.109+0000 7fd3786c9640 1 -- 10.20.193.5:0/3496799877 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd37006fe90 con 0x7fd3700c7e20 2026-02-17T21:26:54.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.112+0000 7fd356ffd640 1 -- 10.20.193.5:0/3496799877 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fd3640622a0 con 0x7fd3700c7e20 2026-02-17T21:26:54.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.112+0000 7fd356ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:54.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.112+0000 7fd356ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:26:54.115 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:26:54.115 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:26:54.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.113+0000 7fd3786c9640 10 librados: watch_flush enter 2026-02-17T21:26:54.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.113+0000 7fd3786c9640 10 librados: watch_flush exit 2026-02-17T21:26:54.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.113+0000 7fd3786c9640 20 client.4722.objecter shutdown clearing up homeless session... 2026-02-17T21:26:54.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.113+0000 7fd3786c9640 10 client.4722.objecter successfully canceled tick 2026-02-17T21:26:54.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.114+0000 7fd3786c9640 1 -- 10.20.193.5:0/3496799877 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd3400792b0 msgr2=0x7fd34007b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:54.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.114+0000 7fd3786c9640 1 --2- 10.20.193.5:0/3496799877 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd3400792b0 0x7fd34007b770 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd360009c40 tx=0x7fd360009290 comp rx=0 tx=0).stop 2026-02-17T21:26:54.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.114+0000 7fd3786c9640 10 monclient: shutdown 2026-02-17T21:26:54.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.114+0000 7fd3786c9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:54.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.114+0000 7fd3786c9640 1 -- 10.20.193.5:0/3496799877 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd3700c7e20 msgr2=0x7fd370158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:54.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.114+0000 7fd3786c9640 1 --2- 10.20.193.5:0/3496799877 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd3700c7e20 0x7fd370158900 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd36400c4b0 tx=0x7fd36400c980 comp rx=0 tx=0).stop 2026-02-17T21:26:54.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.114+0000 7fd3786c9640 1 -- 10.20.193.5:0/3496799877 shutdown_connections 2026-02-17T21:26:54.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.114+0000 7fd3786c9640 1 --2- 10.20.193.5:0/3496799877 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd3400792b0 0x7fd34007b770 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:54.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.114+0000 7fd3786c9640 1 --2- 10.20.193.5:0/3496799877 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd37015d370 0x7fd3701f46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:54.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.114+0000 7fd3786c9640 1 --2- 10.20.193.5:0/3496799877 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd3700c7e20 0x7fd370158900 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:54.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.114+0000 7fd3786c9640 1 --2- 10.20.193.5:0/3496799877 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd3700c74c0 0x7fd3701f61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:54.119 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.114+0000 7fd3786c9640 1 -- 10.20.193.5:0/3496799877 >> 10.20.193.5:0/3496799877 conn(0x7fd3700c9f20 msgr2=0x7fd3700ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:54.119 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.114+0000 7fd3786c9640 1 -- 10.20.193.5:0/3496799877 shutdown_connections 2026-02-17T21:26:54.119 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.114+0000 7fd3786c9640 1 -- 10.20.193.5:0/3496799877 wait complete. 2026-02-17T21:26:54.119 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:54.114+0000 7fd3786c9640 1 librados: shutdown 2026-02-17T21:26:57.126 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:26:57.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.194+0000 7f85658d6640 10 monclient: get_monmap_and_config 2026-02-17T21:26:57.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.194+0000 7f85658d6640 10 monclient: build_initial_monmap 2026-02-17T21:26:57.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.194+0000 7f85658d6640 10 monclient: monmap: 2026-02-17T21:26:57.197 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:57.197 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:57.197 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:26:57.195998+0000 2026-02-17T21:26:57.197 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:26:57.195998+0000 2026-02-17T21:26:57.197 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:57.197 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:57.197 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:26:57.197 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:26:57.197 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:26:57.197 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:26:57.197 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:26:57.197 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:26:57.197 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:57.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.194+0000 7f85658d6640 1 Processor -- start 2026-02-17T21:26:57.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.194+0000 7f85658d6640 1 -- start start 2026-02-17T21:26:57.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.194+0000 7f85658d6640 10 monclient: init 2026-02-17T21:26:57.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.195+0000 7f85658d6640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:57.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.195+0000 7f85658d6640 10 monclient: _add_conns ranks=[1,4,3,2,5,0] 2026-02-17T21:26:57.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.195+0000 7f85658d6640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f856015d370 addr v1:10.20.193.119:6789/0 2026-02-17T21:26:57.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.195+0000 7f85658d6640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f85600c7e20 0x7f856015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:57.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.195+0000 7f85658d6640 10 monclient(hunting): picked mon.noname-b con 0x7f85600c7e20 addr v2:10.20.193.119:3300/0 2026-02-17T21:26:57.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.195+0000 7f85658d6640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f85600c74c0 0x7f85600c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:57.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.195+0000 7f85658d6640 10 monclient(hunting): picked mon.noname-a con 0x7f85600c74c0 addr v2:10.20.193.5:3300/0 2026-02-17T21:26:57.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.195+0000 7f85658d6640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85600c8350 con 0x7f856015d370 2026-02-17T21:26:57.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.195+0000 7f85658d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:57.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.195+0000 7f85658d6640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f856015b710 con 0x7f85600c74c0 2026-02-17T21:26:57.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.195+0000 7f85658d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:57.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.195+0000 7f85658d6640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f85600c9240 con 0x7f85600c7e20 2026-02-17T21:26:57.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.195+0000 7f85658d6640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:57.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.195+0000 7f85658d6640 10 monclient(hunting): authenticate will time out at 1122.761317s 2026-02-17T21:26:57.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.195+0000 7f855f7fe640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f85600c74c0 0x7f85600c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:57.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.195+0000 7f855e7fc640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f85600c7e20 0x7f856015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:57.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.196+0000 7f855f7fe640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f85600c74c0 0x7f85600c52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:50270/0 (socket says 10.20.193.5:50270) 2026-02-17T21:26:57.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.196+0000 7f855f7fe640 1 -- 10.20.193.5:0/3450927698 learned_addr learned my addr 10.20.193.5:0/3450927698 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:26:57.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.196+0000 7f855f7fe640 10 monclient(hunting): get_auth_request con 0x7f85600c74c0 auth_method 0 2026-02-17T21:26:57.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.196+0000 7f855f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:57.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.196+0000 7f855f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:57.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.196+0000 7f855f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:57.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.196+0000 7f855e7fc640 10 monclient(hunting): get_auth_request con 0x7f85600c7e20 auth_method 0 2026-02-17T21:26:57.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.196+0000 7f855e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:57.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.196+0000 7f855e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:57.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.196+0000 7f855e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:57.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.196+0000 7f855f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:57.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.196+0000 7f855f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:57.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.196+0000 7f855f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:57.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.196+0000 7f855e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:57.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.196+0000 7f855e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:57.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.196+0000 7f855e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:57.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.197+0000 7f855f7fe640 10 monclient(hunting): handle_auth_done global_id 4725 payload 274 2026-02-17T21:26:57.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.197+0000 7f855f7fe640 1 -- 10.20.193.5:0/3450927698 >> v2:10.20.193.119:3300/0 conn(0x7f85600c7e20 msgr2=0x7f856015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:26:57.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.197+0000 7f855f7fe640 1 --2- 10.20.193.5:0/3450927698 >> v2:10.20.193.119:3300/0 conn(0x7f85600c7e20 0x7f856015d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:57.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.197+0000 7f855f7fe640 1 -- 10.20.193.5:0/3450927698 >> v1:10.20.193.119:6789/0 conn(0x7f856015d370 legacy=0x7f856015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:57.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.197+0000 7f855f7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:26:57.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.197+0000 7f855f7fe640 1 monclient: found mon.noname-a 2026-02-17T21:26:57.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.197+0000 7f855f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:57.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.197+0000 7f855f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:26:57.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.197+0000 7f855f7fe640 1 -- 10.20.193.5:0/3450927698 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85600c8630 con 0x7f85600c74c0 2026-02-17T21:26:57.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.198+0000 7f855f7fe640 1 --2- 10.20.193.5:0/3450927698 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f85600c74c0 0x7f85600c52b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f856015d060 tx=0x7f855002f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e81a5d4298e789 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:57.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.199+0000 7f855dffb640 1 -- 10.20.193.5:0/3450927698 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855002fd70 con 0x7f85600c74c0 2026-02-17T21:26:57.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.199+0000 7f855dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:57.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.199+0000 7f855dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:26:57.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.199+0000 7f855dffb640 10 monclient: dump: 2026-02-17T21:26:57.202 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:57.202 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:57.202 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:57.202 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:57.202 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:57.202 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:57.202 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:57.202 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:57.202 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:57.202 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:57.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.199+0000 7f855dffb640 10 monclient: _finish_auth 0 2026-02-17T21:26:57.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.199+0000 7f855dffb640 10 monclient: _check_auth_tickets 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.199+0000 7f855dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.199+0000 7f855dffb640 1 -- 10.20.193.5:0/3450927698 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85500373f0 con 0x7f85600c74c0 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.199+0000 7f85658d6640 5 monclient: authenticate success, global_id 4725 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.199+0000 7f85658d6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.199+0000 7f855dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.199+0000 7f855dffb640 1 -- 10.20.193.5:0/3450927698 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85500377c0 con 0x7f85600c74c0 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.199+0000 7f85658d6640 10 monclient: get_monmap_and_config success 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.200+0000 7f85658d6640 4 set_mon_vals no callback set 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.200+0000 7f855dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.200+0000 7f855dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.200+0000 7f855dffb640 10 monclient: dump: 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.200+0000 7f85658d6640 10 monclient: shutdown 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.200+0000 7f85658d6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.200+0000 7f85658d6640 1 -- 10.20.193.5:0/3450927698 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f85600c74c0 msgr2=0x7f85600c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.200+0000 7f85658d6640 1 --2- 10.20.193.5:0/3450927698 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f85600c74c0 0x7f85600c52b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f856015d060 tx=0x7f855002f270 comp rx=0 tx=0).stop 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.200+0000 7f85658d6640 1 -- 10.20.193.5:0/3450927698 shutdown_connections 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.200+0000 7f85658d6640 1 --2- 10.20.193.5:0/3450927698 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f85600c74c0 0x7f85600c52b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.200+0000 7f85658d6640 1 --2- 10.20.193.5:0/3450927698 >> v2:10.20.193.119:3300/0 conn(0x7f85600c7e20 0x7f856015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.200+0000 7f85658d6640 1 -- 10.20.193.5:0/3450927698 >> 10.20.193.5:0/3450927698 conn(0x7f85600c9f20 msgr2=0x7f85600ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.200+0000 7f85658d6640 1 -- 10.20.193.5:0/3450927698 shutdown_connections 2026-02-17T21:26:57.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.200+0000 7f85658d6640 1 -- 10.20.193.5:0/3450927698 wait complete. 2026-02-17T21:26:57.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.200+0000 7f85658d6640 10 monclient: build_initial_monmap 2026-02-17T21:26:57.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.200+0000 7f85658d6640 10 monclient: monmap: 2026-02-17T21:26:57.204 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:26:57.204 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:26:57.204 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:26:57.204 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:26:57.204 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:26:57.204 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:57.204 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:26:57.204 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:26:57.204 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.201+0000 7f85658d6640 1 librados: starting msgr at 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.201+0000 7f85658d6640 1 librados: starting objecter 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.201+0000 7f85658d6640 1 Processor -- start 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.201+0000 7f85658d6640 1 -- start start 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.201+0000 7f85658d6640 1 librados: setting wanted keys 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.201+0000 7f85658d6640 1 librados: calling monclient init 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.201+0000 7f85658d6640 10 monclient: init 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.201+0000 7f85658d6640 10 monclient: _reopen_session rank -1 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.201+0000 7f85658d6640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.201+0000 7f85658d6640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f85600c74c0 0x7f8560156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.201+0000 7f85658d6640 10 monclient(hunting): picked mon.noname-b con 0x7f85600c74c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.201+0000 7f85658d6640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f85600c7e20 0x7f8560149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.201+0000 7f85658d6640 10 monclient(hunting): picked mon.noname-c con 0x7f85600c7e20 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.201+0000 7f85658d6640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f856015d370 0x7f856014a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.201+0000 7f85658d6640 10 monclient(hunting): picked mon.noname-a con 0x7f856015d370 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.201+0000 7f85658d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.201+0000 7f85658d6640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f85600c8ed0 con 0x7f856015d370 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.201+0000 7f85658d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.201+0000 7f85658d6640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f85600c8bf0 con 0x7f85600c74c0 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.201+0000 7f85658d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.201+0000 7f85658d6640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f85600c96d0 con 0x7f85600c7e20 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.201+0000 7f85658d6640 10 monclient(hunting): _renew_subs 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.201+0000 7f85658d6640 10 monclient(hunting): authenticate will time out at 1122.767712s 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855f7fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f856015d370 0x7f856014a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855e7fc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f85600c7e20 0x7f8560149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855e7fc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f85600c7e20 0x7f8560149df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:50322/0 (socket says 10.20.193.5:50322) 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855e7fc640 1 -- 10.20.193.5:0/1830167932 learned_addr learned my addr 10.20.193.5:0/1830167932 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855e7fc640 10 monclient(hunting): get_auth_request con 0x7f85600c7e20 auth_method 0 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855f7fe640 10 monclient(hunting): get_auth_request con 0x7f856015d370 auth_method 0 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855effd640 1 --2- 10.20.193.5:0/1830167932 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f85600c74c0 0x7f8560156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:57.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:57.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855effd640 10 monclient(hunting): get_auth_request con 0x7f85600c74c0 auth_method 0 2026-02-17T21:26:57.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:26:57.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:26:57.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:26:57.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:57.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:57.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:57.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:26:57.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:26:57.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.202+0000 7f855effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:26:57.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.203+0000 7f855f7fe640 10 monclient(hunting): handle_auth_done global_id 4728 payload 824 2026-02-17T21:26:57.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.203+0000 7f855f7fe640 1 -- 10.20.193.5:0/1830167932 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f85600c7e20 msgr2=0x7f8560149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:57.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.203+0000 7f855f7fe640 1 --2- 10.20.193.5:0/1830167932 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f85600c7e20 0x7f8560149df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:57.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.203+0000 7f855f7fe640 1 -- 10.20.193.5:0/1830167932 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f85600c74c0 msgr2=0x7f8560156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:57.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.203+0000 7f855f7fe640 1 --2- 10.20.193.5:0/1830167932 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f85600c74c0 0x7f8560156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:57.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.203+0000 7f855f7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:26:57.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.203+0000 7f855f7fe640 1 monclient: found mon.noname-a 2026-02-17T21:26:57.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.203+0000 7f855f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:26:57.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.203+0000 7f855f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:26:57.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.203+0000 7f855f7fe640 1 -- 10.20.193.5:0/1830167932 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8560148a70 con 0x7f856015d370 2026-02-17T21:26:57.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.204+0000 7f855f7fe640 1 --2- 10.20.193.5:0/1830167932 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f856015d370 0x7f856014a330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f85600c68a0 tx=0x7f8550004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:57.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.204+0000 7f8537fff640 10 client.?.objecter ms_handle_connect 0x7f856015d370 2026-02-17T21:26:57.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.204+0000 7f8537fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:26:57.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f8537fff640 1 -- 10.20.193.5:0/1830167932 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8550046020 con 0x7f856015d370 2026-02-17T21:26:57.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f8537fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:57.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f8537fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:26:57.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f8537fff640 10 monclient: dump: 2026-02-17T21:26:57.208 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:57.208 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:57.208 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:57.208 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:57.208 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f8537fff640 10 monclient: _finish_auth 0 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f8537fff640 10 monclient: _check_auth_tickets 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f8537fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f8537fff640 1 -- 10.20.193.5:0/1830167932 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8550041450 con 0x7f856015d370 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f85658d6640 5 monclient: authenticate success, global_id 4728 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f85658d6640 10 monclient: _renew_subs 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f85658d6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f85658d6640 1 -- 10.20.193.5:0/1830167932 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8560148d50 con 0x7f856015d370 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f8537fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f8537fff640 1 -- 10.20.193.5:0/1830167932 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8550009510 con 0x7f856015d370 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f8537fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f8537fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f8537fff640 10 monclient: dump: 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f855d7fa640 4 set_mon_vals no callback set 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f85658d6640 10 client.4728.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f85658d6640 10 monclient: _renew_subs 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f85658d6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f85658d6640 1 -- 10.20.193.5:0/1830167932 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8560149310 con 0x7f856015d370 2026-02-17T21:26:57.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f85658d6640 1 librados: init done 2026-02-17T21:26:57.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f85658d6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:57.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f85658d6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:57.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f85658d6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:57.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.206+0000 7f85658d6640 1 -- 10.20.193.5:0/1830167932 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f856015d750 con 0x7f856015d370 2026-02-17T21:26:57.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.218+0000 7f8537fff640 1 -- 10.20.193.5:0/1830167932 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f8550041860 con 0x7f856015d370 2026-02-17T21:26:57.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.219+0000 7f8537fff640 1 --2- 10.20.193.5:0/1830167932 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8530079300 0x7f853007b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:26:57.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.219+0000 7f855effd640 1 --2- 10.20.193.5:0/1830167932 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8530079300 0x7f853007b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:26:57.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.219+0000 7f855effd640 10 monclient: get_auth_request con 0x7f8530079300 auth_method 0 2026-02-17T21:26:57.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.220+0000 7f855effd640 1 --2- 10.20.193.5:0/1830167932 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8530079300 0x7f853007b7c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f85540051f0 tx=0x7f8554007f30 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:26:57.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.220+0000 7f8537fff640 10 client.4728.objecter ms_handle_connect 0x7f8530079300 2026-02-17T21:26:57.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.321+0000 7f8537fff640 1 -- 10.20.193.5:0/1830167932 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f8550083b30 con 0x7f856015d370 2026-02-17T21:26:57.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.321+0000 7f8537fff640 10 client.4728.objecter ms_dispatch2 0x7f8560000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:26:57.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.321+0000 7f8537fff640 3 client.4728.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:26:57.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.321+0000 7f8537fff640 3 client.4728.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:26:57.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.321+0000 7f8537fff640 20 client.4728.objecter dump_active .. 0 homeless 2026-02-17T21:26:57.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.321+0000 7f8537fff640 1 -- 10.20.193.5:0/1830167932 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8550050030 con 0x7f856015d370 2026-02-17T21:26:57.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.321+0000 7f8537fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:26:57.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.321+0000 7f8537fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:26:57.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.424+0000 7f85658d6640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:26:57.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.424+0000 7f85658d6640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:57.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.424+0000 7f85658d6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:26:57.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.424+0000 7f85658d6640 1 -- 10.20.193.5:0/1830167932 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8560150970 con 0x7f856015d370 2026-02-17T21:26:57.454 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:03:37.079 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:57.460 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:03:37.085 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:57.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.461+0000 7f8537fff640 1 -- 10.20.193.5:0/1830167932 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f8550087af0 con 0x7f856015d370 2026-02-17T21:26:57.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.461+0000 7f8537fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:26:57.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.461+0000 7f8537fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:26:57.465 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:26:57.465 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:26:57.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.463+0000 7f85658d6640 10 librados: watch_flush enter 2026-02-17T21:26:57.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.463+0000 7f85658d6640 10 librados: watch_flush exit 2026-02-17T21:26:57.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.463+0000 7f85658d6640 20 client.4728.objecter shutdown clearing up homeless session... 2026-02-17T21:26:57.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.463+0000 7f85658d6640 10 client.4728.objecter successfully canceled tick 2026-02-17T21:26:57.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.464+0000 7f85658d6640 1 -- 10.20.193.5:0/1830167932 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8530079300 msgr2=0x7f853007b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:57.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.464+0000 7f85658d6640 1 --2- 10.20.193.5:0/1830167932 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8530079300 0x7f853007b7c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f85540051f0 tx=0x7f8554007f30 comp rx=0 tx=0).stop 2026-02-17T21:26:57.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.464+0000 7f85658d6640 10 monclient: shutdown 2026-02-17T21:26:57.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.464+0000 7f85658d6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:26:57.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.464+0000 7f85658d6640 1 -- 10.20.193.5:0/1830167932 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f856015d370 msgr2=0x7f856014a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:26:57.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.464+0000 7f85658d6640 1 --2- 10.20.193.5:0/1830167932 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f856015d370 0x7f856014a330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f85600c68a0 tx=0x7f8550004b40 comp rx=0 tx=0).stop 2026-02-17T21:26:57.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.464+0000 7f85658d6640 1 -- 10.20.193.5:0/1830167932 shutdown_connections 2026-02-17T21:26:57.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.464+0000 7f85658d6640 1 --2- 10.20.193.5:0/1830167932 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8530079300 0x7f853007b7c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:57.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.464+0000 7f85658d6640 1 --2- 10.20.193.5:0/1830167932 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f856015d370 0x7f856014a330 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:57.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.464+0000 7f85658d6640 1 --2- 10.20.193.5:0/1830167932 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f85600c7e20 0x7f8560149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:57.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.464+0000 7f85658d6640 1 --2- 10.20.193.5:0/1830167932 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f85600c74c0 0x7f8560156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:26:57.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.464+0000 7f85658d6640 1 -- 10.20.193.5:0/1830167932 >> 10.20.193.5:0/1830167932 conn(0x7f85600c9f20 msgr2=0x7f856015af00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:26:57.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.464+0000 7f85658d6640 1 -- 10.20.193.5:0/1830167932 shutdown_connections 2026-02-17T21:26:57.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.464+0000 7f85658d6640 1 -- 10.20.193.5:0/1830167932 wait complete. 2026-02-17T21:26:57.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:26:57.464+0000 7f85658d6640 1 librados: shutdown 2026-02-17T21:26:57.470 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:03:37.095 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:57.484 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:03:37.108 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:57.485 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:03:37.109 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:57.485 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:03:37.071 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:57.486 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:03:37.072 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:57.493 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:03:37.117 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:26:57.494 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:03:37.080 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:27:00.477 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:27:00.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.543+0000 7fba63b2c640 10 monclient: get_monmap_and_config 2026-02-17T21:27:00.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.543+0000 7fba63b2c640 10 monclient: build_initial_monmap 2026-02-17T21:27:00.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.544+0000 7fba63b2c640 10 monclient: monmap: 2026-02-17T21:27:00.546 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:00.546 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:00.546 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:27:00.544676+0000 2026-02-17T21:27:00.546 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:27:00.544676+0000 2026-02-17T21:27:00.546 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:00.547 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:00.547 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:27:00.547 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:27:00.547 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:27:00.547 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:27:00.547 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:27:00.547 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:27:00.547 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:00.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.544+0000 7fba63b2c640 1 Processor -- start 2026-02-17T21:27:00.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.544+0000 7fba63b2c640 1 -- start start 2026-02-17T21:27:00.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.544+0000 7fba63b2c640 10 monclient: init 2026-02-17T21:27:00.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.544+0000 7fba63b2c640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:00.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.545+0000 7fba63b2c640 10 monclient: _add_conns ranks=[4,2,0,3,5,1] 2026-02-17T21:27:00.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.545+0000 7fba63b2c640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fba5c152820 0x7fba5c1593f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:00.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.545+0000 7fba63b2c640 10 monclient(hunting): picked mon.noname-b con 0x7fba5c152820 addr v2:10.20.193.119:3300/0 2026-02-17T21:27:00.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.545+0000 7fba63b2c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fba5c152c00 addr v1:10.20.193.135:6789/0 2026-02-17T21:27:00.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.545+0000 7fba63b2c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fba5c0738f0 addr v1:10.20.193.5:6789/0 2026-02-17T21:27:00.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.545+0000 7fba63b2c640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba5c073e90 con 0x7fba5c0738f0 2026-02-17T21:27:00.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.545+0000 7fba63b2c640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba5c074170 con 0x7fba5c152c00 2026-02-17T21:27:00.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.545+0000 7fba63b2c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:00.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.545+0000 7fba63b2c640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fba5c159930 con 0x7fba5c152820 2026-02-17T21:27:00.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.545+0000 7fba63b2c640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:00.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.545+0000 7fba63b2c640 10 monclient(hunting): authenticate will time out at 1126.110067s 2026-02-17T21:27:00.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.545+0000 7fba610a0640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7fba5c152c00 0x7fba5c0c7e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:49864/0 (socket says 10.20.193.5:49864) 2026-02-17T21:27:00.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.545+0000 7fba610a0640 1 -- 10.20.193.5:0/3023553753 learned_addr learned my addr 10.20.193.5:0/3023553753 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:27:00.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.545+0000 7fba618a1640 1 --2- 10.20.193.5:0/3023553753 >> v2:10.20.193.119:3300/0 conn(0x7fba5c152820 0x7fba5c1593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:00.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.545+0000 7fba618a1640 10 monclient(hunting): get_auth_request con 0x7fba5c152820 auth_method 0 2026-02-17T21:27:00.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.545+0000 7fba618a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:00.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.545+0000 7fba618a1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:00.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.545+0000 7fba618a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:00.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.545+0000 7fba618a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:00.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.545+0000 7fba618a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:00.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.545+0000 7fba618a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:00.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.546+0000 7fba6089f640 1 -- 10.20.193.5:0/3023553753 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 63464582 0 0) 0x7fba5c074170 con 0x7fba5c152c00 2026-02-17T21:27:00.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.546+0000 7fba6089f640 10 monclient(hunting): _negotiate 2026-02-17T21:27:00.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.546+0000 7fba6089f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:00.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.546+0000 7fba6089f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:00.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.546+0000 7fba6089f640 10 monclient(hunting): my global_id is 4760 2026-02-17T21:27:00.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.546+0000 7fba6089f640 1 -- 10.20.193.5:0/3023553753 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba44003620 con 0x7fba5c152c00 2026-02-17T21:27:00.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.546+0000 7fba618a1640 10 monclient(hunting): handle_auth_done global_id 4747 payload 274 2026-02-17T21:27:00.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.546+0000 7fba618a1640 1 -- 10.20.193.5:0/3023553753 >> v1:10.20.193.135:6789/0 conn(0x7fba5c152c00 legacy=0x7fba5c0c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:00.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.546+0000 7fba618a1640 1 -- 10.20.193.5:0/3023553753 >> v1:10.20.193.5:6789/0 conn(0x7fba5c0738f0 legacy=0x7fba5c0c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:00.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.546+0000 7fba618a1640 10 monclient: _finish_hunting 0 2026-02-17T21:27:00.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.546+0000 7fba618a1640 1 monclient: found mon.noname-b 2026-02-17T21:27:00.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.546+0000 7fba618a1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:00.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.546+0000 7fba618a1640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:27:00.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.546+0000 7fba618a1640 1 -- 10.20.193.5:0/3023553753 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5c074450 con 0x7fba5c152820 2026-02-17T21:27:00.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.547+0000 7fba618a1640 1 --2- 10.20.193.5:0/3023553753 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fba5c152820 0x7fba5c1593f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0098a0 tx=0x7fba4c02ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fffe3cb0188fb53e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:00.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.548+0000 7fba6089f640 1 -- 10.20.193.5:0/3023553753 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c03c070 con 0x7fba5c152820 2026-02-17T21:27:00.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.548+0000 7fba6089f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:00.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.548+0000 7fba6089f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:27:00.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.548+0000 7fba6089f640 10 monclient: dump: 2026-02-17T21:27:00.559 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:00.559 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:00.559 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:00.559 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:00.559 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:00.559 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:00.560 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:00.560 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:00.560 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:00.560 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:00.560 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.548+0000 7fba6089f640 10 monclient: _finish_auth 0 2026-02-17T21:27:00.560 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.548+0000 7fba6089f640 10 monclient: _check_auth_tickets 2026-02-17T21:27:00.560 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.548+0000 7fba6089f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:00.560 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.548+0000 7fba63b2c640 5 monclient: authenticate success, global_id 4747 2026-02-17T21:27:00.560 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.548+0000 7fba63b2c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:27:00.560 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.549+0000 7fba6089f640 1 -- 10.20.193.5:0/3023553753 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4c02fc10 con 0x7fba5c152820 2026-02-17T21:27:00.560 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.549+0000 7fba6089f640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:00.560 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.549+0000 7fba6089f640 1 -- 10.20.193.5:0/3023553753 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c037440 con 0x7fba5c152820 2026-02-17T21:27:00.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.549+0000 7fba6089f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:00.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.549+0000 7fba6089f640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:27:00.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.549+0000 7fba6089f640 10 monclient: dump: 2026-02-17T21:27:00.561 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:00.561 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:00.561 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:00.561 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:00.561 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:00.561 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:00.561 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:00.561 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:00.561 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:00.561 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:00.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.549+0000 7fba63b2c640 10 monclient: get_monmap_and_config success 2026-02-17T21:27:00.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.549+0000 7fba63b2c640 4 set_mon_vals no callback set 2026-02-17T21:27:00.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.549+0000 7fba63b2c640 10 monclient: shutdown 2026-02-17T21:27:00.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.549+0000 7fba63b2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:00.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.549+0000 7fba63b2c640 1 -- 10.20.193.5:0/3023553753 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fba5c152820 msgr2=0x7fba5c1593f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:00.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.549+0000 7fba63b2c640 1 --2- 10.20.193.5:0/3023553753 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fba5c152820 0x7fba5c1593f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0098a0 tx=0x7fba4c02ef00 comp rx=0 tx=0).stop 2026-02-17T21:27:00.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.549+0000 7fba63b2c640 1 -- 10.20.193.5:0/3023553753 shutdown_connections 2026-02-17T21:27:00.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.549+0000 7fba63b2c640 1 --2- 10.20.193.5:0/3023553753 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fba5c152820 0x7fba5c1593f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:00.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.549+0000 7fba63b2c640 1 -- 10.20.193.5:0/3023553753 >> 10.20.193.5:0/3023553753 conn(0x7fba5c0c9f40 msgr2=0x7fba5c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:00.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.549+0000 7fba63b2c640 1 -- 10.20.193.5:0/3023553753 shutdown_connections 2026-02-17T21:27:00.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.549+0000 7fba63b2c640 1 -- 10.20.193.5:0/3023553753 wait complete. 2026-02-17T21:27:00.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.550+0000 7fba63b2c640 10 monclient: build_initial_monmap 2026-02-17T21:27:00.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.550+0000 7fba63b2c640 10 monclient: monmap: 2026-02-17T21:27:00.563 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:00.563 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:27:00.563 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:27:00.563 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:27:00.563 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:00.563 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:00.563 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:27:00.563 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:27:00.563 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:27:00.563 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:00.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.550+0000 7fba63b2c640 1 librados: starting msgr at 2026-02-17T21:27:00.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.550+0000 7fba63b2c640 1 librados: starting objecter 2026-02-17T21:27:00.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.550+0000 7fba63b2c640 1 Processor -- start 2026-02-17T21:27:00.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.550+0000 7fba63b2c640 1 -- start start 2026-02-17T21:27:00.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.550+0000 7fba63b2c640 1 librados: setting wanted keys 2026-02-17T21:27:00.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.550+0000 7fba63b2c640 1 librados: calling monclient init 2026-02-17T21:27:00.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.550+0000 7fba63b2c640 10 monclient: init 2026-02-17T21:27:00.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.550+0000 7fba63b2c640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:00.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.550+0000 7fba63b2c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:27:00.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba63b2c640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fba5c0738f0 0x7fba5c1f7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:00.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba63b2c640 10 monclient(hunting): picked mon.noname-a con 0x7fba5c0738f0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:27:00.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba63b2c640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fba5c152820 0x7fba5c14b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:00.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba63b2c640 10 monclient(hunting): picked mon.noname-c con 0x7fba5c152820 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:27:00.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba63b2c640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fba5c152c00 0x7fba5c0cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:00.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba63b2c640 10 monclient(hunting): picked mon.noname-b con 0x7fba5c152c00 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:27:00.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba63b2c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:00.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba63b2c640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c074a10 con 0x7fba5c0738f0 2026-02-17T21:27:00.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba63b2c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:00.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba63b2c640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c0c8550 con 0x7fba5c152c00 2026-02-17T21:27:00.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba63b2c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:00.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba63b2c640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c074cf0 con 0x7fba5c152820 2026-02-17T21:27:00.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba63b2c640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:00.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba63b2c640 10 monclient(hunting): authenticate will time out at 1126.116040s 2026-02-17T21:27:00.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba618a1640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fba5c0738f0 0x7fba5c1f7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:00.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba620a2640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fba5c152c00 0x7fba5c0cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:00.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba610a0640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fba5c152820 0x7fba5c14b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:00.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba620a2640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fba5c152c00 0x7fba5c0cb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:46490/0 (socket says 10.20.193.5:46490) 2026-02-17T21:27:00.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba620a2640 1 -- 10.20.193.5:0/281518797 learned_addr learned my addr 10.20.193.5:0/281518797 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:27:00.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba620a2640 10 monclient(hunting): get_auth_request con 0x7fba5c152c00 auth_method 0 2026-02-17T21:27:00.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba620a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:00.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba620a2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:00.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba620a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:00.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba610a0640 10 monclient(hunting): get_auth_request con 0x7fba5c152820 auth_method 0 2026-02-17T21:27:00.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba610a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:00.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba610a0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:00.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba610a0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:00.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba618a1640 10 monclient(hunting): get_auth_request con 0x7fba5c0738f0 auth_method 0 2026-02-17T21:27:00.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba618a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:00.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba618a1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:00.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba618a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:00.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba620a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:00.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba620a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:00.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba620a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:00.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba610a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:00.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba610a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:00.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba610a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:00.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba618a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:00.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba618a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:00.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.551+0000 7fba618a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:00.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.553+0000 7fba620a2640 10 monclient(hunting): handle_auth_done global_id 4750 payload 824 2026-02-17T21:27:00.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.553+0000 7fba620a2640 1 -- 10.20.193.5:0/281518797 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fba5c152820 msgr2=0x7fba5c14b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:00.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.553+0000 7fba620a2640 1 --2- 10.20.193.5:0/281518797 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fba5c152820 0x7fba5c14b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:00.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.553+0000 7fba620a2640 1 -- 10.20.193.5:0/281518797 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fba5c0738f0 msgr2=0x7fba5c1f7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:00.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.553+0000 7fba620a2640 1 --2- 10.20.193.5:0/281518797 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fba5c0738f0 0x7fba5c1f7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:00.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.553+0000 7fba620a2640 10 monclient: _finish_hunting 0 2026-02-17T21:27:00.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.553+0000 7fba620a2640 1 monclient: found mon.noname-b 2026-02-17T21:27:00.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.553+0000 7fba620a2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:00.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.553+0000 7fba620a2640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:27:00.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.553+0000 7fba620a2640 1 -- 10.20.193.5:0/281518797 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5c06e380 con 0x7fba5c152c00 2026-02-17T21:27:00.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.554+0000 7fba620a2640 1 --2- 10.20.193.5:0/281518797 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fba5c152c00 0x7fba5c0cb810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fba5800cba0 tx=0x7fba5800a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:00.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.554+0000 7fba4a7fc640 10 client.?.objecter ms_handle_connect 0x7fba5c152c00 2026-02-17T21:27:00.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.554+0000 7fba4a7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:27:00.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.555+0000 7fba4a7fc640 1 -- 10.20.193.5:0/281518797 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5800ad50 con 0x7fba5c152c00 2026-02-17T21:27:00.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.555+0000 7fba4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:00.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.555+0000 7fba4a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:27:00.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.555+0000 7fba4a7fc640 10 monclient: dump: 2026-02-17T21:27:00.572 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:00.572 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:00.572 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:00.572 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:00.572 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:00.572 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:00.573 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:00.573 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:00.573 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:00.573 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:00.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.555+0000 7fba4a7fc640 10 monclient: _finish_auth 0 2026-02-17T21:27:00.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.555+0000 7fba4a7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:27:00.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.555+0000 7fba4a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:00.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.555+0000 7fba63b2c640 5 monclient: authenticate success, global_id 4750 2026-02-17T21:27:00.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.555+0000 7fba63b2c640 10 monclient: _renew_subs 2026-02-17T21:27:00.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.555+0000 7fba63b2c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:00.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.555+0000 7fba63b2c640 1 -- 10.20.193.5:0/281518797 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba5c06e660 con 0x7fba5c152c00 2026-02-17T21:27:00.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.555+0000 7fba63b2c640 10 client.4750.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:27:00.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.555+0000 7fba63b2c640 10 monclient: _renew_subs 2026-02-17T21:27:00.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.555+0000 7fba63b2c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:00.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.555+0000 7fba63b2c640 1 -- 10.20.193.5:0/281518797 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba5c06ec20 con 0x7fba5c152c00 2026-02-17T21:27:00.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.555+0000 7fba63b2c640 1 librados: init done 2026-02-17T21:27:00.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.555+0000 7fba4a7fc640 1 -- 10.20.193.5:0/281518797 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba58003a70 con 0x7fba5c152c00 2026-02-17T21:27:00.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.555+0000 7fba4a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:00.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.555+0000 7fba4a7fc640 1 -- 10.20.193.5:0/281518797 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba58003e20 con 0x7fba5c152c00 2026-02-17T21:27:00.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.555+0000 7fba4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:00.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.555+0000 7fba4a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:27:00.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.555+0000 7fba4bfff640 4 set_mon_vals no callback set 2026-02-17T21:27:00.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.555+0000 7fba4a7fc640 10 monclient: dump: 2026-02-17T21:27:00.574 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:00.575 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:00.575 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:00.575 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:00.575 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:00.575 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:00.575 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:00.575 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:00.575 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:00.575 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:00.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.556+0000 7fba63b2c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:00.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.556+0000 7fba63b2c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:00.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.556+0000 7fba63b2c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:00.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.556+0000 7fba63b2c640 1 -- 10.20.193.5:0/281518797 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba5c1593f0 con 0x7fba5c152c00 2026-02-17T21:27:00.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.566+0000 7fba4a7fc640 1 -- 10.20.193.5:0/281518797 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fba580050d0 con 0x7fba5c152c00 2026-02-17T21:27:00.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.567+0000 7fba4a7fc640 1 --2- 10.20.193.5:0/281518797 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fba2c079280 0x7fba2c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:00.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.567+0000 7fba618a1640 1 --2- 10.20.193.5:0/281518797 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fba2c079280 0x7fba2c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:00.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.567+0000 7fba618a1640 10 monclient: get_auth_request con 0x7fba2c079280 auth_method 0 2026-02-17T21:27:00.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.568+0000 7fba618a1640 1 --2- 10.20.193.5:0/281518797 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fba2c079280 0x7fba2c07b740 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fba4c039000 tx=0x7fba4c033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:00.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.568+0000 7fba4a7fc640 10 client.4750.objecter ms_handle_connect 0x7fba2c079280 2026-02-17T21:27:00.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.569+0000 7fba4a7fc640 1 -- 10.20.193.5:0/281518797 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fba5805ea80 con 0x7fba5c152c00 2026-02-17T21:27:00.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.569+0000 7fba4a7fc640 10 client.4750.objecter ms_dispatch2 0x7fba5c000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:27:00.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.569+0000 7fba4a7fc640 3 client.4750.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:27:00.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.569+0000 7fba4a7fc640 3 client.4750.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:27:00.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.569+0000 7fba4a7fc640 20 client.4750.objecter dump_active .. 0 homeless 2026-02-17T21:27:00.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.668+0000 7fba4a7fc640 1 -- 10.20.193.5:0/281518797 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fba58062a40 con 0x7fba5c152c00 2026-02-17T21:27:00.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.668+0000 7fba4a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:00.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.668+0000 7fba4a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:27:00.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.769+0000 7fba63b2c640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:27:00.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.769+0000 7fba63b2c640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:00.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.769+0000 7fba63b2c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:00.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.769+0000 7fba63b2c640 1 -- 10.20.193.5:0/281518797 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fba5c0c61d0 con 0x7fba5c152c00 2026-02-17T21:27:00.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.772+0000 7fba4a7fc640 1 -- 10.20.193.5:0/281518797 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fba58066d40 con 0x7fba5c152c00 2026-02-17T21:27:00.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.772+0000 7fba4a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:00.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.772+0000 7fba4a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:27:00.775 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:27:00.775 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:27:00.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.773+0000 7fba63b2c640 10 librados: watch_flush enter 2026-02-17T21:27:00.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.773+0000 7fba63b2c640 10 librados: watch_flush exit 2026-02-17T21:27:00.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.773+0000 7fba63b2c640 20 client.4750.objecter shutdown clearing up homeless session... 2026-02-17T21:27:00.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.773+0000 7fba63b2c640 10 client.4750.objecter successfully canceled tick 2026-02-17T21:27:00.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.773+0000 7fba63b2c640 1 -- 10.20.193.5:0/281518797 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fba2c079280 msgr2=0x7fba2c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:00.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.773+0000 7fba63b2c640 1 --2- 10.20.193.5:0/281518797 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fba2c079280 0x7fba2c07b740 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fba4c039000 tx=0x7fba4c033000 comp rx=0 tx=0).stop 2026-02-17T21:27:00.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.773+0000 7fba63b2c640 10 monclient: shutdown 2026-02-17T21:27:00.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.773+0000 7fba63b2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:00.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.773+0000 7fba63b2c640 1 -- 10.20.193.5:0/281518797 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fba5c152c00 msgr2=0x7fba5c0cb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:00.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.773+0000 7fba63b2c640 1 --2- 10.20.193.5:0/281518797 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fba5c152c00 0x7fba5c0cb810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fba5800cba0 tx=0x7fba5800a430 comp rx=0 tx=0).stop 2026-02-17T21:27:00.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.773+0000 7fba63b2c640 1 -- 10.20.193.5:0/281518797 shutdown_connections 2026-02-17T21:27:00.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.773+0000 7fba63b2c640 1 --2- 10.20.193.5:0/281518797 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fba2c079280 0x7fba2c07b740 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:00.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.773+0000 7fba63b2c640 1 --2- 10.20.193.5:0/281518797 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fba5c152c00 0x7fba5c0cb810 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:00.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.773+0000 7fba63b2c640 1 --2- 10.20.193.5:0/281518797 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fba5c152820 0x7fba5c14b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:00.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.773+0000 7fba63b2c640 1 --2- 10.20.193.5:0/281518797 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fba5c0738f0 0x7fba5c1f7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:00.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.773+0000 7fba63b2c640 1 -- 10.20.193.5:0/281518797 >> 10.20.193.5:0/281518797 conn(0x7fba5c0c9f40 msgr2=0x7fba5c14e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:00.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.773+0000 7fba63b2c640 1 -- 10.20.193.5:0/281518797 shutdown_connections 2026-02-17T21:27:00.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.773+0000 7fba63b2c640 1 -- 10.20.193.5:0/281518797 wait complete. 2026-02-17T21:27:00.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:00.773+0000 7fba63b2c640 1 librados: shutdown 2026-02-17T21:27:03.784 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:27:03.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.855+0000 7f0b2c3a9640 10 monclient: get_monmap_and_config 2026-02-17T21:27:03.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.855+0000 7f0b2c3a9640 10 monclient: build_initial_monmap 2026-02-17T21:27:03.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.855+0000 7f0b2c3a9640 10 monclient: monmap: 2026-02-17T21:27:03.858 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:03.858 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:03.858 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:27:03.856348+0000 2026-02-17T21:27:03.858 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:27:03.856348+0000 2026-02-17T21:27:03.858 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:03.858 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:03.858 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:27:03.858 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:27:03.858 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:27:03.859 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:27:03.859 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:27:03.859 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:27:03.859 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:03.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.856+0000 7f0b2c3a9640 1 Processor -- start 2026-02-17T21:27:03.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.856+0000 7f0b2c3a9640 1 -- start start 2026-02-17T21:27:03.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.856+0000 7f0b2c3a9640 10 monclient: init 2026-02-17T21:27:03.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.856+0000 7f0b2c3a9640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:03.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.856+0000 7f0b2c3a9640 10 monclient: _add_conns ranks=[5,0,1,2,4,3] 2026-02-17T21:27:03.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.856+0000 7f0b2c3a9640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f0b240c7170 0x7f0b240c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:03.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.856+0000 7f0b2c3a9640 10 monclient(hunting): picked mon.noname-c con 0x7f0b240c7170 addr v2:10.20.193.135:3300/0 2026-02-17T21:27:03.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.856+0000 7f0b2c3a9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0b240c48c0 addr v1:10.20.193.5:6789/0 2026-02-17T21:27:03.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.856+0000 7f0b2c3a9640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f0b240c4d10 addr v1:10.20.193.119:6789/0 2026-02-17T21:27:03.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.856+0000 7f0b2c3a9640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b2415a9a0 con 0x7f0b240c48c0 2026-02-17T21:27:03.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.856+0000 7f0b2c3a9640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b240c5270 con 0x7f0b240c4d10 2026-02-17T21:27:03.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.856+0000 7f0b2c3a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:03.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.856+0000 7f0b2c3a9640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0b240c8530 con 0x7f0b240c7170 2026-02-17T21:27:03.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.856+0000 7f0b2c3a9640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:03.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.856+0000 7f0b2c3a9640 10 monclient(hunting): authenticate will time out at 1129.421762s 2026-02-17T21:27:03.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.857+0000 7f0b2a91f640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f0b240c4d10 0x7f0b240c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:34166/0 (socket says 10.20.193.5:34166) 2026-02-17T21:27:03.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.857+0000 7f0b2991d640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f0b240c48c0 0x7f0b240749b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:48098/0 (socket says 10.20.193.5:48098) 2026-02-17T21:27:03.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.857+0000 7f0b2a91f640 1 -- 10.20.193.5:0/2634583885 learned_addr learned my addr 10.20.193.5:0/2634583885 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:27:03.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.857+0000 7f0b2a11e640 1 --2- 10.20.193.5:0/2634583885 >> v2:10.20.193.135:3300/0 conn(0x7f0b240c7170 0x7f0b240c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:03.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.857+0000 7f0b2a11e640 10 monclient(hunting): get_auth_request con 0x7f0b240c7170 auth_method 0 2026-02-17T21:27:03.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.857+0000 7f0b2a11e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:03.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.857+0000 7f0b2a11e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:03.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.857+0000 7f0b2a11e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:03.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.857+0000 7f0b2a11e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:03.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.857+0000 7f0b2a11e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:03.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.857+0000 7f0b2a11e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:03.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.858+0000 7f0b2911c640 1 -- 10.20.193.5:0/2634583885 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2371510530 0 0) 0x7f0b2415a9a0 con 0x7f0b240c48c0 2026-02-17T21:27:03.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.858+0000 7f0b2911c640 10 monclient(hunting): _negotiate 2026-02-17T21:27:03.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.858+0000 7f0b2911c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:03.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.858+0000 7f0b2911c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:03.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.858+0000 7f0b2911c640 10 monclient(hunting): my global_id is 4737 2026-02-17T21:27:03.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.858+0000 7f0b2911c640 1 -- 10.20.193.5:0/2634583885 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b0c003620 con 0x7f0b240c48c0 2026-02-17T21:27:03.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.858+0000 7f0b2911c640 1 -- 10.20.193.5:0/2634583885 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3277853533 0 0) 0x7f0b240c5270 con 0x7f0b240c4d10 2026-02-17T21:27:03.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.858+0000 7f0b2911c640 10 monclient(hunting): _negotiate 2026-02-17T21:27:03.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.858+0000 7f0b2911c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:03.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.858+0000 7f0b2911c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:03.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.858+0000 7f0b2911c640 10 monclient(hunting): my global_id is 4753 2026-02-17T21:27:03.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.858+0000 7f0b2911c640 1 -- 10.20.193.5:0/2634583885 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b2415a9a0 con 0x7f0b240c4d10 2026-02-17T21:27:03.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.858+0000 7f0b2a11e640 10 monclient(hunting): handle_auth_done global_id 4766 payload 274 2026-02-17T21:27:03.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.858+0000 7f0b2a11e640 1 -- 10.20.193.5:0/2634583885 >> v1:10.20.193.119:6789/0 conn(0x7f0b240c4d10 legacy=0x7f0b240c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:03.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.858+0000 7f0b2a11e640 1 -- 10.20.193.5:0/2634583885 >> v1:10.20.193.5:6789/0 conn(0x7f0b240c48c0 legacy=0x7f0b240749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:03.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.858+0000 7f0b2a11e640 10 monclient: _finish_hunting 0 2026-02-17T21:27:03.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.858+0000 7f0b2a11e640 1 monclient: found mon.noname-c 2026-02-17T21:27:03.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.858+0000 7f0b2a11e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:03.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.858+0000 7f0b2a11e640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:27:03.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.858+0000 7f0b2a11e640 1 -- 10.20.193.5:0/2634583885 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b240c5550 con 0x7f0b240c7170 2026-02-17T21:27:03.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.859+0000 7f0b2a11e640 1 --2- 10.20.193.5:0/2634583885 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0b240c7170 0x7f0b240c7550 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0b140098a0 tx=0x7f0b1402ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7b2cb1e37a26e00 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:03.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.861+0000 7f0b2911c640 1 -- 10.20.193.5:0/2634583885 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1403c070 con 0x7f0b240c7170 2026-02-17T21:27:03.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.861+0000 7f0b2911c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:03.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.861+0000 7f0b2911c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:27:03.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.861+0000 7f0b2911c640 10 monclient: dump: 2026-02-17T21:27:03.874 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:03.874 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:03.874 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:03.874 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:03.874 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:03.874 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:03.874 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:03.874 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:03.874 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:03.874 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:03.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.861+0000 7f0b2911c640 10 monclient: _finish_auth 0 2026-02-17T21:27:03.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.861+0000 7f0b2911c640 10 monclient: _check_auth_tickets 2026-02-17T21:27:03.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.861+0000 7f0b2911c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:03.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.861+0000 7f0b2911c640 1 -- 10.20.193.5:0/2634583885 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b1402fb70 con 0x7f0b240c7170 2026-02-17T21:27:03.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.861+0000 7f0b2911c640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:03.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.861+0000 7f0b2c3a9640 5 monclient: authenticate success, global_id 4766 2026-02-17T21:27:03.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.861+0000 7f0b2911c640 1 -- 10.20.193.5:0/2634583885 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b14037440 con 0x7f0b240c7170 2026-02-17T21:27:03.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.861+0000 7f0b2c3a9640 10 monclient: get_monmap_and_config success 2026-02-17T21:27:03.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.861+0000 7f0b2c3a9640 4 set_mon_vals no callback set 2026-02-17T21:27:03.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.861+0000 7f0b2911c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:03.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.861+0000 7f0b2911c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:27:03.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.861+0000 7f0b2911c640 10 monclient: dump: 2026-02-17T21:27:03.876 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:03.876 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:03.876 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:03.876 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:03.876 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:03.876 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:03.876 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:03.876 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:03.876 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:03.876 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:03.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.862+0000 7f0b2c3a9640 10 monclient: shutdown 2026-02-17T21:27:03.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.862+0000 7f0b2c3a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:03.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.862+0000 7f0b2c3a9640 1 -- 10.20.193.5:0/2634583885 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0b240c7170 msgr2=0x7f0b240c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:03.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.862+0000 7f0b2c3a9640 1 --2- 10.20.193.5:0/2634583885 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0b240c7170 0x7f0b240c7550 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0b140098a0 tx=0x7f0b1402ee60 comp rx=0 tx=0).stop 2026-02-17T21:27:03.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.862+0000 7f0b2c3a9640 1 -- 10.20.193.5:0/2634583885 shutdown_connections 2026-02-17T21:27:03.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.862+0000 7f0b2c3a9640 1 --2- 10.20.193.5:0/2634583885 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0b240c7170 0x7f0b240c7550 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:03.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.862+0000 7f0b2c3a9640 1 -- 10.20.193.5:0/2634583885 >> 10.20.193.5:0/2634583885 conn(0x7f0b240c9f40 msgr2=0x7f0b240ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:03.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.862+0000 7f0b2c3a9640 1 -- 10.20.193.5:0/2634583885 shutdown_connections 2026-02-17T21:27:03.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.862+0000 7f0b2c3a9640 1 -- 10.20.193.5:0/2634583885 wait complete. 2026-02-17T21:27:03.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.862+0000 7f0b2c3a9640 10 monclient: build_initial_monmap 2026-02-17T21:27:03.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.862+0000 7f0b2c3a9640 10 monclient: monmap: 2026-02-17T21:27:03.877 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:03.878 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:27:03.878 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:27:03.878 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:27:03.878 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:03.878 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:03.878 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:27:03.878 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:27:03.878 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:27:03.878 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:03.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.863+0000 7f0b2c3a9640 1 librados: starting msgr at 2026-02-17T21:27:03.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.863+0000 7f0b2c3a9640 1 librados: starting objecter 2026-02-17T21:27:03.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.863+0000 7f0b2c3a9640 1 Processor -- start 2026-02-17T21:27:03.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.863+0000 7f0b2c3a9640 1 -- start start 2026-02-17T21:27:03.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.863+0000 7f0b2c3a9640 1 librados: setting wanted keys 2026-02-17T21:27:03.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.863+0000 7f0b2c3a9640 1 librados: calling monclient init 2026-02-17T21:27:03.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.863+0000 7f0b2c3a9640 10 monclient: init 2026-02-17T21:27:03.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.863+0000 7f0b2c3a9640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:03.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.863+0000 7f0b2c3a9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:27:03.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.863+0000 7f0b2c3a9640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0b240c48c0 0x7f0b24155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:03.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.863+0000 7f0b2c3a9640 10 monclient(hunting): picked mon.noname-b con 0x7f0b240c48c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:27:03.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.863+0000 7f0b2c3a9640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0b240c4d10 0x7f0b24159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:03.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.863+0000 7f0b2c3a9640 10 monclient(hunting): picked mon.noname-a con 0x7f0b240c4d10 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:27:03.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.863+0000 7f0b2c3a9640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0b240c7170 0x7f0b241f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:03.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.863+0000 7f0b2c3a9640 10 monclient(hunting): picked mon.noname-c con 0x7f0b240c7170 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:27:03.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.863+0000 7f0b2c3a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:03.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.863+0000 7f0b2c3a9640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0b240c81c0 con 0x7f0b240c4d10 2026-02-17T21:27:03.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.863+0000 7f0b2c3a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:03.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.863+0000 7f0b2c3a9640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0b240c7ee0 con 0x7f0b240c48c0 2026-02-17T21:27:03.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.863+0000 7f0b2c3a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:03.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.863+0000 7f0b2c3a9640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0b240750c0 con 0x7f0b240c7170 2026-02-17T21:27:03.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.863+0000 7f0b2c3a9640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:03.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.863+0000 7f0b2c3a9640 10 monclient(hunting): authenticate will time out at 1129.428609s 2026-02-17T21:27:03.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.863+0000 7f0b2991d640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0b240c4d10 0x7f0b24159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:03.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.864+0000 7f0b2a11e640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0b240c48c0 0x7f0b24155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:03.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.864+0000 7f0b2a91f640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0b240c7170 0x7f0b241f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:03.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.864+0000 7f0b2991d640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0b240c4d10 0x7f0b24159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:50284/0 (socket says 10.20.193.5:50284) 2026-02-17T21:27:03.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.864+0000 7f0b2991d640 1 -- 10.20.193.5:0/4264967196 learned_addr learned my addr 10.20.193.5:0/4264967196 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:27:03.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.864+0000 7f0b2991d640 10 monclient(hunting): get_auth_request con 0x7f0b240c4d10 auth_method 0 2026-02-17T21:27:03.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.864+0000 7f0b2991d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:03.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.864+0000 7f0b2991d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:03.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.864+0000 7f0b2991d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:03.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.864+0000 7f0b2a91f640 10 monclient(hunting): get_auth_request con 0x7f0b240c7170 auth_method 0 2026-02-17T21:27:03.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.864+0000 7f0b2a91f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:03.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.864+0000 7f0b2a91f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:03.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.864+0000 7f0b2a91f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:03.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.864+0000 7f0b2a11e640 10 monclient(hunting): get_auth_request con 0x7f0b240c48c0 auth_method 0 2026-02-17T21:27:03.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.864+0000 7f0b2a11e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:03.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.864+0000 7f0b2a11e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:03.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.864+0000 7f0b2a11e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:03.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.864+0000 7f0b2991d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:03.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.864+0000 7f0b2991d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:03.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.864+0000 7f0b2991d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:03.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.864+0000 7f0b2a91f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:03.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.864+0000 7f0b2a91f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:03.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.864+0000 7f0b2a91f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:03.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.864+0000 7f0b2a11e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:03.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.864+0000 7f0b2a11e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:03.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.864+0000 7f0b2a11e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:03.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.865+0000 7f0b2991d640 10 monclient(hunting): handle_auth_done global_id 4740 payload 824 2026-02-17T21:27:03.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.865+0000 7f0b2991d640 1 -- 10.20.193.5:0/4264967196 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0b240c7170 msgr2=0x7f0b241f4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:03.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.865+0000 7f0b2991d640 1 --2- 10.20.193.5:0/4264967196 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0b240c7170 0x7f0b241f4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:03.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.865+0000 7f0b2991d640 1 -- 10.20.193.5:0/4264967196 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0b240c48c0 msgr2=0x7f0b24155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:03.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.865+0000 7f0b2991d640 1 --2- 10.20.193.5:0/4264967196 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0b240c48c0 0x7f0b24155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:03.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.865+0000 7f0b2991d640 10 monclient: _finish_hunting 0 2026-02-17T21:27:03.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.865+0000 7f0b2991d640 1 monclient: found mon.noname-a 2026-02-17T21:27:03.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.865+0000 7f0b2991d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:03.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.865+0000 7f0b2991d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:27:03.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.865+0000 7f0b2991d640 1 -- 10.20.193.5:0/4264967196 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b241563a0 con 0x7f0b240c4d10 2026-02-17T21:27:03.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.866+0000 7f0b2991d640 1 --2- 10.20.193.5:0/4264967196 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0b240c4d10 0x7f0b24159280 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0b1800c700 tx=0x7f0b1800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:03.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.866+0000 7f0b0affd640 10 client.?.objecter ms_handle_connect 0x7f0b240c4d10 2026-02-17T21:27:03.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.866+0000 7f0b0affd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:27:03.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.867+0000 7f0b0affd640 1 -- 10.20.193.5:0/4264967196 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b18004ae0 con 0x7f0b240c4d10 2026-02-17T21:27:03.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.867+0000 7f0b0affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:03.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.867+0000 7f0b0affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:27:03.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.867+0000 7f0b0affd640 10 monclient: dump: 2026-02-17T21:27:03.884 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:03.884 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:03.885 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:03.885 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:03.885 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:03.885 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:03.885 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:03.885 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:03.885 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:03.885 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:03.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.867+0000 7f0b0affd640 10 monclient: _finish_auth 0 2026-02-17T21:27:03.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.867+0000 7f0b0affd640 10 monclient: _check_auth_tickets 2026-02-17T21:27:03.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.867+0000 7f0b0affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:03.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.867+0000 7f0b2c3a9640 5 monclient: authenticate success, global_id 4740 2026-02-17T21:27:03.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.867+0000 7f0b2c3a9640 10 monclient: _renew_subs 2026-02-17T21:27:03.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.867+0000 7f0b2c3a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:27:03.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.867+0000 7f0b2c3a9640 1 -- 10.20.193.5:0/4264967196 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b24156680 con 0x7f0b240c4d10 2026-02-17T21:27:03.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.867+0000 7f0b2c3a9640 10 client.4740.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:27:03.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.867+0000 7f0b2c3a9640 10 monclient: _renew_subs 2026-02-17T21:27:03.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.867+0000 7f0b2c3a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:27:03.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.867+0000 7f0b2c3a9640 1 -- 10.20.193.5:0/4264967196 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b24156c40 con 0x7f0b240c4d10 2026-02-17T21:27:03.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.867+0000 7f0b2c3a9640 1 librados: init done 2026-02-17T21:27:03.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.868+0000 7f0b2c3a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:03.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.868+0000 7f0b2c3a9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:03.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.868+0000 7f0b2c3a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:27:03.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.868+0000 7f0b2c3a9640 1 -- 10.20.193.5:0/4264967196 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b240c7550 con 0x7f0b240c4d10 2026-02-17T21:27:03.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.869+0000 7f0b0affd640 1 -- 10.20.193.5:0/4264967196 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b18004c80 con 0x7f0b240c4d10 2026-02-17T21:27:03.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.869+0000 7f0b0affd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:03.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.869+0000 7f0b0affd640 1 -- 10.20.193.5:0/4264967196 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b18007270 con 0x7f0b240c4d10 2026-02-17T21:27:03.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.869+0000 7f0b0affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:03.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.869+0000 7f0b0affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:27:03.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.869+0000 7f0b0affd640 10 monclient: dump: 2026-02-17T21:27:03.887 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:03.887 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:03.887 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:03.887 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:03.888 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:03.888 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:03.888 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:03.888 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:03.888 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:03.888 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:03.888 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.869+0000 7f0b2891b640 4 set_mon_vals no callback set 2026-02-17T21:27:03.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.973+0000 7f0b0affd640 1 -- 10.20.193.5:0/4264967196 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f0b18007410 con 0x7f0b240c4d10 2026-02-17T21:27:03.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.973+0000 7f0b0affd640 1 --2- 10.20.193.5:0/4264967196 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0af4079280 0x7f0af407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:03.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.973+0000 7f0b2a11e640 1 --2- 10.20.193.5:0/4264967196 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0af4079280 0x7f0af407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:03.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.974+0000 7f0b2a11e640 10 monclient: get_auth_request con 0x7f0af4079280 auth_method 0 2026-02-17T21:27:03.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.974+0000 7f0b2a11e640 1 --2- 10.20.193.5:0/4264967196 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0af4079280 0x7f0af407b740 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0b14039000 tx=0x7f0b14033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:03.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.974+0000 7f0b0affd640 10 client.4740.objecter ms_handle_connect 0x7f0af4079280 2026-02-17T21:27:03.982 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.981+0000 7f0b0affd640 1 -- 10.20.193.5:0/4264967196 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f0b18007730 con 0x7f0b240c4d10 2026-02-17T21:27:03.982 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.981+0000 7f0b0affd640 10 client.4740.objecter ms_dispatch2 0x7f0b24000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:27:03.983 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.981+0000 7f0b0affd640 3 client.4740.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:27:03.983 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.981+0000 7f0b0affd640 3 client.4740.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:27:03.983 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.981+0000 7f0b0affd640 20 client.4740.objecter dump_active .. 0 homeless 2026-02-17T21:27:03.983 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.981+0000 7f0b0affd640 1 -- 10.20.193.5:0/4264967196 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0b18021070 con 0x7f0b240c4d10 2026-02-17T21:27:03.983 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.981+0000 7f0b0affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:03.983 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:03.981+0000 7f0b0affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:27:04.084 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.083+0000 7f0b2c3a9640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:27:04.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.083+0000 7f0b2c3a9640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:04.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.083+0000 7f0b2c3a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:27:04.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.083+0000 7f0b2c3a9640 1 -- 10.20.193.5:0/4264967196 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0b241579d0 con 0x7f0b240c4d10 2026-02-17T21:27:04.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.085+0000 7f0b0affd640 1 -- 10.20.193.5:0/4264967196 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f0b18061ea0 con 0x7f0b240c4d10 2026-02-17T21:27:04.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.085+0000 7f0b0affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:04.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.085+0000 7f0b0affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:27:04.087 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:27:04.087 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:27:04.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.086+0000 7f0b2c3a9640 10 librados: watch_flush enter 2026-02-17T21:27:04.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.086+0000 7f0b2c3a9640 10 librados: watch_flush exit 2026-02-17T21:27:04.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.086+0000 7f0b2c3a9640 20 client.4740.objecter shutdown clearing up homeless session... 2026-02-17T21:27:04.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.086+0000 7f0b2c3a9640 10 client.4740.objecter successfully canceled tick 2026-02-17T21:27:04.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.086+0000 7f0b2c3a9640 1 -- 10.20.193.5:0/4264967196 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0af4079280 msgr2=0x7f0af407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:04.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.086+0000 7f0b2c3a9640 1 --2- 10.20.193.5:0/4264967196 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0af4079280 0x7f0af407b740 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0b14039000 tx=0x7f0b14033000 comp rx=0 tx=0).stop 2026-02-17T21:27:04.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.086+0000 7f0b2c3a9640 10 monclient: shutdown 2026-02-17T21:27:04.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.086+0000 7f0b2c3a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:04.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.086+0000 7f0b2c3a9640 1 -- 10.20.193.5:0/4264967196 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0b240c4d10 msgr2=0x7f0b24159280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:04.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.086+0000 7f0b2c3a9640 1 --2- 10.20.193.5:0/4264967196 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0b240c4d10 0x7f0b24159280 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0b1800c700 tx=0x7f0b1800cbd0 comp rx=0 tx=0).stop 2026-02-17T21:27:04.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.086+0000 7f0b2c3a9640 1 -- 10.20.193.5:0/4264967196 shutdown_connections 2026-02-17T21:27:04.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.086+0000 7f0b2c3a9640 1 --2- 10.20.193.5:0/4264967196 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0af4079280 0x7f0af407b740 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:04.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.086+0000 7f0b2c3a9640 1 --2- 10.20.193.5:0/4264967196 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0b240c7170 0x7f0b241f4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:04.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.086+0000 7f0b2c3a9640 1 --2- 10.20.193.5:0/4264967196 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0b240c4d10 0x7f0b24159280 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:04.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.086+0000 7f0b2c3a9640 1 --2- 10.20.193.5:0/4264967196 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0b240c48c0 0x7f0b24155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:04.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.086+0000 7f0b2c3a9640 1 -- 10.20.193.5:0/4264967196 >> 10.20.193.5:0/4264967196 conn(0x7f0b240c9f40 msgr2=0x7f0b240ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:04.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.086+0000 7f0b2c3a9640 1 -- 10.20.193.5:0/4264967196 shutdown_connections 2026-02-17T21:27:04.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.086+0000 7f0b2c3a9640 1 -- 10.20.193.5:0/4264967196 wait complete. 2026-02-17T21:27:04.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:04.086+0000 7f0b2c3a9640 1 librados: shutdown 2026-02-17T21:27:07.097 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:27:07.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.165+0000 7f1596856640 10 monclient: get_monmap_and_config 2026-02-17T21:27:07.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.165+0000 7f1596856640 10 monclient: build_initial_monmap 2026-02-17T21:27:07.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.165+0000 7f1596856640 10 monclient: monmap: 2026-02-17T21:27:07.167 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:07.167 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:07.167 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:27:07.166640+0000 2026-02-17T21:27:07.167 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:27:07.166640+0000 2026-02-17T21:27:07.167 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:07.167 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:07.167 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:27:07.167 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:27:07.167 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:27:07.167 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:27:07.167 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:27:07.167 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:27:07.168 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:07.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.166+0000 7f1596856640 1 Processor -- start 2026-02-17T21:27:07.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.166+0000 7f1596856640 1 -- start start 2026-02-17T21:27:07.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.166+0000 7f1596856640 10 monclient: init 2026-02-17T21:27:07.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.166+0000 7f1596856640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:07.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.166+0000 7f1596856640 10 monclient: _add_conns ranks=[1,4,3,5,0,2] 2026-02-17T21:27:07.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.166+0000 7f1596856640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f159014f280 addr v1:10.20.193.119:6789/0 2026-02-17T21:27:07.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.166+0000 7f1596856640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f159014f660 0x7f15900c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:07.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.166+0000 7f1596856640 10 monclient(hunting): picked mon.noname-b con 0x7f159014f660 addr v2:10.20.193.119:3300/0 2026-02-17T21:27:07.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.166+0000 7f1596856640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f159015abc0 0x7f159015afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:07.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.166+0000 7f1596856640 10 monclient(hunting): picked mon.noname-a con 0x7f159015abc0 addr v2:10.20.193.5:3300/0 2026-02-17T21:27:07.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.166+0000 7f1596856640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15900c7390 con 0x7f159014f280 2026-02-17T21:27:07.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.166+0000 7f1596856640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:07.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.166+0000 7f1596856640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f15900c7950 con 0x7f159015abc0 2026-02-17T21:27:07.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.166+0000 7f1596856640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:07.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.166+0000 7f1596856640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f15900c8530 con 0x7f159014f660 2026-02-17T21:27:07.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.166+0000 7f1596856640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:07.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.166+0000 7f1596856640 10 monclient(hunting): authenticate will time out at 1132.731985s 2026-02-17T21:27:07.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.167+0000 7f1594dcc640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f159015abc0 0x7f159015afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:07.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.167+0000 7f158f7fe640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f159014f660 0x7f15900c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:07.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.167+0000 7f1594dcc640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f159015abc0 0x7f159015afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:50294/0 (socket says 10.20.193.5:50294) 2026-02-17T21:27:07.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.167+0000 7f1594dcc640 1 -- 10.20.193.5:0/2094464801 learned_addr learned my addr 10.20.193.5:0/2094464801 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:27:07.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.167+0000 7f1594dcc640 10 monclient(hunting): get_auth_request con 0x7f159015abc0 auth_method 0 2026-02-17T21:27:07.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.167+0000 7f1594dcc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:07.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.167+0000 7f1594dcc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:07.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.167+0000 7f1594dcc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:07.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.167+0000 7f1594dcc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:07.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.167+0000 7f1594dcc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:07.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.167+0000 7f1594dcc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:07.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.167+0000 7f158f7fe640 10 monclient(hunting): get_auth_request con 0x7f159014f660 auth_method 0 2026-02-17T21:27:07.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.168+0000 7f158f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:07.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.168+0000 7f158f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:07.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.168+0000 7f158f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:07.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.168+0000 7f158f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:07.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.168+0000 7f158f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:07.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.168+0000 7f158f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:07.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.168+0000 7f1594dcc640 10 monclient(hunting): handle_auth_done global_id 4743 payload 274 2026-02-17T21:27:07.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.168+0000 7f1594dcc640 1 -- 10.20.193.5:0/2094464801 >> v2:10.20.193.119:3300/0 conn(0x7f159014f660 msgr2=0x7f15900c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:27:07.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.168+0000 7f1594dcc640 1 --2- 10.20.193.5:0/2094464801 >> v2:10.20.193.119:3300/0 conn(0x7f159014f660 0x7f15900c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:07.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.168+0000 7f1594dcc640 1 -- 10.20.193.5:0/2094464801 >> v1:10.20.193.119:6789/0 conn(0x7f159014f280 legacy=0x7f15900c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:07.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.168+0000 7f1594dcc640 10 monclient: _finish_hunting 0 2026-02-17T21:27:07.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.168+0000 7f1594dcc640 1 monclient: found mon.noname-a 2026-02-17T21:27:07.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.168+0000 7f1594dcc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:07.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.168+0000 7f1594dcc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:27:07.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.168+0000 7f1594dcc640 1 -- 10.20.193.5:0/2094464801 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15900c7670 con 0x7f159015abc0 2026-02-17T21:27:07.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.169+0000 7f1594dcc640 1 --2- 10.20.193.5:0/2094464801 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f159015abc0 0x7f159015afe0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1590153310 tx=0x7f158402f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f7dbb6c717f23c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:07.177 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.171+0000 7f158effd640 1 -- 10.20.193.5:0/2094464801 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158402fe10 con 0x7f159015abc0 2026-02-17T21:27:07.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.171+0000 7f158effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:07.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.171+0000 7f158effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:27:07.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.171+0000 7f158effd640 10 monclient: dump: 2026-02-17T21:27:07.178 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:07.178 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:07.178 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:07.178 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:07.178 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:07.178 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:07.178 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:07.179 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:07.179 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:07.179 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:07.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.171+0000 7f158effd640 10 monclient: _finish_auth 0 2026-02-17T21:27:07.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.171+0000 7f158effd640 10 monclient: _check_auth_tickets 2026-02-17T21:27:07.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.171+0000 7f158effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:07.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.171+0000 7f158effd640 1 -- 10.20.193.5:0/2094464801 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15840373f0 con 0x7f159015abc0 2026-02-17T21:27:07.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.171+0000 7f158effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:07.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.171+0000 7f1596856640 5 monclient: authenticate success, global_id 4743 2026-02-17T21:27:07.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.171+0000 7f158effd640 1 -- 10.20.193.5:0/2094464801 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15840377c0 con 0x7f159015abc0 2026-02-17T21:27:07.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.171+0000 7f1596856640 10 monclient: get_monmap_and_config success 2026-02-17T21:27:07.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.171+0000 7f1596856640 4 set_mon_vals no callback set 2026-02-17T21:27:07.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.171+0000 7f158effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:07.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.171+0000 7f158effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:27:07.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.171+0000 7f158effd640 10 monclient: dump: 2026-02-17T21:27:07.180 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:07.180 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:07.180 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:07.180 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:07.180 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:07.180 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:07.180 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:07.181 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:07.181 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:07.181 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:07.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.172+0000 7f1596856640 10 monclient: shutdown 2026-02-17T21:27:07.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.172+0000 7f1596856640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:07.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.172+0000 7f1596856640 1 -- 10.20.193.5:0/2094464801 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f159015abc0 msgr2=0x7f159015afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:07.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.172+0000 7f1596856640 1 --2- 10.20.193.5:0/2094464801 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f159015abc0 0x7f159015afe0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1590153310 tx=0x7f158402f310 comp rx=0 tx=0).stop 2026-02-17T21:27:07.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.172+0000 7f1596856640 1 -- 10.20.193.5:0/2094464801 shutdown_connections 2026-02-17T21:27:07.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.172+0000 7f1596856640 1 --2- 10.20.193.5:0/2094464801 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f159015abc0 0x7f159015afe0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:07.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.172+0000 7f1596856640 1 --2- 10.20.193.5:0/2094464801 >> v2:10.20.193.119:3300/0 conn(0x7f159014f660 0x7f15900c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:07.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.172+0000 7f1596856640 1 -- 10.20.193.5:0/2094464801 >> 10.20.193.5:0/2094464801 conn(0x7f15900c9f20 msgr2=0x7f15900ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:07.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.172+0000 7f1596856640 1 -- 10.20.193.5:0/2094464801 shutdown_connections 2026-02-17T21:27:07.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.172+0000 7f1596856640 1 -- 10.20.193.5:0/2094464801 wait complete. 2026-02-17T21:27:07.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.172+0000 7f1596856640 10 monclient: build_initial_monmap 2026-02-17T21:27:07.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.172+0000 7f1596856640 10 monclient: monmap: 2026-02-17T21:27:07.182 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:07.182 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:27:07.182 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:27:07.182 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:27:07.182 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:07.182 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:07.182 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:27:07.182 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:27:07.183 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:27:07.183 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:07.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.172+0000 7f1596856640 1 librados: starting msgr at 2026-02-17T21:27:07.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.172+0000 7f1596856640 1 librados: starting objecter 2026-02-17T21:27:07.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.172+0000 7f1596856640 1 Processor -- start 2026-02-17T21:27:07.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.172+0000 7f1596856640 1 -- start start 2026-02-17T21:27:07.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.172+0000 7f1596856640 1 librados: setting wanted keys 2026-02-17T21:27:07.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.172+0000 7f1596856640 1 librados: calling monclient init 2026-02-17T21:27:07.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.172+0000 7f1596856640 10 monclient: init 2026-02-17T21:27:07.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1596856640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:07.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1596856640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:27:07.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1596856640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f159014f280 0x7f15901f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:07.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1596856640 10 monclient(hunting): picked mon.noname-c con 0x7f159014f280 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:27:07.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1596856640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f159014f660 0x7f159006e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:07.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1596856640 10 monclient(hunting): picked mon.noname-b con 0x7f159014f660 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:27:07.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1596856640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f159015abc0 0x7f1590152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:07.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1596856640 10 monclient(hunting): picked mon.noname-a con 0x7f159015abc0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:27:07.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1596856640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:07.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1596856640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f159015a3c0 con 0x7f159015abc0 2026-02-17T21:27:07.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1596856640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:07.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1596856640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f159015a730 con 0x7f159014f660 2026-02-17T21:27:07.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1596856640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:07.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1596856640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f159015b520 con 0x7f159014f280 2026-02-17T21:27:07.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1596856640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:07.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1596856640 10 monclient(hunting): authenticate will time out at 1132.738290s 2026-02-17T21:27:07.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1594dcc640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f159015abc0 0x7f1590152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:07.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f158f7fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f159014f660 0x7f159006e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:07.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1594dcc640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f159015abc0 0x7f1590152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:34924/0 (socket says 10.20.193.5:34924) 2026-02-17T21:27:07.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1594dcc640 1 -- 10.20.193.5:0/54458369 learned_addr learned my addr 10.20.193.5:0/54458369 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:27:07.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1594dcc640 10 monclient(hunting): get_auth_request con 0x7f159015abc0 auth_method 0 2026-02-17T21:27:07.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1594dcc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:07.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1594dcc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:07.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1594dcc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:07.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f158f7fe640 10 monclient(hunting): get_auth_request con 0x7f159014f660 auth_method 0 2026-02-17T21:27:07.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f158f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:07.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f158f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:07.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f158f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:07.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f158ffff640 1 --2- 10.20.193.5:0/54458369 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f159014f280 0x7f15901f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:07.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1594dcc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:07.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1594dcc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:07.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f1594dcc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:07.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f158f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:07.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f158f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:07.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.173+0000 7f158f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:07.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.174+0000 7f158ffff640 10 monclient(hunting): get_auth_request con 0x7f159014f280 auth_method 0 2026-02-17T21:27:07.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.174+0000 7f158ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:07.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.174+0000 7f158ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:07.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.174+0000 7f158ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:07.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.174+0000 7f158ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:07.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.174+0000 7f158ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:07.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.174+0000 7f158ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:07.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.175+0000 7f1594dcc640 10 monclient(hunting): handle_auth_done global_id 4746 payload 824 2026-02-17T21:27:07.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.175+0000 7f1594dcc640 1 -- 10.20.193.5:0/54458369 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f159014f280 msgr2=0x7f15901f63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:07.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.175+0000 7f1594dcc640 1 --2- 10.20.193.5:0/54458369 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f159014f280 0x7f15901f63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:07.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.175+0000 7f1594dcc640 1 -- 10.20.193.5:0/54458369 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f159014f660 msgr2=0x7f159006e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:07.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.175+0000 7f1594dcc640 1 --2- 10.20.193.5:0/54458369 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f159014f660 0x7f159006e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:07.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.175+0000 7f1594dcc640 10 monclient: _finish_hunting 0 2026-02-17T21:27:07.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.175+0000 7f1594dcc640 1 monclient: found mon.noname-a 2026-02-17T21:27:07.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.175+0000 7f1594dcc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:07.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.175+0000 7f1594dcc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:27:07.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.175+0000 7f1594dcc640 1 -- 10.20.193.5:0/54458369 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f159006d3b0 con 0x7f159015abc0 2026-02-17T21:27:07.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.176+0000 7f1594dcc640 1 --2- 10.20.193.5:0/54458369 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f159015abc0 0x7f1590152380 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f158402f840 tx=0x7f1584004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:07.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.176+0000 7f158cff9640 10 client.?.objecter ms_handle_connect 0x7f159015abc0 2026-02-17T21:27:07.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.176+0000 7f158cff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:27:07.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f158cff9640 1 -- 10.20.193.5:0/54458369 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584046020 con 0x7f159015abc0 2026-02-17T21:27:07.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f158cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:07.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f158cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:27:07.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f158cff9640 10 monclient: dump: 2026-02-17T21:27:07.191 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:07.191 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:07.191 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:07.191 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:07.192 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:07.192 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:07.192 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:07.192 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:07.192 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:07.192 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:07.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f158cff9640 10 monclient: _finish_auth 0 2026-02-17T21:27:07.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f158cff9640 10 monclient: _check_auth_tickets 2026-02-17T21:27:07.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f158cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:07.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f158cff9640 1 -- 10.20.193.5:0/54458369 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1584041660 con 0x7f159015abc0 2026-02-17T21:27:07.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f158cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:07.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f158cff9640 1 -- 10.20.193.5:0/54458369 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584041a70 con 0x7f159015abc0 2026-02-17T21:27:07.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f158cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:07.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f158cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:27:07.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f158e7fc640 4 set_mon_vals no callback set 2026-02-17T21:27:07.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f158cff9640 10 monclient: dump: 2026-02-17T21:27:07.193 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:07.193 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:07.193 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:07.193 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:07.193 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:07.193 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:07.194 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:07.194 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:07.194 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:07.194 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:07.194 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f1596856640 5 monclient: authenticate success, global_id 4746 2026-02-17T21:27:07.194 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f1596856640 10 monclient: _renew_subs 2026-02-17T21:27:07.194 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f1596856640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:27:07.194 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f1596856640 1 -- 10.20.193.5:0/54458369 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f159006d690 con 0x7f159015abc0 2026-02-17T21:27:07.194 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f1596856640 10 client.4746.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:27:07.194 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f1596856640 10 monclient: _renew_subs 2026-02-17T21:27:07.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f1596856640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:27:07.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f1596856640 1 -- 10.20.193.5:0/54458369 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f159006dc50 con 0x7f159015abc0 2026-02-17T21:27:07.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f1596856640 1 librados: init done 2026-02-17T21:27:07.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f1596856640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:07.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f1596856640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:07.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f1596856640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:27:07.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.178+0000 7f1596856640 1 -- 10.20.193.5:0/54458369 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15900c9b70 con 0x7f159015abc0 2026-02-17T21:27:07.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.190+0000 7f158cff9640 1 -- 10.20.193.5:0/54458369 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f1584041c10 con 0x7f159015abc0 2026-02-17T21:27:07.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.190+0000 7f158cff9640 1 --2- 10.20.193.5:0/54458369 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f15600792d0 0x7f156007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:07.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.191+0000 7f158ffff640 1 --2- 10.20.193.5:0/54458369 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f15600792d0 0x7f156007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:07.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.191+0000 7f158ffff640 10 monclient: get_auth_request con 0x7f15600792d0 auth_method 0 2026-02-17T21:27:07.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.191+0000 7f158ffff640 1 --2- 10.20.193.5:0/54458369 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f15600792d0 0x7f156007b790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f159006f520 tx=0x7f157c007f30 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:07.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.191+0000 7f158cff9640 10 client.4746.objecter ms_handle_connect 0x7f15600792d0 2026-02-17T21:27:07.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.294+0000 7f158cff9640 1 -- 10.20.193.5:0/54458369 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f1584084200 con 0x7f159015abc0 2026-02-17T21:27:07.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.294+0000 7f158cff9640 10 client.4746.objecter ms_dispatch2 0x7f1590000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:27:07.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.294+0000 7f158cff9640 3 client.4746.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:27:07.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.294+0000 7f158cff9640 3 client.4746.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:27:07.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.294+0000 7f158cff9640 20 client.4746.objecter dump_active .. 0 homeless 2026-02-17T21:27:07.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.294+0000 7f158cff9640 1 -- 10.20.193.5:0/54458369 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1584050030 con 0x7f159015abc0 2026-02-17T21:27:07.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.294+0000 7f158cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:07.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.294+0000 7f158cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:27:07.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.393+0000 7f1596856640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:27:07.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.393+0000 7f1596856640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:07.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.393+0000 7f1596856640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:27:07.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.393+0000 7f1596856640 1 -- 10.20.193.5:0/54458369 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f15900c95d0 con 0x7f159015abc0 2026-02-17T21:27:07.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.396+0000 7f158cff9640 1 -- 10.20.193.5:0/54458369 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f15840881c0 con 0x7f159015abc0 2026-02-17T21:27:07.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.396+0000 7f158cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:07.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.396+0000 7f158cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:27:07.398 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:27:07.398 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:27:07.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.397+0000 7f1596856640 10 librados: watch_flush enter 2026-02-17T21:27:07.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.397+0000 7f1596856640 10 librados: watch_flush exit 2026-02-17T21:27:07.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.397+0000 7f1596856640 20 client.4746.objecter shutdown clearing up homeless session... 2026-02-17T21:27:07.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.397+0000 7f1596856640 10 client.4746.objecter successfully canceled tick 2026-02-17T21:27:07.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.397+0000 7f1596856640 1 -- 10.20.193.5:0/54458369 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f15600792d0 msgr2=0x7f156007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:07.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.397+0000 7f1596856640 1 --2- 10.20.193.5:0/54458369 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f15600792d0 0x7f156007b790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f159006f520 tx=0x7f157c007f30 comp rx=0 tx=0).stop 2026-02-17T21:27:07.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.397+0000 7f1596856640 10 monclient: shutdown 2026-02-17T21:27:07.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.397+0000 7f1596856640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:07.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.397+0000 7f1596856640 1 -- 10.20.193.5:0/54458369 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f159015abc0 msgr2=0x7f1590152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:07.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.397+0000 7f1596856640 1 --2- 10.20.193.5:0/54458369 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f159015abc0 0x7f1590152380 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f158402f840 tx=0x7f1584004b40 comp rx=0 tx=0).stop 2026-02-17T21:27:07.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.397+0000 7f1596856640 1 -- 10.20.193.5:0/54458369 shutdown_connections 2026-02-17T21:27:07.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.397+0000 7f1596856640 1 --2- 10.20.193.5:0/54458369 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f15600792d0 0x7f156007b790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:07.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.397+0000 7f1596856640 1 --2- 10.20.193.5:0/54458369 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f159015abc0 0x7f1590152380 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:07.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.397+0000 7f1596856640 1 --2- 10.20.193.5:0/54458369 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f159014f660 0x7f159006e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:07.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.397+0000 7f1596856640 1 --2- 10.20.193.5:0/54458369 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f159014f280 0x7f15901f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:07.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.397+0000 7f1596856640 1 -- 10.20.193.5:0/54458369 >> 10.20.193.5:0/54458369 conn(0x7f15900c9f20 msgr2=0x7f15900c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:07.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.397+0000 7f1596856640 1 -- 10.20.193.5:0/54458369 shutdown_connections 2026-02-17T21:27:07.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.397+0000 7f1596856640 1 -- 10.20.193.5:0/54458369 wait complete. 2026-02-17T21:27:07.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:07.397+0000 7f1596856640 1 librados: shutdown 2026-02-17T21:27:10.408 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:27:10.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.476+0000 7fd9bc72c640 10 monclient: get_monmap_and_config 2026-02-17T21:27:10.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.476+0000 7fd9bc72c640 10 monclient: build_initial_monmap 2026-02-17T21:27:10.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.476+0000 7fd9bc72c640 10 monclient: monmap: 2026-02-17T21:27:10.478 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:10.479 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:10.479 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:27:10.477033+0000 2026-02-17T21:27:10.479 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:27:10.477033+0000 2026-02-17T21:27:10.479 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:10.479 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:10.479 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:27:10.479 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:27:10.479 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:27:10.479 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:27:10.479 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:27:10.479 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:27:10.480 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:10.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.476+0000 7fd9bc72c640 1 Processor -- start 2026-02-17T21:27:10.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.476+0000 7fd9bc72c640 1 -- start start 2026-02-17T21:27:10.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.476+0000 7fd9bc72c640 10 monclient: init 2026-02-17T21:27:10.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.477+0000 7fd9bc72c640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:10.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.477+0000 7fd9bc72c640 10 monclient: _add_conns ranks=[5,2,4,1,0,3] 2026-02-17T21:27:10.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.477+0000 7fd9bc72c640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fd9b40c7170 0x7fd9b40c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:10.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.477+0000 7fd9bc72c640 10 monclient(hunting): picked mon.noname-c con 0x7fd9b40c7170 addr v2:10.20.193.135:3300/0 2026-02-17T21:27:10.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.477+0000 7fd9bc72c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd9b40c48c0 addr v1:10.20.193.135:6789/0 2026-02-17T21:27:10.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.477+0000 7fd9bc72c640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fd9b40c4d10 0x7fd9b40c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:10.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.477+0000 7fd9bc72c640 10 monclient(hunting): picked mon.noname-b con 0x7fd9b40c4d10 addr v2:10.20.193.119:3300/0 2026-02-17T21:27:10.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.477+0000 7fd9bc72c640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9b415a9a0 con 0x7fd9b40c48c0 2026-02-17T21:27:10.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.477+0000 7fd9bc72c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:10.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.477+0000 7fd9bc72c640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fd9b40c8530 con 0x7fd9b40c4d10 2026-02-17T21:27:10.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.477+0000 7fd9bc72c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:10.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.477+0000 7fd9bc72c640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd9b40c5270 con 0x7fd9b40c7170 2026-02-17T21:27:10.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.477+0000 7fd9bc72c640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:10.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.477+0000 7fd9bc72c640 10 monclient(hunting): authenticate will time out at 1136.042337s 2026-02-17T21:27:10.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.477+0000 7fd9ba4a1640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fd9b40c7170 0x7fd9b40c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:10.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.477+0000 7fd9baca2640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fd9b40c4d10 0x7fd9b40c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:10.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.477+0000 7fd9b9ca0640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7fd9b40c48c0 0x7fd9b40749b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:58968/0 (socket says 10.20.193.5:58968) 2026-02-17T21:27:10.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.477+0000 7fd9b9ca0640 1 -- 10.20.193.5:0/187710980 learned_addr learned my addr 10.20.193.5:0/187710980 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:27:10.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.477+0000 7fd9baca2640 10 monclient(hunting): get_auth_request con 0x7fd9b40c4d10 auth_method 0 2026-02-17T21:27:10.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.477+0000 7fd9baca2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:10.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.477+0000 7fd9baca2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:10.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.477+0000 7fd9baca2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:10.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.478+0000 7fd9ba4a1640 10 monclient(hunting): get_auth_request con 0x7fd9b40c7170 auth_method 0 2026-02-17T21:27:10.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.478+0000 7fd9ba4a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:10.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.478+0000 7fd9ba4a1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:10.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.478+0000 7fd9ba4a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:10.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.478+0000 7fd9baca2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:10.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.478+0000 7fd9baca2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:10.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.478+0000 7fd9baca2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:10.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.478+0000 7fd9ba4a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:10.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.478+0000 7fd9ba4a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:10.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.478+0000 7fd9ba4a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:10.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.479+0000 7fd9baca2640 10 monclient(hunting): handle_auth_done global_id 4768 payload 274 2026-02-17T21:27:10.491 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.479+0000 7fd9baca2640 1 -- 10.20.193.5:0/187710980 >> v2:10.20.193.135:3300/0 conn(0x7fd9b40c7170 msgr2=0x7fd9b40c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:27:10.491 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.479+0000 7fd9baca2640 1 --2- 10.20.193.5:0/187710980 >> v2:10.20.193.135:3300/0 conn(0x7fd9b40c7170 0x7fd9b40c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:10.491 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.479+0000 7fd9baca2640 1 -- 10.20.193.5:0/187710980 >> v1:10.20.193.135:6789/0 conn(0x7fd9b40c48c0 legacy=0x7fd9b40749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:10.491 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.479+0000 7fd9baca2640 10 monclient: _finish_hunting 0 2026-02-17T21:27:10.491 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.479+0000 7fd9baca2640 1 monclient: found mon.noname-b 2026-02-17T21:27:10.491 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.479+0000 7fd9baca2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:10.491 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.479+0000 7fd9baca2640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:27:10.491 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.479+0000 7fd9baca2640 1 -- 10.20.193.5:0/187710980 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b40c5550 con 0x7fd9b40c4d10 2026-02-17T21:27:10.491 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.480+0000 7fd9baca2640 1 --2- 10.20.193.5:0/187710980 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd9b40c4d10 0x7fd9b40c89c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd9b40723c0 tx=0x7fd9b002f1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d108762dc0f2b15 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:10.491 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.481+0000 7fd9b949f640 1 -- 10.20.193.5:0/187710980 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b003c070 con 0x7fd9b40c4d10 2026-02-17T21:27:10.491 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.481+0000 7fd9b949f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:10.492 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.481+0000 7fd9b949f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:27:10.492 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.481+0000 7fd9b949f640 10 monclient: dump: 2026-02-17T21:27:10.492 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:10.492 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:10.492 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:10.492 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:10.492 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:10.492 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:10.492 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:10.492 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:10.492 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:10.492 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:10.493 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.481+0000 7fd9b949f640 10 monclient: _finish_auth 0 2026-02-17T21:27:10.493 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.481+0000 7fd9b949f640 10 monclient: _check_auth_tickets 2026-02-17T21:27:10.493 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.481+0000 7fd9b949f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:10.493 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.481+0000 7fd9bc72c640 5 monclient: authenticate success, global_id 4768 2026-02-17T21:27:10.493 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.481+0000 7fd9bc72c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:27:10.493 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.481+0000 7fd9b949f640 1 -- 10.20.193.5:0/187710980 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9b0037440 con 0x7fd9b40c4d10 2026-02-17T21:27:10.493 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.481+0000 7fd9b949f640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:10.493 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.481+0000 7fd9b949f640 1 -- 10.20.193.5:0/187710980 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0037810 con 0x7fd9b40c4d10 2026-02-17T21:27:10.493 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.481+0000 7fd9b949f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:10.493 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.481+0000 7fd9b949f640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:27:10.493 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.481+0000 7fd9b949f640 10 monclient: dump: 2026-02-17T21:27:10.494 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:10.494 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:10.494 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:10.494 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:10.494 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:10.494 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:10.494 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:10.494 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:10.494 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:10.494 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:10.494 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.481+0000 7fd9bc72c640 10 monclient: get_monmap_and_config success 2026-02-17T21:27:10.495 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.481+0000 7fd9bc72c640 4 set_mon_vals no callback set 2026-02-17T21:27:10.495 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.482+0000 7fd9bc72c640 10 monclient: shutdown 2026-02-17T21:27:10.495 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.482+0000 7fd9bc72c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:10.495 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.482+0000 7fd9bc72c640 1 -- 10.20.193.5:0/187710980 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd9b40c4d10 msgr2=0x7fd9b40c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:10.495 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.482+0000 7fd9bc72c640 1 --2- 10.20.193.5:0/187710980 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd9b40c4d10 0x7fd9b40c89c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd9b40723c0 tx=0x7fd9b002f1c0 comp rx=0 tx=0).stop 2026-02-17T21:27:10.495 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.482+0000 7fd9bc72c640 1 -- 10.20.193.5:0/187710980 shutdown_connections 2026-02-17T21:27:10.495 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.482+0000 7fd9bc72c640 1 --2- 10.20.193.5:0/187710980 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd9b40c4d10 0x7fd9b40c89c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:10.495 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.482+0000 7fd9bc72c640 1 --2- 10.20.193.5:0/187710980 >> v2:10.20.193.135:3300/0 conn(0x7fd9b40c7170 0x7fd9b40c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:10.495 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.482+0000 7fd9bc72c640 1 -- 10.20.193.5:0/187710980 >> 10.20.193.5:0/187710980 conn(0x7fd9b40c9f40 msgr2=0x7fd9b40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:10.495 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.482+0000 7fd9bc72c640 1 -- 10.20.193.5:0/187710980 shutdown_connections 2026-02-17T21:27:10.495 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.482+0000 7fd9bc72c640 1 -- 10.20.193.5:0/187710980 wait complete. 2026-02-17T21:27:10.496 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.482+0000 7fd9bc72c640 10 monclient: build_initial_monmap 2026-02-17T21:27:10.496 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.482+0000 7fd9bc72c640 10 monclient: monmap: 2026-02-17T21:27:10.496 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:10.496 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:27:10.496 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:27:10.496 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:27:10.496 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:10.496 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:10.496 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:27:10.496 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:27:10.496 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:27:10.496 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:10.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.482+0000 7fd9bc72c640 1 librados: starting msgr at 2026-02-17T21:27:10.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.482+0000 7fd9bc72c640 1 librados: starting objecter 2026-02-17T21:27:10.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.482+0000 7fd9bc72c640 1 Processor -- start 2026-02-17T21:27:10.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.482+0000 7fd9bc72c640 1 -- start start 2026-02-17T21:27:10.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.482+0000 7fd9bc72c640 1 librados: setting wanted keys 2026-02-17T21:27:10.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.482+0000 7fd9bc72c640 1 librados: calling monclient init 2026-02-17T21:27:10.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.482+0000 7fd9bc72c640 10 monclient: init 2026-02-17T21:27:10.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9bc72c640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:10.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9bc72c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:27:10.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9bc72c640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd9b40c48c0 0x7fd9b414c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:10.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9bc72c640 10 monclient(hunting): picked mon.noname-a con 0x7fd9b40c48c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:27:10.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9bc72c640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd9b40c4d10 0x7fd9b41f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:10.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9bc72c640 10 monclient(hunting): picked mon.noname-b con 0x7fd9b40c4d10 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:27:10.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9bc72c640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd9b40c7170 0x7fd9b41f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:10.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9bc72c640 10 monclient(hunting): picked mon.noname-c con 0x7fd9b40c7170 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:27:10.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9bc72c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:10.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9bc72c640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b40c81c0 con 0x7fd9b40c48c0 2026-02-17T21:27:10.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9bc72c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:10.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9bc72c640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b40c7ee0 con 0x7fd9b40c4d10 2026-02-17T21:27:10.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9bc72c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:10.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9bc72c640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b40750c0 con 0x7fd9b40c7170 2026-02-17T21:27:10.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9bc72c640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:10.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9bc72c640 10 monclient(hunting): authenticate will time out at 1136.048303s 2026-02-17T21:27:10.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9b9ca0640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd9b40c4d10 0x7fd9b41f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:10.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9ba4a1640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd9b40c48c0 0x7fd9b414c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:10.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9b9ca0640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd9b40c4d10 0x7fd9b41f5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:46798/0 (socket says 10.20.193.5:46798) 2026-02-17T21:27:10.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9b9ca0640 1 -- 10.20.193.5:0/1532795904 learned_addr learned my addr 10.20.193.5:0/1532795904 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:27:10.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9b9ca0640 10 monclient(hunting): get_auth_request con 0x7fd9b40c4d10 auth_method 0 2026-02-17T21:27:10.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9b9ca0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:10.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9b9ca0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:10.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9b9ca0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:10.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9baca2640 1 --2- 10.20.193.5:0/1532795904 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd9b40c7170 0x7fd9b41f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:10.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9ba4a1640 10 monclient(hunting): get_auth_request con 0x7fd9b40c48c0 auth_method 0 2026-02-17T21:27:10.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9ba4a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:10.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9ba4a1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:10.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9ba4a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:10.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9baca2640 10 monclient(hunting): get_auth_request con 0x7fd9b40c7170 auth_method 0 2026-02-17T21:27:10.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9baca2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:10.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9baca2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:10.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9baca2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:10.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9b9ca0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:10.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9b9ca0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:10.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.483+0000 7fd9b9ca0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:10.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.484+0000 7fd9ba4a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:10.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.484+0000 7fd9ba4a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:10.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.484+0000 7fd9ba4a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:10.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.484+0000 7fd9baca2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:10.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.484+0000 7fd9baca2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:10.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.484+0000 7fd9baca2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:10.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.485+0000 7fd9b9ca0640 10 monclient(hunting): handle_auth_done global_id 4771 payload 824 2026-02-17T21:27:10.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.485+0000 7fd9b9ca0640 1 -- 10.20.193.5:0/1532795904 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd9b40c7170 msgr2=0x7fd9b41f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:10.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.485+0000 7fd9b9ca0640 1 --2- 10.20.193.5:0/1532795904 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd9b40c7170 0x7fd9b41f55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:10.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.485+0000 7fd9b9ca0640 1 -- 10.20.193.5:0/1532795904 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd9b40c48c0 msgr2=0x7fd9b414c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:10.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.485+0000 7fd9b9ca0640 1 --2- 10.20.193.5:0/1532795904 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd9b40c48c0 0x7fd9b414c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:10.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.485+0000 7fd9b9ca0640 10 monclient: _finish_hunting 0 2026-02-17T21:27:10.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.485+0000 7fd9b9ca0640 1 monclient: found mon.noname-b 2026-02-17T21:27:10.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.485+0000 7fd9b9ca0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:10.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.485+0000 7fd9b9ca0640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:27:10.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.485+0000 7fd9b9ca0640 1 -- 10.20.193.5:0/1532795904 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b4155800 con 0x7fd9b40c4d10 2026-02-17T21:27:10.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.486+0000 7fd9b9ca0640 1 --2- 10.20.193.5:0/1532795904 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd9b40c4d10 0x7fd9b41f5070 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd9a800c4d0 tx=0x7fd9a800c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:10.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.486+0000 7fd99affd640 10 client.?.objecter ms_handle_connect 0x7fd9b40c4d10 2026-02-17T21:27:10.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.486+0000 7fd99affd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:27:10.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.487+0000 7fd99affd640 1 -- 10.20.193.5:0/1532795904 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8017070 con 0x7fd9b40c4d10 2026-02-17T21:27:10.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.487+0000 7fd99affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:10.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.487+0000 7fd99affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:27:10.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.487+0000 7fd99affd640 10 monclient: dump: 2026-02-17T21:27:10.505 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:10.505 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:10.505 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:10.505 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:10.505 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:10.506 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:10.506 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:10.506 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:10.506 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:10.506 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:10.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.487+0000 7fd99affd640 10 monclient: _finish_auth 0 2026-02-17T21:27:10.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.487+0000 7fd99affd640 10 monclient: _check_auth_tickets 2026-02-17T21:27:10.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.487+0000 7fd99affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:10.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.487+0000 7fd99affd640 1 -- 10.20.193.5:0/1532795904 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a8005de0 con 0x7fd9b40c4d10 2026-02-17T21:27:10.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.487+0000 7fd99affd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:10.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.487+0000 7fd99affd640 1 -- 10.20.193.5:0/1532795904 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8007290 con 0x7fd9b40c4d10 2026-02-17T21:27:10.507 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.487+0000 7fd99affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:10.507 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.487+0000 7fd99affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:27:10.507 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.487+0000 7fd99affd640 10 monclient: dump: 2026-02-17T21:27:10.507 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:10.507 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:10.507 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:10.507 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:10.507 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:10.507 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:10.507 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:10.507 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:10.507 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:10.508 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:10.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.487+0000 7fd9bc72c640 5 monclient: authenticate success, global_id 4771 2026-02-17T21:27:10.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.487+0000 7fd9bc72c640 10 monclient: _renew_subs 2026-02-17T21:27:10.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.487+0000 7fd9b8c9e640 4 set_mon_vals no callback set 2026-02-17T21:27:10.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.487+0000 7fd9bc72c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:10.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.487+0000 7fd9bc72c640 1 -- 10.20.193.5:0/1532795904 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9b4155ae0 con 0x7fd9b40c4d10 2026-02-17T21:27:10.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.487+0000 7fd9bc72c640 10 client.4771.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:27:10.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.487+0000 7fd9bc72c640 10 monclient: _renew_subs 2026-02-17T21:27:10.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.487+0000 7fd9bc72c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:10.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.487+0000 7fd9bc72c640 1 -- 10.20.193.5:0/1532795904 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9b41560a0 con 0x7fd9b40c4d10 2026-02-17T21:27:10.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.487+0000 7fd9bc72c640 1 librados: init done 2026-02-17T21:27:10.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.488+0000 7fd9bc72c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:10.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.488+0000 7fd9bc72c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:10.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.488+0000 7fd9bc72c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:10.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.488+0000 7fd9bc72c640 1 -- 10.20.193.5:0/1532795904 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9b40c7550 con 0x7fd9b40c4d10 2026-02-17T21:27:10.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.499+0000 7fd99affd640 1 -- 10.20.193.5:0/1532795904 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fd9a8007430 con 0x7fd9b40c4d10 2026-02-17T21:27:10.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.499+0000 7fd99affd640 1 --2- 10.20.193.5:0/1532795904 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd984079280 0x7fd98407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:10.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.500+0000 7fd9ba4a1640 1 --2- 10.20.193.5:0/1532795904 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd984079280 0x7fd98407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:10.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.500+0000 7fd9ba4a1640 10 monclient: get_auth_request con 0x7fd984079280 auth_method 0 2026-02-17T21:27:10.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.500+0000 7fd9ba4a1640 1 --2- 10.20.193.5:0/1532795904 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd984079280 0x7fd98407b740 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4009c40 tx=0x7fd9a4009290 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:10.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.500+0000 7fd99affd640 10 client.4771.objecter ms_handle_connect 0x7fd984079280 2026-02-17T21:27:10.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.501+0000 7fd99affd640 1 -- 10.20.193.5:0/1532795904 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fd9a8007750 con 0x7fd9b40c4d10 2026-02-17T21:27:10.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.501+0000 7fd99affd640 10 client.4771.objecter ms_dispatch2 0x7fd9b4000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:27:10.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.501+0000 7fd99affd640 3 client.4771.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:27:10.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.501+0000 7fd99affd640 3 client.4771.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:27:10.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.501+0000 7fd99affd640 20 client.4771.objecter dump_active .. 0 homeless 2026-02-17T21:27:10.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.605+0000 7fd99affd640 1 -- 10.20.193.5:0/1532795904 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd9a8021020 con 0x7fd9b40c4d10 2026-02-17T21:27:10.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.605+0000 7fd99affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:10.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.605+0000 7fd99affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:27:10.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.705+0000 7fd9bc72c640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:27:10.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.705+0000 7fd9bc72c640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:10.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.705+0000 7fd9bc72c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:10.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.705+0000 7fd9bc72c640 1 -- 10.20.193.5:0/1532795904 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd9b40c96e0 con 0x7fd9b40c4d10 2026-02-17T21:27:10.723 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.722+0000 7fd99affd640 1 -- 10.20.193.5:0/1532795904 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fd9a8061790 con 0x7fd9b40c4d10 2026-02-17T21:27:10.724 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.722+0000 7fd99affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:10.724 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.722+0000 7fd99affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:27:10.724 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:27:10.724 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:27:10.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.724+0000 7fd9bc72c640 10 librados: watch_flush enter 2026-02-17T21:27:10.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.724+0000 7fd9bc72c640 10 librados: watch_flush exit 2026-02-17T21:27:10.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.724+0000 7fd9bc72c640 20 client.4771.objecter shutdown clearing up homeless session... 2026-02-17T21:27:10.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.724+0000 7fd9bc72c640 10 client.4771.objecter successfully canceled tick 2026-02-17T21:27:10.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.724+0000 7fd9bc72c640 1 -- 10.20.193.5:0/1532795904 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd984079280 msgr2=0x7fd98407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:10.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.724+0000 7fd9bc72c640 1 --2- 10.20.193.5:0/1532795904 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd984079280 0x7fd98407b740 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4009c40 tx=0x7fd9a4009290 comp rx=0 tx=0).stop 2026-02-17T21:27:10.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.724+0000 7fd9bc72c640 10 monclient: shutdown 2026-02-17T21:27:10.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.724+0000 7fd9bc72c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:10.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.724+0000 7fd9bc72c640 1 -- 10.20.193.5:0/1532795904 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd9b40c4d10 msgr2=0x7fd9b41f5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:10.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.724+0000 7fd9bc72c640 1 --2- 10.20.193.5:0/1532795904 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd9b40c4d10 0x7fd9b41f5070 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd9a800c4d0 tx=0x7fd9a800c9a0 comp rx=0 tx=0).stop 2026-02-17T21:27:10.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.724+0000 7fd9bc72c640 1 -- 10.20.193.5:0/1532795904 shutdown_connections 2026-02-17T21:27:10.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.724+0000 7fd9bc72c640 1 --2- 10.20.193.5:0/1532795904 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd984079280 0x7fd98407b740 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:10.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.724+0000 7fd9bc72c640 1 --2- 10.20.193.5:0/1532795904 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd9b40c7170 0x7fd9b41f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:10.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.724+0000 7fd9bc72c640 1 --2- 10.20.193.5:0/1532795904 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd9b40c4d10 0x7fd9b41f5070 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:10.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.724+0000 7fd9bc72c640 1 --2- 10.20.193.5:0/1532795904 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd9b40c48c0 0x7fd9b414c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:10.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.724+0000 7fd9bc72c640 1 -- 10.20.193.5:0/1532795904 >> 10.20.193.5:0/1532795904 conn(0x7fd9b40c9f40 msgr2=0x7fd9b40cb450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:10.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.724+0000 7fd9bc72c640 1 -- 10.20.193.5:0/1532795904 shutdown_connections 2026-02-17T21:27:10.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.724+0000 7fd9bc72c640 1 -- 10.20.193.5:0/1532795904 wait complete. 2026-02-17T21:27:10.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:10.724+0000 7fd9bc72c640 1 librados: shutdown 2026-02-17T21:27:13.735 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:27:13.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.802+0000 7fa6c9222640 10 monclient: get_monmap_and_config 2026-02-17T21:27:13.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.802+0000 7fa6c9222640 10 monclient: build_initial_monmap 2026-02-17T21:27:13.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.802+0000 7fa6c9222640 10 monclient: monmap: 2026-02-17T21:27:13.804 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:13.804 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:13.804 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:27:13.803374+0000 2026-02-17T21:27:13.805 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:27:13.803374+0000 2026-02-17T21:27:13.805 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:13.805 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:13.805 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:27:13.805 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:27:13.805 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:27:13.805 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:27:13.805 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:27:13.805 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:27:13.805 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:13.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.803+0000 7fa6c9222640 1 Processor -- start 2026-02-17T21:27:13.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.803+0000 7fa6c9222640 1 -- start start 2026-02-17T21:27:13.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.803+0000 7fa6c9222640 10 monclient: init 2026-02-17T21:27:13.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.803+0000 7fa6c9222640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:13.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.803+0000 7fa6c9222640 10 monclient: _add_conns ranks=[1,2,4,0,5,3] 2026-02-17T21:27:13.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.803+0000 7fa6c9222640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fa6c40c7170 addr v1:10.20.193.119:6789/0 2026-02-17T21:27:13.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.803+0000 7fa6c9222640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa6c40c7550 addr v1:10.20.193.135:6789/0 2026-02-17T21:27:13.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.803+0000 7fa6c9222640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fa6c40c89c0 0x7fa6c40c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:13.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.803+0000 7fa6c9222640 10 monclient(hunting): picked mon.noname-b con 0x7fa6c40c89c0 addr v2:10.20.193.119:3300/0 2026-02-17T21:27:13.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.803+0000 7fa6c9222640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6c40c4fd0 con 0x7fa6c40c7170 2026-02-17T21:27:13.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.803+0000 7fa6c9222640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6c415a9a0 con 0x7fa6c40c7550 2026-02-17T21:27:13.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.803+0000 7fa6c9222640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:13.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.803+0000 7fa6c9222640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fa6c40c8530 con 0x7fa6c40c89c0 2026-02-17T21:27:13.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.803+0000 7fa6c9222640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:13.808 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.803+0000 7fa6c9222640 10 monclient(hunting): authenticate will time out at 1139.368819s 2026-02-17T21:27:13.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.828+0000 7fa6c3577640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fa6c40c89c0 0x7fa6c40c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:13.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.828+0000 7fa6c2d76640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7fa6c40c7170 0x7fa6c40c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:34282/0 (socket says 10.20.193.5:34282) 2026-02-17T21:27:13.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.828+0000 7fa6c2d76640 1 -- 10.20.193.5:0/3350177833 learned_addr learned my addr 10.20.193.5:0/3350177833 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:27:13.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.829+0000 7fa6c3577640 10 monclient(hunting): get_auth_request con 0x7fa6c40c89c0 auth_method 0 2026-02-17T21:27:13.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.829+0000 7fa6c3577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:13.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.829+0000 7fa6c3577640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:13.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.829+0000 7fa6c3577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:13.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.829+0000 7fa6c3577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:13.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.829+0000 7fa6c3577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:13.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.829+0000 7fa6c3577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:13.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.831+0000 7fa6c3577640 10 monclient(hunting): handle_auth_done global_id 4774 payload 274 2026-02-17T21:27:13.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.831+0000 7fa6c3577640 1 -- 10.20.193.5:0/3350177833 >> v1:10.20.193.135:6789/0 conn(0x7fa6c40c7550 legacy=0x7fa6c40749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:13.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.831+0000 7fa6c3577640 1 -- 10.20.193.5:0/3350177833 >> v1:10.20.193.119:6789/0 conn(0x7fa6c40c7170 legacy=0x7fa6c40c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:13.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.831+0000 7fa6c3577640 10 monclient: _finish_hunting 0 2026-02-17T21:27:13.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.831+0000 7fa6c3577640 1 monclient: found mon.noname-b 2026-02-17T21:27:13.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.831+0000 7fa6c3577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:13.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.831+0000 7fa6c3577640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:27:13.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.831+0000 7fa6c3577640 1 -- 10.20.193.5:0/3350177833 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c40c5270 con 0x7fa6c40c89c0 2026-02-17T21:27:13.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.832+0000 7fa6c3577640 1 --2- 10.20.193.5:0/3350177833 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa6c40c89c0 0x7fa6c40c8e70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4009d90 tx=0x7fa6b402f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53df91aa262b75c5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:13.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.834+0000 7fa6c1d74640 1 -- 10.20.193.5:0/3350177833 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b403c070 con 0x7fa6c40c89c0 2026-02-17T21:27:13.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.834+0000 7fa6c1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:13.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.834+0000 7fa6c1d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:27:13.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.834+0000 7fa6c1d74640 10 monclient: dump: 2026-02-17T21:27:13.841 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:13.841 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:13.841 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:13.841 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:13.841 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:13.842 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:13.842 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:13.842 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:13.842 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:13.842 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:13.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.834+0000 7fa6c1d74640 10 monclient: _finish_auth 0 2026-02-17T21:27:13.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.834+0000 7fa6c1d74640 10 monclient: _check_auth_tickets 2026-02-17T21:27:13.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.834+0000 7fa6c1d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:13.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.834+0000 7fa6c1d74640 1 -- 10.20.193.5:0/3350177833 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b4037440 con 0x7fa6c40c89c0 2026-02-17T21:27:13.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.834+0000 7fa6c1d74640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:13.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.834+0000 7fa6c1d74640 1 -- 10.20.193.5:0/3350177833 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4037810 con 0x7fa6c40c89c0 2026-02-17T21:27:13.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.834+0000 7fa6c9222640 5 monclient: authenticate success, global_id 4774 2026-02-17T21:27:13.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.834+0000 7fa6c9222640 10 monclient: get_monmap_and_config success 2026-02-17T21:27:13.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.834+0000 7fa6c9222640 4 set_mon_vals no callback set 2026-02-17T21:27:13.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.834+0000 7fa6c1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:13.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.834+0000 7fa6c1d74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:27:13.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.834+0000 7fa6c1d74640 10 monclient: dump: 2026-02-17T21:27:13.843 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:13.843 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:13.843 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:13.843 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:13.843 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:13.843 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:13.844 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:13.844 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:13.844 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:13.844 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:13.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.835+0000 7fa6c9222640 10 monclient: shutdown 2026-02-17T21:27:13.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.835+0000 7fa6c9222640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:13.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.835+0000 7fa6c9222640 1 -- 10.20.193.5:0/3350177833 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa6c40c89c0 msgr2=0x7fa6c40c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:13.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.835+0000 7fa6c9222640 1 --2- 10.20.193.5:0/3350177833 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa6c40c89c0 0x7fa6c40c8e70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4009d90 tx=0x7fa6b402f230 comp rx=0 tx=0).stop 2026-02-17T21:27:13.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.835+0000 7fa6c9222640 1 -- 10.20.193.5:0/3350177833 shutdown_connections 2026-02-17T21:27:13.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.835+0000 7fa6c9222640 1 --2- 10.20.193.5:0/3350177833 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa6c40c89c0 0x7fa6c40c8e70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:13.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.835+0000 7fa6c9222640 1 -- 10.20.193.5:0/3350177833 >> 10.20.193.5:0/3350177833 conn(0x7fa6c40c9f40 msgr2=0x7fa6c40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:13.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.835+0000 7fa6c9222640 1 -- 10.20.193.5:0/3350177833 shutdown_connections 2026-02-17T21:27:13.845 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.835+0000 7fa6c9222640 1 -- 10.20.193.5:0/3350177833 wait complete. 2026-02-17T21:27:13.845 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.835+0000 7fa6c9222640 10 monclient: build_initial_monmap 2026-02-17T21:27:13.845 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.835+0000 7fa6c9222640 10 monclient: monmap: 2026-02-17T21:27:13.845 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:13.845 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:27:13.845 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:27:13.845 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:27:13.845 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:13.845 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:13.845 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:27:13.845 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:27:13.845 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:27:13.845 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:13.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c9222640 1 librados: starting msgr at 2026-02-17T21:27:13.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c9222640 1 librados: starting objecter 2026-02-17T21:27:13.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c9222640 1 Processor -- start 2026-02-17T21:27:13.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c9222640 1 -- start start 2026-02-17T21:27:13.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c9222640 1 librados: setting wanted keys 2026-02-17T21:27:13.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c9222640 1 librados: calling monclient init 2026-02-17T21:27:13.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c9222640 10 monclient: init 2026-02-17T21:27:13.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c9222640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:13.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c9222640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:27:13.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c9222640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa6c40c7170 0x7fa6c41f7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:13.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c9222640 10 monclient(hunting): picked mon.noname-c con 0x7fa6c40c7170 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:27:13.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c9222640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa6c40c7550 0x7fa6c406d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:13.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c9222640 10 monclient(hunting): picked mon.noname-a con 0x7fa6c40c7550 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:27:13.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c9222640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa6c40c89c0 0x7fa6c4156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:13.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c9222640 10 monclient(hunting): picked mon.noname-b con 0x7fa6c40c89c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:27:13.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c9222640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:13.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c9222640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c40c5830 con 0x7fa6c40c7550 2026-02-17T21:27:13.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c9222640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:13.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c9222640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c40c93b0 con 0x7fa6c40c89c0 2026-02-17T21:27:13.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c9222640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:13.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c9222640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c40c7ee0 con 0x7fa6c40c7170 2026-02-17T21:27:13.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c9222640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:13.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c9222640 10 monclient(hunting): authenticate will time out at 1139.401589s 2026-02-17T21:27:13.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c3577640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa6c40c89c0 0x7fa6c4156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:13.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c2575640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa6c40c7550 0x7fa6c406d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:13.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.836+0000 7fa6c2d76640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa6c40c7170 0x7fa6c41f7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:13.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.837+0000 7fa6c3577640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa6c40c89c0 0x7fa6c4156be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:46820/0 (socket says 10.20.193.5:46820) 2026-02-17T21:27:13.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.837+0000 7fa6c3577640 1 -- 10.20.193.5:0/1771541019 learned_addr learned my addr 10.20.193.5:0/1771541019 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:27:13.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.837+0000 7fa6c3577640 10 monclient(hunting): get_auth_request con 0x7fa6c40c89c0 auth_method 0 2026-02-17T21:27:13.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.837+0000 7fa6c3577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:13.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.837+0000 7fa6c3577640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:13.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.837+0000 7fa6c3577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:13.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.837+0000 7fa6c2575640 10 monclient(hunting): get_auth_request con 0x7fa6c40c7550 auth_method 0 2026-02-17T21:27:13.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.837+0000 7fa6c2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:13.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.837+0000 7fa6c2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:13.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.837+0000 7fa6c2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:13.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.837+0000 7fa6c2d76640 10 monclient(hunting): get_auth_request con 0x7fa6c40c7170 auth_method 0 2026-02-17T21:27:13.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.837+0000 7fa6c2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:13.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.837+0000 7fa6c2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:13.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.837+0000 7fa6c2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:13.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.837+0000 7fa6c3577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:13.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.837+0000 7fa6c3577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:13.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.837+0000 7fa6c3577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:13.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.837+0000 7fa6c2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:13.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.837+0000 7fa6c2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:13.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.837+0000 7fa6c2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:13.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.837+0000 7fa6c2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:13.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.837+0000 7fa6c2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:13.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.837+0000 7fa6c2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:13.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.838+0000 7fa6c3577640 10 monclient(hunting): handle_auth_done global_id 4780 payload 824 2026-02-17T21:27:13.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.838+0000 7fa6c3577640 1 -- 10.20.193.5:0/1771541019 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa6c40c7170 msgr2=0x7fa6c41f7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:13.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.838+0000 7fa6c3577640 1 --2- 10.20.193.5:0/1771541019 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa6c40c7170 0x7fa6c41f7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:13.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.838+0000 7fa6c3577640 1 -- 10.20.193.5:0/1771541019 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa6c40c7550 msgr2=0x7fa6c406d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:13.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.838+0000 7fa6c3577640 1 --2- 10.20.193.5:0/1771541019 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa6c40c7550 0x7fa6c406d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:13.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.838+0000 7fa6c3577640 10 monclient: _finish_hunting 0 2026-02-17T21:27:13.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.838+0000 7fa6c3577640 1 monclient: found mon.noname-b 2026-02-17T21:27:13.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.838+0000 7fa6c3577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:13.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.838+0000 7fa6c3577640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:27:13.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.838+0000 7fa6c3577640 1 -- 10.20.193.5:0/1771541019 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c41f76c0 con 0x7fa6c40c89c0 2026-02-17T21:27:13.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.839+0000 7fa6c3577640 1 --2- 10.20.193.5:0/1771541019 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa6c40c89c0 0x7fa6c4156be0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa6b403a040 tx=0x7fa6b4004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:13.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.839+0000 7fa6a37fe640 10 client.?.objecter ms_handle_connect 0x7fa6c40c89c0 2026-02-17T21:27:13.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.839+0000 7fa6a37fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:27:13.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6a37fe640 1 -- 10.20.193.5:0/1771541019 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b403c050 con 0x7fa6c40c89c0 2026-02-17T21:27:13.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:13.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6a37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:27:13.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6a37fe640 10 monclient: dump: 2026-02-17T21:27:13.855 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:13.855 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:13.855 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:13.855 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:13.855 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:13.855 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:13.856 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:13.856 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:13.856 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:13.856 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:13.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6a37fe640 10 monclient: _finish_auth 0 2026-02-17T21:27:13.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6a37fe640 10 monclient: _check_auth_tickets 2026-02-17T21:27:13.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6a37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:13.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6a37fe640 1 -- 10.20.193.5:0/1771541019 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b4048070 con 0x7fa6c40c89c0 2026-02-17T21:27:13.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6a37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:13.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6a37fe640 1 -- 10.20.193.5:0/1771541019 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4037e60 con 0x7fa6c40c89c0 2026-02-17T21:27:13.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:13.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6a37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:27:13.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6a37fe640 10 monclient: dump: 2026-02-17T21:27:13.858 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:13.858 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:13.858 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:13.858 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:13.859 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:13.859 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:13.859 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:13.859 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:13.859 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:13.860 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:13.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6c1573640 4 set_mon_vals no callback set 2026-02-17T21:27:13.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6c9222640 5 monclient: authenticate success, global_id 4780 2026-02-17T21:27:13.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6c9222640 10 monclient: _renew_subs 2026-02-17T21:27:13.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6c9222640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:13.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6c9222640 1 -- 10.20.193.5:0/1771541019 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6c406db30 con 0x7fa6c40c89c0 2026-02-17T21:27:13.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6c9222640 10 client.4780.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:27:13.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6c9222640 10 monclient: _renew_subs 2026-02-17T21:27:13.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6c9222640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:13.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6c9222640 1 -- 10.20.193.5:0/1771541019 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6c406e0e0 con 0x7fa6c40c89c0 2026-02-17T21:27:13.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6c9222640 1 librados: init done 2026-02-17T21:27:13.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6c9222640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:13.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6c9222640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:13.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6c9222640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:13.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.841+0000 7fa6c9222640 1 -- 10.20.193.5:0/1771541019 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6c40c81c0 con 0x7fa6c40c89c0 2026-02-17T21:27:13.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.947+0000 7fa6a37fe640 1 -- 10.20.193.5:0/1771541019 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fa6b404d460 con 0x7fa6c40c89c0 2026-02-17T21:27:13.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.948+0000 7fa6a37fe640 1 --2- 10.20.193.5:0/1771541019 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa6900792b0 0x7fa69007b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:13.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.948+0000 7fa6c2d76640 1 --2- 10.20.193.5:0/1771541019 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa6900792b0 0x7fa69007b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:13.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.948+0000 7fa6c2d76640 10 monclient: get_auth_request con 0x7fa6900792b0 auth_method 0 2026-02-17T21:27:13.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.949+0000 7fa6c2d76640 1 --2- 10.20.193.5:0/1771541019 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa6900792b0 0x7fa69007b770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8002770 tx=0x7fa6b8009040 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:13.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.949+0000 7fa6a37fe640 10 client.4780.objecter ms_handle_connect 0x7fa6900792b0 2026-02-17T21:27:13.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.949+0000 7fa6a37fe640 1 -- 10.20.193.5:0/1771541019 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fa6b4035d40 con 0x7fa6c40c89c0 2026-02-17T21:27:13.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.949+0000 7fa6a37fe640 10 client.4780.objecter ms_dispatch2 0x7fa6c4000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:27:13.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.949+0000 7fa6a37fe640 3 client.4780.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:27:13.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.949+0000 7fa6a37fe640 3 client.4780.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:27:13.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.949+0000 7fa6a37fe640 20 client.4780.objecter dump_active .. 0 homeless 2026-02-17T21:27:13.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.956+0000 7fa6a37fe640 1 -- 10.20.193.5:0/1771541019 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa6b4088920 con 0x7fa6c40c89c0 2026-02-17T21:27:13.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.956+0000 7fa6a37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:13.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:13.956+0000 7fa6a37fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:27:14.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.055+0000 7fa6c9222640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:27:14.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.055+0000 7fa6c9222640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:14.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.055+0000 7fa6c9222640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:14.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.055+0000 7fa6c9222640 1 -- 10.20.193.5:0/1771541019 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa6c4153f80 con 0x7fa6c40c89c0 2026-02-17T21:27:14.060 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.058+0000 7fa6a37fe640 1 -- 10.20.193.5:0/1771541019 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fa6b408cc20 con 0x7fa6c40c89c0 2026-02-17T21:27:14.060 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.058+0000 7fa6a37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:14.060 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.058+0000 7fa6a37fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:27:14.061 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:27:14.061 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:27:14.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.059+0000 7fa6c9222640 10 librados: watch_flush enter 2026-02-17T21:27:14.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.059+0000 7fa6c9222640 10 librados: watch_flush exit 2026-02-17T21:27:14.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.059+0000 7fa6c9222640 20 client.4780.objecter shutdown clearing up homeless session... 2026-02-17T21:27:14.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.059+0000 7fa6c9222640 10 client.4780.objecter successfully canceled tick 2026-02-17T21:27:14.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.059+0000 7fa6c9222640 1 -- 10.20.193.5:0/1771541019 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa6900792b0 msgr2=0x7fa69007b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:14.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.059+0000 7fa6c9222640 1 --2- 10.20.193.5:0/1771541019 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa6900792b0 0x7fa69007b770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8002770 tx=0x7fa6b8009040 comp rx=0 tx=0).stop 2026-02-17T21:27:14.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.059+0000 7fa6c9222640 10 monclient: shutdown 2026-02-17T21:27:14.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.059+0000 7fa6c9222640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:14.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.059+0000 7fa6c9222640 1 -- 10.20.193.5:0/1771541019 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa6c40c89c0 msgr2=0x7fa6c4156be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:14.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.059+0000 7fa6c9222640 1 --2- 10.20.193.5:0/1771541019 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa6c40c89c0 0x7fa6c4156be0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa6b403a040 tx=0x7fa6b4004b40 comp rx=0 tx=0).stop 2026-02-17T21:27:14.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.059+0000 7fa6c9222640 1 -- 10.20.193.5:0/1771541019 shutdown_connections 2026-02-17T21:27:14.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.059+0000 7fa6c9222640 1 --2- 10.20.193.5:0/1771541019 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fa6900792b0 0x7fa69007b770 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:14.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.059+0000 7fa6c9222640 1 --2- 10.20.193.5:0/1771541019 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa6c40c89c0 0x7fa6c4156be0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:14.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.059+0000 7fa6c9222640 1 --2- 10.20.193.5:0/1771541019 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fa6c40c7550 0x7fa6c406d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:14.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.059+0000 7fa6c9222640 1 --2- 10.20.193.5:0/1771541019 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fa6c40c7170 0x7fa6c41f7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:14.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.059+0000 7fa6c9222640 1 -- 10.20.193.5:0/1771541019 >> 10.20.193.5:0/1771541019 conn(0x7fa6c40c9f40 msgr2=0x7fa6c414e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:14.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.059+0000 7fa6c9222640 1 -- 10.20.193.5:0/1771541019 shutdown_connections 2026-02-17T21:27:14.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.059+0000 7fa6c9222640 1 -- 10.20.193.5:0/1771541019 wait complete. 2026-02-17T21:27:14.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:14.059+0000 7fa6c9222640 1 librados: shutdown 2026-02-17T21:27:17.070 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:27:17.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.137+0000 7fdaa8ff7640 10 monclient: get_monmap_and_config 2026-02-17T21:27:17.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.137+0000 7fdaa8ff7640 10 monclient: build_initial_monmap 2026-02-17T21:27:17.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.137+0000 7fdaa8ff7640 10 monclient: monmap: 2026-02-17T21:27:17.139 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:17.139 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:17.139 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:27:17.138364+0000 2026-02-17T21:27:17.139 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:27:17.138364+0000 2026-02-17T21:27:17.139 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:17.139 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:17.139 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:27:17.139 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:27:17.139 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:27:17.139 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:27:17.139 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:27:17.139 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:27:17.139 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:17.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.138+0000 7fdaa8ff7640 1 Processor -- start 2026-02-17T21:27:17.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.138+0000 7fdaa8ff7640 1 -- start start 2026-02-17T21:27:17.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.138+0000 7fdaa8ff7640 10 monclient: init 2026-02-17T21:27:17.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.138+0000 7fdaa8ff7640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:17.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.138+0000 7fdaa8ff7640 10 monclient: _add_conns ranks=[4,0,3,2,1,5] 2026-02-17T21:27:17.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.138+0000 7fdaa8ff7640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fdaa415f570 0x7fdaa415f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:17.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.138+0000 7fdaa8ff7640 10 monclient(hunting): picked mon.noname-b con 0x7fdaa415f570 addr v2:10.20.193.119:3300/0 2026-02-17T21:27:17.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.138+0000 7fdaa8ff7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdaa40be810 addr v1:10.20.193.5:6789/0 2026-02-17T21:27:17.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.138+0000 7fdaa8ff7640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fdaa4155770 0x7fdaa4155c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:17.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.138+0000 7fdaa8ff7640 10 monclient(hunting): picked mon.noname-a con 0x7fdaa4155770 addr v2:10.20.193.5:3300/0 2026-02-17T21:27:17.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.138+0000 7fdaa8ff7640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa40bee70 con 0x7fdaa40be810 2026-02-17T21:27:17.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.138+0000 7fdaa8ff7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:17.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.138+0000 7fdaa8ff7640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fdaa40bec50 con 0x7fdaa4155770 2026-02-17T21:27:17.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.138+0000 7fdaa8ff7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:17.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.138+0000 7fdaa8ff7640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fdaa40bfd60 con 0x7fdaa415f570 2026-02-17T21:27:17.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.138+0000 7fdaa8ff7640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:17.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.138+0000 7fdaa8ff7640 10 monclient(hunting): authenticate will time out at 1142.703784s 2026-02-17T21:27:17.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.139+0000 7fdaa2575640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fdaa415f570 0x7fdaa415f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:17.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.139+0000 7fdaa2d76640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fdaa4155770 0x7fdaa4155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:17.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.139+0000 7fdaa2575640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fdaa415f570 0x7fdaa415f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:46834/0 (socket says 10.20.193.5:46834) 2026-02-17T21:27:17.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.139+0000 7fdaa2575640 1 -- 10.20.193.5:0/509811589 learned_addr learned my addr 10.20.193.5:0/509811589 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:27:17.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.139+0000 7fdaa2575640 10 monclient(hunting): get_auth_request con 0x7fdaa415f570 auth_method 0 2026-02-17T21:27:17.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.139+0000 7fdaa2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:17.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.139+0000 7fdaa2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:17.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.139+0000 7fdaa2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:17.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.139+0000 7fdaa2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:17.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.139+0000 7fdaa2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:17.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.139+0000 7fdaa2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:17.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.139+0000 7fdaa2d76640 10 monclient(hunting): get_auth_request con 0x7fdaa4155770 auth_method 0 2026-02-17T21:27:17.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.139+0000 7fdaa2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:17.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.139+0000 7fdaa2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:17.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.139+0000 7fdaa2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:17.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.140+0000 7fdaa2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:17.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.140+0000 7fdaa2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:17.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.140+0000 7fdaa2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:17.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.140+0000 7fdaa2575640 10 monclient(hunting): handle_auth_done global_id 4783 payload 274 2026-02-17T21:27:17.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.140+0000 7fdaa2575640 1 -- 10.20.193.5:0/509811589 >> v2:10.20.193.5:3300/0 conn(0x7fdaa4155770 msgr2=0x7fdaa4155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:27:17.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.140+0000 7fdaa2575640 1 --2- 10.20.193.5:0/509811589 >> v2:10.20.193.5:3300/0 conn(0x7fdaa4155770 0x7fdaa4155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:17.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.140+0000 7fdaa2575640 1 -- 10.20.193.5:0/509811589 >> v1:10.20.193.5:6789/0 conn(0x7fdaa40be810 legacy=0x7fdaa415d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:17.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.141+0000 7fdaa2575640 10 monclient: _finish_hunting 0 2026-02-17T21:27:17.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.141+0000 7fdaa2575640 1 monclient: found mon.noname-b 2026-02-17T21:27:17.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.141+0000 7fdaa2575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:17.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.141+0000 7fdaa2575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:27:17.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.141+0000 7fdaa2575640 1 -- 10.20.193.5:0/509811589 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa40bf150 con 0x7fdaa415f570 2026-02-17T21:27:17.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.142+0000 7fdaa2575640 1 --2- 10.20.193.5:0/509811589 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdaa415f570 0x7fdaa415f950 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40696f0 tx=0x7fda9802eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8665dd43f9ae170f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:17.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa1573640 1 -- 10.20.193.5:0/509811589 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9803c070 con 0x7fdaa415f570 2026-02-17T21:27:17.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:17.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa1573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:27:17.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa1573640 10 monclient: dump: 2026-02-17T21:27:17.146 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:17.146 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:17.146 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:17.146 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:17.146 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:17.146 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:17.146 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:17.146 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:17.146 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:17.146 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:17.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa1573640 10 monclient: _finish_auth 0 2026-02-17T21:27:17.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa1573640 10 monclient: _check_auth_tickets 2026-02-17T21:27:17.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:17.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa1573640 1 -- 10.20.193.5:0/509811589 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda9802fbe0 con 0x7fdaa415f570 2026-02-17T21:27:17.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa1573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:17.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa1573640 1 -- 10.20.193.5:0/509811589 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda98037440 con 0x7fdaa415f570 2026-02-17T21:27:17.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:17.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa1573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:27:17.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa1573640 10 monclient: dump: 2026-02-17T21:27:17.147 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:17.147 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:17.147 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:17.147 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:17.147 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:17.147 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:17.147 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:17.147 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:17.147 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:17.147 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:17.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa8ff7640 5 monclient: authenticate success, global_id 4783 2026-02-17T21:27:17.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa8ff7640 10 monclient: get_monmap_and_config success 2026-02-17T21:27:17.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa8ff7640 4 set_mon_vals no callback set 2026-02-17T21:27:17.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa8ff7640 10 monclient: shutdown 2026-02-17T21:27:17.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa8ff7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:17.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa8ff7640 1 -- 10.20.193.5:0/509811589 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdaa415f570 msgr2=0x7fdaa415f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:17.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa8ff7640 1 --2- 10.20.193.5:0/509811589 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdaa415f570 0x7fdaa415f950 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40696f0 tx=0x7fda9802eed0 comp rx=0 tx=0).stop 2026-02-17T21:27:17.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa8ff7640 1 -- 10.20.193.5:0/509811589 shutdown_connections 2026-02-17T21:27:17.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa8ff7640 1 --2- 10.20.193.5:0/509811589 >> v2:10.20.193.5:3300/0 conn(0x7fdaa4155770 0x7fdaa4155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:17.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa8ff7640 1 --2- 10.20.193.5:0/509811589 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdaa415f570 0x7fdaa415f950 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:17.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa8ff7640 1 -- 10.20.193.5:0/509811589 >> 10.20.193.5:0/509811589 conn(0x7fdaa40c9f40 msgr2=0x7fdaa40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:17.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa8ff7640 1 -- 10.20.193.5:0/509811589 shutdown_connections 2026-02-17T21:27:17.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.144+0000 7fdaa8ff7640 1 -- 10.20.193.5:0/509811589 wait complete. 2026-02-17T21:27:17.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.145+0000 7fdaa8ff7640 10 monclient: build_initial_monmap 2026-02-17T21:27:17.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.145+0000 7fdaa8ff7640 10 monclient: monmap: 2026-02-17T21:27:17.150 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:17.150 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:27:17.150 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:27:17.150 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:27:17.150 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:17.150 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:17.150 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:27:17.150 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:27:17.150 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:27:17.150 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:17.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.145+0000 7fdaa8ff7640 1 librados: starting msgr at 2026-02-17T21:27:17.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.145+0000 7fdaa8ff7640 1 librados: starting objecter 2026-02-17T21:27:17.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.145+0000 7fdaa8ff7640 1 Processor -- start 2026-02-17T21:27:17.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.145+0000 7fdaa8ff7640 1 -- start start 2026-02-17T21:27:17.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.145+0000 7fdaa8ff7640 1 librados: setting wanted keys 2026-02-17T21:27:17.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.145+0000 7fdaa8ff7640 1 librados: calling monclient init 2026-02-17T21:27:17.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.145+0000 7fdaa8ff7640 10 monclient: init 2026-02-17T21:27:17.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.145+0000 7fdaa8ff7640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:17.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.145+0000 7fdaa8ff7640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:27:17.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.145+0000 7fdaa8ff7640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fdaa40be810 0x7fdaa4074d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:17.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.145+0000 7fdaa8ff7640 10 monclient(hunting): picked mon.noname-c con 0x7fdaa40be810 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:27:17.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.145+0000 7fdaa8ff7640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdaa4155770 0x7fdaa41f7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:17.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.145+0000 7fdaa8ff7640 10 monclient(hunting): picked mon.noname-b con 0x7fdaa4155770 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:27:17.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.145+0000 7fdaa8ff7640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fdaa415f570 0x7fdaa4158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:17.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.145+0000 7fdaa8ff7640 10 monclient(hunting): picked mon.noname-a con 0x7fdaa415f570 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:27:17.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.145+0000 7fdaa8ff7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:17.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.145+0000 7fdaa8ff7640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa40bf9f0 con 0x7fdaa415f570 2026-02-17T21:27:17.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.145+0000 7fdaa8ff7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:17.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.145+0000 7fdaa8ff7640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa40bf710 con 0x7fdaa4155770 2026-02-17T21:27:17.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.145+0000 7fdaa8ff7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:17.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.145+0000 7fdaa8ff7640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa415d910 con 0x7fdaa40be810 2026-02-17T21:27:17.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.145+0000 7fdaa8ff7640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:17.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.145+0000 7fdaa8ff7640 10 monclient(hunting): authenticate will time out at 1142.710936s 2026-02-17T21:27:17.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.146+0000 7fdaa1d74640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdaa4155770 0x7fdaa41f7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:17.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.146+0000 7fdaa2d76640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fdaa415f570 0x7fdaa4158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:17.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.146+0000 7fdaa1d74640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdaa4155770 0x7fdaa41f7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:46844/0 (socket says 10.20.193.5:46844) 2026-02-17T21:27:17.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.146+0000 7fdaa1d74640 1 -- 10.20.193.5:0/974734701 learned_addr learned my addr 10.20.193.5:0/974734701 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:27:17.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.146+0000 7fdaa1d74640 10 monclient(hunting): get_auth_request con 0x7fdaa4155770 auth_method 0 2026-02-17T21:27:17.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.146+0000 7fdaa1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:17.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.146+0000 7fdaa1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:17.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.146+0000 7fdaa1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:17.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.146+0000 7fdaa2575640 1 --2- 10.20.193.5:0/974734701 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fdaa40be810 0x7fdaa4074d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:17.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.146+0000 7fdaa2d76640 10 monclient(hunting): get_auth_request con 0x7fdaa415f570 auth_method 0 2026-02-17T21:27:17.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.146+0000 7fdaa2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:17.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.146+0000 7fdaa2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:17.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.146+0000 7fdaa2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:17.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.146+0000 7fdaa1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:17.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.146+0000 7fdaa1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:17.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.146+0000 7fdaa1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:17.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.146+0000 7fdaa2575640 10 monclient(hunting): get_auth_request con 0x7fdaa40be810 auth_method 0 2026-02-17T21:27:17.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.146+0000 7fdaa2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:17.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.146+0000 7fdaa2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:17.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.146+0000 7fdaa2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:17.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.146+0000 7fdaa2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:17.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.146+0000 7fdaa2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:17.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.146+0000 7fdaa2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:17.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.147+0000 7fdaa2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:17.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.147+0000 7fdaa2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:17.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.147+0000 7fdaa2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:17.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.148+0000 7fdaa1d74640 10 monclient(hunting): handle_auth_done global_id 4786 payload 824 2026-02-17T21:27:17.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.148+0000 7fdaa1d74640 1 -- 10.20.193.5:0/974734701 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fdaa40be810 msgr2=0x7fdaa4074d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:17.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.148+0000 7fdaa1d74640 1 --2- 10.20.193.5:0/974734701 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fdaa40be810 0x7fdaa4074d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:17.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.148+0000 7fdaa1d74640 1 -- 10.20.193.5:0/974734701 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fdaa415f570 msgr2=0x7fdaa4158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:17.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.148+0000 7fdaa1d74640 1 --2- 10.20.193.5:0/974734701 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fdaa415f570 0x7fdaa4158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:17.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.148+0000 7fdaa1d74640 10 monclient: _finish_hunting 0 2026-02-17T21:27:17.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.148+0000 7fdaa1d74640 1 monclient: found mon.noname-b 2026-02-17T21:27:17.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.148+0000 7fdaa1d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:17.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.148+0000 7fdaa1d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:27:17.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.148+0000 7fdaa1d74640 1 -- 10.20.193.5:0/974734701 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa41f39c0 con 0x7fdaa4155770 2026-02-17T21:27:17.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.149+0000 7fdaa1d74640 1 --2- 10.20.193.5:0/974734701 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdaa4155770 0x7fdaa41f7800 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00c580 tx=0x7fda8c00ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:17.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.149+0000 7fda8affd640 10 client.?.objecter ms_handle_connect 0x7fdaa4155770 2026-02-17T21:27:17.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.149+0000 7fda8affd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:27:17.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.149+0000 7fda8affd640 1 -- 10.20.193.5:0/974734701 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c017070 con 0x7fdaa4155770 2026-02-17T21:27:17.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fda8affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:17.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fda8affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:27:17.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fda8affd640 10 monclient: dump: 2026-02-17T21:27:17.154 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:17.154 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:17.154 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:17.154 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:17.154 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:17.154 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:17.154 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:17.154 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:17.154 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:17.154 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:17.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fda8affd640 10 monclient: _finish_auth 0 2026-02-17T21:27:17.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fda8affd640 10 monclient: _check_auth_tickets 2026-02-17T21:27:17.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fda8affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:17.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fdaa8ff7640 5 monclient: authenticate success, global_id 4786 2026-02-17T21:27:17.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fdaa8ff7640 10 monclient: _renew_subs 2026-02-17T21:27:17.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fdaa8ff7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:17.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fdaa8ff7640 1 -- 10.20.193.5:0/974734701 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa41f3ca0 con 0x7fdaa4155770 2026-02-17T21:27:17.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fdaa8ff7640 10 client.4786.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:27:17.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fdaa8ff7640 10 monclient: _renew_subs 2026-02-17T21:27:17.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fdaa8ff7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:17.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fdaa8ff7640 1 -- 10.20.193.5:0/974734701 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaa41f4260 con 0x7fdaa4155770 2026-02-17T21:27:17.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fdaa8ff7640 1 librados: init done 2026-02-17T21:27:17.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fdaa8ff7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:17.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fdaa8ff7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:17.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fdaa8ff7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:17.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fdaa8ff7640 1 -- 10.20.193.5:0/974734701 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaa41f7d40 con 0x7fdaa4155770 2026-02-17T21:27:17.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fda8affd640 1 -- 10.20.193.5:0/974734701 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda8c0052d0 con 0x7fdaa4155770 2026-02-17T21:27:17.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fda8affd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:17.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fda8affd640 1 -- 10.20.193.5:0/974734701 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c021060 con 0x7fdaa4155770 2026-02-17T21:27:17.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fda8affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:17.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fda8affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:27:17.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fdaa0d72640 4 set_mon_vals no callback set 2026-02-17T21:27:17.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.150+0000 7fda8affd640 10 monclient: dump: 2026-02-17T21:27:17.155 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:17.155 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:17.155 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:17.155 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:17.156 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:17.156 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:17.156 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:17.156 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:17.156 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:17.156 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:17.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.255+0000 7fda8affd640 1 -- 10.20.193.5:0/974734701 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fda8c024080 con 0x7fdaa4155770 2026-02-17T21:27:17.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.256+0000 7fda8affd640 1 --2- 10.20.193.5:0/974734701 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fda70079280 0x7fda7007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:17.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.256+0000 7fdaa2575640 1 --2- 10.20.193.5:0/974734701 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fda70079280 0x7fda7007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:17.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.256+0000 7fdaa2575640 10 monclient: get_auth_request con 0x7fda70079280 auth_method 0 2026-02-17T21:27:17.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.256+0000 7fda8affd640 1 -- 10.20.193.5:0/974734701 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fda8c0972e0 con 0x7fdaa4155770 2026-02-17T21:27:17.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.256+0000 7fda8affd640 10 client.4786.objecter ms_dispatch2 0x7fdaa4000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:27:17.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.256+0000 7fda8affd640 3 client.4786.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:27:17.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.256+0000 7fda8affd640 3 client.4786.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:27:17.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.257+0000 7fda8affd640 20 client.4786.objecter dump_active .. 0 homeless 2026-02-17T21:27:17.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.257+0000 7fda8affd640 10 client.4786.objecter ms_handle_connect 0x7fda70079280 2026-02-17T21:27:17.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.257+0000 7fdaa2575640 1 --2- 10.20.193.5:0/974734701 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fda70079280 0x7fda7007b740 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4159900 tx=0x7fda98039040 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:17.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.262+0000 7fda8affd640 1 -- 10.20.193.5:0/974734701 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fda8c061870 con 0x7fdaa4155770 2026-02-17T21:27:17.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.262+0000 7fda8affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:17.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.262+0000 7fda8affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:27:17.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.363+0000 7fdaa8ff7640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:27:17.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.363+0000 7fdaa8ff7640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:17.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.363+0000 7fdaa8ff7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:17.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.363+0000 7fdaa8ff7640 1 -- 10.20.193.5:0/974734701 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdaa40c01d0 con 0x7fdaa4155770 2026-02-17T21:27:17.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.366+0000 7fda8affd640 1 -- 10.20.193.5:0/974734701 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fda8c065b70 con 0x7fdaa4155770 2026-02-17T21:27:17.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.366+0000 7fda8affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:17.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.366+0000 7fda8affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:27:17.368 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:27:17.368 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:27:17.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.367+0000 7fdaa8ff7640 10 librados: watch_flush enter 2026-02-17T21:27:17.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.367+0000 7fdaa8ff7640 10 librados: watch_flush exit 2026-02-17T21:27:17.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.367+0000 7fdaa8ff7640 20 client.4786.objecter shutdown clearing up homeless session... 2026-02-17T21:27:17.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.367+0000 7fdaa8ff7640 10 client.4786.objecter successfully canceled tick 2026-02-17T21:27:17.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.367+0000 7fdaa8ff7640 1 -- 10.20.193.5:0/974734701 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fda70079280 msgr2=0x7fda7007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:17.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.367+0000 7fdaa8ff7640 1 --2- 10.20.193.5:0/974734701 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fda70079280 0x7fda7007b740 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4159900 tx=0x7fda98039040 comp rx=0 tx=0).stop 2026-02-17T21:27:17.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.367+0000 7fdaa8ff7640 10 monclient: shutdown 2026-02-17T21:27:17.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.367+0000 7fdaa8ff7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:17.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.367+0000 7fdaa8ff7640 1 -- 10.20.193.5:0/974734701 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdaa4155770 msgr2=0x7fdaa41f7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:17.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.367+0000 7fdaa8ff7640 1 --2- 10.20.193.5:0/974734701 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdaa4155770 0x7fdaa41f7800 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00c580 tx=0x7fda8c00ca50 comp rx=0 tx=0).stop 2026-02-17T21:27:17.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.367+0000 7fdaa8ff7640 1 -- 10.20.193.5:0/974734701 shutdown_connections 2026-02-17T21:27:17.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.367+0000 7fdaa8ff7640 1 --2- 10.20.193.5:0/974734701 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fda70079280 0x7fda7007b740 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:17.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.367+0000 7fdaa8ff7640 1 --2- 10.20.193.5:0/974734701 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fdaa415f570 0x7fdaa4158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:17.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.367+0000 7fdaa8ff7640 1 --2- 10.20.193.5:0/974734701 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdaa4155770 0x7fdaa41f7800 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:17.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.367+0000 7fdaa8ff7640 1 --2- 10.20.193.5:0/974734701 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fdaa40be810 0x7fdaa4074d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:17.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.367+0000 7fdaa8ff7640 1 -- 10.20.193.5:0/974734701 >> 10.20.193.5:0/974734701 conn(0x7fdaa40c9f40 msgr2=0x7fdaa415e480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:17.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.367+0000 7fdaa8ff7640 1 -- 10.20.193.5:0/974734701 shutdown_connections 2026-02-17T21:27:17.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.367+0000 7fdaa8ff7640 1 -- 10.20.193.5:0/974734701 wait complete. 2026-02-17T21:27:17.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:17.368+0000 7fdaa8ff7640 1 librados: shutdown 2026-02-17T21:27:17.477 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:03:57.102 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:27:17.477 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:03:57.101 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:27:17.478 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:03:57.103 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:27:17.479 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:03:57.103 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:27:17.488 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:03:57.113 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:27:17.488 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:03:57.113 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:27:17.507 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:03:57.093 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:27:17.509 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:03:57.095 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:27:17.518 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:03:57.104 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:27:20.379 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:27:20.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.448+0000 7f2871ed3640 10 monclient: get_monmap_and_config 2026-02-17T21:27:20.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.448+0000 7f2871ed3640 10 monclient: build_initial_monmap 2026-02-17T21:27:20.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.448+0000 7f2871ed3640 10 monclient: monmap: 2026-02-17T21:27:20.451 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:20.451 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:20.451 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:27:20.449200+0000 2026-02-17T21:27:20.451 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:27:20.449200+0000 2026-02-17T21:27:20.451 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:20.451 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:20.451 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:27:20.451 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:27:20.451 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:27:20.451 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:27:20.452 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:27:20.452 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:27:20.452 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:20.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.448+0000 7f2871ed3640 1 Processor -- start 2026-02-17T21:27:20.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.448+0000 7f2871ed3640 1 -- start start 2026-02-17T21:27:20.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.448+0000 7f2871ed3640 10 monclient: init 2026-02-17T21:27:20.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.449+0000 7f2871ed3640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:20.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.449+0000 7f2871ed3640 10 monclient: _add_conns ranks=[1,0,4,5,2,3] 2026-02-17T21:27:20.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.449+0000 7f2871ed3640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f286c0c7170 addr v1:10.20.193.119:6789/0 2026-02-17T21:27:20.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.449+0000 7f2871ed3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f286c0c7550 addr v1:10.20.193.5:6789/0 2026-02-17T21:27:20.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.449+0000 7f2871ed3640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f286c0c89c0 0x7f286c0c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:20.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.449+0000 7f2871ed3640 10 monclient(hunting): picked mon.noname-b con 0x7f286c0c89c0 addr v2:10.20.193.119:3300/0 2026-02-17T21:27:20.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.449+0000 7f2871ed3640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f286c0c4fd0 con 0x7f286c0c7550 2026-02-17T21:27:20.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.449+0000 7f2871ed3640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f286c15a9a0 con 0x7f286c0c7170 2026-02-17T21:27:20.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.449+0000 7f2871ed3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:20.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.449+0000 7f2871ed3640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f286c0c8530 con 0x7f286c0c89c0 2026-02-17T21:27:20.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.449+0000 7f2871ed3640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:20.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.449+0000 7f2871ed3640 10 monclient(hunting): authenticate will time out at 1146.014497s 2026-02-17T21:27:20.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.449+0000 7f286affd640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f286c0c7550 0x7f286c0749b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:46598/0 (socket says 10.20.193.5:46598) 2026-02-17T21:27:20.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.449+0000 7f286affd640 1 -- 10.20.193.5:0/1216712933 learned_addr learned my addr 10.20.193.5:0/1216712933 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:27:20.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.450+0000 7f286bfff640 1 --2- 10.20.193.5:0/1216712933 >> v2:10.20.193.119:3300/0 conn(0x7f286c0c89c0 0x7f286c0c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:20.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.450+0000 7f286bfff640 10 monclient(hunting): get_auth_request con 0x7f286c0c89c0 auth_method 0 2026-02-17T21:27:20.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.450+0000 7f286bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:20.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.450+0000 7f286bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:20.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.450+0000 7f286bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:20.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.451+0000 7f286bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:20.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.451+0000 7f286bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:20.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.451+0000 7f286bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:20.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.451+0000 7f286a7fc640 1 -- 10.20.193.5:0/1216712933 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2775295163 0 0) 0x7f286c0c4fd0 con 0x7f286c0c7550 2026-02-17T21:27:20.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.451+0000 7f286a7fc640 10 monclient(hunting): _negotiate 2026-02-17T21:27:20.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.451+0000 7f286a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:20.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.451+0000 7f286a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:20.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.451+0000 7f286a7fc640 10 monclient(hunting): my global_id is 4764 2026-02-17T21:27:20.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.451+0000 7f286a7fc640 1 -- 10.20.193.5:0/1216712933 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2850003620 con 0x7f286c0c7550 2026-02-17T21:27:20.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.452+0000 7f286a7fc640 1 -- 10.20.193.5:0/1216712933 <== mon.0 v1:10.20.193.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3266401034 0 0) 0x7f2850003620 con 0x7f286c0c7550 2026-02-17T21:27:20.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 1 -- 10.20.193.5:0/1216712933 >> v2:10.20.193.119:3300/0 conn(0x7f286c0c89c0 msgr2=0x7f286c0c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:27:20.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 1 --2- 10.20.193.5:0/1216712933 >> v2:10.20.193.119:3300/0 conn(0x7f286c0c89c0 0x7f286c0c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:20.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 1 -- 10.20.193.5:0/1216712933 >> v1:10.20.193.119:6789/0 conn(0x7f286c0c7170 legacy=0x7f286c0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:20.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:27:20.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 1 monclient: found mon.noname-a-legacy 2026-02-17T21:27:20.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:20.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.5:6789/0 2026-02-17T21:27:20.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 1 -- 10.20.193.5:0/1216712933 --> v1:10.20.193.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286c0c5270 con 0x7f286c0c7550 2026-02-17T21:27:20.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 10 monclient: _finish_auth 0 2026-02-17T21:27:20.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:27:20.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:20.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 1 -- 10.20.193.5:0/1216712933 <== mon.0 v1:10.20.193.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3880376286 0 0) 0x7f285c002f00 con 0x7f286c0c7550 2026-02-17T21:27:20.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:20.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T21:27:20.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 10 monclient: dump: 2026-02-17T21:27:20.462 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:20.462 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:20.463 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:20.463 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:20.463 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:20.463 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:20.463 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:20.463 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:20.463 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:20.463 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:20.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] but i'm connected to v1:10.20.193.5:6789/0, reconnecting 2026-02-17T21:27:20.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:20.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 1 -- 10.20.193.5:0/1216712933 >> v1:10.20.193.5:6789/0 conn(0x7f286c0c7550 legacy=0x7f286c0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:20.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:27:20.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 1 --2- 10.20.193.5:0/1216712933 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2850003bf0 0x7f2850004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:20.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 10 monclient(hunting): picked mon.b con 0x7f2850003bf0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:27:20.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 1 --2- 10.20.193.5:0/1216712933 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2850004900 0x7f2850004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:20.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 10 monclient(hunting): picked mon.a con 0x7f2850004900 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:27:20.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 1 --2- 10.20.193.5:0/1216712933 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f28500054c0 0x7f285000bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:20.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 10 monclient(hunting): picked mon.c con 0x7f28500054c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:27:20.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:20.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 1 -- 10.20.193.5:0/1216712933 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f286c0c8530 con 0x7f2850004900 2026-02-17T21:27:20.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:20.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 1 -- 10.20.193.5:0/1216712933 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f285000c330 con 0x7f2850003bf0 2026-02-17T21:27:20.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:20.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 1 -- 10.20.193.5:0/1216712933 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f285000c530 con 0x7f28500054c0 2026-02-17T21:27:20.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:20.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:27:20.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286bfff640 1 --2- 10.20.193.5:0/1216712933 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f28500054c0 0x7f285000bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:20.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286bfff640 10 monclient(hunting): get_auth_request con 0x7f28500054c0 auth_method 0 2026-02-17T21:27:20.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:20.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:20.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.453+0000 7f286bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:27:20.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.454+0000 7f286affd640 1 --2- 10.20.193.5:0/1216712933 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2850004900 0x7f2850004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:20.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.454+0000 7f286bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:20.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.454+0000 7f286bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:20.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.454+0000 7f286bfff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:27:20.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286affd640 10 monclient(hunting): get_auth_request con 0x7f2850004900 auth_method 0 2026-02-17T21:27:20.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:20.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:20.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:27:20.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286b7fe640 1 --2- 10.20.193.5:0/1216712933 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2850003bf0 0x7f2850004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:20.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286b7fe640 10 monclient(hunting): get_auth_request con 0x7f2850003bf0 auth_method 0 2026-02-17T21:27:20.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:20.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:20.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:27:20.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:20.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:20.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286affd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:27:20.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:20.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:20.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:27:20.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286bfff640 10 monclient(hunting): handle_auth_done global_id 4764 payload 293 2026-02-17T21:27:20.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286bfff640 1 -- 10.20.193.5:0/1216712933 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2850003bf0 msgr2=0x7f2850004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:27:20.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286bfff640 1 --2- 10.20.193.5:0/1216712933 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2850003bf0 0x7f2850004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:20.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286bfff640 1 -- 10.20.193.5:0/1216712933 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2850004900 msgr2=0x7f2850004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:27:20.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286bfff640 1 --2- 10.20.193.5:0/1216712933 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2850004900 0x7f2850004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:20.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286bfff640 10 monclient: _finish_hunting 0 2026-02-17T21:27:20.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286bfff640 1 monclient: found mon.c 2026-02-17T21:27:20.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:20.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286bfff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:27:20.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286bfff640 1 -- 10.20.193.5:0/1216712933 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2850003620 con 0x7f28500054c0 2026-02-17T21:27:20.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286bfff640 10 monclient: _finish_auth 0 2026-02-17T21:27:20.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286bfff640 10 monclient: _check_auth_tickets 2026-02-17T21:27:20.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f286bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:20.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f2871ed3640 5 monclient: authenticate success, global_id 4764 2026-02-17T21:27:20.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.455+0000 7f2871ed3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:27:20.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.456+0000 7f286bfff640 1 -- 10.20.193.5:0/1216712933 reap_dead start 2026-02-17T21:27:20.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.457+0000 7f286bfff640 1 --2- 10.20.193.5:0/1216712933 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f28500054c0 0x7f285000bac0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2860009fc0 tx=0x7f286002f5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d8a8e5eb0e886e3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:20.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.459+0000 7f286a7fc640 1 -- 10.20.193.5:0/1216712933 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286003a020 con 0x7f28500054c0 2026-02-17T21:27:20.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.459+0000 7f286a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:20.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.459+0000 7f286a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:27:20.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.459+0000 7f286a7fc640 10 monclient: dump: 2026-02-17T21:27:20.475 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:20.476 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:20.476 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:20.476 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:20.476 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:20.476 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:20.476 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:20.476 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:20.476 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:20.476 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:20.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.459+0000 7f2871ed3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:27:20.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.459+0000 7f286a7fc640 1 -- 10.20.193.5:0/1216712933 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2860003c90 con 0x7f28500054c0 2026-02-17T21:27:20.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.459+0000 7f286a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:20.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.459+0000 7f286a7fc640 1 -- 10.20.193.5:0/1216712933 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2860009c10 con 0x7f28500054c0 2026-02-17T21:27:20.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.459+0000 7f2871ed3640 10 monclient: get_monmap_and_config success 2026-02-17T21:27:20.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.459+0000 7f2871ed3640 4 set_mon_vals no callback set 2026-02-17T21:27:20.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.459+0000 7f286a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:20.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.459+0000 7f286a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:27:20.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.459+0000 7f286a7fc640 10 monclient: dump: 2026-02-17T21:27:20.477 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:20.477 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:20.477 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:20.477 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:20.477 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:20.478 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:20.478 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:20.478 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:20.478 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:20.478 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:20.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.459+0000 7f2871ed3640 10 monclient: shutdown 2026-02-17T21:27:20.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.459+0000 7f2871ed3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:20.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.459+0000 7f2871ed3640 1 -- 10.20.193.5:0/1216712933 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f28500054c0 msgr2=0x7f285000bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:20.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.459+0000 7f2871ed3640 1 --2- 10.20.193.5:0/1216712933 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f28500054c0 0x7f285000bac0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2860009fc0 tx=0x7f286002f5b0 comp rx=0 tx=0).stop 2026-02-17T21:27:20.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.459+0000 7f2871ed3640 1 -- 10.20.193.5:0/1216712933 shutdown_connections 2026-02-17T21:27:20.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.459+0000 7f2871ed3640 1 --2- 10.20.193.5:0/1216712933 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f28500054c0 0x7f285000bac0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:20.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.459+0000 7f2871ed3640 1 -- 10.20.193.5:0/1216712933 >> 10.20.193.5:0/1216712933 conn(0x7f286c0c9f40 msgr2=0x7f286c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:20.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.459+0000 7f2871ed3640 1 -- 10.20.193.5:0/1216712933 shutdown_connections 2026-02-17T21:27:20.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.459+0000 7f2871ed3640 1 -- 10.20.193.5:0/1216712933 wait complete. 2026-02-17T21:27:20.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.459+0000 7f2871ed3640 10 monclient: build_initial_monmap 2026-02-17T21:27:20.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.460+0000 7f2871ed3640 10 monclient: monmap: 2026-02-17T21:27:20.479 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:20.479 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:27:20.479 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:27:20.479 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:27:20.479 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:20.479 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:20.479 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:27:20.480 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:27:20.480 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:27:20.480 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:20.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.460+0000 7f2871ed3640 1 librados: starting msgr at 2026-02-17T21:27:20.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.460+0000 7f2871ed3640 1 librados: starting objecter 2026-02-17T21:27:20.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.460+0000 7f2871ed3640 1 Processor -- start 2026-02-17T21:27:20.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.460+0000 7f2871ed3640 1 -- start start 2026-02-17T21:27:20.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.460+0000 7f2871ed3640 1 librados: setting wanted keys 2026-02-17T21:27:20.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.460+0000 7f2871ed3640 1 librados: calling monclient init 2026-02-17T21:27:20.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.460+0000 7f2871ed3640 10 monclient: init 2026-02-17T21:27:20.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.460+0000 7f2871ed3640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:20.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.460+0000 7f2871ed3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:27:20.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.460+0000 7f2871ed3640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f28500054c0 0x7f286c15cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:20.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.460+0000 7f2871ed3640 10 monclient(hunting): picked mon.noname-a con 0x7f28500054c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:27:20.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.460+0000 7f2871ed3640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f286c15dc50 0x7f286c1f2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:20.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.460+0000 7f2871ed3640 10 monclient(hunting): picked mon.noname-c con 0x7f286c15dc50 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:27:20.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.460+0000 7f2871ed3640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f286c1f3150 0x7f286c072a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:20.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.460+0000 7f2871ed3640 10 monclient(hunting): picked mon.noname-b con 0x7f286c1f3150 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:27:20.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.460+0000 7f2871ed3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:20.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.460+0000 7f2871ed3640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f286c0c7ee0 con 0x7f28500054c0 2026-02-17T21:27:20.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.460+0000 7f2871ed3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:20.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.460+0000 7f2871ed3640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f286c0c5830 con 0x7f286c1f3150 2026-02-17T21:27:20.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.460+0000 7f2871ed3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:20.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.460+0000 7f2871ed3640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f286c0c81c0 con 0x7f286c15dc50 2026-02-17T21:27:20.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.460+0000 7f2871ed3640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:20.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.460+0000 7f2871ed3640 10 monclient(hunting): authenticate will time out at 1146.025784s 2026-02-17T21:27:20.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.461+0000 7f286bfff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f286c1f3150 0x7f286c072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:20.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.461+0000 7f286affd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f286c15dc50 0x7f286c1f2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:20.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.461+0000 7f286bfff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f286c1f3150 0x7f286c072a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:39940/0 (socket says 10.20.193.5:39940) 2026-02-17T21:27:20.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.461+0000 7f286bfff640 1 -- 10.20.193.5:0/2581867312 learned_addr learned my addr 10.20.193.5:0/2581867312 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:27:20.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.461+0000 7f286bfff640 10 monclient(hunting): get_auth_request con 0x7f286c1f3150 auth_method 0 2026-02-17T21:27:20.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.461+0000 7f286bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:20.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.461+0000 7f286bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:20.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.461+0000 7f286bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:20.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.461+0000 7f286affd640 10 monclient(hunting): get_auth_request con 0x7f286c15dc50 auth_method 0 2026-02-17T21:27:20.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.461+0000 7f286affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:20.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.461+0000 7f286affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:20.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.461+0000 7f286affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:20.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.461+0000 7f286bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:20.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.461+0000 7f286bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:20.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.461+0000 7f286bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:20.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.461+0000 7f286affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:20.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.461+0000 7f286affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:20.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.461+0000 7f286affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:20.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.461+0000 7f286b7fe640 1 --2- 10.20.193.5:0/2581867312 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f28500054c0 0x7f286c15cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:20.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.462+0000 7f286b7fe640 10 monclient(hunting): get_auth_request con 0x7f28500054c0 auth_method 0 2026-02-17T21:27:20.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.462+0000 7f286b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:20.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.462+0000 7f286b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:20.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.462+0000 7f286b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:20.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.462+0000 7f286b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:20.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.462+0000 7f286b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:20.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.462+0000 7f286b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:20.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.463+0000 7f286affd640 10 monclient(hunting): handle_auth_done global_id 4793 payload 824 2026-02-17T21:27:20.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.463+0000 7f286affd640 1 -- 10.20.193.5:0/2581867312 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f286c1f3150 msgr2=0x7f286c072a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:20.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.463+0000 7f286affd640 1 --2- 10.20.193.5:0/2581867312 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f286c1f3150 0x7f286c072a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:20.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.463+0000 7f286affd640 1 -- 10.20.193.5:0/2581867312 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f28500054c0 msgr2=0x7f286c15cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:20.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.463+0000 7f286affd640 1 --2- 10.20.193.5:0/2581867312 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f28500054c0 0x7f286c15cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:20.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.463+0000 7f286affd640 10 monclient: _finish_hunting 0 2026-02-17T21:27:20.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.463+0000 7f286affd640 1 monclient: found mon.noname-c 2026-02-17T21:27:20.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.463+0000 7f286affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:20.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.463+0000 7f286affd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:27:20.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.463+0000 7f286affd640 1 -- 10.20.193.5:0/2581867312 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286c1f35e0 con 0x7f286c15dc50 2026-02-17T21:27:20.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.466+0000 7f286affd640 1 --2- 10.20.193.5:0/2581867312 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f286c15dc50 0x7f286c1f2c10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f285c007110 tx=0x7f285c0075e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:20.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.466+0000 7f2847fff640 10 client.?.objecter ms_handle_connect 0x7f286c15dc50 2026-02-17T21:27:20.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.466+0000 7f2847fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:27:20.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.468+0000 7f2847fff640 1 -- 10.20.193.5:0/2581867312 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c00f9c0 con 0x7f286c15dc50 2026-02-17T21:27:20.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.468+0000 7f2847fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:20.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.468+0000 7f2847fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:27:20.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.468+0000 7f2847fff640 10 monclient: dump: 2026-02-17T21:27:20.485 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:20.486 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:20.486 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:20.486 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:20.486 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:20.486 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:20.486 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:20.486 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:20.486 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:20.486 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:20.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.468+0000 7f2847fff640 10 monclient: _finish_auth 0 2026-02-17T21:27:20.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.468+0000 7f2847fff640 10 monclient: _check_auth_tickets 2026-02-17T21:27:20.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.468+0000 7f2847fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:20.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.468+0000 7f2871ed3640 5 monclient: authenticate success, global_id 4793 2026-02-17T21:27:20.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.468+0000 7f2847fff640 1 -- 10.20.193.5:0/2581867312 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f285c018070 con 0x7f286c15dc50 2026-02-17T21:27:20.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.468+0000 7f2871ed3640 10 monclient: _renew_subs 2026-02-17T21:27:20.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.468+0000 7f2871ed3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:27:20.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.468+0000 7f2871ed3640 1 -- 10.20.193.5:0/2581867312 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f286c1f17c0 con 0x7f286c15dc50 2026-02-17T21:27:20.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.468+0000 7f2847fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:20.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.468+0000 7f2847fff640 1 -- 10.20.193.5:0/2581867312 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c00fd80 con 0x7f286c15dc50 2026-02-17T21:27:20.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.468+0000 7f2847fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:20.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.468+0000 7f2847fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:27:20.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.468+0000 7f2869ffb640 4 set_mon_vals no callback set 2026-02-17T21:27:20.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.468+0000 7f2847fff640 10 monclient: dump: 2026-02-17T21:27:20.487 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:20.488 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:20.488 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:20.488 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:20.488 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:20.488 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:20.488 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:20.488 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:20.488 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:20.488 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:20.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.468+0000 7f2871ed3640 10 client.4793.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:27:20.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.468+0000 7f2871ed3640 10 monclient: _renew_subs 2026-02-17T21:27:20.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.468+0000 7f2871ed3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:27:20.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.468+0000 7f2871ed3640 1 -- 10.20.193.5:0/2581867312 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f286c1f1d80 con 0x7f286c15dc50 2026-02-17T21:27:20.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.468+0000 7f2871ed3640 1 librados: init done 2026-02-17T21:27:20.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.469+0000 7f2871ed3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:20.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.469+0000 7f2871ed3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:20.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.469+0000 7f2871ed3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:27:20.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.469+0000 7f2871ed3640 1 -- 10.20.193.5:0/2581867312 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f286c0c8e70 con 0x7f286c15dc50 2026-02-17T21:27:20.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.575+0000 7f2847fff640 1 -- 10.20.193.5:0/2581867312 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f285c01d460 con 0x7f286c15dc50 2026-02-17T21:27:20.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.576+0000 7f2847fff640 1 --2- 10.20.193.5:0/2581867312 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f283c079280 0x7f283c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:20.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.576+0000 7f286b7fe640 1 --2- 10.20.193.5:0/2581867312 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f283c079280 0x7f283c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:20.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.576+0000 7f286b7fe640 10 monclient: get_auth_request con 0x7f283c079280 auth_method 0 2026-02-17T21:27:20.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.576+0000 7f286b7fe640 1 --2- 10.20.193.5:0/2581867312 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f283c079280 0x7f283c07b740 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f286c0c0ad0 tx=0x7f2858007dc0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:20.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.576+0000 7f2847fff640 10 client.4793.objecter ms_handle_connect 0x7f283c079280 2026-02-17T21:27:20.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.577+0000 7f2847fff640 1 -- 10.20.193.5:0/2581867312 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f285c05e710 con 0x7f286c15dc50 2026-02-17T21:27:20.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.577+0000 7f2847fff640 10 client.4793.objecter ms_dispatch2 0x7f286c000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:27:20.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.577+0000 7f2847fff640 3 client.4793.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:27:20.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.577+0000 7f2847fff640 3 client.4793.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:27:20.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.577+0000 7f2847fff640 20 client.4793.objecter dump_active .. 0 homeless 2026-02-17T21:27:20.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.584+0000 7f2847fff640 1 -- 10.20.193.5:0/2581867312 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f285c0626d0 con 0x7f286c15dc50 2026-02-17T21:27:20.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.584+0000 7f2847fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:20.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.584+0000 7f2847fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:27:20.686 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.684+0000 7f2871ed3640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:27:20.686 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.684+0000 7f2871ed3640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:20.686 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.684+0000 7f2871ed3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:27:20.686 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.684+0000 7f2871ed3640 1 -- 10.20.193.5:0/2581867312 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f286c0c0cd0 con 0x7f286c15dc50 2026-02-17T21:27:20.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.687+0000 7f2847fff640 1 -- 10.20.193.5:0/2581867312 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f285c0669d0 con 0x7f286c15dc50 2026-02-17T21:27:20.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.687+0000 7f2847fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:20.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.687+0000 7f2847fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:27:20.689 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:27:20.689 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:27:20.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.688+0000 7f2871ed3640 10 librados: watch_flush enter 2026-02-17T21:27:20.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.688+0000 7f2871ed3640 10 librados: watch_flush exit 2026-02-17T21:27:20.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.688+0000 7f2871ed3640 20 client.4793.objecter shutdown clearing up homeless session... 2026-02-17T21:27:20.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.688+0000 7f2871ed3640 10 client.4793.objecter successfully canceled tick 2026-02-17T21:27:20.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.688+0000 7f2871ed3640 1 -- 10.20.193.5:0/2581867312 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f283c079280 msgr2=0x7f283c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:20.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.688+0000 7f2871ed3640 1 --2- 10.20.193.5:0/2581867312 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f283c079280 0x7f283c07b740 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f286c0c0ad0 tx=0x7f2858007dc0 comp rx=0 tx=0).stop 2026-02-17T21:27:20.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.688+0000 7f2871ed3640 10 monclient: shutdown 2026-02-17T21:27:20.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.688+0000 7f2871ed3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:20.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.688+0000 7f2871ed3640 1 -- 10.20.193.5:0/2581867312 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f286c15dc50 msgr2=0x7f286c1f2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:20.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.688+0000 7f2871ed3640 1 --2- 10.20.193.5:0/2581867312 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f286c15dc50 0x7f286c1f2c10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f285c007110 tx=0x7f285c0075e0 comp rx=0 tx=0).stop 2026-02-17T21:27:20.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.688+0000 7f2871ed3640 1 -- 10.20.193.5:0/2581867312 shutdown_connections 2026-02-17T21:27:20.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.688+0000 7f2871ed3640 1 --2- 10.20.193.5:0/2581867312 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f283c079280 0x7f283c07b740 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:20.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.688+0000 7f2871ed3640 1 --2- 10.20.193.5:0/2581867312 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f286c1f3150 0x7f286c072a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:20.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.688+0000 7f2871ed3640 1 --2- 10.20.193.5:0/2581867312 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f286c15dc50 0x7f286c1f2c10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:20.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.688+0000 7f2871ed3640 1 --2- 10.20.193.5:0/2581867312 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f28500054c0 0x7f286c15cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:20.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.688+0000 7f2871ed3640 1 -- 10.20.193.5:0/2581867312 >> 10.20.193.5:0/2581867312 conn(0x7f286c0c9f40 msgr2=0x7f286c14e420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:20.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.688+0000 7f2871ed3640 1 -- 10.20.193.5:0/2581867312 shutdown_connections 2026-02-17T21:27:20.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.688+0000 7f2871ed3640 1 -- 10.20.193.5:0/2581867312 wait complete. 2026-02-17T21:27:20.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:20.688+0000 7f2871ed3640 1 librados: shutdown 2026-02-17T21:27:23.699 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:27:23.766 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.765+0000 7f6bf8d08640 10 monclient: get_monmap_and_config 2026-02-17T21:27:23.766 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.765+0000 7f6bf8d08640 10 monclient: build_initial_monmap 2026-02-17T21:27:23.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.765+0000 7f6bf8d08640 10 monclient: monmap: 2026-02-17T21:27:23.767 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:23.767 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:23.767 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:27:23.766207+0000 2026-02-17T21:27:23.767 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:27:23.766207+0000 2026-02-17T21:27:23.767 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:23.767 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:23.767 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:27:23.767 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:27:23.767 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:27:23.767 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:27:23.767 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:27:23.767 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:27:23.767 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:23.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.766+0000 7f6bf8d08640 1 Processor -- start 2026-02-17T21:27:23.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.766+0000 7f6bf8d08640 1 -- start start 2026-02-17T21:27:23.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.766+0000 7f6bf8d08640 10 monclient: init 2026-02-17T21:27:23.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.766+0000 7f6bf8d08640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:23.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.766+0000 7f6bf8d08640 10 monclient: _add_conns ranks=[0,3,5,1,2,4] 2026-02-17T21:27:23.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.766+0000 7f6bf8d08640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6bf415f570 addr v1:10.20.193.5:6789/0 2026-02-17T21:27:23.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.766+0000 7f6bf8d08640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f6bf415f950 0x7f6bf40be810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:23.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.766+0000 7f6bf8d08640 10 monclient(hunting): picked mon.noname-a con 0x7f6bf415f950 addr v2:10.20.193.5:3300/0 2026-02-17T21:27:23.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.766+0000 7f6bf8d08640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f6bf4155770 0x7f6bf4155c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:23.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.766+0000 7f6bf8d08640 10 monclient(hunting): picked mon.noname-c con 0x7f6bf4155770 addr v2:10.20.193.135:3300/0 2026-02-17T21:27:23.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.766+0000 7f6bf8d08640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bf40bee70 con 0x7f6bf415f570 2026-02-17T21:27:23.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.766+0000 7f6bf8d08640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:23.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.766+0000 7f6bf8d08640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6bf40bfd60 con 0x7f6bf415f950 2026-02-17T21:27:23.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.766+0000 7f6bf8d08640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:23.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.766+0000 7f6bf8d08640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f6bf40bf150 con 0x7f6bf4155770 2026-02-17T21:27:23.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.766+0000 7f6bf8d08640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:23.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.766+0000 7f6bf8d08640 10 monclient(hunting): authenticate will time out at 1149.331617s 2026-02-17T21:27:23.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.766+0000 7f6bf1d74640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f6bf415f950 0x7f6bf40be810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:23.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.767+0000 7f6bf2d76640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f6bf4155770 0x7f6bf4155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:23.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.767+0000 7f6bf2d76640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f6bf4155770 0x7f6bf4155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:45940/0 (socket says 10.20.193.5:45940) 2026-02-17T21:27:23.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.767+0000 7f6bf2d76640 1 -- 10.20.193.5:0/473885687 learned_addr learned my addr 10.20.193.5:0/473885687 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:27:23.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.767+0000 7f6bf2d76640 10 monclient(hunting): get_auth_request con 0x7f6bf4155770 auth_method 0 2026-02-17T21:27:23.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.767+0000 7f6bf2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:23.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.767+0000 7f6bf2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:23.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.767+0000 7f6bf2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:23.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.767+0000 7f6bf1d74640 10 monclient(hunting): get_auth_request con 0x7f6bf415f950 auth_method 0 2026-02-17T21:27:23.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.767+0000 7f6bf1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:23.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.767+0000 7f6bf1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:23.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.767+0000 7f6bf1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:23.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.767+0000 7f6bf2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:23.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.767+0000 7f6bf2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:23.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.767+0000 7f6bf2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:23.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.767+0000 7f6bf1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:23.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.767+0000 7f6bf1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:23.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.767+0000 7f6bf1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:23.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.768+0000 7f6bf2d76640 10 monclient(hunting): handle_auth_done global_id 4796 payload 274 2026-02-17T21:27:23.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.768+0000 7f6bf2d76640 1 -- 10.20.193.5:0/473885687 >> v2:10.20.193.5:3300/0 conn(0x7f6bf415f950 msgr2=0x7f6bf40be810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:27:23.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.768+0000 7f6bf2d76640 1 --2- 10.20.193.5:0/473885687 >> v2:10.20.193.5:3300/0 conn(0x7f6bf415f950 0x7f6bf40be810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:23.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.768+0000 7f6bf2d76640 1 -- 10.20.193.5:0/473885687 >> v1:10.20.193.5:6789/0 conn(0x7f6bf415f570 legacy=0x7f6bf415d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:23.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.768+0000 7f6bf2d76640 10 monclient: _finish_hunting 0 2026-02-17T21:27:23.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.768+0000 7f6bf2d76640 1 monclient: found mon.noname-c 2026-02-17T21:27:23.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.768+0000 7f6bf2d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:23.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.768+0000 7f6bf2d76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:27:23.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.768+0000 7f6bf2d76640 1 -- 10.20.193.5:0/473885687 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf40bf430 con 0x7f6bf4155770 2026-02-17T21:27:23.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.769+0000 7f6bf2d76640 1 --2- 10.20.193.5:0/473885687 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6bf4155770 0x7f6bf4155c00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4070ff0 tx=0x7f6be402f270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc0af2def5762621 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:23.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf1573640 1 -- 10.20.193.5:0/473885687 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be402fd70 con 0x7f6bf4155770 2026-02-17T21:27:23.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:23.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf1573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:27:23.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf1573640 10 monclient: dump: 2026-02-17T21:27:23.773 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:23.773 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:23.773 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:23.773 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:23.773 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:23.773 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:23.773 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:23.773 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:23.773 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:23.773 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:23.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf1573640 10 monclient: _finish_auth 0 2026-02-17T21:27:23.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf1573640 10 monclient: _check_auth_tickets 2026-02-17T21:27:23.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:23.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf1573640 1 -- 10.20.193.5:0/473885687 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6be40373f0 con 0x7f6bf4155770 2026-02-17T21:27:23.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf1573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:23.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf1573640 1 -- 10.20.193.5:0/473885687 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be40377c0 con 0x7f6bf4155770 2026-02-17T21:27:23.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf8d08640 5 monclient: authenticate success, global_id 4796 2026-02-17T21:27:23.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf8d08640 10 monclient: get_monmap_and_config success 2026-02-17T21:27:23.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf8d08640 4 set_mon_vals no callback set 2026-02-17T21:27:23.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:23.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf1573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:27:23.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf1573640 10 monclient: dump: 2026-02-17T21:27:23.774 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:23.774 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:23.774 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:23.774 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:23.774 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:23.774 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:23.774 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:23.774 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:23.774 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:23.774 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:23.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf8d08640 10 monclient: shutdown 2026-02-17T21:27:23.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf8d08640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:23.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf8d08640 1 -- 10.20.193.5:0/473885687 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6bf4155770 msgr2=0x7f6bf4155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:23.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf8d08640 1 --2- 10.20.193.5:0/473885687 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6bf4155770 0x7f6bf4155c00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4070ff0 tx=0x7f6be402f270 comp rx=0 tx=0).stop 2026-02-17T21:27:23.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf8d08640 1 -- 10.20.193.5:0/473885687 shutdown_connections 2026-02-17T21:27:23.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf8d08640 1 --2- 10.20.193.5:0/473885687 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6bf4155770 0x7f6bf4155c00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:23.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf8d08640 1 --2- 10.20.193.5:0/473885687 >> v2:10.20.193.5:3300/0 conn(0x7f6bf415f950 0x7f6bf40be810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:23.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf8d08640 1 -- 10.20.193.5:0/473885687 >> 10.20.193.5:0/473885687 conn(0x7f6bf40c9f40 msgr2=0x7f6bf40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:23.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf8d08640 1 -- 10.20.193.5:0/473885687 shutdown_connections 2026-02-17T21:27:23.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf8d08640 1 -- 10.20.193.5:0/473885687 wait complete. 2026-02-17T21:27:23.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf8d08640 10 monclient: build_initial_monmap 2026-02-17T21:27:23.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.771+0000 7f6bf8d08640 10 monclient: monmap: 2026-02-17T21:27:23.777 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:23.777 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:27:23.777 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:27:23.777 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:27:23.777 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:23.777 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:23.777 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:27:23.777 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:27:23.777 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:27:23.777 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:23.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf8d08640 1 librados: starting msgr at 2026-02-17T21:27:23.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf8d08640 1 librados: starting objecter 2026-02-17T21:27:23.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf8d08640 1 Processor -- start 2026-02-17T21:27:23.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf8d08640 1 -- start start 2026-02-17T21:27:23.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf8d08640 1 librados: setting wanted keys 2026-02-17T21:27:23.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf8d08640 1 librados: calling monclient init 2026-02-17T21:27:23.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf8d08640 10 monclient: init 2026-02-17T21:27:23.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf8d08640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:23.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf8d08640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:27:23.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf8d08640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6bf4155770 0x7f6bf4072f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:23.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf8d08640 10 monclient(hunting): picked mon.noname-a con 0x7f6bf4155770 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:27:23.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf8d08640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6bf415f570 0x7f6bf406e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:23.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf8d08640 10 monclient(hunting): picked mon.noname-c con 0x7f6bf415f570 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:27:23.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf8d08640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6bf415f950 0x7f6bf40748f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:23.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf8d08640 10 monclient(hunting): picked mon.noname-b con 0x7f6bf415f950 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:27:23.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf8d08640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:23.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf8d08640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf415d910 con 0x7f6bf4155770 2026-02-17T21:27:23.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf8d08640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:23.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf8d08640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf40bf9f0 con 0x7f6bf415f950 2026-02-17T21:27:23.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf8d08640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:23.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf8d08640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf4156140 con 0x7f6bf415f570 2026-02-17T21:27:23.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf8d08640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:23.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf8d08640 10 monclient(hunting): authenticate will time out at 1149.337578s 2026-02-17T21:27:23.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf2575640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6bf4155770 0x7f6bf4072f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:23.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf1d74640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6bf415f570 0x7f6bf406e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:23.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf2575640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6bf4155770 0x7f6bf4072f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:53936/0 (socket says 10.20.193.5:53936) 2026-02-17T21:27:23.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf2575640 1 -- 10.20.193.5:0/1450878053 learned_addr learned my addr 10.20.193.5:0/1450878053 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:27:23.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf2575640 10 monclient(hunting): get_auth_request con 0x7f6bf4155770 auth_method 0 2026-02-17T21:27:23.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:23.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:23.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.772+0000 7f6bf2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:23.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.773+0000 7f6bf1d74640 10 monclient(hunting): get_auth_request con 0x7f6bf415f570 auth_method 0 2026-02-17T21:27:23.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.773+0000 7f6bf1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:23.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.773+0000 7f6bf1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:23.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.773+0000 7f6bf1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:23.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.773+0000 7f6bf2d76640 1 --2- 10.20.193.5:0/1450878053 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6bf415f950 0x7f6bf40748f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:23.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.773+0000 7f6bf2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:23.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.773+0000 7f6bf2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:23.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.773+0000 7f6bf2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:23.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.773+0000 7f6bf2d76640 10 monclient(hunting): get_auth_request con 0x7f6bf415f950 auth_method 0 2026-02-17T21:27:23.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.773+0000 7f6bf2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:23.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.773+0000 7f6bf2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:23.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.773+0000 7f6bf2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:23.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.773+0000 7f6bf1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:23.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.773+0000 7f6bf1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:23.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.773+0000 7f6bf1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:23.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.773+0000 7f6bf2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:23.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.773+0000 7f6bf2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:23.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.773+0000 7f6bf2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:23.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.774+0000 7f6bf2575640 10 monclient(hunting): handle_auth_done global_id 4776 payload 824 2026-02-17T21:27:23.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.774+0000 7f6bf2575640 1 -- 10.20.193.5:0/1450878053 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6bf415f570 msgr2=0x7f6bf406e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:23.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.774+0000 7f6bf2575640 1 --2- 10.20.193.5:0/1450878053 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6bf415f570 0x7f6bf406e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:23.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.774+0000 7f6bf2575640 1 -- 10.20.193.5:0/1450878053 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6bf415f950 msgr2=0x7f6bf40748f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:23.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.774+0000 7f6bf2575640 1 --2- 10.20.193.5:0/1450878053 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6bf415f950 0x7f6bf40748f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:23.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.774+0000 7f6bf2575640 10 monclient: _finish_hunting 0 2026-02-17T21:27:23.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.774+0000 7f6bf2575640 1 monclient: found mon.noname-a 2026-02-17T21:27:23.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.774+0000 7f6bf2575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:23.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.774+0000 7f6bf2575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:27:23.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.774+0000 7f6bf2575640 1 -- 10.20.193.5:0/1450878053 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf4073810 con 0x7f6bf4155770 2026-02-17T21:27:23.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.775+0000 7f6bf2575640 1 --2- 10.20.193.5:0/1450878053 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6bf4155770 0x7f6bf4072f70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6be800c5b0 tx=0x7f6be800ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:23.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.775+0000 7f6bdaffd640 10 client.?.objecter ms_handle_connect 0x7f6bf4155770 2026-02-17T21:27:23.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.775+0000 7f6bdaffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:27:23.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bdaffd640 1 -- 10.20.193.5:0/1450878053 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be80052d0 con 0x7f6bf4155770 2026-02-17T21:27:23.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bdaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:23.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bdaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:27:23.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bdaffd640 10 monclient: dump: 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bdaffd640 10 monclient: _finish_auth 0 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bdaffd640 10 monclient: _check_auth_tickets 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bdaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bdaffd640 1 -- 10.20.193.5:0/1450878053 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6be8005470 con 0x7f6bf4155770 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bf8d08640 5 monclient: authenticate success, global_id 4776 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bf8d08640 10 monclient: _renew_subs 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bf8d08640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bf8d08640 1 -- 10.20.193.5:0/1450878053 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bf4073af0 con 0x7f6bf4155770 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bdaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bdaffd640 1 -- 10.20.193.5:0/1450878053 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be80038f0 con 0x7f6bf4155770 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bdaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bdaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bdaffd640 10 monclient: dump: 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:23.781 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:23.782 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:23.782 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:23.782 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:23.782 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:23.782 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:23.782 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:23.782 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:23.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bf0d72640 4 set_mon_vals no callback set 2026-02-17T21:27:23.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bf8d08640 10 client.4776.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:27:23.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bf8d08640 10 monclient: _renew_subs 2026-02-17T21:27:23.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bf8d08640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:27:23.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bf8d08640 1 -- 10.20.193.5:0/1450878053 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bf40c2aa0 con 0x7f6bf4155770 2026-02-17T21:27:23.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bf8d08640 1 librados: init done 2026-02-17T21:27:23.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bf8d08640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:23.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bf8d08640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:23.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bf8d08640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:27:23.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.777+0000 7f6bf8d08640 1 -- 10.20.193.5:0/1450878053 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bf40c01f0 con 0x7f6bf4155770 2026-02-17T21:27:23.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.864+0000 7f6bdaffd640 1 -- 10.20.193.5:0/1450878053 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f6be8003a90 con 0x7f6bf4155770 2026-02-17T21:27:23.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.865+0000 7f6bdaffd640 1 --2- 10.20.193.5:0/1450878053 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6bc0079280 0x7f6bc007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:23.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.865+0000 7f6bf1d74640 1 --2- 10.20.193.5:0/1450878053 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6bc0079280 0x7f6bc007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:23.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.865+0000 7f6bf1d74640 10 monclient: get_auth_request con 0x7f6bc0079280 auth_method 0 2026-02-17T21:27:23.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.866+0000 7f6bf1d74640 1 --2- 10.20.193.5:0/1450878053 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6bc0079280 0x7f6bc007b740 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6bf406f750 tx=0x7f6bdc009290 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:23.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.866+0000 7f6bdaffd640 10 client.4776.objecter ms_handle_connect 0x7f6bc0079280 2026-02-17T21:27:23.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.892+0000 7f6bdaffd640 1 -- 10.20.193.5:0/1450878053 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f6be805e3c0 con 0x7f6bf4155770 2026-02-17T21:27:23.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.892+0000 7f6bdaffd640 10 client.4776.objecter ms_dispatch2 0x7f6bf4000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:27:23.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.892+0000 7f6bdaffd640 3 client.4776.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:27:23.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.892+0000 7f6bdaffd640 3 client.4776.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:27:23.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.892+0000 7f6bdaffd640 20 client.4776.objecter dump_active .. 0 homeless 2026-02-17T21:27:23.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.892+0000 7f6bdaffd640 1 -- 10.20.193.5:0/1450878053 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6be8062380 con 0x7f6bf4155770 2026-02-17T21:27:23.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.892+0000 7f6bdaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:23.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.892+0000 7f6bdaffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:27:23.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.991+0000 7f6bf8d08640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:27:23.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.991+0000 7f6bf8d08640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:23.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.991+0000 7f6bf8d08640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:27:23.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.991+0000 7f6bf8d08640 1 -- 10.20.193.5:0/1450878053 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6bf4151030 con 0x7f6bf4155770 2026-02-17T21:27:23.994 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.993+0000 7f6bdaffd640 1 -- 10.20.193.5:0/1450878053 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f6be8066680 con 0x7f6bf4155770 2026-02-17T21:27:23.994 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.993+0000 7f6bdaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:23.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.993+0000 7f6bdaffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:27:23.995 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:27:23.995 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:27:23.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.994+0000 7f6bf8d08640 10 librados: watch_flush enter 2026-02-17T21:27:23.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.994+0000 7f6bf8d08640 10 librados: watch_flush exit 2026-02-17T21:27:23.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.994+0000 7f6bf8d08640 20 client.4776.objecter shutdown clearing up homeless session... 2026-02-17T21:27:23.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.994+0000 7f6bf8d08640 10 client.4776.objecter successfully canceled tick 2026-02-17T21:27:23.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.995+0000 7f6bf8d08640 1 -- 10.20.193.5:0/1450878053 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6bc0079280 msgr2=0x7f6bc007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:23.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.995+0000 7f6bf8d08640 1 --2- 10.20.193.5:0/1450878053 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6bc0079280 0x7f6bc007b740 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6bf406f750 tx=0x7f6bdc009290 comp rx=0 tx=0).stop 2026-02-17T21:27:23.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.995+0000 7f6bf8d08640 10 monclient: shutdown 2026-02-17T21:27:23.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.995+0000 7f6bf8d08640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:23.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.995+0000 7f6bf8d08640 1 -- 10.20.193.5:0/1450878053 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6bf4155770 msgr2=0x7f6bf4072f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:23.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.995+0000 7f6bf8d08640 1 --2- 10.20.193.5:0/1450878053 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6bf4155770 0x7f6bf4072f70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6be800c5b0 tx=0x7f6be800ca80 comp rx=0 tx=0).stop 2026-02-17T21:27:23.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.995+0000 7f6bf8d08640 1 -- 10.20.193.5:0/1450878053 shutdown_connections 2026-02-17T21:27:23.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.995+0000 7f6bf8d08640 1 --2- 10.20.193.5:0/1450878053 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6bc0079280 0x7f6bc007b740 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:23.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.995+0000 7f6bf8d08640 1 --2- 10.20.193.5:0/1450878053 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6bf415f950 0x7f6bf40748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:23.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.995+0000 7f6bf8d08640 1 --2- 10.20.193.5:0/1450878053 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6bf415f570 0x7f6bf406e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:23.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.995+0000 7f6bf8d08640 1 --2- 10.20.193.5:0/1450878053 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6bf4155770 0x7f6bf4072f70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:23.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.995+0000 7f6bf8d08640 1 -- 10.20.193.5:0/1450878053 >> 10.20.193.5:0/1450878053 conn(0x7f6bf40c9f40 msgr2=0x7f6bf415dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:23.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.995+0000 7f6bf8d08640 1 -- 10.20.193.5:0/1450878053 shutdown_connections 2026-02-17T21:27:23.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.995+0000 7f6bf8d08640 1 -- 10.20.193.5:0/1450878053 wait complete. 2026-02-17T21:27:23.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:23.995+0000 7f6bf8d08640 1 librados: shutdown 2026-02-17T21:27:27.005 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:27:27.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.074+0000 7f57f100e640 10 monclient: get_monmap_and_config 2026-02-17T21:27:27.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.074+0000 7f57f100e640 10 monclient: build_initial_monmap 2026-02-17T21:27:27.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.074+0000 7f57f100e640 10 monclient: monmap: 2026-02-17T21:27:27.076 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:27.076 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:27.076 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:27:27.074883+0000 2026-02-17T21:27:27.076 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:27:27.074883+0000 2026-02-17T21:27:27.076 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:27.076 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:27.076 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:27:27.077 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:27:27.077 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:27:27.077 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:27:27.077 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:27:27.077 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:27:27.077 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:27.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.074+0000 7f57f100e640 1 Processor -- start 2026-02-17T21:27:27.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.074+0000 7f57f100e640 1 -- start start 2026-02-17T21:27:27.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.074+0000 7f57f100e640 10 monclient: init 2026-02-17T21:27:27.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.075+0000 7f57f100e640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:27.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.075+0000 7f57f100e640 10 monclient: _add_conns ranks=[5,0,2,1,4,3] 2026-02-17T21:27:27.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.075+0000 7f57f100e640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f57ec0c7170 0x7f57ec0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:27.080 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.075+0000 7f57f100e640 10 monclient(hunting): picked mon.noname-c con 0x7f57ec0c7170 addr v2:10.20.193.135:3300/0 2026-02-17T21:27:27.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.075+0000 7f57f100e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f57ec0c48c0 addr v1:10.20.193.5:6789/0 2026-02-17T21:27:27.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.075+0000 7f57f100e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f57ec0c4d10 addr v1:10.20.193.135:6789/0 2026-02-17T21:27:27.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.075+0000 7f57f100e640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57ec15a9a0 con 0x7f57ec0c48c0 2026-02-17T21:27:27.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.075+0000 7f57f100e640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57ec0c5270 con 0x7f57ec0c4d10 2026-02-17T21:27:27.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.075+0000 7f57f100e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:27.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.075+0000 7f57f100e640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f57ec0c8530 con 0x7f57ec0c7170 2026-02-17T21:27:27.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.075+0000 7f57f100e640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:27.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.075+0000 7f57f100e640 10 monclient(hunting): authenticate will time out at 1152.640294s 2026-02-17T21:27:27.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.075+0000 7f57ea575640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f57ec0c48c0 0x7f57ec0749b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:46622/0 (socket says 10.20.193.5:46622) 2026-02-17T21:27:27.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.075+0000 7f57ea575640 1 -- 10.20.193.5:0/3417571693 learned_addr learned my addr 10.20.193.5:0/3417571693 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:27:27.081 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.075+0000 7f57ead76640 1 --2- 10.20.193.5:0/3417571693 >> v2:10.20.193.135:3300/0 conn(0x7f57ec0c7170 0x7f57ec0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:27.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.076+0000 7f57ead76640 10 monclient(hunting): get_auth_request con 0x7f57ec0c7170 auth_method 0 2026-02-17T21:27:27.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.076+0000 7f57ead76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:27.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.076+0000 7f57ead76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:27.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.076+0000 7f57ead76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:27.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.076+0000 7f57ead76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:27.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.076+0000 7f57ead76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:27.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.076+0000 7f57ead76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:27.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.077+0000 7f57e9d74640 1 -- 10.20.193.5:0/3417571693 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 421378532 0 0) 0x7f57ec15a9a0 con 0x7f57ec0c48c0 2026-02-17T21:27:27.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.077+0000 7f57e9d74640 10 monclient(hunting): _negotiate 2026-02-17T21:27:27.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.077+0000 7f57e9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:27.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.077+0000 7f57e9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:27.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.077+0000 7f57e9d74640 10 monclient(hunting): my global_id is 4779 2026-02-17T21:27:27.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.077+0000 7f57e9d74640 1 -- 10.20.193.5:0/3417571693 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57d8003620 con 0x7f57ec0c48c0 2026-02-17T21:27:27.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.078+0000 7f57ead76640 10 monclient(hunting): handle_auth_done global_id 4802 payload 274 2026-02-17T21:27:27.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.078+0000 7f57ead76640 1 -- 10.20.193.5:0/3417571693 >> v1:10.20.193.135:6789/0 conn(0x7f57ec0c4d10 legacy=0x7f57ec0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:27.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.078+0000 7f57ead76640 1 -- 10.20.193.5:0/3417571693 >> v1:10.20.193.5:6789/0 conn(0x7f57ec0c48c0 legacy=0x7f57ec0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:27.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.078+0000 7f57ead76640 10 monclient: _finish_hunting 0 2026-02-17T21:27:27.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.078+0000 7f57ead76640 1 monclient: found mon.noname-c 2026-02-17T21:27:27.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.078+0000 7f57ead76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:27.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.078+0000 7f57ead76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:27:27.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.078+0000 7f57ead76640 1 -- 10.20.193.5:0/3417571693 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57ec0c5550 con 0x7f57ec0c7170 2026-02-17T21:27:27.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.079+0000 7f57ead76640 1 --2- 10.20.193.5:0/3417571693 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f57ec0c7170 0x7f57ec0c7550 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f57e00098a0 tx=0x7f57e002ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff378d44335cbb3a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:27.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.081+0000 7f57e9d74640 1 -- 10.20.193.5:0/3417571693 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e003c070 con 0x7f57ec0c7170 2026-02-17T21:27:27.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.081+0000 7f57e9d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:27.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.081+0000 7f57e9d74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:27:27.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.081+0000 7f57e9d74640 10 monclient: dump: 2026-02-17T21:27:27.091 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:27.091 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:27.091 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:27.091 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:27.091 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:27.091 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:27.091 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:27.091 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:27.092 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:27.092 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:27.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.081+0000 7f57e9d74640 10 monclient: _finish_auth 0 2026-02-17T21:27:27.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.081+0000 7f57e9d74640 10 monclient: _check_auth_tickets 2026-02-17T21:27:27.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.081+0000 7f57e9d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:27.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.081+0000 7f57e9d74640 1 -- 10.20.193.5:0/3417571693 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57e002fb70 con 0x7f57ec0c7170 2026-02-17T21:27:27.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.081+0000 7f57f100e640 5 monclient: authenticate success, global_id 4802 2026-02-17T21:27:27.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.081+0000 7f57e9d74640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:27.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.081+0000 7f57e9d74640 1 -- 10.20.193.5:0/3417571693 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e0037440 con 0x7f57ec0c7170 2026-02-17T21:27:27.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.081+0000 7f57f100e640 10 monclient: get_monmap_and_config success 2026-02-17T21:27:27.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.081+0000 7f57f100e640 4 set_mon_vals no callback set 2026-02-17T21:27:27.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.081+0000 7f57e9d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:27.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.081+0000 7f57e9d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:27:27.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.081+0000 7f57e9d74640 10 monclient: dump: 2026-02-17T21:27:27.093 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:27.093 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:27.093 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:27.093 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:27.093 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:27.093 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:27.093 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:27.093 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:27.093 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:27.093 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:27.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.082+0000 7f57f100e640 10 monclient: shutdown 2026-02-17T21:27:27.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.082+0000 7f57f100e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:27.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.082+0000 7f57f100e640 1 -- 10.20.193.5:0/3417571693 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f57ec0c7170 msgr2=0x7f57ec0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:27.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.082+0000 7f57f100e640 1 --2- 10.20.193.5:0/3417571693 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f57ec0c7170 0x7f57ec0c7550 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f57e00098a0 tx=0x7f57e002ee60 comp rx=0 tx=0).stop 2026-02-17T21:27:27.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.082+0000 7f57f100e640 1 -- 10.20.193.5:0/3417571693 shutdown_connections 2026-02-17T21:27:27.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.082+0000 7f57f100e640 1 --2- 10.20.193.5:0/3417571693 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f57ec0c7170 0x7f57ec0c7550 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:27.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.082+0000 7f57f100e640 1 -- 10.20.193.5:0/3417571693 >> 10.20.193.5:0/3417571693 conn(0x7f57ec0c9f40 msgr2=0x7f57ec0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:27.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.082+0000 7f57f100e640 1 -- 10.20.193.5:0/3417571693 shutdown_connections 2026-02-17T21:27:27.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.082+0000 7f57f100e640 1 -- 10.20.193.5:0/3417571693 wait complete. 2026-02-17T21:27:27.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.082+0000 7f57f100e640 10 monclient: build_initial_monmap 2026-02-17T21:27:27.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.082+0000 7f57f100e640 10 monclient: monmap: 2026-02-17T21:27:27.095 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:27.095 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:27:27.095 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:27:27.095 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:27:27.095 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:27.095 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:27.095 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:27:27.095 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:27:27.095 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:27:27.095 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:27.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57f100e640 1 librados: starting msgr at 2026-02-17T21:27:27.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57f100e640 1 librados: starting objecter 2026-02-17T21:27:27.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57f100e640 1 Processor -- start 2026-02-17T21:27:27.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57f100e640 1 -- start start 2026-02-17T21:27:27.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57f100e640 1 librados: setting wanted keys 2026-02-17T21:27:27.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57f100e640 1 librados: calling monclient init 2026-02-17T21:27:27.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57f100e640 10 monclient: init 2026-02-17T21:27:27.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57f100e640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:27.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57f100e640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:27:27.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57f100e640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f57ec0c48c0 0x7f57ec1f1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:27.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57f100e640 10 monclient(hunting): picked mon.noname-c con 0x7f57ec0c48c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:27:27.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57f100e640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f57ec0c4d10 0x7f57ec1f1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:27.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57f100e640 10 monclient(hunting): picked mon.noname-b con 0x7f57ec0c4d10 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:27:27.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57f100e640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f57ec0c7170 0x7f57ec14be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:27.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57f100e640 10 monclient(hunting): picked mon.noname-a con 0x7f57ec0c7170 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:27:27.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57f100e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:27.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57f100e640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f57ec0c81c0 con 0x7f57ec0c7170 2026-02-17T21:27:27.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57f100e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:27.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57f100e640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f57ec0c7ee0 con 0x7f57ec0c4d10 2026-02-17T21:27:27.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57f100e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:27.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57f100e640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f57ec0750c0 con 0x7f57ec0c48c0 2026-02-17T21:27:27.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57f100e640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:27.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57f100e640 10 monclient(hunting): authenticate will time out at 1152.648524s 2026-02-17T21:27:27.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57eb577640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f57ec0c7170 0x7f57ec14be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:27.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57ead76640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f57ec0c48c0 0x7f57ec1f1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:27.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57ead76640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f57ec0c48c0 0x7f57ec1f1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:45982/0 (socket says 10.20.193.5:45982) 2026-02-17T21:27:27.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57ead76640 1 -- 10.20.193.5:0/4181310041 learned_addr learned my addr 10.20.193.5:0/4181310041 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:27:27.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57ead76640 10 monclient(hunting): get_auth_request con 0x7f57ec0c48c0 auth_method 0 2026-02-17T21:27:27.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57ead76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:27.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57ead76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:27.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57ead76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:27.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.083+0000 7f57ea575640 1 --2- 10.20.193.5:0/4181310041 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f57ec0c4d10 0x7f57ec1f1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:27.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.084+0000 7f57eb577640 10 monclient(hunting): get_auth_request con 0x7f57ec0c7170 auth_method 0 2026-02-17T21:27:27.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.084+0000 7f57eb577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:27.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.084+0000 7f57eb577640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:27.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.084+0000 7f57eb577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:27.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.084+0000 7f57ea575640 10 monclient(hunting): get_auth_request con 0x7f57ec0c4d10 auth_method 0 2026-02-17T21:27:27.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.084+0000 7f57ea575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:27.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.084+0000 7f57ea575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:27.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.084+0000 7f57ea575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:27.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.084+0000 7f57ead76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:27.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.084+0000 7f57ead76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:27.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.084+0000 7f57ead76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:27.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.084+0000 7f57eb577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:27.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.084+0000 7f57eb577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:27.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.084+0000 7f57eb577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:27.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.084+0000 7f57ea575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:27.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.084+0000 7f57ea575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:27.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.084+0000 7f57ea575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:27.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.085+0000 7f57ead76640 10 monclient(hunting): handle_auth_done global_id 4808 payload 824 2026-02-17T21:27:27.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.085+0000 7f57ead76640 1 -- 10.20.193.5:0/4181310041 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f57ec0c4d10 msgr2=0x7f57ec1f1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:27.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.085+0000 7f57ead76640 1 --2- 10.20.193.5:0/4181310041 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f57ec0c4d10 0x7f57ec1f1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:27.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.085+0000 7f57ead76640 1 -- 10.20.193.5:0/4181310041 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f57ec0c7170 msgr2=0x7f57ec14be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:27.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.085+0000 7f57ead76640 1 --2- 10.20.193.5:0/4181310041 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f57ec0c7170 0x7f57ec14be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:27.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.085+0000 7f57ead76640 10 monclient: _finish_hunting 0 2026-02-17T21:27:27.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.085+0000 7f57ead76640 1 monclient: found mon.noname-c 2026-02-17T21:27:27.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.085+0000 7f57ead76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:27.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.085+0000 7f57ead76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:27:27.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.085+0000 7f57ead76640 1 -- 10.20.193.5:0/4181310041 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57ec1f58d0 con 0x7f57ec0c48c0 2026-02-17T21:27:27.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.086+0000 7f57ead76640 1 --2- 10.20.193.5:0/4181310041 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f57ec0c48c0 0x7f57ec1f1740 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009130 tx=0x7f57e00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:27.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.086+0000 7f57cb7fe640 10 client.?.objecter ms_handle_connect 0x7f57ec0c48c0 2026-02-17T21:27:27.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.086+0000 7f57cb7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:27:27.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.087+0000 7f57cb7fe640 1 -- 10.20.193.5:0/4181310041 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e003c040 con 0x7f57ec0c48c0 2026-02-17T21:27:27.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.087+0000 7f57cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:27.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.087+0000 7f57cb7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:27:27.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.087+0000 7f57cb7fe640 10 monclient: dump: 2026-02-17T21:27:27.101 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:27.101 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:27.101 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:27.101 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:27.101 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:27.101 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:27.101 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:27.101 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:27.102 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:27.102 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:27.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.087+0000 7f57cb7fe640 10 monclient: _finish_auth 0 2026-02-17T21:27:27.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.087+0000 7f57cb7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:27:27.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.087+0000 7f57cb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:27.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.087+0000 7f57f100e640 5 monclient: authenticate success, global_id 4808 2026-02-17T21:27:27.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.087+0000 7f57f100e640 10 monclient: _renew_subs 2026-02-17T21:27:27.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.087+0000 7f57f100e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:27:27.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.087+0000 7f57f100e640 1 -- 10.20.193.5:0/4181310041 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57ec1f5bb0 con 0x7f57ec0c48c0 2026-02-17T21:27:27.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.088+0000 7f57f100e640 10 client.4808.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:27:27.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.088+0000 7f57f100e640 10 monclient: _renew_subs 2026-02-17T21:27:27.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.088+0000 7f57f100e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:27:27.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.088+0000 7f57f100e640 1 -- 10.20.193.5:0/4181310041 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57ec1f6170 con 0x7f57ec0c48c0 2026-02-17T21:27:27.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.088+0000 7f57f100e640 1 librados: init done 2026-02-17T21:27:27.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.088+0000 7f57f100e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:27.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.088+0000 7f57f100e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:27.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.088+0000 7f57f100e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:27:27.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.088+0000 7f57f100e640 1 -- 10.20.193.5:0/4181310041 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57ec0c7550 con 0x7f57ec0c48c0 2026-02-17T21:27:27.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.088+0000 7f57cb7fe640 1 -- 10.20.193.5:0/4181310041 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57e002fab0 con 0x7f57ec0c48c0 2026-02-17T21:27:27.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.088+0000 7f57cb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:27.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.088+0000 7f57cb7fe640 1 -- 10.20.193.5:0/4181310041 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e0042810 con 0x7f57ec0c48c0 2026-02-17T21:27:27.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.088+0000 7f57cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:27.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.088+0000 7f57cb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:27:27.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.088+0000 7f57e9573640 4 set_mon_vals no callback set 2026-02-17T21:27:27.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.088+0000 7f57cb7fe640 10 monclient: dump: 2026-02-17T21:27:27.104 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:27.104 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:27.104 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:27.104 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:27.104 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:27.104 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:27.104 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:27.104 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:27.104 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:27.104 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:27.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.194+0000 7f57cb7fe640 1 -- 10.20.193.5:0/4181310041 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f57e004b450 con 0x7f57ec0c48c0 2026-02-17T21:27:27.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.194+0000 7f57cb7fe640 1 --2- 10.20.193.5:0/4181310041 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f57b8079280 0x7f57b807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:27.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.194+0000 7f57ea575640 1 --2- 10.20.193.5:0/4181310041 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f57b8079280 0x7f57b807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:27.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.195+0000 7f57ea575640 10 monclient: get_auth_request con 0x7f57b8079280 auth_method 0 2026-02-17T21:27:27.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.195+0000 7f57ea575640 1 --2- 10.20.193.5:0/4181310041 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f57b8079280 0x7f57b807b740 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f57ec157e00 tx=0x7f57d4007dd0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:27.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.195+0000 7f57cb7fe640 10 client.4808.objecter ms_handle_connect 0x7f57b8079280 2026-02-17T21:27:27.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.195+0000 7f57cb7fe640 1 -- 10.20.193.5:0/4181310041 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f57e0082dd0 con 0x7f57ec0c48c0 2026-02-17T21:27:27.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.195+0000 7f57cb7fe640 10 client.4808.objecter ms_dispatch2 0x7f57ec000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:27:27.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.195+0000 7f57cb7fe640 3 client.4808.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:27:27.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.195+0000 7f57cb7fe640 3 client.4808.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:27:27.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.196+0000 7f57cb7fe640 20 client.4808.objecter dump_active .. 0 homeless 2026-02-17T21:27:27.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.202+0000 7f57cb7fe640 1 -- 10.20.193.5:0/4181310041 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f57e0086d90 con 0x7f57ec0c48c0 2026-02-17T21:27:27.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.202+0000 7f57cb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:27.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.202+0000 7f57cb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:27:27.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.307+0000 7f57f100e640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:27:27.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.307+0000 7f57f100e640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:27.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.307+0000 7f57f100e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:27:27.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.307+0000 7f57f100e640 1 -- 10.20.193.5:0/4181310041 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f57ec153100 con 0x7f57ec0c48c0 2026-02-17T21:27:27.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.311+0000 7f57cb7fe640 1 -- 10.20.193.5:0/4181310041 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f57e008b090 con 0x7f57ec0c48c0 2026-02-17T21:27:27.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.311+0000 7f57cb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:27.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.311+0000 7f57cb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:27:27.313 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:27:27.313 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:27:27.314 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.311+0000 7f57f100e640 10 librados: watch_flush enter 2026-02-17T21:27:27.314 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.311+0000 7f57f100e640 10 librados: watch_flush exit 2026-02-17T21:27:27.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.311+0000 7f57f100e640 20 client.4808.objecter shutdown clearing up homeless session... 2026-02-17T21:27:27.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.311+0000 7f57f100e640 10 client.4808.objecter successfully canceled tick 2026-02-17T21:27:27.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.311+0000 7f57f100e640 1 -- 10.20.193.5:0/4181310041 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f57b8079280 msgr2=0x7f57b807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:27.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.311+0000 7f57f100e640 1 --2- 10.20.193.5:0/4181310041 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f57b8079280 0x7f57b807b740 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f57ec157e00 tx=0x7f57d4007dd0 comp rx=0 tx=0).stop 2026-02-17T21:27:27.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.311+0000 7f57f100e640 10 monclient: shutdown 2026-02-17T21:27:27.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.311+0000 7f57f100e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:27.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.311+0000 7f57f100e640 1 -- 10.20.193.5:0/4181310041 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f57ec0c48c0 msgr2=0x7f57ec1f1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:27.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.311+0000 7f57f100e640 1 --2- 10.20.193.5:0/4181310041 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f57ec0c48c0 0x7f57ec1f1740 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009130 tx=0x7f57e00047c0 comp rx=0 tx=0).stop 2026-02-17T21:27:27.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.311+0000 7f57f100e640 1 -- 10.20.193.5:0/4181310041 shutdown_connections 2026-02-17T21:27:27.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.311+0000 7f57f100e640 1 --2- 10.20.193.5:0/4181310041 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f57b8079280 0x7f57b807b740 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:27.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.311+0000 7f57f100e640 1 --2- 10.20.193.5:0/4181310041 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f57ec0c7170 0x7f57ec14be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:27.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.311+0000 7f57f100e640 1 --2- 10.20.193.5:0/4181310041 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f57ec0c4d10 0x7f57ec1f1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:27.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.311+0000 7f57f100e640 1 --2- 10.20.193.5:0/4181310041 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f57ec0c48c0 0x7f57ec1f1740 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:27.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.311+0000 7f57f100e640 1 -- 10.20.193.5:0/4181310041 >> 10.20.193.5:0/4181310041 conn(0x7f57ec0c9f40 msgr2=0x7f57ec153620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:27.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.311+0000 7f57f100e640 1 -- 10.20.193.5:0/4181310041 shutdown_connections 2026-02-17T21:27:27.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.311+0000 7f57f100e640 1 -- 10.20.193.5:0/4181310041 wait complete. 2026-02-17T21:27:27.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:27.312+0000 7f57f100e640 1 librados: shutdown 2026-02-17T21:27:30.322 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:27:30.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.390+0000 7f710fcc9640 10 monclient: get_monmap_and_config 2026-02-17T21:27:30.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.390+0000 7f710fcc9640 10 monclient: build_initial_monmap 2026-02-17T21:27:30.394 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.390+0000 7f710fcc9640 10 monclient: monmap: 2026-02-17T21:27:30.394 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:30.394 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:30.394 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:27:30.392301+0000 2026-02-17T21:27:30.394 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:27:30.392301+0000 2026-02-17T21:27:30.394 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:30.394 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:30.394 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:27:30.394 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:27:30.394 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:27:30.394 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:27:30.395 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:27:30.395 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:27:30.395 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:30.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.391+0000 7f710fcc9640 1 Processor -- start 2026-02-17T21:27:30.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.391+0000 7f710fcc9640 1 -- start start 2026-02-17T21:27:30.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.391+0000 7f710fcc9640 10 monclient: init 2026-02-17T21:27:30.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.391+0000 7f710fcc9640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:30.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.391+0000 7f710fcc9640 10 monclient: _add_conns ranks=[2,0,3,4,5,1] 2026-02-17T21:27:30.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.391+0000 7f710fcc9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f710815d370 addr v1:10.20.193.135:6789/0 2026-02-17T21:27:30.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.391+0000 7f710fcc9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f71080c7e20 addr v1:10.20.193.5:6789/0 2026-02-17T21:27:30.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.391+0000 7f710fcc9640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f71080c59c0 0x7f710815d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:30.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.391+0000 7f710fcc9640 10 monclient(hunting): picked mon.noname-a con 0x7f71080c59c0 addr v2:10.20.193.5:3300/0 2026-02-17T21:27:30.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.391+0000 7f710fcc9640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71080c8350 con 0x7f71080c7e20 2026-02-17T21:27:30.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.391+0000 7f710fcc9640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71080c8630 con 0x7f710815d370 2026-02-17T21:27:30.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.391+0000 7f710fcc9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:30.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.391+0000 7f710fcc9640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f710815b710 con 0x7f71080c59c0 2026-02-17T21:27:30.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.391+0000 7f710fcc9640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:30.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.391+0000 7f710fcc9640 10 monclient(hunting): authenticate will time out at 1155.957725s 2026-02-17T21:27:30.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.392+0000 7f710da3e640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f710815d370 0x7f710815b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:59336/0 (socket says 10.20.193.5:59336) 2026-02-17T21:27:30.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.392+0000 7f710da3e640 1 -- 10.20.193.5:0/4061357539 learned_addr learned my addr 10.20.193.5:0/4061357539 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:27:30.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.392+0000 7f710e23f640 1 --2- 10.20.193.5:0/4061357539 >> v2:10.20.193.5:3300/0 conn(0x7f71080c59c0 0x7f710815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:30.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.392+0000 7f710e23f640 10 monclient(hunting): get_auth_request con 0x7f71080c59c0 auth_method 0 2026-02-17T21:27:30.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.392+0000 7f710e23f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:30.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.392+0000 7f710e23f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:30.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.392+0000 7f710e23f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:30.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.393+0000 7f710e23f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:30.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.393+0000 7f710e23f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:30.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.393+0000 7f710e23f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:30.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.393+0000 7f710ca3c640 1 -- 10.20.193.5:0/4061357539 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 672619849 0 0) 0x7f71080c8630 con 0x7f710815d370 2026-02-17T21:27:30.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.393+0000 7f710ca3c640 10 monclient(hunting): _negotiate 2026-02-17T21:27:30.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.393+0000 7f710ca3c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:30.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.393+0000 7f710ca3c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:30.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.393+0000 7f710ca3c640 10 monclient(hunting): my global_id is 4811 2026-02-17T21:27:30.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.393+0000 7f710ca3c640 1 -- 10.20.193.5:0/4061357539 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70f0003620 con 0x7f710815d370 2026-02-17T21:27:30.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.394+0000 7f710e23f640 10 monclient(hunting): handle_auth_done global_id 4785 payload 274 2026-02-17T21:27:30.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.394+0000 7f710e23f640 1 -- 10.20.193.5:0/4061357539 >> v1:10.20.193.135:6789/0 conn(0x7f710815d370 legacy=0x7f710815b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:30.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.394+0000 7f710e23f640 1 -- 10.20.193.5:0/4061357539 >> v1:10.20.193.5:6789/0 conn(0x7f71080c7e20 legacy=0x7f71080c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:30.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.394+0000 7f710e23f640 10 monclient: _finish_hunting 0 2026-02-17T21:27:30.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.394+0000 7f710e23f640 1 monclient: found mon.noname-a 2026-02-17T21:27:30.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.394+0000 7f710e23f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:30.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.394+0000 7f710e23f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:27:30.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.394+0000 7f710e23f640 1 -- 10.20.193.5:0/4061357539 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71080c8910 con 0x7f71080c59c0 2026-02-17T21:27:30.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.396+0000 7f710e23f640 1 --2- 10.20.193.5:0/4061357539 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f71080c59c0 0x7f710815d750 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7104009d90 tx=0x7f710402f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=672468847203b5d8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:30.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.398+0000 7f710ca3c640 1 -- 10.20.193.5:0/4061357539 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710403c070 con 0x7f71080c59c0 2026-02-17T21:27:30.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.398+0000 7f710ca3c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:30.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.398+0000 7f710ca3c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:27:30.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.398+0000 7f710ca3c640 10 monclient: dump: 2026-02-17T21:27:30.407 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:30.407 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:30.407 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:30.407 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:30.407 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:30.407 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:30.408 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:30.408 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:30.408 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:30.408 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:30.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.398+0000 7f710ca3c640 10 monclient: _finish_auth 0 2026-02-17T21:27:30.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.398+0000 7f710ca3c640 10 monclient: _check_auth_tickets 2026-02-17T21:27:30.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.398+0000 7f710ca3c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:30.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.398+0000 7f710ca3c640 1 -- 10.20.193.5:0/4061357539 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7104037440 con 0x7f71080c59c0 2026-02-17T21:27:30.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.398+0000 7f710ca3c640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:30.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.398+0000 7f710ca3c640 1 -- 10.20.193.5:0/4061357539 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7104037810 con 0x7f71080c59c0 2026-02-17T21:27:30.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.398+0000 7f710ca3c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:30.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.398+0000 7f710ca3c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:27:30.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.398+0000 7f710ca3c640 10 monclient: dump: 2026-02-17T21:27:30.409 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:30.409 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:30.409 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:30.409 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:30.409 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:30.409 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:30.409 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:30.409 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:30.410 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:30.410 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:30.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.398+0000 7f710fcc9640 5 monclient: authenticate success, global_id 4785 2026-02-17T21:27:30.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.398+0000 7f710fcc9640 10 monclient: get_monmap_and_config success 2026-02-17T21:27:30.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.398+0000 7f710fcc9640 4 set_mon_vals no callback set 2026-02-17T21:27:30.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.398+0000 7f710fcc9640 10 monclient: shutdown 2026-02-17T21:27:30.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.398+0000 7f710fcc9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:30.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.398+0000 7f710fcc9640 1 -- 10.20.193.5:0/4061357539 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f71080c59c0 msgr2=0x7f710815d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:30.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.398+0000 7f710fcc9640 1 --2- 10.20.193.5:0/4061357539 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f71080c59c0 0x7f710815d750 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7104009d90 tx=0x7f710402f230 comp rx=0 tx=0).stop 2026-02-17T21:27:30.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.398+0000 7f710fcc9640 1 -- 10.20.193.5:0/4061357539 shutdown_connections 2026-02-17T21:27:30.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.398+0000 7f710fcc9640 1 --2- 10.20.193.5:0/4061357539 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f71080c59c0 0x7f710815d750 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:30.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.398+0000 7f710fcc9640 1 -- 10.20.193.5:0/4061357539 >> 10.20.193.5:0/4061357539 conn(0x7f71080c9f20 msgr2=0x7f71080ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:30.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.398+0000 7f710fcc9640 1 -- 10.20.193.5:0/4061357539 shutdown_connections 2026-02-17T21:27:30.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.398+0000 7f710fcc9640 1 -- 10.20.193.5:0/4061357539 wait complete. 2026-02-17T21:27:30.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.399+0000 7f710fcc9640 10 monclient: build_initial_monmap 2026-02-17T21:27:30.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.399+0000 7f710fcc9640 10 monclient: monmap: 2026-02-17T21:27:30.412 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:30.412 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:27:30.412 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:27:30.412 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:27:30.412 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:30.412 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:30.412 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:27:30.412 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:27:30.413 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:27:30.413 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:30.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.399+0000 7f710fcc9640 1 librados: starting msgr at 2026-02-17T21:27:30.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.399+0000 7f710fcc9640 1 librados: starting objecter 2026-02-17T21:27:30.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.399+0000 7f710fcc9640 1 Processor -- start 2026-02-17T21:27:30.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.399+0000 7f710fcc9640 1 -- start start 2026-02-17T21:27:30.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.399+0000 7f710fcc9640 1 librados: setting wanted keys 2026-02-17T21:27:30.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.399+0000 7f710fcc9640 1 librados: calling monclient init 2026-02-17T21:27:30.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.399+0000 7f710fcc9640 10 monclient: init 2026-02-17T21:27:30.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710fcc9640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:30.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710fcc9640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:27:30.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710fcc9640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f71080c59c0 0x7f7108074340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:30.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710fcc9640 10 monclient(hunting): picked mon.noname-c con 0x7f71080c59c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:27:30.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710fcc9640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f71080c7e20 0x7f710814bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:30.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710fcc9640 10 monclient(hunting): picked mon.noname-a con 0x7f71080c7e20 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:27:30.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710fcc9640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f710815d370 0x7f71081f3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:30.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710fcc9640 10 monclient(hunting): picked mon.noname-b con 0x7f710815d370 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:27:30.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710fcc9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:30.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710fcc9640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f71080c8ed0 con 0x7f71080c7e20 2026-02-17T21:27:30.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710fcc9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:30.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710fcc9640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f71080c9240 con 0x7f710815d370 2026-02-17T21:27:30.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710fcc9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:30.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710fcc9640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f71080c96d0 con 0x7f71080c59c0 2026-02-17T21:27:30.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710fcc9640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:30.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710fcc9640 10 monclient(hunting): authenticate will time out at 1155.966100s 2026-02-17T21:27:30.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710d23d640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f71080c7e20 0x7f710814bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:30.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710da3e640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f71080c59c0 0x7f7108074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:30.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710e23f640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f710815d370 0x7f71081f3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:30.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710d23d640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f71080c7e20 0x7f710814bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:46868/0 (socket says 10.20.193.5:46868) 2026-02-17T21:27:30.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710d23d640 1 -- 10.20.193.5:0/3684302561 learned_addr learned my addr 10.20.193.5:0/3684302561 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:27:30.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710d23d640 10 monclient(hunting): get_auth_request con 0x7f71080c7e20 auth_method 0 2026-02-17T21:27:30.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710d23d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:30.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710d23d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:30.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710d23d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:30.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710da3e640 10 monclient(hunting): get_auth_request con 0x7f71080c59c0 auth_method 0 2026-02-17T21:27:30.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710da3e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:30.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710da3e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:30.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710da3e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:30.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710e23f640 10 monclient(hunting): get_auth_request con 0x7f710815d370 auth_method 0 2026-02-17T21:27:30.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710e23f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:30.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710e23f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:30.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710e23f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:30.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710d23d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:30.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710d23d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:30.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710d23d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:30.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710e23f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:30.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710e23f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:30.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710e23f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:30.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710da3e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:30.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710da3e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:30.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.400+0000 7f710da3e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:30.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.402+0000 7f710d23d640 10 monclient(hunting): handle_auth_done global_id 4791 payload 824 2026-02-17T21:27:30.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.402+0000 7f710d23d640 1 -- 10.20.193.5:0/3684302561 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f71080c59c0 msgr2=0x7f7108074340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:30.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.402+0000 7f710d23d640 1 --2- 10.20.193.5:0/3684302561 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f71080c59c0 0x7f7108074340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:30.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.402+0000 7f710d23d640 1 -- 10.20.193.5:0/3684302561 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f710815d370 msgr2=0x7f71081f3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:30.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.402+0000 7f710d23d640 1 --2- 10.20.193.5:0/3684302561 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f710815d370 0x7f71081f3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:30.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.402+0000 7f710d23d640 10 monclient: _finish_hunting 0 2026-02-17T21:27:30.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.402+0000 7f710d23d640 1 monclient: found mon.noname-a 2026-02-17T21:27:30.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.402+0000 7f710d23d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:30.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.402+0000 7f710d23d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:27:30.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.402+0000 7f710d23d640 1 -- 10.20.193.5:0/3684302561 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710814c770 con 0x7f71080c7e20 2026-02-17T21:27:30.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.403+0000 7f710d23d640 1 --2- 10.20.193.5:0/3684302561 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f71080c7e20 0x7f710814bd90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00c700 tx=0x7f70fc00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:30.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.403+0000 7f70f67fc640 10 client.?.objecter ms_handle_connect 0x7f71080c7e20 2026-02-17T21:27:30.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.403+0000 7f70f67fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:27:30.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f70f67fc640 1 -- 10.20.193.5:0/3684302561 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0052d0 con 0x7f71080c7e20 2026-02-17T21:27:30.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f70f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:30.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f70f67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:27:30.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f70f67fc640 10 monclient: dump: 2026-02-17T21:27:30.421 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:30.421 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:30.421 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:30.421 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:30.422 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:30.422 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:30.422 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:30.422 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:30.422 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:30.422 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:30.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f70f67fc640 10 monclient: _finish_auth 0 2026-02-17T21:27:30.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f70f67fc640 10 monclient: _check_auth_tickets 2026-02-17T21:27:30.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f70f67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:30.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f70f67fc640 1 -- 10.20.193.5:0/3684302561 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70fc005470 con 0x7f71080c7e20 2026-02-17T21:27:30.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f70f67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:30.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f70f67fc640 1 -- 10.20.193.5:0/3684302561 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0038d0 con 0x7f71080c7e20 2026-02-17T21:27:30.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f710fcc9640 5 monclient: authenticate success, global_id 4791 2026-02-17T21:27:30.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f710fcc9640 10 monclient: _renew_subs 2026-02-17T21:27:30.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f710fcc9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:27:30.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f710fcc9640 1 -- 10.20.193.5:0/3684302561 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f710814ca50 con 0x7f71080c7e20 2026-02-17T21:27:30.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f70f7fff640 4 set_mon_vals no callback set 2026-02-17T21:27:30.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f70f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:30.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f70f67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:27:30.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f70f67fc640 10 monclient: dump: 2026-02-17T21:27:30.423 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:30.423 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:30.423 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:30.423 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:30.424 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:30.424 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:30.424 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:30.424 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:30.424 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:30.424 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:30.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f710fcc9640 10 client.4791.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:27:30.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f710fcc9640 10 monclient: _renew_subs 2026-02-17T21:27:30.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f710fcc9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:27:30.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f710fcc9640 1 -- 10.20.193.5:0/3684302561 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f710814d010 con 0x7f71080c7e20 2026-02-17T21:27:30.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f710fcc9640 1 librados: init done 2026-02-17T21:27:30.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f710fcc9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:30.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f710fcc9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:30.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f710fcc9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:27:30.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.405+0000 7f710fcc9640 1 -- 10.20.193.5:0/3684302561 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f710815d750 con 0x7f71080c7e20 2026-02-17T21:27:30.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.417+0000 7f70f67fc640 1 -- 10.20.193.5:0/3684302561 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f70fc003a70 con 0x7f71080c7e20 2026-02-17T21:27:30.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.417+0000 7f70f67fc640 1 --2- 10.20.193.5:0/3684302561 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f70d8079280 0x7f70d807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:30.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.417+0000 7f710da3e640 1 --2- 10.20.193.5:0/3684302561 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f70d8079280 0x7f70d807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:30.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.417+0000 7f710da3e640 10 monclient: get_auth_request con 0x7f70d8079280 auth_method 0 2026-02-17T21:27:30.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.418+0000 7f710da3e640 1 --2- 10.20.193.5:0/3684302561 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f70d8079280 0x7f70d807b740 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f70f8005980 tx=0x7f70f8007dd0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:30.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.418+0000 7f70f67fc640 10 client.4791.objecter ms_handle_connect 0x7f70d8079280 2026-02-17T21:27:30.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.521+0000 7f70f67fc640 1 -- 10.20.193.5:0/3684302561 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f70fc05e470 con 0x7f71080c7e20 2026-02-17T21:27:30.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.521+0000 7f70f67fc640 10 client.4791.objecter ms_dispatch2 0x7f7108000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:27:30.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.521+0000 7f70f67fc640 3 client.4791.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:27:30.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.521+0000 7f70f67fc640 3 client.4791.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:27:30.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.521+0000 7f70f67fc640 20 client.4791.objecter dump_active .. 0 homeless 2026-02-17T21:27:30.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.521+0000 7f70f67fc640 1 -- 10.20.193.5:0/3684302561 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f70fc062430 con 0x7f71080c7e20 2026-02-17T21:27:30.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.521+0000 7f70f67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:30.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.521+0000 7f70f67fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:27:30.622 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.620+0000 7f710fcc9640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:27:30.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.620+0000 7f710fcc9640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:30.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.620+0000 7f710fcc9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:27:30.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.620+0000 7f710fcc9640 1 -- 10.20.193.5:0/3684302561 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7108151dc0 con 0x7f71080c7e20 2026-02-17T21:27:30.625 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.623+0000 7f70f67fc640 1 -- 10.20.193.5:0/3684302561 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f70fc066730 con 0x7f71080c7e20 2026-02-17T21:27:30.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.623+0000 7f70f67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:30.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.623+0000 7f70f67fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:27:30.626 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:27:30.626 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:27:30.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.624+0000 7f710fcc9640 10 librados: watch_flush enter 2026-02-17T21:27:30.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.624+0000 7f710fcc9640 10 librados: watch_flush exit 2026-02-17T21:27:30.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.624+0000 7f710fcc9640 20 client.4791.objecter shutdown clearing up homeless session... 2026-02-17T21:27:30.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.624+0000 7f710fcc9640 10 client.4791.objecter successfully canceled tick 2026-02-17T21:27:30.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.624+0000 7f710fcc9640 1 -- 10.20.193.5:0/3684302561 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f70d8079280 msgr2=0x7f70d807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:30.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.624+0000 7f710fcc9640 1 --2- 10.20.193.5:0/3684302561 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f70d8079280 0x7f70d807b740 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f70f8005980 tx=0x7f70f8007dd0 comp rx=0 tx=0).stop 2026-02-17T21:27:30.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.624+0000 7f710fcc9640 10 monclient: shutdown 2026-02-17T21:27:30.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.624+0000 7f710fcc9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:30.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.624+0000 7f710fcc9640 1 -- 10.20.193.5:0/3684302561 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f71080c7e20 msgr2=0x7f710814bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:30.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.624+0000 7f710fcc9640 1 --2- 10.20.193.5:0/3684302561 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f71080c7e20 0x7f710814bd90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00c700 tx=0x7f70fc00cbd0 comp rx=0 tx=0).stop 2026-02-17T21:27:30.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.624+0000 7f710fcc9640 1 -- 10.20.193.5:0/3684302561 shutdown_connections 2026-02-17T21:27:30.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.624+0000 7f710fcc9640 1 --2- 10.20.193.5:0/3684302561 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f70d8079280 0x7f70d807b740 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:30.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.624+0000 7f710fcc9640 1 --2- 10.20.193.5:0/3684302561 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f710815d370 0x7f71081f3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:30.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.624+0000 7f710fcc9640 1 --2- 10.20.193.5:0/3684302561 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f71080c7e20 0x7f710814bd90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:30.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.624+0000 7f710fcc9640 1 --2- 10.20.193.5:0/3684302561 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f71080c59c0 0x7f7108074340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:30.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.624+0000 7f710fcc9640 1 -- 10.20.193.5:0/3684302561 >> 10.20.193.5:0/3684302561 conn(0x7f71080c9f20 msgr2=0x7f71080ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:30.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.624+0000 7f710fcc9640 1 -- 10.20.193.5:0/3684302561 shutdown_connections 2026-02-17T21:27:30.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.624+0000 7f710fcc9640 1 -- 10.20.193.5:0/3684302561 wait complete. 2026-02-17T21:27:30.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:30.624+0000 7f710fcc9640 1 librados: shutdown 2026-02-17T21:27:33.637 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:27:33.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.701+0000 7ff559e74640 10 monclient: get_monmap_and_config 2026-02-17T21:27:33.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.701+0000 7ff559e74640 10 monclient: build_initial_monmap 2026-02-17T21:27:33.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.702+0000 7ff559e74640 10 monclient: monmap: 2026-02-17T21:27:33.708 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:33.708 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:33.708 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:27:33.703678+0000 2026-02-17T21:27:33.708 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:27:33.703678+0000 2026-02-17T21:27:33.708 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:33.708 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:33.708 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:27:33.708 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:27:33.709 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:27:33.709 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:27:33.709 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:27:33.709 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:27:33.709 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:33.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.702+0000 7ff559e74640 1 Processor -- start 2026-02-17T21:27:33.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.702+0000 7ff559e74640 1 -- start start 2026-02-17T21:27:33.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.702+0000 7ff559e74640 10 monclient: init 2026-02-17T21:27:33.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff559e74640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:33.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff559e74640 10 monclient: _add_conns ranks=[3,4,5,2,1,0] 2026-02-17T21:27:33.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff559e74640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7ff5540d1b60 0x7ff5540d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:33.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff559e74640 10 monclient(hunting): picked mon.noname-a con 0x7ff5540d1b60 addr v2:10.20.193.5:3300/0 2026-02-17T21:27:33.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff559e74640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7ff55415c840 0x7ff5540c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:33.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff559e74640 10 monclient(hunting): picked mon.noname-b con 0x7ff55415c840 addr v2:10.20.193.119:3300/0 2026-02-17T21:27:33.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff559e74640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7ff5540c92a0 0x7ff55415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:33.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff559e74640 10 monclient(hunting): picked mon.noname-c con 0x7ff5540c92a0 addr v2:10.20.193.135:3300/0 2026-02-17T21:27:33.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff559e74640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:33.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff559e74640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff5540ca460 con 0x7ff5540d1b60 2026-02-17T21:27:33.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff559e74640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:33.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff559e74640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7ff55415d4c0 con 0x7ff55415c840 2026-02-17T21:27:33.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff559e74640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:33.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff559e74640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff5540c98e0 con 0x7ff5540c92a0 2026-02-17T21:27:33.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff559e74640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:33.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff559e74640 10 monclient(hunting): authenticate will time out at 1159.269080s 2026-02-17T21:27:33.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff552ffd640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7ff55415c840 0x7ff5540c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:33.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff5537fe640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7ff5540d1b60 0x7ff5540d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:33.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff553fff640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7ff5540c92a0 0x7ff55415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:33.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff553fff640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7ff5540c92a0 0x7ff55415d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:43894/0 (socket says 10.20.193.5:43894) 2026-02-17T21:27:33.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff553fff640 1 -- 10.20.193.5:0/2441726605 learned_addr learned my addr 10.20.193.5:0/2441726605 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:27:33.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff553fff640 10 monclient(hunting): get_auth_request con 0x7ff5540c92a0 auth_method 0 2026-02-17T21:27:33.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff553fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:33.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff553fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:33.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff553fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:33.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff552ffd640 10 monclient(hunting): get_auth_request con 0x7ff55415c840 auth_method 0 2026-02-17T21:27:33.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff552ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:33.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff552ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:33.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff552ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:33.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff5537fe640 10 monclient(hunting): get_auth_request con 0x7ff5540d1b60 auth_method 0 2026-02-17T21:27:33.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff5537fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:33.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff5537fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:33.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.703+0000 7ff5537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:33.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.704+0000 7ff553fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:33.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.704+0000 7ff553fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:33.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.704+0000 7ff553fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:33.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.704+0000 7ff5537fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:33.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.704+0000 7ff5537fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:33.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.704+0000 7ff5537fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:33.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.704+0000 7ff552ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:33.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.704+0000 7ff552ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:33.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.704+0000 7ff552ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:33.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.705+0000 7ff553fff640 10 monclient(hunting): handle_auth_done global_id 4817 payload 274 2026-02-17T21:27:33.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.705+0000 7ff553fff640 1 -- 10.20.193.5:0/2441726605 >> v2:10.20.193.119:3300/0 conn(0x7ff55415c840 msgr2=0x7ff5540c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:27:33.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.705+0000 7ff553fff640 1 --2- 10.20.193.5:0/2441726605 >> v2:10.20.193.119:3300/0 conn(0x7ff55415c840 0x7ff5540c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:33.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.705+0000 7ff553fff640 1 -- 10.20.193.5:0/2441726605 >> v2:10.20.193.5:3300/0 conn(0x7ff5540d1b60 msgr2=0x7ff5540d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:27:33.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.705+0000 7ff553fff640 1 --2- 10.20.193.5:0/2441726605 >> v2:10.20.193.5:3300/0 conn(0x7ff5540d1b60 0x7ff5540d1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:33.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.705+0000 7ff553fff640 10 monclient: _finish_hunting 0 2026-02-17T21:27:33.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.705+0000 7ff553fff640 1 monclient: found mon.noname-c 2026-02-17T21:27:33.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.705+0000 7ff553fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:33.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.705+0000 7ff553fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:27:33.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.705+0000 7ff553fff640 1 -- 10.20.193.5:0/2441726605 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5540c9bc0 con 0x7ff5540c92a0 2026-02-17T21:27:33.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.705+0000 7ff553fff640 1 --2- 10.20.193.5:0/2441726605 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff5540c92a0 0x7ff55415d950 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff55408fc80 tx=0x7ff54802f260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=611a06ed6312f35a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:33.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.707+0000 7ff5527fc640 1 -- 10.20.193.5:0/2441726605 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54802fd10 con 0x7ff5540c92a0 2026-02-17T21:27:33.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.707+0000 7ff5527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:33.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.707+0000 7ff5527fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:27:33.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.707+0000 7ff5527fc640 10 monclient: dump: 2026-02-17T21:27:33.720 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:33.720 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:33.720 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:33.720 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:33.721 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:33.721 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:33.721 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:33.721 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:33.721 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:33.721 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:33.721 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.707+0000 7ff5527fc640 10 monclient: _finish_auth 0 2026-02-17T21:27:33.721 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.707+0000 7ff5527fc640 10 monclient: _check_auth_tickets 2026-02-17T21:27:33.721 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.707+0000 7ff5527fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:33.721 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.707+0000 7ff5527fc640 1 -- 10.20.193.5:0/2441726605 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5480373f0 con 0x7ff5540c92a0 2026-02-17T21:27:33.721 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.707+0000 7ff5527fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:33.721 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.707+0000 7ff5527fc640 1 -- 10.20.193.5:0/2441726605 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5480377c0 con 0x7ff5540c92a0 2026-02-17T21:27:33.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.707+0000 7ff559e74640 5 monclient: authenticate success, global_id 4817 2026-02-17T21:27:33.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.707+0000 7ff559e74640 10 monclient: get_monmap_and_config success 2026-02-17T21:27:33.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.707+0000 7ff559e74640 4 set_mon_vals no callback set 2026-02-17T21:27:33.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.707+0000 7ff5527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:33.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.707+0000 7ff5527fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:27:33.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.707+0000 7ff5527fc640 10 monclient: dump: 2026-02-17T21:27:33.722 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:33.722 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:33.722 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:33.722 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:33.722 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:33.722 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:33.723 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:33.723 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:33.723 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:33.723 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:33.723 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.708+0000 7ff559e74640 10 monclient: shutdown 2026-02-17T21:27:33.723 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.708+0000 7ff559e74640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:33.723 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.708+0000 7ff559e74640 1 -- 10.20.193.5:0/2441726605 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff5540c92a0 msgr2=0x7ff55415d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:33.723 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.708+0000 7ff559e74640 1 --2- 10.20.193.5:0/2441726605 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff5540c92a0 0x7ff55415d950 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff55408fc80 tx=0x7ff54802f260 comp rx=0 tx=0).stop 2026-02-17T21:27:33.723 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.708+0000 7ff559e74640 1 -- 10.20.193.5:0/2441726605 shutdown_connections 2026-02-17T21:27:33.723 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.708+0000 7ff559e74640 1 --2- 10.20.193.5:0/2441726605 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff5540c92a0 0x7ff55415d950 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:33.723 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.708+0000 7ff559e74640 1 --2- 10.20.193.5:0/2441726605 >> v2:10.20.193.119:3300/0 conn(0x7ff55415c840 0x7ff5540c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:33.723 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.708+0000 7ff559e74640 1 --2- 10.20.193.5:0/2441726605 >> v2:10.20.193.5:3300/0 conn(0x7ff5540d1b60 0x7ff5540d1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:33.724 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.708+0000 7ff559e74640 1 -- 10.20.193.5:0/2441726605 >> 10.20.193.5:0/2441726605 conn(0x7ff55406d9b0 msgr2=0x7ff55406ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:33.724 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.708+0000 7ff559e74640 1 -- 10.20.193.5:0/2441726605 shutdown_connections 2026-02-17T21:27:33.724 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.708+0000 7ff559e74640 1 -- 10.20.193.5:0/2441726605 wait complete. 2026-02-17T21:27:33.724 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.708+0000 7ff559e74640 10 monclient: build_initial_monmap 2026-02-17T21:27:33.724 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.708+0000 7ff559e74640 10 monclient: monmap: 2026-02-17T21:27:33.724 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:33.724 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:27:33.724 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:27:33.724 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:27:33.724 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:33.724 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:33.724 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:27:33.725 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:27:33.725 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:27:33.725 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:33.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.709+0000 7ff559e74640 1 librados: starting msgr at 2026-02-17T21:27:33.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.709+0000 7ff559e74640 1 librados: starting objecter 2026-02-17T21:27:33.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.709+0000 7ff559e74640 1 Processor -- start 2026-02-17T21:27:33.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.709+0000 7ff559e74640 1 -- start start 2026-02-17T21:27:33.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.709+0000 7ff559e74640 1 librados: setting wanted keys 2026-02-17T21:27:33.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.709+0000 7ff559e74640 1 librados: calling monclient init 2026-02-17T21:27:33.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.709+0000 7ff559e74640 10 monclient: init 2026-02-17T21:27:33.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.709+0000 7ff559e74640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:33.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.709+0000 7ff559e74640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:27:33.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.709+0000 7ff559e74640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff5540c92a0 0x7ff5541f7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:33.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.709+0000 7ff559e74640 10 monclient(hunting): picked mon.noname-a con 0x7ff5540c92a0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:27:33.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.709+0000 7ff559e74640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff5540d1b60 0x7ff5541f38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:33.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.709+0000 7ff559e74640 10 monclient(hunting): picked mon.noname-b con 0x7ff5540d1b60 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:27:33.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.709+0000 7ff559e74640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff55415c840 0x7ff5541503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:33.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.709+0000 7ff559e74640 10 monclient(hunting): picked mon.noname-c con 0x7ff55415c840 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:27:33.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.709+0000 7ff559e74640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:33.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.709+0000 7ff559e74640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff55415cc90 con 0x7ff5540c92a0 2026-02-17T21:27:33.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.709+0000 7ff559e74640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:33.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.709+0000 7ff559e74640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff5540ca180 con 0x7ff5540d1b60 2026-02-17T21:27:33.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.709+0000 7ff559e74640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:33.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.709+0000 7ff559e74640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff55406e7b0 con 0x7ff55415c840 2026-02-17T21:27:33.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.709+0000 7ff559e74640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:33.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.709+0000 7ff559e74640 10 monclient(hunting): authenticate will time out at 1159.275626s 2026-02-17T21:27:33.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.709+0000 7ff5537fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff5540c92a0 0x7ff5541f7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:33.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.709+0000 7ff553fff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff55415c840 0x7ff5541503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:33.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.710+0000 7ff552ffd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff5540d1b60 0x7ff5541f38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:33.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.710+0000 7ff5537fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff5540c92a0 0x7ff5541f7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:46892/0 (socket says 10.20.193.5:46892) 2026-02-17T21:27:33.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.710+0000 7ff5537fe640 1 -- 10.20.193.5:0/702776744 learned_addr learned my addr 10.20.193.5:0/702776744 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:27:33.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.710+0000 7ff5537fe640 10 monclient(hunting): get_auth_request con 0x7ff5540c92a0 auth_method 0 2026-02-17T21:27:33.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.710+0000 7ff5537fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:33.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.710+0000 7ff5537fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:33.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.710+0000 7ff5537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:33.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.710+0000 7ff553fff640 10 monclient(hunting): get_auth_request con 0x7ff55415c840 auth_method 0 2026-02-17T21:27:33.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.710+0000 7ff553fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:33.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.710+0000 7ff553fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:33.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.710+0000 7ff553fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:33.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.710+0000 7ff552ffd640 10 monclient(hunting): get_auth_request con 0x7ff5540d1b60 auth_method 0 2026-02-17T21:27:33.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.710+0000 7ff552ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:33.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.710+0000 7ff552ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:33.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.710+0000 7ff552ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:33.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.710+0000 7ff553fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:33.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.710+0000 7ff553fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:33.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.710+0000 7ff553fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:33.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.710+0000 7ff5537fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:33.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.710+0000 7ff5537fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:33.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.710+0000 7ff5537fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:33.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.710+0000 7ff552ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:33.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.710+0000 7ff552ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:33.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.710+0000 7ff552ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:33.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.711+0000 7ff553fff640 10 monclient(hunting): handle_auth_done global_id 4820 payload 824 2026-02-17T21:27:33.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.711+0000 7ff553fff640 1 -- 10.20.193.5:0/702776744 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff5540d1b60 msgr2=0x7ff5541f38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:33.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.711+0000 7ff553fff640 1 --2- 10.20.193.5:0/702776744 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff5540d1b60 0x7ff5541f38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:33.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.711+0000 7ff553fff640 1 -- 10.20.193.5:0/702776744 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff5540c92a0 msgr2=0x7ff5541f7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:33.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.711+0000 7ff553fff640 1 --2- 10.20.193.5:0/702776744 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff5540c92a0 0x7ff5541f7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:33.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.711+0000 7ff553fff640 10 monclient: _finish_hunting 0 2026-02-17T21:27:33.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.711+0000 7ff553fff640 1 monclient: found mon.noname-c 2026-02-17T21:27:33.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.711+0000 7ff553fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:33.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.711+0000 7ff553fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:27:33.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.711+0000 7ff553fff640 1 -- 10.20.193.5:0/702776744 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5541f4210 con 0x7ff55415c840 2026-02-17T21:27:33.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.713+0000 7ff553fff640 1 --2- 10.20.193.5:0/702776744 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff55415c840 0x7ff5541503e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff548035000 tx=0x7ff548004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:33.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.713+0000 7ff52ffff640 10 client.?.objecter ms_handle_connect 0x7ff55415c840 2026-02-17T21:27:33.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.713+0000 7ff52ffff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:27:33.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff52ffff640 1 -- 10.20.193.5:0/702776744 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff548046020 con 0x7ff55415c840 2026-02-17T21:27:33.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff52ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:33.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff52ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:27:33.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff52ffff640 10 monclient: dump: 2026-02-17T21:27:33.730 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:33.731 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:33.731 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:33.731 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:33.731 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:33.731 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:33.731 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:33.731 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:33.731 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:33.731 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:33.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff52ffff640 10 monclient: _finish_auth 0 2026-02-17T21:27:33.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff52ffff640 10 monclient: _check_auth_tickets 2026-02-17T21:27:33.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff52ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:33.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff52ffff640 1 -- 10.20.193.5:0/702776744 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff548037de0 con 0x7ff55415c840 2026-02-17T21:27:33.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff559e74640 5 monclient: authenticate success, global_id 4820 2026-02-17T21:27:33.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff559e74640 10 monclient: _renew_subs 2026-02-17T21:27:33.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff559e74640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:27:33.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff559e74640 1 -- 10.20.193.5:0/702776744 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5541f44f0 con 0x7ff55415c840 2026-02-17T21:27:33.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff52ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:33.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff52ffff640 1 -- 10.20.193.5:0/702776744 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff548009510 con 0x7ff55415c840 2026-02-17T21:27:33.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff52ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:33.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff52ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:27:33.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff551ffb640 4 set_mon_vals no callback set 2026-02-17T21:27:33.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff52ffff640 10 monclient: dump: 2026-02-17T21:27:33.732 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:33.733 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:33.733 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:33.733 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:33.733 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:33.733 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:33.733 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:33.733 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:33.733 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:33.733 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:33.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff559e74640 10 client.4820.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:27:33.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff559e74640 10 monclient: _renew_subs 2026-02-17T21:27:33.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff559e74640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:27:33.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff559e74640 1 -- 10.20.193.5:0/702776744 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff554157bf0 con 0x7ff55415c840 2026-02-17T21:27:33.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff559e74640 1 librados: init done 2026-02-17T21:27:33.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff559e74640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:33.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff559e74640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:33.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff559e74640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:27:33.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.715+0000 7ff559e74640 1 -- 10.20.193.5:0/702776744 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5540d1f40 con 0x7ff55415c840 2026-02-17T21:27:33.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.726+0000 7ff52ffff640 1 -- 10.20.193.5:0/702776744 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7ff548041690 con 0x7ff55415c840 2026-02-17T21:27:33.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.727+0000 7ff52ffff640 1 --2- 10.20.193.5:0/702776744 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff5240792d0 0x7ff52407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:33.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.727+0000 7ff5537fe640 1 --2- 10.20.193.5:0/702776744 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff5240792d0 0x7ff52407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:33.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.727+0000 7ff5537fe640 10 monclient: get_auth_request con 0x7ff5240792d0 auth_method 0 2026-02-17T21:27:33.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.728+0000 7ff5537fe640 1 --2- 10.20.193.5:0/702776744 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff5240792d0 0x7ff52407b790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff540009c60 tx=0x7ff540009290 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:33.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.728+0000 7ff52ffff640 10 client.4820.objecter ms_handle_connect 0x7ff5240792d0 2026-02-17T21:27:33.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.729+0000 7ff52ffff640 1 -- 10.20.193.5:0/702776744 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7ff548041e10 con 0x7ff55415c840 2026-02-17T21:27:33.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.729+0000 7ff52ffff640 10 client.4820.objecter ms_dispatch2 0x7ff554000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:27:33.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.729+0000 7ff52ffff640 3 client.4820.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:27:33.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.729+0000 7ff52ffff640 3 client.4820.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:27:33.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.729+0000 7ff52ffff640 20 client.4820.objecter dump_active .. 0 homeless 2026-02-17T21:27:33.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.828+0000 7ff52ffff640 1 -- 10.20.193.5:0/702776744 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff548050030 con 0x7ff55415c840 2026-02-17T21:27:33.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.828+0000 7ff52ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:33.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.828+0000 7ff52ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:27:33.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.930+0000 7ff559e74640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:27:33.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.930+0000 7ff559e74640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:33.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.930+0000 7ff559e74640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:27:33.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.930+0000 7ff559e74640 1 -- 10.20.193.5:0/702776744 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff5541597e0 con 0x7ff55415c840 2026-02-17T21:27:33.935 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.934+0000 7ff52ffff640 1 -- 10.20.193.5:0/702776744 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7ff548087a60 con 0x7ff55415c840 2026-02-17T21:27:33.936 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.934+0000 7ff52ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:33.936 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.934+0000 7ff52ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:27:33.936 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:27:33.936 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:27:33.938 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.934+0000 7ff559e74640 10 librados: watch_flush enter 2026-02-17T21:27:33.938 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.934+0000 7ff559e74640 10 librados: watch_flush exit 2026-02-17T21:27:33.938 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.934+0000 7ff559e74640 20 client.4820.objecter shutdown clearing up homeless session... 2026-02-17T21:27:33.938 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.934+0000 7ff559e74640 10 client.4820.objecter successfully canceled tick 2026-02-17T21:27:33.938 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.934+0000 7ff559e74640 1 -- 10.20.193.5:0/702776744 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff5240792d0 msgr2=0x7ff52407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:33.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.934+0000 7ff559e74640 1 --2- 10.20.193.5:0/702776744 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff5240792d0 0x7ff52407b790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff540009c60 tx=0x7ff540009290 comp rx=0 tx=0).stop 2026-02-17T21:27:33.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.934+0000 7ff559e74640 10 monclient: shutdown 2026-02-17T21:27:33.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.934+0000 7ff559e74640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:33.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.934+0000 7ff559e74640 1 -- 10.20.193.5:0/702776744 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff55415c840 msgr2=0x7ff5541503e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:33.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.934+0000 7ff559e74640 1 --2- 10.20.193.5:0/702776744 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff55415c840 0x7ff5541503e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff548035000 tx=0x7ff548004b40 comp rx=0 tx=0).stop 2026-02-17T21:27:33.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.934+0000 7ff559e74640 1 -- 10.20.193.5:0/702776744 shutdown_connections 2026-02-17T21:27:33.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.934+0000 7ff559e74640 1 --2- 10.20.193.5:0/702776744 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff5240792d0 0x7ff52407b790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:33.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.934+0000 7ff559e74640 1 --2- 10.20.193.5:0/702776744 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff55415c840 0x7ff5541503e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:33.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.934+0000 7ff559e74640 1 --2- 10.20.193.5:0/702776744 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff5540d1b60 0x7ff5541f38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:33.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.934+0000 7ff559e74640 1 --2- 10.20.193.5:0/702776744 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff5540c92a0 0x7ff5541f7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:33.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.934+0000 7ff559e74640 1 -- 10.20.193.5:0/702776744 >> 10.20.193.5:0/702776744 conn(0x7ff55406d9b0 msgr2=0x7ff55415d950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:33.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.934+0000 7ff559e74640 1 -- 10.20.193.5:0/702776744 shutdown_connections 2026-02-17T21:27:33.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.934+0000 7ff559e74640 1 -- 10.20.193.5:0/702776744 wait complete. 2026-02-17T21:27:33.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:33.935+0000 7ff559e74640 1 librados: shutdown 2026-02-17T21:27:36.946 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:27:37.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.015+0000 7f33e4266640 10 monclient: get_monmap_and_config 2026-02-17T21:27:37.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.015+0000 7f33e4266640 10 monclient: build_initial_monmap 2026-02-17T21:27:37.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.015+0000 7f33e4266640 10 monclient: monmap: 2026-02-17T21:27:37.018 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:37.019 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:37.019 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:27:37.017382+0000 2026-02-17T21:27:37.019 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:27:37.017382+0000 2026-02-17T21:27:37.019 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:37.019 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:37.019 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:27:37.019 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:27:37.019 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:27:37.019 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:27:37.019 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:27:37.019 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:27:37.019 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:37.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.016+0000 7f33e4266640 1 Processor -- start 2026-02-17T21:27:37.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.016+0000 7f33e4266640 1 -- start start 2026-02-17T21:27:37.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.016+0000 7f33e4266640 10 monclient: init 2026-02-17T21:27:37.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.016+0000 7f33e4266640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:37.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.016+0000 7f33e4266640 10 monclient: _add_conns ranks=[4,0,3,1,5,2] 2026-02-17T21:27:37.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.016+0000 7f33e4266640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f33dc0c7170 0x7f33dc0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:37.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.016+0000 7f33e4266640 10 monclient(hunting): picked mon.noname-b con 0x7f33dc0c7170 addr v2:10.20.193.119:3300/0 2026-02-17T21:27:37.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.016+0000 7f33e4266640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f33dc0c48c0 addr v1:10.20.193.5:6789/0 2026-02-17T21:27:37.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.016+0000 7f33e4266640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f33dc0c4d10 0x7f33dc0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:37.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.016+0000 7f33e4266640 10 monclient(hunting): picked mon.noname-a con 0x7f33dc0c4d10 addr v2:10.20.193.5:3300/0 2026-02-17T21:27:37.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.016+0000 7f33e4266640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33dc15a9a0 con 0x7f33dc0c48c0 2026-02-17T21:27:37.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.016+0000 7f33e4266640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:37.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.016+0000 7f33e4266640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f33dc0c8530 con 0x7f33dc0c4d10 2026-02-17T21:27:37.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.016+0000 7f33e4266640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:37.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.016+0000 7f33e4266640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f33dc0c5270 con 0x7f33dc0c7170 2026-02-17T21:27:37.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.016+0000 7f33e4266640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:37.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.016+0000 7f33e4266640 10 monclient(hunting): authenticate will time out at 1162.582802s 2026-02-17T21:27:37.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.017+0000 7f33e27dc640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f33dc0c4d10 0x7f33dc0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:37.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.017+0000 7f33e1fdb640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f33dc0c7170 0x7f33dc0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:37.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.017+0000 7f33e1fdb640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f33dc0c7170 0x7f33dc0c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:49718/0 (socket says 10.20.193.5:49718) 2026-02-17T21:27:37.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.017+0000 7f33e1fdb640 1 -- 10.20.193.5:0/1070842961 learned_addr learned my addr 10.20.193.5:0/1070842961 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:27:37.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.017+0000 7f33e1fdb640 10 monclient(hunting): get_auth_request con 0x7f33dc0c7170 auth_method 0 2026-02-17T21:27:37.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.017+0000 7f33e1fdb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:37.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.017+0000 7f33e1fdb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:37.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.017+0000 7f33e1fdb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:37.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.017+0000 7f33e27dc640 10 monclient(hunting): get_auth_request con 0x7f33dc0c4d10 auth_method 0 2026-02-17T21:27:37.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.017+0000 7f33e27dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:37.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.017+0000 7f33e27dc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:37.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.017+0000 7f33e27dc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:37.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.017+0000 7f33e1fdb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:37.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.017+0000 7f33e1fdb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:37.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.017+0000 7f33e1fdb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:37.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.018+0000 7f33e27dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:37.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.018+0000 7f33e27dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:37.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.018+0000 7f33e27dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:37.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.018+0000 7f33e1fdb640 10 monclient(hunting): handle_auth_done global_id 4813 payload 274 2026-02-17T21:27:37.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.018+0000 7f33e1fdb640 1 -- 10.20.193.5:0/1070842961 >> v2:10.20.193.5:3300/0 conn(0x7f33dc0c4d10 msgr2=0x7f33dc0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:27:37.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.018+0000 7f33e1fdb640 1 --2- 10.20.193.5:0/1070842961 >> v2:10.20.193.5:3300/0 conn(0x7f33dc0c4d10 0x7f33dc0c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:37.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.018+0000 7f33e1fdb640 1 -- 10.20.193.5:0/1070842961 >> v1:10.20.193.5:6789/0 conn(0x7f33dc0c48c0 legacy=0x7f33dc0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:37.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.018+0000 7f33e1fdb640 10 monclient: _finish_hunting 0 2026-02-17T21:27:37.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.018+0000 7f33e1fdb640 1 monclient: found mon.noname-b 2026-02-17T21:27:37.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.018+0000 7f33e1fdb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:37.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.018+0000 7f33e1fdb640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:27:37.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.018+0000 7f33e1fdb640 1 -- 10.20.193.5:0/1070842961 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33dc0c5550 con 0x7f33dc0c7170 2026-02-17T21:27:37.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.020+0000 7f33e1fdb640 1 --2- 10.20.193.5:0/1070842961 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f33dc0c7170 0x7f33dc0c7550 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0723c0 tx=0x7f33cc02eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=726461c4ef0dcf87 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:37.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e0fd9640 1 -- 10.20.193.5:0/1070842961 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc03c070 con 0x7f33dc0c7170 2026-02-17T21:27:37.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e0fd9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:37.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e0fd9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:27:37.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e0fd9640 10 monclient: dump: 2026-02-17T21:27:37.033 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:37.033 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:37.033 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:37.033 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:37.033 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:37.034 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:37.034 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:37.034 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:37.034 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:37.034 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:37.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e0fd9640 10 monclient: _finish_auth 0 2026-02-17T21:27:37.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e0fd9640 10 monclient: _check_auth_tickets 2026-02-17T21:27:37.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e0fd9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:37.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e0fd9640 1 -- 10.20.193.5:0/1070842961 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33cc02fbe0 con 0x7f33dc0c7170 2026-02-17T21:27:37.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e0fd9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:37.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e0fd9640 1 -- 10.20.193.5:0/1070842961 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc037440 con 0x7f33dc0c7170 2026-02-17T21:27:37.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e4266640 5 monclient: authenticate success, global_id 4813 2026-02-17T21:27:37.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e4266640 10 monclient: get_monmap_and_config success 2026-02-17T21:27:37.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e4266640 4 set_mon_vals no callback set 2026-02-17T21:27:37.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e0fd9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:37.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e0fd9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:27:37.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e0fd9640 10 monclient: dump: 2026-02-17T21:27:37.035 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:37.035 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:37.035 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:37.035 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:37.035 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:37.035 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:37.036 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:37.036 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:37.036 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:37.036 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:37.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e4266640 10 monclient: shutdown 2026-02-17T21:27:37.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e4266640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:37.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e4266640 1 -- 10.20.193.5:0/1070842961 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f33dc0c7170 msgr2=0x7f33dc0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:37.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e4266640 1 --2- 10.20.193.5:0/1070842961 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f33dc0c7170 0x7f33dc0c7550 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0723c0 tx=0x7f33cc02eed0 comp rx=0 tx=0).stop 2026-02-17T21:27:37.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e4266640 1 -- 10.20.193.5:0/1070842961 shutdown_connections 2026-02-17T21:27:37.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e4266640 1 --2- 10.20.193.5:0/1070842961 >> v2:10.20.193.5:3300/0 conn(0x7f33dc0c4d10 0x7f33dc0c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:37.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e4266640 1 --2- 10.20.193.5:0/1070842961 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f33dc0c7170 0x7f33dc0c7550 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:37.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e4266640 1 -- 10.20.193.5:0/1070842961 >> 10.20.193.5:0/1070842961 conn(0x7f33dc0c9f40 msgr2=0x7f33dc0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:37.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e4266640 1 -- 10.20.193.5:0/1070842961 shutdown_connections 2026-02-17T21:27:37.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.022+0000 7f33e4266640 1 -- 10.20.193.5:0/1070842961 wait complete. 2026-02-17T21:27:37.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.023+0000 7f33e4266640 10 monclient: build_initial_monmap 2026-02-17T21:27:37.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.023+0000 7f33e4266640 10 monclient: monmap: 2026-02-17T21:27:37.037 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:37.037 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:27:37.037 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:27:37.037 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:27:37.037 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:37.037 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:37.037 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:27:37.037 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:27:37.037 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:27:37.038 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:37.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.023+0000 7f33e4266640 1 librados: starting msgr at 2026-02-17T21:27:37.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.023+0000 7f33e4266640 1 librados: starting objecter 2026-02-17T21:27:37.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.023+0000 7f33e4266640 1 Processor -- start 2026-02-17T21:27:37.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.023+0000 7f33e4266640 1 -- start start 2026-02-17T21:27:37.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.023+0000 7f33e4266640 1 librados: setting wanted keys 2026-02-17T21:27:37.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.023+0000 7f33e4266640 1 librados: calling monclient init 2026-02-17T21:27:37.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.023+0000 7f33e4266640 10 monclient: init 2026-02-17T21:27:37.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.023+0000 7f33e4266640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:37.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.023+0000 7f33e4266640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:27:37.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.023+0000 7f33e4266640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f33dc0c48c0 0x7f33dc157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:37.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.023+0000 7f33e4266640 10 monclient(hunting): picked mon.noname-b con 0x7f33dc0c48c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:27:37.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.023+0000 7f33e4266640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f33dc0c4d10 0x7f33dc15cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:37.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.023+0000 7f33e4266640 10 monclient(hunting): picked mon.noname-c con 0x7f33dc0c4d10 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:27:37.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.023+0000 7f33e4266640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f33dc0c7170 0x7f33dc15d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:37.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.023+0000 7f33e4266640 10 monclient(hunting): picked mon.noname-a con 0x7f33dc0c7170 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:27:37.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.023+0000 7f33e4266640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:37.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.023+0000 7f33e4266640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f33dc0c81c0 con 0x7f33dc0c7170 2026-02-17T21:27:37.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.023+0000 7f33e4266640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:37.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.023+0000 7f33e4266640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f33dc0c7ee0 con 0x7f33dc0c48c0 2026-02-17T21:27:37.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.023+0000 7f33e4266640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:37.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.023+0000 7f33e4266640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f33dc0750c0 con 0x7f33dc0c4d10 2026-02-17T21:27:37.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.023+0000 7f33e4266640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:37.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.023+0000 7f33e4266640 10 monclient(hunting): authenticate will time out at 1162.589854s 2026-02-17T21:27:37.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e27dc640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f33dc0c7170 0x7f33dc15d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:37.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e1fdb640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f33dc0c48c0 0x7f33dc157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:37.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e1fdb640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f33dc0c48c0 0x7f33dc157bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:49732/0 (socket says 10.20.193.5:49732) 2026-02-17T21:27:37.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e1fdb640 1 -- 10.20.193.5:0/2266621228 learned_addr learned my addr 10.20.193.5:0/2266621228 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:27:37.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e1fdb640 10 monclient(hunting): get_auth_request con 0x7f33dc0c48c0 auth_method 0 2026-02-17T21:27:37.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e1fdb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:37.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e1fdb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:37.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e1fdb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:37.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e27dc640 10 monclient(hunting): get_auth_request con 0x7f33dc0c7170 auth_method 0 2026-02-17T21:27:37.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e27dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:37.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e27dc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:37.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e27dc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:37.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e17da640 1 --2- 10.20.193.5:0/2266621228 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f33dc0c4d10 0x7f33dc15cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:37.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e17da640 10 monclient(hunting): get_auth_request con 0x7f33dc0c4d10 auth_method 0 2026-02-17T21:27:37.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e17da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:37.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e17da640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:37.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e17da640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:37.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e1fdb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:37.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e1fdb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:37.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e1fdb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:37.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e27dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:37.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e27dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:37.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e27dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:37.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e17da640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:37.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e17da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:37.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.024+0000 7f33e17da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:37.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.025+0000 7f33e1fdb640 10 monclient(hunting): handle_auth_done global_id 4816 payload 824 2026-02-17T21:27:37.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.025+0000 7f33e1fdb640 1 -- 10.20.193.5:0/2266621228 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f33dc0c4d10 msgr2=0x7f33dc15cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:37.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.025+0000 7f33e1fdb640 1 --2- 10.20.193.5:0/2266621228 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f33dc0c4d10 0x7f33dc15cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:37.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.025+0000 7f33e1fdb640 1 -- 10.20.193.5:0/2266621228 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f33dc0c7170 msgr2=0x7f33dc15d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:37.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.025+0000 7f33e1fdb640 1 --2- 10.20.193.5:0/2266621228 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f33dc0c7170 0x7f33dc15d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:37.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.025+0000 7f33e1fdb640 10 monclient: _finish_hunting 0 2026-02-17T21:27:37.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.025+0000 7f33e1fdb640 1 monclient: found mon.noname-b 2026-02-17T21:27:37.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.025+0000 7f33e1fdb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:37.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.025+0000 7f33e1fdb640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:27:37.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.025+0000 7f33e1fdb640 1 -- 10.20.193.5:0/2266621228 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33dc14d360 con 0x7f33dc0c48c0 2026-02-17T21:27:37.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.027+0000 7f33e1fdb640 1 --2- 10.20.193.5:0/2266621228 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f33dc0c48c0 0x7f33dc157bb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009a70 tx=0x7f33cc0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:37.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.027+0000 7f33ca7fc640 10 client.?.objecter ms_handle_connect 0x7f33dc0c48c0 2026-02-17T21:27:37.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.027+0000 7f33ca7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:27:37.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.028+0000 7f33ca7fc640 1 -- 10.20.193.5:0/2266621228 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc044070 con 0x7f33dc0c48c0 2026-02-17T21:27:37.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.028+0000 7f33ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:37.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.028+0000 7f33ca7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:27:37.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.028+0000 7f33ca7fc640 10 monclient: dump: 2026-02-17T21:27:37.043 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:37.043 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:37.043 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:37.043 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:37.043 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:37.043 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:37.043 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:37.043 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:37.044 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:37.044 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:37.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.028+0000 7f33ca7fc640 10 monclient: _finish_auth 0 2026-02-17T21:27:37.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.028+0000 7f33ca7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:27:37.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.028+0000 7f33ca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:37.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.028+0000 7f33ca7fc640 1 -- 10.20.193.5:0/2266621228 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33cc040410 con 0x7f33dc0c48c0 2026-02-17T21:27:37.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.028+0000 7f33ca7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:37.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.028+0000 7f33ca7fc640 1 -- 10.20.193.5:0/2266621228 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc03c040 con 0x7f33dc0c48c0 2026-02-17T21:27:37.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.028+0000 7f33ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:37.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.028+0000 7f33ca7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:27:37.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.028+0000 7f33cbfff640 4 set_mon_vals no callback set 2026-02-17T21:27:37.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.028+0000 7f33ca7fc640 10 monclient: dump: 2026-02-17T21:27:37.045 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:37.045 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:37.045 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:37.045 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:37.045 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:37.045 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:37.045 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:37.045 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:37.045 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:37.045 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:37.045 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.028+0000 7f33e4266640 5 monclient: authenticate success, global_id 4816 2026-02-17T21:27:37.045 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.028+0000 7f33e4266640 10 monclient: _renew_subs 2026-02-17T21:27:37.045 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.028+0000 7f33e4266640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:37.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.028+0000 7f33e4266640 1 -- 10.20.193.5:0/2266621228 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33dc14d620 con 0x7f33dc0c48c0 2026-02-17T21:27:37.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.028+0000 7f33e4266640 10 client.4816.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:27:37.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.028+0000 7f33e4266640 10 monclient: _renew_subs 2026-02-17T21:27:37.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.028+0000 7f33e4266640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:37.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.028+0000 7f33e4266640 1 -- 10.20.193.5:0/2266621228 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33dc14dbe0 con 0x7f33dc0c48c0 2026-02-17T21:27:37.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.028+0000 7f33e4266640 1 librados: init done 2026-02-17T21:27:37.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.029+0000 7f33e4266640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:37.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.029+0000 7f33e4266640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:37.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.029+0000 7f33e4266640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:37.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.029+0000 7f33e4266640 1 -- 10.20.193.5:0/2266621228 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33dc0c7550 con 0x7f33dc0c48c0 2026-02-17T21:27:37.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.135+0000 7f33ca7fc640 1 -- 10.20.193.5:0/2266621228 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f33cc03f050 con 0x7f33dc0c48c0 2026-02-17T21:27:37.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.136+0000 7f33ca7fc640 1 --2- 10.20.193.5:0/2266621228 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f33ac0792d0 0x7f33ac07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:37.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.136+0000 7f33e17da640 1 --2- 10.20.193.5:0/2266621228 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f33ac0792d0 0x7f33ac07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:37.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.136+0000 7f33e17da640 10 monclient: get_auth_request con 0x7f33ac0792d0 auth_method 0 2026-02-17T21:27:37.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.137+0000 7f33e17da640 1 --2- 10.20.193.5:0/2266621228 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f33ac0792d0 0x7f33ac07b790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0cc8f0 tx=0x7f33d0007f30 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:37.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.137+0000 7f33ca7fc640 10 client.4816.objecter ms_handle_connect 0x7f33ac0792d0 2026-02-17T21:27:37.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.137+0000 7f33ca7fc640 1 -- 10.20.193.5:0/2266621228 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f33cc083000 con 0x7f33dc0c48c0 2026-02-17T21:27:37.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.137+0000 7f33ca7fc640 10 client.4816.objecter ms_dispatch2 0x7f33dc000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:27:37.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.137+0000 7f33ca7fc640 3 client.4816.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:27:37.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.137+0000 7f33ca7fc640 3 client.4816.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:27:37.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.137+0000 7f33ca7fc640 20 client.4816.objecter dump_active .. 0 homeless 2026-02-17T21:27:37.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.144+0000 7f33ca7fc640 1 -- 10.20.193.5:0/2266621228 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f33cc086fc0 con 0x7f33dc0c48c0 2026-02-17T21:27:37.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.144+0000 7f33ca7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:37.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.144+0000 7f33ca7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:27:37.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.246+0000 7f33e4266640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:27:37.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.246+0000 7f33e4266640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:37.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.246+0000 7f33e4266640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:37.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.246+0000 7f33e4266640 1 -- 10.20.193.5:0/2266621228 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f33dc0cc130 con 0x7f33dc0c48c0 2026-02-17T21:27:37.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.249+0000 7f33ca7fc640 1 -- 10.20.193.5:0/2266621228 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f33cc08b2c0 con 0x7f33dc0c48c0 2026-02-17T21:27:37.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.249+0000 7f33ca7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:37.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.249+0000 7f33ca7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:27:37.252 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:27:37.252 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:27:37.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.250+0000 7f33e4266640 10 librados: watch_flush enter 2026-02-17T21:27:37.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.250+0000 7f33e4266640 10 librados: watch_flush exit 2026-02-17T21:27:37.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.250+0000 7f33e4266640 20 client.4816.objecter shutdown clearing up homeless session... 2026-02-17T21:27:37.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.250+0000 7f33e4266640 10 client.4816.objecter successfully canceled tick 2026-02-17T21:27:37.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.250+0000 7f33e4266640 1 -- 10.20.193.5:0/2266621228 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f33ac0792d0 msgr2=0x7f33ac07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:37.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.250+0000 7f33e4266640 1 --2- 10.20.193.5:0/2266621228 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f33ac0792d0 0x7f33ac07b790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0cc8f0 tx=0x7f33d0007f30 comp rx=0 tx=0).stop 2026-02-17T21:27:37.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.250+0000 7f33e4266640 10 monclient: shutdown 2026-02-17T21:27:37.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.250+0000 7f33e4266640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:37.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.250+0000 7f33e4266640 1 -- 10.20.193.5:0/2266621228 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f33dc0c48c0 msgr2=0x7f33dc157bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:37.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.250+0000 7f33e4266640 1 --2- 10.20.193.5:0/2266621228 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f33dc0c48c0 0x7f33dc157bb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009a70 tx=0x7f33cc0047c0 comp rx=0 tx=0).stop 2026-02-17T21:27:37.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.250+0000 7f33e4266640 1 -- 10.20.193.5:0/2266621228 shutdown_connections 2026-02-17T21:27:37.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.250+0000 7f33e4266640 1 --2- 10.20.193.5:0/2266621228 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f33ac0792d0 0x7f33ac07b790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:37.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.250+0000 7f33e4266640 1 --2- 10.20.193.5:0/2266621228 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f33dc0c7170 0x7f33dc15d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:37.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.250+0000 7f33e4266640 1 --2- 10.20.193.5:0/2266621228 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f33dc0c4d10 0x7f33dc15cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:37.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.250+0000 7f33e4266640 1 --2- 10.20.193.5:0/2266621228 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f33dc0c48c0 0x7f33dc157bb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:37.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.250+0000 7f33e4266640 1 -- 10.20.193.5:0/2266621228 >> 10.20.193.5:0/2266621228 conn(0x7f33dc0c9f40 msgr2=0x7f33dc0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:37.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.250+0000 7f33e4266640 1 -- 10.20.193.5:0/2266621228 shutdown_connections 2026-02-17T21:27:37.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.250+0000 7f33e4266640 1 -- 10.20.193.5:0/2266621228 wait complete. 2026-02-17T21:27:37.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:37.250+0000 7f33e4266640 1 librados: shutdown 2026-02-17T21:27:40.263 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:27:40.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.331+0000 7f2e0e4d6640 10 monclient: get_monmap_and_config 2026-02-17T21:27:40.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.331+0000 7f2e0e4d6640 10 monclient: build_initial_monmap 2026-02-17T21:27:40.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.331+0000 7f2e0e4d6640 10 monclient: monmap: 2026-02-17T21:27:40.334 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:40.334 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:40.334 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:27:40.332883+0000 2026-02-17T21:27:40.334 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:27:40.332883+0000 2026-02-17T21:27:40.334 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:40.335 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:40.335 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:27:40.335 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:27:40.335 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:27:40.335 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:27:40.335 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:27:40.335 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:27:40.335 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:40.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.331+0000 7f2e0e4d6640 1 Processor -- start 2026-02-17T21:27:40.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.331+0000 7f2e0e4d6640 1 -- start start 2026-02-17T21:27:40.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.331+0000 7f2e0e4d6640 10 monclient: init 2026-02-17T21:27:40.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.332+0000 7f2e0e4d6640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:40.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.332+0000 7f2e0e4d6640 10 monclient: _add_conns ranks=[3,0,4,1,5,2] 2026-02-17T21:27:40.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.332+0000 7f2e0e4d6640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f2e0814f280 0x7f2e080c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:40.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.332+0000 7f2e0e4d6640 10 monclient(hunting): picked mon.noname-a con 0x7f2e0814f280 addr v2:10.20.193.5:3300/0 2026-02-17T21:27:40.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.332+0000 7f2e0e4d6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2e0814f660 addr v1:10.20.193.5:6789/0 2026-02-17T21:27:40.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.332+0000 7f2e0e4d6640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f2e0815abc0 0x7f2e0815afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:40.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.332+0000 7f2e0e4d6640 10 monclient(hunting): picked mon.noname-b con 0x7f2e0815abc0 addr v2:10.20.193.119:3300/0 2026-02-17T21:27:40.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.332+0000 7f2e0e4d6640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e080c7110 con 0x7f2e0814f660 2026-02-17T21:27:40.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.332+0000 7f2e0e4d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:40.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.332+0000 7f2e0e4d6640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2e080c7950 con 0x7f2e0814f280 2026-02-17T21:27:40.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.332+0000 7f2e0e4d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:40.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.332+0000 7f2e0e4d6640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f2e0815a730 con 0x7f2e0815abc0 2026-02-17T21:27:40.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.332+0000 7f2e0e4d6640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:40.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.332+0000 7f2e0e4d6640 10 monclient(hunting): authenticate will time out at 1165.898208s 2026-02-17T21:27:40.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.332+0000 7f2e07fff640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f2e0814f280 0x7f2e080c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:40.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.332+0000 7f2e0ca4c640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f2e0815abc0 0x7f2e0815afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:40.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.332+0000 7f2e0ca4c640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f2e0815abc0 0x7f2e0815afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:47884/0 (socket says 10.20.193.5:47884) 2026-02-17T21:27:40.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.332+0000 7f2e0ca4c640 1 -- 10.20.193.5:0/4062711554 learned_addr learned my addr 10.20.193.5:0/4062711554 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:27:40.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.332+0000 7f2e0ca4c640 10 monclient(hunting): get_auth_request con 0x7f2e0815abc0 auth_method 0 2026-02-17T21:27:40.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.332+0000 7f2e0ca4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:40.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.332+0000 7f2e0ca4c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:40.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.332+0000 7f2e0ca4c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:40.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.333+0000 7f2e07fff640 10 monclient(hunting): get_auth_request con 0x7f2e0814f280 auth_method 0 2026-02-17T21:27:40.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.333+0000 7f2e07fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:40.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.333+0000 7f2e07fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:40.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.333+0000 7f2e07fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:40.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.333+0000 7f2e0ca4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:40.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.333+0000 7f2e0ca4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:40.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.333+0000 7f2e0ca4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:40.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.333+0000 7f2e07fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:40.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.333+0000 7f2e07fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:40.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.333+0000 7f2e07fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:40.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.334+0000 7f2e0ca4c640 10 monclient(hunting): handle_auth_done global_id 4819 payload 274 2026-02-17T21:27:40.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.334+0000 7f2e0ca4c640 1 -- 10.20.193.5:0/4062711554 >> v2:10.20.193.5:3300/0 conn(0x7f2e0814f280 msgr2=0x7f2e080c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:27:40.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.334+0000 7f2e0ca4c640 1 --2- 10.20.193.5:0/4062711554 >> v2:10.20.193.5:3300/0 conn(0x7f2e0814f280 0x7f2e080c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:40.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.334+0000 7f2e0ca4c640 1 -- 10.20.193.5:0/4062711554 >> v1:10.20.193.5:6789/0 conn(0x7f2e0814f660 legacy=0x7f2e080c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:40.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.334+0000 7f2e0ca4c640 10 monclient: _finish_hunting 0 2026-02-17T21:27:40.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.334+0000 7f2e0ca4c640 1 monclient: found mon.noname-b 2026-02-17T21:27:40.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.334+0000 7f2e0ca4c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:40.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.334+0000 7f2e0ca4c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:27:40.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.334+0000 7f2e0ca4c640 1 -- 10.20.193.5:0/4062711554 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e080c7390 con 0x7f2e0815abc0 2026-02-17T21:27:40.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.335+0000 7f2e0ca4c640 1 --2- 10.20.193.5:0/4062711554 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e0815abc0 0x7f2e0815afe0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2e080c4740 tx=0x7f2dfc02f310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=296333a43a1a8728 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:40.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.337+0000 7f2e06ffd640 1 -- 10.20.193.5:0/4062711554 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc02fe10 con 0x7f2e0815abc0 2026-02-17T21:27:40.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.337+0000 7f2e06ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:40.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.337+0000 7f2e06ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:27:40.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.337+0000 7f2e06ffd640 10 monclient: dump: 2026-02-17T21:27:40.349 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:40.349 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:40.349 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:40.349 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:40.349 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:40.349 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:40.349 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:40.349 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:40.350 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:40.350 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:40.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.337+0000 7f2e06ffd640 10 monclient: _finish_auth 0 2026-02-17T21:27:40.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.337+0000 7f2e06ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:27:40.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.337+0000 7f2e06ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:40.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.337+0000 7f2e06ffd640 1 -- 10.20.193.5:0/4062711554 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dfc0373f0 con 0x7f2e0815abc0 2026-02-17T21:27:40.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.337+0000 7f2e0e4d6640 5 monclient: authenticate success, global_id 4819 2026-02-17T21:27:40.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.337+0000 7f2e0e4d6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:27:40.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.337+0000 7f2e06ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:40.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.337+0000 7f2e06ffd640 1 -- 10.20.193.5:0/4062711554 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc0377c0 con 0x7f2e0815abc0 2026-02-17T21:27:40.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.337+0000 7f2e0e4d6640 10 monclient: get_monmap_and_config success 2026-02-17T21:27:40.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.337+0000 7f2e0e4d6640 4 set_mon_vals no callback set 2026-02-17T21:27:40.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.337+0000 7f2e06ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:40.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.337+0000 7f2e06ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:27:40.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.337+0000 7f2e06ffd640 10 monclient: dump: 2026-02-17T21:27:40.351 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:40.351 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:40.351 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:40.351 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:40.351 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:40.351 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:40.351 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:40.351 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:40.352 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:40.352 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:40.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.338+0000 7f2e0e4d6640 10 monclient: shutdown 2026-02-17T21:27:40.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.338+0000 7f2e0e4d6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:40.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.338+0000 7f2e0e4d6640 1 -- 10.20.193.5:0/4062711554 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e0815abc0 msgr2=0x7f2e0815afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:40.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.338+0000 7f2e0e4d6640 1 --2- 10.20.193.5:0/4062711554 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e0815abc0 0x7f2e0815afe0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2e080c4740 tx=0x7f2dfc02f310 comp rx=0 tx=0).stop 2026-02-17T21:27:40.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.338+0000 7f2e0e4d6640 1 -- 10.20.193.5:0/4062711554 shutdown_connections 2026-02-17T21:27:40.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.338+0000 7f2e0e4d6640 1 --2- 10.20.193.5:0/4062711554 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e0815abc0 0x7f2e0815afe0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:40.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.338+0000 7f2e0e4d6640 1 --2- 10.20.193.5:0/4062711554 >> v2:10.20.193.5:3300/0 conn(0x7f2e0814f280 0x7f2e080c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:40.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.338+0000 7f2e0e4d6640 1 -- 10.20.193.5:0/4062711554 >> 10.20.193.5:0/4062711554 conn(0x7f2e080c9f20 msgr2=0x7f2e080ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:40.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.338+0000 7f2e0e4d6640 1 -- 10.20.193.5:0/4062711554 shutdown_connections 2026-02-17T21:27:40.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.338+0000 7f2e0e4d6640 1 -- 10.20.193.5:0/4062711554 wait complete. 2026-02-17T21:27:40.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.338+0000 7f2e0e4d6640 10 monclient: build_initial_monmap 2026-02-17T21:27:40.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.338+0000 7f2e0e4d6640 10 monclient: monmap: 2026-02-17T21:27:40.353 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:40.353 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:27:40.353 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:27:40.353 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:27:40.353 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:40.353 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:40.353 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:27:40.353 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:27:40.353 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:27:40.353 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:40.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.338+0000 7f2e0e4d6640 1 librados: starting msgr at 2026-02-17T21:27:40.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.338+0000 7f2e0e4d6640 1 librados: starting objecter 2026-02-17T21:27:40.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.338+0000 7f2e0e4d6640 1 Processor -- start 2026-02-17T21:27:40.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.339+0000 7f2e0e4d6640 1 -- start start 2026-02-17T21:27:40.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.339+0000 7f2e0e4d6640 1 librados: setting wanted keys 2026-02-17T21:27:40.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.339+0000 7f2e0e4d6640 1 librados: calling monclient init 2026-02-17T21:27:40.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.339+0000 7f2e0e4d6640 10 monclient: init 2026-02-17T21:27:40.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.339+0000 7f2e0e4d6640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:40.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.339+0000 7f2e0e4d6640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:27:40.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.339+0000 7f2e0e4d6640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2e0814f280 0x7f2e080c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:40.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.339+0000 7f2e0e4d6640 10 monclient(hunting): picked mon.noname-c con 0x7f2e0814f280 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:27:40.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.339+0000 7f2e0e4d6640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e0814f660 0x7f2e081f6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:40.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.339+0000 7f2e0e4d6640 10 monclient(hunting): picked mon.noname-b con 0x7f2e0814f660 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:27:40.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.339+0000 7f2e0e4d6640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2e0815abc0 0x7f2e080738a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:40.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.339+0000 7f2e0e4d6640 10 monclient(hunting): picked mon.noname-a con 0x7f2e0815abc0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:27:40.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.339+0000 7f2e0e4d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:40.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.339+0000 7f2e0e4d6640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0815a3c0 con 0x7f2e0815abc0 2026-02-17T21:27:40.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.339+0000 7f2e0e4d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:40.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.339+0000 7f2e0e4d6640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0815a0e0 con 0x7f2e0814f660 2026-02-17T21:27:40.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.339+0000 7f2e0e4d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:40.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.339+0000 7f2e0e4d6640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0815b520 con 0x7f2e0814f280 2026-02-17T21:27:40.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.339+0000 7f2e0e4d6640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:40.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.339+0000 7f2e0e4d6640 10 monclient(hunting): authenticate will time out at 1165.905584s 2026-02-17T21:27:40.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.339+0000 7f2e0ca4c640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2e0815abc0 0x7f2e080738a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:40.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.339+0000 7f2e077fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e0814f660 0x7f2e081f6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:40.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.339+0000 7f2e0ca4c640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2e0815abc0 0x7f2e080738a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:46422/0 (socket says 10.20.193.5:46422) 2026-02-17T21:27:40.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.340+0000 7f2e0ca4c640 1 -- 10.20.193.5:0/980147795 learned_addr learned my addr 10.20.193.5:0/980147795 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:27:40.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.340+0000 7f2e0ca4c640 10 monclient(hunting): get_auth_request con 0x7f2e0815abc0 auth_method 0 2026-02-17T21:27:40.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.340+0000 7f2e0ca4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:40.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.340+0000 7f2e0ca4c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:40.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.340+0000 7f2e0ca4c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:40.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.340+0000 7f2e077fe640 10 monclient(hunting): get_auth_request con 0x7f2e0814f660 auth_method 0 2026-02-17T21:27:40.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.340+0000 7f2e077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:40.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.340+0000 7f2e077fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:40.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.340+0000 7f2e077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:40.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.340+0000 7f2e07fff640 1 --2- 10.20.193.5:0/980147795 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2e0814f280 0x7f2e080c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:40.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.340+0000 7f2e07fff640 10 monclient(hunting): get_auth_request con 0x7f2e0814f280 auth_method 0 2026-02-17T21:27:40.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.340+0000 7f2e07fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:40.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.340+0000 7f2e07fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:40.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.340+0000 7f2e07fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:40.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.340+0000 7f2e077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:40.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.340+0000 7f2e077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:40.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.340+0000 7f2e077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:40.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.340+0000 7f2e0ca4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:40.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.340+0000 7f2e0ca4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:40.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.340+0000 7f2e0ca4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:40.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.340+0000 7f2e07fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:40.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.340+0000 7f2e07fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:40.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.340+0000 7f2e07fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:40.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.341+0000 7f2e077fe640 10 monclient(hunting): handle_auth_done global_id 4822 payload 824 2026-02-17T21:27:40.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.341+0000 7f2e077fe640 1 -- 10.20.193.5:0/980147795 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2e0814f280 msgr2=0x7f2e080c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:40.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.341+0000 7f2e077fe640 1 --2- 10.20.193.5:0/980147795 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2e0814f280 0x7f2e080c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:40.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.341+0000 7f2e077fe640 1 -- 10.20.193.5:0/980147795 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2e0815abc0 msgr2=0x7f2e080738a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:40.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.341+0000 7f2e077fe640 1 --2- 10.20.193.5:0/980147795 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2e0815abc0 0x7f2e080738a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:40.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.341+0000 7f2e077fe640 10 monclient: _finish_hunting 0 2026-02-17T21:27:40.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.341+0000 7f2e077fe640 1 monclient: found mon.noname-b 2026-02-17T21:27:40.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.341+0000 7f2e077fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:40.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.341+0000 7f2e077fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:27:40.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.341+0000 7f2e077fe640 1 -- 10.20.193.5:0/980147795 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e08072800 con 0x7f2e0814f660 2026-02-17T21:27:40.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.342+0000 7f2e077fe640 1 --2- 10.20.193.5:0/980147795 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e0814f660 0x7f2e081f6f90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2df800c480 tx=0x7f2df800c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:40.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.342+0000 7f2e04ff9640 10 client.?.objecter ms_handle_connect 0x7f2e0814f660 2026-02-17T21:27:40.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.342+0000 7f2e04ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:27:40.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e04ff9640 1 -- 10.20.193.5:0/980147795 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df8017070 con 0x7f2e0814f660 2026-02-17T21:27:40.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e04ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:40.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e04ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:27:40.359 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e04ff9640 10 monclient: dump: 2026-02-17T21:27:40.359 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:40.359 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:40.359 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:40.359 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:40.359 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:40.359 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:40.359 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:40.360 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:40.360 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:40.360 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:40.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e04ff9640 10 monclient: _finish_auth 0 2026-02-17T21:27:40.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e04ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:27:40.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e04ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:40.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e04ff9640 1 -- 10.20.193.5:0/980147795 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df80052d0 con 0x7f2e0814f660 2026-02-17T21:27:40.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e0e4d6640 5 monclient: authenticate success, global_id 4822 2026-02-17T21:27:40.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e0e4d6640 10 monclient: _renew_subs 2026-02-17T21:27:40.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e0e4d6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:40.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e0e4d6640 1 -- 10.20.193.5:0/980147795 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e08072ae0 con 0x7f2e0814f660 2026-02-17T21:27:40.360 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e04ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:40.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e04ff9640 1 -- 10.20.193.5:0/980147795 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df80036f0 con 0x7f2e0814f660 2026-02-17T21:27:40.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e04ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:40.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e04ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:27:40.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e04ff9640 10 monclient: dump: 2026-02-17T21:27:40.361 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:40.361 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:40.361 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:40.361 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:40.361 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:40.361 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:40.361 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:40.361 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:40.362 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:40.362 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:40.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e067fc640 4 set_mon_vals no callback set 2026-02-17T21:27:40.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e0e4d6640 10 client.4822.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:27:40.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e0e4d6640 10 monclient: _renew_subs 2026-02-17T21:27:40.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e0e4d6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:40.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e0e4d6640 1 -- 10.20.193.5:0/980147795 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e080730a0 con 0x7f2e0814f660 2026-02-17T21:27:40.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e0e4d6640 1 librados: init done 2026-02-17T21:27:40.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e0e4d6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:40.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e0e4d6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:40.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e0e4d6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:40.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.344+0000 7f2e0e4d6640 1 -- 10.20.193.5:0/980147795 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e080c9b70 con 0x7f2e0814f660 2026-02-17T21:27:40.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.356+0000 7f2e04ff9640 1 -- 10.20.193.5:0/980147795 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f2df8003890 con 0x7f2e0814f660 2026-02-17T21:27:40.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.356+0000 7f2e04ff9640 1 --2- 10.20.193.5:0/980147795 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2dd80792b0 0x7f2dd807b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:40.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.357+0000 7f2e07fff640 1 --2- 10.20.193.5:0/980147795 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2dd80792b0 0x7f2dd807b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:40.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.357+0000 7f2e07fff640 10 monclient: get_auth_request con 0x7f2dd80792b0 auth_method 0 2026-02-17T21:27:40.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.357+0000 7f2e04ff9640 10 client.4822.objecter ms_handle_connect 0x7f2dd80792b0 2026-02-17T21:27:40.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.357+0000 7f2e07fff640 1 --2- 10.20.193.5:0/980147795 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2dd80792b0 0x7f2dd807b770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2df4009ba0 tx=0x7f2df4009290 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:40.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.358+0000 7f2e04ff9640 1 -- 10.20.193.5:0/980147795 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f2df805d740 con 0x7f2e0814f660 2026-02-17T21:27:40.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.358+0000 7f2e04ff9640 10 client.4822.objecter ms_dispatch2 0x7f2e08000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:27:40.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.358+0000 7f2e04ff9640 3 client.4822.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:27:40.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.358+0000 7f2e04ff9640 3 client.4822.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:27:40.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.358+0000 7f2e04ff9640 20 client.4822.objecter dump_active .. 0 homeless 2026-02-17T21:27:40.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.460+0000 7f2e04ff9640 1 -- 10.20.193.5:0/980147795 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2df8021020 con 0x7f2e0814f660 2026-02-17T21:27:40.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.460+0000 7f2e04ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:40.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.460+0000 7f2e04ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:27:40.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.559+0000 7f2e0e4d6640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:27:40.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.559+0000 7f2e0e4d6640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:40.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.559+0000 7f2e0e4d6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:40.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.559+0000 7f2e0e4d6640 1 -- 10.20.193.5:0/980147795 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2e08156470 con 0x7f2e0814f660 2026-02-17T21:27:40.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.562+0000 7f2e04ff9640 1 -- 10.20.193.5:0/980147795 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f2e080c7110 con 0x7f2e0814f660 2026-02-17T21:27:40.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.562+0000 7f2e04ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:40.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.562+0000 7f2e04ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:27:40.565 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:27:40.565 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:27:40.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.563+0000 7f2e0e4d6640 10 librados: watch_flush enter 2026-02-17T21:27:40.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.563+0000 7f2e0e4d6640 10 librados: watch_flush exit 2026-02-17T21:27:40.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.563+0000 7f2e0e4d6640 20 client.4822.objecter shutdown clearing up homeless session... 2026-02-17T21:27:40.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.563+0000 7f2e0e4d6640 10 client.4822.objecter successfully canceled tick 2026-02-17T21:27:40.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.563+0000 7f2e0e4d6640 1 -- 10.20.193.5:0/980147795 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2dd80792b0 msgr2=0x7f2dd807b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:40.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.563+0000 7f2e0e4d6640 1 --2- 10.20.193.5:0/980147795 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2dd80792b0 0x7f2dd807b770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2df4009ba0 tx=0x7f2df4009290 comp rx=0 tx=0).stop 2026-02-17T21:27:40.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.563+0000 7f2e0e4d6640 10 monclient: shutdown 2026-02-17T21:27:40.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.563+0000 7f2e0e4d6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:40.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.563+0000 7f2e0e4d6640 1 -- 10.20.193.5:0/980147795 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e0814f660 msgr2=0x7f2e081f6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:40.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.563+0000 7f2e0e4d6640 1 --2- 10.20.193.5:0/980147795 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e0814f660 0x7f2e081f6f90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2df800c480 tx=0x7f2df800c950 comp rx=0 tx=0).stop 2026-02-17T21:27:40.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.563+0000 7f2e0e4d6640 1 -- 10.20.193.5:0/980147795 shutdown_connections 2026-02-17T21:27:40.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.563+0000 7f2e0e4d6640 1 --2- 10.20.193.5:0/980147795 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2dd80792b0 0x7f2dd807b770 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:40.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.563+0000 7f2e0e4d6640 1 --2- 10.20.193.5:0/980147795 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2e0815abc0 0x7f2e080738a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:40.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.563+0000 7f2e0e4d6640 1 --2- 10.20.193.5:0/980147795 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e0814f660 0x7f2e081f6f90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:40.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.563+0000 7f2e0e4d6640 1 --2- 10.20.193.5:0/980147795 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2e0814f280 0x7f2e080c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:40.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.563+0000 7f2e0e4d6640 1 -- 10.20.193.5:0/980147795 >> 10.20.193.5:0/980147795 conn(0x7f2e080c9f20 msgr2=0x7f2e080cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:40.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.563+0000 7f2e0e4d6640 1 -- 10.20.193.5:0/980147795 shutdown_connections 2026-02-17T21:27:40.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.564+0000 7f2e0e4d6640 1 -- 10.20.193.5:0/980147795 wait complete. 2026-02-17T21:27:40.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:40.564+0000 7f2e0e4d6640 1 librados: shutdown 2026-02-17T21:27:43.576 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:27:43.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.642+0000 7fbc05864640 10 monclient: get_monmap_and_config 2026-02-17T21:27:43.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.642+0000 7fbc05864640 10 monclient: build_initial_monmap 2026-02-17T21:27:43.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.642+0000 7fbc05864640 10 monclient: monmap: 2026-02-17T21:27:43.645 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:43.645 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:43.645 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:27:43.644449+0000 2026-02-17T21:27:43.645 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:27:43.644449+0000 2026-02-17T21:27:43.645 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:43.645 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:43.645 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:27:43.645 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:27:43.645 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:27:43.645 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:27:43.645 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:27:43.645 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:27:43.645 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:43.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.643+0000 7fbc05864640 1 Processor -- start 2026-02-17T21:27:43.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.643+0000 7fbc05864640 1 -- start start 2026-02-17T21:27:43.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.643+0000 7fbc05864640 10 monclient: init 2026-02-17T21:27:43.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.643+0000 7fbc05864640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:43.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.643+0000 7fbc05864640 10 monclient: _add_conns ranks=[2,1,4,5,0,3] 2026-02-17T21:27:43.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.643+0000 7fbc05864640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbc0015d370 addr v1:10.20.193.135:6789/0 2026-02-17T21:27:43.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.643+0000 7fbc05864640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fbc000c7e20 addr v1:10.20.193.119:6789/0 2026-02-17T21:27:43.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.643+0000 7fbc05864640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fbc000c59c0 0x7fbc0015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:43.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.643+0000 7fbc05864640 10 monclient(hunting): picked mon.noname-b con 0x7fbc000c59c0 addr v2:10.20.193.119:3300/0 2026-02-17T21:27:43.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.643+0000 7fbc05864640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc000c8350 con 0x7fbc000c7e20 2026-02-17T21:27:43.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.643+0000 7fbc05864640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc000c8630 con 0x7fbc0015d370 2026-02-17T21:27:43.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.643+0000 7fbc05864640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:43.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.643+0000 7fbc05864640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fbc0015b710 con 0x7fbc000c59c0 2026-02-17T21:27:43.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.643+0000 7fbc05864640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:43.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.643+0000 7fbc05864640 10 monclient(hunting): authenticate will time out at 1169.209817s 2026-02-17T21:27:43.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.644+0000 7fbbfeffd640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7fbc0015d370 0x7fbc0015b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:58182/0 (socket says 10.20.193.5:58182) 2026-02-17T21:27:43.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.644+0000 7fbbfeffd640 1 -- 10.20.193.5:0/566538884 learned_addr learned my addr 10.20.193.5:0/566538884 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:27:43.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.644+0000 7fbbff7fe640 1 --2- 10.20.193.5:0/566538884 >> v2:10.20.193.119:3300/0 conn(0x7fbc000c59c0 0x7fbc0015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:43.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.644+0000 7fbbff7fe640 10 monclient(hunting): get_auth_request con 0x7fbc000c59c0 auth_method 0 2026-02-17T21:27:43.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.644+0000 7fbbff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:43.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.644+0000 7fbbff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:43.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.644+0000 7fbbff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:43.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.644+0000 7fbbff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:43.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.644+0000 7fbbff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:43.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.644+0000 7fbbff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:43.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.645+0000 7fbbfdffb640 1 -- 10.20.193.5:0/566538884 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4153379383 0 0) 0x7fbc000c8630 con 0x7fbc0015d370 2026-02-17T21:27:43.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.646+0000 7fbbfdffb640 10 monclient(hunting): _negotiate 2026-02-17T21:27:43.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.646+0000 7fbbfdffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:43.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.646+0000 7fbbfdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:43.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.646+0000 7fbbfdffb640 10 monclient(hunting): my global_id is 4829 2026-02-17T21:27:43.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.646+0000 7fbbfdffb640 1 -- 10.20.193.5:0/566538884 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbec003620 con 0x7fbc0015d370 2026-02-17T21:27:43.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.646+0000 7fbbff7fe640 10 monclient(hunting): handle_auth_done global_id 4825 payload 274 2026-02-17T21:27:43.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.646+0000 7fbbff7fe640 1 -- 10.20.193.5:0/566538884 >> v1:10.20.193.135:6789/0 conn(0x7fbc0015d370 legacy=0x7fbc0015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:43.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.646+0000 7fbbff7fe640 1 -- 10.20.193.5:0/566538884 >> v1:10.20.193.119:6789/0 conn(0x7fbc000c7e20 legacy=0x7fbc000c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:43.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.646+0000 7fbbff7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:27:43.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.646+0000 7fbbff7fe640 1 monclient: found mon.noname-b 2026-02-17T21:27:43.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.646+0000 7fbbff7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:43.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.646+0000 7fbbff7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:27:43.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.646+0000 7fbbff7fe640 1 -- 10.20.193.5:0/566538884 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc000c8910 con 0x7fbc000c59c0 2026-02-17T21:27:43.650 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.648+0000 7fbbff7fe640 1 --2- 10.20.193.5:0/566538884 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbc000c59c0 0x7fbc0015d750 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0009d90 tx=0x7fbbf002f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3d6bdd53f3a9a69 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:43.652 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.649+0000 7fbbfdffb640 1 -- 10.20.193.5:0/566538884 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf003c070 con 0x7fbc000c59c0 2026-02-17T21:27:43.652 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.649+0000 7fbbfdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:43.652 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.649+0000 7fbbfdffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:27:43.652 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.649+0000 7fbbfdffb640 10 monclient: dump: 2026-02-17T21:27:43.652 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:43.652 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:43.652 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:43.653 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:43.653 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:43.653 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:43.653 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:43.653 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:43.653 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:43.653 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:43.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.649+0000 7fbbfdffb640 10 monclient: _finish_auth 0 2026-02-17T21:27:43.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.649+0000 7fbbfdffb640 10 monclient: _check_auth_tickets 2026-02-17T21:27:43.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.649+0000 7fbbfdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:43.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.649+0000 7fbbfdffb640 1 -- 10.20.193.5:0/566538884 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbf0037440 con 0x7fbc000c59c0 2026-02-17T21:27:43.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.649+0000 7fbbfdffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:43.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.649+0000 7fbc05864640 5 monclient: authenticate success, global_id 4825 2026-02-17T21:27:43.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.649+0000 7fbbfdffb640 1 -- 10.20.193.5:0/566538884 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf0037810 con 0x7fbc000c59c0 2026-02-17T21:27:43.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.649+0000 7fbc05864640 10 monclient: get_monmap_and_config success 2026-02-17T21:27:43.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.649+0000 7fbc05864640 4 set_mon_vals no callback set 2026-02-17T21:27:43.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.649+0000 7fbbfdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:43.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.649+0000 7fbbfdffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:27:43.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.649+0000 7fbbfdffb640 10 monclient: dump: 2026-02-17T21:27:43.653 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:43.653 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:43.653 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:43.653 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:43.654 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:43.654 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:43.654 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:43.654 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:43.654 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:43.654 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:43.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.650+0000 7fbc05864640 10 monclient: shutdown 2026-02-17T21:27:43.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.650+0000 7fbc05864640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:43.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.650+0000 7fbc05864640 1 -- 10.20.193.5:0/566538884 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbc000c59c0 msgr2=0x7fbc0015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:43.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.650+0000 7fbc05864640 1 --2- 10.20.193.5:0/566538884 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbc000c59c0 0x7fbc0015d750 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0009d90 tx=0x7fbbf002f230 comp rx=0 tx=0).stop 2026-02-17T21:27:43.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.650+0000 7fbc05864640 1 -- 10.20.193.5:0/566538884 shutdown_connections 2026-02-17T21:27:43.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.650+0000 7fbc05864640 1 --2- 10.20.193.5:0/566538884 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbc000c59c0 0x7fbc0015d750 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:43.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.650+0000 7fbc05864640 1 -- 10.20.193.5:0/566538884 >> 10.20.193.5:0/566538884 conn(0x7fbc000c9f20 msgr2=0x7fbc000ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:43.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.650+0000 7fbc05864640 1 -- 10.20.193.5:0/566538884 shutdown_connections 2026-02-17T21:27:43.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.650+0000 7fbc05864640 1 -- 10.20.193.5:0/566538884 wait complete. 2026-02-17T21:27:43.656 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.650+0000 7fbc05864640 10 monclient: build_initial_monmap 2026-02-17T21:27:43.656 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.650+0000 7fbc05864640 10 monclient: monmap: 2026-02-17T21:27:43.656 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:43.656 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:27:43.656 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:27:43.656 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:27:43.656 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:43.656 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:43.656 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:27:43.656 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:27:43.656 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:27:43.656 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:43.656 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.650+0000 7fbc05864640 1 librados: starting msgr at 2026-02-17T21:27:43.656 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.650+0000 7fbc05864640 1 librados: starting objecter 2026-02-17T21:27:43.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.650+0000 7fbc05864640 1 Processor -- start 2026-02-17T21:27:43.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.650+0000 7fbc05864640 1 -- start start 2026-02-17T21:27:43.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.650+0000 7fbc05864640 1 librados: setting wanted keys 2026-02-17T21:27:43.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.650+0000 7fbc05864640 1 librados: calling monclient init 2026-02-17T21:27:43.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.650+0000 7fbc05864640 10 monclient: init 2026-02-17T21:27:43.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbc05864640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:43.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbc05864640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:27:43.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbc05864640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbc000c59c0 0x7fbc000c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:43.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbc05864640 10 monclient(hunting): picked mon.noname-a con 0x7fbc000c59c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:27:43.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbc05864640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbc000c7e20 0x7fbc00149940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:43.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbc05864640 10 monclient(hunting): picked mon.noname-c con 0x7fbc000c7e20 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:27:43.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbc05864640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbc0015d370 0x7fbc00149e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:43.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbc05864640 10 monclient(hunting): picked mon.noname-b con 0x7fbc0015d370 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:27:43.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbc05864640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:43.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbc05864640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbc000c8ed0 con 0x7fbc000c59c0 2026-02-17T21:27:43.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbc05864640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:43.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbc05864640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbc000c9240 con 0x7fbc0015d370 2026-02-17T21:27:43.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbc05864640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:43.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbc05864640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbc000c96d0 con 0x7fbc000c7e20 2026-02-17T21:27:43.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbc05864640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:43.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbc05864640 10 monclient(hunting): authenticate will time out at 1169.217401s 2026-02-17T21:27:43.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbbfe7fc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbc000c7e20 0x7fbc00149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:43.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbbff7fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbc0015d370 0x7fbc00149e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:43.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbbfe7fc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbc000c7e20 0x7fbc00149940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:36450/0 (socket says 10.20.193.5:36450) 2026-02-17T21:27:43.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbbfe7fc640 1 -- 10.20.193.5:0/3632677540 learned_addr learned my addr 10.20.193.5:0/3632677540 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbbfe7fc640 10 monclient(hunting): get_auth_request con 0x7fbc000c7e20 auth_method 0 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbbfe7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbbfe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbbfe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbbfeffd640 1 --2- 10.20.193.5:0/3632677540 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbc000c59c0 0x7fbc000c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbbff7fe640 10 monclient(hunting): get_auth_request con 0x7fbc0015d370 auth_method 0 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbbff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbbff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.651+0000 7fbbff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.652+0000 7fbbfe7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.652+0000 7fbbfe7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.652+0000 7fbbfe7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.652+0000 7fbbfeffd640 10 monclient(hunting): get_auth_request con 0x7fbc000c59c0 auth_method 0 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.652+0000 7fbbfeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.652+0000 7fbbfeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.652+0000 7fbbfeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.652+0000 7fbbff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.652+0000 7fbbff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.652+0000 7fbbff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.652+0000 7fbbfeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.652+0000 7fbbfeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.652+0000 7fbbfeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.653+0000 7fbbfe7fc640 10 monclient(hunting): handle_auth_done global_id 4832 payload 824 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.653+0000 7fbbfe7fc640 1 -- 10.20.193.5:0/3632677540 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbc0015d370 msgr2=0x7fbc00149e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.653+0000 7fbbfe7fc640 1 --2- 10.20.193.5:0/3632677540 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbc0015d370 0x7fbc00149e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.653+0000 7fbbfe7fc640 1 -- 10.20.193.5:0/3632677540 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbc000c59c0 msgr2=0x7fbc000c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:43.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.653+0000 7fbbfe7fc640 1 --2- 10.20.193.5:0/3632677540 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbc000c59c0 0x7fbc000c3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:43.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.653+0000 7fbbfe7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:27:43.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.653+0000 7fbbfe7fc640 1 monclient: found mon.noname-c 2026-02-17T21:27:43.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.653+0000 7fbbfe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:43.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.653+0000 7fbbfe7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:27:43.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.653+0000 7fbbfe7fc640 1 -- 10.20.193.5:0/3632677540 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc000cc1d0 con 0x7fbc000c7e20 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.654+0000 7fbbfe7fc640 1 --2- 10.20.193.5:0/3632677540 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbc000c7e20 0x7fbc00149940 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800c700 tx=0x7fbbe800cbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.654+0000 7fbbd7fff640 10 client.?.objecter ms_handle_connect 0x7fbc000c7e20 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.654+0000 7fbbd7fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbbd7fff640 1 -- 10.20.193.5:0/3632677540 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe80052d0 con 0x7fbc000c7e20 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbbd7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbbd7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbbd7fff640 10 monclient: dump: 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbbd7fff640 10 monclient: _finish_auth 0 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbbd7fff640 10 monclient: _check_auth_tickets 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbbd7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbbd7fff640 1 -- 10.20.193.5:0/3632677540 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe8005470 con 0x7fbc000c7e20 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbbd7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbc05864640 5 monclient: authenticate success, global_id 4832 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbbd7fff640 1 -- 10.20.193.5:0/3632677540 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe80038d0 con 0x7fbc000c7e20 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbc05864640 10 monclient: _renew_subs 2026-02-17T21:27:43.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbc05864640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:27:43.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbc05864640 1 -- 10.20.193.5:0/3632677540 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc000cc4b0 con 0x7fbc000c7e20 2026-02-17T21:27:43.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbbd7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:43.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbbfd7fa640 4 set_mon_vals no callback set 2026-02-17T21:27:43.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbbd7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:27:43.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbbd7fff640 10 monclient: dump: 2026-02-17T21:27:43.661 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:43.661 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:43.661 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:43.661 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:43.661 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:43.661 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:43.661 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:43.661 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:43.661 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:43.661 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:43.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbc05864640 10 client.4832.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:27:43.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbc05864640 10 monclient: _renew_subs 2026-02-17T21:27:43.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbc05864640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:27:43.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbc05864640 1 -- 10.20.193.5:0/3632677540 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc000cca70 con 0x7fbc000c7e20 2026-02-17T21:27:43.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbc05864640 1 librados: init done 2026-02-17T21:27:43.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbc05864640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:43.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbc05864640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:43.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbc05864640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:27:43.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.656+0000 7fbc05864640 1 -- 10.20.193.5:0/3632677540 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc000cccb0 con 0x7fbc000c7e20 2026-02-17T21:27:43.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.668+0000 7fbbd7fff640 1 -- 10.20.193.5:0/3632677540 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fbbe8003a70 con 0x7fbc000c7e20 2026-02-17T21:27:43.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.668+0000 7fbbd7fff640 1 --2- 10.20.193.5:0/3632677540 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbbd0079280 0x7fbbd007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:43.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.669+0000 7fbbfeffd640 1 --2- 10.20.193.5:0/3632677540 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbbd0079280 0x7fbbd007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:43.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.669+0000 7fbbfeffd640 10 monclient: get_auth_request con 0x7fbbd0079280 auth_method 0 2026-02-17T21:27:43.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.669+0000 7fbbfeffd640 1 --2- 10.20.193.5:0/3632677540 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbbd0079280 0x7fbbd007b740 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4007b60 tx=0x7fbbf4007ab0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:43.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.669+0000 7fbbd7fff640 10 client.4832.objecter ms_handle_connect 0x7fbbd0079280 2026-02-17T21:27:43.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.670+0000 7fbbd7fff640 1 -- 10.20.193.5:0/3632677540 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fbbe805e4b0 con 0x7fbc000c7e20 2026-02-17T21:27:43.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.670+0000 7fbbd7fff640 10 client.4832.objecter ms_dispatch2 0x7fbc00000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:27:43.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.670+0000 7fbbd7fff640 3 client.4832.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:27:43.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.670+0000 7fbbd7fff640 3 client.4832.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:27:43.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.670+0000 7fbbd7fff640 20 client.4832.objecter dump_active .. 0 homeless 2026-02-17T21:27:43.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.773+0000 7fbbd7fff640 1 -- 10.20.193.5:0/3632677540 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbbe8062470 con 0x7fbc000c7e20 2026-02-17T21:27:43.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.773+0000 7fbbd7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:43.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.773+0000 7fbbd7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:27:43.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.872+0000 7fbc05864640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:27:43.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.872+0000 7fbc05864640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:43.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.872+0000 7fbc05864640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:27:43.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.872+0000 7fbc05864640 1 -- 10.20.193.5:0/3632677540 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbc0015d750 con 0x7fbc000c7e20 2026-02-17T21:27:43.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.875+0000 7fbbd7fff640 1 -- 10.20.193.5:0/3632677540 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fbbe8066770 con 0x7fbc000c7e20 2026-02-17T21:27:43.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.875+0000 7fbbd7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:43.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.875+0000 7fbbd7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:27:43.878 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:27:43.878 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:27:43.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.876+0000 7fbc05864640 10 librados: watch_flush enter 2026-02-17T21:27:43.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.876+0000 7fbc05864640 10 librados: watch_flush exit 2026-02-17T21:27:43.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.876+0000 7fbc05864640 20 client.4832.objecter shutdown clearing up homeless session... 2026-02-17T21:27:43.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.876+0000 7fbc05864640 10 client.4832.objecter successfully canceled tick 2026-02-17T21:27:43.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.876+0000 7fbc05864640 1 -- 10.20.193.5:0/3632677540 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbbd0079280 msgr2=0x7fbbd007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:43.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.876+0000 7fbc05864640 1 --2- 10.20.193.5:0/3632677540 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbbd0079280 0x7fbbd007b740 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4007b60 tx=0x7fbbf4007ab0 comp rx=0 tx=0).stop 2026-02-17T21:27:43.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.876+0000 7fbc05864640 10 monclient: shutdown 2026-02-17T21:27:43.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.876+0000 7fbc05864640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:43.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.876+0000 7fbc05864640 1 -- 10.20.193.5:0/3632677540 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbc000c7e20 msgr2=0x7fbc00149940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:43.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.876+0000 7fbc05864640 1 --2- 10.20.193.5:0/3632677540 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbc000c7e20 0x7fbc00149940 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800c700 tx=0x7fbbe800cbd0 comp rx=0 tx=0).stop 2026-02-17T21:27:43.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.876+0000 7fbc05864640 1 -- 10.20.193.5:0/3632677540 shutdown_connections 2026-02-17T21:27:43.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.876+0000 7fbc05864640 1 --2- 10.20.193.5:0/3632677540 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbbd0079280 0x7fbbd007b740 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:43.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.876+0000 7fbc05864640 1 --2- 10.20.193.5:0/3632677540 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbc0015d370 0x7fbc00149e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:43.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.876+0000 7fbc05864640 1 --2- 10.20.193.5:0/3632677540 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbc000c7e20 0x7fbc00149940 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:43.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.876+0000 7fbc05864640 1 --2- 10.20.193.5:0/3632677540 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbc000c59c0 0x7fbc000c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:43.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.876+0000 7fbc05864640 1 -- 10.20.193.5:0/3632677540 >> 10.20.193.5:0/3632677540 conn(0x7fbc000c9f20 msgr2=0x7fbc0015c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:43.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.876+0000 7fbc05864640 1 -- 10.20.193.5:0/3632677540 shutdown_connections 2026-02-17T21:27:43.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.876+0000 7fbc05864640 1 -- 10.20.193.5:0/3632677540 wait complete. 2026-02-17T21:27:43.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:43.876+0000 7fbc05864640 1 librados: shutdown 2026-02-17T21:27:46.888 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:27:46.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.957+0000 7ff6e2ad3640 10 monclient: get_monmap_and_config 2026-02-17T21:27:46.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.957+0000 7ff6e2ad3640 10 monclient: build_initial_monmap 2026-02-17T21:27:46.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.957+0000 7ff6e2ad3640 10 monclient: monmap: 2026-02-17T21:27:46.960 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:46.960 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:46.960 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:27:46.958628+0000 2026-02-17T21:27:46.960 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:27:46.958628+0000 2026-02-17T21:27:46.960 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:46.960 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:46.960 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:27:46.960 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:27:46.960 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:27:46.961 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:27:46.961 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:27:46.961 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:27:46.961 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:46.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.958+0000 7ff6e2ad3640 1 Processor -- start 2026-02-17T21:27:46.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.958+0000 7ff6e2ad3640 1 -- start start 2026-02-17T21:27:46.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.958+0000 7ff6e2ad3640 10 monclient: init 2026-02-17T21:27:46.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.959+0000 7ff6e2ad3640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:46.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.959+0000 7ff6e2ad3640 10 monclient: _add_conns ranks=[1,0,5,4,3,2] 2026-02-17T21:27:46.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.959+0000 7ff6e2ad3640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7ff6dc153c10 addr v1:10.20.193.119:6789/0 2026-02-17T21:27:46.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.959+0000 7ff6e2ad3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff6dc0cbac0 addr v1:10.20.193.5:6789/0 2026-02-17T21:27:46.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.959+0000 7ff6e2ad3640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7ff6dc153ff0 0x7ff6dc06e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:46.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.959+0000 7ff6e2ad3640 10 monclient(hunting): picked mon.noname-c con 0x7ff6dc153ff0 addr v2:10.20.193.135:3300/0 2026-02-17T21:27:46.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.959+0000 7ff6e2ad3640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6dc15b050 con 0x7ff6dc0cbac0 2026-02-17T21:27:46.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.959+0000 7ff6e2ad3640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6dc15df70 con 0x7ff6dc153c10 2026-02-17T21:27:46.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.959+0000 7ff6e2ad3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:46.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.959+0000 7ff6e2ad3640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff6dc159bd0 con 0x7ff6dc153ff0 2026-02-17T21:27:46.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.959+0000 7ff6e2ad3640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:46.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.959+0000 7ff6e2ad3640 10 monclient(hunting): authenticate will time out at 1172.524327s 2026-02-17T21:27:46.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.960+0000 7ff6e1049640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7ff6dc153ff0 0x7ff6dc06e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:46.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.961+0000 7ff6e1049640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7ff6dc153ff0 0x7ff6dc06e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:36472/0 (socket says 10.20.193.5:36472) 2026-02-17T21:27:46.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.961+0000 7ff6e1049640 1 -- 10.20.193.5:0/1792155850 learned_addr learned my addr 10.20.193.5:0/1792155850 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:27:46.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.961+0000 7ff6e1049640 10 monclient(hunting): get_auth_request con 0x7ff6dc153ff0 auth_method 0 2026-02-17T21:27:46.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.961+0000 7ff6e1049640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:46.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.961+0000 7ff6e1049640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:46.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.961+0000 7ff6e1049640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:46.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.986+0000 7ff6d37fe640 1 -- 10.20.193.5:0/1792155850 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3169815053 0 0) 0x7ff6dc15b050 con 0x7ff6dc0cbac0 2026-02-17T21:27:46.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.986+0000 7ff6d37fe640 10 monclient(hunting): _negotiate 2026-02-17T21:27:46.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.986+0000 7ff6d37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:46.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.986+0000 7ff6d37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:46.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.986+0000 7ff6d37fe640 10 monclient(hunting): my global_id is 4821 2026-02-17T21:27:46.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.986+0000 7ff6d37fe640 1 -- 10.20.193.5:0/1792155850 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6c8003620 con 0x7ff6dc0cbac0 2026-02-17T21:27:46.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.987+0000 7ff6d37fe640 1 -- 10.20.193.5:0/1792155850 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 53333728 0 0) 0x7ff6dc15df70 con 0x7ff6dc153c10 2026-02-17T21:27:46.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.987+0000 7ff6d37fe640 10 monclient(hunting): _negotiate 2026-02-17T21:27:46.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.987+0000 7ff6d37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:46.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.987+0000 7ff6d37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:46.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.987+0000 7ff6d37fe640 10 monclient(hunting): my global_id is 4834 2026-02-17T21:27:46.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.987+0000 7ff6d37fe640 1 -- 10.20.193.5:0/1792155850 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6dc15b050 con 0x7ff6dc153c10 2026-02-17T21:27:46.994 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.988+0000 7ff6e1049640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:46.994 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.988+0000 7ff6e1049640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:46.994 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.988+0000 7ff6e1049640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:46.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 1 -- 10.20.193.5:0/1792155850 <== mon.0 v1:10.20.193.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1119558999 0 0) 0x7ff6c8003620 con 0x7ff6dc0cbac0 2026-02-17T21:27:46.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 1 -- 10.20.193.5:0/1792155850 >> v2:10.20.193.135:3300/0 conn(0x7ff6dc153ff0 msgr2=0x7ff6dc06e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:27:46.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 1 --2- 10.20.193.5:0/1792155850 >> v2:10.20.193.135:3300/0 conn(0x7ff6dc153ff0 0x7ff6dc06e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:46.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 1 -- 10.20.193.5:0/1792155850 >> v1:10.20.193.119:6789/0 conn(0x7ff6dc153c10 legacy=0x7ff6dc15a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:46.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 10 monclient: _finish_hunting 0 2026-02-17T21:27:46.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 1 monclient: found mon.noname-a-legacy 2026-02-17T21:27:46.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:46.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.5:6789/0 2026-02-17T21:27:46.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 1 -- 10.20.193.5:0/1792155850 --> v1:10.20.193.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6dc070200 con 0x7ff6dc0cbac0 2026-02-17T21:27:46.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 10 monclient: _finish_auth 0 2026-02-17T21:27:46.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 10 monclient: _check_auth_tickets 2026-02-17T21:27:46.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:46.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6e2ad3640 5 monclient: authenticate success, global_id 4821 2026-02-17T21:27:46.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6e2ad3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:27:46.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 1 -- 10.20.193.5:0/1792155850 <== mon.0 v1:10.20.193.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3880376286 0 0) 0x7ff6c4002ec0 con 0x7ff6dc0cbac0 2026-02-17T21:27:46.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:46.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T21:27:46.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 10 monclient: dump: 2026-02-17T21:27:46.996 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:46.996 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:46.996 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:46.996 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:46.996 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:46.997 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:46.997 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:46.997 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:46.997 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:46.997 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:46.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] but i'm connected to v1:10.20.193.5:6789/0, reconnecting 2026-02-17T21:27:46.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:46.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 1 -- 10.20.193.5:0/1792155850 >> v1:10.20.193.5:6789/0 conn(0x7ff6dc0cbac0 legacy=0x7ff6dc0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:46.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:27:46.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 1 --2- 10.20.193.5:0/1792155850 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff6c8003d80 0x7ff6c80041a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:46.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 10 monclient(hunting): picked mon.a con 0x7ff6c8003d80 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:27:46.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 1 --2- 10.20.193.5:0/1792155850 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff6c8004900 0x7ff6c8004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:46.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 10 monclient(hunting): picked mon.b con 0x7ff6c8004900 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:27:46.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 1 --2- 10.20.193.5:0/1792155850 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff6c80053f0 0x7ff6c800bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:46.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 10 monclient(hunting): picked mon.c con 0x7ff6c80053f0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:27:46.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:46.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 1 -- 10.20.193.5:0/1792155850 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc159bd0 con 0x7ff6c8003d80 2026-02-17T21:27:46.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:46.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 1 -- 10.20.193.5:0/1792155850 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c800c330 con 0x7ff6c8004900 2026-02-17T21:27:46.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:46.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 1 -- 10.20.193.5:0/1792155850 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c800c530 con 0x7ff6c80053f0 2026-02-17T21:27:46.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:46.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6d37fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:27:46.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.989+0000 7ff6e2ad3640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T21:27:46.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.990+0000 7ff6e0848640 1 --2- 10.20.193.5:0/1792155850 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff6c8003d80 0x7ff6c80041a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:46.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.990+0000 7ff6d3fff640 1 --2- 10.20.193.5:0/1792155850 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff6c8004900 0x7ff6c8004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:46.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.990+0000 7ff6d3fff640 10 monclient(hunting): get_auth_request con 0x7ff6c8004900 auth_method 0 2026-02-17T21:27:46.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.990+0000 7ff6d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:46.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.990+0000 7ff6d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:46.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.990+0000 7ff6d3fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:27:46.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.990+0000 7ff6d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:46.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.990+0000 7ff6d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:46.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.991+0000 7ff6d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:27:46.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.991+0000 7ff6e0848640 10 monclient(hunting): get_auth_request con 0x7ff6c8003d80 auth_method 0 2026-02-17T21:27:47.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.991+0000 7ff6e0848640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:47.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.991+0000 7ff6e0848640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:47.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.991+0000 7ff6e0848640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:27:47.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.991+0000 7ff6e0848640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:47.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.991+0000 7ff6e0848640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:47.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.991+0000 7ff6e0848640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:27:47.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.992+0000 7ff6e1049640 1 --2- 10.20.193.5:0/1792155850 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff6c80053f0 0x7ff6c800bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:47.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.992+0000 7ff6d3fff640 10 monclient(hunting): handle_auth_done global_id 4821 payload 293 2026-02-17T21:27:47.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.992+0000 7ff6d3fff640 1 -- 10.20.193.5:0/1792155850 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff6c80053f0 msgr2=0x7ff6c800bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:27:47.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.992+0000 7ff6d3fff640 1 --2- 10.20.193.5:0/1792155850 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff6c80053f0 0x7ff6c800bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:47.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.992+0000 7ff6d3fff640 1 -- 10.20.193.5:0/1792155850 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff6c8003d80 msgr2=0x7ff6c80041a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:27:47.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.992+0000 7ff6d3fff640 1 --2- 10.20.193.5:0/1792155850 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff6c8003d80 0x7ff6c80041a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:47.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.992+0000 7ff6d3fff640 10 monclient: _finish_hunting 0 2026-02-17T21:27:47.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.992+0000 7ff6d3fff640 1 monclient: found mon.b 2026-02-17T21:27:47.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.992+0000 7ff6d3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:47.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.992+0000 7ff6d3fff640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:47.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.992+0000 7ff6d3fff640 1 -- 10.20.193.5:0/1792155850 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6c8003620 con 0x7ff6c8004900 2026-02-17T21:27:47.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.992+0000 7ff6d3fff640 10 monclient: _finish_auth 0 2026-02-17T21:27:47.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.992+0000 7ff6d3fff640 10 monclient: _check_auth_tickets 2026-02-17T21:27:47.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.992+0000 7ff6d3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:47.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.992+0000 7ff6e1049640 1 -- 10.20.193.5:0/1792155850 reap_dead start 2026-02-17T21:27:47.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.993+0000 7ff6d3fff640 1 --2- 10.20.193.5:0/1792155850 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff6c8004900 0x7ff6c8004d80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400c190 tx=0x7ff6c402f430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b69392d4cace390a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:47.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.994+0000 7ff6d37fe640 1 -- 10.20.193.5:0/1792155850 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c403c070 con 0x7ff6c8004900 2026-02-17T21:27:47.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.994+0000 7ff6d37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:47.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.994+0000 7ff6d37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:27:47.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.994+0000 7ff6d37fe640 10 monclient: dump: 2026-02-17T21:27:47.008 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:47.009 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:47.009 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:47.009 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:47.009 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:47.009 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:47.009 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:47.009 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:47.009 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:47.009 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:47.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.994+0000 7ff6d37fe640 1 -- 10.20.193.5:0/1792155850 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c4037440 con 0x7ff6c8004900 2026-02-17T21:27:47.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.994+0000 7ff6d37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:47.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.994+0000 7ff6d37fe640 1 -- 10.20.193.5:0/1792155850 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4007cb0 con 0x7ff6c8004900 2026-02-17T21:27:47.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.994+0000 7ff6e2ad3640 10 monclient: get_monmap_and_config success 2026-02-17T21:27:47.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.994+0000 7ff6e2ad3640 4 set_mon_vals no callback set 2026-02-17T21:27:47.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.994+0000 7ff6d37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:47.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.994+0000 7ff6d37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:27:47.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.994+0000 7ff6d37fe640 10 monclient: dump: 2026-02-17T21:27:47.010 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:47.010 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:47.010 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:47.010 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:47.010 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:47.010 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:47.010 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:47.011 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:47.011 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:47.011 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:47.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.995+0000 7ff6e2ad3640 10 monclient: shutdown 2026-02-17T21:27:47.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.995+0000 7ff6e2ad3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:47.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.995+0000 7ff6e2ad3640 1 -- 10.20.193.5:0/1792155850 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff6c8004900 msgr2=0x7ff6c8004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:47.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.995+0000 7ff6e2ad3640 1 --2- 10.20.193.5:0/1792155850 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff6c8004900 0x7ff6c8004d80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400c190 tx=0x7ff6c402f430 comp rx=0 tx=0).stop 2026-02-17T21:27:47.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.995+0000 7ff6e2ad3640 1 -- 10.20.193.5:0/1792155850 shutdown_connections 2026-02-17T21:27:47.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.995+0000 7ff6e2ad3640 1 --2- 10.20.193.5:0/1792155850 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff6c8004900 0x7ff6c8004d80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:47.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.995+0000 7ff6e2ad3640 1 -- 10.20.193.5:0/1792155850 >> 10.20.193.5:0/1792155850 conn(0x7ff6dc0cafa0 msgr2=0x7ff6dc0cb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:47.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.995+0000 7ff6e2ad3640 1 -- 10.20.193.5:0/1792155850 shutdown_connections 2026-02-17T21:27:47.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.995+0000 7ff6e2ad3640 1 -- 10.20.193.5:0/1792155850 wait complete. 2026-02-17T21:27:47.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.996+0000 7ff6e2ad3640 10 monclient: build_initial_monmap 2026-02-17T21:27:47.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.996+0000 7ff6e2ad3640 10 monclient: monmap: 2026-02-17T21:27:47.012 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:47.012 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:27:47.012 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:27:47.012 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:27:47.012 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:47.012 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:47.012 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:27:47.012 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:27:47.012 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:27:47.013 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:47.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.996+0000 7ff6e2ad3640 1 librados: starting msgr at 2026-02-17T21:27:47.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.996+0000 7ff6e2ad3640 1 librados: starting objecter 2026-02-17T21:27:47.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.996+0000 7ff6e2ad3640 1 Processor -- start 2026-02-17T21:27:47.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.996+0000 7ff6e2ad3640 1 -- start start 2026-02-17T21:27:47.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.996+0000 7ff6e2ad3640 1 librados: setting wanted keys 2026-02-17T21:27:47.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.996+0000 7ff6e2ad3640 1 librados: calling monclient init 2026-02-17T21:27:47.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.996+0000 7ff6e2ad3640 10 monclient: init 2026-02-17T21:27:47.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.996+0000 7ff6e2ad3640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:47.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.996+0000 7ff6e2ad3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:27:47.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.996+0000 7ff6e2ad3640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff6c8004900 0x7ff6dc0ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:47.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.996+0000 7ff6e2ad3640 10 monclient(hunting): picked mon.noname-c con 0x7ff6c8004900 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:27:47.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.996+0000 7ff6e2ad3640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff6dc1f70a0 0x7ff6dc1493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:47.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.996+0000 7ff6e2ad3640 10 monclient(hunting): picked mon.noname-a con 0x7ff6dc1f70a0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:27:47.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.996+0000 7ff6e2ad3640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff6dc1f7520 0x7ff6dc1498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:47.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.996+0000 7ff6e2ad3640 10 monclient(hunting): picked mon.noname-b con 0x7ff6dc1f7520 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:27:47.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.996+0000 7ff6e2ad3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:47.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.996+0000 7ff6e2ad3640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc070a60 con 0x7ff6dc1f70a0 2026-02-17T21:27:47.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.996+0000 7ff6e2ad3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:47.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.996+0000 7ff6e2ad3640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc159eb0 con 0x7ff6dc1f7520 2026-02-17T21:27:47.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.996+0000 7ff6e2ad3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:47.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.996+0000 7ff6e2ad3640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc06fe90 con 0x7ff6c8004900 2026-02-17T21:27:47.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.996+0000 7ff6e2ad3640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:47.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.996+0000 7ff6e2ad3640 10 monclient(hunting): authenticate will time out at 1172.561772s 2026-02-17T21:27:47.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6d3fff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff6dc1f70a0 0x7ff6dc1493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:47.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6e1049640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff6dc1f7520 0x7ff6dc1498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:47.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6e0848640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff6c8004900 0x7ff6dc0ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:47.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6e1049640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff6dc1f7520 0x7ff6dc1498f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:47920/0 (socket says 10.20.193.5:47920) 2026-02-17T21:27:47.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6d3fff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff6dc1f70a0 0x7ff6dc1493b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:46444/0 (socket says 10.20.193.5:46444) 2026-02-17T21:27:47.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6e1049640 1 -- 10.20.193.5:0/276775876 learned_addr learned my addr 10.20.193.5:0/276775876 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:27:47.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6e1049640 10 monclient(hunting): get_auth_request con 0x7ff6dc1f7520 auth_method 0 2026-02-17T21:27:47.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6e1049640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:47.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6e1049640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:47.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6e1049640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:47.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6d3fff640 10 monclient(hunting): get_auth_request con 0x7ff6dc1f70a0 auth_method 0 2026-02-17T21:27:47.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:47.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:47.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:47.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6e0848640 10 monclient(hunting): get_auth_request con 0x7ff6c8004900 auth_method 0 2026-02-17T21:27:47.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6e0848640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:47.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6e0848640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:47.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6e0848640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:47.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6e1049640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:47.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6e1049640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:47.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6e1049640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:47.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:47.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:47.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:47.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6e0848640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:47.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6e0848640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:47.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.997+0000 7ff6e0848640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:47.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.998+0000 7ff6e1049640 10 monclient(hunting): handle_auth_done global_id 4837 payload 824 2026-02-17T21:27:47.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.998+0000 7ff6e1049640 1 -- 10.20.193.5:0/276775876 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff6c8004900 msgr2=0x7ff6dc0ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:47.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.998+0000 7ff6e1049640 1 --2- 10.20.193.5:0/276775876 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff6c8004900 0x7ff6dc0ca1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:47.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.998+0000 7ff6e1049640 1 -- 10.20.193.5:0/276775876 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff6dc1f70a0 msgr2=0x7ff6dc1493b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:47.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.998+0000 7ff6e1049640 1 --2- 10.20.193.5:0/276775876 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff6dc1f70a0 0x7ff6dc1493b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:47.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.998+0000 7ff6e1049640 10 monclient: _finish_hunting 0 2026-02-17T21:27:47.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.998+0000 7ff6e1049640 1 monclient: found mon.noname-b 2026-02-17T21:27:47.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.998+0000 7ff6e1049640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:47.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.998+0000 7ff6e1049640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:27:47.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.998+0000 7ff6e1049640 1 -- 10.20.193.5:0/276775876 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6dc0c8e50 con 0x7ff6dc1f7520 2026-02-17T21:27:47.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.999+0000 7ff6e1049640 1 --2- 10.20.193.5:0/276775876 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff6dc1f7520 0x7ff6dc1498f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc154460 tx=0x7ff6d800f520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:47.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.999+0000 7ff6d17fa640 10 client.?.objecter ms_handle_connect 0x7ff6dc1f7520 2026-02-17T21:27:47.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:46.999+0000 7ff6d17fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:27:47.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.000+0000 7ff6d17fa640 1 -- 10.20.193.5:0/276775876 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8003a90 con 0x7ff6dc1f7520 2026-02-17T21:27:47.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.000+0000 7ff6d17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:47.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.000+0000 7ff6d17fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:27:47.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.000+0000 7ff6d17fa640 10 monclient: dump: 2026-02-17T21:27:47.018 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:47.018 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:47.018 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:47.018 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:47.018 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:47.018 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:47.018 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:47.018 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:47.018 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:47.018 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:47.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.000+0000 7ff6d17fa640 10 monclient: _finish_auth 0 2026-02-17T21:27:47.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.000+0000 7ff6d17fa640 10 monclient: _check_auth_tickets 2026-02-17T21:27:47.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.000+0000 7ff6d17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:47.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.000+0000 7ff6e2ad3640 5 monclient: authenticate success, global_id 4837 2026-02-17T21:27:47.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.000+0000 7ff6e2ad3640 10 monclient: _renew_subs 2026-02-17T21:27:47.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.000+0000 7ff6e2ad3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:47.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.000+0000 7ff6e2ad3640 1 -- 10.20.193.5:0/276775876 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6dc0c9130 con 0x7ff6dc1f7520 2026-02-17T21:27:47.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.000+0000 7ff6e2ad3640 10 client.4837.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:27:47.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.000+0000 7ff6e2ad3640 10 monclient: _renew_subs 2026-02-17T21:27:47.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.000+0000 7ff6e2ad3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:47.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.000+0000 7ff6e2ad3640 1 -- 10.20.193.5:0/276775876 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6dc0c96f0 con 0x7ff6dc1f7520 2026-02-17T21:27:47.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.000+0000 7ff6e2ad3640 1 librados: init done 2026-02-17T21:27:47.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.001+0000 7ff6e2ad3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:47.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.001+0000 7ff6e2ad3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:47.020 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.001+0000 7ff6e2ad3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:47.020 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.001+0000 7ff6e2ad3640 1 -- 10.20.193.5:0/276775876 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6dc06be20 con 0x7ff6dc1f7520 2026-02-17T21:27:47.020 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.001+0000 7ff6d17fa640 1 -- 10.20.193.5:0/276775876 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d8003c30 con 0x7ff6dc1f7520 2026-02-17T21:27:47.020 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.001+0000 7ff6d17fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:47.020 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.001+0000 7ff6d17fa640 1 -- 10.20.193.5:0/276775876 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d800fab0 con 0x7ff6dc1f7520 2026-02-17T21:27:47.020 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.001+0000 7ff6d17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:47.020 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.001+0000 7ff6d17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:27:47.020 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.001+0000 7ff6d2ffd640 4 set_mon_vals no callback set 2026-02-17T21:27:47.020 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.001+0000 7ff6d17fa640 10 monclient: dump: 2026-02-17T21:27:47.020 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:47.020 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:47.020 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:47.020 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:47.020 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:47.020 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:47.020 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:47.021 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:47.021 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:47.021 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:47.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.109+0000 7ff6d17fa640 1 -- 10.20.193.5:0/276775876 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7ff6d800fc50 con 0x7ff6dc1f7520 2026-02-17T21:27:47.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.109+0000 7ff6d17fa640 1 --2- 10.20.193.5:0/276775876 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff6ac079280 0x7ff6ac07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:47.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.109+0000 7ff6e0848640 1 --2- 10.20.193.5:0/276775876 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff6ac079280 0x7ff6ac07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:47.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.109+0000 7ff6e0848640 10 monclient: get_auth_request con 0x7ff6ac079280 auth_method 0 2026-02-17T21:27:47.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.110+0000 7ff6d17fa640 10 client.4837.objecter ms_handle_connect 0x7ff6ac079280 2026-02-17T21:27:47.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.110+0000 7ff6e0848640 1 --2- 10.20.193.5:0/276775876 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff6ac079280 0x7ff6ac07b740 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc005610 tx=0x7ff6cc007d60 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:47.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.111+0000 7ff6d17fa640 1 -- 10.20.193.5:0/276775876 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7ff6d8098970 con 0x7ff6dc1f7520 2026-02-17T21:27:47.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.111+0000 7ff6d17fa640 10 client.4837.objecter ms_dispatch2 0x7ff6dc000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:27:47.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.111+0000 7ff6d17fa640 3 client.4837.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:27:47.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.111+0000 7ff6d17fa640 3 client.4837.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:27:47.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.111+0000 7ff6d17fa640 20 client.4837.objecter dump_active .. 0 homeless 2026-02-17T21:27:47.119 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.118+0000 7ff6d17fa640 1 -- 10.20.193.5:0/276775876 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff6d8063550 con 0x7ff6dc1f7520 2026-02-17T21:27:47.119 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.118+0000 7ff6d17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:47.119 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.118+0000 7ff6d17fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:27:47.217 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.215+0000 7ff6e2ad3640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:27:47.217 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.215+0000 7ff6e2ad3640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:47.217 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.215+0000 7ff6e2ad3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:47.217 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.215+0000 7ff6e2ad3640 1 -- 10.20.193.5:0/276775876 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff6dc1504a0 con 0x7ff6dc1f7520 2026-02-17T21:27:47.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.219+0000 7ff6d17fa640 1 -- 10.20.193.5:0/276775876 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7ff6d8062e50 con 0x7ff6dc1f7520 2026-02-17T21:27:47.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.219+0000 7ff6d17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:47.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.219+0000 7ff6d17fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:27:47.221 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:27:47.221 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:27:47.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.220+0000 7ff6e2ad3640 10 librados: watch_flush enter 2026-02-17T21:27:47.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.220+0000 7ff6e2ad3640 10 librados: watch_flush exit 2026-02-17T21:27:47.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.220+0000 7ff6e2ad3640 20 client.4837.objecter shutdown clearing up homeless session... 2026-02-17T21:27:47.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.220+0000 7ff6e2ad3640 10 client.4837.objecter successfully canceled tick 2026-02-17T21:27:47.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.220+0000 7ff6e2ad3640 1 -- 10.20.193.5:0/276775876 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff6ac079280 msgr2=0x7ff6ac07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:47.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.220+0000 7ff6e2ad3640 1 --2- 10.20.193.5:0/276775876 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff6ac079280 0x7ff6ac07b740 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc005610 tx=0x7ff6cc007d60 comp rx=0 tx=0).stop 2026-02-17T21:27:47.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.220+0000 7ff6e2ad3640 10 monclient: shutdown 2026-02-17T21:27:47.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.220+0000 7ff6e2ad3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:47.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.220+0000 7ff6e2ad3640 1 -- 10.20.193.5:0/276775876 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff6dc1f7520 msgr2=0x7ff6dc1498f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:47.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.220+0000 7ff6e2ad3640 1 --2- 10.20.193.5:0/276775876 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff6dc1f7520 0x7ff6dc1498f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc154460 tx=0x7ff6d800f520 comp rx=0 tx=0).stop 2026-02-17T21:27:47.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.220+0000 7ff6e2ad3640 1 -- 10.20.193.5:0/276775876 shutdown_connections 2026-02-17T21:27:47.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.220+0000 7ff6e2ad3640 1 --2- 10.20.193.5:0/276775876 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff6ac079280 0x7ff6ac07b740 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:47.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.220+0000 7ff6e2ad3640 1 --2- 10.20.193.5:0/276775876 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff6dc1f7520 0x7ff6dc1498f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:47.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.220+0000 7ff6e2ad3640 1 --2- 10.20.193.5:0/276775876 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff6dc1f70a0 0x7ff6dc1493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:47.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.220+0000 7ff6e2ad3640 1 --2- 10.20.193.5:0/276775876 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff6c8004900 0x7ff6dc0ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:47.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.220+0000 7ff6e2ad3640 1 -- 10.20.193.5:0/276775876 >> 10.20.193.5:0/276775876 conn(0x7ff6dc0cafa0 msgr2=0x7ff6dc151c80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:47.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.220+0000 7ff6e2ad3640 1 -- 10.20.193.5:0/276775876 shutdown_connections 2026-02-17T21:27:47.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.220+0000 7ff6e2ad3640 1 -- 10.20.193.5:0/276775876 wait complete. 2026-02-17T21:27:47.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:47.220+0000 7ff6e2ad3640 1 librados: shutdown 2026-02-17T21:27:50.231 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:27:50.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.299+0000 7f3c2a474640 10 monclient: get_monmap_and_config 2026-02-17T21:27:50.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.299+0000 7f3c2a474640 10 monclient: build_initial_monmap 2026-02-17T21:27:50.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.299+0000 7f3c2a474640 10 monclient: monmap: 2026-02-17T21:27:50.301 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:50.301 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:50.301 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:27:50.300218+0000 2026-02-17T21:27:50.301 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:27:50.300218+0000 2026-02-17T21:27:50.301 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:50.302 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:50.302 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:27:50.302 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:27:50.302 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:27:50.302 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:27:50.302 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:27:50.302 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:27:50.302 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:50.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.300+0000 7f3c2a474640 1 Processor -- start 2026-02-17T21:27:50.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.300+0000 7f3c2a474640 1 -- start start 2026-02-17T21:27:50.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.300+0000 7f3c2a474640 10 monclient: init 2026-02-17T21:27:50.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.300+0000 7f3c2a474640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:50.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.300+0000 7f3c2a474640 10 monclient: _add_conns ranks=[2,1,0,5,4,3] 2026-02-17T21:27:50.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.300+0000 7f3c2a474640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3c240c7170 addr v1:10.20.193.135:6789/0 2026-02-17T21:27:50.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.300+0000 7f3c2a474640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f3c240c7550 addr v1:10.20.193.119:6789/0 2026-02-17T21:27:50.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.300+0000 7f3c2a474640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3c240c89c0 addr v1:10.20.193.5:6789/0 2026-02-17T21:27:50.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.300+0000 7f3c2a474640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c240c4fd0 con 0x7f3c240c89c0 2026-02-17T21:27:50.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.300+0000 7f3c2a474640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c2415a9a0 con 0x7f3c240c7550 2026-02-17T21:27:50.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.300+0000 7f3c2a474640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c240c5270 con 0x7f3c240c7170 2026-02-17T21:27:50.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.300+0000 7f3c2a474640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:50.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.300+0000 7f3c2a474640 10 monclient(hunting): authenticate will time out at 1175.865647s 2026-02-17T21:27:50.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.301+0000 7f3c289ea640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f3c240c89c0 0x7f3c241646d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:45800/0 (socket says 10.20.193.5:45800) 2026-02-17T21:27:50.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.301+0000 7f3c289ea640 1 -- 10.20.193.5:0/2617156154 learned_addr learned my addr 10.20.193.5:0/2617156154 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:27:50.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.302+0000 7f3c22ffd640 1 -- 10.20.193.5:0/2617156154 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 928844600 0 0) 0x7f3c240c4fd0 con 0x7f3c240c89c0 2026-02-17T21:27:50.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.302+0000 7f3c22ffd640 10 monclient(hunting): _negotiate 2026-02-17T21:27:50.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.302+0000 7f3c22ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:50.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.302+0000 7f3c22ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:50.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.302+0000 7f3c22ffd640 10 monclient(hunting): my global_id is 4827 2026-02-17T21:27:50.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.302+0000 7f3c22ffd640 1 -- 10.20.193.5:0/2617156154 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c08003620 con 0x7f3c240c89c0 2026-02-17T21:27:50.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.302+0000 7f3c22ffd640 1 -- 10.20.193.5:0/2617156154 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3948647270 0 0) 0x7f3c2415a9a0 con 0x7f3c240c7550 2026-02-17T21:27:50.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.302+0000 7f3c22ffd640 10 monclient(hunting): _negotiate 2026-02-17T21:27:50.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.302+0000 7f3c22ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:50.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.302+0000 7f3c22ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:50.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.302+0000 7f3c22ffd640 10 monclient(hunting): my global_id is 4840 2026-02-17T21:27:50.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.302+0000 7f3c22ffd640 1 -- 10.20.193.5:0/2617156154 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c240c4fd0 con 0x7f3c240c7550 2026-02-17T21:27:50.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.302+0000 7f3c22ffd640 1 -- 10.20.193.5:0/2617156154 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4291005117 0 0) 0x7f3c240c5270 con 0x7f3c240c7170 2026-02-17T21:27:50.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.302+0000 7f3c22ffd640 10 monclient(hunting): _negotiate 2026-02-17T21:27:50.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.302+0000 7f3c22ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:50.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.302+0000 7f3c22ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:50.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.302+0000 7f3c22ffd640 10 monclient(hunting): my global_id is 4841 2026-02-17T21:27:50.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.302+0000 7f3c22ffd640 1 -- 10.20.193.5:0/2617156154 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c2415a9a0 con 0x7f3c240c7170 2026-02-17T21:27:50.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 1 -- 10.20.193.5:0/2617156154 <== mon.0 v1:10.20.193.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2464337226 0 0) 0x7f3c08003620 con 0x7f3c240c89c0 2026-02-17T21:27:50.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 1 -- 10.20.193.5:0/2617156154 >> v1:10.20.193.135:6789/0 conn(0x7f3c240c7170 legacy=0x7f3c240c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:50.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 1 -- 10.20.193.5:0/2617156154 >> v1:10.20.193.119:6789/0 conn(0x7f3c240c7550 legacy=0x7f3c240749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:50.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:27:50.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 1 monclient: found mon.noname-a-legacy 2026-02-17T21:27:50.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:50.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.5:6789/0 2026-02-17T21:27:50.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 1 -- 10.20.193.5:0/2617156154 --> v1:10.20.193.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c240c5550 con 0x7f3c240c89c0 2026-02-17T21:27:50.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 10 monclient: _finish_auth 0 2026-02-17T21:27:50.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:27:50.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:50.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 1 -- 10.20.193.5:0/2617156154 <== mon.0 v1:10.20.193.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3880376286 0 0) 0x7f3c18003280 con 0x7f3c240c89c0 2026-02-17T21:27:50.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:50.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T21:27:50.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 10 monclient: dump: 2026-02-17T21:27:50.318 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:50.318 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:50.318 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:50.318 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:50.318 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:50.318 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:50.318 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:50.318 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:50.318 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:50.318 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:50.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] but i'm connected to v1:10.20.193.5:6789/0, reconnecting 2026-02-17T21:27:50.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:50.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 1 -- 10.20.193.5:0/2617156154 >> v1:10.20.193.5:6789/0 conn(0x7f3c240c89c0 legacy=0x7f3c241646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:50.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:27:50.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 1 --2- 10.20.193.5:0/2617156154 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3c08003fe0 0x7f3c08004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:50.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 10 monclient(hunting): picked mon.c con 0x7f3c08003fe0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:27:50.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 1 --2- 10.20.193.5:0/2617156154 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c08004e40 0x7f3c080052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:50.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 10 monclient(hunting): picked mon.b con 0x7f3c08004e40 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:27:50.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 1 --2- 10.20.193.5:0/2617156154 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c08009ab0 0x7f3c0800bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:50.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 10 monclient(hunting): picked mon.a con 0x7f3c08009ab0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:27:50.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:50.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 1 -- 10.20.193.5:0/2617156154 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0800c570 con 0x7f3c08009ab0 2026-02-17T21:27:50.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:50.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 1 -- 10.20.193.5:0/2617156154 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0800c6f0 con 0x7f3c08004e40 2026-02-17T21:27:50.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:50.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 1 -- 10.20.193.5:0/2617156154 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0800c8f0 con 0x7f3c08003fe0 2026-02-17T21:27:50.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:50.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.304+0000 7f3c22ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:27:50.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.305+0000 7f3c289ea640 1 --2- 10.20.193.5:0/2617156154 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c08009ab0 0x7f3c0800bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:50.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.305+0000 7f3c23fff640 1 --2- 10.20.193.5:0/2617156154 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3c08003fe0 0x7f3c08004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:50.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.305+0000 7f3c237fe640 1 --2- 10.20.193.5:0/2617156154 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c08004e40 0x7f3c080052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:50.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.305+0000 7f3c237fe640 10 monclient(hunting): get_auth_request con 0x7f3c08004e40 auth_method 0 2026-02-17T21:27:50.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.305+0000 7f3c237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:50.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.305+0000 7f3c237fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:50.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.305+0000 7f3c237fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:27:50.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.305+0000 7f3c23fff640 10 monclient(hunting): get_auth_request con 0x7f3c08003fe0 auth_method 0 2026-02-17T21:27:50.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.305+0000 7f3c23fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:50.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.305+0000 7f3c23fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:50.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.305+0000 7f3c23fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:27:50.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.306+0000 7f3c289ea640 10 monclient(hunting): get_auth_request con 0x7f3c08009ab0 auth_method 0 2026-02-17T21:27:50.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.306+0000 7f3c289ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:50.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.306+0000 7f3c289ea640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:50.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.306+0000 7f3c289ea640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:27:50.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.306+0000 7f3c237fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:50.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.306+0000 7f3c237fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:50.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.306+0000 7f3c237fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:27:50.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.306+0000 7f3c23fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:50.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.306+0000 7f3c23fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:50.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.306+0000 7f3c23fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:27:50.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.306+0000 7f3c289ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:50.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.306+0000 7f3c289ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:50.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.306+0000 7f3c289ea640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:27:50.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.307+0000 7f3c237fe640 10 monclient(hunting): handle_auth_done global_id 4827 payload 293 2026-02-17T21:27:50.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.307+0000 7f3c237fe640 1 -- 10.20.193.5:0/2617156154 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3c08003fe0 msgr2=0x7f3c08004900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:27:50.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.307+0000 7f3c237fe640 1 --2- 10.20.193.5:0/2617156154 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3c08003fe0 0x7f3c08004900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:50.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.307+0000 7f3c237fe640 1 -- 10.20.193.5:0/2617156154 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c08009ab0 msgr2=0x7f3c0800bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:27:50.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.307+0000 7f3c237fe640 1 --2- 10.20.193.5:0/2617156154 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c08009ab0 0x7f3c0800bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:50.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.307+0000 7f3c237fe640 10 monclient: _finish_hunting 0 2026-02-17T21:27:50.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.307+0000 7f3c237fe640 1 monclient: found mon.b 2026-02-17T21:27:50.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.307+0000 7f3c289ea640 1 -- 10.20.193.5:0/2617156154 reap_dead start 2026-02-17T21:27:50.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.307+0000 7f3c237fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:50.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.307+0000 7f3c237fe640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:50.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.307+0000 7f3c237fe640 1 -- 10.20.193.5:0/2617156154 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c08003620 con 0x7f3c08004e40 2026-02-17T21:27:50.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.307+0000 7f3c237fe640 10 monclient: _finish_auth 0 2026-02-17T21:27:50.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.307+0000 7f3c237fe640 10 monclient: _check_auth_tickets 2026-02-17T21:27:50.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.307+0000 7f3c237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:50.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.307+0000 7f3c2a474640 5 monclient: authenticate success, global_id 4827 2026-02-17T21:27:50.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.307+0000 7f3c2a474640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:27:50.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.307+0000 7f3c23fff640 1 --2- 10.20.193.5:0/2617156154 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3c08003fe0 0x7f3c08004900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T21:27:50.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.308+0000 7f3c237fe640 1 --2- 10.20.193.5:0/2617156154 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c08004e40 0x7f3c080052c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3c140031f0 tx=0x7f3c1402ef40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1dd72bb1bbc94df server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:50.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.310+0000 7f3c22ffd640 1 -- 10.20.193.5:0/2617156154 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c14002e10 con 0x7f3c08004e40 2026-02-17T21:27:50.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.310+0000 7f3c22ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:50.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.310+0000 7f3c22ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:27:50.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.310+0000 7f3c22ffd640 10 monclient: dump: 2026-02-17T21:27:50.324 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:50.324 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:50.324 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:50.324 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:50.324 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:50.324 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:50.324 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:50.325 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:50.325 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:50.325 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:50.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.310+0000 7f3c22ffd640 1 -- 10.20.193.5:0/2617156154 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c140052d0 con 0x7f3c08004e40 2026-02-17T21:27:50.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.310+0000 7f3c2a474640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:27:50.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.310+0000 7f3c22ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:50.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.310+0000 7f3c22ffd640 1 -- 10.20.193.5:0/2617156154 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1402f760 con 0x7f3c08004e40 2026-02-17T21:27:50.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.310+0000 7f3c2a474640 10 monclient: get_monmap_and_config success 2026-02-17T21:27:50.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.310+0000 7f3c2a474640 4 set_mon_vals no callback set 2026-02-17T21:27:50.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.310+0000 7f3c22ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:50.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.310+0000 7f3c22ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:27:50.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.310+0000 7f3c22ffd640 10 monclient: dump: 2026-02-17T21:27:50.326 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:50.326 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:50.326 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:50.326 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:50.326 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:50.326 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:50.326 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:50.326 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:50.326 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:50.326 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:50.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.310+0000 7f3c2a474640 10 monclient: shutdown 2026-02-17T21:27:50.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.310+0000 7f3c2a474640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:50.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.310+0000 7f3c2a474640 1 -- 10.20.193.5:0/2617156154 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c08004e40 msgr2=0x7f3c080052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:50.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.310+0000 7f3c2a474640 1 --2- 10.20.193.5:0/2617156154 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c08004e40 0x7f3c080052c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3c140031f0 tx=0x7f3c1402ef40 comp rx=0 tx=0).stop 2026-02-17T21:27:50.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.310+0000 7f3c2a474640 1 -- 10.20.193.5:0/2617156154 shutdown_connections 2026-02-17T21:27:50.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.310+0000 7f3c2a474640 1 --2- 10.20.193.5:0/2617156154 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c08004e40 0x7f3c080052c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:50.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.310+0000 7f3c2a474640 1 -- 10.20.193.5:0/2617156154 >> 10.20.193.5:0/2617156154 conn(0x7f3c240c9f40 msgr2=0x7f3c240ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:50.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.310+0000 7f3c2a474640 1 -- 10.20.193.5:0/2617156154 shutdown_connections 2026-02-17T21:27:50.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.310+0000 7f3c2a474640 1 -- 10.20.193.5:0/2617156154 wait complete. 2026-02-17T21:27:50.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.311+0000 7f3c2a474640 10 monclient: build_initial_monmap 2026-02-17T21:27:50.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.311+0000 7f3c2a474640 10 monclient: monmap: 2026-02-17T21:27:50.327 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:50.327 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:27:50.327 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:27:50.328 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:27:50.328 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:50.328 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:50.328 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:27:50.328 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:27:50.328 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:27:50.328 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:50.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.311+0000 7f3c2a474640 1 librados: starting msgr at 2026-02-17T21:27:50.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.311+0000 7f3c2a474640 1 librados: starting objecter 2026-02-17T21:27:50.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.311+0000 7f3c2a474640 1 Processor -- start 2026-02-17T21:27:50.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.311+0000 7f3c2a474640 1 -- start start 2026-02-17T21:27:50.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.311+0000 7f3c2a474640 1 librados: setting wanted keys 2026-02-17T21:27:50.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.311+0000 7f3c2a474640 1 librados: calling monclient init 2026-02-17T21:27:50.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.311+0000 7f3c2a474640 10 monclient: init 2026-02-17T21:27:50.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.311+0000 7f3c2a474640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:50.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.311+0000 7f3c2a474640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:27:50.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.311+0000 7f3c2a474640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c08004e40 0x7f3c240c2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:50.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.311+0000 7f3c2a474640 10 monclient(hunting): picked mon.noname-b con 0x7f3c08004e40 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:27:50.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.311+0000 7f3c2a474640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3c2406eb50 0x7f3c240bff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:50.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.311+0000 7f3c2a474640 10 monclient(hunting): picked mon.noname-c con 0x7f3c2406eb50 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:27:50.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.311+0000 7f3c2a474640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c240c04b0 0x7f3c24153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:50.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.311+0000 7f3c2a474640 10 monclient(hunting): picked mon.noname-a con 0x7f3c240c04b0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:27:50.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.311+0000 7f3c2a474640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:50.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.311+0000 7f3c2a474640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3c240c7ee0 con 0x7f3c240c04b0 2026-02-17T21:27:50.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.311+0000 7f3c2a474640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:50.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.311+0000 7f3c2a474640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3c240c8530 con 0x7f3c08004e40 2026-02-17T21:27:50.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.311+0000 7f3c2a474640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:50.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.311+0000 7f3c2a474640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3c240c81c0 con 0x7f3c2406eb50 2026-02-17T21:27:50.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.311+0000 7f3c2a474640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:50.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.311+0000 7f3c2a474640 10 monclient(hunting): authenticate will time out at 1175.876883s 2026-02-17T21:27:50.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c23fff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c08004e40 0x7f3c240c2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:50.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c289ea640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c240c04b0 0x7f3c24153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:50.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c23fff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c08004e40 0x7f3c240c2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:44318/0 (socket says 10.20.193.5:44318) 2026-02-17T21:27:50.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c23fff640 1 -- 10.20.193.5:0/1395071654 learned_addr learned my addr 10.20.193.5:0/1395071654 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:27:50.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c23fff640 10 monclient(hunting): get_auth_request con 0x7f3c08004e40 auth_method 0 2026-02-17T21:27:50.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c23fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:50.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c23fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:50.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:50.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c289ea640 10 monclient(hunting): get_auth_request con 0x7f3c240c04b0 auth_method 0 2026-02-17T21:27:50.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c289ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:50.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c289ea640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:50.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c289ea640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:50.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c237fe640 1 --2- 10.20.193.5:0/1395071654 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3c2406eb50 0x7f3c240bff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:50.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c23fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:50.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c23fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:50.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c23fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:50.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c289ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:50.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c289ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:50.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c289ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:50.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c237fe640 10 monclient(hunting): get_auth_request con 0x7f3c2406eb50 auth_method 0 2026-02-17T21:27:50.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:50.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c237fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:50.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c237fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:50.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c237fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:50.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c237fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:50.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.312+0000 7f3c237fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:50.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.313+0000 7f3c23fff640 10 monclient(hunting): handle_auth_done global_id 4843 payload 824 2026-02-17T21:27:50.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.313+0000 7f3c23fff640 1 -- 10.20.193.5:0/1395071654 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3c2406eb50 msgr2=0x7f3c240bff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:50.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.313+0000 7f3c23fff640 1 --2- 10.20.193.5:0/1395071654 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3c2406eb50 0x7f3c240bff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:50.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.313+0000 7f3c23fff640 1 -- 10.20.193.5:0/1395071654 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c240c04b0 msgr2=0x7f3c24153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:50.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.313+0000 7f3c23fff640 1 --2- 10.20.193.5:0/1395071654 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c240c04b0 0x7f3c24153400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:50.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.313+0000 7f3c23fff640 10 monclient: _finish_hunting 0 2026-02-17T21:27:50.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.313+0000 7f3c23fff640 1 monclient: found mon.noname-b 2026-02-17T21:27:50.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.313+0000 7f3c23fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:50.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.313+0000 7f3c23fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:27:50.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.313+0000 7f3c23fff640 1 -- 10.20.193.5:0/1395071654 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2406efb0 con 0x7f3c08004e40 2026-02-17T21:27:50.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.314+0000 7f3c23fff640 1 --2- 10.20.193.5:0/1395071654 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c08004e40 0x7f3c240c2670 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000eaa0 tx=0x7f3c1000ef70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:50.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.314+0000 7f3c20ff9640 10 client.?.objecter ms_handle_connect 0x7f3c08004e40 2026-02-17T21:27:50.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.314+0000 7f3c20ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:27:50.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.316+0000 7f3c20ff9640 1 -- 10.20.193.5:0/1395071654 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c10002dc0 con 0x7f3c08004e40 2026-02-17T21:27:50.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.316+0000 7f3c20ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:50.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.316+0000 7f3c20ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:27:50.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.316+0000 7f3c20ff9640 10 monclient: dump: 2026-02-17T21:27:50.336 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:50.336 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:50.336 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:50.336 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:50.336 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:50.336 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:50.336 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:50.337 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:50.337 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:50.337 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:50.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.316+0000 7f3c20ff9640 10 monclient: _finish_auth 0 2026-02-17T21:27:50.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.316+0000 7f3c20ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:27:50.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.316+0000 7f3c20ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:50.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.316+0000 7f3c20ff9640 1 -- 10.20.193.5:0/1395071654 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c10019070 con 0x7f3c08004e40 2026-02-17T21:27:50.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.316+0000 7f3c2a474640 5 monclient: authenticate success, global_id 4843 2026-02-17T21:27:50.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.316+0000 7f3c20ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:50.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.316+0000 7f3c20ff9640 1 -- 10.20.193.5:0/1395071654 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1000caf0 con 0x7f3c08004e40 2026-02-17T21:27:50.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.316+0000 7f3c20ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:50.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.316+0000 7f3c20ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:27:50.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.316+0000 7f3c20ff9640 10 monclient: dump: 2026-02-17T21:27:50.338 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:50.338 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:50.338 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:50.338 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:50.338 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:50.338 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:50.338 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:50.338 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:50.338 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:50.338 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:50.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.316+0000 7f3c227fc640 4 set_mon_vals no callback set 2026-02-17T21:27:50.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.316+0000 7f3c2a474640 10 monclient: _renew_subs 2026-02-17T21:27:50.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.316+0000 7f3c2a474640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:50.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.316+0000 7f3c2a474640 1 -- 10.20.193.5:0/1395071654 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c240c0910 con 0x7f3c08004e40 2026-02-17T21:27:50.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.316+0000 7f3c2a474640 10 client.4843.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:27:50.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.316+0000 7f3c2a474640 10 monclient: _renew_subs 2026-02-17T21:27:50.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.316+0000 7f3c2a474640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:50.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.316+0000 7f3c2a474640 1 -- 10.20.193.5:0/1395071654 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c2406dab0 con 0x7f3c08004e40 2026-02-17T21:27:50.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.316+0000 7f3c2a474640 1 librados: init done 2026-02-17T21:27:50.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.317+0000 7f3c2a474640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:50.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.317+0000 7f3c2a474640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:50.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.317+0000 7f3c2a474640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:50.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.317+0000 7f3c2a474640 1 -- 10.20.193.5:0/1395071654 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c240c8e70 con 0x7f3c08004e40 2026-02-17T21:27:50.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.329+0000 7f3c20ff9640 1 -- 10.20.193.5:0/1395071654 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f3c1000cc90 con 0x7f3c08004e40 2026-02-17T21:27:50.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.329+0000 7f3c20ff9640 1 --2- 10.20.193.5:0/1395071654 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3bf40792d0 0x7f3bf407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:50.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.329+0000 7f3c237fe640 1 --2- 10.20.193.5:0/1395071654 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3bf40792d0 0x7f3bf407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:50.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.329+0000 7f3c237fe640 10 monclient: get_auth_request con 0x7f3bf40792d0 auth_method 0 2026-02-17T21:27:50.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.330+0000 7f3c20ff9640 10 client.4843.objecter ms_handle_connect 0x7f3bf40792d0 2026-02-17T21:27:50.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.330+0000 7f3c237fe640 1 --2- 10.20.193.5:0/1395071654 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3bf40792d0 0x7f3bf407b790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3c14037000 tx=0x7f3c14033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:50.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.424+0000 7f3c20ff9640 1 -- 10.20.193.5:0/1395071654 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f3c1005e910 con 0x7f3c08004e40 2026-02-17T21:27:50.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.424+0000 7f3c20ff9640 10 client.4843.objecter ms_dispatch2 0x7f3c24000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:27:50.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.424+0000 7f3c20ff9640 3 client.4843.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:27:50.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.424+0000 7f3c20ff9640 3 client.4843.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:27:50.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.424+0000 7f3c20ff9640 20 client.4843.objecter dump_active .. 0 homeless 2026-02-17T21:27:50.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.431+0000 7f3c20ff9640 1 -- 10.20.193.5:0/1395071654 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3c100628d0 con 0x7f3c08004e40 2026-02-17T21:27:50.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.431+0000 7f3c20ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:50.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.431+0000 7f3c20ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:27:50.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.531+0000 7f3c2a474640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:27:50.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.531+0000 7f3c2a474640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:50.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.531+0000 7f3c2a474640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:27:50.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.531+0000 7f3c2a474640 1 -- 10.20.193.5:0/1395071654 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3c24073fb0 con 0x7f3c08004e40 2026-02-17T21:27:50.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.534+0000 7f3c20ff9640 1 -- 10.20.193.5:0/1395071654 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f3c10066bd0 con 0x7f3c08004e40 2026-02-17T21:27:50.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.534+0000 7f3c20ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:50.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.534+0000 7f3c20ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:27:50.536 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:27:50.536 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:27:50.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.536+0000 7f3c2a474640 10 librados: watch_flush enter 2026-02-17T21:27:50.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.536+0000 7f3c2a474640 10 librados: watch_flush exit 2026-02-17T21:27:50.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.536+0000 7f3c2a474640 20 client.4843.objecter shutdown clearing up homeless session... 2026-02-17T21:27:50.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.536+0000 7f3c2a474640 10 client.4843.objecter successfully canceled tick 2026-02-17T21:27:50.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.536+0000 7f3c2a474640 1 -- 10.20.193.5:0/1395071654 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3bf40792d0 msgr2=0x7f3bf407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:50.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.536+0000 7f3c2a474640 1 --2- 10.20.193.5:0/1395071654 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3bf40792d0 0x7f3bf407b790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3c14037000 tx=0x7f3c14033000 comp rx=0 tx=0).stop 2026-02-17T21:27:50.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.536+0000 7f3c2a474640 10 monclient: shutdown 2026-02-17T21:27:50.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.536+0000 7f3c2a474640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:50.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.536+0000 7f3c2a474640 1 -- 10.20.193.5:0/1395071654 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c08004e40 msgr2=0x7f3c240c2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:50.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.536+0000 7f3c2a474640 1 --2- 10.20.193.5:0/1395071654 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c08004e40 0x7f3c240c2670 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000eaa0 tx=0x7f3c1000ef70 comp rx=0 tx=0).stop 2026-02-17T21:27:50.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.536+0000 7f3c2a474640 1 -- 10.20.193.5:0/1395071654 shutdown_connections 2026-02-17T21:27:50.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.536+0000 7f3c2a474640 1 --2- 10.20.193.5:0/1395071654 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3bf40792d0 0x7f3bf407b790 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:50.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.536+0000 7f3c2a474640 1 --2- 10.20.193.5:0/1395071654 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3c240c04b0 0x7f3c24153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:50.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.536+0000 7f3c2a474640 1 --2- 10.20.193.5:0/1395071654 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3c2406eb50 0x7f3c240bff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:50.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.536+0000 7f3c2a474640 1 --2- 10.20.193.5:0/1395071654 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3c08004e40 0x7f3c240c2670 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:50.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.536+0000 7f3c2a474640 1 -- 10.20.193.5:0/1395071654 >> 10.20.193.5:0/1395071654 conn(0x7f3c240c9f40 msgr2=0x7f3c240ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:50.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.536+0000 7f3c2a474640 1 -- 10.20.193.5:0/1395071654 shutdown_connections 2026-02-17T21:27:50.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.536+0000 7f3c2a474640 1 -- 10.20.193.5:0/1395071654 wait complete. 2026-02-17T21:27:50.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:50.536+0000 7f3c2a474640 1 librados: shutdown 2026-02-17T21:27:53.547 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:27:53.615 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.614+0000 7f3071285640 10 monclient: get_monmap_and_config 2026-02-17T21:27:53.615 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.614+0000 7f3071285640 10 monclient: build_initial_monmap 2026-02-17T21:27:53.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.614+0000 7f3071285640 10 monclient: monmap: 2026-02-17T21:27:53.616 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:53.616 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:53.616 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:27:53.614741+0000 2026-02-17T21:27:53.616 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:27:53.614741+0000 2026-02-17T21:27:53.616 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:53.616 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:53.616 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:27:53.616 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:27:53.616 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:27:53.617 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:27:53.617 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:27:53.617 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:27:53.617 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:53.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.614+0000 7f3071285640 1 Processor -- start 2026-02-17T21:27:53.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.614+0000 7f3071285640 1 -- start start 2026-02-17T21:27:53.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.614+0000 7f3071285640 10 monclient: init 2026-02-17T21:27:53.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f3071285640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:53.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f3071285640 10 monclient: _add_conns ranks=[5,4,0,1,2,3] 2026-02-17T21:27:53.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f3071285640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f306c155d40 0x7f306c156120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:53.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f3071285640 10 monclient(hunting): picked mon.noname-c con 0x7f306c155d40 addr v2:10.20.193.135:3300/0 2026-02-17T21:27:53.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f3071285640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f306c0ccc00 0x7f306c15d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:53.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f3071285640 10 monclient(hunting): picked mon.noname-b con 0x7f306c0ccc00 addr v2:10.20.193.119:3300/0 2026-02-17T21:27:53.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f3071285640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f306c15d7e0 addr v1:10.20.193.5:6789/0 2026-02-17T21:27:53.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f3071285640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f306c15c8d0 con 0x7f306c15d7e0 2026-02-17T21:27:53.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f3071285640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:53.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f3071285640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f306c06c890 con 0x7f306c0ccc00 2026-02-17T21:27:53.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f3071285640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:53.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f3071285640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f306c06d410 con 0x7f306c155d40 2026-02-17T21:27:53.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f3071285640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:53.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f3071285640 10 monclient(hunting): authenticate will time out at 1179.180220s 2026-02-17T21:27:53.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f306b577640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f306c15d7e0 0x7f306c0caff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:45804/0 (socket says 10.20.193.5:45804) 2026-02-17T21:27:53.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f306b577640 1 -- 10.20.193.5:0/936229650 learned_addr learned my addr 10.20.193.5:0/936229650 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:27:53.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f306ad76640 1 --2- 10.20.193.5:0/936229650 >> v2:10.20.193.135:3300/0 conn(0x7f306c155d40 0x7f306c156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:53.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f306a575640 1 --2- 10.20.193.5:0/936229650 >> v2:10.20.193.119:3300/0 conn(0x7f306c0ccc00 0x7f306c15d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:53.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f306a575640 10 monclient(hunting): get_auth_request con 0x7f306c0ccc00 auth_method 0 2026-02-17T21:27:53.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f306a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:53.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f306a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:53.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f306a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:53.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f306ad76640 10 monclient(hunting): get_auth_request con 0x7f306c155d40 auth_method 0 2026-02-17T21:27:53.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f306ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:53.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f306ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:53.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.615+0000 7f306ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:53.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.616+0000 7f306a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:53.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.616+0000 7f306a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:53.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.616+0000 7f306a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:53.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.616+0000 7f306ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:53.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.616+0000 7f306ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:53.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.616+0000 7f306ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:53.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.616+0000 7f3069d74640 1 -- 10.20.193.5:0/936229650 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3242736122 0 0) 0x7f306c15c8d0 con 0x7f306c15d7e0 2026-02-17T21:27:53.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.616+0000 7f3069d74640 10 monclient(hunting): _negotiate 2026-02-17T21:27:53.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.616+0000 7f3069d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:53.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.616+0000 7f3069d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:53.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.616+0000 7f3069d74640 10 monclient(hunting): my global_id is 4833 2026-02-17T21:27:53.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.616+0000 7f3069d74640 1 -- 10.20.193.5:0/936229650 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3058003620 con 0x7f306c15d7e0 2026-02-17T21:27:53.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.617+0000 7f306ad76640 10 monclient(hunting): handle_auth_done global_id 4847 payload 274 2026-02-17T21:27:53.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.617+0000 7f306ad76640 1 -- 10.20.193.5:0/936229650 >> v2:10.20.193.119:3300/0 conn(0x7f306c0ccc00 msgr2=0x7f306c15d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:27:53.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.617+0000 7f306ad76640 1 --2- 10.20.193.5:0/936229650 >> v2:10.20.193.119:3300/0 conn(0x7f306c0ccc00 0x7f306c15d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:53.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.617+0000 7f306ad76640 1 -- 10.20.193.5:0/936229650 >> v1:10.20.193.5:6789/0 conn(0x7f306c15d7e0 legacy=0x7f306c0caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:53.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.617+0000 7f306ad76640 10 monclient: _finish_hunting 0 2026-02-17T21:27:53.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.617+0000 7f306ad76640 1 monclient: found mon.noname-c 2026-02-17T21:27:53.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.617+0000 7f306ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:53.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.617+0000 7f306ad76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:27:53.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.617+0000 7f306ad76640 1 -- 10.20.193.5:0/936229650 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f306c15cbb0 con 0x7f306c155d40 2026-02-17T21:27:53.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.618+0000 7f306ad76640 1 --2- 10.20.193.5:0/936229650 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f306c155d40 0x7f306c156120 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f306c06f220 tx=0x7f306002ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e17b5ea94f1d9146 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:53.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.619+0000 7f3069d74640 1 -- 10.20.193.5:0/936229650 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306003c070 con 0x7f306c155d40 2026-02-17T21:27:53.631 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.619+0000 7f3069d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:53.631 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.619+0000 7f3069d74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:27:53.631 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.619+0000 7f3069d74640 10 monclient: dump: 2026-02-17T21:27:53.631 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:53.631 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:53.631 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:53.631 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:53.631 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:53.631 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:53.631 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:53.631 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:53.631 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:53.632 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:53.632 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.619+0000 7f3069d74640 10 monclient: _finish_auth 0 2026-02-17T21:27:53.632 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.619+0000 7f3069d74640 10 monclient: _check_auth_tickets 2026-02-17T21:27:53.632 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.619+0000 7f3069d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:53.632 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.619+0000 7f3069d74640 1 -- 10.20.193.5:0/936229650 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f306002fa60 con 0x7f306c155d40 2026-02-17T21:27:53.632 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.619+0000 7f3069d74640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:53.632 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.619+0000 7f3069d74640 1 -- 10.20.193.5:0/936229650 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306002fe30 con 0x7f306c155d40 2026-02-17T21:27:53.632 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.619+0000 7f3071285640 5 monclient: authenticate success, global_id 4847 2026-02-17T21:27:53.632 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.619+0000 7f3069d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:53.632 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.619+0000 7f3069d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:27:53.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.619+0000 7f3069d74640 10 monclient: dump: 2026-02-17T21:27:53.633 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:53.633 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:53.633 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:53.633 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:53.633 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:53.633 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:53.633 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:53.633 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:53.633 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:53.633 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:53.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.619+0000 7f3071285640 10 monclient: get_monmap_and_config success 2026-02-17T21:27:53.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.619+0000 7f3071285640 4 set_mon_vals no callback set 2026-02-17T21:27:53.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.620+0000 7f3071285640 10 monclient: shutdown 2026-02-17T21:27:53.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.620+0000 7f3071285640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:53.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.620+0000 7f3071285640 1 -- 10.20.193.5:0/936229650 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f306c155d40 msgr2=0x7f306c156120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:53.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.620+0000 7f3071285640 1 --2- 10.20.193.5:0/936229650 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f306c155d40 0x7f306c156120 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f306c06f220 tx=0x7f306002ed50 comp rx=0 tx=0).stop 2026-02-17T21:27:53.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.620+0000 7f3071285640 1 -- 10.20.193.5:0/936229650 shutdown_connections 2026-02-17T21:27:53.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.620+0000 7f3071285640 1 --2- 10.20.193.5:0/936229650 >> v2:10.20.193.119:3300/0 conn(0x7f306c0ccc00 0x7f306c15d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:53.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.620+0000 7f3071285640 1 --2- 10.20.193.5:0/936229650 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f306c155d40 0x7f306c156120 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:53.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.620+0000 7f3071285640 1 -- 10.20.193.5:0/936229650 >> 10.20.193.5:0/936229650 conn(0x7f306c0cc0e0 msgr2=0x7f306c0cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:53.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.620+0000 7f3071285640 1 -- 10.20.193.5:0/936229650 shutdown_connections 2026-02-17T21:27:53.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.620+0000 7f3071285640 1 -- 10.20.193.5:0/936229650 wait complete. 2026-02-17T21:27:53.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.620+0000 7f3071285640 10 monclient: build_initial_monmap 2026-02-17T21:27:53.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.620+0000 7f3071285640 10 monclient: monmap: 2026-02-17T21:27:53.635 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:53.635 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:27:53.635 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:27:53.635 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:27:53.635 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:53.635 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:53.635 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:27:53.635 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:27:53.635 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:27:53.635 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:53.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.620+0000 7f3071285640 1 librados: starting msgr at 2026-02-17T21:27:53.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.620+0000 7f3071285640 1 librados: starting objecter 2026-02-17T21:27:53.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.620+0000 7f3071285640 1 Processor -- start 2026-02-17T21:27:53.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.620+0000 7f3071285640 1 -- start start 2026-02-17T21:27:53.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.620+0000 7f3071285640 1 librados: setting wanted keys 2026-02-17T21:27:53.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.620+0000 7f3071285640 1 librados: calling monclient init 2026-02-17T21:27:53.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.620+0000 7f3071285640 10 monclient: init 2026-02-17T21:27:53.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f3071285640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:53.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f3071285640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:27:53.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f3071285640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f306c0ccc00 0x7f306c15b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:53.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f3071285640 10 monclient(hunting): picked mon.noname-a con 0x7f306c0ccc00 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:27:53.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f3071285640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f306c155d40 0x7f306c0ce850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:53.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f3071285640 10 monclient(hunting): picked mon.noname-b con 0x7f306c155d40 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:27:53.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f3071285640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f306c15d7e0 0x7f306c1f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:53.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f3071285640 10 monclient(hunting): picked mon.noname-c con 0x7f306c15d7e0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:27:53.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f3071285640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:53.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f3071285640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f306c06d0a0 con 0x7f306c0ccc00 2026-02-17T21:27:53.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f3071285640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:53.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f3071285640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f306c06cdc0 con 0x7f306c155d40 2026-02-17T21:27:53.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f3071285640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:53.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f3071285640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f306c073080 con 0x7f306c15d7e0 2026-02-17T21:27:53.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f3071285640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:53.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f3071285640 10 monclient(hunting): authenticate will time out at 1179.186422s 2026-02-17T21:27:53.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f306ad76640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f306c0ccc00 0x7f306c15b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:53.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f306a575640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f306c155d40 0x7f306c0ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:53.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f306b577640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f306c15d7e0 0x7f306c1f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:53.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f306a575640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f306c155d40 0x7f306c0ce850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:44340/0 (socket says 10.20.193.5:44340) 2026-02-17T21:27:53.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f306a575640 1 -- 10.20.193.5:0/1151792741 learned_addr learned my addr 10.20.193.5:0/1151792741 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:27:53.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f306a575640 10 monclient(hunting): get_auth_request con 0x7f306c155d40 auth_method 0 2026-02-17T21:27:53.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f306a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:53.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f306a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:53.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f306a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:53.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f306ad76640 10 monclient(hunting): get_auth_request con 0x7f306c0ccc00 auth_method 0 2026-02-17T21:27:53.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f306ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:53.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f306ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:53.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f306ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:53.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f306b577640 10 monclient(hunting): get_auth_request con 0x7f306c15d7e0 auth_method 0 2026-02-17T21:27:53.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f306b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:53.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f306b577640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:53.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.621+0000 7f306b577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:53.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.622+0000 7f306a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:53.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.622+0000 7f306a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:53.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.622+0000 7f306a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:53.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.622+0000 7f306b577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:53.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.622+0000 7f306b577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:53.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.622+0000 7f306b577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:53.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.622+0000 7f306ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:53.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.622+0000 7f306ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:53.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.622+0000 7f306ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:53.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.623+0000 7f306b577640 10 monclient(hunting): handle_auth_done global_id 4850 payload 824 2026-02-17T21:27:53.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.623+0000 7f306b577640 1 -- 10.20.193.5:0/1151792741 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f306c155d40 msgr2=0x7f306c0ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:53.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.623+0000 7f306b577640 1 --2- 10.20.193.5:0/1151792741 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f306c155d40 0x7f306c0ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:53.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.623+0000 7f306b577640 1 -- 10.20.193.5:0/1151792741 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f306c0ccc00 msgr2=0x7f306c15b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:53.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.623+0000 7f306b577640 1 --2- 10.20.193.5:0/1151792741 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f306c0ccc00 0x7f306c15b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:53.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.623+0000 7f306b577640 10 monclient: _finish_hunting 0 2026-02-17T21:27:53.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.623+0000 7f306b577640 1 monclient: found mon.noname-c 2026-02-17T21:27:53.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.623+0000 7f306b577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:53.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.623+0000 7f306b577640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:27:53.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.623+0000 7f306b577640 1 -- 10.20.193.5:0/1151792741 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f306c1573f0 con 0x7f306c15d7e0 2026-02-17T21:27:53.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.624+0000 7f306b577640 1 --2- 10.20.193.5:0/1151792741 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f306c15d7e0 0x7f306c1f4ab0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f306c06eaf0 tx=0x7f305c00cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:53.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.624+0000 7f304b7fe640 10 client.?.objecter ms_handle_connect 0x7f306c15d7e0 2026-02-17T21:27:53.641 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.624+0000 7f304b7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:27:53.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f304b7fe640 1 -- 10.20.193.5:0/1151792741 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c00abe0 con 0x7f306c15d7e0 2026-02-17T21:27:53.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f304b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:53.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f304b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:27:53.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f304b7fe640 10 monclient: dump: 2026-02-17T21:27:53.644 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:53.644 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:53.644 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:53.644 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:53.644 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:53.644 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:53.644 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:53.644 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:53.644 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:53.644 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:53.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f304b7fe640 10 monclient: _finish_auth 0 2026-02-17T21:27:53.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f304b7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:27:53.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f304b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:53.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f304b7fe640 1 -- 10.20.193.5:0/1151792741 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f305c00ad80 con 0x7f306c15d7e0 2026-02-17T21:27:53.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f304b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:53.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f304b7fe640 1 -- 10.20.193.5:0/1151792741 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c012600 con 0x7f306c15d7e0 2026-02-17T21:27:53.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f3071285640 5 monclient: authenticate success, global_id 4850 2026-02-17T21:27:53.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f3071285640 10 monclient: _renew_subs 2026-02-17T21:27:53.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f3071285640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:27:53.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f3071285640 1 -- 10.20.193.5:0/1151792741 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f306c1576d0 con 0x7f306c15d7e0 2026-02-17T21:27:53.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f3069573640 4 set_mon_vals no callback set 2026-02-17T21:27:53.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f304b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:53.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f304b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:27:53.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f304b7fe640 10 monclient: dump: 2026-02-17T21:27:53.646 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:53.646 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:53.646 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:53.646 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:53.646 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:53.646 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:53.646 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:53.646 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:53.646 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:53.646 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:53.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f3071285640 10 client.4850.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:27:53.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f3071285640 10 monclient: _renew_subs 2026-02-17T21:27:53.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f3071285640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:27:53.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f3071285640 1 -- 10.20.193.5:0/1151792741 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f306c157c90 con 0x7f306c15d7e0 2026-02-17T21:27:53.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f3071285640 1 librados: init done 2026-02-17T21:27:53.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f3071285640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:53.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f3071285640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:53.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f3071285640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:27:53.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.626+0000 7f3071285640 1 -- 10.20.193.5:0/1151792741 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f306c06d880 con 0x7f306c15d7e0 2026-02-17T21:27:53.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.638+0000 7f304b7fe640 1 -- 10.20.193.5:0/1151792741 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f305c0127a0 con 0x7f306c15d7e0 2026-02-17T21:27:53.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.638+0000 7f304b7fe640 1 --2- 10.20.193.5:0/1151792741 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3038079280 0x7f303807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:53.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.638+0000 7f306ad76640 1 --2- 10.20.193.5:0/1151792741 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3038079280 0x7f303807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:53.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.638+0000 7f306ad76640 10 monclient: get_auth_request con 0x7f3038079280 auth_method 0 2026-02-17T21:27:53.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.639+0000 7f306ad76640 1 --2- 10.20.193.5:0/1151792741 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3038079280 0x7f303807b740 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3060039000 tx=0x7f3060033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:53.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.639+0000 7f304b7fe640 10 client.4850.objecter ms_handle_connect 0x7f3038079280 2026-02-17T21:27:53.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.640+0000 7f304b7fe640 1 -- 10.20.193.5:0/1151792741 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f305c05eb70 con 0x7f306c15d7e0 2026-02-17T21:27:53.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.640+0000 7f304b7fe640 10 client.4850.objecter ms_dispatch2 0x7f306c000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:27:53.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.640+0000 7f304b7fe640 3 client.4850.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:27:53.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.640+0000 7f304b7fe640 3 client.4850.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:27:53.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.640+0000 7f304b7fe640 20 client.4850.objecter dump_active .. 0 homeless 2026-02-17T21:27:53.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.741+0000 7f304b7fe640 1 -- 10.20.193.5:0/1151792741 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f305c062b30 con 0x7f306c15d7e0 2026-02-17T21:27:53.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.741+0000 7f304b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:53.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.741+0000 7f304b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:27:53.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.840+0000 7f3071285640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:27:53.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.840+0000 7f3071285640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:53.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.840+0000 7f3071285640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:27:53.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.840+0000 7f3071285640 1 -- 10.20.193.5:0/1151792741 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f306c0cc660 con 0x7f306c15d7e0 2026-02-17T21:27:53.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.842+0000 7f304b7fe640 1 -- 10.20.193.5:0/1151792741 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f305c066e30 con 0x7f306c15d7e0 2026-02-17T21:27:53.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.842+0000 7f304b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:53.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.842+0000 7f304b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:27:53.844 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:27:53.844 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:27:53.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.843+0000 7f3071285640 10 librados: watch_flush enter 2026-02-17T21:27:53.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.843+0000 7f3071285640 10 librados: watch_flush exit 2026-02-17T21:27:53.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.843+0000 7f3071285640 20 client.4850.objecter shutdown clearing up homeless session... 2026-02-17T21:27:53.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.843+0000 7f3071285640 10 client.4850.objecter successfully canceled tick 2026-02-17T21:27:53.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.843+0000 7f3071285640 1 -- 10.20.193.5:0/1151792741 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3038079280 msgr2=0x7f303807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:53.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.843+0000 7f3071285640 1 --2- 10.20.193.5:0/1151792741 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3038079280 0x7f303807b740 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3060039000 tx=0x7f3060033000 comp rx=0 tx=0).stop 2026-02-17T21:27:53.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.843+0000 7f3071285640 10 monclient: shutdown 2026-02-17T21:27:53.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.843+0000 7f3071285640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:53.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.843+0000 7f3071285640 1 -- 10.20.193.5:0/1151792741 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f306c15d7e0 msgr2=0x7f306c1f4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:53.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.843+0000 7f3071285640 1 --2- 10.20.193.5:0/1151792741 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f306c15d7e0 0x7f306c1f4ab0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f306c06eaf0 tx=0x7f305c00cef0 comp rx=0 tx=0).stop 2026-02-17T21:27:53.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.844+0000 7f3071285640 1 -- 10.20.193.5:0/1151792741 shutdown_connections 2026-02-17T21:27:53.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.844+0000 7f3071285640 1 --2- 10.20.193.5:0/1151792741 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3038079280 0x7f303807b740 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:53.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.844+0000 7f3071285640 1 --2- 10.20.193.5:0/1151792741 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f306c15d7e0 0x7f306c1f4ab0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:53.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.844+0000 7f3071285640 1 --2- 10.20.193.5:0/1151792741 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f306c155d40 0x7f306c0ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:53.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.844+0000 7f3071285640 1 --2- 10.20.193.5:0/1151792741 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f306c0ccc00 0x7f306c15b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:53.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.844+0000 7f3071285640 1 -- 10.20.193.5:0/1151792741 >> 10.20.193.5:0/1151792741 conn(0x7f306c0cc0e0 msgr2=0x7f306c0c8100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:53.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.844+0000 7f3071285640 1 -- 10.20.193.5:0/1151792741 shutdown_connections 2026-02-17T21:27:53.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.844+0000 7f3071285640 1 -- 10.20.193.5:0/1151792741 wait complete. 2026-02-17T21:27:53.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:53.844+0000 7f3071285640 1 librados: shutdown 2026-02-17T21:27:56.854 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:27:56.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.922+0000 7f7a7d66d640 10 monclient: get_monmap_and_config 2026-02-17T21:27:56.925 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.922+0000 7f7a7d66d640 10 monclient: build_initial_monmap 2026-02-17T21:27:56.925 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.922+0000 7f7a7d66d640 10 monclient: monmap: 2026-02-17T21:27:56.925 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:56.925 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:56.925 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:27:56.923524+0000 2026-02-17T21:27:56.925 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:27:56.923524+0000 2026-02-17T21:27:56.925 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:56.925 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:56.925 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:27:56.925 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:27:56.926 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:27:56.926 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:27:56.926 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:27:56.926 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:27:56.926 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:56.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.923+0000 7f7a7d66d640 1 Processor -- start 2026-02-17T21:27:56.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.923+0000 7f7a7d66d640 1 -- start start 2026-02-17T21:27:56.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.923+0000 7f7a7d66d640 10 monclient: init 2026-02-17T21:27:56.929 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.923+0000 7f7a7d66d640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:56.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.923+0000 7f7a7d66d640 10 monclient: _add_conns ranks=[0,5,1,2,4,3] 2026-02-17T21:27:56.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.923+0000 7f7a7d66d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7a780c7170 addr v1:10.20.193.5:6789/0 2026-02-17T21:27:56.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.923+0000 7f7a7d66d640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f7a780c7550 0x7f7a780749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:56.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.923+0000 7f7a7d66d640 10 monclient(hunting): picked mon.noname-c con 0x7f7a780c7550 addr v2:10.20.193.135:3300/0 2026-02-17T21:27:56.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.923+0000 7f7a7d66d640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f7a78074ef0 addr v1:10.20.193.119:6789/0 2026-02-17T21:27:56.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.923+0000 7f7a7d66d640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a780c4fd0 con 0x7f7a780c7170 2026-02-17T21:27:56.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.923+0000 7f7a7d66d640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a7815a9a0 con 0x7f7a78074ef0 2026-02-17T21:27:56.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.923+0000 7f7a7d66d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:56.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.923+0000 7f7a7d66d640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f7a780c8530 con 0x7f7a780c7550 2026-02-17T21:27:56.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.923+0000 7f7a7d66d640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:56.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.923+0000 7f7a7d66d640 10 monclient(hunting): authenticate will time out at 1182.488837s 2026-02-17T21:27:56.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.924+0000 7f7a76ffd640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f7a780c7170 0x7f7a780c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:45818/0 (socket says 10.20.193.5:45818) 2026-02-17T21:27:56.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.924+0000 7f7a76ffd640 1 -- 10.20.193.5:0/3195691267 learned_addr learned my addr 10.20.193.5:0/3195691267 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:27:56.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.924+0000 7f7a777fe640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f7a78074ef0 0x7f7a780c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:43992/0 (socket says 10.20.193.5:43992) 2026-02-17T21:27:56.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.924+0000 7f7a767fc640 1 --2- 10.20.193.5:0/3195691267 >> v2:10.20.193.135:3300/0 conn(0x7f7a780c7550 0x7f7a780749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:56.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.924+0000 7f7a767fc640 10 monclient(hunting): get_auth_request con 0x7f7a780c7550 auth_method 0 2026-02-17T21:27:56.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.924+0000 7f7a767fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:56.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.924+0000 7f7a767fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:56.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.924+0000 7f7a767fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:56.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.925+0000 7f7a767fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:56.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.925+0000 7f7a767fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:56.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.925+0000 7f7a767fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:56.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.925+0000 7f7a75ffb640 1 -- 10.20.193.5:0/3195691267 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2636304333 0 0) 0x7f7a780c4fd0 con 0x7f7a780c7170 2026-02-17T21:27:56.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.925+0000 7f7a75ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:27:56.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.925+0000 7f7a75ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:56.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.925+0000 7f7a75ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:56.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.925+0000 7f7a75ffb640 10 monclient(hunting): my global_id is 4839 2026-02-17T21:27:56.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.925+0000 7f7a75ffb640 1 -- 10.20.193.5:0/3195691267 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a64003620 con 0x7f7a780c7170 2026-02-17T21:27:56.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.926+0000 7f7a75ffb640 1 -- 10.20.193.5:0/3195691267 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1035947919 0 0) 0x7f7a7815a9a0 con 0x7f7a78074ef0 2026-02-17T21:27:56.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.926+0000 7f7a75ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:27:56.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.926+0000 7f7a75ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:56.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.926+0000 7f7a75ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:56.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.926+0000 7f7a75ffb640 10 monclient(hunting): my global_id is 4852 2026-02-17T21:27:56.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.926+0000 7f7a75ffb640 1 -- 10.20.193.5:0/3195691267 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a780c4fd0 con 0x7f7a78074ef0 2026-02-17T21:27:56.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.926+0000 7f7a767fc640 10 monclient(hunting): handle_auth_done global_id 4853 payload 274 2026-02-17T21:27:56.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.926+0000 7f7a767fc640 1 -- 10.20.193.5:0/3195691267 >> v1:10.20.193.119:6789/0 conn(0x7f7a78074ef0 legacy=0x7f7a780c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:56.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.926+0000 7f7a767fc640 1 -- 10.20.193.5:0/3195691267 >> v1:10.20.193.5:6789/0 conn(0x7f7a780c7170 legacy=0x7f7a780c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:56.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.926+0000 7f7a767fc640 10 monclient: _finish_hunting 0 2026-02-17T21:27:56.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.926+0000 7f7a767fc640 1 monclient: found mon.noname-c 2026-02-17T21:27:56.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.926+0000 7f7a767fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:56.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.926+0000 7f7a767fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:27:56.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.926+0000 7f7a767fc640 1 -- 10.20.193.5:0/3195691267 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a780c5270 con 0x7f7a780c7550 2026-02-17T21:27:56.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.928+0000 7f7a767fc640 1 --2- 10.20.193.5:0/3195691267 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7a780c7550 0x7f7a780749b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7a600098a0 tx=0x7f7a6002ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48e40844c226c2aa server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:56.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.930+0000 7f7a75ffb640 1 -- 10.20.193.5:0/3195691267 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6003c070 con 0x7f7a780c7550 2026-02-17T21:27:56.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.930+0000 7f7a75ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:56.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.930+0000 7f7a75ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:27:56.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.930+0000 7f7a75ffb640 10 monclient: dump: 2026-02-17T21:27:56.940 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:56.941 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:56.941 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:56.941 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:56.941 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:56.941 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:56.941 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:56.941 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:56.941 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:56.941 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:56.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.930+0000 7f7a75ffb640 10 monclient: _finish_auth 0 2026-02-17T21:27:56.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.930+0000 7f7a75ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:27:56.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.930+0000 7f7a75ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:56.942 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.930+0000 7f7a75ffb640 1 -- 10.20.193.5:0/3195691267 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a6002fb70 con 0x7f7a780c7550 2026-02-17T21:27:56.942 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.930+0000 7f7a75ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:56.942 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.930+0000 7f7a75ffb640 1 -- 10.20.193.5:0/3195691267 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a60037440 con 0x7f7a780c7550 2026-02-17T21:27:56.942 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.930+0000 7f7a75ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:56.942 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.930+0000 7f7a75ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:27:56.942 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.930+0000 7f7a75ffb640 10 monclient: dump: 2026-02-17T21:27:56.942 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:56.942 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:56.942 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:56.942 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:56.942 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:56.943 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:56.943 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:56.943 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:56.943 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:56.943 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:56.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.930+0000 7f7a7d66d640 5 monclient: authenticate success, global_id 4853 2026-02-17T21:27:56.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.930+0000 7f7a7d66d640 10 monclient: get_monmap_and_config success 2026-02-17T21:27:56.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.930+0000 7f7a7d66d640 4 set_mon_vals no callback set 2026-02-17T21:27:56.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.930+0000 7f7a7d66d640 10 monclient: shutdown 2026-02-17T21:27:56.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.930+0000 7f7a7d66d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:56.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.930+0000 7f7a7d66d640 1 -- 10.20.193.5:0/3195691267 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7a780c7550 msgr2=0x7f7a780749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:56.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.930+0000 7f7a7d66d640 1 --2- 10.20.193.5:0/3195691267 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7a780c7550 0x7f7a780749b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7a600098a0 tx=0x7f7a6002ee60 comp rx=0 tx=0).stop 2026-02-17T21:27:56.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.930+0000 7f7a7d66d640 1 -- 10.20.193.5:0/3195691267 shutdown_connections 2026-02-17T21:27:56.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.930+0000 7f7a7d66d640 1 --2- 10.20.193.5:0/3195691267 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7a780c7550 0x7f7a780749b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:56.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.930+0000 7f7a7d66d640 1 -- 10.20.193.5:0/3195691267 >> 10.20.193.5:0/3195691267 conn(0x7f7a780c9f40 msgr2=0x7f7a780ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:56.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.930+0000 7f7a7d66d640 1 -- 10.20.193.5:0/3195691267 shutdown_connections 2026-02-17T21:27:56.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.930+0000 7f7a7d66d640 1 -- 10.20.193.5:0/3195691267 wait complete. 2026-02-17T21:27:56.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.931+0000 7f7a7d66d640 10 monclient: build_initial_monmap 2026-02-17T21:27:56.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.931+0000 7f7a7d66d640 10 monclient: monmap: 2026-02-17T21:27:56.944 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:27:56.944 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:27:56.944 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:27:56.944 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:27:56.945 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:27:56.945 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:56.945 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:27:56.945 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:27:56.945 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:27:56.945 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:56.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.931+0000 7f7a7d66d640 1 librados: starting msgr at 2026-02-17T21:27:56.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.931+0000 7f7a7d66d640 1 librados: starting objecter 2026-02-17T21:27:56.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.931+0000 7f7a7d66d640 1 Processor -- start 2026-02-17T21:27:56.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.931+0000 7f7a7d66d640 1 -- start start 2026-02-17T21:27:56.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.931+0000 7f7a7d66d640 1 librados: setting wanted keys 2026-02-17T21:27:56.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.931+0000 7f7a7d66d640 1 librados: calling monclient init 2026-02-17T21:27:56.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.931+0000 7f7a7d66d640 10 monclient: init 2026-02-17T21:27:56.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.931+0000 7f7a7d66d640 10 monclient: _reopen_session rank -1 2026-02-17T21:27:56.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.931+0000 7f7a7d66d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:27:56.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.931+0000 7f7a7d66d640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7a78074ef0 0x7f7a780c10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:56.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.931+0000 7f7a7d66d640 10 monclient(hunting): picked mon.noname-a con 0x7f7a78074ef0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:27:56.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.931+0000 7f7a7d66d640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7a780c7170 0x7f7a780c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:56.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.931+0000 7f7a7d66d640 10 monclient(hunting): picked mon.noname-b con 0x7f7a780c7170 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:27:56.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.931+0000 7f7a7d66d640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7a780c7550 0x7f7a78074530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:56.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.931+0000 7f7a7d66d640 10 monclient(hunting): picked mon.noname-c con 0x7f7a780c7550 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:27:56.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.931+0000 7f7a7d66d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:56.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.931+0000 7f7a7d66d640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7a780c7ee0 con 0x7f7a78074ef0 2026-02-17T21:27:56.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.931+0000 7f7a7d66d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:56.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.931+0000 7f7a7d66d640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7a780c5830 con 0x7f7a780c7170 2026-02-17T21:27:56.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.931+0000 7f7a7d66d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:27:56.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.931+0000 7f7a7d66d640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7a780c81c0 con 0x7f7a780c7550 2026-02-17T21:27:56.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.931+0000 7f7a7d66d640 10 monclient(hunting): _renew_subs 2026-02-17T21:27:56.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.931+0000 7f7a7d66d640 10 monclient(hunting): authenticate will time out at 1182.496780s 2026-02-17T21:27:56.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a76ffd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7a78074ef0 0x7f7a780c10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:56.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a767fc640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7a780c7170 0x7f7a780c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:56.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a777fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7a780c7550 0x7f7a78074530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:56.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a767fc640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7a780c7170 0x7f7a780c2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:44350/0 (socket says 10.20.193.5:44350) 2026-02-17T21:27:56.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a767fc640 1 -- 10.20.193.5:0/2369338304 learned_addr learned my addr 10.20.193.5:0/2369338304 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:27:56.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a767fc640 10 monclient(hunting): get_auth_request con 0x7f7a780c7170 auth_method 0 2026-02-17T21:27:56.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a767fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:56.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a767fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:56.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a767fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:56.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a76ffd640 10 monclient(hunting): get_auth_request con 0x7f7a78074ef0 auth_method 0 2026-02-17T21:27:56.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a76ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:56.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a76ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:56.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a76ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:56.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a777fe640 10 monclient(hunting): get_auth_request con 0x7f7a780c7550 auth_method 0 2026-02-17T21:27:56.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a777fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:27:56.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a777fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:27:56.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:27:56.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a767fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:56.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a767fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:56.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a767fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:56.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a76ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:56.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a76ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:56.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a76ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:56.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a777fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:27:56.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a777fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:27:56.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.932+0000 7f7a777fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:27:56.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.933+0000 7f7a76ffd640 10 monclient(hunting): handle_auth_done global_id 4842 payload 824 2026-02-17T21:27:56.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.933+0000 7f7a76ffd640 1 -- 10.20.193.5:0/2369338304 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7a780c7550 msgr2=0x7f7a78074530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:56.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.933+0000 7f7a76ffd640 1 --2- 10.20.193.5:0/2369338304 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7a780c7550 0x7f7a78074530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:56.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.933+0000 7f7a76ffd640 1 -- 10.20.193.5:0/2369338304 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7a780c7170 msgr2=0x7f7a780c2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:56.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.933+0000 7f7a76ffd640 1 --2- 10.20.193.5:0/2369338304 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7a780c7170 0x7f7a780c2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:56.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.933+0000 7f7a76ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:27:56.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.933+0000 7f7a76ffd640 1 monclient: found mon.noname-a 2026-02-17T21:27:56.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.933+0000 7f7a76ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:27:56.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.933+0000 7f7a76ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:27:56.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.933+0000 7f7a76ffd640 1 -- 10.20.193.5:0/2369338304 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a780c3e20 con 0x7f7a78074ef0 2026-02-17T21:27:56.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.933+0000 7f7a767fc640 1 --2- 10.20.193.5:0/2369338304 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7a780c7170 0x7f7a780c2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T21:27:56.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.935+0000 7f7a76ffd640 1 --2- 10.20.193.5:0/2369338304 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7a78074ef0 0x7f7a780c10d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00c4f0 tx=0x7f7a6c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:56.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.935+0000 7f7a577fe640 10 client.?.objecter ms_handle_connect 0x7f7a78074ef0 2026-02-17T21:27:56.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.935+0000 7f7a577fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:27:56.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a577fe640 1 -- 10.20.193.5:0/2369338304 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c017070 con 0x7f7a78074ef0 2026-02-17T21:27:56.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:56.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a577fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:27:56.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a577fe640 10 monclient: dump: 2026-02-17T21:27:56.951 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:56.951 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:56.951 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:56.951 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:56.951 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:56.951 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:56.951 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:56.951 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:56.951 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:56.952 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:56.952 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a577fe640 10 monclient: _finish_auth 0 2026-02-17T21:27:56.952 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a577fe640 10 monclient: _check_auth_tickets 2026-02-17T21:27:56.952 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:27:56.952 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a577fe640 1 -- 10.20.193.5:0/2369338304 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a6c005e00 con 0x7f7a78074ef0 2026-02-17T21:27:56.952 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a7d66d640 5 monclient: authenticate success, global_id 4842 2026-02-17T21:27:56.952 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a7d66d640 10 monclient: _renew_subs 2026-02-17T21:27:56.952 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a7d66d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:27:56.952 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a7d66d640 1 -- 10.20.193.5:0/2369338304 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a780c2ff0 con 0x7f7a78074ef0 2026-02-17T21:27:56.952 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a577fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:27:56.952 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a577fe640 1 -- 10.20.193.5:0/2369338304 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c0072b0 con 0x7f7a78074ef0 2026-02-17T21:27:56.952 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:27:56.953 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a577fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:27:56.953 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a577fe640 10 monclient: dump: 2026-02-17T21:27:56.953 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:27:56.953 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:27:56.953 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:56.953 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:27:56.953 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:27:56.953 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:27:56.953 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:27:56.953 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:27:56.953 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:27:56.954 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:27:56.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a757fa640 4 set_mon_vals no callback set 2026-02-17T21:27:56.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a7d66d640 10 client.4842.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:27:56.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a7d66d640 10 monclient: _renew_subs 2026-02-17T21:27:56.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a7d66d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:27:56.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a7d66d640 1 -- 10.20.193.5:0/2369338304 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a780c3580 con 0x7f7a78074ef0 2026-02-17T21:27:56.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a7d66d640 1 librados: init done 2026-02-17T21:27:56.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a7d66d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:56.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a7d66d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:56.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a7d66d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:27:56.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.937+0000 7f7a7d66d640 1 -- 10.20.193.5:0/2369338304 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a7815a9a0 con 0x7f7a78074ef0 2026-02-17T21:27:56.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.949+0000 7f7a577fe640 1 -- 10.20.193.5:0/2369338304 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f7a6c007510 con 0x7f7a78074ef0 2026-02-17T21:27:56.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.949+0000 7f7a577fe640 1 --2- 10.20.193.5:0/2369338304 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7a440792d0 0x7f7a4407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:27:56.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.949+0000 7f7a767fc640 1 --2- 10.20.193.5:0/2369338304 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7a440792d0 0x7f7a4407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:27:56.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.950+0000 7f7a767fc640 10 monclient: get_auth_request con 0x7f7a440792d0 auth_method 0 2026-02-17T21:27:56.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.950+0000 7f7a767fc640 1 --2- 10.20.193.5:0/2369338304 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7a440792d0 0x7f7a4407b790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7a600098a0 tx=0x7f7a60033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:27:56.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.950+0000 7f7a577fe640 10 client.4842.objecter ms_handle_connect 0x7f7a440792d0 2026-02-17T21:27:56.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.951+0000 7f7a577fe640 1 -- 10.20.193.5:0/2369338304 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f7a6c05d860 con 0x7f7a78074ef0 2026-02-17T21:27:56.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.951+0000 7f7a577fe640 10 client.4842.objecter ms_dispatch2 0x7f7a78000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:27:56.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.951+0000 7f7a577fe640 3 client.4842.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:27:56.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.951+0000 7f7a577fe640 3 client.4842.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:27:56.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:56.951+0000 7f7a577fe640 20 client.4842.objecter dump_active .. 0 homeless 2026-02-17T21:27:57.054 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.052+0000 7f7a577fe640 1 -- 10.20.193.5:0/2369338304 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7a6c021020 con 0x7f7a78074ef0 2026-02-17T21:27:57.054 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.052+0000 7f7a577fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:27:57.054 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.052+0000 7f7a577fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:27:57.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.153+0000 7f7a7d66d640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:27:57.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.153+0000 7f7a7d66d640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:57.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.153+0000 7f7a7d66d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:27:57.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.153+0000 7f7a7d66d640 1 -- 10.20.193.5:0/2369338304 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7a781574f0 con 0x7f7a78074ef0 2026-02-17T21:27:57.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.177+0000 7f7a577fe640 1 -- 10.20.193.5:0/2369338304 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f7a6c061820 con 0x7f7a78074ef0 2026-02-17T21:27:57.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.178+0000 7f7a577fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:27:57.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.178+0000 7f7a577fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:27:57.180 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:27:57.180 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:27:57.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.179+0000 7f7a7d66d640 10 librados: watch_flush enter 2026-02-17T21:27:57.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.179+0000 7f7a7d66d640 10 librados: watch_flush exit 2026-02-17T21:27:57.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.179+0000 7f7a7d66d640 20 client.4842.objecter shutdown clearing up homeless session... 2026-02-17T21:27:57.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.179+0000 7f7a7d66d640 10 client.4842.objecter successfully canceled tick 2026-02-17T21:27:57.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.179+0000 7f7a7d66d640 1 -- 10.20.193.5:0/2369338304 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7a440792d0 msgr2=0x7f7a4407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:57.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.179+0000 7f7a7d66d640 1 --2- 10.20.193.5:0/2369338304 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7a440792d0 0x7f7a4407b790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7a600098a0 tx=0x7f7a60033000 comp rx=0 tx=0).stop 2026-02-17T21:27:57.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.179+0000 7f7a7d66d640 10 monclient: shutdown 2026-02-17T21:27:57.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.179+0000 7f7a7d66d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:27:57.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.179+0000 7f7a7d66d640 1 -- 10.20.193.5:0/2369338304 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7a78074ef0 msgr2=0x7f7a780c10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:27:57.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.179+0000 7f7a7d66d640 1 --2- 10.20.193.5:0/2369338304 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7a78074ef0 0x7f7a780c10d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00c4f0 tx=0x7f7a6c00c9c0 comp rx=0 tx=0).stop 2026-02-17T21:27:57.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.179+0000 7f7a7d66d640 1 -- 10.20.193.5:0/2369338304 shutdown_connections 2026-02-17T21:27:57.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.179+0000 7f7a7d66d640 1 --2- 10.20.193.5:0/2369338304 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7a440792d0 0x7f7a4407b790 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:57.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.179+0000 7f7a7d66d640 1 --2- 10.20.193.5:0/2369338304 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7a780c7550 0x7f7a78074530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:57.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.179+0000 7f7a7d66d640 1 --2- 10.20.193.5:0/2369338304 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7a780c7170 0x7f7a780c2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:57.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.179+0000 7f7a7d66d640 1 --2- 10.20.193.5:0/2369338304 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7a78074ef0 0x7f7a780c10d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:27:57.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.179+0000 7f7a7d66d640 1 -- 10.20.193.5:0/2369338304 >> 10.20.193.5:0/2369338304 conn(0x7f7a780c9f40 msgr2=0x7f7a7814d540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:27:57.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.179+0000 7f7a7d66d640 1 -- 10.20.193.5:0/2369338304 shutdown_connections 2026-02-17T21:27:57.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.179+0000 7f7a7d66d640 1 -- 10.20.193.5:0/2369338304 wait complete. 2026-02-17T21:27:57.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:27:57.179+0000 7f7a7d66d640 1 librados: shutdown 2026-02-17T21:27:57.529 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:04:37.154 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:27:57.531 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:04:37.156 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:27:57.542 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:04:37.167 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:27:57.558 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:04:37.144 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:27:57.559 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:04:37.183 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:27:57.560 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:04:37.146 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:27:57.561 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:04:37.185 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:27:57.571 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:04:37.157 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:27:57.572 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:04:37.195 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:00.191 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:28:00.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.259+0000 7fed0c986640 10 monclient: get_monmap_and_config 2026-02-17T21:28:00.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.259+0000 7fed0c986640 10 monclient: build_initial_monmap 2026-02-17T21:28:00.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.259+0000 7fed0c986640 10 monclient: monmap: 2026-02-17T21:28:00.261 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:00.261 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:00.261 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:28:00.260394+0000 2026-02-17T21:28:00.261 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:28:00.260394+0000 2026-02-17T21:28:00.261 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:00.262 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:00.262 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:28:00.262 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:28:00.262 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:28:00.262 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:28:00.262 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:28:00.262 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:28:00.262 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:00.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.260+0000 7fed0c986640 1 Processor -- start 2026-02-17T21:28:00.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.260+0000 7fed0c986640 1 -- start start 2026-02-17T21:28:00.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.260+0000 7fed0c986640 10 monclient: init 2026-02-17T21:28:00.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.260+0000 7fed0c986640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:00.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.260+0000 7fed0c986640 10 monclient: _add_conns ranks=[3,4,1,2,0,5] 2026-02-17T21:28:00.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.260+0000 7fed0c986640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fed040c7170 0x7fed040c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:00.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.260+0000 7fed0c986640 10 monclient(hunting): picked mon.noname-a con 0x7fed040c7170 addr v2:10.20.193.5:3300/0 2026-02-17T21:28:00.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.260+0000 7fed0c986640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fed040c48c0 0x7fed040749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:00.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.260+0000 7fed0c986640 10 monclient(hunting): picked mon.noname-b con 0x7fed040c48c0 addr v2:10.20.193.119:3300/0 2026-02-17T21:28:00.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.260+0000 7fed0c986640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fed04074ef0 addr v1:10.20.193.119:6789/0 2026-02-17T21:28:00.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.260+0000 7fed0c986640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed0415a9a0 con 0x7fed04074ef0 2026-02-17T21:28:00.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.260+0000 7fed0c986640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:00.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.260+0000 7fed0c986640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fed040c8530 con 0x7fed040c7170 2026-02-17T21:28:00.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.260+0000 7fed0c986640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:00.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.260+0000 7fed0c986640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fed040c5270 con 0x7fed040c48c0 2026-02-17T21:28:00.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.260+0000 7fed0c986640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:00.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.260+0000 7fed0c986640 10 monclient(hunting): authenticate will time out at 1185.825841s 2026-02-17T21:28:00.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.261+0000 7fed0a6fb640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fed040c7170 0x7fed040c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:00.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.261+0000 7fed09efa640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fed040c48c0 0x7fed040749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:00.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.261+0000 7fed0a6fb640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fed040c7170 0x7fed040c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:42322/0 (socket says 10.20.193.5:42322) 2026-02-17T21:28:00.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.261+0000 7fed0a6fb640 1 -- 10.20.193.5:0/1491405747 learned_addr learned my addr 10.20.193.5:0/1491405747 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:28:00.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.261+0000 7fed0a6fb640 10 monclient(hunting): get_auth_request con 0x7fed040c7170 auth_method 0 2026-02-17T21:28:00.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.261+0000 7fed0a6fb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:00.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.261+0000 7fed0a6fb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:00.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.261+0000 7fed0a6fb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:00.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.261+0000 7fed09efa640 10 monclient(hunting): get_auth_request con 0x7fed040c48c0 auth_method 0 2026-02-17T21:28:00.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.261+0000 7fed09efa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:00.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.261+0000 7fed09efa640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:00.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.261+0000 7fed09efa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:00.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.261+0000 7fed0a6fb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:00.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.261+0000 7fed0a6fb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:00.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.261+0000 7fed0a6fb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:00.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.262+0000 7fed09efa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:00.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.262+0000 7fed09efa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:00.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.262+0000 7fed09efa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:00.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.262+0000 7fed0a6fb640 10 monclient(hunting): handle_auth_done global_id 4845 payload 274 2026-02-17T21:28:00.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.262+0000 7fed0a6fb640 1 -- 10.20.193.5:0/1491405747 >> v2:10.20.193.119:3300/0 conn(0x7fed040c48c0 msgr2=0x7fed040749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:28:00.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.262+0000 7fed0a6fb640 1 --2- 10.20.193.5:0/1491405747 >> v2:10.20.193.119:3300/0 conn(0x7fed040c48c0 0x7fed040749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:00.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.262+0000 7fed0a6fb640 1 -- 10.20.193.5:0/1491405747 >> v1:10.20.193.119:6789/0 conn(0x7fed04074ef0 legacy=0x7fed040c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:00.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.262+0000 7fed0a6fb640 10 monclient: _finish_hunting 0 2026-02-17T21:28:00.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.262+0000 7fed0a6fb640 1 monclient: found mon.noname-a 2026-02-17T21:28:00.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.262+0000 7fed0a6fb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:00.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.262+0000 7fed0a6fb640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:28:00.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.262+0000 7fed0a6fb640 1 -- 10.20.193.5:0/1491405747 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed040c5550 con 0x7fed040c7170 2026-02-17T21:28:00.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.263+0000 7fed0a6fb640 1 --2- 10.20.193.5:0/1491405747 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fed040c7170 0x7fed040c7550 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fed040c7a90 tx=0x7fecfc02eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd43de75b080dba server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:00.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed096f9640 1 -- 10.20.193.5:0/1491405747 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecfc03c070 con 0x7fed040c7170 2026-02-17T21:28:00.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed096f9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:00.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed096f9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:28:00.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed096f9640 10 monclient: dump: 2026-02-17T21:28:00.276 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:00.276 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:00.276 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:00.276 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:00.276 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:00.276 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:00.277 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:00.277 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:00.277 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:00.277 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:00.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed096f9640 10 monclient: _finish_auth 0 2026-02-17T21:28:00.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed096f9640 10 monclient: _check_auth_tickets 2026-02-17T21:28:00.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed096f9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:00.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed096f9640 1 -- 10.20.193.5:0/1491405747 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecfc02fbe0 con 0x7fed040c7170 2026-02-17T21:28:00.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed096f9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:00.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed096f9640 1 -- 10.20.193.5:0/1491405747 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecfc037440 con 0x7fed040c7170 2026-02-17T21:28:00.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed096f9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:00.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed096f9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:28:00.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed096f9640 10 monclient: dump: 2026-02-17T21:28:00.278 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:00.278 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:00.278 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:00.278 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:00.278 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:00.278 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:00.278 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:00.278 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:00.278 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:00.278 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:00.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed0c986640 5 monclient: authenticate success, global_id 4845 2026-02-17T21:28:00.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed0c986640 10 monclient: get_monmap_and_config success 2026-02-17T21:28:00.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed0c986640 4 set_mon_vals no callback set 2026-02-17T21:28:00.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed0c986640 10 monclient: shutdown 2026-02-17T21:28:00.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed0c986640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:00.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed0c986640 1 -- 10.20.193.5:0/1491405747 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fed040c7170 msgr2=0x7fed040c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:00.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed0c986640 1 --2- 10.20.193.5:0/1491405747 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fed040c7170 0x7fed040c7550 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fed040c7a90 tx=0x7fecfc02eed0 comp rx=0 tx=0).stop 2026-02-17T21:28:00.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed0c986640 1 -- 10.20.193.5:0/1491405747 shutdown_connections 2026-02-17T21:28:00.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed0c986640 1 --2- 10.20.193.5:0/1491405747 >> v2:10.20.193.119:3300/0 conn(0x7fed040c48c0 0x7fed040749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:00.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed0c986640 1 --2- 10.20.193.5:0/1491405747 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fed040c7170 0x7fed040c7550 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:00.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed0c986640 1 -- 10.20.193.5:0/1491405747 >> 10.20.193.5:0/1491405747 conn(0x7fed040c9f40 msgr2=0x7fed040ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:00.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed0c986640 1 -- 10.20.193.5:0/1491405747 shutdown_connections 2026-02-17T21:28:00.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.265+0000 7fed0c986640 1 -- 10.20.193.5:0/1491405747 wait complete. 2026-02-17T21:28:00.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.266+0000 7fed0c986640 10 monclient: build_initial_monmap 2026-02-17T21:28:00.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.266+0000 7fed0c986640 10 monclient: monmap: 2026-02-17T21:28:00.280 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:00.280 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:28:00.280 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:28:00.280 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:28:00.280 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:00.280 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:00.280 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:28:00.280 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:28:00.280 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:28:00.281 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:00.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.266+0000 7fed0c986640 1 librados: starting msgr at 2026-02-17T21:28:00.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.266+0000 7fed0c986640 1 librados: starting objecter 2026-02-17T21:28:00.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.266+0000 7fed0c986640 1 Processor -- start 2026-02-17T21:28:00.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.266+0000 7fed0c986640 1 -- start start 2026-02-17T21:28:00.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.266+0000 7fed0c986640 1 librados: setting wanted keys 2026-02-17T21:28:00.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.266+0000 7fed0c986640 1 librados: calling monclient init 2026-02-17T21:28:00.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.266+0000 7fed0c986640 10 monclient: init 2026-02-17T21:28:00.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0c986640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:00.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0c986640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:28:00.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0c986640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fed04074ef0 0x7fed040c28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:00.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0c986640 10 monclient(hunting): picked mon.noname-a con 0x7fed04074ef0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:28:00.281 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0c986640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fed040c48c0 0x7fed040c2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:00.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0c986640 10 monclient(hunting): picked mon.noname-c con 0x7fed040c48c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:28:00.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0c986640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fed040c7170 0x7fed0406e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:00.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0c986640 10 monclient(hunting): picked mon.noname-b con 0x7fed040c7170 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:28:00.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0c986640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:00.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0c986640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fed040c81c0 con 0x7fed04074ef0 2026-02-17T21:28:00.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0c986640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:00.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0c986640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fed040c7ee0 con 0x7fed040c7170 2026-02-17T21:28:00.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0c986640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:00.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0c986640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fed040c90d0 con 0x7fed040c48c0 2026-02-17T21:28:00.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0c986640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:00.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0c986640 10 monclient(hunting): authenticate will time out at 1185.832259s 2026-02-17T21:28:00.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0a6fb640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fed04074ef0 0x7fed040c28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:00.282 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0aefc640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fed040c7170 0x7fed0406e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:00.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0a6fb640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fed04074ef0 0x7fed040c28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:42336/0 (socket says 10.20.193.5:42336) 2026-02-17T21:28:00.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0a6fb640 1 -- 10.20.193.5:0/2641091115 learned_addr learned my addr 10.20.193.5:0/2641091115 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:28:00.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0a6fb640 10 monclient(hunting): get_auth_request con 0x7fed04074ef0 auth_method 0 2026-02-17T21:28:00.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0a6fb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:00.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0a6fb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:00.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0a6fb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:00.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0aefc640 10 monclient(hunting): get_auth_request con 0x7fed040c7170 auth_method 0 2026-02-17T21:28:00.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0aefc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:00.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0aefc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:00.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0aefc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:00.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed09efa640 1 --2- 10.20.193.5:0/2641091115 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fed040c48c0 0x7fed040c2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:00.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0a6fb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:00.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0a6fb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:00.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0a6fb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:00.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0aefc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:00.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0aefc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:00.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.267+0000 7fed0aefc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:00.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.268+0000 7fed09efa640 10 monclient(hunting): get_auth_request con 0x7fed040c48c0 auth_method 0 2026-02-17T21:28:00.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.268+0000 7fed09efa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:00.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.268+0000 7fed09efa640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:00.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.268+0000 7fed09efa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:00.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.268+0000 7fed09efa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:00.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.268+0000 7fed09efa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:00.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.268+0000 7fed09efa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:00.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.269+0000 7fed0a6fb640 10 monclient(hunting): handle_auth_done global_id 4848 payload 824 2026-02-17T21:28:00.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.269+0000 7fed0a6fb640 1 -- 10.20.193.5:0/2641091115 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fed040c48c0 msgr2=0x7fed040c2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:00.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.269+0000 7fed0a6fb640 1 --2- 10.20.193.5:0/2641091115 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fed040c48c0 0x7fed040c2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:00.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.269+0000 7fed0a6fb640 1 -- 10.20.193.5:0/2641091115 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fed040c7170 msgr2=0x7fed0406e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:00.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.269+0000 7fed0a6fb640 1 --2- 10.20.193.5:0/2641091115 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fed040c7170 0x7fed0406e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:00.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.269+0000 7fed0a6fb640 10 monclient: _finish_hunting 0 2026-02-17T21:28:00.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.269+0000 7fed0a6fb640 1 monclient: found mon.noname-a 2026-02-17T21:28:00.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.269+0000 7fed0a6fb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:00.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.269+0000 7fed0a6fb640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:28:00.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.269+0000 7fed0a6fb640 1 -- 10.20.193.5:0/2641091115 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed040c0ce0 con 0x7fed04074ef0 2026-02-17T21:28:00.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.270+0000 7fed0a6fb640 1 --2- 10.20.193.5:0/2641091115 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fed04074ef0 0x7fed040c28f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009a70 tx=0x7fecfc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:00.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.270+0000 7feceeffd640 10 client.?.objecter ms_handle_connect 0x7fed04074ef0 2026-02-17T21:28:00.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.270+0000 7feceeffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:28:00.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7feceeffd640 1 -- 10.20.193.5:0/2641091115 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecfc03c040 con 0x7fed04074ef0 2026-02-17T21:28:00.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7feceeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:00.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7feceeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:28:00.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7feceeffd640 10 monclient: dump: 2026-02-17T21:28:00.286 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:00.286 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:00.286 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:00.286 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:00.286 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:00.286 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:00.286 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:00.287 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:00.287 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:00.287 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:00.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7feceeffd640 10 monclient: _finish_auth 0 2026-02-17T21:28:00.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7feceeffd640 10 monclient: _check_auth_tickets 2026-02-17T21:28:00.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7feceeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:00.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7feceeffd640 1 -- 10.20.193.5:0/2641091115 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecfc042630 con 0x7fed04074ef0 2026-02-17T21:28:00.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7fed0c986640 5 monclient: authenticate success, global_id 4848 2026-02-17T21:28:00.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7fed0c986640 10 monclient: _renew_subs 2026-02-17T21:28:00.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7fed0c986640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:00.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7fed0c986640 1 -- 10.20.193.5:0/2641091115 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed040c0fc0 con 0x7fed04074ef0 2026-02-17T21:28:00.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7feceeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:00.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7feceeffd640 1 -- 10.20.193.5:0/2641091115 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecfc042a20 con 0x7fed04074ef0 2026-02-17T21:28:00.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7feceeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:00.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7feceeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:28:00.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7feceeffd640 10 monclient: dump: 2026-02-17T21:28:00.288 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:00.288 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:00.288 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:00.288 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:00.288 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:00.288 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:00.288 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:00.288 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:00.289 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:00.289 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:00.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7fed08ef8640 4 set_mon_vals no callback set 2026-02-17T21:28:00.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7fed0c986640 10 client.4848.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:28:00.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7fed0c986640 10 monclient: _renew_subs 2026-02-17T21:28:00.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7fed0c986640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:00.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7fed0c986640 1 -- 10.20.193.5:0/2641091115 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed040c1580 con 0x7fed04074ef0 2026-02-17T21:28:00.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7fed0c986640 1 librados: init done 2026-02-17T21:28:00.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7fed0c986640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:00.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7fed0c986640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:00.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7fed0c986640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:00.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.272+0000 7fed0c986640 1 -- 10.20.193.5:0/2641091115 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed040c4d10 con 0x7fed04074ef0 2026-02-17T21:28:00.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.284+0000 7feceeffd640 1 -- 10.20.193.5:0/2641091115 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fecfc042bc0 con 0x7fed04074ef0 2026-02-17T21:28:00.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.284+0000 7feceeffd640 1 --2- 10.20.193.5:0/2641091115 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fecd4079280 0x7fecd407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:00.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.284+0000 7fed09efa640 1 --2- 10.20.193.5:0/2641091115 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fecd4079280 0x7fecd407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:00.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.284+0000 7fed09efa640 10 monclient: get_auth_request con 0x7fecd4079280 auth_method 0 2026-02-17T21:28:00.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.285+0000 7feceeffd640 10 client.4848.objecter ms_handle_connect 0x7fecd4079280 2026-02-17T21:28:00.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.285+0000 7fed09efa640 1 --2- 10.20.193.5:0/2641091115 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fecd4079280 0x7fecd407b740 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fed0414c970 tx=0x7fecf0009290 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:00.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.287+0000 7feceeffd640 1 -- 10.20.193.5:0/2641091115 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fecfc02faa0 con 0x7fed04074ef0 2026-02-17T21:28:00.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.287+0000 7feceeffd640 10 client.4848.objecter ms_dispatch2 0x7fed04000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:28:00.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.287+0000 7feceeffd640 3 client.4848.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:28:00.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.287+0000 7feceeffd640 3 client.4848.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:28:00.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.287+0000 7feceeffd640 20 client.4848.objecter dump_active .. 0 homeless 2026-02-17T21:28:00.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.386+0000 7feceeffd640 1 -- 10.20.193.5:0/2641091115 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fecfc0879e0 con 0x7fed04074ef0 2026-02-17T21:28:00.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.386+0000 7feceeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:00.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.386+0000 7feceeffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:28:00.491 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.489+0000 7fed0c986640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:28:00.491 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.489+0000 7fed0c986640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:00.491 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.489+0000 7fed0c986640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:00.491 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.489+0000 7fed0c986640 1 -- 10.20.193.5:0/2641091115 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fed04074cd0 con 0x7fed04074ef0 2026-02-17T21:28:00.494 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.492+0000 7feceeffd640 1 -- 10.20.193.5:0/2641091115 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fecfc08bce0 con 0x7fed04074ef0 2026-02-17T21:28:00.494 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.492+0000 7feceeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:00.494 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.492+0000 7feceeffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:28:00.494 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:28:00.494 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:28:00.496 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.493+0000 7fed0c986640 10 librados: watch_flush enter 2026-02-17T21:28:00.496 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.493+0000 7fed0c986640 10 librados: watch_flush exit 2026-02-17T21:28:00.496 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.493+0000 7fed0c986640 20 client.4848.objecter shutdown clearing up homeless session... 2026-02-17T21:28:00.496 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.493+0000 7fed0c986640 10 client.4848.objecter successfully canceled tick 2026-02-17T21:28:00.496 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.493+0000 7fed0c986640 1 -- 10.20.193.5:0/2641091115 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fecd4079280 msgr2=0x7fecd407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:00.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.493+0000 7fed0c986640 1 --2- 10.20.193.5:0/2641091115 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fecd4079280 0x7fecd407b740 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fed0414c970 tx=0x7fecf0009290 comp rx=0 tx=0).stop 2026-02-17T21:28:00.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.493+0000 7fed0c986640 10 monclient: shutdown 2026-02-17T21:28:00.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.493+0000 7fed0c986640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:00.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.493+0000 7fed0c986640 1 -- 10.20.193.5:0/2641091115 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fed04074ef0 msgr2=0x7fed040c28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:00.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.493+0000 7fed0c986640 1 --2- 10.20.193.5:0/2641091115 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fed04074ef0 0x7fed040c28f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009a70 tx=0x7fecfc0047c0 comp rx=0 tx=0).stop 2026-02-17T21:28:00.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.493+0000 7fed0c986640 1 -- 10.20.193.5:0/2641091115 shutdown_connections 2026-02-17T21:28:00.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.493+0000 7fed0c986640 1 --2- 10.20.193.5:0/2641091115 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fecd4079280 0x7fecd407b740 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:00.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.493+0000 7fed0c986640 1 --2- 10.20.193.5:0/2641091115 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fed040c7170 0x7fed0406e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:00.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.493+0000 7fed0c986640 1 --2- 10.20.193.5:0/2641091115 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fed040c48c0 0x7fed040c2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:00.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.493+0000 7fed0c986640 1 --2- 10.20.193.5:0/2641091115 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fed04074ef0 0x7fed040c28f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:00.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.493+0000 7fed0c986640 1 -- 10.20.193.5:0/2641091115 >> 10.20.193.5:0/2641091115 conn(0x7fed040c9f40 msgr2=0x7fed040738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:00.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.494+0000 7fed0c986640 1 -- 10.20.193.5:0/2641091115 shutdown_connections 2026-02-17T21:28:00.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.494+0000 7fed0c986640 1 -- 10.20.193.5:0/2641091115 wait complete. 2026-02-17T21:28:00.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:00.494+0000 7fed0c986640 1 librados: shutdown 2026-02-17T21:28:03.505 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:28:03.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.572+0000 7fe34f8f5640 10 monclient: get_monmap_and_config 2026-02-17T21:28:03.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.572+0000 7fe34f8f5640 10 monclient: build_initial_monmap 2026-02-17T21:28:03.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.572+0000 7fe34f8f5640 10 monclient: monmap: 2026-02-17T21:28:03.574 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:03.574 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:03.574 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:28:03.572792+0000 2026-02-17T21:28:03.574 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:28:03.572792+0000 2026-02-17T21:28:03.575 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:03.575 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:03.575 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:28:03.575 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:28:03.575 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:28:03.575 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:28:03.575 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:28:03.575 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:28:03.575 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:03.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.572+0000 7fe34f8f5640 1 Processor -- start 2026-02-17T21:28:03.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.572+0000 7fe34f8f5640 1 -- start start 2026-02-17T21:28:03.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.572+0000 7fe34f8f5640 10 monclient: init 2026-02-17T21:28:03.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34f8f5640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:03.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34f8f5640 10 monclient: _add_conns ranks=[5,1,3,0,4,2] 2026-02-17T21:28:03.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34f8f5640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fe34815f690 0x7fe34815fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:03.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34f8f5640 10 monclient(hunting): picked mon.noname-c con 0x7fe34815f690 addr v2:10.20.193.135:3300/0 2026-02-17T21:28:03.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34f8f5640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fe3480c9050 addr v1:10.20.193.119:6789/0 2026-02-17T21:28:03.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34f8f5640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fe348072de0 0x7fe34815d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:03.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34f8f5640 10 monclient(hunting): picked mon.noname-a con 0x7fe348072de0 addr v2:10.20.193.5:3300/0 2026-02-17T21:28:03.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34f8f5640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3480732e0 con 0x7fe3480c9050 2026-02-17T21:28:03.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34f8f5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:03.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34f8f5640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe3480735c0 con 0x7fe348072de0 2026-02-17T21:28:03.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34f8f5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:03.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34f8f5640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe3480738a0 con 0x7fe34815f690 2026-02-17T21:28:03.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34f8f5640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:03.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34f8f5640 10 monclient(hunting): authenticate will time out at 1189.138123s 2026-02-17T21:28:03.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34de6b640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fe348072de0 0x7fe34815d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:03.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34ce69640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7fe3480c9050 0x7fe3480726d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:36978/0 (socket says 10.20.193.5:36978) 2026-02-17T21:28:03.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34ce69640 1 -- 10.20.193.5:0/3248379535 learned_addr learned my addr 10.20.193.5:0/3248379535 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:28:03.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34d66a640 1 --2- 10.20.193.5:0/3248379535 >> v2:10.20.193.135:3300/0 conn(0x7fe34815f690 0x7fe34815fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:03.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34de6b640 10 monclient(hunting): get_auth_request con 0x7fe348072de0 auth_method 0 2026-02-17T21:28:03.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34de6b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:03.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34de6b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:03.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34de6b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:03.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34d66a640 10 monclient(hunting): get_auth_request con 0x7fe34815f690 auth_method 0 2026-02-17T21:28:03.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34d66a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:03.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34d66a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:03.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34d66a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:03.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34de6b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:03.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34de6b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:03.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.573+0000 7fe34de6b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:03.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.574+0000 7fe34d66a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:03.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.574+0000 7fe34d66a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:03.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.574+0000 7fe34d66a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:03.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.574+0000 7fe34de6b640 10 monclient(hunting): handle_auth_done global_id 4851 payload 274 2026-02-17T21:28:03.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.574+0000 7fe34de6b640 1 -- 10.20.193.5:0/3248379535 >> v2:10.20.193.135:3300/0 conn(0x7fe34815f690 msgr2=0x7fe34815fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:28:03.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.574+0000 7fe34de6b640 1 --2- 10.20.193.5:0/3248379535 >> v2:10.20.193.135:3300/0 conn(0x7fe34815f690 0x7fe34815fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:03.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.574+0000 7fe34de6b640 1 -- 10.20.193.5:0/3248379535 >> v1:10.20.193.119:6789/0 conn(0x7fe3480c9050 legacy=0x7fe3480726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:03.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.574+0000 7fe34de6b640 10 monclient: _finish_hunting 0 2026-02-17T21:28:03.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.574+0000 7fe34de6b640 1 monclient: found mon.noname-a 2026-02-17T21:28:03.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.574+0000 7fe34de6b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:03.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.574+0000 7fe34de6b640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:28:03.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.574+0000 7fe34de6b640 1 -- 10.20.193.5:0/3248379535 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe348073b80 con 0x7fe348072de0 2026-02-17T21:28:03.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.575+0000 7fe34de6b640 1 --2- 10.20.193.5:0/3248379535 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe348072de0 0x7fe34815d420 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe348072680 tx=0x7fe34402f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4289e681cd2fcb server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:03.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe337fff640 1 -- 10.20.193.5:0/3248379535 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34403c070 con 0x7fe348072de0 2026-02-17T21:28:03.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe337fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:03.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe337fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:28:03.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe337fff640 10 monclient: dump: 2026-02-17T21:28:03.588 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:03.588 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:03.588 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:03.588 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:03.589 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:03.589 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:03.589 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:03.589 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:03.589 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:03.589 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:03.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe337fff640 10 monclient: _finish_auth 0 2026-02-17T21:28:03.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe337fff640 10 monclient: _check_auth_tickets 2026-02-17T21:28:03.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe337fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:03.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe34f8f5640 5 monclient: authenticate success, global_id 4851 2026-02-17T21:28:03.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe337fff640 1 -- 10.20.193.5:0/3248379535 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe34402fe40 con 0x7fe348072de0 2026-02-17T21:28:03.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe34f8f5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:28:03.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe337fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:03.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe337fff640 1 -- 10.20.193.5:0/3248379535 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344037660 con 0x7fe348072de0 2026-02-17T21:28:03.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe34f8f5640 10 monclient: get_monmap_and_config success 2026-02-17T21:28:03.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe34f8f5640 4 set_mon_vals no callback set 2026-02-17T21:28:03.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe337fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:03.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe337fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:28:03.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe337fff640 10 monclient: dump: 2026-02-17T21:28:03.590 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:03.590 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:03.591 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:03.591 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:03.591 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:03.591 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:03.591 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:03.591 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:03.591 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:03.591 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:03.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe34f8f5640 10 monclient: shutdown 2026-02-17T21:28:03.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe34f8f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:03.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe34f8f5640 1 -- 10.20.193.5:0/3248379535 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe348072de0 msgr2=0x7fe34815d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:03.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe34f8f5640 1 --2- 10.20.193.5:0/3248379535 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe348072de0 0x7fe34815d420 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe348072680 tx=0x7fe34402f130 comp rx=0 tx=0).stop 2026-02-17T21:28:03.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe34f8f5640 1 -- 10.20.193.5:0/3248379535 shutdown_connections 2026-02-17T21:28:03.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe34f8f5640 1 --2- 10.20.193.5:0/3248379535 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe348072de0 0x7fe34815d420 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:03.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe34f8f5640 1 --2- 10.20.193.5:0/3248379535 >> v2:10.20.193.135:3300/0 conn(0x7fe34815f690 0x7fe34815fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:03.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe34f8f5640 1 -- 10.20.193.5:0/3248379535 >> 10.20.193.5:0/3248379535 conn(0x7fe3480c9f20 msgr2=0x7fe3480ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:03.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe34f8f5640 1 -- 10.20.193.5:0/3248379535 shutdown_connections 2026-02-17T21:28:03.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.577+0000 7fe34f8f5640 1 -- 10.20.193.5:0/3248379535 wait complete. 2026-02-17T21:28:03.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.578+0000 7fe34f8f5640 10 monclient: build_initial_monmap 2026-02-17T21:28:03.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.578+0000 7fe34f8f5640 10 monclient: monmap: 2026-02-17T21:28:03.592 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:03.592 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:28:03.592 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:28:03.593 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:28:03.593 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:03.593 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:03.593 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:28:03.593 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:28:03.593 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:28:03.593 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:03.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.578+0000 7fe34f8f5640 1 librados: starting msgr at 2026-02-17T21:28:03.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.578+0000 7fe34f8f5640 1 librados: starting objecter 2026-02-17T21:28:03.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.578+0000 7fe34f8f5640 1 Processor -- start 2026-02-17T21:28:03.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.578+0000 7fe34f8f5640 1 -- start start 2026-02-17T21:28:03.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.578+0000 7fe34f8f5640 1 librados: setting wanted keys 2026-02-17T21:28:03.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.578+0000 7fe34f8f5640 1 librados: calling monclient init 2026-02-17T21:28:03.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.578+0000 7fe34f8f5640 10 monclient: init 2026-02-17T21:28:03.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.578+0000 7fe34f8f5640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:03.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.578+0000 7fe34f8f5640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:28:03.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.578+0000 7fe34f8f5640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe348072de0 0x7fe348156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:03.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34f8f5640 10 monclient(hunting): picked mon.noname-a con 0x7fe348072de0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:28:03.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34f8f5640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe3480c9050 0x7fe34814b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:03.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34f8f5640 10 monclient(hunting): picked mon.noname-c con 0x7fe3480c9050 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:28:03.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34f8f5640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe34815f690 0x7fe348158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:03.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34f8f5640 10 monclient(hunting): picked mon.noname-b con 0x7fe34815f690 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:28:03.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34f8f5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:03.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34f8f5640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe3480c9640 con 0x7fe348072de0 2026-02-17T21:28:03.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34f8f5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:03.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34f8f5640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe3480c94c0 con 0x7fe34815f690 2026-02-17T21:28:03.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34f8f5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:03.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34f8f5640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe3480c97c0 con 0x7fe3480c9050 2026-02-17T21:28:03.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34f8f5640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:03.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34f8f5640 10 monclient(hunting): authenticate will time out at 1189.144039s 2026-02-17T21:28:03.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34d66a640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe348072de0 0x7fe348156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:03.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34de6b640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe34815f690 0x7fe348158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:03.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34ce69640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe3480c9050 0x7fe34814b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:03.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34d66a640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe348072de0 0x7fe348156900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:42350/0 (socket says 10.20.193.5:42350) 2026-02-17T21:28:03.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34d66a640 1 -- 10.20.193.5:0/1860128786 learned_addr learned my addr 10.20.193.5:0/1860128786 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:28:03.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34d66a640 10 monclient(hunting): get_auth_request con 0x7fe348072de0 auth_method 0 2026-02-17T21:28:03.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34d66a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:03.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34d66a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:03.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34d66a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:03.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34de6b640 10 monclient(hunting): get_auth_request con 0x7fe34815f690 auth_method 0 2026-02-17T21:28:03.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34de6b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:03.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34de6b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:03.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34de6b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:03.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34ce69640 10 monclient(hunting): get_auth_request con 0x7fe3480c9050 auth_method 0 2026-02-17T21:28:03.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34ce69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:03.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34ce69640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:03.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34ce69640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:03.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34d66a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:03.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34d66a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:03.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34d66a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:03.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34de6b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:03.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34de6b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:03.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.579+0000 7fe34de6b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:03.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.580+0000 7fe34ce69640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:03.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.580+0000 7fe34ce69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:03.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.580+0000 7fe34ce69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:03.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.580+0000 7fe34d66a640 10 monclient(hunting): handle_auth_done global_id 4854 payload 824 2026-02-17T21:28:03.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.580+0000 7fe34d66a640 1 -- 10.20.193.5:0/1860128786 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe3480c9050 msgr2=0x7fe34814b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:03.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.580+0000 7fe34d66a640 1 --2- 10.20.193.5:0/1860128786 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe3480c9050 0x7fe34814b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:03.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.580+0000 7fe34d66a640 1 -- 10.20.193.5:0/1860128786 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe34815f690 msgr2=0x7fe348158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:03.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.581+0000 7fe34d66a640 1 --2- 10.20.193.5:0/1860128786 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe34815f690 0x7fe348158590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:03.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.581+0000 7fe34d66a640 10 monclient: _finish_hunting 0 2026-02-17T21:28:03.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.581+0000 7fe34d66a640 1 monclient: found mon.noname-a 2026-02-17T21:28:03.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.581+0000 7fe34d66a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:03.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.581+0000 7fe34d66a640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:28:03.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.581+0000 7fe34d66a640 1 -- 10.20.193.5:0/1860128786 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3481f77f0 con 0x7fe348072de0 2026-02-17T21:28:03.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.581+0000 7fe34d66a640 1 --2- 10.20.193.5:0/1860128786 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe348072de0 0x7fe348156900 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe33800ec10 tx=0x7fe33800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:03.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.581+0000 7fe335ffb640 10 client.?.objecter ms_handle_connect 0x7fe348072de0 2026-02-17T21:28:03.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.581+0000 7fe335ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:28:03.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.583+0000 7fe335ffb640 1 -- 10.20.193.5:0/1860128786 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe338017070 con 0x7fe348072de0 2026-02-17T21:28:03.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.583+0000 7fe335ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:03.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.583+0000 7fe335ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:28:03.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.583+0000 7fe335ffb640 10 monclient: dump: 2026-02-17T21:28:03.601 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:03.602 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:03.602 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:03.602 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:03.602 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:03.602 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:03.602 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:03.602 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:03.602 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:03.602 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:03.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.583+0000 7fe335ffb640 10 monclient: _finish_auth 0 2026-02-17T21:28:03.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.583+0000 7fe335ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:28:03.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.583+0000 7fe335ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:03.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.583+0000 7fe335ffb640 1 -- 10.20.193.5:0/1860128786 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe33800cc40 con 0x7fe348072de0 2026-02-17T21:28:03.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.583+0000 7fe335ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:03.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.583+0000 7fe335ffb640 1 -- 10.20.193.5:0/1860128786 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe338013470 con 0x7fe348072de0 2026-02-17T21:28:03.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.583+0000 7fe335ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:03.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.583+0000 7fe3377fe640 4 set_mon_vals no callback set 2026-02-17T21:28:03.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.583+0000 7fe335ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:28:03.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.583+0000 7fe335ffb640 10 monclient: dump: 2026-02-17T21:28:03.603 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:03.603 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:03.603 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:03.604 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:03.604 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:03.604 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:03.604 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:03.604 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:03.604 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:03.604 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:03.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.583+0000 7fe34f8f5640 5 monclient: authenticate success, global_id 4854 2026-02-17T21:28:03.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.583+0000 7fe34f8f5640 10 monclient: _renew_subs 2026-02-17T21:28:03.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.583+0000 7fe34f8f5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:03.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.583+0000 7fe34f8f5640 1 -- 10.20.193.5:0/1860128786 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3481f3810 con 0x7fe348072de0 2026-02-17T21:28:03.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.583+0000 7fe34f8f5640 10 client.4854.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:28:03.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.583+0000 7fe34f8f5640 10 monclient: _renew_subs 2026-02-17T21:28:03.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.583+0000 7fe34f8f5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:03.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.583+0000 7fe34f8f5640 1 -- 10.20.193.5:0/1860128786 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3481f3dd0 con 0x7fe348072de0 2026-02-17T21:28:03.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.583+0000 7fe34f8f5640 1 librados: init done 2026-02-17T21:28:03.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.584+0000 7fe34f8f5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:03.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.584+0000 7fe34f8f5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:03.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.584+0000 7fe34f8f5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:03.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.584+0000 7fe34f8f5640 1 -- 10.20.193.5:0/1860128786 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe34815fa70 con 0x7fe348072de0 2026-02-17T21:28:03.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.595+0000 7fe335ffb640 1 -- 10.20.193.5:0/1860128786 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fe338013630 con 0x7fe348072de0 2026-02-17T21:28:03.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.596+0000 7fe335ffb640 1 --2- 10.20.193.5:0/1860128786 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe3180792d0 0x7fe31807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:03.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.596+0000 7fe34ce69640 1 --2- 10.20.193.5:0/1860128786 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe3180792d0 0x7fe31807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:03.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.596+0000 7fe34ce69640 10 monclient: get_auth_request con 0x7fe3180792d0 auth_method 0 2026-02-17T21:28:03.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.597+0000 7fe335ffb640 10 client.4854.objecter ms_handle_connect 0x7fe3180792d0 2026-02-17T21:28:03.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.597+0000 7fe34ce69640 1 --2- 10.20.193.5:0/1860128786 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe3180792d0 0x7fe31807b790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe34806f7f0 tx=0x7fe33c009040 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:03.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.597+0000 7fe335ffb640 1 -- 10.20.193.5:0/1860128786 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fe33805e8b0 con 0x7fe348072de0 2026-02-17T21:28:03.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.597+0000 7fe335ffb640 10 client.4854.objecter ms_dispatch2 0x7fe348000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:28:03.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.597+0000 7fe335ffb640 3 client.4854.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:28:03.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.597+0000 7fe335ffb640 3 client.4854.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:28:03.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.597+0000 7fe335ffb640 20 client.4854.objecter dump_active .. 0 homeless 2026-02-17T21:28:03.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.697+0000 7fe335ffb640 1 -- 10.20.193.5:0/1860128786 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe338062870 con 0x7fe348072de0 2026-02-17T21:28:03.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.697+0000 7fe335ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:03.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.697+0000 7fe335ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:28:03.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.797+0000 7fe34f8f5640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:28:03.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.797+0000 7fe34f8f5640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:03.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.797+0000 7fe34f8f5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:03.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.797+0000 7fe34f8f5640 1 -- 10.20.193.5:0/1860128786 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe348159850 con 0x7fe348072de0 2026-02-17T21:28:03.802 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.800+0000 7fe335ffb640 1 -- 10.20.193.5:0/1860128786 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fe338066b70 con 0x7fe348072de0 2026-02-17T21:28:03.802 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.800+0000 7fe335ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:03.802 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.800+0000 7fe335ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:28:03.802 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:28:03.802 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:28:03.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.801+0000 7fe34f8f5640 10 librados: watch_flush enter 2026-02-17T21:28:03.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.801+0000 7fe34f8f5640 10 librados: watch_flush exit 2026-02-17T21:28:03.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.801+0000 7fe34f8f5640 20 client.4854.objecter shutdown clearing up homeless session... 2026-02-17T21:28:03.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.801+0000 7fe34f8f5640 10 client.4854.objecter successfully canceled tick 2026-02-17T21:28:03.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.801+0000 7fe34f8f5640 1 -- 10.20.193.5:0/1860128786 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe3180792d0 msgr2=0x7fe31807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:03.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.801+0000 7fe34f8f5640 1 --2- 10.20.193.5:0/1860128786 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe3180792d0 0x7fe31807b790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe34806f7f0 tx=0x7fe33c009040 comp rx=0 tx=0).stop 2026-02-17T21:28:03.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.801+0000 7fe34f8f5640 10 monclient: shutdown 2026-02-17T21:28:03.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.801+0000 7fe34f8f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:03.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.801+0000 7fe34f8f5640 1 -- 10.20.193.5:0/1860128786 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe348072de0 msgr2=0x7fe348156900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:03.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.801+0000 7fe34f8f5640 1 --2- 10.20.193.5:0/1860128786 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe348072de0 0x7fe348156900 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe33800ec10 tx=0x7fe33800c520 comp rx=0 tx=0).stop 2026-02-17T21:28:03.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.801+0000 7fe34f8f5640 1 -- 10.20.193.5:0/1860128786 shutdown_connections 2026-02-17T21:28:03.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.801+0000 7fe34f8f5640 1 --2- 10.20.193.5:0/1860128786 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe3180792d0 0x7fe31807b790 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:03.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.801+0000 7fe34f8f5640 1 --2- 10.20.193.5:0/1860128786 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe34815f690 0x7fe348158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:03.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.801+0000 7fe34f8f5640 1 --2- 10.20.193.5:0/1860128786 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe3480c9050 0x7fe34814b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:03.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.801+0000 7fe34f8f5640 1 --2- 10.20.193.5:0/1860128786 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe348072de0 0x7fe348156900 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:03.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.801+0000 7fe34f8f5640 1 -- 10.20.193.5:0/1860128786 >> 10.20.193.5:0/1860128786 conn(0x7fe3480c9f20 msgr2=0x7fe3480c7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:03.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.802+0000 7fe34f8f5640 1 -- 10.20.193.5:0/1860128786 shutdown_connections 2026-02-17T21:28:03.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.802+0000 7fe34f8f5640 1 -- 10.20.193.5:0/1860128786 wait complete. 2026-02-17T21:28:03.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:03.802+0000 7fe34f8f5640 1 librados: shutdown 2026-02-17T21:28:06.813 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:28:06.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.883+0000 7f9390ada640 10 monclient: get_monmap_and_config 2026-02-17T21:28:06.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.883+0000 7f9390ada640 10 monclient: build_initial_monmap 2026-02-17T21:28:06.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.883+0000 7f9390ada640 10 monclient: monmap: 2026-02-17T21:28:06.886 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:06.886 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:06.886 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:28:06.884636+0000 2026-02-17T21:28:06.886 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:28:06.884636+0000 2026-02-17T21:28:06.886 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:06.886 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:06.886 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:28:06.886 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:28:06.887 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:28:06.887 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:28:06.887 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:28:06.887 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:28:06.887 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:06.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.884+0000 7f9390ada640 1 Processor -- start 2026-02-17T21:28:06.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.884+0000 7f9390ada640 1 -- start start 2026-02-17T21:28:06.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.884+0000 7f9390ada640 10 monclient: init 2026-02-17T21:28:06.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.884+0000 7f9390ada640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:06.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.884+0000 7f9390ada640 10 monclient: _add_conns ranks=[4,5,0,3,1,2] 2026-02-17T21:28:06.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.884+0000 7f9390ada640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f938c0c7170 0x7f938c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:06.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.884+0000 7f9390ada640 10 monclient(hunting): picked mon.noname-b con 0x7f938c0c7170 addr v2:10.20.193.119:3300/0 2026-02-17T21:28:06.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.884+0000 7f9390ada640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f938c0c48c0 0x7f938c0749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:06.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.884+0000 7f9390ada640 10 monclient(hunting): picked mon.noname-c con 0x7f938c0c48c0 addr v2:10.20.193.135:3300/0 2026-02-17T21:28:06.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.884+0000 7f9390ada640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f938c074ef0 addr v1:10.20.193.5:6789/0 2026-02-17T21:28:06.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.884+0000 7f9390ada640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f938c15a9a0 con 0x7f938c074ef0 2026-02-17T21:28:06.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.884+0000 7f9390ada640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:06.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.884+0000 7f9390ada640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f938c0c8530 con 0x7f938c0c7170 2026-02-17T21:28:06.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.884+0000 7f9390ada640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:06.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.884+0000 7f9390ada640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f938c0c5270 con 0x7f938c0c48c0 2026-02-17T21:28:06.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.884+0000 7f9390ada640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:06.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.884+0000 7f9390ada640 10 monclient(hunting): authenticate will time out at 1192.449923s 2026-02-17T21:28:06.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.885+0000 7f938ad76640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f938c074ef0 0x7f938c0c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:56090/0 (socket says 10.20.193.5:56090) 2026-02-17T21:28:06.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.885+0000 7f938ad76640 1 -- 10.20.193.5:0/3787929229 learned_addr learned my addr 10.20.193.5:0/3787929229 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:28:06.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.885+0000 7f9389d74640 1 --2- 10.20.193.5:0/3787929229 >> v2:10.20.193.135:3300/0 conn(0x7f938c0c48c0 0x7f938c0749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:06.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.885+0000 7f938a575640 1 --2- 10.20.193.5:0/3787929229 >> v2:10.20.193.119:3300/0 conn(0x7f938c0c7170 0x7f938c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:06.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.885+0000 7f938a575640 10 monclient(hunting): get_auth_request con 0x7f938c0c7170 auth_method 0 2026-02-17T21:28:06.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.885+0000 7f938a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:06.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.885+0000 7f938a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:06.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.885+0000 7f938a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:06.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.885+0000 7f9389d74640 10 monclient(hunting): get_auth_request con 0x7f938c0c48c0 auth_method 0 2026-02-17T21:28:06.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.885+0000 7f9389d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:06.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.885+0000 7f9389d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:06.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.885+0000 7f9389d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:06.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.885+0000 7f938a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:06.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.885+0000 7f938a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:06.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.885+0000 7f938a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:06.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.885+0000 7f9389d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:06.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.885+0000 7f9389d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:06.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.885+0000 7f9389d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:06.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.886+0000 7f9389573640 1 -- 10.20.193.5:0/3787929229 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2550421145 0 0) 0x7f938c15a9a0 con 0x7f938c074ef0 2026-02-17T21:28:06.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.886+0000 7f9389573640 10 monclient(hunting): _negotiate 2026-02-17T21:28:06.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.886+0000 7f9389573640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:06.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.886+0000 7f9389573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:06.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.886+0000 7f9389573640 10 monclient(hunting): my global_id is 4857 2026-02-17T21:28:06.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.886+0000 7f9389573640 1 -- 10.20.193.5:0/3787929229 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9378003620 con 0x7f938c074ef0 2026-02-17T21:28:06.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.886+0000 7f9389d74640 10 monclient(hunting): handle_auth_done global_id 4868 payload 274 2026-02-17T21:28:06.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.886+0000 7f9389d74640 1 -- 10.20.193.5:0/3787929229 >> v2:10.20.193.119:3300/0 conn(0x7f938c0c7170 msgr2=0x7f938c0c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:28:06.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.886+0000 7f9389d74640 1 --2- 10.20.193.5:0/3787929229 >> v2:10.20.193.119:3300/0 conn(0x7f938c0c7170 0x7f938c0c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:06.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.886+0000 7f9389d74640 1 -- 10.20.193.5:0/3787929229 >> v1:10.20.193.5:6789/0 conn(0x7f938c074ef0 legacy=0x7f938c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:06.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.886+0000 7f9389d74640 10 monclient: _finish_hunting 0 2026-02-17T21:28:06.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.886+0000 7f9389d74640 1 monclient: found mon.noname-c 2026-02-17T21:28:06.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.886+0000 7f9389d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:06.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.886+0000 7f9389d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:28:06.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.886+0000 7f9389d74640 1 -- 10.20.193.5:0/3787929229 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f938c0c5550 con 0x7f938c0c48c0 2026-02-17T21:28:06.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.887+0000 7f9389d74640 1 --2- 10.20.193.5:0/3787929229 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f938c0c48c0 0x7f938c0749b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f938c0c7a90 tx=0x7f937402ede0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4953b13505e0aa22 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:06.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.889+0000 7f9389573640 1 -- 10.20.193.5:0/3787929229 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937403c070 con 0x7f938c0c48c0 2026-02-17T21:28:06.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.889+0000 7f9389573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:06.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.889+0000 7f9389573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:28:06.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.889+0000 7f9389573640 10 monclient: dump: 2026-02-17T21:28:06.901 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:06.901 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:06.901 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:06.901 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:06.901 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:06.901 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:06.901 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:06.901 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:06.901 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:06.901 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:06.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.889+0000 7f9389573640 10 monclient: _finish_auth 0 2026-02-17T21:28:06.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.889+0000 7f9389573640 10 monclient: _check_auth_tickets 2026-02-17T21:28:06.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.889+0000 7f9389573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:06.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.889+0000 7f9389573640 1 -- 10.20.193.5:0/3787929229 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f937402faf0 con 0x7f938c0c48c0 2026-02-17T21:28:06.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.889+0000 7f9390ada640 5 monclient: authenticate success, global_id 4868 2026-02-17T21:28:06.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.889+0000 7f9389573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:06.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.889+0000 7f9390ada640 10 monclient: get_monmap_and_config success 2026-02-17T21:28:06.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.889+0000 7f9389573640 1 -- 10.20.193.5:0/3787929229 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9374037440 con 0x7f938c0c48c0 2026-02-17T21:28:06.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.889+0000 7f9389573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:06.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.889+0000 7f9390ada640 4 set_mon_vals no callback set 2026-02-17T21:28:06.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.889+0000 7f9389573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:28:06.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.889+0000 7f9389573640 10 monclient: dump: 2026-02-17T21:28:06.903 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:06.903 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:06.903 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:06.903 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:06.903 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:06.903 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:06.903 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:06.903 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:06.903 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:06.903 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:06.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.889+0000 7f9390ada640 10 monclient: shutdown 2026-02-17T21:28:06.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.889+0000 7f9390ada640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:06.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.889+0000 7f9390ada640 1 -- 10.20.193.5:0/3787929229 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f938c0c48c0 msgr2=0x7f938c0749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:06.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.889+0000 7f9390ada640 1 --2- 10.20.193.5:0/3787929229 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f938c0c48c0 0x7f938c0749b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f938c0c7a90 tx=0x7f937402ede0 comp rx=0 tx=0).stop 2026-02-17T21:28:06.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.890+0000 7f9390ada640 1 -- 10.20.193.5:0/3787929229 shutdown_connections 2026-02-17T21:28:06.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.890+0000 7f9390ada640 1 --2- 10.20.193.5:0/3787929229 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f938c0c48c0 0x7f938c0749b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:06.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.890+0000 7f9390ada640 1 --2- 10.20.193.5:0/3787929229 >> v2:10.20.193.119:3300/0 conn(0x7f938c0c7170 0x7f938c0c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:06.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.890+0000 7f9390ada640 1 -- 10.20.193.5:0/3787929229 >> 10.20.193.5:0/3787929229 conn(0x7f938c0c9f40 msgr2=0x7f938c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:06.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.890+0000 7f9390ada640 1 -- 10.20.193.5:0/3787929229 shutdown_connections 2026-02-17T21:28:06.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.890+0000 7f9390ada640 1 -- 10.20.193.5:0/3787929229 wait complete. 2026-02-17T21:28:06.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.890+0000 7f9390ada640 10 monclient: build_initial_monmap 2026-02-17T21:28:06.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.890+0000 7f9390ada640 10 monclient: monmap: 2026-02-17T21:28:06.904 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:06.905 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:28:06.905 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:28:06.905 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:28:06.905 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:06.905 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:06.905 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:28:06.905 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:28:06.905 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:28:06.905 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:06.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.890+0000 7f9390ada640 1 librados: starting msgr at 2026-02-17T21:28:06.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.890+0000 7f9390ada640 1 librados: starting objecter 2026-02-17T21:28:06.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.890+0000 7f9390ada640 1 Processor -- start 2026-02-17T21:28:06.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.890+0000 7f9390ada640 1 -- start start 2026-02-17T21:28:06.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.890+0000 7f9390ada640 1 librados: setting wanted keys 2026-02-17T21:28:06.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.890+0000 7f9390ada640 1 librados: calling monclient init 2026-02-17T21:28:06.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.890+0000 7f9390ada640 10 monclient: init 2026-02-17T21:28:06.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f9390ada640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:06.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f9390ada640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:28:06.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f9390ada640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f938c074ef0 0x7f938c1f23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:06.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f9390ada640 10 monclient(hunting): picked mon.noname-b con 0x7f938c074ef0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:28:06.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f9390ada640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f938c0c48c0 0x7f938c0c3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:06.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f9390ada640 10 monclient(hunting): picked mon.noname-a con 0x7f938c0c48c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:28:06.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f9390ada640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f938c0c7170 0x7f938c1f4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:06.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f9390ada640 10 monclient(hunting): picked mon.noname-c con 0x7f938c0c7170 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:28:06.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f9390ada640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:06.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f9390ada640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f938c0c81c0 con 0x7f938c0c48c0 2026-02-17T21:28:06.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f9390ada640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:06.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f9390ada640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f938c0c7ee0 con 0x7f938c074ef0 2026-02-17T21:28:06.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f9390ada640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:06.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f9390ada640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f938c0c90d0 con 0x7f938c0c7170 2026-02-17T21:28:06.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f9390ada640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:06.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f9390ada640 10 monclient(hunting): authenticate will time out at 1192.456418s 2026-02-17T21:28:06.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f9389d74640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f938c0c48c0 0x7f938c0c3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:06.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f938ad76640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f938c0c7170 0x7f938c1f4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:06.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f938a575640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f938c074ef0 0x7f938c1f23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:06.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f9389d74640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f938c0c48c0 0x7f938c0c3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:42366/0 (socket says 10.20.193.5:42366) 2026-02-17T21:28:06.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f9389d74640 1 -- 10.20.193.5:0/994853875 learned_addr learned my addr 10.20.193.5:0/994853875 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:28:06.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f9389d74640 10 monclient(hunting): get_auth_request con 0x7f938c0c48c0 auth_method 0 2026-02-17T21:28:06.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f9389d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:06.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f9389d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:06.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f9389d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:06.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f938ad76640 10 monclient(hunting): get_auth_request con 0x7f938c0c7170 auth_method 0 2026-02-17T21:28:06.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f938ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:06.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f938ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:06.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f938ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:06.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f938a575640 10 monclient(hunting): get_auth_request con 0x7f938c074ef0 auth_method 0 2026-02-17T21:28:06.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f938a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:06.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f938a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:06.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.891+0000 7f938a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:06.909 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.892+0000 7f9389d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:06.909 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.892+0000 7f9389d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:06.909 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.892+0000 7f9389d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:06.909 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.892+0000 7f938ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:06.909 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.892+0000 7f938ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:06.909 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.892+0000 7f938ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:06.909 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.892+0000 7f938a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:06.909 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.892+0000 7f938a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:06.909 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.892+0000 7f938a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:06.909 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.893+0000 7f938ad76640 10 monclient(hunting): handle_auth_done global_id 4871 payload 824 2026-02-17T21:28:06.909 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.893+0000 7f938ad76640 1 -- 10.20.193.5:0/994853875 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f938c074ef0 msgr2=0x7f938c1f23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:06.909 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.893+0000 7f938ad76640 1 --2- 10.20.193.5:0/994853875 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f938c074ef0 0x7f938c1f23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:06.909 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.893+0000 7f938ad76640 1 -- 10.20.193.5:0/994853875 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f938c0c48c0 msgr2=0x7f938c0c3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:06.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.893+0000 7f938ad76640 1 --2- 10.20.193.5:0/994853875 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f938c0c48c0 0x7f938c0c3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:06.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.893+0000 7f938ad76640 10 monclient: _finish_hunting 0 2026-02-17T21:28:06.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.893+0000 7f938ad76640 1 monclient: found mon.noname-c 2026-02-17T21:28:06.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.893+0000 7f938ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:06.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.893+0000 7f938ad76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:28:06.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.893+0000 7f938ad76640 1 -- 10.20.193.5:0/994853875 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f938c0c1e00 con 0x7f938c0c7170 2026-02-17T21:28:06.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.894+0000 7f938ad76640 1 --2- 10.20.193.5:0/994853875 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f938c0c7170 0x7f938c1f4730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f937c00ca80 tx=0x7f937c00cf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:06.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.894+0000 7f9372ffd640 10 client.?.objecter ms_handle_connect 0x7f938c0c7170 2026-02-17T21:28:06.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.894+0000 7f9372ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:28:06.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.895+0000 7f9372ffd640 1 -- 10.20.193.5:0/994853875 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937c00ac40 con 0x7f938c0c7170 2026-02-17T21:28:06.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.895+0000 7f9372ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:06.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.895+0000 7f9372ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:28:06.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.895+0000 7f9372ffd640 10 monclient: dump: 2026-02-17T21:28:06.911 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:06.911 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:06.911 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:06.911 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:06.911 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:06.911 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:06.911 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:06.911 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:06.911 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:06.911 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:06.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.895+0000 7f9372ffd640 10 monclient: _finish_auth 0 2026-02-17T21:28:06.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.895+0000 7f9372ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:28:06.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.895+0000 7f9372ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:06.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.895+0000 7f9390ada640 5 monclient: authenticate success, global_id 4871 2026-02-17T21:28:06.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.895+0000 7f9390ada640 10 monclient: _renew_subs 2026-02-17T21:28:06.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.895+0000 7f9390ada640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:28:06.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.895+0000 7f9390ada640 1 -- 10.20.193.5:0/994853875 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f938c0c20e0 con 0x7f938c0c7170 2026-02-17T21:28:06.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.895+0000 7f9390ada640 10 client.4871.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:28:06.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.895+0000 7f9390ada640 10 monclient: _renew_subs 2026-02-17T21:28:06.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.895+0000 7f9390ada640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:28:06.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.895+0000 7f9390ada640 1 -- 10.20.193.5:0/994853875 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f938c0c26a0 con 0x7f938c0c7170 2026-02-17T21:28:06.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.895+0000 7f9390ada640 1 librados: init done 2026-02-17T21:28:06.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.896+0000 7f9372ffd640 1 -- 10.20.193.5:0/994853875 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f937c00ade0 con 0x7f938c0c7170 2026-02-17T21:28:06.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.896+0000 7f9372ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:06.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.896+0000 7f9372ffd640 1 -- 10.20.193.5:0/994853875 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937c01b600 con 0x7f938c0c7170 2026-02-17T21:28:06.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.896+0000 7f9372ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:06.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.896+0000 7f9372ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:28:06.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.896+0000 7f9388d72640 4 set_mon_vals no callback set 2026-02-17T21:28:06.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.896+0000 7f9372ffd640 10 monclient: dump: 2026-02-17T21:28:06.913 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:06.913 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:06.913 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:06.913 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:06.913 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:06.913 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:06.913 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:06.914 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:06.914 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:06.914 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:06.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.896+0000 7f9390ada640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:06.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.896+0000 7f9390ada640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:06.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.896+0000 7f9390ada640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:28:06.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.896+0000 7f9390ada640 1 -- 10.20.193.5:0/994853875 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f938c0c4d10 con 0x7f938c0c7170 2026-02-17T21:28:06.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.908+0000 7f9372ffd640 1 -- 10.20.193.5:0/994853875 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f937c01b7a0 con 0x7f938c0c7170 2026-02-17T21:28:06.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.908+0000 7f9372ffd640 1 --2- 10.20.193.5:0/994853875 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9358079280 0x7f935807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:06.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.909+0000 7f938a575640 1 --2- 10.20.193.5:0/994853875 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9358079280 0x7f935807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:06.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.909+0000 7f938a575640 10 monclient: get_auth_request con 0x7f9358079280 auth_method 0 2026-02-17T21:28:06.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.909+0000 7f9372ffd640 10 client.4871.objecter ms_handle_connect 0x7f9358079280 2026-02-17T21:28:06.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.909+0000 7f938a575640 1 --2- 10.20.193.5:0/994853875 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9358079280 0x7f935807b740 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f938c0c3800 tx=0x7f9380009290 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:06.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.910+0000 7f9372ffd640 1 -- 10.20.193.5:0/994853875 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f937c05ec70 con 0x7f938c0c7170 2026-02-17T21:28:06.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.910+0000 7f9372ffd640 10 client.4871.objecter ms_dispatch2 0x7f938c000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:28:06.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.910+0000 7f9372ffd640 3 client.4871.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:28:06.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.910+0000 7f9372ffd640 3 client.4871.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:28:06.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:06.910+0000 7f9372ffd640 20 client.4871.objecter dump_active .. 0 homeless 2026-02-17T21:28:07.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.010+0000 7f9372ffd640 1 -- 10.20.193.5:0/994853875 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f937c062c30 con 0x7f938c0c7170 2026-02-17T21:28:07.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.010+0000 7f9372ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:07.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.010+0000 7f9372ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:28:07.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.111+0000 7f9390ada640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:28:07.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.111+0000 7f9390ada640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:07.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.111+0000 7f9390ada640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:28:07.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.111+0000 7f9390ada640 1 -- 10.20.193.5:0/994853875 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f938c0c9ce0 con 0x7f938c0c7170 2026-02-17T21:28:07.114 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.113+0000 7f9372ffd640 1 -- 10.20.193.5:0/994853875 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f937c066f30 con 0x7f938c0c7170 2026-02-17T21:28:07.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.113+0000 7f9372ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:07.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.113+0000 7f9372ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:28:07.115 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:28:07.115 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:28:07.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.114+0000 7f9390ada640 10 librados: watch_flush enter 2026-02-17T21:28:07.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.114+0000 7f9390ada640 10 librados: watch_flush exit 2026-02-17T21:28:07.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.114+0000 7f9390ada640 20 client.4871.objecter shutdown clearing up homeless session... 2026-02-17T21:28:07.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.114+0000 7f9390ada640 10 client.4871.objecter successfully canceled tick 2026-02-17T21:28:07.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.114+0000 7f9390ada640 1 -- 10.20.193.5:0/994853875 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9358079280 msgr2=0x7f935807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:07.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.114+0000 7f9390ada640 1 --2- 10.20.193.5:0/994853875 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9358079280 0x7f935807b740 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f938c0c3800 tx=0x7f9380009290 comp rx=0 tx=0).stop 2026-02-17T21:28:07.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.114+0000 7f9390ada640 10 monclient: shutdown 2026-02-17T21:28:07.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.114+0000 7f9390ada640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:07.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.114+0000 7f9390ada640 1 -- 10.20.193.5:0/994853875 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f938c0c7170 msgr2=0x7f938c1f4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:07.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.114+0000 7f9390ada640 1 --2- 10.20.193.5:0/994853875 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f938c0c7170 0x7f938c1f4730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f937c00ca80 tx=0x7f937c00cf50 comp rx=0 tx=0).stop 2026-02-17T21:28:07.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.115+0000 7f9390ada640 1 -- 10.20.193.5:0/994853875 shutdown_connections 2026-02-17T21:28:07.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.115+0000 7f9390ada640 1 --2- 10.20.193.5:0/994853875 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9358079280 0x7f935807b740 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:07.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.115+0000 7f9390ada640 1 --2- 10.20.193.5:0/994853875 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f938c0c7170 0x7f938c1f4730 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:07.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.115+0000 7f9390ada640 1 --2- 10.20.193.5:0/994853875 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f938c0c48c0 0x7f938c0c3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:07.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.115+0000 7f9390ada640 1 --2- 10.20.193.5:0/994853875 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f938c074ef0 0x7f938c1f23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:07.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.115+0000 7f9390ada640 1 -- 10.20.193.5:0/994853875 >> 10.20.193.5:0/994853875 conn(0x7f938c0c9f40 msgr2=0x7f938c0cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:07.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.115+0000 7f9390ada640 1 -- 10.20.193.5:0/994853875 shutdown_connections 2026-02-17T21:28:07.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.115+0000 7f9390ada640 1 -- 10.20.193.5:0/994853875 wait complete. 2026-02-17T21:28:07.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:07.115+0000 7f9390ada640 1 librados: shutdown 2026-02-17T21:28:10.126 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:28:10.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.193+0000 7f1504c88640 10 monclient: get_monmap_and_config 2026-02-17T21:28:10.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.193+0000 7f1504c88640 10 monclient: build_initial_monmap 2026-02-17T21:28:10.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.193+0000 7f1504c88640 10 monclient: monmap: 2026-02-17T21:28:10.195 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:10.195 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:10.196 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:28:10.194255+0000 2026-02-17T21:28:10.196 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:28:10.194255+0000 2026-02-17T21:28:10.196 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:10.196 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:10.196 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:28:10.196 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:28:10.196 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:28:10.196 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:28:10.196 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:28:10.196 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:28:10.196 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:10.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.194+0000 7f1504c88640 1 Processor -- start 2026-02-17T21:28:10.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.194+0000 7f1504c88640 1 -- start start 2026-02-17T21:28:10.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.194+0000 7f1504c88640 10 monclient: init 2026-02-17T21:28:10.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.194+0000 7f1504c88640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:10.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.194+0000 7f1504c88640 10 monclient: _add_conns ranks=[3,2,0,1,5,4] 2026-02-17T21:28:10.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.194+0000 7f1504c88640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f150015d370 0x7f150015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:10.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.194+0000 7f1504c88640 10 monclient(hunting): picked mon.noname-a con 0x7f150015d370 addr v2:10.20.193.5:3300/0 2026-02-17T21:28:10.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.194+0000 7f1504c88640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f15000c7e20 addr v1:10.20.193.135:6789/0 2026-02-17T21:28:10.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.194+0000 7f1504c88640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f15000c74c0 addr v1:10.20.193.5:6789/0 2026-02-17T21:28:10.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.194+0000 7f1504c88640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15000c8350 con 0x7f15000c74c0 2026-02-17T21:28:10.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.194+0000 7f1504c88640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15000c8630 con 0x7f15000c7e20 2026-02-17T21:28:10.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.194+0000 7f1504c88640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:10.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.194+0000 7f1504c88640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f150015b710 con 0x7f150015d370 2026-02-17T21:28:10.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.194+0000 7f1504c88640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:10.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.194+0000 7f1504c88640 10 monclient(hunting): authenticate will time out at 1195.759578s 2026-02-17T21:28:10.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.195+0000 7f14fe575640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f150015d370 0x7f150015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:10.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.195+0000 7f14fdd74640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f15000c7e20 0x7f150015b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:36594/0 (socket says 10.20.193.5:36594) 2026-02-17T21:28:10.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.195+0000 7f14fdd74640 1 -- 10.20.193.5:0/1352244215 learned_addr learned my addr 10.20.193.5:0/1352244215 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:28:10.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.195+0000 7f14fe575640 10 monclient(hunting): get_auth_request con 0x7f150015d370 auth_method 0 2026-02-17T21:28:10.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.195+0000 7f14fe575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:10.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.195+0000 7f14fe575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:10.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.195+0000 7f14fe575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:10.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.195+0000 7f14fe575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:10.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.195+0000 7f14fe575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:10.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.195+0000 7f14fe575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:10.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.196+0000 7f14fe575640 10 monclient(hunting): handle_auth_done global_id 4863 payload 274 2026-02-17T21:28:10.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.196+0000 7f14fe575640 1 -- 10.20.193.5:0/1352244215 >> v1:10.20.193.135:6789/0 conn(0x7f15000c7e20 legacy=0x7f150015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:10.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.196+0000 7f14fd573640 1 -- 10.20.193.5:0/1352244215 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1587525672 0 0) 0x7f15000c8630 con 0x7f15000c7e20 2026-02-17T21:28:10.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.196+0000 7f14fe575640 1 -- 10.20.193.5:0/1352244215 >> v1:10.20.193.5:6789/0 conn(0x7f15000c74c0 legacy=0x7f15000c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:10.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.196+0000 7f14fe575640 10 monclient: _finish_hunting 0 2026-02-17T21:28:10.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.196+0000 7f14fe575640 1 monclient: found mon.noname-a 2026-02-17T21:28:10.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.196+0000 7f14fe575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:10.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.196+0000 7f14fe575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:28:10.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.196+0000 7f14fe575640 1 -- 10.20.193.5:0/1352244215 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15000c8910 con 0x7f150015d370 2026-02-17T21:28:10.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.196+0000 7f14fd573640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-17T21:28:10.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.198+0000 7f14fe575640 1 --2- 10.20.193.5:0/1352244215 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f150015d370 0x7f150015d750 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f14f40098a0 tx=0x7f14f402ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c158884431558678 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:10.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.200+0000 7f14fd573640 1 -- 10.20.193.5:0/1352244215 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f403c070 con 0x7f150015d370 2026-02-17T21:28:10.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.200+0000 7f14fd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:10.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.200+0000 7f14fd573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:28:10.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.200+0000 7f14fd573640 10 monclient: dump: 2026-02-17T21:28:10.207 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:10.207 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:10.207 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:10.207 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:10.207 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:10.207 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:10.207 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:10.207 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:10.207 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:10.208 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:10.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.200+0000 7f14fd573640 10 monclient: _finish_auth 0 2026-02-17T21:28:10.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.200+0000 7f14fd573640 10 monclient: _check_auth_tickets 2026-02-17T21:28:10.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.200+0000 7f14fd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:10.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.200+0000 7f14fd573640 1 -- 10.20.193.5:0/1352244215 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f402fb70 con 0x7f150015d370 2026-02-17T21:28:10.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.200+0000 7f1504c88640 5 monclient: authenticate success, global_id 4863 2026-02-17T21:28:10.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.200+0000 7f1504c88640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:28:10.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.200+0000 7f14fd573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:10.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.200+0000 7f14fd573640 1 -- 10.20.193.5:0/1352244215 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f4037440 con 0x7f150015d370 2026-02-17T21:28:10.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.200+0000 7f1504c88640 10 monclient: get_monmap_and_config success 2026-02-17T21:28:10.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.200+0000 7f1504c88640 4 set_mon_vals no callback set 2026-02-17T21:28:10.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.200+0000 7f14fd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:10.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.200+0000 7f14fd573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:28:10.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.200+0000 7f14fd573640 10 monclient: dump: 2026-02-17T21:28:10.209 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:10.209 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:10.209 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:10.209 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:10.209 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:10.209 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:10.209 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:10.209 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:10.209 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:10.209 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:10.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.200+0000 7f1504c88640 10 monclient: shutdown 2026-02-17T21:28:10.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.200+0000 7f1504c88640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:10.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.200+0000 7f1504c88640 1 -- 10.20.193.5:0/1352244215 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f150015d370 msgr2=0x7f150015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:10.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.200+0000 7f1504c88640 1 --2- 10.20.193.5:0/1352244215 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f150015d370 0x7f150015d750 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f14f40098a0 tx=0x7f14f402ee60 comp rx=0 tx=0).stop 2026-02-17T21:28:10.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.200+0000 7f1504c88640 1 -- 10.20.193.5:0/1352244215 shutdown_connections 2026-02-17T21:28:10.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.200+0000 7f1504c88640 1 --2- 10.20.193.5:0/1352244215 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f150015d370 0x7f150015d750 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:10.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.200+0000 7f1504c88640 1 -- 10.20.193.5:0/1352244215 >> 10.20.193.5:0/1352244215 conn(0x7f15000c9f20 msgr2=0x7f15000ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:10.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.201+0000 7f1504c88640 1 -- 10.20.193.5:0/1352244215 shutdown_connections 2026-02-17T21:28:10.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.201+0000 7f1504c88640 1 -- 10.20.193.5:0/1352244215 wait complete. 2026-02-17T21:28:10.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.201+0000 7f1504c88640 10 monclient: build_initial_monmap 2026-02-17T21:28:10.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.201+0000 7f1504c88640 10 monclient: monmap: 2026-02-17T21:28:10.210 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:10.211 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:28:10.211 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:28:10.211 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:28:10.211 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:10.211 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:10.211 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:28:10.211 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:28:10.211 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:28:10.211 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:10.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.201+0000 7f1504c88640 1 librados: starting msgr at 2026-02-17T21:28:10.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.201+0000 7f1504c88640 1 librados: starting objecter 2026-02-17T21:28:10.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.202+0000 7f1504c88640 1 Processor -- start 2026-02-17T21:28:10.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.202+0000 7f1504c88640 1 -- start start 2026-02-17T21:28:10.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.202+0000 7f1504c88640 1 librados: setting wanted keys 2026-02-17T21:28:10.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.202+0000 7f1504c88640 1 librados: calling monclient init 2026-02-17T21:28:10.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.202+0000 7f1504c88640 10 monclient: init 2026-02-17T21:28:10.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.202+0000 7f1504c88640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:10.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.202+0000 7f1504c88640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:28:10.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.202+0000 7f1504c88640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f15000c74c0 0x7f15000c4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:10.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.202+0000 7f1504c88640 10 monclient(hunting): picked mon.noname-a con 0x7f15000c74c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:28:10.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.202+0000 7f1504c88640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f15000c7e20 0x7f15000cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:10.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.202+0000 7f1504c88640 10 monclient(hunting): picked mon.noname-c con 0x7f15000c7e20 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:28:10.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.202+0000 7f1504c88640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f150015d370 0x7f150006e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:10.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.202+0000 7f1504c88640 10 monclient(hunting): picked mon.noname-b con 0x7f150015d370 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:28:10.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.202+0000 7f1504c88640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:10.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.202+0000 7f1504c88640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f15000c8ed0 con 0x7f15000c74c0 2026-02-17T21:28:10.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.202+0000 7f1504c88640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:10.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.202+0000 7f1504c88640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f15000c9240 con 0x7f150015d370 2026-02-17T21:28:10.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.202+0000 7f1504c88640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:10.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.202+0000 7f1504c88640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f15000c96d0 con 0x7f15000c7e20 2026-02-17T21:28:10.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.202+0000 7f1504c88640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:10.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.202+0000 7f1504c88640 10 monclient(hunting): authenticate will time out at 1195.767578s 2026-02-17T21:28:10.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.202+0000 7f14fe575640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f15000c74c0 0x7f15000c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:10.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.203+0000 7f14fdd74640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f15000c7e20 0x7f15000cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:10.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.203+0000 7f14fe575640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f15000c74c0 0x7f15000c4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:58360/0 (socket says 10.20.193.5:58360) 2026-02-17T21:28:10.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.203+0000 7f14fe575640 1 -- 10.20.193.5:0/2734597251 learned_addr learned my addr 10.20.193.5:0/2734597251 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:28:10.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.203+0000 7f14fe575640 10 monclient(hunting): get_auth_request con 0x7f15000c74c0 auth_method 0 2026-02-17T21:28:10.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.203+0000 7f14fe575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:10.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.203+0000 7f14fe575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:10.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.203+0000 7f14fe575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:10.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.203+0000 7f14fed76640 1 --2- 10.20.193.5:0/2734597251 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f150015d370 0x7f150006e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:10.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.203+0000 7f14fdd74640 10 monclient(hunting): get_auth_request con 0x7f15000c7e20 auth_method 0 2026-02-17T21:28:10.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.203+0000 7f14fdd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:10.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.203+0000 7f14fdd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:10.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.203+0000 7f14fdd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:10.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.203+0000 7f14fe575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:10.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.203+0000 7f14fe575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:10.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.203+0000 7f14fe575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:10.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.203+0000 7f14fed76640 10 monclient(hunting): get_auth_request con 0x7f150015d370 auth_method 0 2026-02-17T21:28:10.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.203+0000 7f14fed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:10.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.203+0000 7f14fed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:10.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.203+0000 7f14fed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:10.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.203+0000 7f14fdd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:10.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.203+0000 7f14fdd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:10.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.203+0000 7f14fdd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:10.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.203+0000 7f14fed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:10.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.203+0000 7f14fed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:10.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.203+0000 7f14fed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:10.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.204+0000 7f14fe575640 10 monclient(hunting): handle_auth_done global_id 4866 payload 824 2026-02-17T21:28:10.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.204+0000 7f14fe575640 1 -- 10.20.193.5:0/2734597251 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f15000c7e20 msgr2=0x7f15000cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:10.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.204+0000 7f14fe575640 1 --2- 10.20.193.5:0/2734597251 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f15000c7e20 0x7f15000cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:10.216 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.204+0000 7f14fe575640 1 -- 10.20.193.5:0/2734597251 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f150015d370 msgr2=0x7f150006e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:10.216 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.204+0000 7f14fe575640 1 --2- 10.20.193.5:0/2734597251 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f150015d370 0x7f150006e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:10.216 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.204+0000 7f14fe575640 10 monclient: _finish_hunting 0 2026-02-17T21:28:10.216 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.204+0000 7f14fe575640 1 monclient: found mon.noname-a 2026-02-17T21:28:10.216 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.204+0000 7f14fe575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:10.216 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.204+0000 7f14fe575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:28:10.216 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.204+0000 7f14fe575640 1 -- 10.20.193.5:0/2734597251 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15000cc6f0 con 0x7f15000c74c0 2026-02-17T21:28:10.218 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.205+0000 7f14fe575640 1 --2- 10.20.193.5:0/2734597251 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f15000c74c0 0x7f15000c4040 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f14f402f390 tx=0x7f14f40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:10.218 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.205+0000 7f14e6ffd640 10 client.?.objecter ms_handle_connect 0x7f15000c74c0 2026-02-17T21:28:10.218 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.205+0000 7f14e6ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:28:10.218 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f14e6ffd640 1 -- 10.20.193.5:0/2734597251 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f403c040 con 0x7f15000c74c0 2026-02-17T21:28:10.218 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f14e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:10.218 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f14e6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:28:10.218 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f14e6ffd640 10 monclient: dump: 2026-02-17T21:28:10.218 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:10.219 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:10.219 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:10.219 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:10.219 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:10.219 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:10.219 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:10.219 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:10.219 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:10.219 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:10.219 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f14e6ffd640 10 monclient: _finish_auth 0 2026-02-17T21:28:10.219 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f14e6ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:28:10.219 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f14e6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:10.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f14e6ffd640 1 -- 10.20.193.5:0/2734597251 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f4047070 con 0x7f15000c74c0 2026-02-17T21:28:10.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f14e6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:10.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f14e6ffd640 1 -- 10.20.193.5:0/2734597251 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f40418d0 con 0x7f15000c74c0 2026-02-17T21:28:10.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f14e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:10.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f14fcd72640 4 set_mon_vals no callback set 2026-02-17T21:28:10.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f14e6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:28:10.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f14e6ffd640 10 monclient: dump: 2026-02-17T21:28:10.220 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:10.220 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:10.220 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:10.220 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:10.220 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:10.221 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:10.221 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:10.221 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:10.221 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:10.221 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:10.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f1504c88640 5 monclient: authenticate success, global_id 4866 2026-02-17T21:28:10.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f1504c88640 10 monclient: _renew_subs 2026-02-17T21:28:10.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f1504c88640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:10.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f1504c88640 1 -- 10.20.193.5:0/2734597251 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15000cc9d0 con 0x7f15000c74c0 2026-02-17T21:28:10.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f1504c88640 10 client.4866.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:28:10.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f1504c88640 10 monclient: _renew_subs 2026-02-17T21:28:10.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f1504c88640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:10.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f1504c88640 1 -- 10.20.193.5:0/2734597251 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f150006dcf0 con 0x7f15000c74c0 2026-02-17T21:28:10.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f1504c88640 1 librados: init done 2026-02-17T21:28:10.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f1504c88640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:10.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f1504c88640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:10.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f1504c88640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:10.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.207+0000 7f1504c88640 1 -- 10.20.193.5:0/2734597251 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f150015d750 con 0x7f15000c74c0 2026-02-17T21:28:10.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.219+0000 7f14e6ffd640 1 -- 10.20.193.5:0/2734597251 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f14f4041a70 con 0x7f15000c74c0 2026-02-17T21:28:10.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.219+0000 7f14e6ffd640 1 --2- 10.20.193.5:0/2734597251 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f14cc0792d0 0x7f14cc07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:10.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.220+0000 7f14fdd74640 1 --2- 10.20.193.5:0/2734597251 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f14cc0792d0 0x7f14cc07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:10.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.220+0000 7f14fdd74640 10 monclient: get_auth_request con 0x7f14cc0792d0 auth_method 0 2026-02-17T21:28:10.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.220+0000 7f14fdd74640 1 --2- 10.20.193.5:0/2734597251 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f14cc0792d0 0x7f14cc07b790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f15001edcb0 tx=0x7f14e8007df0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:10.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.220+0000 7f14e6ffd640 10 client.4866.objecter ms_handle_connect 0x7f14cc0792d0 2026-02-17T21:28:10.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.222+0000 7f14e6ffd640 1 -- 10.20.193.5:0/2734597251 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f14f4041d90 con 0x7f15000c74c0 2026-02-17T21:28:10.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.222+0000 7f14e6ffd640 10 client.4866.objecter ms_dispatch2 0x7f1500000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:28:10.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.222+0000 7f14e6ffd640 3 client.4866.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:28:10.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.222+0000 7f14e6ffd640 3 client.4866.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:28:10.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.222+0000 7f14e6ffd640 20 client.4866.objecter dump_active .. 0 homeless 2026-02-17T21:28:10.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.325+0000 7f14e6ffd640 1 -- 10.20.193.5:0/2734597251 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f14f4087db0 con 0x7f15000c74c0 2026-02-17T21:28:10.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.325+0000 7f14e6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:10.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.325+0000 7f14e6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:28:10.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.426+0000 7f1504c88640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:28:10.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.426+0000 7f1504c88640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:10.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.426+0000 7f1504c88640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:10.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.426+0000 7f1504c88640 1 -- 10.20.193.5:0/2734597251 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f15000cccb0 con 0x7f15000c74c0 2026-02-17T21:28:10.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.430+0000 7f14e6ffd640 1 -- 10.20.193.5:0/2734597251 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f14f408c0b0 con 0x7f15000c74c0 2026-02-17T21:28:10.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.430+0000 7f14e6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:10.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.430+0000 7f14e6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:28:10.431 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:28:10.432 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:28:10.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.431+0000 7f1504c88640 10 librados: watch_flush enter 2026-02-17T21:28:10.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.431+0000 7f1504c88640 10 librados: watch_flush exit 2026-02-17T21:28:10.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.431+0000 7f1504c88640 20 client.4866.objecter shutdown clearing up homeless session... 2026-02-17T21:28:10.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.431+0000 7f1504c88640 10 client.4866.objecter successfully canceled tick 2026-02-17T21:28:10.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.431+0000 7f1504c88640 1 -- 10.20.193.5:0/2734597251 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f14cc0792d0 msgr2=0x7f14cc07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:10.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.431+0000 7f1504c88640 1 --2- 10.20.193.5:0/2734597251 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f14cc0792d0 0x7f14cc07b790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f15001edcb0 tx=0x7f14e8007df0 comp rx=0 tx=0).stop 2026-02-17T21:28:10.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.431+0000 7f1504c88640 10 monclient: shutdown 2026-02-17T21:28:10.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.431+0000 7f1504c88640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:10.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.431+0000 7f1504c88640 1 -- 10.20.193.5:0/2734597251 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f15000c74c0 msgr2=0x7f15000c4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:10.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.431+0000 7f1504c88640 1 --2- 10.20.193.5:0/2734597251 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f15000c74c0 0x7f15000c4040 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f14f402f390 tx=0x7f14f40047c0 comp rx=0 tx=0).stop 2026-02-17T21:28:10.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.431+0000 7f1504c88640 1 -- 10.20.193.5:0/2734597251 shutdown_connections 2026-02-17T21:28:10.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.431+0000 7f1504c88640 1 --2- 10.20.193.5:0/2734597251 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f14cc0792d0 0x7f14cc07b790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:10.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.431+0000 7f1504c88640 1 --2- 10.20.193.5:0/2734597251 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f150015d370 0x7f150006e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:10.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.431+0000 7f1504c88640 1 --2- 10.20.193.5:0/2734597251 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f15000c7e20 0x7f15000cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:10.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.431+0000 7f1504c88640 1 --2- 10.20.193.5:0/2734597251 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f15000c74c0 0x7f15000c4040 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:10.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.431+0000 7f1504c88640 1 -- 10.20.193.5:0/2734597251 >> 10.20.193.5:0/2734597251 conn(0x7f15000c9f20 msgr2=0x7f15000ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:10.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.431+0000 7f1504c88640 1 -- 10.20.193.5:0/2734597251 shutdown_connections 2026-02-17T21:28:10.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.431+0000 7f1504c88640 1 -- 10.20.193.5:0/2734597251 wait complete. 2026-02-17T21:28:10.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:10.431+0000 7f1504c88640 1 librados: shutdown 2026-02-17T21:28:13.442 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:28:13.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.511+0000 7f42af05b640 10 monclient: get_monmap_and_config 2026-02-17T21:28:13.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.511+0000 7f42af05b640 10 monclient: build_initial_monmap 2026-02-17T21:28:13.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.511+0000 7f42af05b640 10 monclient: monmap: 2026-02-17T21:28:13.513 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:13.513 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:13.513 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:28:13.511963+0000 2026-02-17T21:28:13.513 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:28:13.511963+0000 2026-02-17T21:28:13.513 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:13.513 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:13.513 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:28:13.513 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:28:13.514 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:28:13.514 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:28:13.514 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:28:13.514 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:28:13.514 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:13.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.511+0000 7f42af05b640 1 Processor -- start 2026-02-17T21:28:13.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.511+0000 7f42af05b640 1 -- start start 2026-02-17T21:28:13.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.511+0000 7f42af05b640 10 monclient: init 2026-02-17T21:28:13.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.512+0000 7f42af05b640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:13.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.512+0000 7f42af05b640 10 monclient: _add_conns ranks=[1,3,4,2,5,0] 2026-02-17T21:28:13.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.512+0000 7f42af05b640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f42a815d370 addr v1:10.20.193.119:6789/0 2026-02-17T21:28:13.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.512+0000 7f42af05b640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f42a80c7e20 0x7f42a815d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:13.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.512+0000 7f42af05b640 10 monclient(hunting): picked mon.noname-a con 0x7f42a80c7e20 addr v2:10.20.193.5:3300/0 2026-02-17T21:28:13.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.512+0000 7f42af05b640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f42a80c74c0 0x7f42a80c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:13.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.512+0000 7f42af05b640 10 monclient(hunting): picked mon.noname-b con 0x7f42a80c74c0 addr v2:10.20.193.119:3300/0 2026-02-17T21:28:13.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.512+0000 7f42af05b640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42a80c8350 con 0x7f42a815d370 2026-02-17T21:28:13.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.512+0000 7f42af05b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:13.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.512+0000 7f42af05b640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f42a815b710 con 0x7f42a80c7e20 2026-02-17T21:28:13.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.512+0000 7f42af05b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:13.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.512+0000 7f42af05b640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f42a80c9240 con 0x7f42a80c74c0 2026-02-17T21:28:13.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.512+0000 7f42af05b640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:13.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.512+0000 7f42af05b640 10 monclient(hunting): authenticate will time out at 1199.077374s 2026-02-17T21:28:13.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.512+0000 7f42acdd0640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f42a815d370 0x7f42a815b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:35762/0 (socket says 10.20.193.5:35762) 2026-02-17T21:28:13.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.512+0000 7f42acdd0640 1 -- 10.20.193.5:0/1748337962 learned_addr learned my addr 10.20.193.5:0/1748337962 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:28:13.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.512+0000 7f429ffff640 1 --2- 10.20.193.5:0/1748337962 >> v2:10.20.193.5:3300/0 conn(0x7f42a80c7e20 0x7f42a815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:13.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.513+0000 7f429ffff640 10 monclient(hunting): get_auth_request con 0x7f42a80c7e20 auth_method 0 2026-02-17T21:28:13.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.513+0000 7f429ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:13.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.513+0000 7f429ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:13.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.513+0000 7f429ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:13.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.513+0000 7f429ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:13.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.513+0000 7f429ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:13.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.513+0000 7f429ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:13.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.514+0000 7f42ad5d1640 1 --2- 10.20.193.5:0/1748337962 >> v2:10.20.193.119:3300/0 conn(0x7f42a80c74c0 0x7f42a80c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:13.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.514+0000 7f429f7fe640 1 -- 10.20.193.5:0/1748337962 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 65141037 0 0) 0x7f42a80c8350 con 0x7f42a815d370 2026-02-17T21:28:13.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.514+0000 7f429f7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:28:13.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.514+0000 7f429f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:13.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.514+0000 7f429f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:13.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.514+0000 7f429f7fe640 10 monclient(hunting): my global_id is 4882 2026-02-17T21:28:13.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.514+0000 7f429f7fe640 1 -- 10.20.193.5:0/1748337962 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4294003620 con 0x7f42a815d370 2026-02-17T21:28:13.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.514+0000 7f429ffff640 10 monclient(hunting): handle_auth_done global_id 4869 payload 274 2026-02-17T21:28:13.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.514+0000 7f429ffff640 1 -- 10.20.193.5:0/1748337962 >> v2:10.20.193.119:3300/0 conn(0x7f42a80c74c0 msgr2=0x7f42a80c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:28:13.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.514+0000 7f429ffff640 1 --2- 10.20.193.5:0/1748337962 >> v2:10.20.193.119:3300/0 conn(0x7f42a80c74c0 0x7f42a80c52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:13.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.514+0000 7f429ffff640 1 -- 10.20.193.5:0/1748337962 >> v1:10.20.193.119:6789/0 conn(0x7f42a815d370 legacy=0x7f42a815b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:13.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.514+0000 7f429ffff640 10 monclient: _finish_hunting 0 2026-02-17T21:28:13.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.514+0000 7f429ffff640 1 monclient: found mon.noname-a 2026-02-17T21:28:13.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.514+0000 7f429ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:13.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.514+0000 7f429ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:28:13.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.514+0000 7f429ffff640 1 -- 10.20.193.5:0/1748337962 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a80c8630 con 0x7f42a80c7e20 2026-02-17T21:28:13.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.515+0000 7f429ffff640 1 --2- 10.20.193.5:0/1748337962 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f42a80c7e20 0x7f42a815d750 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f42a815dcf0 tx=0x7f429002ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3b6c173d81181b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:13.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f429f7fe640 1 -- 10.20.193.5:0/1748337962 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429003c070 con 0x7f42a80c7e20 2026-02-17T21:28:13.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f429f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:13.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f429f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:28:13.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f429f7fe640 10 monclient: dump: 2026-02-17T21:28:13.527 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:13.527 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:13.527 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:13.528 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:13.528 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:13.528 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:13.528 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:13.528 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:13.528 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:13.528 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:13.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f429f7fe640 10 monclient: _finish_auth 0 2026-02-17T21:28:13.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f429f7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:28:13.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f429f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:13.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f429f7fe640 1 -- 10.20.193.5:0/1748337962 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f429002faf0 con 0x7f42a80c7e20 2026-02-17T21:28:13.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f429f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:13.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f429f7fe640 1 -- 10.20.193.5:0/1748337962 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4290037440 con 0x7f42a80c7e20 2026-02-17T21:28:13.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f42af05b640 5 monclient: authenticate success, global_id 4869 2026-02-17T21:28:13.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f429f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:13.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f429f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:28:13.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f429f7fe640 10 monclient: dump: 2026-02-17T21:28:13.529 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:13.529 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:13.529 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:13.529 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:13.529 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:13.529 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:13.529 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:13.530 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:13.530 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:13.530 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:13.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f42af05b640 10 monclient: get_monmap_and_config success 2026-02-17T21:28:13.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f42af05b640 4 set_mon_vals no callback set 2026-02-17T21:28:13.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f42af05b640 10 monclient: shutdown 2026-02-17T21:28:13.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f42af05b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:13.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f42af05b640 1 -- 10.20.193.5:0/1748337962 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f42a80c7e20 msgr2=0x7f42a815d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:13.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f42af05b640 1 --2- 10.20.193.5:0/1748337962 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f42a80c7e20 0x7f42a815d750 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f42a815dcf0 tx=0x7f429002ede0 comp rx=0 tx=0).stop 2026-02-17T21:28:13.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f42af05b640 1 -- 10.20.193.5:0/1748337962 shutdown_connections 2026-02-17T21:28:13.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f42af05b640 1 --2- 10.20.193.5:0/1748337962 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f42a80c7e20 0x7f42a815d750 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:13.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f42af05b640 1 --2- 10.20.193.5:0/1748337962 >> v2:10.20.193.119:3300/0 conn(0x7f42a80c74c0 0x7f42a80c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:13.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f42af05b640 1 -- 10.20.193.5:0/1748337962 >> 10.20.193.5:0/1748337962 conn(0x7f42a80c9f20 msgr2=0x7f42a80ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:13.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f42af05b640 1 -- 10.20.193.5:0/1748337962 shutdown_connections 2026-02-17T21:28:13.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.517+0000 7f42af05b640 1 -- 10.20.193.5:0/1748337962 wait complete. 2026-02-17T21:28:13.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.518+0000 7f42af05b640 10 monclient: build_initial_monmap 2026-02-17T21:28:13.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.518+0000 7f42af05b640 10 monclient: monmap: 2026-02-17T21:28:13.531 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:13.531 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:28:13.531 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:28:13.531 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:28:13.531 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:13.531 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:13.531 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:28:13.532 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:28:13.532 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:28:13.532 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:13.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.518+0000 7f42af05b640 1 librados: starting msgr at 2026-02-17T21:28:13.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.518+0000 7f42af05b640 1 librados: starting objecter 2026-02-17T21:28:13.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.518+0000 7f42af05b640 1 Processor -- start 2026-02-17T21:28:13.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.518+0000 7f42af05b640 1 -- start start 2026-02-17T21:28:13.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.518+0000 7f42af05b640 1 librados: setting wanted keys 2026-02-17T21:28:13.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.518+0000 7f42af05b640 1 librados: calling monclient init 2026-02-17T21:28:13.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.518+0000 7f42af05b640 10 monclient: init 2026-02-17T21:28:13.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.518+0000 7f42af05b640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:13.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.518+0000 7f42af05b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:28:13.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.518+0000 7f42af05b640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f42a80c74c0 0x7f42a81f13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:13.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.518+0000 7f42af05b640 10 monclient(hunting): picked mon.noname-c con 0x7f42a80c74c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:28:13.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.518+0000 7f42af05b640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f42a80c7e20 0x7f42a81471b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:13.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.518+0000 7f42af05b640 10 monclient(hunting): picked mon.noname-a con 0x7f42a80c7e20 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:28:13.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.518+0000 7f42af05b640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f42a815d370 0x7f42a8149320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:13.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.518+0000 7f42af05b640 10 monclient(hunting): picked mon.noname-b con 0x7f42a815d370 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:28:13.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.518+0000 7f42af05b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:13.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.518+0000 7f42af05b640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f42a80c8ed0 con 0x7f42a80c7e20 2026-02-17T21:28:13.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.518+0000 7f42af05b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:13.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.518+0000 7f42af05b640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f42a80c8bf0 con 0x7f42a815d370 2026-02-17T21:28:13.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.518+0000 7f42af05b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:13.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.518+0000 7f42af05b640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f42a80c96d0 con 0x7f42a80c74c0 2026-02-17T21:28:13.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.518+0000 7f42af05b640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:13.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.518+0000 7f42af05b640 10 monclient(hunting): authenticate will time out at 1199.083889s 2026-02-17T21:28:13.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f429ffff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f42a80c7e20 0x7f42a81471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:13.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f42ad5d1640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f42a815d370 0x7f42a8149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:13.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f429ffff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f42a80c7e20 0x7f42a81471b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:58382/0 (socket says 10.20.193.5:58382) 2026-02-17T21:28:13.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f429ffff640 1 -- 10.20.193.5:0/3230552529 learned_addr learned my addr 10.20.193.5:0/3230552529 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:28:13.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f429ffff640 10 monclient(hunting): get_auth_request con 0x7f42a80c7e20 auth_method 0 2026-02-17T21:28:13.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f429ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:13.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f429ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:13.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f429ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:13.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f42acdd0640 1 --2- 10.20.193.5:0/3230552529 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f42a80c74c0 0x7f42a81f13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:13.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f42ad5d1640 10 monclient(hunting): get_auth_request con 0x7f42a815d370 auth_method 0 2026-02-17T21:28:13.534 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f42ad5d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:13.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f42ad5d1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:13.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f42ad5d1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:13.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f429ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:13.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f429ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:13.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f429ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:13.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f42acdd0640 10 monclient(hunting): get_auth_request con 0x7f42a80c74c0 auth_method 0 2026-02-17T21:28:13.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f42acdd0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:13.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f42acdd0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:13.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f42acdd0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:13.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f42ad5d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:13.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f42ad5d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:13.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f42ad5d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:13.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f42acdd0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:13.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f42acdd0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:13.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.519+0000 7f42acdd0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:13.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.521+0000 7f429ffff640 10 monclient(hunting): handle_auth_done global_id 4872 payload 824 2026-02-17T21:28:13.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.521+0000 7f429ffff640 1 -- 10.20.193.5:0/3230552529 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f42a80c74c0 msgr2=0x7f42a81f13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:13.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.521+0000 7f429ffff640 1 --2- 10.20.193.5:0/3230552529 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f42a80c74c0 0x7f42a81f13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:13.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.521+0000 7f429ffff640 1 -- 10.20.193.5:0/3230552529 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f42a815d370 msgr2=0x7f42a8149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:13.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.521+0000 7f429ffff640 1 --2- 10.20.193.5:0/3230552529 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f42a815d370 0x7f42a8149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:13.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.521+0000 7f429ffff640 10 monclient: _finish_hunting 0 2026-02-17T21:28:13.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.521+0000 7f429ffff640 1 monclient: found mon.noname-a 2026-02-17T21:28:13.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.521+0000 7f429ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:13.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.521+0000 7f429ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:28:13.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.521+0000 7f429ffff640 1 -- 10.20.193.5:0/3230552529 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a81f1af0 con 0x7f42a80c7e20 2026-02-17T21:28:13.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.522+0000 7f429ffff640 1 --2- 10.20.193.5:0/3230552529 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f42a80c7e20 0x7f42a81471b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f429003a040 tx=0x7f42900047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:13.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.522+0000 7f429d7fa640 10 client.?.objecter ms_handle_connect 0x7f42a80c7e20 2026-02-17T21:28:13.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.522+0000 7f429d7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:28:13.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.523+0000 7f429d7fa640 1 -- 10.20.193.5:0/3230552529 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429003c040 con 0x7f42a80c7e20 2026-02-17T21:28:13.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.523+0000 7f429d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:13.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.523+0000 7f429d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:28:13.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.523+0000 7f429d7fa640 10 monclient: dump: 2026-02-17T21:28:13.537 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:13.537 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:13.537 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:13.537 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:13.538 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:13.538 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:13.538 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:13.538 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:13.538 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:13.538 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:13.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.523+0000 7f429d7fa640 10 monclient: _finish_auth 0 2026-02-17T21:28:13.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.523+0000 7f429d7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:28:13.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.523+0000 7f429d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:13.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.523+0000 7f429d7fa640 1 -- 10.20.193.5:0/3230552529 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4290042610 con 0x7f42a80c7e20 2026-02-17T21:28:13.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.523+0000 7f429d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:13.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.523+0000 7f429d7fa640 1 -- 10.20.193.5:0/3230552529 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42900429e0 con 0x7f42a80c7e20 2026-02-17T21:28:13.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.523+0000 7f429d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:13.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.523+0000 7f429d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:28:13.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.523+0000 7f429effd640 4 set_mon_vals no callback set 2026-02-17T21:28:13.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.523+0000 7f429d7fa640 10 monclient: dump: 2026-02-17T21:28:13.539 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:13.539 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:13.539 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:13.539 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:13.539 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:13.539 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:13.539 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:13.539 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:13.539 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:13.540 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:13.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.524+0000 7f42af05b640 5 monclient: authenticate success, global_id 4872 2026-02-17T21:28:13.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.524+0000 7f42af05b640 10 monclient: _renew_subs 2026-02-17T21:28:13.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.524+0000 7f42af05b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:13.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.524+0000 7f42af05b640 1 -- 10.20.193.5:0/3230552529 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a81f1dd0 con 0x7f42a80c7e20 2026-02-17T21:28:13.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.524+0000 7f42af05b640 10 client.4872.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:28:13.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.524+0000 7f42af05b640 10 monclient: _renew_subs 2026-02-17T21:28:13.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.524+0000 7f42af05b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:13.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.524+0000 7f42af05b640 1 -- 10.20.193.5:0/3230552529 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a8148b20 con 0x7f42a80c7e20 2026-02-17T21:28:13.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.524+0000 7f42af05b640 1 librados: init done 2026-02-17T21:28:13.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.524+0000 7f42af05b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:13.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.524+0000 7f42af05b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:13.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.524+0000 7f42af05b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:13.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.524+0000 7f42af05b640 1 -- 10.20.193.5:0/3230552529 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42a81f22f0 con 0x7f42a80c7e20 2026-02-17T21:28:13.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.536+0000 7f429d7fa640 1 -- 10.20.193.5:0/3230552529 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f429004b450 con 0x7f42a80c7e20 2026-02-17T21:28:13.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.536+0000 7f429d7fa640 1 --2- 10.20.193.5:0/3230552529 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f42780792d0 0x7f427807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:13.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.536+0000 7f42acdd0640 1 --2- 10.20.193.5:0/3230552529 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f42780792d0 0x7f427807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:13.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.536+0000 7f42acdd0640 10 monclient: get_auth_request con 0x7f42780792d0 auth_method 0 2026-02-17T21:28:13.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.537+0000 7f42acdd0640 1 --2- 10.20.193.5:0/3230552529 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f42780792d0 0x7f427807b790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4298007b60 tx=0x7f4298007ab0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:13.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.537+0000 7f429d7fa640 10 client.4872.objecter ms_handle_connect 0x7f42780792d0 2026-02-17T21:28:13.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.538+0000 7f429d7fa640 1 -- 10.20.193.5:0/3230552529 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f429002fa70 con 0x7f42a80c7e20 2026-02-17T21:28:13.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.538+0000 7f429d7fa640 10 client.4872.objecter ms_dispatch2 0x7f42a8000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:28:13.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.538+0000 7f429d7fa640 3 client.4872.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:28:13.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.538+0000 7f429d7fa640 3 client.4872.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:28:13.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.538+0000 7f429d7fa640 20 client.4872.objecter dump_active .. 0 homeless 2026-02-17T21:28:13.642 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.641+0000 7f429d7fa640 1 -- 10.20.193.5:0/3230552529 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f42a81f22f0 con 0x7f42a80c7e20 2026-02-17T21:28:13.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.641+0000 7f429d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:13.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.641+0000 7f429d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:28:13.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.743+0000 7f42af05b640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:28:13.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.743+0000 7f42af05b640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:13.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.743+0000 7f42af05b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:13.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.743+0000 7f42af05b640 1 -- 10.20.193.5:0/3230552529 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f42a815d750 con 0x7f42a80c7e20 2026-02-17T21:28:13.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.746+0000 7f429d7fa640 1 -- 10.20.193.5:0/3230552529 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f4290086c40 con 0x7f42a80c7e20 2026-02-17T21:28:13.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.746+0000 7f429d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:13.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.746+0000 7f429d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:28:13.747 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:28:13.748 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:28:13.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.747+0000 7f42af05b640 10 librados: watch_flush enter 2026-02-17T21:28:13.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.747+0000 7f42af05b640 10 librados: watch_flush exit 2026-02-17T21:28:13.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.747+0000 7f42af05b640 20 client.4872.objecter shutdown clearing up homeless session... 2026-02-17T21:28:13.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.747+0000 7f42af05b640 10 client.4872.objecter successfully canceled tick 2026-02-17T21:28:13.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.747+0000 7f42af05b640 1 -- 10.20.193.5:0/3230552529 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f42780792d0 msgr2=0x7f427807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:13.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.747+0000 7f42af05b640 1 --2- 10.20.193.5:0/3230552529 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f42780792d0 0x7f427807b790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4298007b60 tx=0x7f4298007ab0 comp rx=0 tx=0).stop 2026-02-17T21:28:13.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.747+0000 7f42af05b640 10 monclient: shutdown 2026-02-17T21:28:13.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.747+0000 7f42af05b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:13.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.747+0000 7f42af05b640 1 -- 10.20.193.5:0/3230552529 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f42a80c7e20 msgr2=0x7f42a81471b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:13.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.747+0000 7f42af05b640 1 --2- 10.20.193.5:0/3230552529 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f42a80c7e20 0x7f42a81471b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f429003a040 tx=0x7f42900047c0 comp rx=0 tx=0).stop 2026-02-17T21:28:13.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.747+0000 7f42af05b640 1 -- 10.20.193.5:0/3230552529 shutdown_connections 2026-02-17T21:28:13.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.747+0000 7f42af05b640 1 --2- 10.20.193.5:0/3230552529 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f42780792d0 0x7f427807b790 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:13.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.747+0000 7f42af05b640 1 --2- 10.20.193.5:0/3230552529 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f42a815d370 0x7f42a8149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:13.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.747+0000 7f42af05b640 1 --2- 10.20.193.5:0/3230552529 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f42a80c7e20 0x7f42a81471b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:13.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.747+0000 7f42af05b640 1 --2- 10.20.193.5:0/3230552529 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f42a80c74c0 0x7f42a81f13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:13.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.747+0000 7f42af05b640 1 -- 10.20.193.5:0/3230552529 >> 10.20.193.5:0/3230552529 conn(0x7f42a80c9f20 msgr2=0x7f42a815b890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:13.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.747+0000 7f42af05b640 1 -- 10.20.193.5:0/3230552529 shutdown_connections 2026-02-17T21:28:13.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.747+0000 7f42af05b640 1 -- 10.20.193.5:0/3230552529 wait complete. 2026-02-17T21:28:13.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:13.747+0000 7f42af05b640 1 librados: shutdown 2026-02-17T21:28:16.759 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:28:16.827 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.823+0000 7f5643714640 10 monclient: get_monmap_and_config 2026-02-17T21:28:16.827 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.823+0000 7f5643714640 10 monclient: build_initial_monmap 2026-02-17T21:28:16.827 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.824+0000 7f5643714640 10 monclient: monmap: 2026-02-17T21:28:16.827 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:16.827 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:16.827 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:28:16.825658+0000 2026-02-17T21:28:16.827 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:28:16.825658+0000 2026-02-17T21:28:16.828 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:16.828 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:16.828 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:28:16.828 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:28:16.828 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:28:16.828 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:28:16.828 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:28:16.828 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:28:16.828 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:16.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.824+0000 7f5643714640 1 Processor -- start 2026-02-17T21:28:16.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.824+0000 7f5643714640 1 -- start start 2026-02-17T21:28:16.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.824+0000 7f5643714640 10 monclient: init 2026-02-17T21:28:16.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.824+0000 7f5643714640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:16.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.825+0000 7f5643714640 10 monclient: _add_conns ranks=[1,2,5,0,4,3] 2026-02-17T21:28:16.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.825+0000 7f5643714640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f563c0c7170 addr v1:10.20.193.119:6789/0 2026-02-17T21:28:16.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.825+0000 7f5643714640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f563c0c7550 addr v1:10.20.193.135:6789/0 2026-02-17T21:28:16.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.825+0000 7f5643714640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f563c0c89c0 0x7f563c0c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:16.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.825+0000 7f5643714640 10 monclient(hunting): picked mon.noname-c con 0x7f563c0c89c0 addr v2:10.20.193.135:3300/0 2026-02-17T21:28:16.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.825+0000 7f5643714640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f563c0c4fd0 con 0x7f563c0c7170 2026-02-17T21:28:16.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.825+0000 7f5643714640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f563c15a9a0 con 0x7f563c0c7550 2026-02-17T21:28:16.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.825+0000 7f5643714640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:16.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.825+0000 7f5643714640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f563c0c8530 con 0x7f563c0c89c0 2026-02-17T21:28:16.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.825+0000 7f5643714640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:16.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.825+0000 7f5643714640 10 monclient(hunting): authenticate will time out at 1202.391108s 2026-02-17T21:28:16.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.825+0000 7f5641489640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f563c0c7170 0x7f563c0c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:35772/0 (socket says 10.20.193.5:35772) 2026-02-17T21:28:16.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.825+0000 7f5641489640 1 -- 10.20.193.5:0/35659127 learned_addr learned my addr 10.20.193.5:0/35659127 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:28:16.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.825+0000 7f5641c8a640 1 --2- 10.20.193.5:0/35659127 >> v2:10.20.193.135:3300/0 conn(0x7f563c0c89c0 0x7f563c0c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:16.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.825+0000 7f5641c8a640 10 monclient(hunting): get_auth_request con 0x7f563c0c89c0 auth_method 0 2026-02-17T21:28:16.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.825+0000 7f5641c8a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:16.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.825+0000 7f5641c8a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:16.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.825+0000 7f5641c8a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:16.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.826+0000 7f5641c8a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:16.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.826+0000 7f5641c8a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:16.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.826+0000 7f5641c8a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:16.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.826+0000 7f562bfff640 1 -- 10.20.193.5:0/35659127 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3885382122 0 0) 0x7f563c0c4fd0 con 0x7f563c0c7170 2026-02-17T21:28:16.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.826+0000 7f562bfff640 10 monclient(hunting): _negotiate 2026-02-17T21:28:16.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.826+0000 7f562bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:16.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.826+0000 7f562bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:16.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.826+0000 7f562bfff640 10 monclient(hunting): my global_id is 4888 2026-02-17T21:28:16.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.826+0000 7f562bfff640 1 -- 10.20.193.5:0/35659127 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5624003620 con 0x7f563c0c7170 2026-02-17T21:28:16.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.827+0000 7f5641c8a640 10 monclient(hunting): handle_auth_done global_id 4883 payload 274 2026-02-17T21:28:16.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.827+0000 7f5641c8a640 1 -- 10.20.193.5:0/35659127 >> v1:10.20.193.135:6789/0 conn(0x7f563c0c7550 legacy=0x7f563c0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:16.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.827+0000 7f5641c8a640 1 -- 10.20.193.5:0/35659127 >> v1:10.20.193.119:6789/0 conn(0x7f563c0c7170 legacy=0x7f563c0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:16.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.827+0000 7f5641c8a640 10 monclient: _finish_hunting 0 2026-02-17T21:28:16.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.827+0000 7f5641c8a640 1 monclient: found mon.noname-c 2026-02-17T21:28:16.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.827+0000 7f5641c8a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:16.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.827+0000 7f5641c8a640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:28:16.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.827+0000 7f5641c8a640 1 -- 10.20.193.5:0/35659127 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f563c0c5270 con 0x7f563c0c89c0 2026-02-17T21:28:16.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.829+0000 7f5641c8a640 1 --2- 10.20.193.5:0/35659127 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f563c0c89c0 0x7f563c0c8e70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5638009d90 tx=0x7f563802f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ba2db3ed344fb36 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:16.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.831+0000 7f562bfff640 1 -- 10.20.193.5:0/35659127 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563803c070 con 0x7f563c0c89c0 2026-02-17T21:28:16.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.831+0000 7f562bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:16.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.831+0000 7f562bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:28:16.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.831+0000 7f562bfff640 10 monclient: dump: 2026-02-17T21:28:16.839 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:16.839 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:16.840 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:16.840 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:16.840 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:16.840 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:16.840 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:16.840 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:16.840 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:16.840 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:16.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.831+0000 7f562bfff640 10 monclient: _finish_auth 0 2026-02-17T21:28:16.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.831+0000 7f562bfff640 10 monclient: _check_auth_tickets 2026-02-17T21:28:16.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.831+0000 7f562bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:16.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.831+0000 7f562bfff640 1 -- 10.20.193.5:0/35659127 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5638037440 con 0x7f563c0c89c0 2026-02-17T21:28:16.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.831+0000 7f562bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:16.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.831+0000 7f5643714640 5 monclient: authenticate success, global_id 4883 2026-02-17T21:28:16.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.831+0000 7f562bfff640 1 -- 10.20.193.5:0/35659127 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5638037810 con 0x7f563c0c89c0 2026-02-17T21:28:16.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.831+0000 7f5643714640 10 monclient: get_monmap_and_config success 2026-02-17T21:28:16.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.831+0000 7f5643714640 4 set_mon_vals no callback set 2026-02-17T21:28:16.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.831+0000 7f562bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:16.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.831+0000 7f562bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:28:16.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.831+0000 7f562bfff640 10 monclient: dump: 2026-02-17T21:28:16.841 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:16.841 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:16.841 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:16.842 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:16.842 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:16.842 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:16.842 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:16.842 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:16.842 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:16.842 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:16.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.831+0000 7f5643714640 10 monclient: shutdown 2026-02-17T21:28:16.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.831+0000 7f5643714640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:16.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.831+0000 7f5643714640 1 -- 10.20.193.5:0/35659127 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f563c0c89c0 msgr2=0x7f563c0c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:16.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.831+0000 7f5643714640 1 --2- 10.20.193.5:0/35659127 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f563c0c89c0 0x7f563c0c8e70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5638009d90 tx=0x7f563802f230 comp rx=0 tx=0).stop 2026-02-17T21:28:16.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.831+0000 7f5643714640 1 -- 10.20.193.5:0/35659127 shutdown_connections 2026-02-17T21:28:16.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.831+0000 7f5643714640 1 --2- 10.20.193.5:0/35659127 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f563c0c89c0 0x7f563c0c8e70 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:16.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.831+0000 7f5643714640 1 -- 10.20.193.5:0/35659127 >> 10.20.193.5:0/35659127 conn(0x7f563c0c9f40 msgr2=0x7f563c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:16.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.831+0000 7f5643714640 1 -- 10.20.193.5:0/35659127 shutdown_connections 2026-02-17T21:28:16.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.831+0000 7f5643714640 1 -- 10.20.193.5:0/35659127 wait complete. 2026-02-17T21:28:16.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.832+0000 7f5643714640 10 monclient: build_initial_monmap 2026-02-17T21:28:16.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.832+0000 7f5643714640 10 monclient: monmap: 2026-02-17T21:28:16.843 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:16.843 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:28:16.843 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:28:16.843 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:28:16.843 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:16.844 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:16.844 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:28:16.844 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:28:16.844 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:28:16.844 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:16.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.832+0000 7f5643714640 1 librados: starting msgr at 2026-02-17T21:28:16.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.832+0000 7f5643714640 1 librados: starting objecter 2026-02-17T21:28:16.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.832+0000 7f5643714640 1 Processor -- start 2026-02-17T21:28:16.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.832+0000 7f5643714640 1 -- start start 2026-02-17T21:28:16.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.832+0000 7f5643714640 1 librados: setting wanted keys 2026-02-17T21:28:16.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.832+0000 7f5643714640 1 librados: calling monclient init 2026-02-17T21:28:16.845 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.832+0000 7f5643714640 10 monclient: init 2026-02-17T21:28:16.845 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5643714640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:16.845 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5643714640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:28:16.845 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5643714640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f563c0c7170 0x7f563c0c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:16.845 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5643714640 10 monclient(hunting): picked mon.noname-a con 0x7f563c0c7170 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:28:16.845 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5643714640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f563c0c7550 0x7f563c1f3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:16.845 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5643714640 10 monclient(hunting): picked mon.noname-b con 0x7f563c0c7550 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:28:16.845 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5643714640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f563c0c89c0 0x7f563c1f3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:16.845 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5643714640 10 monclient(hunting): picked mon.noname-c con 0x7f563c0c89c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:28:16.845 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5643714640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:16.845 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5643714640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f563c0c5830 con 0x7f563c0c7170 2026-02-17T21:28:16.845 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5643714640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:16.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5643714640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f563c0c93b0 con 0x7f563c0c7550 2026-02-17T21:28:16.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5643714640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:16.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5643714640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f563c0c7ee0 con 0x7f563c0c89c0 2026-02-17T21:28:16.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5643714640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:16.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5643714640 10 monclient(hunting): authenticate will time out at 1202.399152s 2026-02-17T21:28:16.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5641c8a640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f563c0c89c0 0x7f563c1f3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:16.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5641489640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f563c0c7170 0x7f563c0c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:16.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5640c88640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f563c0c7550 0x7f563c1f3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:16.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5641c8a640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f563c0c89c0 0x7f563c1f3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:53548/0 (socket says 10.20.193.5:53548) 2026-02-17T21:28:16.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5641c8a640 1 -- 10.20.193.5:0/1686664931 learned_addr learned my addr 10.20.193.5:0/1686664931 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:28:16.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5641c8a640 10 monclient(hunting): get_auth_request con 0x7f563c0c89c0 auth_method 0 2026-02-17T21:28:16.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5641c8a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:16.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5641c8a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:16.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5641c8a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:16.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5640c88640 10 monclient(hunting): get_auth_request con 0x7f563c0c7550 auth_method 0 2026-02-17T21:28:16.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5640c88640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:16.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5640c88640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:16.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5640c88640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:16.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5641489640 10 monclient(hunting): get_auth_request con 0x7f563c0c7170 auth_method 0 2026-02-17T21:28:16.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5641489640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:16.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5641489640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:16.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5641489640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:16.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5641c8a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:16.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5641c8a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:16.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.833+0000 7f5641c8a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:16.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.834+0000 7f5640c88640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:16.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.834+0000 7f5640c88640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:16.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.834+0000 7f5640c88640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:16.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.834+0000 7f5641489640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:16.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.834+0000 7f5641489640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:16.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.834+0000 7f5641489640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:16.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.835+0000 7f5641c8a640 10 monclient(hunting): handle_auth_done global_id 4889 payload 824 2026-02-17T21:28:16.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.835+0000 7f5641c8a640 1 -- 10.20.193.5:0/1686664931 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f563c0c7550 msgr2=0x7f563c1f3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:16.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.835+0000 7f5641c8a640 1 --2- 10.20.193.5:0/1686664931 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f563c0c7550 0x7f563c1f3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:16.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.835+0000 7f5641c8a640 1 -- 10.20.193.5:0/1686664931 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f563c0c7170 msgr2=0x7f563c0c3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:16.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.835+0000 7f5641c8a640 1 --2- 10.20.193.5:0/1686664931 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f563c0c7170 0x7f563c0c3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:16.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.835+0000 7f5641c8a640 10 monclient: _finish_hunting 0 2026-02-17T21:28:16.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.835+0000 7f5641c8a640 1 monclient: found mon.noname-c 2026-02-17T21:28:16.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.835+0000 7f5641c8a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:16.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.835+0000 7f5641c8a640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:28:16.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.835+0000 7f5641c8a640 1 -- 10.20.193.5:0/1686664931 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f563c1f6490 con 0x7f563c0c89c0 2026-02-17T21:28:16.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.836+0000 7f5641c8a640 1 --2- 10.20.193.5:0/1686664931 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f563c0c89c0 0x7f563c1f3a60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f563803a040 tx=0x7f5638004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:16.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.836+0000 7f5629ffb640 10 client.?.objecter ms_handle_connect 0x7f563c0c89c0 2026-02-17T21:28:16.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.836+0000 7f5629ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:28:16.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5629ffb640 1 -- 10.20.193.5:0/1686664931 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563803c050 con 0x7f563c0c89c0 2026-02-17T21:28:16.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5629ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:16.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5629ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:28:16.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5629ffb640 10 monclient: dump: 2026-02-17T21:28:16.852 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:16.852 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:16.852 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:16.852 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:16.852 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:16.852 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:16.852 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:16.852 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:16.852 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:16.853 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:16.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5629ffb640 10 monclient: _finish_auth 0 2026-02-17T21:28:16.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5629ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:28:16.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5629ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:16.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5629ffb640 1 -- 10.20.193.5:0/1686664931 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5638048070 con 0x7f563c0c89c0 2026-02-17T21:28:16.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5643714640 5 monclient: authenticate success, global_id 4889 2026-02-17T21:28:16.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5643714640 10 monclient: _renew_subs 2026-02-17T21:28:16.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5643714640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:28:16.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5643714640 1 -- 10.20.193.5:0/1686664931 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f563c1f6770 con 0x7f563c0c89c0 2026-02-17T21:28:16.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5629ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:16.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5629ffb640 1 -- 10.20.193.5:0/1686664931 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5638041a30 con 0x7f563c0c89c0 2026-02-17T21:28:16.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5629ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:16.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f562b7fe640 4 set_mon_vals no callback set 2026-02-17T21:28:16.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5629ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:28:16.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5629ffb640 10 monclient: dump: 2026-02-17T21:28:16.854 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:16.854 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:16.854 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:16.854 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:16.854 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:16.854 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:16.854 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:16.854 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:16.855 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:16.855 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:16.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5643714640 10 client.4889.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:28:16.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5643714640 10 monclient: _renew_subs 2026-02-17T21:28:16.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5643714640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:28:16.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5643714640 1 -- 10.20.193.5:0/1686664931 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f563c1f17a0 con 0x7f563c0c89c0 2026-02-17T21:28:16.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5643714640 1 librados: init done 2026-02-17T21:28:16.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5643714640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:16.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5643714640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:16.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5643714640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:28:16.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.838+0000 7f5643714640 1 -- 10.20.193.5:0/1686664931 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f563c0c81c0 con 0x7f563c0c89c0 2026-02-17T21:28:16.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.850+0000 7f5629ffb640 1 -- 10.20.193.5:0/1686664931 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f5638041bd0 con 0x7f563c0c89c0 2026-02-17T21:28:16.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.850+0000 7f5629ffb640 1 --2- 10.20.193.5:0/1686664931 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f560c0792d0 0x7f560c07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:16.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.851+0000 7f5641489640 1 --2- 10.20.193.5:0/1686664931 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f560c0792d0 0x7f560c07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:16.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.851+0000 7f5641489640 10 monclient: get_auth_request con 0x7f560c0792d0 auth_method 0 2026-02-17T21:28:16.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.851+0000 7f5629ffb640 1 -- 10.20.193.5:0/1686664931 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f5638084730 con 0x7f563c0c89c0 2026-02-17T21:28:16.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.851+0000 7f5629ffb640 10 client.4889.objecter ms_dispatch2 0x7f563c000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:28:16.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.851+0000 7f5629ffb640 3 client.4889.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:28:16.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.851+0000 7f5629ffb640 3 client.4889.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:28:16.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.851+0000 7f5629ffb640 20 client.4889.objecter dump_active .. 0 homeless 2026-02-17T21:28:16.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.851+0000 7f5641489640 1 --2- 10.20.193.5:0/1686664931 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f560c0792d0 0x7f560c07b790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f562c005980 tx=0x7f562c007dd0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:16.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.851+0000 7f5629ffb640 10 client.4889.objecter ms_handle_connect 0x7f560c0792d0 2026-02-17T21:28:16.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.952+0000 7f5629ffb640 1 -- 10.20.193.5:0/1686664931 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f56380886f0 con 0x7f563c0c89c0 2026-02-17T21:28:16.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.952+0000 7f5629ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:16.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:16.952+0000 7f5629ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:28:17.054 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.051+0000 7f5643714640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:28:17.054 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.051+0000 7f5643714640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:17.054 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.051+0000 7f5643714640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:28:17.054 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.051+0000 7f5643714640 1 -- 10.20.193.5:0/1686664931 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f563c0cad20 con 0x7f563c0c89c0 2026-02-17T21:28:17.055 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.054+0000 7f5629ffb640 1 -- 10.20.193.5:0/1686664931 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f563808c9f0 con 0x7f563c0c89c0 2026-02-17T21:28:17.056 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.054+0000 7f5629ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:17.056 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.054+0000 7f5629ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:28:17.056 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:28:17.056 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:28:17.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.054+0000 7f5643714640 10 librados: watch_flush enter 2026-02-17T21:28:17.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.054+0000 7f5643714640 10 librados: watch_flush exit 2026-02-17T21:28:17.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.054+0000 7f5643714640 20 client.4889.objecter shutdown clearing up homeless session... 2026-02-17T21:28:17.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.054+0000 7f5643714640 10 client.4889.objecter successfully canceled tick 2026-02-17T21:28:17.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.054+0000 7f5643714640 1 -- 10.20.193.5:0/1686664931 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f560c0792d0 msgr2=0x7f560c07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:17.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.054+0000 7f5643714640 1 --2- 10.20.193.5:0/1686664931 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f560c0792d0 0x7f560c07b790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f562c005980 tx=0x7f562c007dd0 comp rx=0 tx=0).stop 2026-02-17T21:28:17.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.054+0000 7f5643714640 10 monclient: shutdown 2026-02-17T21:28:17.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.054+0000 7f5643714640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:17.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.054+0000 7f5643714640 1 -- 10.20.193.5:0/1686664931 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f563c0c89c0 msgr2=0x7f563c1f3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:17.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.054+0000 7f5643714640 1 --2- 10.20.193.5:0/1686664931 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f563c0c89c0 0x7f563c1f3a60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f563803a040 tx=0x7f5638004b40 comp rx=0 tx=0).stop 2026-02-17T21:28:17.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.054+0000 7f5643714640 1 -- 10.20.193.5:0/1686664931 shutdown_connections 2026-02-17T21:28:17.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.054+0000 7f5643714640 1 --2- 10.20.193.5:0/1686664931 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f560c0792d0 0x7f560c07b790 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:17.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.054+0000 7f5643714640 1 --2- 10.20.193.5:0/1686664931 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f563c0c89c0 0x7f563c1f3a60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:17.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.054+0000 7f5643714640 1 --2- 10.20.193.5:0/1686664931 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f563c0c7550 0x7f563c1f3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:17.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.054+0000 7f5643714640 1 --2- 10.20.193.5:0/1686664931 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f563c0c7170 0x7f563c0c3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:17.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.054+0000 7f5643714640 1 -- 10.20.193.5:0/1686664931 >> 10.20.193.5:0/1686664931 conn(0x7f563c0c9f40 msgr2=0x7f563c0cb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:17.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.054+0000 7f5643714640 1 -- 10.20.193.5:0/1686664931 shutdown_connections 2026-02-17T21:28:17.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.054+0000 7f5643714640 1 -- 10.20.193.5:0/1686664931 wait complete. 2026-02-17T21:28:17.060 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:17.054+0000 7f5643714640 1 librados: shutdown 2026-02-17T21:28:17.552 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:04:57.177 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:17.555 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:04:57.180 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:17.562 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:04:57.188 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:17.581 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:04:57.166 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:17.581 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:04:57.204 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:17.581 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:04:57.205 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:17.583 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:04:57.169 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:17.589 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:04:57.213 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:17.590 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:04:57.176 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:20.066 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:28:20.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.135+0000 7f77e9e85640 10 monclient: get_monmap_and_config 2026-02-17T21:28:20.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.135+0000 7f77e9e85640 10 monclient: build_initial_monmap 2026-02-17T21:28:20.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.135+0000 7f77e9e85640 10 monclient: monmap: 2026-02-17T21:28:20.140 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:20.140 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:20.140 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:28:20.137249+0000 2026-02-17T21:28:20.140 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:28:20.137249+0000 2026-02-17T21:28:20.140 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:20.140 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:20.141 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:28:20.141 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:28:20.141 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:28:20.141 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:28:20.141 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:28:20.141 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:28:20.141 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:20.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.135+0000 7f77e9e85640 1 Processor -- start 2026-02-17T21:28:20.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.136+0000 7f77e9e85640 1 -- start start 2026-02-17T21:28:20.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.136+0000 7f77e9e85640 10 monclient: init 2026-02-17T21:28:20.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.136+0000 7f77e9e85640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:20.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.136+0000 7f77e9e85640 10 monclient: _add_conns ranks=[5,2,1,3,0,4] 2026-02-17T21:28:20.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.136+0000 7f77e9e85640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f77e40c7170 0x7f77e40c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:20.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.136+0000 7f77e9e85640 10 monclient(hunting): picked mon.noname-c con 0x7f77e40c7170 addr v2:10.20.193.135:3300/0 2026-02-17T21:28:20.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.136+0000 7f77e9e85640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f77e40c48c0 addr v1:10.20.193.135:6789/0 2026-02-17T21:28:20.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.136+0000 7f77e9e85640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f77e40c4d10 addr v1:10.20.193.119:6789/0 2026-02-17T21:28:20.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.136+0000 7f77e9e85640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77e415a9a0 con 0x7f77e40c4d10 2026-02-17T21:28:20.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.136+0000 7f77e9e85640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77e40c5270 con 0x7f77e40c48c0 2026-02-17T21:28:20.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.136+0000 7f77e9e85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:20.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.136+0000 7f77e9e85640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f77e40c8530 con 0x7f77e40c7170 2026-02-17T21:28:20.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.136+0000 7f77e9e85640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:20.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.136+0000 7f77e9e85640 10 monclient(hunting): authenticate will time out at 1205.702556s 2026-02-17T21:28:20.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.137+0000 7f77e3fff640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f77e40c4d10 0x7f77e40c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:47342/0 (socket says 10.20.193.5:47342) 2026-02-17T21:28:20.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.137+0000 7f77e3fff640 1 -- 10.20.193.5:0/3244095798 learned_addr learned my addr 10.20.193.5:0/3244095798 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:28:20.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.137+0000 7f77e37fe640 1 --2- 10.20.193.5:0/3244095798 >> v2:10.20.193.135:3300/0 conn(0x7f77e40c7170 0x7f77e40c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:20.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.137+0000 7f77e37fe640 10 monclient(hunting): get_auth_request con 0x7f77e40c7170 auth_method 0 2026-02-17T21:28:20.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.137+0000 7f77e37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:20.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.137+0000 7f77e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:20.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.137+0000 7f77e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:20.145 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.138+0000 7f77e37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:20.145 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.138+0000 7f77e37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:20.145 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.138+0000 7f77e37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:20.145 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.138+0000 7f77e27fc640 1 -- 10.20.193.5:0/3244095798 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3347607004 0 0) 0x7f77e415a9a0 con 0x7f77e40c4d10 2026-02-17T21:28:20.145 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.138+0000 7f77e27fc640 10 monclient(hunting): _negotiate 2026-02-17T21:28:20.145 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.138+0000 7f77e27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:20.145 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.138+0000 7f77e27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:20.145 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.138+0000 7f77e27fc640 10 monclient(hunting): my global_id is 4894 2026-02-17T21:28:20.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.138+0000 7f77e27fc640 1 -- 10.20.193.5:0/3244095798 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77c8003620 con 0x7f77e40c4d10 2026-02-17T21:28:20.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.139+0000 7f77e37fe640 10 monclient(hunting): handle_auth_done global_id 4892 payload 274 2026-02-17T21:28:20.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.139+0000 7f77e37fe640 1 -- 10.20.193.5:0/3244095798 >> v1:10.20.193.135:6789/0 conn(0x7f77e40c48c0 legacy=0x7f77e40749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:20.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.139+0000 7f77e37fe640 1 -- 10.20.193.5:0/3244095798 >> v1:10.20.193.119:6789/0 conn(0x7f77e40c4d10 legacy=0x7f77e40c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:20.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.139+0000 7f77e37fe640 10 monclient: _finish_hunting 0 2026-02-17T21:28:20.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.139+0000 7f77e37fe640 1 monclient: found mon.noname-c 2026-02-17T21:28:20.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.139+0000 7f77e37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:20.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.139+0000 7f77e37fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:28:20.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.139+0000 7f77e37fe640 1 -- 10.20.193.5:0/3244095798 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e40c5550 con 0x7f77e40c7170 2026-02-17T21:28:20.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.141+0000 7f77e37fe640 1 --2- 10.20.193.5:0/3244095798 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f77e40c7170 0x7f77e40c7550 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f77d00098a0 tx=0x7f77d002ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28157e5e15e14d96 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:20.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e27fc640 1 -- 10.20.193.5:0/3244095798 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d003c070 con 0x7f77e40c7170 2026-02-17T21:28:20.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:20.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:28:20.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e27fc640 10 monclient: dump: 2026-02-17T21:28:20.153 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:20.153 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:20.154 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:20.154 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:20.154 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:20.154 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:20.154 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:20.154 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:20.154 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:20.154 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:20.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e27fc640 10 monclient: _finish_auth 0 2026-02-17T21:28:20.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e27fc640 10 monclient: _check_auth_tickets 2026-02-17T21:28:20.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:20.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e27fc640 1 -- 10.20.193.5:0/3244095798 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77d002fb70 con 0x7f77e40c7170 2026-02-17T21:28:20.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e9e85640 5 monclient: authenticate success, global_id 4892 2026-02-17T21:28:20.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e9e85640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:28:20.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:20.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e27fc640 1 -- 10.20.193.5:0/3244095798 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d0037440 con 0x7f77e40c7170 2026-02-17T21:28:20.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e9e85640 10 monclient: get_monmap_and_config success 2026-02-17T21:28:20.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e9e85640 4 set_mon_vals no callback set 2026-02-17T21:28:20.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:20.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:28:20.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e27fc640 10 monclient: dump: 2026-02-17T21:28:20.155 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:20.155 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:20.155 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:20.156 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:20.156 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:20.156 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:20.156 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:20.156 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:20.156 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:20.156 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:20.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e9e85640 10 monclient: shutdown 2026-02-17T21:28:20.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e9e85640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:20.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e9e85640 1 -- 10.20.193.5:0/3244095798 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f77e40c7170 msgr2=0x7f77e40c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:20.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e9e85640 1 --2- 10.20.193.5:0/3244095798 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f77e40c7170 0x7f77e40c7550 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f77d00098a0 tx=0x7f77d002ee60 comp rx=0 tx=0).stop 2026-02-17T21:28:20.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e9e85640 1 -- 10.20.193.5:0/3244095798 shutdown_connections 2026-02-17T21:28:20.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e9e85640 1 --2- 10.20.193.5:0/3244095798 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f77e40c7170 0x7f77e40c7550 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:20.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e9e85640 1 -- 10.20.193.5:0/3244095798 >> 10.20.193.5:0/3244095798 conn(0x7f77e40c9f40 msgr2=0x7f77e40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:20.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e9e85640 1 -- 10.20.193.5:0/3244095798 shutdown_connections 2026-02-17T21:28:20.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.143+0000 7f77e9e85640 1 -- 10.20.193.5:0/3244095798 wait complete. 2026-02-17T21:28:20.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.144+0000 7f77e9e85640 10 monclient: build_initial_monmap 2026-02-17T21:28:20.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.144+0000 7f77e9e85640 10 monclient: monmap: 2026-02-17T21:28:20.157 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:20.157 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:28:20.157 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:28:20.157 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:28:20.157 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:20.157 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:20.158 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:28:20.158 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:28:20.158 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:28:20.158 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:20.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.144+0000 7f77e9e85640 1 librados: starting msgr at 2026-02-17T21:28:20.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.144+0000 7f77e9e85640 1 librados: starting objecter 2026-02-17T21:28:20.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.144+0000 7f77e9e85640 1 Processor -- start 2026-02-17T21:28:20.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.144+0000 7f77e9e85640 1 -- start start 2026-02-17T21:28:20.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.144+0000 7f77e9e85640 1 librados: setting wanted keys 2026-02-17T21:28:20.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.144+0000 7f77e9e85640 1 librados: calling monclient init 2026-02-17T21:28:20.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.144+0000 7f77e9e85640 10 monclient: init 2026-02-17T21:28:20.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e9e85640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:20.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e9e85640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:28:20.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e9e85640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f77e40c48c0 0x7f77e40c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:20.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e9e85640 10 monclient(hunting): picked mon.noname-c con 0x7f77e40c48c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:28:20.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e9e85640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f77e40c4d10 0x7f77e40c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:20.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e9e85640 10 monclient(hunting): picked mon.noname-a con 0x7f77e40c4d10 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:28:20.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e9e85640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f77e40c7170 0x7f77e4156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:20.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e9e85640 10 monclient(hunting): picked mon.noname-b con 0x7f77e40c7170 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:28:20.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e9e85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:20.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e9e85640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f77e40c81c0 con 0x7f77e40c4d10 2026-02-17T21:28:20.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e9e85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:20.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e9e85640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f77e40c7ee0 con 0x7f77e40c7170 2026-02-17T21:28:20.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e9e85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:20.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e9e85640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f77e40750c0 con 0x7f77e40c48c0 2026-02-17T21:28:20.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e9e85640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:20.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e9e85640 10 monclient(hunting): authenticate will time out at 1205.711142s 2026-02-17T21:28:20.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e3fff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f77e40c7170 0x7f77e4156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:20.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e37fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f77e40c48c0 0x7f77e40c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:20.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e2ffd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f77e40c4d10 0x7f77e40c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:20.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e37fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f77e40c48c0 0x7f77e40c1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:54424/0 (socket says 10.20.193.5:54424) 2026-02-17T21:28:20.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e3fff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f77e40c7170 0x7f77e4156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:39252/0 (socket says 10.20.193.5:39252) 2026-02-17T21:28:20.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e37fe640 1 -- 10.20.193.5:0/3510063853 learned_addr learned my addr 10.20.193.5:0/3510063853 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:28:20.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e37fe640 10 monclient(hunting): get_auth_request con 0x7f77e40c48c0 auth_method 0 2026-02-17T21:28:20.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:20.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:20.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:20.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e3fff640 10 monclient(hunting): get_auth_request con 0x7f77e40c7170 auth_method 0 2026-02-17T21:28:20.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:20.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:20.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:20.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e2ffd640 10 monclient(hunting): get_auth_request con 0x7f77e40c4d10 auth_method 0 2026-02-17T21:28:20.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:20.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:20.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:20.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:20.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:20.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:20.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:20.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:20.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.145+0000 7f77e3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:20.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.146+0000 7f77e2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:20.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.146+0000 7f77e2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:20.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.146+0000 7f77e2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:20.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.147+0000 7f77e37fe640 10 monclient(hunting): handle_auth_done global_id 4895 payload 824 2026-02-17T21:28:20.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.147+0000 7f77e37fe640 1 -- 10.20.193.5:0/3510063853 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f77e40c7170 msgr2=0x7f77e4156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:20.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.147+0000 7f77e37fe640 1 --2- 10.20.193.5:0/3510063853 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f77e40c7170 0x7f77e4156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:20.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.147+0000 7f77e37fe640 1 -- 10.20.193.5:0/3510063853 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f77e40c4d10 msgr2=0x7f77e40c20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:20.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.147+0000 7f77e37fe640 1 --2- 10.20.193.5:0/3510063853 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f77e40c4d10 0x7f77e40c20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:20.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.147+0000 7f77e37fe640 10 monclient: _finish_hunting 0 2026-02-17T21:28:20.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.147+0000 7f77e37fe640 1 monclient: found mon.noname-c 2026-02-17T21:28:20.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.147+0000 7f77e37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:20.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.147+0000 7f77e37fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:28:20.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.147+0000 7f77e37fe640 1 -- 10.20.193.5:0/3510063853 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e415b0a0 con 0x7f77e40c48c0 2026-02-17T21:28:20.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.148+0000 7f77e37fe640 1 --2- 10.20.193.5:0/3510063853 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f77e40c48c0 0x7f77e40c1bb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009130 tx=0x7f77d00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:20.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.148+0000 7f77bffff640 10 client.?.objecter ms_handle_connect 0x7f77e40c48c0 2026-02-17T21:28:20.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.148+0000 7f77bffff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:28:20.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.149+0000 7f77bffff640 1 -- 10.20.193.5:0/3510063853 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d003c040 con 0x7f77e40c48c0 2026-02-17T21:28:20.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.149+0000 7f77bffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:20.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.149+0000 7f77bffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:28:20.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.149+0000 7f77bffff640 10 monclient: dump: 2026-02-17T21:28:20.163 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:20.163 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:20.163 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:20.163 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:20.164 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:20.164 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:20.164 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:20.164 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:20.164 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:20.164 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:20.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.149+0000 7f77bffff640 10 monclient: _finish_auth 0 2026-02-17T21:28:20.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.149+0000 7f77bffff640 10 monclient: _check_auth_tickets 2026-02-17T21:28:20.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.149+0000 7f77bffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:20.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.149+0000 7f77e9e85640 5 monclient: authenticate success, global_id 4895 2026-02-17T21:28:20.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.149+0000 7f77e9e85640 10 monclient: _renew_subs 2026-02-17T21:28:20.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.149+0000 7f77e9e85640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:28:20.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.149+0000 7f77e9e85640 1 -- 10.20.193.5:0/3510063853 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77e415b380 con 0x7f77e40c48c0 2026-02-17T21:28:20.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.149+0000 7f77e9e85640 10 client.4895.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:28:20.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.149+0000 7f77e9e85640 10 monclient: _renew_subs 2026-02-17T21:28:20.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.149+0000 7f77e9e85640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:28:20.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.149+0000 7f77e9e85640 1 -- 10.20.193.5:0/3510063853 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77e415b940 con 0x7f77e40c48c0 2026-02-17T21:28:20.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.149+0000 7f77e9e85640 1 librados: init done 2026-02-17T21:28:20.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.150+0000 7f77e9e85640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:20.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.150+0000 7f77e9e85640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:20.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.150+0000 7f77e9e85640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:28:20.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.150+0000 7f77e9e85640 1 -- 10.20.193.5:0/3510063853 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77e40c7550 con 0x7f77e40c48c0 2026-02-17T21:28:20.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.150+0000 7f77bffff640 1 -- 10.20.193.5:0/3510063853 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77d002fab0 con 0x7f77e40c48c0 2026-02-17T21:28:20.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.150+0000 7f77bffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:20.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.150+0000 7f77bffff640 1 -- 10.20.193.5:0/3510063853 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d0042830 con 0x7f77e40c48c0 2026-02-17T21:28:20.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.150+0000 7f77bffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:20.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.150+0000 7f77bffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:28:20.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.150+0000 7f77e1ffb640 4 set_mon_vals no callback set 2026-02-17T21:28:20.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.150+0000 7f77bffff640 10 monclient: dump: 2026-02-17T21:28:20.166 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:20.166 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:20.166 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:20.166 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:20.166 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:20.166 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:20.166 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:20.166 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:20.166 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:20.167 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:20.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.256+0000 7f77bffff640 1 -- 10.20.193.5:0/3510063853 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f77d004b450 con 0x7f77e40c48c0 2026-02-17T21:28:20.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.257+0000 7f77bffff640 1 --2- 10.20.193.5:0/3510063853 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f77b4079280 0x7f77b407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:20.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.258+0000 7f77e2ffd640 1 --2- 10.20.193.5:0/3510063853 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f77b4079280 0x7f77b407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:20.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.258+0000 7f77e2ffd640 10 monclient: get_auth_request con 0x7f77b4079280 auth_method 0 2026-02-17T21:28:20.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.258+0000 7f77bffff640 1 -- 10.20.193.5:0/3510063853 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f77d0082d70 con 0x7f77e40c48c0 2026-02-17T21:28:20.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.258+0000 7f77bffff640 10 client.4895.objecter ms_dispatch2 0x7f77e4000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:28:20.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.258+0000 7f77bffff640 3 client.4895.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:28:20.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.258+0000 7f77bffff640 3 client.4895.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:28:20.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.258+0000 7f77bffff640 20 client.4895.objecter dump_active .. 0 homeless 2026-02-17T21:28:20.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.258+0000 7f77bffff640 10 client.4895.objecter ms_handle_connect 0x7f77b4079280 2026-02-17T21:28:20.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.258+0000 7f77e2ffd640 1 --2- 10.20.193.5:0/3510063853 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f77b4079280 0x7f77b407b740 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f77e415e3f0 tx=0x7f77d4007ef0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:20.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.264+0000 7f77bffff640 1 -- 10.20.193.5:0/3510063853 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f77d0086d30 con 0x7f77e40c48c0 2026-02-17T21:28:20.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.264+0000 7f77bffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:20.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.264+0000 7f77bffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:28:20.369 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.366+0000 7f77e9e85640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:28:20.369 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.366+0000 7f77e9e85640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:20.369 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.366+0000 7f77e9e85640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:28:20.369 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.366+0000 7f77e9e85640 1 -- 10.20.193.5:0/3510063853 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f77e414f580 con 0x7f77e40c48c0 2026-02-17T21:28:20.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.370+0000 7f77bffff640 1 -- 10.20.193.5:0/3510063853 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f77d008b030 con 0x7f77e40c48c0 2026-02-17T21:28:20.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.370+0000 7f77bffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:20.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.370+0000 7f77bffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:28:20.372 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:28:20.372 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:28:20.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.370+0000 7f77e9e85640 10 librados: watch_flush enter 2026-02-17T21:28:20.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.370+0000 7f77e9e85640 10 librados: watch_flush exit 2026-02-17T21:28:20.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.370+0000 7f77e9e85640 20 client.4895.objecter shutdown clearing up homeless session... 2026-02-17T21:28:20.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.370+0000 7f77e9e85640 10 client.4895.objecter successfully canceled tick 2026-02-17T21:28:20.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.370+0000 7f77e9e85640 1 -- 10.20.193.5:0/3510063853 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f77b4079280 msgr2=0x7f77b407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:20.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.370+0000 7f77e9e85640 1 --2- 10.20.193.5:0/3510063853 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f77b4079280 0x7f77b407b740 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f77e415e3f0 tx=0x7f77d4007ef0 comp rx=0 tx=0).stop 2026-02-17T21:28:20.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.370+0000 7f77e9e85640 10 monclient: shutdown 2026-02-17T21:28:20.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.370+0000 7f77e9e85640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:20.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.370+0000 7f77e9e85640 1 -- 10.20.193.5:0/3510063853 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f77e40c48c0 msgr2=0x7f77e40c1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:20.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.370+0000 7f77e9e85640 1 --2- 10.20.193.5:0/3510063853 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f77e40c48c0 0x7f77e40c1bb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009130 tx=0x7f77d00047c0 comp rx=0 tx=0).stop 2026-02-17T21:28:20.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.370+0000 7f77e9e85640 1 -- 10.20.193.5:0/3510063853 shutdown_connections 2026-02-17T21:28:20.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.370+0000 7f77e9e85640 1 --2- 10.20.193.5:0/3510063853 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f77b4079280 0x7f77b407b740 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:20.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.370+0000 7f77e9e85640 1 --2- 10.20.193.5:0/3510063853 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f77e40c7170 0x7f77e4156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:20.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.370+0000 7f77e9e85640 1 --2- 10.20.193.5:0/3510063853 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f77e40c4d10 0x7f77e40c20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:20.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.370+0000 7f77e9e85640 1 --2- 10.20.193.5:0/3510063853 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f77e40c48c0 0x7f77e40c1bb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:20.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.370+0000 7f77e9e85640 1 -- 10.20.193.5:0/3510063853 >> 10.20.193.5:0/3510063853 conn(0x7f77e40c9f40 msgr2=0x7f77e40cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:20.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.370+0000 7f77e9e85640 1 -- 10.20.193.5:0/3510063853 shutdown_connections 2026-02-17T21:28:20.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.370+0000 7f77e9e85640 1 -- 10.20.193.5:0/3510063853 wait complete. 2026-02-17T21:28:20.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:20.370+0000 7f77e9e85640 1 librados: shutdown 2026-02-17T21:28:23.382 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:28:23.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.450+0000 7f5eeb38f640 10 monclient: get_monmap_and_config 2026-02-17T21:28:23.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.450+0000 7f5eeb38f640 10 monclient: build_initial_monmap 2026-02-17T21:28:23.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.450+0000 7f5eeb38f640 10 monclient: monmap: 2026-02-17T21:28:23.453 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:23.453 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:23.453 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:28:23.451903+0000 2026-02-17T21:28:23.453 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:28:23.451903+0000 2026-02-17T21:28:23.454 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:23.454 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:23.454 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:28:23.454 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:28:23.454 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:28:23.454 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:28:23.454 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:28:23.454 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:28:23.454 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:23.454 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.450+0000 7f5eeb38f640 1 Processor -- start 2026-02-17T21:28:23.454 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.450+0000 7f5eeb38f640 1 -- start start 2026-02-17T21:28:23.454 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.450+0000 7f5eeb38f640 10 monclient: init 2026-02-17T21:28:23.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.451+0000 7f5eeb38f640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:23.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.451+0000 7f5eeb38f640 10 monclient: _add_conns ranks=[4,3,1,5,0,2] 2026-02-17T21:28:23.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.451+0000 7f5eeb38f640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f5ee40c7170 0x7f5ee40c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:23.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.451+0000 7f5eeb38f640 10 monclient(hunting): picked mon.noname-b con 0x7f5ee40c7170 addr v2:10.20.193.119:3300/0 2026-02-17T21:28:23.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.451+0000 7f5eeb38f640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f5ee40c48c0 0x7f5ee40749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:23.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.451+0000 7f5eeb38f640 10 monclient(hunting): picked mon.noname-a con 0x7f5ee40c48c0 addr v2:10.20.193.5:3300/0 2026-02-17T21:28:23.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.451+0000 7f5eeb38f640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f5ee4074ef0 addr v1:10.20.193.119:6789/0 2026-02-17T21:28:23.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.451+0000 7f5eeb38f640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ee415a9a0 con 0x7f5ee4074ef0 2026-02-17T21:28:23.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.451+0000 7f5eeb38f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:23.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.451+0000 7f5eeb38f640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5ee40c8530 con 0x7f5ee40c48c0 2026-02-17T21:28:23.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.451+0000 7f5eeb38f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:23.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.451+0000 7f5eeb38f640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f5ee40c5270 con 0x7f5ee40c7170 2026-02-17T21:28:23.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.451+0000 7f5eeb38f640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:23.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.451+0000 7f5eeb38f640 10 monclient(hunting): authenticate will time out at 1209.017208s 2026-02-17T21:28:23.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.451+0000 7f5ee8903640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f5ee40c48c0 0x7f5ee40749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:23.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.451+0000 7f5ee9104640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f5ee40c7170 0x7f5ee40c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:23.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.451+0000 7f5ee8903640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f5ee40c48c0 0x7f5ee40749b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:46806/0 (socket says 10.20.193.5:46806) 2026-02-17T21:28:23.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.451+0000 7f5ee8903640 1 -- 10.20.193.5:0/1622659746 learned_addr learned my addr 10.20.193.5:0/1622659746 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:28:23.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.451+0000 7f5ee8903640 10 monclient(hunting): get_auth_request con 0x7f5ee40c48c0 auth_method 0 2026-02-17T21:28:23.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.451+0000 7f5ee8903640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:23.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.451+0000 7f5ee8903640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:23.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.451+0000 7f5ee8903640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:23.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.451+0000 7f5ee8903640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:23.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.451+0000 7f5ee8903640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:23.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.451+0000 7f5ee8903640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:23.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.452+0000 7f5ee9104640 10 monclient(hunting): get_auth_request con 0x7f5ee40c7170 auth_method 0 2026-02-17T21:28:23.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.452+0000 7f5ee9104640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:23.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.452+0000 7f5ee9104640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:23.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.452+0000 7f5ee9104640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:23.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.452+0000 7f5ee9104640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:23.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.452+0000 7f5ee9104640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:23.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.452+0000 7f5ee9104640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:23.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.452+0000 7f5ee8903640 10 monclient(hunting): handle_auth_done global_id 4881 payload 274 2026-02-17T21:28:23.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.452+0000 7f5ee8903640 1 -- 10.20.193.5:0/1622659746 >> v2:10.20.193.119:3300/0 conn(0x7f5ee40c7170 msgr2=0x7f5ee40c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:28:23.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.452+0000 7f5ee8903640 1 --2- 10.20.193.5:0/1622659746 >> v2:10.20.193.119:3300/0 conn(0x7f5ee40c7170 0x7f5ee40c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:23.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.452+0000 7f5ee8903640 1 -- 10.20.193.5:0/1622659746 >> v1:10.20.193.119:6789/0 conn(0x7f5ee4074ef0 legacy=0x7f5ee40c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:23.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.452+0000 7f5ee8903640 10 monclient: _finish_hunting 0 2026-02-17T21:28:23.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.452+0000 7f5ee8903640 1 monclient: found mon.noname-a 2026-02-17T21:28:23.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.452+0000 7f5ee8903640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:23.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.452+0000 7f5ee8903640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:28:23.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.452+0000 7f5ee8903640 1 -- 10.20.193.5:0/1622659746 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee40c5550 con 0x7f5ee40c48c0 2026-02-17T21:28:23.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.453+0000 7f5ee8903640 1 --2- 10.20.193.5:0/1622659746 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5ee40c48c0 0x7f5ee40749b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40723c0 tx=0x7f5ed802eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9d8dca4f1a4e20 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:23.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.455+0000 7f5ed3fff640 1 -- 10.20.193.5:0/1622659746 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed803c070 con 0x7f5ee40c48c0 2026-02-17T21:28:23.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.455+0000 7f5ed3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:23.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.455+0000 7f5ed3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:28:23.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.455+0000 7f5ed3fff640 10 monclient: dump: 2026-02-17T21:28:23.468 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:23.468 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:23.468 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:23.469 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:23.469 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:23.469 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:23.469 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:23.469 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:23.469 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:23.469 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:23.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.455+0000 7f5ed3fff640 10 monclient: _finish_auth 0 2026-02-17T21:28:23.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.455+0000 7f5ed3fff640 10 monclient: _check_auth_tickets 2026-02-17T21:28:23.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.455+0000 7f5ed3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:23.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.455+0000 7f5ed3fff640 1 -- 10.20.193.5:0/1622659746 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ed802fbe0 con 0x7f5ee40c48c0 2026-02-17T21:28:23.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.455+0000 7f5eeb38f640 5 monclient: authenticate success, global_id 4881 2026-02-17T21:28:23.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.455+0000 7f5eeb38f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:28:23.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.455+0000 7f5ed3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:23.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.455+0000 7f5ed3fff640 1 -- 10.20.193.5:0/1622659746 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8037440 con 0x7f5ee40c48c0 2026-02-17T21:28:23.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.455+0000 7f5ed3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:23.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.455+0000 7f5ed3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:28:23.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.455+0000 7f5ed3fff640 10 monclient: dump: 2026-02-17T21:28:23.470 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:23.470 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:23.470 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:23.470 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:23.470 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:23.470 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:23.471 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:23.471 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:23.471 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:23.471 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:23.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.455+0000 7f5eeb38f640 10 monclient: get_monmap_and_config success 2026-02-17T21:28:23.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.455+0000 7f5eeb38f640 4 set_mon_vals no callback set 2026-02-17T21:28:23.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.455+0000 7f5eeb38f640 10 monclient: shutdown 2026-02-17T21:28:23.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.455+0000 7f5eeb38f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:23.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.455+0000 7f5eeb38f640 1 -- 10.20.193.5:0/1622659746 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5ee40c48c0 msgr2=0x7f5ee40749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:23.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.455+0000 7f5eeb38f640 1 --2- 10.20.193.5:0/1622659746 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5ee40c48c0 0x7f5ee40749b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40723c0 tx=0x7f5ed802eed0 comp rx=0 tx=0).stop 2026-02-17T21:28:23.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.456+0000 7f5eeb38f640 1 -- 10.20.193.5:0/1622659746 shutdown_connections 2026-02-17T21:28:23.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.456+0000 7f5eeb38f640 1 --2- 10.20.193.5:0/1622659746 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5ee40c48c0 0x7f5ee40749b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:23.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.456+0000 7f5eeb38f640 1 --2- 10.20.193.5:0/1622659746 >> v2:10.20.193.119:3300/0 conn(0x7f5ee40c7170 0x7f5ee40c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:23.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.456+0000 7f5eeb38f640 1 -- 10.20.193.5:0/1622659746 >> 10.20.193.5:0/1622659746 conn(0x7f5ee40c9f40 msgr2=0x7f5ee40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:23.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.456+0000 7f5eeb38f640 1 -- 10.20.193.5:0/1622659746 shutdown_connections 2026-02-17T21:28:23.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.456+0000 7f5eeb38f640 1 -- 10.20.193.5:0/1622659746 wait complete. 2026-02-17T21:28:23.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.456+0000 7f5eeb38f640 10 monclient: build_initial_monmap 2026-02-17T21:28:23.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.456+0000 7f5eeb38f640 10 monclient: monmap: 2026-02-17T21:28:23.472 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:23.472 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:28:23.472 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:28:23.472 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:28:23.472 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:23.472 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:23.473 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:28:23.473 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:28:23.473 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:28:23.473 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:23.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.456+0000 7f5eeb38f640 1 librados: starting msgr at 2026-02-17T21:28:23.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.456+0000 7f5eeb38f640 1 librados: starting objecter 2026-02-17T21:28:23.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.456+0000 7f5eeb38f640 1 Processor -- start 2026-02-17T21:28:23.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.456+0000 7f5eeb38f640 1 -- start start 2026-02-17T21:28:23.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.456+0000 7f5eeb38f640 1 librados: setting wanted keys 2026-02-17T21:28:23.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.456+0000 7f5eeb38f640 1 librados: calling monclient init 2026-02-17T21:28:23.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.456+0000 7f5eeb38f640 10 monclient: init 2026-02-17T21:28:23.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5eeb38f640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:23.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5eeb38f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:28:23.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5eeb38f640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5ee4074ef0 0x7f5ee41ed810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:23.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5eeb38f640 10 monclient(hunting): picked mon.noname-c con 0x7f5ee4074ef0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:28:23.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5eeb38f640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5ee40c48c0 0x7f5ee415cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:23.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5eeb38f640 10 monclient(hunting): picked mon.noname-b con 0x7f5ee40c48c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:28:23.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5eeb38f640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5ee40c7170 0x7f5ee415d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:23.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5eeb38f640 10 monclient(hunting): picked mon.noname-a con 0x7f5ee40c7170 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:28:23.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5eeb38f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:23.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5eeb38f640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee40c81c0 con 0x7f5ee40c7170 2026-02-17T21:28:23.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5eeb38f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:23.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5eeb38f640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee40c7ee0 con 0x7f5ee40c48c0 2026-02-17T21:28:23.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5eeb38f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:23.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5eeb38f640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee40c90d0 con 0x7f5ee4074ef0 2026-02-17T21:28:23.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5eeb38f640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:23.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5eeb38f640 10 monclient(hunting): authenticate will time out at 1209.023396s 2026-02-17T21:28:23.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5ee9905640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5ee40c7170 0x7f5ee415d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:23.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5ee8903640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5ee40c48c0 0x7f5ee415cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:23.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5ee9905640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5ee40c7170 0x7f5ee415d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:46816/0 (socket says 10.20.193.5:46816) 2026-02-17T21:28:23.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5ee9905640 1 -- 10.20.193.5:0/3884110371 learned_addr learned my addr 10.20.193.5:0/3884110371 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:28:23.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5ee9905640 10 monclient(hunting): get_auth_request con 0x7f5ee40c7170 auth_method 0 2026-02-17T21:28:23.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5ee9905640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:23.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5ee9905640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:23.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5ee9905640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:23.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5ee9104640 1 --2- 10.20.193.5:0/3884110371 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5ee4074ef0 0x7f5ee41ed810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:23.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5ee8903640 10 monclient(hunting): get_auth_request con 0x7f5ee40c48c0 auth_method 0 2026-02-17T21:28:23.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5ee8903640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:23.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5ee8903640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:23.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.457+0000 7f5ee8903640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:23.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.458+0000 7f5ee9905640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:23.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.458+0000 7f5ee9905640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:23.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.458+0000 7f5ee9905640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:23.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.458+0000 7f5ee9104640 10 monclient(hunting): get_auth_request con 0x7f5ee4074ef0 auth_method 0 2026-02-17T21:28:23.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.458+0000 7f5ee9104640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:23.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.458+0000 7f5ee9104640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:23.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.458+0000 7f5ee9104640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:23.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.458+0000 7f5ee8903640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:23.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.458+0000 7f5ee8903640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:23.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.458+0000 7f5ee8903640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:23.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.458+0000 7f5ee9104640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:23.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.458+0000 7f5ee9104640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:23.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.458+0000 7f5ee9104640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:23.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.459+0000 7f5ee9905640 10 monclient(hunting): handle_auth_done global_id 4884 payload 824 2026-02-17T21:28:23.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.459+0000 7f5ee9905640 1 -- 10.20.193.5:0/3884110371 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5ee4074ef0 msgr2=0x7f5ee41ed810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:23.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.459+0000 7f5ee9905640 1 --2- 10.20.193.5:0/3884110371 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5ee4074ef0 0x7f5ee41ed810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:23.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.459+0000 7f5ee9905640 1 -- 10.20.193.5:0/3884110371 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5ee40c48c0 msgr2=0x7f5ee415cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:23.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.459+0000 7f5ee9905640 1 --2- 10.20.193.5:0/3884110371 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5ee40c48c0 0x7f5ee415cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:23.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.459+0000 7f5ee9905640 10 monclient: _finish_hunting 0 2026-02-17T21:28:23.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.459+0000 7f5ee9905640 1 monclient: found mon.noname-a 2026-02-17T21:28:23.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.459+0000 7f5ee9905640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:23.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.459+0000 7f5ee9905640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:28:23.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.459+0000 7f5ee9905640 1 -- 10.20.193.5:0/3884110371 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee406d720 con 0x7f5ee40c7170 2026-02-17T21:28:23.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.460+0000 7f5ee9905640 1 --2- 10.20.193.5:0/3884110371 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5ee40c7170 0x7f5ee415d1c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5ee000cbe0 tx=0x7f5ee000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:23.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.460+0000 7f5ed1ffb640 10 client.?.objecter ms_handle_connect 0x7f5ee40c7170 2026-02-17T21:28:23.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.460+0000 7f5ed1ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:28:23.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.461+0000 7f5ed1ffb640 1 -- 10.20.193.5:0/3884110371 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee000ad60 con 0x7f5ee40c7170 2026-02-17T21:28:23.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.461+0000 7f5ed1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:23.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.461+0000 7f5ed1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:28:23.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.461+0000 7f5ed1ffb640 10 monclient: dump: 2026-02-17T21:28:23.478 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:23.478 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:23.478 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:23.479 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:23.479 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:23.479 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:23.479 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:23.479 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:23.479 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:23.479 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:23.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.461+0000 7f5ed1ffb640 10 monclient: _finish_auth 0 2026-02-17T21:28:23.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.461+0000 7f5ed1ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:28:23.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.461+0000 7f5ed1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:23.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.461+0000 7f5ed1ffb640 1 -- 10.20.193.5:0/3884110371 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ee0003a70 con 0x7f5ee40c7170 2026-02-17T21:28:23.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.461+0000 7f5eeb38f640 5 monclient: authenticate success, global_id 4884 2026-02-17T21:28:23.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.461+0000 7f5eeb38f640 10 monclient: _renew_subs 2026-02-17T21:28:23.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.461+0000 7f5eeb38f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:23.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.461+0000 7f5eeb38f640 1 -- 10.20.193.5:0/3884110371 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ee406da00 con 0x7f5ee40c7170 2026-02-17T21:28:23.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.461+0000 7f5ed1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:23.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.461+0000 7f5ed1ffb640 1 -- 10.20.193.5:0/3884110371 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0003e60 con 0x7f5ee40c7170 2026-02-17T21:28:23.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.461+0000 7f5ed1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:23.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.461+0000 7f5ed1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:28:23.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.461+0000 7f5ed1ffb640 10 monclient: dump: 2026-02-17T21:28:23.480 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:23.480 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:23.480 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:23.480 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:23.481 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:23.481 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:23.481 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:23.481 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:23.481 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:23.481 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:23.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.461+0000 7f5ed37fe640 4 set_mon_vals no callback set 2026-02-17T21:28:23.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.462+0000 7f5eeb38f640 10 client.4884.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:28:23.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.462+0000 7f5eeb38f640 10 monclient: _renew_subs 2026-02-17T21:28:23.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.462+0000 7f5eeb38f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:23.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.462+0000 7f5eeb38f640 1 -- 10.20.193.5:0/3884110371 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ee406dfc0 con 0x7f5ee40c7170 2026-02-17T21:28:23.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.462+0000 7f5eeb38f640 1 librados: init done 2026-02-17T21:28:23.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.462+0000 7f5eeb38f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:23.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.462+0000 7f5eeb38f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:23.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.462+0000 7f5eeb38f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:23.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.462+0000 7f5eeb38f640 1 -- 10.20.193.5:0/3884110371 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ee40c4d10 con 0x7f5ee40c7170 2026-02-17T21:28:23.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.474+0000 7f5ed1ffb640 1 -- 10.20.193.5:0/3884110371 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f5ee00050d0 con 0x7f5ee40c7170 2026-02-17T21:28:23.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.474+0000 7f5ed1ffb640 1 --2- 10.20.193.5:0/3884110371 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f5eb40792d0 0x7f5eb407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:23.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.474+0000 7f5ee9104640 1 --2- 10.20.193.5:0/3884110371 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f5eb40792d0 0x7f5eb407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:23.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.474+0000 7f5ee9104640 10 monclient: get_auth_request con 0x7f5eb40792d0 auth_method 0 2026-02-17T21:28:23.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.475+0000 7f5ee9104640 1 --2- 10.20.193.5:0/3884110371 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f5eb40792d0 0x7f5eb407b790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5ee415a8e0 tx=0x7f5ed4009290 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:23.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.475+0000 7f5ed1ffb640 10 client.4884.objecter ms_handle_connect 0x7f5eb40792d0 2026-02-17T21:28:23.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.476+0000 7f5ed1ffb640 1 -- 10.20.193.5:0/3884110371 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f5ee005eb10 con 0x7f5ee40c7170 2026-02-17T21:28:23.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.476+0000 7f5ed1ffb640 10 client.4884.objecter ms_dispatch2 0x7f5ee4000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:28:23.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.476+0000 7f5ed1ffb640 3 client.4884.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:28:23.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.476+0000 7f5ed1ffb640 3 client.4884.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:28:23.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.476+0000 7f5ed1ffb640 20 client.4884.objecter dump_active .. 0 homeless 2026-02-17T21:28:23.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.578+0000 7f5ed1ffb640 1 -- 10.20.193.5:0/3884110371 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5ee0062ad0 con 0x7f5ee40c7170 2026-02-17T21:28:23.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.578+0000 7f5ed1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:23.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.578+0000 7f5ed1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:28:23.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.681+0000 7f5eeb38f640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:28:23.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.681+0000 7f5eeb38f640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:23.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.681+0000 7f5eeb38f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:23.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.681+0000 7f5eeb38f640 1 -- 10.20.193.5:0/3884110371 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5ee415def0 con 0x7f5ee40c7170 2026-02-17T21:28:23.687 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.684+0000 7f5ed1ffb640 1 -- 10.20.193.5:0/3884110371 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f5ee0066dd0 con 0x7f5ee40c7170 2026-02-17T21:28:23.687 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.684+0000 7f5ed1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:23.687 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.684+0000 7f5ed1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:28:23.687 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:28:23.687 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:28:23.689 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.686+0000 7f5eeb38f640 10 librados: watch_flush enter 2026-02-17T21:28:23.689 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.686+0000 7f5eeb38f640 10 librados: watch_flush exit 2026-02-17T21:28:23.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.686+0000 7f5eeb38f640 20 client.4884.objecter shutdown clearing up homeless session... 2026-02-17T21:28:23.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.686+0000 7f5eeb38f640 10 client.4884.objecter successfully canceled tick 2026-02-17T21:28:23.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.686+0000 7f5eeb38f640 1 -- 10.20.193.5:0/3884110371 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f5eb40792d0 msgr2=0x7f5eb407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:23.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.686+0000 7f5eeb38f640 1 --2- 10.20.193.5:0/3884110371 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f5eb40792d0 0x7f5eb407b790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5ee415a8e0 tx=0x7f5ed4009290 comp rx=0 tx=0).stop 2026-02-17T21:28:23.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.686+0000 7f5eeb38f640 10 monclient: shutdown 2026-02-17T21:28:23.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.686+0000 7f5eeb38f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:23.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.686+0000 7f5eeb38f640 1 -- 10.20.193.5:0/3884110371 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5ee40c7170 msgr2=0x7f5ee415d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:23.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.686+0000 7f5eeb38f640 1 --2- 10.20.193.5:0/3884110371 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5ee40c7170 0x7f5ee415d1c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5ee000cbe0 tx=0x7f5ee000a430 comp rx=0 tx=0).stop 2026-02-17T21:28:23.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.686+0000 7f5eeb38f640 1 -- 10.20.193.5:0/3884110371 shutdown_connections 2026-02-17T21:28:23.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.686+0000 7f5eeb38f640 1 --2- 10.20.193.5:0/3884110371 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f5eb40792d0 0x7f5eb407b790 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:23.690 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.686+0000 7f5eeb38f640 1 --2- 10.20.193.5:0/3884110371 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5ee40c7170 0x7f5ee415d1c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:23.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.686+0000 7f5eeb38f640 1 --2- 10.20.193.5:0/3884110371 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5ee40c48c0 0x7f5ee415cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:23.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.686+0000 7f5eeb38f640 1 --2- 10.20.193.5:0/3884110371 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5ee4074ef0 0x7f5ee41ed810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:23.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.686+0000 7f5eeb38f640 1 -- 10.20.193.5:0/3884110371 >> 10.20.193.5:0/3884110371 conn(0x7f5ee40c9f40 msgr2=0x7f5ee40cc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:23.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.686+0000 7f5eeb38f640 1 -- 10.20.193.5:0/3884110371 shutdown_connections 2026-02-17T21:28:23.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.686+0000 7f5eeb38f640 1 -- 10.20.193.5:0/3884110371 wait complete. 2026-02-17T21:28:23.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:23.686+0000 7f5eeb38f640 1 librados: shutdown 2026-02-17T21:28:26.698 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:28:26.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.765+0000 7f53b2378640 10 monclient: get_monmap_and_config 2026-02-17T21:28:26.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.765+0000 7f53b2378640 10 monclient: build_initial_monmap 2026-02-17T21:28:26.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.765+0000 7f53b2378640 10 monclient: monmap: 2026-02-17T21:28:26.769 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:26.769 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:26.769 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:28:26.767554+0000 2026-02-17T21:28:26.769 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:28:26.767554+0000 2026-02-17T21:28:26.769 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:26.769 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:26.769 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:28:26.769 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:28:26.769 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:28:26.769 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:28:26.769 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:28:26.770 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:28:26.770 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:26.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.766+0000 7f53b2378640 1 Processor -- start 2026-02-17T21:28:26.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.766+0000 7f53b2378640 1 -- start start 2026-02-17T21:28:26.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.766+0000 7f53b2378640 10 monclient: init 2026-02-17T21:28:26.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.766+0000 7f53b2378640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:26.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.766+0000 7f53b2378640 10 monclient: _add_conns ranks=[2,1,0,4,3,5] 2026-02-17T21:28:26.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.766+0000 7f53b2378640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f53ac0cb350 addr v1:10.20.193.135:6789/0 2026-02-17T21:28:26.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.766+0000 7f53b2378640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f53ac06d800 addr v1:10.20.193.119:6789/0 2026-02-17T21:28:26.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.766+0000 7f53b2378640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f53ac0714f0 addr v1:10.20.193.5:6789/0 2026-02-17T21:28:26.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.766+0000 7f53b2378640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53ac06c930 con 0x7f53ac0714f0 2026-02-17T21:28:26.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.766+0000 7f53b2378640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53ac0cceb0 con 0x7f53ac06d800 2026-02-17T21:28:26.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.766+0000 7f53b2378640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53ac15cdc0 con 0x7f53ac0cb350 2026-02-17T21:28:26.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.766+0000 7f53b2378640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:26.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.766+0000 7f53b2378640 10 monclient(hunting): authenticate will time out at 1212.332959s 2026-02-17T21:28:26.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.767+0000 7f53ab7fe640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f53ac06d800 0x7f53ac159220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:47370/0 (socket says 10.20.193.5:47370) 2026-02-17T21:28:26.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.767+0000 7f53ab7fe640 1 -- 10.20.193.5:0/2702543598 learned_addr learned my addr 10.20.193.5:0/2702543598 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:28:26.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.768+0000 7f53aaffd640 1 -- 10.20.193.5:0/2702543598 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2969524292 0 0) 0x7f53ac0cceb0 con 0x7f53ac06d800 2026-02-17T21:28:26.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.768+0000 7f53aaffd640 10 monclient(hunting): _negotiate 2026-02-17T21:28:26.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.768+0000 7f53aaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:26.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.768+0000 7f53aaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:26.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.768+0000 7f53aaffd640 10 monclient(hunting): my global_id is 4909 2026-02-17T21:28:26.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.768+0000 7f53aaffd640 1 -- 10.20.193.5:0/2702543598 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5390003620 con 0x7f53ac06d800 2026-02-17T21:28:26.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.768+0000 7f53aaffd640 1 -- 10.20.193.5:0/2702543598 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1630873142 0 0) 0x7f53ac06c930 con 0x7f53ac0714f0 2026-02-17T21:28:26.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.768+0000 7f53aaffd640 10 monclient(hunting): _negotiate 2026-02-17T21:28:26.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.768+0000 7f53aaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:26.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.768+0000 7f53aaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:26.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.768+0000 7f53aaffd640 10 monclient(hunting): my global_id is 4887 2026-02-17T21:28:26.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.768+0000 7f53aaffd640 1 -- 10.20.193.5:0/2702543598 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53ac0cceb0 con 0x7f53ac0714f0 2026-02-17T21:28:26.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.768+0000 7f53aaffd640 1 -- 10.20.193.5:0/2702543598 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1786875759 0 0) 0x7f53ac15cdc0 con 0x7f53ac0cb350 2026-02-17T21:28:26.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.768+0000 7f53aaffd640 10 monclient(hunting): _negotiate 2026-02-17T21:28:26.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.768+0000 7f53aaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:26.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.768+0000 7f53aaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:26.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.768+0000 7f53aaffd640 10 monclient(hunting): my global_id is 4901 2026-02-17T21:28:26.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.768+0000 7f53aaffd640 1 -- 10.20.193.5:0/2702543598 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53ac06c930 con 0x7f53ac0cb350 2026-02-17T21:28:26.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 1 -- 10.20.193.5:0/2702543598 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2218664679 0 0) 0x7f5390003620 con 0x7f53ac06d800 2026-02-17T21:28:26.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 1 -- 10.20.193.5:0/2702543598 >> v1:10.20.193.135:6789/0 conn(0x7f53ac0cb350 legacy=0x7f53ac06d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:26.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 1 -- 10.20.193.5:0/2702543598 >> v1:10.20.193.5:6789/0 conn(0x7f53ac0714f0 legacy=0x7f53ac167a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:26.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 10 monclient: _finish_hunting 0 2026-02-17T21:28:26.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 1 monclient: found mon.noname-b-legacy 2026-02-17T21:28:26.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:26.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.119:6789/0 2026-02-17T21:28:26.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 1 -- 10.20.193.5:0/2702543598 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ac15d0a0 con 0x7f53ac06d800 2026-02-17T21:28:26.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 10 monclient: _finish_auth 0 2026-02-17T21:28:26.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 10 monclient: _check_auth_tickets 2026-02-17T21:28:26.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:26.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 1 -- 10.20.193.5:0/2702543598 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3880376286 0 0) 0x7f539c002f00 con 0x7f53ac06d800 2026-02-17T21:28:26.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:26.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T21:28:26.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 10 monclient: dump: 2026-02-17T21:28:26.787 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:26.787 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:26.787 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:26.787 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:26.787 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:26.788 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:26.788 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:26.788 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:26.788 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:26.788 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:26.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] but i'm connected to v1:10.20.193.119:6789/0, reconnecting 2026-02-17T21:28:26.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:26.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 1 -- 10.20.193.5:0/2702543598 >> v1:10.20.193.119:6789/0 conn(0x7f53ac06d800 legacy=0x7f53ac159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:26.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:28:26.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 1 --2- 10.20.193.5:0/2702543598 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5390003fe0 0x7f5390004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:26.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 10 monclient(hunting): picked mon.a con 0x7f5390003fe0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:28:26.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 1 --2- 10.20.193.5:0/2702543598 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5390004e40 0x7f53900052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:26.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 10 monclient(hunting): picked mon.b con 0x7f5390004e40 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:28:26.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 1 --2- 10.20.193.5:0/2702543598 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5390009ab0 0x7f539000bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:26.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 10 monclient(hunting): picked mon.c con 0x7f5390009ab0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:28:26.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:26.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 1 -- 10.20.193.5:0/2702543598 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f539000c490 con 0x7f5390003fe0 2026-02-17T21:28:26.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:26.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 1 -- 10.20.193.5:0/2702543598 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f539000c640 con 0x7f5390004e40 2026-02-17T21:28:26.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:26.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 1 -- 10.20.193.5:0/2702543598 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f539000c840 con 0x7f5390009ab0 2026-02-17T21:28:26.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:26.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.770+0000 7f53aaffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:28:26.790 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.771+0000 7f53abfff640 1 --2- 10.20.193.5:0/2702543598 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5390003fe0 0x7f5390004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:26.790 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.771+0000 7f53b08ee640 1 --2- 10.20.193.5:0/2702543598 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5390009ab0 0x7f539000bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:26.790 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.771+0000 7f53b08ee640 10 monclient(hunting): get_auth_request con 0x7f5390009ab0 auth_method 0 2026-02-17T21:28:26.790 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.771+0000 7f53b08ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:26.790 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.771+0000 7f53b08ee640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:26.790 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.771+0000 7f53b08ee640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:28:26.790 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.772+0000 7f53abfff640 10 monclient(hunting): get_auth_request con 0x7f5390003fe0 auth_method 0 2026-02-17T21:28:26.790 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.772+0000 7f53abfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:26.790 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.772+0000 7f53abfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:26.790 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.772+0000 7f53abfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:28:26.790 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.772+0000 7f53b08ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:26.790 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.772+0000 7f53b08ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:26.790 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.772+0000 7f53b08ee640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:28:26.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.772+0000 7f53ab7fe640 1 --2- 10.20.193.5:0/2702543598 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5390004e40 0x7f53900052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:26.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.772+0000 7f53abfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:26.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.772+0000 7f53abfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:26.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.772+0000 7f53abfff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:28:26.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.772+0000 7f53ab7fe640 10 monclient(hunting): get_auth_request con 0x7f5390004e40 auth_method 0 2026-02-17T21:28:26.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.772+0000 7f53ab7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:26.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.772+0000 7f53ab7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:26.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.772+0000 7f53ab7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:28:26.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.772+0000 7f53ab7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:26.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.772+0000 7f53ab7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:26.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.772+0000 7f53ab7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:28:26.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.773+0000 7f53b08ee640 10 monclient(hunting): handle_auth_done global_id 4909 payload 293 2026-02-17T21:28:26.792 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.773+0000 7f53b08ee640 1 -- 10.20.193.5:0/2702543598 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5390004e40 msgr2=0x7f53900052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:28:26.792 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.773+0000 7f53b08ee640 1 --2- 10.20.193.5:0/2702543598 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5390004e40 0x7f53900052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:26.792 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.773+0000 7f53b08ee640 1 -- 10.20.193.5:0/2702543598 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5390003fe0 msgr2=0x7f5390004900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:28:26.792 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.773+0000 7f53b08ee640 1 --2- 10.20.193.5:0/2702543598 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5390003fe0 0x7f5390004900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:26.792 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.773+0000 7f53b08ee640 10 monclient: _finish_hunting 0 2026-02-17T21:28:26.792 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.773+0000 7f53b08ee640 1 monclient: found mon.c 2026-02-17T21:28:26.792 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.773+0000 7f53b08ee640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:26.792 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.773+0000 7f53b08ee640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:28:26.792 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.773+0000 7f53b08ee640 1 -- 10.20.193.5:0/2702543598 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5390003620 con 0x7f5390009ab0 2026-02-17T21:28:26.792 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.773+0000 7f53b08ee640 10 monclient: _finish_auth 0 2026-02-17T21:28:26.792 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.773+0000 7f53b08ee640 10 monclient: _check_auth_tickets 2026-02-17T21:28:26.792 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.773+0000 7f53b08ee640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:26.792 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.773+0000 7f53b2378640 5 monclient: authenticate success, global_id 4909 2026-02-17T21:28:26.793 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.773+0000 7f53b2378640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:28:26.793 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.773+0000 7f53b08ee640 1 -- 10.20.193.5:0/2702543598 reap_dead start 2026-02-17T21:28:26.793 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.774+0000 7f53b08ee640 1 --2- 10.20.193.5:0/2702543598 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5390009ab0 0x7f539000bea0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f53a000c320 tx=0x7f53a002f630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e77492b98ecb15ac server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:26.793 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.775+0000 7f53aaffd640 1 -- 10.20.193.5:0/2702543598 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a00038b0 con 0x7f5390009ab0 2026-02-17T21:28:26.793 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.775+0000 7f53aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:26.793 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.775+0000 7f53aaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:28:26.793 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.775+0000 7f53aaffd640 10 monclient: dump: 2026-02-17T21:28:26.793 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:26.793 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:26.793 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:26.793 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:26.793 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:26.794 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:26.794 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:26.794 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:26.794 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:26.794 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:26.794 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.775+0000 7f53aaffd640 1 -- 10.20.193.5:0/2702543598 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53a0003c70 con 0x7f5390009ab0 2026-02-17T21:28:26.794 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.775+0000 7f53b2378640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:28:26.794 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.775+0000 7f53aaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:26.794 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.775+0000 7f53aaffd640 1 -- 10.20.193.5:0/2702543598 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a0005310 con 0x7f5390009ab0 2026-02-17T21:28:26.794 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.775+0000 7f53aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:26.794 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.775+0000 7f53aaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:28:26.794 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.775+0000 7f53aaffd640 10 monclient: dump: 2026-02-17T21:28:26.794 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:26.795 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:26.795 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:26.795 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:26.795 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:26.795 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:26.795 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:26.795 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:26.795 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:26.795 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:26.795 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.775+0000 7f53b2378640 10 monclient: get_monmap_and_config success 2026-02-17T21:28:26.795 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.775+0000 7f53b2378640 4 set_mon_vals no callback set 2026-02-17T21:28:26.795 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.776+0000 7f53b2378640 10 monclient: shutdown 2026-02-17T21:28:26.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.776+0000 7f53b2378640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:26.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.776+0000 7f53b2378640 1 -- 10.20.193.5:0/2702543598 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5390009ab0 msgr2=0x7f539000bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:26.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.776+0000 7f53b2378640 1 --2- 10.20.193.5:0/2702543598 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5390009ab0 0x7f539000bea0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f53a000c320 tx=0x7f53a002f630 comp rx=0 tx=0).stop 2026-02-17T21:28:26.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.776+0000 7f53b2378640 1 -- 10.20.193.5:0/2702543598 shutdown_connections 2026-02-17T21:28:26.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.776+0000 7f53b2378640 1 --2- 10.20.193.5:0/2702543598 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5390009ab0 0x7f539000bea0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:26.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.776+0000 7f53b2378640 1 -- 10.20.193.5:0/2702543598 >> 10.20.193.5:0/2702543598 conn(0x7f53ac0cc1d0 msgr2=0x7f53ac0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:26.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.776+0000 7f53b2378640 1 -- 10.20.193.5:0/2702543598 shutdown_connections 2026-02-17T21:28:26.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.776+0000 7f53b2378640 1 -- 10.20.193.5:0/2702543598 wait complete. 2026-02-17T21:28:26.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.776+0000 7f53b2378640 10 monclient: build_initial_monmap 2026-02-17T21:28:26.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.776+0000 7f53b2378640 10 monclient: monmap: 2026-02-17T21:28:26.796 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:26.796 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:28:26.796 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:28:26.797 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:28:26.797 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:26.797 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:26.797 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:28:26.797 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:28:26.797 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:28:26.797 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:26.797 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.777+0000 7f53b2378640 1 librados: starting msgr at 2026-02-17T21:28:26.797 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.777+0000 7f53b2378640 1 librados: starting objecter 2026-02-17T21:28:26.797 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.777+0000 7f53b2378640 1 Processor -- start 2026-02-17T21:28:26.797 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.777+0000 7f53b2378640 1 -- start start 2026-02-17T21:28:26.797 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.777+0000 7f53b2378640 1 librados: setting wanted keys 2026-02-17T21:28:26.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.777+0000 7f53b2378640 1 librados: calling monclient init 2026-02-17T21:28:26.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.777+0000 7f53b2378640 10 monclient: init 2026-02-17T21:28:26.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.777+0000 7f53b2378640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:26.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.777+0000 7f53b2378640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:28:26.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.777+0000 7f53b2378640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5390009ab0 0x7f53ac0c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:26.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.777+0000 7f53b2378640 10 monclient(hunting): picked mon.noname-b con 0x7f5390009ab0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:28:26.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.777+0000 7f53b2378640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f53ac0c8a10 0x7f53ac1f4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:26.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.777+0000 7f53b2378640 10 monclient(hunting): picked mon.noname-c con 0x7f53ac0c8a10 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:28:26.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.777+0000 7f53b2378640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f53ac1f5340 0x7f53ac14ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:26.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.777+0000 7f53b2378640 10 monclient(hunting): picked mon.noname-a con 0x7f53ac1f5340 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:28:26.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.777+0000 7f53b2378640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:26.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.777+0000 7f53b2378640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac074ab0 con 0x7f53ac1f5340 2026-02-17T21:28:26.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.777+0000 7f53b2378640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:26.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.777+0000 7f53b2378640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac06cc60 con 0x7f5390009ab0 2026-02-17T21:28:26.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.777+0000 7f53b2378640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:26.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.777+0000 7f53b2378640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac069130 con 0x7f53ac0c8a10 2026-02-17T21:28:26.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.777+0000 7f53b2378640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:26.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.777+0000 7f53b2378640 10 monclient(hunting): authenticate will time out at 1212.343670s 2026-02-17T21:28:26.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.777+0000 7f53b08ee640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f53ac1f5340 0x7f53ac14ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:26.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.777+0000 7f53abfff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5390009ab0 0x7f53ac0c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:26.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.778+0000 7f53ab7fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f53ac0c8a10 0x7f53ac1f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:26.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.778+0000 7f53abfff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5390009ab0 0x7f53ac0c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:39308/0 (socket says 10.20.193.5:39308) 2026-02-17T21:28:26.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.778+0000 7f53abfff640 1 -- 10.20.193.5:0/2930738887 learned_addr learned my addr 10.20.193.5:0/2930738887 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:28:26.799 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.778+0000 7f53abfff640 10 monclient(hunting): get_auth_request con 0x7f5390009ab0 auth_method 0 2026-02-17T21:28:26.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.778+0000 7f53abfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:26.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.778+0000 7f53abfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:26.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.778+0000 7f53abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:26.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.778+0000 7f53b08ee640 10 monclient(hunting): get_auth_request con 0x7f53ac1f5340 auth_method 0 2026-02-17T21:28:26.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.778+0000 7f53b08ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:26.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.778+0000 7f53b08ee640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:26.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.778+0000 7f53b08ee640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:26.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.778+0000 7f53ab7fe640 10 monclient(hunting): get_auth_request con 0x7f53ac0c8a10 auth_method 0 2026-02-17T21:28:26.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.778+0000 7f53ab7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:26.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.778+0000 7f53ab7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:26.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.778+0000 7f53ab7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:26.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.778+0000 7f53abfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:26.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.778+0000 7f53abfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:26.800 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.778+0000 7f53abfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:26.801 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.778+0000 7f53b08ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:26.801 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.778+0000 7f53b08ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:26.801 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.778+0000 7f53b08ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:26.801 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.778+0000 7f53ab7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:26.801 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.778+0000 7f53ab7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:26.801 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.778+0000 7f53ab7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:26.801 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.779+0000 7f53abfff640 10 monclient(hunting): handle_auth_done global_id 4912 payload 824 2026-02-17T21:28:26.801 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.779+0000 7f53abfff640 1 -- 10.20.193.5:0/2930738887 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f53ac0c8a10 msgr2=0x7f53ac1f4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:26.801 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.779+0000 7f53abfff640 1 --2- 10.20.193.5:0/2930738887 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f53ac0c8a10 0x7f53ac1f4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:26.801 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.779+0000 7f53abfff640 1 -- 10.20.193.5:0/2930738887 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f53ac1f5340 msgr2=0x7f53ac14ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:26.801 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.779+0000 7f53abfff640 1 --2- 10.20.193.5:0/2930738887 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f53ac1f5340 0x7f53ac14ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:26.801 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.779+0000 7f53abfff640 10 monclient: _finish_hunting 0 2026-02-17T21:28:26.801 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.779+0000 7f53abfff640 1 monclient: found mon.noname-b 2026-02-17T21:28:26.801 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.779+0000 7f53abfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:26.802 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.779+0000 7f53abfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:28:26.802 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.779+0000 7f53abfff640 1 -- 10.20.193.5:0/2930738887 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ac1f57d0 con 0x7f5390009ab0 2026-02-17T21:28:26.802 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.780+0000 7f53abfff640 1 --2- 10.20.193.5:0/2930738887 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5390009ab0 0x7f53ac0c84d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f539800ebc0 tx=0x7f539800c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:26.802 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.780+0000 7f53a8ff9640 10 client.?.objecter ms_handle_connect 0x7f5390009ab0 2026-02-17T21:28:26.802 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.780+0000 7f53a8ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:28:26.802 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.781+0000 7f53a8ff9640 1 -- 10.20.193.5:0/2930738887 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539800cad0 con 0x7f5390009ab0 2026-02-17T21:28:26.802 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.781+0000 7f53a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:26.802 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.781+0000 7f53a8ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:28:26.802 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.781+0000 7f53a8ff9640 10 monclient: dump: 2026-02-17T21:28:26.802 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:26.802 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:26.802 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:26.802 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:26.802 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:26.803 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:26.803 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:26.803 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:26.803 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:26.803 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:26.803 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.781+0000 7f53a8ff9640 10 monclient: _finish_auth 0 2026-02-17T21:28:26.803 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.781+0000 7f53a8ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:28:26.803 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.781+0000 7f53a8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:26.803 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.781+0000 7f53b2378640 5 monclient: authenticate success, global_id 4912 2026-02-17T21:28:26.803 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.781+0000 7f53b2378640 10 monclient: _renew_subs 2026-02-17T21:28:26.803 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.781+0000 7f53b2378640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:26.803 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.781+0000 7f53b2378640 1 -- 10.20.193.5:0/2930738887 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53ac1f7170 con 0x7f5390009ab0 2026-02-17T21:28:26.803 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.781+0000 7f53b2378640 10 client.4912.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:28:26.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.781+0000 7f53b2378640 10 monclient: _renew_subs 2026-02-17T21:28:26.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.781+0000 7f53b2378640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:26.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.781+0000 7f53b2378640 1 -- 10.20.193.5:0/2930738887 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53ac15b460 con 0x7f5390009ab0 2026-02-17T21:28:26.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.781+0000 7f53b2378640 1 librados: init done 2026-02-17T21:28:26.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.782+0000 7f53b2378640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:26.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.782+0000 7f53b2378640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:26.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.782+0000 7f53b2378640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:26.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.782+0000 7f53b2378640 1 -- 10.20.193.5:0/2930738887 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53ac073080 con 0x7f5390009ab0 2026-02-17T21:28:26.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.782+0000 7f53a8ff9640 1 -- 10.20.193.5:0/2930738887 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f539801a070 con 0x7f5390009ab0 2026-02-17T21:28:26.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.782+0000 7f53a8ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:26.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.782+0000 7f53a8ff9640 1 -- 10.20.193.5:0/2930738887 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539801f460 con 0x7f5390009ab0 2026-02-17T21:28:26.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.782+0000 7f53a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:26.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.782+0000 7f53a8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:28:26.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.782+0000 7f53aa7fc640 4 set_mon_vals no callback set 2026-02-17T21:28:26.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.782+0000 7f53a8ff9640 10 monclient: dump: 2026-02-17T21:28:26.805 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:26.805 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:26.805 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:26.805 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:26.805 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:26.805 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:26.805 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:26.805 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:26.805 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:26.805 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:26.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.887+0000 7f53a8ff9640 1 -- 10.20.193.5:0/2930738887 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f5398014070 con 0x7f5390009ab0 2026-02-17T21:28:26.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.888+0000 7f53a8ff9640 1 --2- 10.20.193.5:0/2930738887 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f537c0792b0 0x7f537c07b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:26.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.888+0000 7f53ab7fe640 1 --2- 10.20.193.5:0/2930738887 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f537c0792b0 0x7f537c07b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:26.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.888+0000 7f53ab7fe640 10 monclient: get_auth_request con 0x7f537c0792b0 auth_method 0 2026-02-17T21:28:26.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.889+0000 7f53a8ff9640 1 -- 10.20.193.5:0/2930738887 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f539805ec90 con 0x7f5390009ab0 2026-02-17T21:28:26.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.889+0000 7f53a8ff9640 10 client.4912.objecter ms_dispatch2 0x7f53ac000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:28:26.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.889+0000 7f53a8ff9640 3 client.4912.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:28:26.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.889+0000 7f53a8ff9640 3 client.4912.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:28:26.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.889+0000 7f53a8ff9640 20 client.4912.objecter dump_active .. 0 homeless 2026-02-17T21:28:26.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.889+0000 7f53a8ff9640 10 client.4912.objecter ms_handle_connect 0x7f537c0792b0 2026-02-17T21:28:26.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.889+0000 7f53ab7fe640 1 --2- 10.20.193.5:0/2930738887 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f537c0792b0 0x7f537c07b770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f53ac0c9020 tx=0x7f539c0023d0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:26.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.895+0000 7f53a8ff9640 1 -- 10.20.193.5:0/2930738887 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f53ac073080 con 0x7f5390009ab0 2026-02-17T21:28:26.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.895+0000 7f53a8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:26.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.895+0000 7f53a8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:28:26.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.996+0000 7f53b2378640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:28:26.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.996+0000 7f53b2378640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:26.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.996+0000 7f53b2378640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:26.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.996+0000 7f53b2378640 1 -- 10.20.193.5:0/2930738887 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f53ac0c94a0 con 0x7f5390009ab0 2026-02-17T21:28:27.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.999+0000 7f53a8ff9640 1 -- 10.20.193.5:0/2930738887 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f5398062c50 con 0x7f5390009ab0 2026-02-17T21:28:27.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.999+0000 7f53a8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:27.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:26.999+0000 7f53a8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:28:27.002 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:28:27.002 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:28:27.004 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:27.000+0000 7f53b2378640 10 librados: watch_flush enter 2026-02-17T21:28:27.004 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:27.000+0000 7f53b2378640 10 librados: watch_flush exit 2026-02-17T21:28:27.004 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:27.000+0000 7f53b2378640 20 client.4912.objecter shutdown clearing up homeless session... 2026-02-17T21:28:27.004 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:27.000+0000 7f53b2378640 10 client.4912.objecter successfully canceled tick 2026-02-17T21:28:27.004 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:27.000+0000 7f53b2378640 1 -- 10.20.193.5:0/2930738887 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f537c0792b0 msgr2=0x7f537c07b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:27.004 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:27.000+0000 7f53b2378640 1 --2- 10.20.193.5:0/2930738887 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f537c0792b0 0x7f537c07b770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f53ac0c9020 tx=0x7f539c0023d0 comp rx=0 tx=0).stop 2026-02-17T21:28:27.004 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:27.000+0000 7f53b2378640 10 monclient: shutdown 2026-02-17T21:28:27.004 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:27.000+0000 7f53b2378640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:27.004 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:27.000+0000 7f53b2378640 1 -- 10.20.193.5:0/2930738887 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5390009ab0 msgr2=0x7f53ac0c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:27.004 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:27.000+0000 7f53b2378640 1 --2- 10.20.193.5:0/2930738887 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5390009ab0 0x7f53ac0c84d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f539800ebc0 tx=0x7f539800c4b0 comp rx=0 tx=0).stop 2026-02-17T21:28:27.004 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:27.000+0000 7f53b2378640 1 -- 10.20.193.5:0/2930738887 shutdown_connections 2026-02-17T21:28:27.005 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:27.000+0000 7f53b2378640 1 --2- 10.20.193.5:0/2930738887 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f537c0792b0 0x7f537c07b770 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:27.005 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:27.000+0000 7f53b2378640 1 --2- 10.20.193.5:0/2930738887 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f53ac1f5340 0x7f53ac14ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:27.005 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:27.000+0000 7f53b2378640 1 --2- 10.20.193.5:0/2930738887 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f53ac0c8a10 0x7f53ac1f4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:27.005 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:27.000+0000 7f53b2378640 1 --2- 10.20.193.5:0/2930738887 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5390009ab0 0x7f53ac0c84d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:27.005 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:27.000+0000 7f53b2378640 1 -- 10.20.193.5:0/2930738887 >> 10.20.193.5:0/2930738887 conn(0x7f53ac0cc1d0 msgr2=0x7f53ac0cd530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:27.005 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:27.000+0000 7f53b2378640 1 -- 10.20.193.5:0/2930738887 shutdown_connections 2026-02-17T21:28:27.005 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:27.000+0000 7f53b2378640 1 -- 10.20.193.5:0/2930738887 wait complete. 2026-02-17T21:28:27.005 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:27.000+0000 7f53b2378640 1 librados: shutdown 2026-02-17T21:28:30.012 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:28:30.082 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.079+0000 7f9001f3e640 10 monclient: get_monmap_and_config 2026-02-17T21:28:30.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.079+0000 7f9001f3e640 10 monclient: build_initial_monmap 2026-02-17T21:28:30.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.080+0000 7f9001f3e640 10 monclient: monmap: 2026-02-17T21:28:30.083 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:30.083 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:30.083 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:28:30.081676+0000 2026-02-17T21:28:30.083 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:28:30.081676+0000 2026-02-17T21:28:30.083 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:30.083 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:30.083 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:28:30.083 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:28:30.083 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:28:30.083 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:28:30.083 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:28:30.083 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:28:30.083 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:30.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.080+0000 7f9001f3e640 1 Processor -- start 2026-02-17T21:28:30.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.080+0000 7f9001f3e640 1 -- start start 2026-02-17T21:28:30.084 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.080+0000 7f9001f3e640 10 monclient: init 2026-02-17T21:28:30.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.080+0000 7f9001f3e640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:30.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.081+0000 7f9001f3e640 10 monclient: _add_conns ranks=[5,4,1,2,0,3] 2026-02-17T21:28:30.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.081+0000 7f9001f3e640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f8ffc15f570 0x7f8ffc15f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:30.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.081+0000 7f9001f3e640 10 monclient(hunting): picked mon.noname-c con 0x7f8ffc15f570 addr v2:10.20.193.135:3300/0 2026-02-17T21:28:30.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.081+0000 7f9001f3e640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f8ffc0be810 0x7f8ffc15d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:30.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.081+0000 7f9001f3e640 10 monclient(hunting): picked mon.noname-b con 0x7f8ffc0be810 addr v2:10.20.193.119:3300/0 2026-02-17T21:28:30.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.081+0000 7f9001f3e640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f8ffc15d740 addr v1:10.20.193.119:6789/0 2026-02-17T21:28:30.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.081+0000 7f9001f3e640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ffc0bee70 con 0x7f8ffc15d740 2026-02-17T21:28:30.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.081+0000 7f9001f3e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:30.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.081+0000 7f9001f3e640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f8ffc0bec50 con 0x7f8ffc0be810 2026-02-17T21:28:30.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.081+0000 7f9001f3e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:30.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.081+0000 7f9001f3e640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f8ffc0bfd60 con 0x7f8ffc15f570 2026-02-17T21:28:30.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.081+0000 7f9001f3e640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:30.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.081+0000 7f9001f3e640 10 monclient(hunting): authenticate will time out at 1215.647061s 2026-02-17T21:28:30.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.081+0000 7f8ffb7fe640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f8ffc15f570 0x7f8ffc15f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:30.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.081+0000 7f8ffaffd640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f8ffc0be810 0x7f8ffc15d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:30.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.081+0000 7f8ffbfff640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f8ffc15d740 0x7f8ffc155770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:56704/0 (socket says 10.20.193.5:56704) 2026-02-17T21:28:30.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.081+0000 7f8ffbfff640 1 -- 10.20.193.5:0/2334754036 learned_addr learned my addr 10.20.193.5:0/2334754036 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:28:30.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.082+0000 7f8ffaffd640 10 monclient(hunting): get_auth_request con 0x7f8ffc0be810 auth_method 0 2026-02-17T21:28:30.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.082+0000 7f8ffaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:30.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.082+0000 7f8ffaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:30.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.082+0000 7f8ffaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:30.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.082+0000 7f8ffb7fe640 10 monclient(hunting): get_auth_request con 0x7f8ffc15f570 auth_method 0 2026-02-17T21:28:30.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.082+0000 7f8ffb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:30.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.082+0000 7f8ffb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:30.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.082+0000 7f8ffb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:30.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.082+0000 7f8ffb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:30.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.082+0000 7f8ffb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:30.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.082+0000 7f8ffb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:30.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.082+0000 7f8ffaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:30.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.082+0000 7f8ffaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:30.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.082+0000 7f8ffaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:30.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.083+0000 7f8ffb7fe640 10 monclient(hunting): handle_auth_done global_id 4907 payload 274 2026-02-17T21:28:30.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.083+0000 7f8ffb7fe640 1 -- 10.20.193.5:0/2334754036 >> v2:10.20.193.119:3300/0 conn(0x7f8ffc0be810 msgr2=0x7f8ffc15d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:28:30.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.083+0000 7f8ffb7fe640 1 --2- 10.20.193.5:0/2334754036 >> v2:10.20.193.119:3300/0 conn(0x7f8ffc0be810 0x7f8ffc15d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:30.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.083+0000 7f8ffb7fe640 1 -- 10.20.193.5:0/2334754036 >> v1:10.20.193.119:6789/0 conn(0x7f8ffc15d740 legacy=0x7f8ffc155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:30.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.083+0000 7f8ffb7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:28:30.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.083+0000 7f8ffb7fe640 1 monclient: found mon.noname-c 2026-02-17T21:28:30.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.083+0000 7f8ffb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:30.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.083+0000 7f8ffb7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:28:30.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.083+0000 7f8ffb7fe640 1 -- 10.20.193.5:0/2334754036 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ffc0bf150 con 0x7f8ffc15f570 2026-02-17T21:28:30.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.084+0000 7f8ffb7fe640 1 --2- 10.20.193.5:0/2334754036 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8ffc15f570 0x7f8ffc15f950 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0696f0 tx=0x7f8fe802ede0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=359a715d86a91cd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:30.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f8ffa7fc640 1 -- 10.20.193.5:0/2334754036 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe803c070 con 0x7f8ffc15f570 2026-02-17T21:28:30.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f8ffa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:30.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f8ffa7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:28:30.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f8ffa7fc640 10 monclient: dump: 2026-02-17T21:28:30.090 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:30.090 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:30.090 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:30.090 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:30.090 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:30.090 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:30.090 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:30.090 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:30.090 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:30.090 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:30.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f8ffa7fc640 10 monclient: _finish_auth 0 2026-02-17T21:28:30.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f8ffa7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:28:30.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f8ffa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:30.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f9001f3e640 5 monclient: authenticate success, global_id 4907 2026-02-17T21:28:30.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f9001f3e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:28:30.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f8ffa7fc640 1 -- 10.20.193.5:0/2334754036 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe802faf0 con 0x7f8ffc15f570 2026-02-17T21:28:30.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f8ffa7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:30.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f8ffa7fc640 1 -- 10.20.193.5:0/2334754036 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8037440 con 0x7f8ffc15f570 2026-02-17T21:28:30.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f8ffa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:30.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f8ffa7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:28:30.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f8ffa7fc640 10 monclient: dump: 2026-02-17T21:28:30.091 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:30.091 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:30.091 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:30.091 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:30.091 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:30.091 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:30.091 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:30.091 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:30.091 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:30.091 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:30.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f9001f3e640 10 monclient: get_monmap_and_config success 2026-02-17T21:28:30.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f9001f3e640 4 set_mon_vals no callback set 2026-02-17T21:28:30.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f9001f3e640 10 monclient: shutdown 2026-02-17T21:28:30.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f9001f3e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:30.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f9001f3e640 1 -- 10.20.193.5:0/2334754036 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8ffc15f570 msgr2=0x7f8ffc15f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:30.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f9001f3e640 1 --2- 10.20.193.5:0/2334754036 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8ffc15f570 0x7f8ffc15f950 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0696f0 tx=0x7f8fe802ede0 comp rx=0 tx=0).stop 2026-02-17T21:28:30.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f9001f3e640 1 -- 10.20.193.5:0/2334754036 shutdown_connections 2026-02-17T21:28:30.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f9001f3e640 1 --2- 10.20.193.5:0/2334754036 >> v2:10.20.193.119:3300/0 conn(0x7f8ffc0be810 0x7f8ffc15d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:30.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f9001f3e640 1 --2- 10.20.193.5:0/2334754036 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8ffc15f570 0x7f8ffc15f950 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:30.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f9001f3e640 1 -- 10.20.193.5:0/2334754036 >> 10.20.193.5:0/2334754036 conn(0x7f8ffc0c9f40 msgr2=0x7f8ffc0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:30.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f9001f3e640 1 -- 10.20.193.5:0/2334754036 shutdown_connections 2026-02-17T21:28:30.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.086+0000 7f9001f3e640 1 -- 10.20.193.5:0/2334754036 wait complete. 2026-02-17T21:28:30.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.087+0000 7f9001f3e640 10 monclient: build_initial_monmap 2026-02-17T21:28:30.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.087+0000 7f9001f3e640 10 monclient: monmap: 2026-02-17T21:28:30.092 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:30.092 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:28:30.092 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:28:30.092 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:28:30.092 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:30.092 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:30.092 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:28:30.092 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:28:30.092 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:28:30.093 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:30.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.087+0000 7f9001f3e640 1 librados: starting msgr at 2026-02-17T21:28:30.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.087+0000 7f9001f3e640 1 librados: starting objecter 2026-02-17T21:28:30.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.087+0000 7f9001f3e640 1 Processor -- start 2026-02-17T21:28:30.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.087+0000 7f9001f3e640 1 -- start start 2026-02-17T21:28:30.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.087+0000 7f9001f3e640 1 librados: setting wanted keys 2026-02-17T21:28:30.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.087+0000 7f9001f3e640 1 librados: calling monclient init 2026-02-17T21:28:30.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.087+0000 7f9001f3e640 10 monclient: init 2026-02-17T21:28:30.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.087+0000 7f9001f3e640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:30.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.087+0000 7f9001f3e640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:28:30.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.087+0000 7f9001f3e640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8ffc0be810 0x7f8ffc1f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:30.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f9001f3e640 10 monclient(hunting): picked mon.noname-b con 0x7f8ffc0be810 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:28:30.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f9001f3e640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8ffc15d740 0x7f8ffc074230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:30.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f9001f3e640 10 monclient(hunting): picked mon.noname-c con 0x7f8ffc15d740 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:28:30.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f9001f3e640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8ffc15f570 0x7f8ffc1517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:30.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f9001f3e640 10 monclient(hunting): picked mon.noname-a con 0x7f8ffc15f570 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:28:30.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f9001f3e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:30.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f9001f3e640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc0bf9f0 con 0x7f8ffc15f570 2026-02-17T21:28:30.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f9001f3e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:30.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f9001f3e640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc0bf710 con 0x7f8ffc0be810 2026-02-17T21:28:30.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f9001f3e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:30.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f9001f3e640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc0c01f0 con 0x7f8ffc15d740 2026-02-17T21:28:30.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f9001f3e640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:30.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f9001f3e640 10 monclient(hunting): authenticate will time out at 1215.654039s 2026-02-17T21:28:30.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f8ffb7fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8ffc0be810 0x7f8ffc1f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:30.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f8ffaffd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8ffc15d740 0x7f8ffc074230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:30.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f8ffb7fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8ffc0be810 0x7f8ffc1f33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:60620/0 (socket says 10.20.193.5:60620) 2026-02-17T21:28:30.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f8ffb7fe640 1 -- 10.20.193.5:0/84739061 learned_addr learned my addr 10.20.193.5:0/84739061 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:28:30.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f8ffb7fe640 10 monclient(hunting): get_auth_request con 0x7f8ffc0be810 auth_method 0 2026-02-17T21:28:30.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f8ffb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:30.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f8ffb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:30.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f8ffb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:30.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f8ffbfff640 1 --2- 10.20.193.5:0/84739061 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8ffc15f570 0x7f8ffc1517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:30.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f8ffaffd640 10 monclient(hunting): get_auth_request con 0x7f8ffc15d740 auth_method 0 2026-02-17T21:28:30.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f8ffaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:30.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f8ffaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:30.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f8ffaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:30.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f8ffb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:30.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f8ffb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:30.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f8ffb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:30.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f8ffbfff640 10 monclient(hunting): get_auth_request con 0x7f8ffc15f570 auth_method 0 2026-02-17T21:28:30.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f8ffbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:30.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f8ffbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:30.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f8ffbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:30.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f8ffaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:30.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f8ffaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:30.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.088+0000 7f8ffaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:30.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.089+0000 7f8ffbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:30.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.089+0000 7f8ffbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:30.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.089+0000 7f8ffbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:30.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.090+0000 7f8ffaffd640 10 monclient(hunting): handle_auth_done global_id 4910 payload 824 2026-02-17T21:28:30.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.090+0000 7f8ffaffd640 1 -- 10.20.193.5:0/84739061 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8ffc0be810 msgr2=0x7f8ffc1f33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:30.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.090+0000 7f8ffaffd640 1 --2- 10.20.193.5:0/84739061 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8ffc0be810 0x7f8ffc1f33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:30.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.090+0000 7f8ffaffd640 1 -- 10.20.193.5:0/84739061 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8ffc15f570 msgr2=0x7f8ffc1517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:30.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.090+0000 7f8ffaffd640 1 --2- 10.20.193.5:0/84739061 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8ffc15f570 0x7f8ffc1517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:30.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.090+0000 7f8ffaffd640 10 monclient: _finish_hunting 0 2026-02-17T21:28:30.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.090+0000 7f8ffaffd640 1 monclient: found mon.noname-c 2026-02-17T21:28:30.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.090+0000 7f8ffaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:30.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.090+0000 7f8ffaffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:28:30.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.090+0000 7f8ffaffd640 1 -- 10.20.193.5:0/84739061 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ffc1f3a00 con 0x7f8ffc15d740 2026-02-17T21:28:30.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.091+0000 7f8ffaffd640 1 --2- 10.20.193.5:0/84739061 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8ffc15d740 0x7f8ffc074230 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00e9e0 tx=0x7f8fec00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:30.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.091+0000 7f8fd7fff640 10 client.?.objecter ms_handle_connect 0x7f8ffc15d740 2026-02-17T21:28:30.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.091+0000 7f8fd7fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:28:30.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.092+0000 7f8fd7fff640 1 -- 10.20.193.5:0/84739061 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec017070 con 0x7f8ffc15d740 2026-02-17T21:28:30.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.092+0000 7f8fd7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:30.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.092+0000 7f8fd7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:28:30.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.092+0000 7f8fd7fff640 10 monclient: dump: 2026-02-17T21:28:30.099 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:30.099 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:30.099 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:30.099 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:30.099 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:30.099 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:30.099 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:30.099 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:30.099 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:30.099 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:30.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.092+0000 7f8fd7fff640 10 monclient: _finish_auth 0 2026-02-17T21:28:30.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.092+0000 7f8fd7fff640 10 monclient: _check_auth_tickets 2026-02-17T21:28:30.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.092+0000 7f8fd7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:30.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.092+0000 7f9001f3e640 5 monclient: authenticate success, global_id 4910 2026-02-17T21:28:30.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.092+0000 7f9001f3e640 10 monclient: _renew_subs 2026-02-17T21:28:30.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.092+0000 7f9001f3e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:28:30.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.092+0000 7f9001f3e640 1 -- 10.20.193.5:0/84739061 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ffc1f3ce0 con 0x7f8ffc15d740 2026-02-17T21:28:30.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.092+0000 7f9001f3e640 10 client.4910.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:28:30.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.092+0000 7f9001f3e640 10 monclient: _renew_subs 2026-02-17T21:28:30.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.092+0000 7f9001f3e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:28:30.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.092+0000 7f9001f3e640 1 -- 10.20.193.5:0/84739061 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ffc157f10 con 0x7f8ffc15d740 2026-02-17T21:28:30.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.092+0000 7f9001f3e640 1 librados: init done 2026-02-17T21:28:30.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.092+0000 7f9001f3e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:30.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.092+0000 7f9001f3e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:30.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.092+0000 7f9001f3e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:28:30.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.092+0000 7f9001f3e640 1 -- 10.20.193.5:0/84739061 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ffc15d200 con 0x7f8ffc15d740 2026-02-17T21:28:30.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.093+0000 7f8fd7fff640 1 -- 10.20.193.5:0/84739061 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fec005a90 con 0x7f8ffc15d740 2026-02-17T21:28:30.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.093+0000 7f8fd7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:30.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.093+0000 7f8fd7fff640 1 -- 10.20.193.5:0/84739061 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec021060 con 0x7f8ffc15d740 2026-02-17T21:28:30.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.093+0000 7f8fd7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:30.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.093+0000 7f8fd7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:28:30.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.093+0000 7f8ff9ffb640 4 set_mon_vals no callback set 2026-02-17T21:28:30.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.093+0000 7f8fd7fff640 10 monclient: dump: 2026-02-17T21:28:30.100 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:30.100 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:30.100 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:30.100 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:30.100 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:30.100 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:30.101 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:30.101 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:30.101 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:30.101 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:30.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.201+0000 7f8fd7fff640 1 -- 10.20.193.5:0/84739061 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f8fec00ca00 con 0x7f8ffc15d740 2026-02-17T21:28:30.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.202+0000 7f8fd7fff640 1 --2- 10.20.193.5:0/84739061 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8fcc079280 0x7f8fcc07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:30.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.202+0000 7f8ffb7fe640 1 --2- 10.20.193.5:0/84739061 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8fcc079280 0x7f8fcc07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:30.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.202+0000 7f8ffb7fe640 10 monclient: get_auth_request con 0x7f8fcc079280 auth_method 0 2026-02-17T21:28:30.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.203+0000 7f8fd7fff640 10 client.4910.objecter ms_handle_connect 0x7f8fcc079280 2026-02-17T21:28:30.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.203+0000 7f8ffb7fe640 1 --2- 10.20.193.5:0/84739061 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8fcc079280 0x7f8fcc07b740 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8fe802ee20 tx=0x7f8fe8033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:30.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.204+0000 7f8fd7fff640 1 -- 10.20.193.5:0/84739061 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f8fec0982a0 con 0x7f8ffc15d740 2026-02-17T21:28:30.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.204+0000 7f8fd7fff640 10 client.4910.objecter ms_dispatch2 0x7f8ffc000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:28:30.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.204+0000 7f8fd7fff640 3 client.4910.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:28:30.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.204+0000 7f8fd7fff640 3 client.4910.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:28:30.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.204+0000 7f8fd7fff640 20 client.4910.objecter dump_active .. 0 homeless 2026-02-17T21:28:30.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.211+0000 7f8fd7fff640 1 -- 10.20.193.5:0/84739061 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8fec062830 con 0x7f8ffc15d740 2026-02-17T21:28:30.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.211+0000 7f8fd7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:30.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.211+0000 7f8fd7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:28:30.314 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.312+0000 7f9001f3e640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:28:30.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.312+0000 7f9001f3e640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:30.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.312+0000 7f9001f3e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:28:30.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.312+0000 7f9001f3e640 1 -- 10.20.193.5:0/84739061 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8ffc152650 con 0x7f8ffc15d740 2026-02-17T21:28:30.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.314+0000 7f8fd7fff640 1 -- 10.20.193.5:0/84739061 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f8fec069e20 con 0x7f8ffc15d740 2026-02-17T21:28:30.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.314+0000 7f8fd7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:30.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.314+0000 7f8fd7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:28:30.318 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:28:30.318 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:28:30.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.315+0000 7f9001f3e640 10 librados: watch_flush enter 2026-02-17T21:28:30.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.315+0000 7f9001f3e640 10 librados: watch_flush exit 2026-02-17T21:28:30.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.315+0000 7f9001f3e640 20 client.4910.objecter shutdown clearing up homeless session... 2026-02-17T21:28:30.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.315+0000 7f9001f3e640 10 client.4910.objecter successfully canceled tick 2026-02-17T21:28:30.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.315+0000 7f9001f3e640 1 -- 10.20.193.5:0/84739061 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8fcc079280 msgr2=0x7f8fcc07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:30.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.315+0000 7f9001f3e640 1 --2- 10.20.193.5:0/84739061 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8fcc079280 0x7f8fcc07b740 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8fe802ee20 tx=0x7f8fe8033000 comp rx=0 tx=0).stop 2026-02-17T21:28:30.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.315+0000 7f9001f3e640 10 monclient: shutdown 2026-02-17T21:28:30.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.315+0000 7f9001f3e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:30.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.315+0000 7f9001f3e640 1 -- 10.20.193.5:0/84739061 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8ffc15d740 msgr2=0x7f8ffc074230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:30.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.315+0000 7f9001f3e640 1 --2- 10.20.193.5:0/84739061 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8ffc15d740 0x7f8ffc074230 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00e9e0 tx=0x7f8fec00eeb0 comp rx=0 tx=0).stop 2026-02-17T21:28:30.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.316+0000 7f9001f3e640 1 -- 10.20.193.5:0/84739061 shutdown_connections 2026-02-17T21:28:30.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.316+0000 7f9001f3e640 1 --2- 10.20.193.5:0/84739061 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8fcc079280 0x7f8fcc07b740 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:30.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.316+0000 7f9001f3e640 1 --2- 10.20.193.5:0/84739061 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8ffc15f570 0x7f8ffc1517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:30.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.316+0000 7f9001f3e640 1 --2- 10.20.193.5:0/84739061 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8ffc15d740 0x7f8ffc074230 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:30.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.316+0000 7f9001f3e640 1 --2- 10.20.193.5:0/84739061 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8ffc0be810 0x7f8ffc1f33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:30.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.316+0000 7f9001f3e640 1 -- 10.20.193.5:0/84739061 >> 10.20.193.5:0/84739061 conn(0x7f8ffc0c9f40 msgr2=0x7f8ffc0c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:30.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.316+0000 7f9001f3e640 1 -- 10.20.193.5:0/84739061 shutdown_connections 2026-02-17T21:28:30.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.316+0000 7f9001f3e640 1 -- 10.20.193.5:0/84739061 wait complete. 2026-02-17T21:28:30.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:30.316+0000 7f9001f3e640 1 librados: shutdown 2026-02-17T21:28:33.327 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:28:33.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.395+0000 7f9bed9eb640 10 monclient: get_monmap_and_config 2026-02-17T21:28:33.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.395+0000 7f9bed9eb640 10 monclient: build_initial_monmap 2026-02-17T21:28:33.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.395+0000 7f9bed9eb640 10 monclient: monmap: 2026-02-17T21:28:33.401 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:33.401 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:33.401 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:28:33.396655+0000 2026-02-17T21:28:33.402 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:28:33.396655+0000 2026-02-17T21:28:33.402 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:33.402 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:33.402 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:28:33.402 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:28:33.402 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:28:33.402 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:28:33.402 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:28:33.403 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:28:33.403 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:33.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.396+0000 7f9bed9eb640 1 Processor -- start 2026-02-17T21:28:33.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.396+0000 7f9bed9eb640 1 -- start start 2026-02-17T21:28:33.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.396+0000 7f9bed9eb640 10 monclient: init 2026-02-17T21:28:33.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.396+0000 7f9bed9eb640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:33.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.397+0000 7f9bed9eb640 10 monclient: _add_conns ranks=[2,1,3,0,5,4] 2026-02-17T21:28:33.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.397+0000 7f9bed9eb640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9be8153680 addr v1:10.20.193.135:6789/0 2026-02-17T21:28:33.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.397+0000 7f9bed9eb640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f9be8153a60 addr v1:10.20.193.119:6789/0 2026-02-17T21:28:33.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.397+0000 7f9bed9eb640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f9be806fcd0 0x7f9be8070160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:33.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.397+0000 7f9bed9eb640 10 monclient(hunting): picked mon.noname-a con 0x7f9be806fcd0 addr v2:10.20.193.5:3300/0 2026-02-17T21:28:33.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.397+0000 7f9bed9eb640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9be80706a0 con 0x7f9be8153a60 2026-02-17T21:28:33.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.397+0000 7f9bed9eb640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9be80c40a0 con 0x7f9be8153680 2026-02-17T21:28:33.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.397+0000 7f9bed9eb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:33.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.397+0000 7f9bed9eb640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9be80c7b50 con 0x7f9be806fcd0 2026-02-17T21:28:33.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.397+0000 7f9bed9eb640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:33.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.397+0000 7f9bed9eb640 10 monclient(hunting): authenticate will time out at 1218.962069s 2026-02-17T21:28:33.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.397+0000 7f9bed1ea640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f9be806fcd0 0x7f9be8070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:33.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.397+0000 7f9bdffff640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f9be8153a60 0x7f9be80c85a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:56712/0 (socket says 10.20.193.5:56712) 2026-02-17T21:28:33.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.397+0000 7f9bdffff640 1 -- 10.20.193.5:0/2627632467 learned_addr learned my addr 10.20.193.5:0/2627632467 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:28:33.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.397+0000 7f9bed1ea640 10 monclient(hunting): get_auth_request con 0x7f9be806fcd0 auth_method 0 2026-02-17T21:28:33.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.397+0000 7f9bed1ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:33.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.397+0000 7f9bed1ea640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:33.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.397+0000 7f9bed1ea640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:33.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.397+0000 7f9bed1ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:33.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.397+0000 7f9bed1ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:33.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.397+0000 7f9bed1ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:33.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.398+0000 7f9bed1ea640 10 monclient(hunting): handle_auth_done global_id 4896 payload 274 2026-02-17T21:28:33.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.398+0000 7f9bed1ea640 1 -- 10.20.193.5:0/2627632467 >> v1:10.20.193.135:6789/0 conn(0x7f9be8153680 legacy=0x7f9be8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:33.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.398+0000 7f9bed1ea640 1 -- 10.20.193.5:0/2627632467 >> v1:10.20.193.119:6789/0 conn(0x7f9be8153a60 legacy=0x7f9be80c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:33.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.398+0000 7f9bed1ea640 10 monclient: _finish_hunting 0 2026-02-17T21:28:33.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.398+0000 7f9bed1ea640 1 monclient: found mon.noname-a 2026-02-17T21:28:33.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.398+0000 7f9bed1ea640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:33.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.398+0000 7f9bed1ea640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:28:33.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.398+0000 7f9bed1ea640 1 -- 10.20.193.5:0/2627632467 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be815a110 con 0x7f9be806fcd0 2026-02-17T21:28:33.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.399+0000 7f9bed1ea640 1 --2- 10.20.193.5:0/2627632467 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9be806fcd0 0x7f9be8070160 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9be80c4270 tx=0x7f9be402f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11727b17a014eed7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:33.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.401+0000 7f9bdf7fe640 1 -- 10.20.193.5:0/2627632467 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be403c070 con 0x7f9be806fcd0 2026-02-17T21:28:33.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.401+0000 7f9bdf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:33.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.401+0000 7f9bdf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:28:33.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.401+0000 7f9bdf7fe640 10 monclient: dump: 2026-02-17T21:28:33.419 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:33.419 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:33.419 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:33.420 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:33.420 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:33.420 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:33.420 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:33.420 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:33.420 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:33.420 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:33.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.401+0000 7f9bdf7fe640 10 monclient: _finish_auth 0 2026-02-17T21:28:33.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.401+0000 7f9bdf7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:28:33.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.401+0000 7f9bdf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:33.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.401+0000 7f9bed9eb640 5 monclient: authenticate success, global_id 4896 2026-02-17T21:28:33.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.401+0000 7f9bdf7fe640 1 -- 10.20.193.5:0/2627632467 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9be4037440 con 0x7f9be806fcd0 2026-02-17T21:28:33.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.401+0000 7f9bed9eb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:28:33.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.401+0000 7f9bdf7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:33.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.401+0000 7f9bdf7fe640 1 -- 10.20.193.5:0/2627632467 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be4037810 con 0x7f9be806fcd0 2026-02-17T21:28:33.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.401+0000 7f9bed9eb640 10 monclient: get_monmap_and_config success 2026-02-17T21:28:33.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.401+0000 7f9bed9eb640 4 set_mon_vals no callback set 2026-02-17T21:28:33.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.401+0000 7f9bdf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:33.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.401+0000 7f9bdf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:28:33.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.401+0000 7f9bdf7fe640 10 monclient: dump: 2026-02-17T21:28:33.422 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:33.422 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:33.422 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:33.423 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:33.423 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:33.423 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:33.423 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:33.423 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:33.423 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:33.423 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:33.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.402+0000 7f9bed9eb640 10 monclient: shutdown 2026-02-17T21:28:33.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.402+0000 7f9bed9eb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:33.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.402+0000 7f9bed9eb640 1 -- 10.20.193.5:0/2627632467 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9be806fcd0 msgr2=0x7f9be8070160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:33.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.402+0000 7f9bed9eb640 1 --2- 10.20.193.5:0/2627632467 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9be806fcd0 0x7f9be8070160 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9be80c4270 tx=0x7f9be402f230 comp rx=0 tx=0).stop 2026-02-17T21:28:33.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.402+0000 7f9bed9eb640 1 -- 10.20.193.5:0/2627632467 shutdown_connections 2026-02-17T21:28:33.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.402+0000 7f9bed9eb640 1 --2- 10.20.193.5:0/2627632467 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9be806fcd0 0x7f9be8070160 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:33.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.402+0000 7f9bed9eb640 1 -- 10.20.193.5:0/2627632467 >> 10.20.193.5:0/2627632467 conn(0x7f9be80cd5c0 msgr2=0x7f9be80cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:33.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.402+0000 7f9bed9eb640 1 -- 10.20.193.5:0/2627632467 shutdown_connections 2026-02-17T21:28:33.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.402+0000 7f9bed9eb640 1 -- 10.20.193.5:0/2627632467 wait complete. 2026-02-17T21:28:33.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.402+0000 7f9bed9eb640 10 monclient: build_initial_monmap 2026-02-17T21:28:33.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.402+0000 7f9bed9eb640 10 monclient: monmap: 2026-02-17T21:28:33.425 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:33.425 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:28:33.425 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:28:33.425 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:28:33.425 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:33.425 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:33.425 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:28:33.425 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:28:33.425 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:28:33.426 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:33.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.402+0000 7f9bed9eb640 1 librados: starting msgr at 2026-02-17T21:28:33.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.402+0000 7f9bed9eb640 1 librados: starting objecter 2026-02-17T21:28:33.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.402+0000 7f9bed9eb640 1 Processor -- start 2026-02-17T21:28:33.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.402+0000 7f9bed9eb640 1 -- start start 2026-02-17T21:28:33.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.402+0000 7f9bed9eb640 1 librados: setting wanted keys 2026-02-17T21:28:33.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.402+0000 7f9bed9eb640 1 librados: calling monclient init 2026-02-17T21:28:33.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.402+0000 7f9bed9eb640 10 monclient: init 2026-02-17T21:28:33.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed9eb640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:33.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed9eb640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:28:33.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed9eb640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9be806fcd0 0x7f9be814c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:33.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed9eb640 10 monclient(hunting): picked mon.noname-c con 0x7f9be806fcd0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:28:33.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed9eb640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9be8153680 0x7f9be80cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:33.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed9eb640 10 monclient(hunting): picked mon.noname-b con 0x7f9be8153680 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:28:33.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed9eb640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9be8153a60 0x7f9be814aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:33.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed9eb640 10 monclient(hunting): picked mon.noname-a con 0x7f9be8153a60 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:28:33.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed9eb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:33.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed9eb640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9be815a6d0 con 0x7f9be8153a60 2026-02-17T21:28:33.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed9eb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:33.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed9eb640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9be80c8110 con 0x7f9be8153680 2026-02-17T21:28:33.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed9eb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:33.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed9eb640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9be80c7da0 con 0x7f9be806fcd0 2026-02-17T21:28:33.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed9eb640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:33.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed9eb640 10 monclient(hunting): authenticate will time out at 1218.968345s 2026-02-17T21:28:33.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed1ea640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9be8153a60 0x7f9be814aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:33.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bec9e9640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9be806fcd0 0x7f9be814c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:33.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bdffff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9be8153680 0x7f9be80cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:33.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed1ea640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9be8153a60 0x7f9be814aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:53078/0 (socket says 10.20.193.5:53078) 2026-02-17T21:28:33.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed1ea640 1 -- 10.20.193.5:0/476254798 learned_addr learned my addr 10.20.193.5:0/476254798 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:28:33.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed1ea640 10 monclient(hunting): get_auth_request con 0x7f9be8153a60 auth_method 0 2026-02-17T21:28:33.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed1ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:33.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed1ea640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:33.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed1ea640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:33.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bdffff640 10 monclient(hunting): get_auth_request con 0x7f9be8153680 auth_method 0 2026-02-17T21:28:33.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bdffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:33.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bdffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:33.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bdffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:33.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bec9e9640 10 monclient(hunting): get_auth_request con 0x7f9be806fcd0 auth_method 0 2026-02-17T21:28:33.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bec9e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:33.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bec9e9640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:33.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bec9e9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:33.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed1ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:33.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed1ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:33.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.403+0000 7f9bed1ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:33.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.404+0000 7f9bdffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:33.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.404+0000 7f9bdffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:33.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.404+0000 7f9bdffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:33.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.404+0000 7f9bec9e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:33.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.404+0000 7f9bec9e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:33.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.404+0000 7f9bec9e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:33.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.405+0000 7f9bed1ea640 10 monclient(hunting): handle_auth_done global_id 4899 payload 824 2026-02-17T21:28:33.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.405+0000 7f9bed1ea640 1 -- 10.20.193.5:0/476254798 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9be806fcd0 msgr2=0x7f9be814c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:33.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.405+0000 7f9bed1ea640 1 --2- 10.20.193.5:0/476254798 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9be806fcd0 0x7f9be814c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:33.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.405+0000 7f9bed1ea640 1 -- 10.20.193.5:0/476254798 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9be8153680 msgr2=0x7f9be80cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:33.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.405+0000 7f9bed1ea640 1 --2- 10.20.193.5:0/476254798 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9be8153680 0x7f9be80cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:33.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.405+0000 7f9bed1ea640 10 monclient: _finish_hunting 0 2026-02-17T21:28:33.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.405+0000 7f9bed1ea640 1 monclient: found mon.noname-a 2026-02-17T21:28:33.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.405+0000 7f9bed1ea640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:33.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.405+0000 7f9bed1ea640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:28:33.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.405+0000 7f9bed1ea640 1 -- 10.20.193.5:0/476254798 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be81f5680 con 0x7f9be8153a60 2026-02-17T21:28:33.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.406+0000 7f9bed1ea640 1 --2- 10.20.193.5:0/476254798 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9be8153a60 0x7f9be814aab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9be4017200 tx=0x7f9be4004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:33.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.406+0000 7f9bdd7fa640 10 client.?.objecter ms_handle_connect 0x7f9be8153a60 2026-02-17T21:28:33.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.406+0000 7f9bdd7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:28:33.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.407+0000 7f9bdd7fa640 1 -- 10.20.193.5:0/476254798 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be403c050 con 0x7f9be8153a60 2026-02-17T21:28:33.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.407+0000 7f9bdd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:33.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.407+0000 7f9bdd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:28:33.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.407+0000 7f9bdd7fa640 10 monclient: dump: 2026-02-17T21:28:33.432 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:33.432 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:33.432 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:33.432 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:33.432 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:33.432 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:33.433 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:33.433 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:33.433 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:33.433 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:33.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.408+0000 7f9bdd7fa640 10 monclient: _finish_auth 0 2026-02-17T21:28:33.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.408+0000 7f9bdd7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:28:33.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.408+0000 7f9bdd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:33.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.408+0000 7f9bdd7fa640 1 -- 10.20.193.5:0/476254798 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9be4048070 con 0x7f9be8153a60 2026-02-17T21:28:33.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.408+0000 7f9bed9eb640 5 monclient: authenticate success, global_id 4899 2026-02-17T21:28:33.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.408+0000 7f9bed9eb640 10 monclient: _renew_subs 2026-02-17T21:28:33.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.408+0000 7f9bed9eb640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:33.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.408+0000 7f9bed9eb640 1 -- 10.20.193.5:0/476254798 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9be81f5960 con 0x7f9be8153a60 2026-02-17T21:28:33.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.408+0000 7f9bdd7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:33.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.408+0000 7f9bdd7fa640 1 -- 10.20.193.5:0/476254798 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be4035d60 con 0x7f9be8153a60 2026-02-17T21:28:33.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.408+0000 7f9bdd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:33.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.408+0000 7f9bdd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:28:33.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.408+0000 7f9bdd7fa640 10 monclient: dump: 2026-02-17T21:28:33.434 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:33.434 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:33.434 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:33.434 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:33.434 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:33.434 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:33.434 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:33.434 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:33.435 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:33.435 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:33.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.408+0000 7f9bdeffd640 4 set_mon_vals no callback set 2026-02-17T21:28:33.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.408+0000 7f9bed9eb640 10 client.4899.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:28:33.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.408+0000 7f9bed9eb640 10 monclient: _renew_subs 2026-02-17T21:28:33.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.408+0000 7f9bed9eb640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:33.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.408+0000 7f9bed9eb640 1 -- 10.20.193.5:0/476254798 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9be81f5f20 con 0x7f9be8153a60 2026-02-17T21:28:33.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.408+0000 7f9bed9eb640 1 librados: init done 2026-02-17T21:28:33.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.408+0000 7f9bed9eb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:33.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.408+0000 7f9bed9eb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:33.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.408+0000 7f9bed9eb640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:33.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.408+0000 7f9bed9eb640 1 -- 10.20.193.5:0/476254798 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9be815ad80 con 0x7f9be8153a60 2026-02-17T21:28:33.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.460+0000 7f9bdd7fa640 1 -- 10.20.193.5:0/476254798 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f9be404d460 con 0x7f9be8153a60 2026-02-17T21:28:33.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.461+0000 7f9bdd7fa640 1 --2- 10.20.193.5:0/476254798 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9bb80792d0 0x7f9bb807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:33.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.461+0000 7f9bec9e9640 1 --2- 10.20.193.5:0/476254798 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9bb80792d0 0x7f9bb807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:33.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.461+0000 7f9bec9e9640 10 monclient: get_auth_request con 0x7f9bb80792d0 auth_method 0 2026-02-17T21:28:33.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.462+0000 7f9bec9e9640 1 --2- 10.20.193.5:0/476254798 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9bb80792d0 0x7f9bb807b790 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8002770 tx=0x7f9bd8007ef0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:33.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.462+0000 7f9bdd7fa640 10 client.4899.objecter ms_handle_connect 0x7f9bb80792d0 2026-02-17T21:28:33.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.516+0000 7f9bdd7fa640 1 -- 10.20.193.5:0/476254798 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f9be4084910 con 0x7f9be8153a60 2026-02-17T21:28:33.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.516+0000 7f9bdd7fa640 10 client.4899.objecter ms_dispatch2 0x7f9be8000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:28:33.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.516+0000 7f9bdd7fa640 3 client.4899.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:28:33.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.516+0000 7f9bdd7fa640 3 client.4899.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:28:33.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.516+0000 7f9bdd7fa640 20 client.4899.objecter dump_active .. 0 homeless 2026-02-17T21:28:33.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.523+0000 7f9bdd7fa640 1 -- 10.20.193.5:0/476254798 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9be40888d0 con 0x7f9be8153a60 2026-02-17T21:28:33.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.523+0000 7f9bdd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:33.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.523+0000 7f9bdd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:28:33.625 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.623+0000 7f9bed9eb640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:28:33.625 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.623+0000 7f9bed9eb640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:33.625 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.623+0000 7f9bed9eb640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:33.625 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.623+0000 7f9bed9eb640 1 -- 10.20.193.5:0/476254798 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9be8070480 con 0x7f9be8153a60 2026-02-17T21:28:33.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.625+0000 7f9bdd7fa640 1 -- 10.20.193.5:0/476254798 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f9be408cbd0 con 0x7f9be8153a60 2026-02-17T21:28:33.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.625+0000 7f9bdd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:33.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.625+0000 7f9bdd7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:28:33.627 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:28:33.628 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:28:33.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.626+0000 7f9bed9eb640 10 librados: watch_flush enter 2026-02-17T21:28:33.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.627+0000 7f9bed9eb640 10 librados: watch_flush exit 2026-02-17T21:28:33.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.627+0000 7f9bed9eb640 20 client.4899.objecter shutdown clearing up homeless session... 2026-02-17T21:28:33.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.627+0000 7f9bed9eb640 10 client.4899.objecter successfully canceled tick 2026-02-17T21:28:33.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.627+0000 7f9bed9eb640 1 -- 10.20.193.5:0/476254798 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9bb80792d0 msgr2=0x7f9bb807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:33.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.627+0000 7f9bed9eb640 1 --2- 10.20.193.5:0/476254798 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9bb80792d0 0x7f9bb807b790 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8002770 tx=0x7f9bd8007ef0 comp rx=0 tx=0).stop 2026-02-17T21:28:33.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.627+0000 7f9bed9eb640 10 monclient: shutdown 2026-02-17T21:28:33.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.627+0000 7f9bed9eb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:33.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.627+0000 7f9bed9eb640 1 -- 10.20.193.5:0/476254798 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9be8153a60 msgr2=0x7f9be814aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:33.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.627+0000 7f9bed9eb640 1 --2- 10.20.193.5:0/476254798 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9be8153a60 0x7f9be814aab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9be4017200 tx=0x7f9be4004b40 comp rx=0 tx=0).stop 2026-02-17T21:28:33.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.627+0000 7f9bed9eb640 1 -- 10.20.193.5:0/476254798 shutdown_connections 2026-02-17T21:28:33.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.627+0000 7f9bed9eb640 1 --2- 10.20.193.5:0/476254798 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f9bb80792d0 0x7f9bb807b790 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:33.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.627+0000 7f9bed9eb640 1 --2- 10.20.193.5:0/476254798 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f9be8153a60 0x7f9be814aab0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:33.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.627+0000 7f9bed9eb640 1 --2- 10.20.193.5:0/476254798 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9be8153680 0x7f9be80cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:33.631 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.627+0000 7f9bed9eb640 1 --2- 10.20.193.5:0/476254798 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f9be806fcd0 0x7f9be814c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:33.631 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.627+0000 7f9bed9eb640 1 -- 10.20.193.5:0/476254798 >> 10.20.193.5:0/476254798 conn(0x7f9be80cd5c0 msgr2=0x7f9be80cd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:33.631 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.627+0000 7f9bed9eb640 1 -- 10.20.193.5:0/476254798 shutdown_connections 2026-02-17T21:28:33.631 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.627+0000 7f9bed9eb640 1 -- 10.20.193.5:0/476254798 wait complete. 2026-02-17T21:28:33.631 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:33.627+0000 7f9bed9eb640 1 librados: shutdown 2026-02-17T21:28:36.637 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:28:36.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.705+0000 7ff84f196640 10 monclient: get_monmap_and_config 2026-02-17T21:28:36.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.705+0000 7ff84f196640 10 monclient: build_initial_monmap 2026-02-17T21:28:36.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.705+0000 7ff84f196640 10 monclient: monmap: 2026-02-17T21:28:36.708 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:36.708 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:36.708 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:28:36.706179+0000 2026-02-17T21:28:36.708 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:28:36.706179+0000 2026-02-17T21:28:36.709 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:36.709 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:36.709 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:28:36.709 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:28:36.709 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:28:36.709 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:28:36.709 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:28:36.709 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:28:36.710 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:36.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.705+0000 7ff84f196640 1 Processor -- start 2026-02-17T21:28:36.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.705+0000 7ff84f196640 1 -- start start 2026-02-17T21:28:36.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.705+0000 7ff84f196640 10 monclient: init 2026-02-17T21:28:36.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.706+0000 7ff84f196640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:36.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.706+0000 7ff84f196640 10 monclient: _add_conns ranks=[4,2,1,0,3,5] 2026-02-17T21:28:36.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.706+0000 7ff84f196640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7ff84815d370 0x7ff84815d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:36.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.706+0000 7ff84f196640 10 monclient(hunting): picked mon.noname-b con 0x7ff84815d370 addr v2:10.20.193.119:3300/0 2026-02-17T21:28:36.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.706+0000 7ff84f196640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff8480c7e20 addr v1:10.20.193.135:6789/0 2026-02-17T21:28:36.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.706+0000 7ff84f196640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7ff8480c74c0 addr v1:10.20.193.119:6789/0 2026-02-17T21:28:36.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.706+0000 7ff84f196640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8480c8350 con 0x7ff8480c74c0 2026-02-17T21:28:36.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.706+0000 7ff84f196640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8480c8630 con 0x7ff8480c7e20 2026-02-17T21:28:36.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.706+0000 7ff84f196640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:36.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.706+0000 7ff84f196640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7ff84815b710 con 0x7ff84815d370 2026-02-17T21:28:36.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.706+0000 7ff84f196640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:36.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.706+0000 7ff84f196640 10 monclient(hunting): authenticate will time out at 1222.271518s 2026-02-17T21:28:36.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.706+0000 7ff84d70c640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7ff8480c74c0 0x7ff8480c52b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:56714/0 (socket says 10.20.193.5:56714) 2026-02-17T21:28:36.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.706+0000 7ff84d70c640 1 -- 10.20.193.5:0/3122514742 learned_addr learned my addr 10.20.193.5:0/3122514742 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:28:36.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.707+0000 7ff84cf0b640 1 --2- 10.20.193.5:0/3122514742 >> v2:10.20.193.119:3300/0 conn(0x7ff84815d370 0x7ff84815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:36.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.707+0000 7ff84cf0b640 10 monclient(hunting): get_auth_request con 0x7ff84815d370 auth_method 0 2026-02-17T21:28:36.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.707+0000 7ff84cf0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:36.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.707+0000 7ff84cf0b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:36.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.707+0000 7ff84cf0b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:36.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.708+0000 7ff83f7fe640 1 -- 10.20.193.5:0/3122514742 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 626316420 0 0) 0x7ff8480c8630 con 0x7ff8480c7e20 2026-02-17T21:28:36.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.708+0000 7ff83f7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:28:36.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.708+0000 7ff83f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:36.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.708+0000 7ff83f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:36.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.708+0000 7ff83f7fe640 10 monclient(hunting): my global_id is 4919 2026-02-17T21:28:36.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.708+0000 7ff83f7fe640 1 -- 10.20.193.5:0/3122514742 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff834003620 con 0x7ff8480c7e20 2026-02-17T21:28:36.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.708+0000 7ff84cf0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:36.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.708+0000 7ff84cf0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:36.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.708+0000 7ff84cf0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:36.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.709+0000 7ff83f7fe640 1 -- 10.20.193.5:0/3122514742 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2150602862 0 0) 0x7ff8480c8350 con 0x7ff8480c74c0 2026-02-17T21:28:36.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.709+0000 7ff83f7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:28:36.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.709+0000 7ff83f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:36.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.709+0000 7ff83f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:36.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.709+0000 7ff83f7fe640 10 monclient(hunting): my global_id is 4930 2026-02-17T21:28:36.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.709+0000 7ff83f7fe640 1 -- 10.20.193.5:0/3122514742 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8480c8630 con 0x7ff8480c74c0 2026-02-17T21:28:36.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.709+0000 7ff84cf0b640 10 monclient(hunting): handle_auth_done global_id 4933 payload 274 2026-02-17T21:28:36.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.709+0000 7ff84cf0b640 1 -- 10.20.193.5:0/3122514742 >> v1:10.20.193.135:6789/0 conn(0x7ff8480c7e20 legacy=0x7ff84815b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:36.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.709+0000 7ff84cf0b640 1 -- 10.20.193.5:0/3122514742 >> v1:10.20.193.119:6789/0 conn(0x7ff8480c74c0 legacy=0x7ff8480c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:36.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.709+0000 7ff84cf0b640 10 monclient: _finish_hunting 0 2026-02-17T21:28:36.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.709+0000 7ff84cf0b640 1 monclient: found mon.noname-b 2026-02-17T21:28:36.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.709+0000 7ff84cf0b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:36.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.709+0000 7ff84cf0b640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:28:36.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.709+0000 7ff84cf0b640 1 -- 10.20.193.5:0/3122514742 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8480c8910 con 0x7ff84815d370 2026-02-17T21:28:36.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.711+0000 7ff84cf0b640 1 --2- 10.20.193.5:0/3122514742 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff84815d370 0x7ff84815d750 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff8380098a0 tx=0x7ff83802ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffe8b2028c5ed681 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:36.723 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff83f7fe640 1 -- 10.20.193.5:0/3122514742 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83803c070 con 0x7ff84815d370 2026-02-17T21:28:36.723 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff83f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:36.723 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff83f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:28:36.723 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff83f7fe640 10 monclient: dump: 2026-02-17T21:28:36.723 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:36.724 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:36.724 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:36.724 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:36.724 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:36.724 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:36.724 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:36.724 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:36.724 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:36.724 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:36.724 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff83f7fe640 10 monclient: _finish_auth 0 2026-02-17T21:28:36.724 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff83f7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:28:36.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff83f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:36.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff83f7fe640 1 -- 10.20.193.5:0/3122514742 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff83802fb70 con 0x7ff84815d370 2026-02-17T21:28:36.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff84f196640 5 monclient: authenticate success, global_id 4933 2026-02-17T21:28:36.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff84f196640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:28:36.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff83f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:36.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff83f7fe640 1 -- 10.20.193.5:0/3122514742 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff838037440 con 0x7ff84815d370 2026-02-17T21:28:36.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff84f196640 10 monclient: get_monmap_and_config success 2026-02-17T21:28:36.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff84f196640 4 set_mon_vals no callback set 2026-02-17T21:28:36.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff83f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:36.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff83f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:28:36.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff83f7fe640 10 monclient: dump: 2026-02-17T21:28:36.726 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:36.726 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:36.726 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:36.726 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:36.726 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:36.726 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:36.726 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:36.726 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:36.726 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:36.726 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:36.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff84f196640 10 monclient: shutdown 2026-02-17T21:28:36.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff84f196640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:36.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff84f196640 1 -- 10.20.193.5:0/3122514742 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff84815d370 msgr2=0x7ff84815d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:36.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff84f196640 1 --2- 10.20.193.5:0/3122514742 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff84815d370 0x7ff84815d750 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff8380098a0 tx=0x7ff83802ee60 comp rx=0 tx=0).stop 2026-02-17T21:28:36.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff84f196640 1 -- 10.20.193.5:0/3122514742 shutdown_connections 2026-02-17T21:28:36.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff84f196640 1 --2- 10.20.193.5:0/3122514742 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff84815d370 0x7ff84815d750 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:36.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff84f196640 1 -- 10.20.193.5:0/3122514742 >> 10.20.193.5:0/3122514742 conn(0x7ff8480c9f20 msgr2=0x7ff8480ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:36.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff84f196640 1 -- 10.20.193.5:0/3122514742 shutdown_connections 2026-02-17T21:28:36.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.713+0000 7ff84f196640 1 -- 10.20.193.5:0/3122514742 wait complete. 2026-02-17T21:28:36.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff84f196640 10 monclient: build_initial_monmap 2026-02-17T21:28:36.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff84f196640 10 monclient: monmap: 2026-02-17T21:28:36.727 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:36.728 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:28:36.728 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:28:36.728 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:28:36.728 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:36.728 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:36.728 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:28:36.728 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:28:36.728 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:28:36.728 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:36.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff84f196640 1 librados: starting msgr at 2026-02-17T21:28:36.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff84f196640 1 librados: starting objecter 2026-02-17T21:28:36.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff84f196640 1 Processor -- start 2026-02-17T21:28:36.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff84f196640 1 -- start start 2026-02-17T21:28:36.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff84f196640 1 librados: setting wanted keys 2026-02-17T21:28:36.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff84f196640 1 librados: calling monclient init 2026-02-17T21:28:36.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff84f196640 10 monclient: init 2026-02-17T21:28:36.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff84f196640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:36.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff84f196640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:28:36.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff84f196640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff8480c74c0 0x7ff848072940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:36.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff84f196640 10 monclient(hunting): picked mon.noname-c con 0x7ff8480c74c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:28:36.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff84f196640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff8480c7e20 0x7ff84814cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:36.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff84f196640 10 monclient(hunting): picked mon.noname-b con 0x7ff8480c7e20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:28:36.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff84f196640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff84815d370 0x7ff84814d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:36.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff84f196640 10 monclient(hunting): picked mon.noname-a con 0x7ff84815d370 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:28:36.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff84f196640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:36.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff84f196640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff8480c8ed0 con 0x7ff84815d370 2026-02-17T21:28:36.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff84f196640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:36.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff84f196640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff8480c9240 con 0x7ff8480c7e20 2026-02-17T21:28:36.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff84f196640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:36.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff84f196640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff8480c96d0 con 0x7ff8480c74c0 2026-02-17T21:28:36.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff84f196640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:36.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff84f196640 10 monclient(hunting): authenticate will time out at 1222.279699s 2026-02-17T21:28:36.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.715+0000 7ff84d70c640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff84815d370 0x7ff84814d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:36.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.714+0000 7ff83ffff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff8480c7e20 0x7ff84814cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:36.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.715+0000 7ff83ffff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff8480c7e20 0x7ff84814cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:60642/0 (socket says 10.20.193.5:60642) 2026-02-17T21:28:36.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.715+0000 7ff83ffff640 1 -- 10.20.193.5:0/2906772062 learned_addr learned my addr 10.20.193.5:0/2906772062 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:28:36.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.715+0000 7ff83ffff640 10 monclient(hunting): get_auth_request con 0x7ff8480c7e20 auth_method 0 2026-02-17T21:28:36.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.715+0000 7ff83ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:36.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.715+0000 7ff83ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:36.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.715+0000 7ff83ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:36.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.715+0000 7ff84cf0b640 1 --2- 10.20.193.5:0/2906772062 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff8480c74c0 0x7ff848072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:36.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.715+0000 7ff84d70c640 10 monclient(hunting): get_auth_request con 0x7ff84815d370 auth_method 0 2026-02-17T21:28:36.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.715+0000 7ff84d70c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:36.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.715+0000 7ff84d70c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:36.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.715+0000 7ff84d70c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:36.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.715+0000 7ff83ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:36.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.715+0000 7ff83ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:36.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.715+0000 7ff83ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:36.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.715+0000 7ff84cf0b640 10 monclient(hunting): get_auth_request con 0x7ff8480c74c0 auth_method 0 2026-02-17T21:28:36.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.715+0000 7ff84cf0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:36.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.715+0000 7ff84cf0b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:36.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.715+0000 7ff84cf0b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:36.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.715+0000 7ff84d70c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:36.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.715+0000 7ff84d70c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:36.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.715+0000 7ff84d70c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:36.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.715+0000 7ff84cf0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:36.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.715+0000 7ff84cf0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:36.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.715+0000 7ff84cf0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:36.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.716+0000 7ff83ffff640 10 monclient(hunting): handle_auth_done global_id 4936 payload 824 2026-02-17T21:28:36.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.716+0000 7ff83ffff640 1 -- 10.20.193.5:0/2906772062 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff8480c74c0 msgr2=0x7ff848072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:36.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.716+0000 7ff83ffff640 1 --2- 10.20.193.5:0/2906772062 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff8480c74c0 0x7ff848072940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:36.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.716+0000 7ff83ffff640 1 -- 10.20.193.5:0/2906772062 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff84815d370 msgr2=0x7ff84814d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:36.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.716+0000 7ff83ffff640 1 --2- 10.20.193.5:0/2906772062 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff84815d370 0x7ff84814d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:36.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.716+0000 7ff83ffff640 10 monclient: _finish_hunting 0 2026-02-17T21:28:36.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.716+0000 7ff83ffff640 1 monclient: found mon.noname-b 2026-02-17T21:28:36.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.716+0000 7ff83ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:36.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.716+0000 7ff83ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:28:36.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.716+0000 7ff83ffff640 1 -- 10.20.193.5:0/2906772062 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8481f3760 con 0x7ff8480c7e20 2026-02-17T21:28:36.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.717+0000 7ff83ffff640 1 --2- 10.20.193.5:0/2906772062 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff8480c7e20 0x7ff84814cad0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff83000c760 tx=0x7ff83000cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:36.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.717+0000 7ff83d7fa640 10 client.?.objecter ms_handle_connect 0x7ff8480c7e20 2026-02-17T21:28:36.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.717+0000 7ff83d7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:28:36.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff83d7fa640 1 -- 10.20.193.5:0/2906772062 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8300052d0 con 0x7ff8480c7e20 2026-02-17T21:28:36.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff83d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:36.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff83d7fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:28:36.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff83d7fa640 10 monclient: dump: 2026-02-17T21:28:36.734 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:36.734 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:36.734 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:36.734 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:36.734 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:36.734 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:36.734 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:36.734 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:36.734 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:36.734 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:36.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff83d7fa640 10 monclient: _finish_auth 0 2026-02-17T21:28:36.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff83d7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:28:36.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff83d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:36.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff83d7fa640 1 -- 10.20.193.5:0/2906772062 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff830005470 con 0x7ff8480c7e20 2026-02-17T21:28:36.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff84f196640 5 monclient: authenticate success, global_id 4936 2026-02-17T21:28:36.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff83d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:36.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff83d7fa640 1 -- 10.20.193.5:0/2906772062 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8300038b0 con 0x7ff8480c7e20 2026-02-17T21:28:36.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff83d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:36.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff83d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:28:36.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff83d7fa640 10 monclient: dump: 2026-02-17T21:28:36.735 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:36.735 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:36.735 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:36.735 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:36.736 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:36.736 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:36.736 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:36.736 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:36.736 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:36.736 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:36.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff83effd640 4 set_mon_vals no callback set 2026-02-17T21:28:36.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff84f196640 10 monclient: _renew_subs 2026-02-17T21:28:36.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff84f196640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:36.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff84f196640 1 -- 10.20.193.5:0/2906772062 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff848074640 con 0x7ff8480c7e20 2026-02-17T21:28:36.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff84f196640 10 client.4936.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:28:36.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff84f196640 10 monclient: _renew_subs 2026-02-17T21:28:36.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff84f196640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:36.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff84f196640 1 -- 10.20.193.5:0/2906772062 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff84814bd10 con 0x7ff8480c7e20 2026-02-17T21:28:36.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff84f196640 1 librados: init done 2026-02-17T21:28:36.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff84f196640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:36.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff84f196640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:36.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff84f196640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:36.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.719+0000 7ff84f196640 1 -- 10.20.193.5:0/2906772062 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff84815d750 con 0x7ff8480c7e20 2026-02-17T21:28:36.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.730+0000 7ff83d7fa640 1 -- 10.20.193.5:0/2906772062 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7ff830003a50 con 0x7ff8480c7e20 2026-02-17T21:28:36.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.731+0000 7ff83d7fa640 1 --2- 10.20.193.5:0/2906772062 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff8180792d0 0x7ff81807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:36.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.731+0000 7ff84cf0b640 1 --2- 10.20.193.5:0/2906772062 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff8180792d0 0x7ff81807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:36.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.731+0000 7ff84cf0b640 10 monclient: get_auth_request con 0x7ff8180792d0 auth_method 0 2026-02-17T21:28:36.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.732+0000 7ff84cf0b640 1 --2- 10.20.193.5:0/2906772062 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff8180792d0 0x7ff81807b790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff838039000 tx=0x7ff838033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:36.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.732+0000 7ff83d7fa640 10 client.4936.objecter ms_handle_connect 0x7ff8180792d0 2026-02-17T21:28:36.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.732+0000 7ff83d7fa640 1 -- 10.20.193.5:0/2906772062 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7ff83005e480 con 0x7ff8480c7e20 2026-02-17T21:28:36.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.732+0000 7ff83d7fa640 10 client.4936.objecter ms_dispatch2 0x7ff848000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:28:36.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.732+0000 7ff83d7fa640 3 client.4936.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:28:36.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.732+0000 7ff83d7fa640 3 client.4936.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:28:36.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.732+0000 7ff83d7fa640 20 client.4936.objecter dump_active .. 0 homeless 2026-02-17T21:28:36.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.834+0000 7ff83d7fa640 1 -- 10.20.193.5:0/2906772062 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff830062440 con 0x7ff8480c7e20 2026-02-17T21:28:36.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.834+0000 7ff83d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:36.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.834+0000 7ff83d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:28:36.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.939+0000 7ff84f196640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:28:36.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.939+0000 7ff84f196640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:36.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.939+0000 7ff84f196640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:36.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.939+0000 7ff84f196640 1 -- 10.20.193.5:0/2906772062 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff8480c47a0 con 0x7ff8480c7e20 2026-02-17T21:28:36.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.941+0000 7ff83d7fa640 1 -- 10.20.193.5:0/2906772062 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7ff830066740 con 0x7ff8480c7e20 2026-02-17T21:28:36.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.941+0000 7ff83d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:36.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.941+0000 7ff83d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:28:36.944 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:28:36.944 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:28:36.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.943+0000 7ff84f196640 10 librados: watch_flush enter 2026-02-17T21:28:36.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.943+0000 7ff84f196640 10 librados: watch_flush exit 2026-02-17T21:28:36.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.943+0000 7ff84f196640 20 client.4936.objecter shutdown clearing up homeless session... 2026-02-17T21:28:36.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.943+0000 7ff84f196640 10 client.4936.objecter successfully canceled tick 2026-02-17T21:28:36.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.943+0000 7ff84f196640 1 -- 10.20.193.5:0/2906772062 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff8180792d0 msgr2=0x7ff81807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:36.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.943+0000 7ff84f196640 1 --2- 10.20.193.5:0/2906772062 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff8180792d0 0x7ff81807b790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff838039000 tx=0x7ff838033000 comp rx=0 tx=0).stop 2026-02-17T21:28:36.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.943+0000 7ff84f196640 10 monclient: shutdown 2026-02-17T21:28:36.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.943+0000 7ff84f196640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:36.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.943+0000 7ff84f196640 1 -- 10.20.193.5:0/2906772062 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff8480c7e20 msgr2=0x7ff84814cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:36.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.943+0000 7ff84f196640 1 --2- 10.20.193.5:0/2906772062 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff8480c7e20 0x7ff84814cad0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff83000c760 tx=0x7ff83000cc30 comp rx=0 tx=0).stop 2026-02-17T21:28:36.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.943+0000 7ff84f196640 1 -- 10.20.193.5:0/2906772062 shutdown_connections 2026-02-17T21:28:36.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.943+0000 7ff84f196640 1 --2- 10.20.193.5:0/2906772062 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff8180792d0 0x7ff81807b790 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:36.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.943+0000 7ff84f196640 1 --2- 10.20.193.5:0/2906772062 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff84815d370 0x7ff84814d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:36.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.943+0000 7ff84f196640 1 --2- 10.20.193.5:0/2906772062 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff8480c7e20 0x7ff84814cad0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:36.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.943+0000 7ff84f196640 1 --2- 10.20.193.5:0/2906772062 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff8480c74c0 0x7ff848072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:36.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.943+0000 7ff84f196640 1 -- 10.20.193.5:0/2906772062 >> 10.20.193.5:0/2906772062 conn(0x7ff8480c9f20 msgr2=0x7ff8480ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:36.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.943+0000 7ff84f196640 1 -- 10.20.193.5:0/2906772062 shutdown_connections 2026-02-17T21:28:36.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.943+0000 7ff84f196640 1 -- 10.20.193.5:0/2906772062 wait complete. 2026-02-17T21:28:36.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:36.943+0000 7ff84f196640 1 librados: shutdown 2026-02-17T21:28:37.587 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:05:17.212 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:37.589 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:05:17.214 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:37.597 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:05:17.222 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:37.617 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:05:17.202 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:37.617 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:05:17.203 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:37.619 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:05:17.243 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:37.619 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:05:17.243 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:37.625 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:05:17.211 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:37.627 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:05:17.251 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:39.954 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:28:40.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.022+0000 7ff4d7032640 10 monclient: get_monmap_and_config 2026-02-17T21:28:40.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.022+0000 7ff4d7032640 10 monclient: build_initial_monmap 2026-02-17T21:28:40.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.022+0000 7ff4d7032640 10 monclient: monmap: 2026-02-17T21:28:40.024 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:40.024 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:40.024 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:28:40.023407+0000 2026-02-17T21:28:40.024 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:28:40.023407+0000 2026-02-17T21:28:40.024 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:40.024 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:40.024 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:28:40.024 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:28:40.024 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:28:40.024 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:28:40.024 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:28:40.024 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:28:40.024 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:40.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.023+0000 7ff4d7032640 1 Processor -- start 2026-02-17T21:28:40.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.023+0000 7ff4d7032640 1 -- start start 2026-02-17T21:28:40.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.023+0000 7ff4d7032640 10 monclient: init 2026-02-17T21:28:40.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.023+0000 7ff4d7032640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:40.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.023+0000 7ff4d7032640 10 monclient: _add_conns ranks=[3,1,0,4,5,2] 2026-02-17T21:28:40.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.023+0000 7ff4d7032640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7ff4d014f280 0x7ff4d00c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:40.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.023+0000 7ff4d7032640 10 monclient(hunting): picked mon.noname-a con 0x7ff4d014f280 addr v2:10.20.193.5:3300/0 2026-02-17T21:28:40.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.023+0000 7ff4d7032640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7ff4d014f660 addr v1:10.20.193.119:6789/0 2026-02-17T21:28:40.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.023+0000 7ff4d7032640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff4d015abc0 addr v1:10.20.193.5:6789/0 2026-02-17T21:28:40.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.023+0000 7ff4d7032640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4d00c7110 con 0x7ff4d015abc0 2026-02-17T21:28:40.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.023+0000 7ff4d7032640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4d00c7390 con 0x7ff4d014f660 2026-02-17T21:28:40.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.023+0000 7ff4d7032640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:40.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.023+0000 7ff4d7032640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff4d00c7950 con 0x7ff4d014f280 2026-02-17T21:28:40.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.023+0000 7ff4d7032640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:40.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.023+0000 7ff4d7032640 10 monclient(hunting): authenticate will time out at 1225.588731s 2026-02-17T21:28:40.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.024+0000 7ff4c7fff640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7ff4d014f660 0x7ff4d00c6a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:53178/0 (socket says 10.20.193.5:53178) 2026-02-17T21:28:40.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.024+0000 7ff4c7fff640 1 -- 10.20.193.5:0/3477325831 learned_addr learned my addr 10.20.193.5:0/3477325831 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:28:40.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.024+0000 7ff4d4da7640 1 --2- 10.20.193.5:0/3477325831 >> v2:10.20.193.5:3300/0 conn(0x7ff4d014f280 0x7ff4d00c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:40.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.024+0000 7ff4d4da7640 10 monclient(hunting): get_auth_request con 0x7ff4d014f280 auth_method 0 2026-02-17T21:28:40.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.024+0000 7ff4d4da7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:40.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.024+0000 7ff4d4da7640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:40.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.024+0000 7ff4d4da7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:40.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.025+0000 7ff4d4da7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:40.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.025+0000 7ff4d4da7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:40.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.025+0000 7ff4d4da7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:40.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.025+0000 7ff4c77fe640 1 -- 10.20.193.5:0/3477325831 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 227892716 0 0) 0x7ff4d00c7390 con 0x7ff4d014f660 2026-02-17T21:28:40.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.025+0000 7ff4c77fe640 10 monclient(hunting): _negotiate 2026-02-17T21:28:40.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.025+0000 7ff4c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:40.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.025+0000 7ff4c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:40.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.025+0000 7ff4c77fe640 10 monclient(hunting): my global_id is 4939 2026-02-17T21:28:40.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.025+0000 7ff4c77fe640 1 -- 10.20.193.5:0/3477325831 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4bc003620 con 0x7ff4d014f660 2026-02-17T21:28:40.028 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.027+0000 7ff4d4da7640 10 monclient(hunting): handle_auth_done global_id 4905 payload 274 2026-02-17T21:28:40.028 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.027+0000 7ff4d4da7640 1 -- 10.20.193.5:0/3477325831 >> v1:10.20.193.119:6789/0 conn(0x7ff4d014f660 legacy=0x7ff4d00c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:40.028 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.027+0000 7ff4d4da7640 1 -- 10.20.193.5:0/3477325831 >> v1:10.20.193.5:6789/0 conn(0x7ff4d015abc0 legacy=0x7ff4d015afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:40.028 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.027+0000 7ff4d4da7640 10 monclient: _finish_hunting 0 2026-02-17T21:28:40.028 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.027+0000 7ff4d4da7640 1 monclient: found mon.noname-a 2026-02-17T21:28:40.028 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.027+0000 7ff4d4da7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:40.028 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.027+0000 7ff4d4da7640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:28:40.028 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.027+0000 7ff4d4da7640 1 -- 10.20.193.5:0/3477325831 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d00c7670 con 0x7ff4d014f280 2026-02-17T21:28:40.029 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.028+0000 7ff4d4da7640 1 --2- 10.20.193.5:0/3477325831 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff4d014f280 0x7ff4d00c7e20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00098a0 tx=0x7ff4c002ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c7e3279d083f62 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:40.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.030+0000 7ff4c77fe640 1 -- 10.20.193.5:0/3477325831 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c003c070 con 0x7ff4d014f280 2026-02-17T21:28:40.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.030+0000 7ff4c77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:40.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.030+0000 7ff4c77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:28:40.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.030+0000 7ff4c77fe640 10 monclient: dump: 2026-02-17T21:28:40.032 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:40.032 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:40.032 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:40.032 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:40.032 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:40.032 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:40.032 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:40.032 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:40.032 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:40.032 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:40.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.030+0000 7ff4c77fe640 10 monclient: _finish_auth 0 2026-02-17T21:28:40.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.030+0000 7ff4c77fe640 10 monclient: _check_auth_tickets 2026-02-17T21:28:40.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.030+0000 7ff4c77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:40.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.030+0000 7ff4c77fe640 1 -- 10.20.193.5:0/3477325831 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4c002fc10 con 0x7ff4d014f280 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.030+0000 7ff4d7032640 5 monclient: authenticate success, global_id 4905 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.030+0000 7ff4d7032640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.030+0000 7ff4c77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.030+0000 7ff4d7032640 10 monclient: get_monmap_and_config success 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.030+0000 7ff4c77fe640 1 -- 10.20.193.5:0/3477325831 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0037440 con 0x7ff4d014f280 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.030+0000 7ff4c77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.030+0000 7ff4d7032640 4 set_mon_vals no callback set 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.030+0000 7ff4c77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.030+0000 7ff4c77fe640 10 monclient: dump: 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.030+0000 7ff4d7032640 10 monclient: shutdown 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.030+0000 7ff4d7032640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.030+0000 7ff4d7032640 1 -- 10.20.193.5:0/3477325831 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff4d014f280 msgr2=0x7ff4d00c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.030+0000 7ff4d7032640 1 --2- 10.20.193.5:0/3477325831 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff4d014f280 0x7ff4d00c7e20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00098a0 tx=0x7ff4c002ef00 comp rx=0 tx=0).stop 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.031+0000 7ff4d7032640 1 -- 10.20.193.5:0/3477325831 shutdown_connections 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.031+0000 7ff4d7032640 1 --2- 10.20.193.5:0/3477325831 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff4d014f280 0x7ff4d00c7e20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:40.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.031+0000 7ff4d7032640 1 -- 10.20.193.5:0/3477325831 >> 10.20.193.5:0/3477325831 conn(0x7ff4d00c9f20 msgr2=0x7ff4d00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:40.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.031+0000 7ff4d7032640 1 -- 10.20.193.5:0/3477325831 shutdown_connections 2026-02-17T21:28:40.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.031+0000 7ff4d7032640 1 -- 10.20.193.5:0/3477325831 wait complete. 2026-02-17T21:28:40.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.031+0000 7ff4d7032640 10 monclient: build_initial_monmap 2026-02-17T21:28:40.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.031+0000 7ff4d7032640 10 monclient: monmap: 2026-02-17T21:28:40.035 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:40.035 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:28:40.036 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:28:40.036 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:28:40.036 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:40.036 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:40.036 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:28:40.036 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:28:40.036 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:28:40.036 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:40.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.031+0000 7ff4d7032640 1 librados: starting msgr at 2026-02-17T21:28:40.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.031+0000 7ff4d7032640 1 librados: starting objecter 2026-02-17T21:28:40.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.031+0000 7ff4d7032640 1 Processor -- start 2026-02-17T21:28:40.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.031+0000 7ff4d7032640 1 -- start start 2026-02-17T21:28:40.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.031+0000 7ff4d7032640 1 librados: setting wanted keys 2026-02-17T21:28:40.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.031+0000 7ff4d7032640 1 librados: calling monclient init 2026-02-17T21:28:40.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.031+0000 7ff4d7032640 10 monclient: init 2026-02-17T21:28:40.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d7032640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:40.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d7032640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:28:40.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d7032640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff4d014f280 0x7ff4d01f7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:40.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d7032640 10 monclient(hunting): picked mon.noname-c con 0x7ff4d014f280 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:28:40.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d7032640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff4d014f660 0x7ff4d014b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:40.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d7032640 10 monclient(hunting): picked mon.noname-b con 0x7ff4d014f660 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:28:40.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d7032640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff4d015abc0 0x7ff4d01450c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:40.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d7032640 10 monclient(hunting): picked mon.noname-a con 0x7ff4d015abc0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d7032640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d7032640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d015a3c0 con 0x7ff4d015abc0 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d7032640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d7032640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d015a730 con 0x7ff4d014f660 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d7032640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d7032640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d00c9b70 con 0x7ff4d014f280 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d7032640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d7032640 10 monclient(hunting): authenticate will time out at 1225.597102s 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d55a8640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff4d015abc0 0x7ff4d01450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4c7fff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff4d014f660 0x7ff4d014b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d4da7640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff4d014f280 0x7ff4d01f7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d55a8640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff4d015abc0 0x7ff4d01450c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:45738/0 (socket says 10.20.193.5:45738) 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d55a8640 1 -- 10.20.193.5:0/4005108731 learned_addr learned my addr 10.20.193.5:0/4005108731 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d55a8640 10 monclient(hunting): get_auth_request con 0x7ff4d015abc0 auth_method 0 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d55a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d55a8640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d55a8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4c7fff640 10 monclient(hunting): get_auth_request con 0x7ff4d014f660 auth_method 0 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4c7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4c7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4c7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d4da7640 10 monclient(hunting): get_auth_request con 0x7ff4d014f280 auth_method 0 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d4da7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d4da7640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d4da7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:40.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d55a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:40.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d55a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:40.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.032+0000 7ff4d55a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:40.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.033+0000 7ff4c7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:40.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.033+0000 7ff4c7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:40.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.033+0000 7ff4c7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:40.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.033+0000 7ff4d4da7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:40.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.033+0000 7ff4d4da7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:40.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.033+0000 7ff4d4da7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:40.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.034+0000 7ff4d55a8640 10 monclient(hunting): handle_auth_done global_id 4911 payload 824 2026-02-17T21:28:40.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.034+0000 7ff4d55a8640 1 -- 10.20.193.5:0/4005108731 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff4d014f280 msgr2=0x7ff4d01f7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:40.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.034+0000 7ff4d55a8640 1 --2- 10.20.193.5:0/4005108731 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff4d014f280 0x7ff4d01f7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:40.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.034+0000 7ff4d55a8640 1 -- 10.20.193.5:0/4005108731 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff4d014f660 msgr2=0x7ff4d014b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:40.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.034+0000 7ff4d55a8640 1 --2- 10.20.193.5:0/4005108731 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff4d014f660 0x7ff4d014b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:40.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.034+0000 7ff4d55a8640 10 monclient: _finish_hunting 0 2026-02-17T21:28:40.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.034+0000 7ff4d55a8640 1 monclient: found mon.noname-a 2026-02-17T21:28:40.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.034+0000 7ff4d55a8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:40.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.034+0000 7ff4d55a8640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:28:40.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.034+0000 7ff4d55a8640 1 -- 10.20.193.5:0/4005108731 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d0144900 con 0x7ff4d015abc0 2026-02-17T21:28:40.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.035+0000 7ff4d55a8640 1 --2- 10.20.193.5:0/4005108731 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff4d015abc0 0x7ff4d01450c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00cba0 tx=0x7ff4cc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:40.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.035+0000 7ff4c57fa640 10 client.?.objecter ms_handle_connect 0x7ff4d015abc0 2026-02-17T21:28:40.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.035+0000 7ff4c57fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:28:40.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.036+0000 7ff4c57fa640 1 -- 10.20.193.5:0/4005108731 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc00ad50 con 0x7ff4d015abc0 2026-02-17T21:28:40.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.036+0000 7ff4c57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:40.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.036+0000 7ff4c57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:28:40.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.036+0000 7ff4c57fa640 10 monclient: dump: 2026-02-17T21:28:40.040 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:40.040 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:40.040 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:40.040 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:40.040 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:40.040 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:40.040 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:40.040 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:40.040 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:40.040 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:40.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.036+0000 7ff4c57fa640 10 monclient: _finish_auth 0 2026-02-17T21:28:40.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.036+0000 7ff4c57fa640 10 monclient: _check_auth_tickets 2026-02-17T21:28:40.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.036+0000 7ff4c57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:40.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.036+0000 7ff4c57fa640 1 -- 10.20.193.5:0/4005108731 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4cc003a70 con 0x7ff4d015abc0 2026-02-17T21:28:40.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.036+0000 7ff4d7032640 5 monclient: authenticate success, global_id 4911 2026-02-17T21:28:40.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.036+0000 7ff4d7032640 10 monclient: _renew_subs 2026-02-17T21:28:40.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.036+0000 7ff4d7032640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:40.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.036+0000 7ff4d7032640 1 -- 10.20.193.5:0/4005108731 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4d0073500 con 0x7ff4d015abc0 2026-02-17T21:28:40.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.036+0000 7ff4c57fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:40.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.036+0000 7ff4c57fa640 1 -- 10.20.193.5:0/4005108731 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc003e40 con 0x7ff4d015abc0 2026-02-17T21:28:40.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.036+0000 7ff4c57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:40.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.036+0000 7ff4c57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:28:40.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.036+0000 7ff4c57fa640 10 monclient: dump: 2026-02-17T21:28:40.041 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:40.041 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:40.041 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:40.041 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:40.041 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:40.041 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:40.041 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:40.041 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:40.041 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:40.041 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:40.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.036+0000 7ff4c6ffd640 4 set_mon_vals no callback set 2026-02-17T21:28:40.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.036+0000 7ff4d7032640 10 client.4911.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:28:40.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.036+0000 7ff4d7032640 10 monclient: _renew_subs 2026-02-17T21:28:40.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.036+0000 7ff4d7032640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:40.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.036+0000 7ff4d7032640 1 -- 10.20.193.5:0/4005108731 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4d0073ac0 con 0x7ff4d015abc0 2026-02-17T21:28:40.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.036+0000 7ff4d7032640 1 librados: init done 2026-02-17T21:28:40.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.037+0000 7ff4d7032640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:40.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.037+0000 7ff4d7032640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:40.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.037+0000 7ff4d7032640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:40.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.037+0000 7ff4d7032640 1 -- 10.20.193.5:0/4005108731 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4d00c6a00 con 0x7ff4d015abc0 2026-02-17T21:28:40.050 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.048+0000 7ff4c57fa640 1 -- 10.20.193.5:0/4005108731 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7ff4cc0050d0 con 0x7ff4d015abc0 2026-02-17T21:28:40.050 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.049+0000 7ff4c57fa640 1 --2- 10.20.193.5:0/4005108731 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff4a0079280 0x7ff4a007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:40.051 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.049+0000 7ff4d4da7640 1 --2- 10.20.193.5:0/4005108731 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff4a0079280 0x7ff4a007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:40.051 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.049+0000 7ff4d4da7640 10 monclient: get_auth_request con 0x7ff4a0079280 auth_method 0 2026-02-17T21:28:40.051 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.050+0000 7ff4d4da7640 1 --2- 10.20.193.5:0/4005108731 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff4a0079280 0x7ff4a007b740 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0039000 tx=0x7ff4c0033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:40.051 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.050+0000 7ff4c57fa640 10 client.4911.objecter ms_handle_connect 0x7ff4a0079280 2026-02-17T21:28:40.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.151+0000 7ff4c57fa640 1 -- 10.20.193.5:0/4005108731 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7ff4cc05ea40 con 0x7ff4d015abc0 2026-02-17T21:28:40.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.151+0000 7ff4c57fa640 10 client.4911.objecter ms_dispatch2 0x7ff4d0000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:28:40.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.151+0000 7ff4c57fa640 3 client.4911.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:28:40.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.151+0000 7ff4c57fa640 3 client.4911.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:28:40.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.151+0000 7ff4c57fa640 20 client.4911.objecter dump_active .. 0 homeless 2026-02-17T21:28:40.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.151+0000 7ff4c57fa640 1 -- 10.20.193.5:0/4005108731 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff4d00c7110 con 0x7ff4d015abc0 2026-02-17T21:28:40.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.151+0000 7ff4c57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:40.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.151+0000 7ff4c57fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:28:40.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.258+0000 7ff4d7032640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:28:40.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.258+0000 7ff4d7032640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:40.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.258+0000 7ff4d7032640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:40.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.258+0000 7ff4d7032640 1 -- 10.20.193.5:0/4005108731 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff4d0142da0 con 0x7ff4d015abc0 2026-02-17T21:28:40.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.261+0000 7ff4c57fa640 1 -- 10.20.193.5:0/4005108731 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7ff4cc062a00 con 0x7ff4d015abc0 2026-02-17T21:28:40.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.261+0000 7ff4c57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:40.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.261+0000 7ff4c57fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:28:40.263 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:28:40.263 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:28:40.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.262+0000 7ff4d7032640 10 librados: watch_flush enter 2026-02-17T21:28:40.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.262+0000 7ff4d7032640 10 librados: watch_flush exit 2026-02-17T21:28:40.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.262+0000 7ff4d7032640 20 client.4911.objecter shutdown clearing up homeless session... 2026-02-17T21:28:40.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.262+0000 7ff4d7032640 10 client.4911.objecter successfully canceled tick 2026-02-17T21:28:40.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.262+0000 7ff4d7032640 1 -- 10.20.193.5:0/4005108731 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff4a0079280 msgr2=0x7ff4a007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:40.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.262+0000 7ff4d7032640 1 --2- 10.20.193.5:0/4005108731 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff4a0079280 0x7ff4a007b740 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0039000 tx=0x7ff4c0033000 comp rx=0 tx=0).stop 2026-02-17T21:28:40.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.262+0000 7ff4d7032640 10 monclient: shutdown 2026-02-17T21:28:40.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.262+0000 7ff4d7032640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:40.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.262+0000 7ff4d7032640 1 -- 10.20.193.5:0/4005108731 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff4d015abc0 msgr2=0x7ff4d01450c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:40.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.262+0000 7ff4d7032640 1 --2- 10.20.193.5:0/4005108731 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff4d015abc0 0x7ff4d01450c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00cba0 tx=0x7ff4cc00a430 comp rx=0 tx=0).stop 2026-02-17T21:28:40.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.262+0000 7ff4d7032640 1 -- 10.20.193.5:0/4005108731 shutdown_connections 2026-02-17T21:28:40.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.262+0000 7ff4d7032640 1 --2- 10.20.193.5:0/4005108731 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff4a0079280 0x7ff4a007b740 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:40.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.262+0000 7ff4d7032640 1 --2- 10.20.193.5:0/4005108731 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff4d015abc0 0x7ff4d01450c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:40.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.262+0000 7ff4d7032640 1 --2- 10.20.193.5:0/4005108731 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff4d014f660 0x7ff4d014b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:40.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.262+0000 7ff4d7032640 1 --2- 10.20.193.5:0/4005108731 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff4d014f280 0x7ff4d01f7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:40.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.262+0000 7ff4d7032640 1 -- 10.20.193.5:0/4005108731 >> 10.20.193.5:0/4005108731 conn(0x7ff4d00c9f20 msgr2=0x7ff4d00c9440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:40.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.262+0000 7ff4d7032640 1 -- 10.20.193.5:0/4005108731 shutdown_connections 2026-02-17T21:28:40.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.262+0000 7ff4d7032640 1 -- 10.20.193.5:0/4005108731 wait complete. 2026-02-17T21:28:40.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:40.262+0000 7ff4d7032640 1 librados: shutdown 2026-02-17T21:28:43.274 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:28:43.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.341+0000 7fbb3a52c640 10 monclient: get_monmap_and_config 2026-02-17T21:28:43.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.341+0000 7fbb3a52c640 10 monclient: build_initial_monmap 2026-02-17T21:28:43.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.341+0000 7fbb3a52c640 10 monclient: monmap: 2026-02-17T21:28:43.343 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:43.343 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:43.343 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:28:43.342228+0000 2026-02-17T21:28:43.343 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:28:43.342228+0000 2026-02-17T21:28:43.343 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:43.343 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:43.343 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:28:43.343 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:28:43.343 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:28:43.343 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:28:43.343 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:28:43.343 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:28:43.343 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:43.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.341+0000 7fbb3a52c640 1 Processor -- start 2026-02-17T21:28:43.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.342+0000 7fbb3a52c640 1 -- start start 2026-02-17T21:28:43.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.342+0000 7fbb3a52c640 10 monclient: init 2026-02-17T21:28:43.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.342+0000 7fbb3a52c640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:43.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.342+0000 7fbb3a52c640 10 monclient: _add_conns ranks=[1,5,4,0,3,2] 2026-02-17T21:28:43.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.342+0000 7fbb3a52c640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fbb340c7170 addr v1:10.20.193.119:6789/0 2026-02-17T21:28:43.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.342+0000 7fbb3a52c640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fbb340c7550 0x7fbb340749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:43.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.342+0000 7fbb3a52c640 10 monclient(hunting): picked mon.noname-c con 0x7fbb340c7550 addr v2:10.20.193.135:3300/0 2026-02-17T21:28:43.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.342+0000 7fbb3a52c640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fbb34074ef0 0x7fbb340c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:43.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.342+0000 7fbb3a52c640 10 monclient(hunting): picked mon.noname-b con 0x7fbb34074ef0 addr v2:10.20.193.119:3300/0 2026-02-17T21:28:43.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.342+0000 7fbb3a52c640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb340c4fd0 con 0x7fbb340c7170 2026-02-17T21:28:43.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.342+0000 7fbb3a52c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:43.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.342+0000 7fbb3a52c640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fbb340c8530 con 0x7fbb34074ef0 2026-02-17T21:28:43.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.342+0000 7fbb3a52c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:43.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.342+0000 7fbb3a52c640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fbb3415a9a0 con 0x7fbb340c7550 2026-02-17T21:28:43.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.342+0000 7fbb3a52c640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:43.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.342+0000 7fbb3a52c640 10 monclient(hunting): authenticate will time out at 1228.907496s 2026-02-17T21:28:43.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.342+0000 7fbb337fe640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fbb340c7550 0x7fbb340749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:43.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.343+0000 7fbb337fe640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fbb340c7550 0x7fbb340749b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:60044/0 (socket says 10.20.193.5:60044) 2026-02-17T21:28:43.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.343+0000 7fbb337fe640 1 -- 10.20.193.5:0/2469977943 learned_addr learned my addr 10.20.193.5:0/2469977943 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:28:43.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.343+0000 7fbb337fe640 10 monclient(hunting): get_auth_request con 0x7fbb340c7550 auth_method 0 2026-02-17T21:28:43.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.343+0000 7fbb337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:43.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.343+0000 7fbb337fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:43.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.343+0000 7fbb337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:43.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.343+0000 7fbb337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:43.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.343+0000 7fbb337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:43.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.343+0000 7fbb337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:43.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.344+0000 7fbb337fe640 10 monclient(hunting): handle_auth_done global_id 4928 payload 274 2026-02-17T21:28:43.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.344+0000 7fbb337fe640 1 -- 10.20.193.5:0/2469977943 >> v2:10.20.193.119:3300/0 conn(0x7fbb34074ef0 msgr2=0x7fbb340c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:28:43.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.344+0000 7fbb337fe640 1 --2- 10.20.193.5:0/2469977943 >> v2:10.20.193.119:3300/0 conn(0x7fbb34074ef0 0x7fbb340c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:43.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.344+0000 7fbb337fe640 1 -- 10.20.193.5:0/2469977943 >> v1:10.20.193.119:6789/0 conn(0x7fbb340c7170 legacy=0x7fbb340c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:28:43.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.344+0000 7fbb337fe640 10 monclient: _finish_hunting 0 2026-02-17T21:28:43.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.344+0000 7fbb337fe640 1 monclient: found mon.noname-c 2026-02-17T21:28:43.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.344+0000 7fbb337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:43.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.344+0000 7fbb337fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:28:43.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.344+0000 7fbb337fe640 1 -- 10.20.193.5:0/2469977943 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb340c5270 con 0x7fbb340c7550 2026-02-17T21:28:43.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.345+0000 7fbb337fe640 1 --2- 10.20.193.5:0/2469977943 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbb340c7550 0x7fbb340749b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbb340c84a0 tx=0x7fbb2402eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=572155b43e7f83a6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:43.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.347+0000 7fbb32ffd640 1 -- 10.20.193.5:0/2469977943 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2403c070 con 0x7fbb340c7550 2026-02-17T21:28:43.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.347+0000 7fbb32ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:43.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.347+0000 7fbb32ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:28:43.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.347+0000 7fbb32ffd640 10 monclient: dump: 2026-02-17T21:28:43.349 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:43.349 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:43.349 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:43.349 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:43.349 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:43.349 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:43.349 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:43.349 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:43.349 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:43.349 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.347+0000 7fbb32ffd640 10 monclient: _finish_auth 0 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.347+0000 7fbb32ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.347+0000 7fbb32ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.347+0000 7fbb32ffd640 1 -- 10.20.193.5:0/2469977943 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb2402fb20 con 0x7fbb340c7550 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.347+0000 7fbb3a52c640 5 monclient: authenticate success, global_id 4928 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.347+0000 7fbb32ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.347+0000 7fbb32ffd640 1 -- 10.20.193.5:0/2469977943 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb24037440 con 0x7fbb340c7550 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.347+0000 7fbb32ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.347+0000 7fbb32ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.347+0000 7fbb32ffd640 10 monclient: dump: 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.347+0000 7fbb3a52c640 10 monclient: get_monmap_and_config success 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.347+0000 7fbb3a52c640 4 set_mon_vals no callback set 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.347+0000 7fbb3a52c640 10 monclient: shutdown 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.347+0000 7fbb3a52c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.347+0000 7fbb3a52c640 1 -- 10.20.193.5:0/2469977943 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbb340c7550 msgr2=0x7fbb340749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:43.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.347+0000 7fbb3a52c640 1 --2- 10.20.193.5:0/2469977943 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbb340c7550 0x7fbb340749b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbb340c84a0 tx=0x7fbb2402eeb0 comp rx=0 tx=0).stop 2026-02-17T21:28:43.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.348+0000 7fbb3a52c640 1 -- 10.20.193.5:0/2469977943 shutdown_connections 2026-02-17T21:28:43.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.348+0000 7fbb3a52c640 1 --2- 10.20.193.5:0/2469977943 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbb340c7550 0x7fbb340749b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:43.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.348+0000 7fbb3a52c640 1 --2- 10.20.193.5:0/2469977943 >> v2:10.20.193.119:3300/0 conn(0x7fbb34074ef0 0x7fbb340c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:43.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.348+0000 7fbb3a52c640 1 -- 10.20.193.5:0/2469977943 >> 10.20.193.5:0/2469977943 conn(0x7fbb340c9f40 msgr2=0x7fbb340ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:43.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.348+0000 7fbb3a52c640 1 -- 10.20.193.5:0/2469977943 shutdown_connections 2026-02-17T21:28:43.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.348+0000 7fbb3a52c640 1 -- 10.20.193.5:0/2469977943 wait complete. 2026-02-17T21:28:43.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.348+0000 7fbb3a52c640 10 monclient: build_initial_monmap 2026-02-17T21:28:43.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.348+0000 7fbb3a52c640 10 monclient: monmap: 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.348+0000 7fbb3a52c640 1 librados: starting msgr at 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.348+0000 7fbb3a52c640 1 librados: starting objecter 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.348+0000 7fbb3a52c640 1 Processor -- start 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.348+0000 7fbb3a52c640 1 -- start start 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.348+0000 7fbb3a52c640 1 librados: setting wanted keys 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.348+0000 7fbb3a52c640 1 librados: calling monclient init 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.348+0000 7fbb3a52c640 10 monclient: init 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb3a52c640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb3a52c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb3a52c640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbb34074ef0 0x7fbb340be810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb3a52c640 10 monclient(hunting): picked mon.noname-a con 0x7fbb34074ef0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb3a52c640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbb340c7170 0x7fbb34149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb3a52c640 10 monclient(hunting): picked mon.noname-c con 0x7fbb340c7170 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb3a52c640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbb340c7550 0x7fbb3415d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb3a52c640 10 monclient(hunting): picked mon.noname-b con 0x7fbb340c7550 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:28:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb3a52c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb3a52c640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbb340c7ee0 con 0x7fbb34074ef0 2026-02-17T21:28:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb3a52c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb3a52c640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbb340c5830 con 0x7fbb340c7550 2026-02-17T21:28:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb3a52c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb3a52c640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbb340c81c0 con 0x7fbb340c7170 2026-02-17T21:28:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb3a52c640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb3a52c640 10 monclient(hunting): authenticate will time out at 1228.914381s 2026-02-17T21:28:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb38aa2640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbb340c7550 0x7fbb3415d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb337fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbb340c7170 0x7fbb34149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb38aa2640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbb340c7550 0x7fbb3415d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:55294/0 (socket says 10.20.193.5:55294) 2026-02-17T21:28:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb38aa2640 1 -- 10.20.193.5:0/3987159675 learned_addr learned my addr 10.20.193.5:0/3987159675 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:28:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb38aa2640 10 monclient(hunting): get_auth_request con 0x7fbb340c7550 auth_method 0 2026-02-17T21:28:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb38aa2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb38aa2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb38aa2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb337fe640 10 monclient(hunting): get_auth_request con 0x7fbb340c7170 auth_method 0 2026-02-17T21:28:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb337fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.349+0000 7fbb337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.350+0000 7fbb38aa2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.350+0000 7fbb38aa2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.350+0000 7fbb38aa2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.350+0000 7fbb337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.350+0000 7fbb337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:43.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.350+0000 7fbb337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:43.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.351+0000 7fbb38aa2640 10 monclient(hunting): handle_auth_done global_id 4945 payload 824 2026-02-17T21:28:43.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.351+0000 7fbb38aa2640 1 -- 10.20.193.5:0/3987159675 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbb340c7170 msgr2=0x7fbb34149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:43.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.351+0000 7fbb38aa2640 1 --2- 10.20.193.5:0/3987159675 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbb340c7170 0x7fbb34149800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:43.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.351+0000 7fbb38aa2640 1 -- 10.20.193.5:0/3987159675 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbb34074ef0 msgr2=0x7fbb340be810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:43.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.351+0000 7fbb38aa2640 1 --2- 10.20.193.5:0/3987159675 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbb34074ef0 0x7fbb340be810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:43.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.351+0000 7fbb38aa2640 10 monclient: _finish_hunting 0 2026-02-17T21:28:43.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.351+0000 7fbb38aa2640 1 monclient: found mon.noname-b 2026-02-17T21:28:43.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.351+0000 7fbb38aa2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:43.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.351+0000 7fbb38aa2640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:28:43.355 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.351+0000 7fbb38aa2640 1 -- 10.20.193.5:0/3987159675 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb341f46e0 con 0x7fbb340c7550 2026-02-17T21:28:43.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.352+0000 7fbb38aa2640 1 --2- 10.20.193.5:0/3987159675 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbb340c7550 0x7fbb3415d090 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbb2800b970 tx=0x7fbb2800be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:43.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.352+0000 7fbb30ff9640 10 client.?.objecter ms_handle_connect 0x7fbb340c7550 2026-02-17T21:28:43.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.352+0000 7fbb30ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:28:43.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb30ff9640 1 -- 10.20.193.5:0/3987159675 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2800c790 con 0x7fbb340c7550 2026-02-17T21:28:43.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb30ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:43.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb30ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:28:43.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb30ff9640 10 monclient: dump: 2026-02-17T21:28:43.356 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:43.356 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:43.356 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:43.356 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:43.356 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:43.356 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:43.356 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:43.356 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:43.356 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:43.356 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:43.356 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb30ff9640 10 monclient: _finish_auth 0 2026-02-17T21:28:43.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb30ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:28:43.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb30ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:43.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb30ff9640 1 -- 10.20.193.5:0/3987159675 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb28010070 con 0x7fbb340c7550 2026-02-17T21:28:43.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb30ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:43.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb30ff9640 1 -- 10.20.193.5:0/3987159675 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2800cb90 con 0x7fbb340c7550 2026-02-17T21:28:43.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb30ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:43.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb30ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:28:43.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb327fc640 4 set_mon_vals no callback set 2026-02-17T21:28:43.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb30ff9640 10 monclient: dump: 2026-02-17T21:28:43.357 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:43.357 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:43.357 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:43.357 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:43.357 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:43.357 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:43.357 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:43.357 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:43.357 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:43.357 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:43.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb3a52c640 5 monclient: authenticate success, global_id 4945 2026-02-17T21:28:43.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb3a52c640 10 monclient: _renew_subs 2026-02-17T21:28:43.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb3a52c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:43.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb3a52c640 1 -- 10.20.193.5:0/3987159675 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb340c3230 con 0x7fbb340c7550 2026-02-17T21:28:43.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb3a52c640 10 client.4945.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:28:43.357 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb3a52c640 10 monclient: _renew_subs 2026-02-17T21:28:43.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb3a52c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:43.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb3a52c640 1 -- 10.20.193.5:0/3987159675 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb340c37f0 con 0x7fbb340c7550 2026-02-17T21:28:43.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb3a52c640 1 librados: init done 2026-02-17T21:28:43.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb3a52c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:43.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb3a52c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:43.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb3a52c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:43.358 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.354+0000 7fbb3a52c640 1 -- 10.20.193.5:0/3987159675 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb340749b0 con 0x7fbb340c7550 2026-02-17T21:28:43.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.457+0000 7fbb30ff9640 1 -- 10.20.193.5:0/3987159675 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fbb28004070 con 0x7fbb340c7550 2026-02-17T21:28:43.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.458+0000 7fbb30ff9640 1 --2- 10.20.193.5:0/3987159675 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbb040792b0 0x7fbb0407b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:43.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.458+0000 7fbb33fff640 1 --2- 10.20.193.5:0/3987159675 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbb040792b0 0x7fbb0407b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:43.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.458+0000 7fbb33fff640 10 monclient: get_auth_request con 0x7fbb040792b0 auth_method 0 2026-02-17T21:28:43.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.459+0000 7fbb33fff640 1 --2- 10.20.193.5:0/3987159675 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbb040792b0 0x7fbb0407b770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbb20006fd0 tx=0x7fbb20006d40 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:43.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.459+0000 7fbb30ff9640 10 client.4945.objecter ms_handle_connect 0x7fbb040792b0 2026-02-17T21:28:43.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.459+0000 7fbb30ff9640 1 -- 10.20.193.5:0/3987159675 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fbb2800cd30 con 0x7fbb340c7550 2026-02-17T21:28:43.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.459+0000 7fbb30ff9640 10 client.4945.objecter ms_dispatch2 0x7fbb34000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:28:43.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.459+0000 7fbb30ff9640 3 client.4945.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:28:43.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.459+0000 7fbb30ff9640 3 client.4945.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:28:43.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.459+0000 7fbb30ff9640 20 client.4945.objecter dump_active .. 0 homeless 2026-02-17T21:28:43.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.467+0000 7fbb30ff9640 1 -- 10.20.193.5:0/3987159675 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbb28062520 con 0x7fbb340c7550 2026-02-17T21:28:43.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.467+0000 7fbb30ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:43.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.467+0000 7fbb30ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:28:43.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.568+0000 7fbb3a52c640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:28:43.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.568+0000 7fbb3a52c640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:43.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.568+0000 7fbb3a52c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:43.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.568+0000 7fbb3a52c640 1 -- 10.20.193.5:0/3987159675 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbb34073ad0 con 0x7fbb340c7550 2026-02-17T21:28:43.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.570+0000 7fbb30ff9640 1 -- 10.20.193.5:0/3987159675 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fbb28061e20 con 0x7fbb340c7550 2026-02-17T21:28:43.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.570+0000 7fbb30ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:43.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.570+0000 7fbb30ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:28:43.572 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:28:43.572 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:28:43.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.571+0000 7fbb3a52c640 10 librados: watch_flush enter 2026-02-17T21:28:43.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.571+0000 7fbb3a52c640 10 librados: watch_flush exit 2026-02-17T21:28:43.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.571+0000 7fbb3a52c640 20 client.4945.objecter shutdown clearing up homeless session... 2026-02-17T21:28:43.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.571+0000 7fbb3a52c640 10 client.4945.objecter successfully canceled tick 2026-02-17T21:28:43.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.571+0000 7fbb3a52c640 1 -- 10.20.193.5:0/3987159675 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbb040792b0 msgr2=0x7fbb0407b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:43.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.571+0000 7fbb3a52c640 1 --2- 10.20.193.5:0/3987159675 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbb040792b0 0x7fbb0407b770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbb20006fd0 tx=0x7fbb20006d40 comp rx=0 tx=0).stop 2026-02-17T21:28:43.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.571+0000 7fbb3a52c640 10 monclient: shutdown 2026-02-17T21:28:43.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.571+0000 7fbb3a52c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:43.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.571+0000 7fbb3a52c640 1 -- 10.20.193.5:0/3987159675 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbb340c7550 msgr2=0x7fbb3415d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:43.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.571+0000 7fbb3a52c640 1 --2- 10.20.193.5:0/3987159675 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbb340c7550 0x7fbb3415d090 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbb2800b970 tx=0x7fbb2800be40 comp rx=0 tx=0).stop 2026-02-17T21:28:43.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.571+0000 7fbb3a52c640 1 -- 10.20.193.5:0/3987159675 shutdown_connections 2026-02-17T21:28:43.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.571+0000 7fbb3a52c640 1 --2- 10.20.193.5:0/3987159675 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbb040792b0 0x7fbb0407b770 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:43.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.571+0000 7fbb3a52c640 1 --2- 10.20.193.5:0/3987159675 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbb340c7550 0x7fbb3415d090 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:43.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.571+0000 7fbb3a52c640 1 --2- 10.20.193.5:0/3987159675 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbb340c7170 0x7fbb34149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:43.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.571+0000 7fbb3a52c640 1 --2- 10.20.193.5:0/3987159675 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbb34074ef0 0x7fbb340be810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:43.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.571+0000 7fbb3a52c640 1 -- 10.20.193.5:0/3987159675 >> 10.20.193.5:0/3987159675 conn(0x7fbb340c9f40 msgr2=0x7fbb34073ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:43.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.571+0000 7fbb3a52c640 1 -- 10.20.193.5:0/3987159675 shutdown_connections 2026-02-17T21:28:43.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.571+0000 7fbb3a52c640 1 -- 10.20.193.5:0/3987159675 wait complete. 2026-02-17T21:28:43.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:43.571+0000 7fbb3a52c640 1 librados: shutdown 2026-02-17T21:28:46.582 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:28:46.652 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.649+0000 7f013065e640 10 monclient: get_monmap_and_config 2026-02-17T21:28:46.652 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.649+0000 7f013065e640 10 monclient: build_initial_monmap 2026-02-17T21:28:46.652 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.649+0000 7f013065e640 10 monclient: monmap: 2026-02-17T21:28:46.652 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:46.652 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:46.652 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:28:46.649824+0000 2026-02-17T21:28:46.653 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:28:46.649824+0000 2026-02-17T21:28:46.653 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:46.653 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:46.653 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:28:46.653 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:28:46.653 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:28:46.653 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:28:46.653 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:28:46.653 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:28:46.653 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:46.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.649+0000 7f013065e640 1 Processor -- start 2026-02-17T21:28:46.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.649+0000 7f013065e640 1 -- start start 2026-02-17T21:28:46.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.649+0000 7f013065e640 10 monclient: init 2026-02-17T21:28:46.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.650+0000 7f013065e640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:46.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.650+0000 7f013065e640 10 monclient: _add_conns ranks=[2,1,3,0,5,4] 2026-02-17T21:28:46.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.650+0000 7f013065e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f012815d370 addr v1:10.20.193.135:6789/0 2026-02-17T21:28:46.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.650+0000 7f013065e640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f01280c7e20 addr v1:10.20.193.119:6789/0 2026-02-17T21:28:46.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.650+0000 7f013065e640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f01280c59c0 0x7f012815d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:46.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.650+0000 7f013065e640 10 monclient(hunting): picked mon.noname-a con 0x7f01280c59c0 addr v2:10.20.193.5:3300/0 2026-02-17T21:28:46.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.650+0000 7f013065e640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01280c8350 con 0x7f01280c7e20 2026-02-17T21:28:46.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.650+0000 7f013065e640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01280c8630 con 0x7f012815d370 2026-02-17T21:28:46.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.650+0000 7f013065e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:46.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.650+0000 7f013065e640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f012815b710 con 0x7f01280c59c0 2026-02-17T21:28:46.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.650+0000 7f013065e640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:46.655 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.650+0000 7f013065e640 10 monclient(hunting): authenticate will time out at 1232.215126s 2026-02-17T21:28:46.655 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.650+0000 7f012dbd2640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f01280c7e20 0x7f01280c52b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:53200/0 (socket says 10.20.193.5:53200) 2026-02-17T21:28:46.655 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.650+0000 7f012dbd2640 1 -- 10.20.193.5:0/1933901417 learned_addr learned my addr 10.20.193.5:0/1933901417 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:28:46.655 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.650+0000 7f012ebd4640 1 --2- 10.20.193.5:0/1933901417 >> v2:10.20.193.5:3300/0 conn(0x7f01280c59c0 0x7f012815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:46.655 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.650+0000 7f012ebd4640 10 monclient(hunting): get_auth_request con 0x7f01280c59c0 auth_method 0 2026-02-17T21:28:46.655 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.650+0000 7f012ebd4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:46.655 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.650+0000 7f012ebd4640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:46.655 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.650+0000 7f012ebd4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:46.661 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.651+0000 7f012ebd4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:46.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.651+0000 7f012ebd4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:46.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.651+0000 7f012ebd4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:46.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.651+0000 7f012d3d1640 1 -- 10.20.193.5:0/1933901417 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3382352974 0 0) 0x7f01280c8350 con 0x7f01280c7e20 2026-02-17T21:28:46.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.651+0000 7f012d3d1640 10 monclient(hunting): _negotiate 2026-02-17T21:28:46.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.651+0000 7f012d3d1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:46.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.651+0000 7f012d3d1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:46.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.652+0000 7f012d3d1640 10 monclient(hunting): my global_id is 4948 2026-02-17T21:28:46.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.652+0000 7f012d3d1640 1 -- 10.20.193.5:0/1933901417 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0110003620 con 0x7f01280c7e20 2026-02-17T21:28:46.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.652+0000 7f012ebd4640 10 monclient(hunting): handle_auth_done global_id 4914 payload 274 2026-02-17T21:28:46.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.652+0000 7f012ebd4640 1 -- 10.20.193.5:0/1933901417 >> v1:10.20.193.135:6789/0 conn(0x7f012815d370 legacy=0x7f012815b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:46.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.652+0000 7f012ebd4640 1 -- 10.20.193.5:0/1933901417 >> v1:10.20.193.119:6789/0 conn(0x7f01280c7e20 legacy=0x7f01280c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:46.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.652+0000 7f012ebd4640 10 monclient: _finish_hunting 0 2026-02-17T21:28:46.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.652+0000 7f012ebd4640 1 monclient: found mon.noname-a 2026-02-17T21:28:46.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.652+0000 7f012ebd4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:46.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.652+0000 7f012ebd4640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:28:46.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.652+0000 7f012ebd4640 1 -- 10.20.193.5:0/1933901417 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01280c8910 con 0x7f01280c59c0 2026-02-17T21:28:46.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.653+0000 7f012ebd4640 1 --2- 10.20.193.5:0/1933901417 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f01280c59c0 0x7f012815d750 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0124009d90 tx=0x7f012402f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=577889f1f7701646 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:46.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f012d3d1640 1 -- 10.20.193.5:0/1933901417 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012403c070 con 0x7f01280c59c0 2026-02-17T21:28:46.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f012d3d1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:46.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f012d3d1640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:28:46.663 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f012d3d1640 10 monclient: dump: 2026-02-17T21:28:46.663 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:46.664 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:46.664 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:46.664 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:46.664 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:46.664 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:46.664 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:46.664 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:46.664 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:46.664 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:46.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f012d3d1640 10 monclient: _finish_auth 0 2026-02-17T21:28:46.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f012d3d1640 10 monclient: _check_auth_tickets 2026-02-17T21:28:46.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f012d3d1640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:46.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f012d3d1640 1 -- 10.20.193.5:0/1933901417 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0124037440 con 0x7f01280c59c0 2026-02-17T21:28:46.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f013065e640 5 monclient: authenticate success, global_id 4914 2026-02-17T21:28:46.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f013065e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:28:46.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f012d3d1640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:46.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f012d3d1640 1 -- 10.20.193.5:0/1933901417 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0124037810 con 0x7f01280c59c0 2026-02-17T21:28:46.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f013065e640 10 monclient: get_monmap_and_config success 2026-02-17T21:28:46.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f012d3d1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:46.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f013065e640 4 set_mon_vals no callback set 2026-02-17T21:28:46.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f012d3d1640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:28:46.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f012d3d1640 10 monclient: dump: 2026-02-17T21:28:46.665 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:46.666 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:46.666 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:46.666 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:46.666 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:46.666 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:46.666 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:46.666 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:46.666 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:46.666 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:46.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f013065e640 10 monclient: shutdown 2026-02-17T21:28:46.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f013065e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:46.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f013065e640 1 -- 10.20.193.5:0/1933901417 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f01280c59c0 msgr2=0x7f012815d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:46.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f013065e640 1 --2- 10.20.193.5:0/1933901417 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f01280c59c0 0x7f012815d750 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0124009d90 tx=0x7f012402f230 comp rx=0 tx=0).stop 2026-02-17T21:28:46.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f013065e640 1 -- 10.20.193.5:0/1933901417 shutdown_connections 2026-02-17T21:28:46.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f013065e640 1 --2- 10.20.193.5:0/1933901417 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f01280c59c0 0x7f012815d750 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:46.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f013065e640 1 -- 10.20.193.5:0/1933901417 >> 10.20.193.5:0/1933901417 conn(0x7f01280c9f20 msgr2=0x7f01280ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:46.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f013065e640 1 -- 10.20.193.5:0/1933901417 shutdown_connections 2026-02-17T21:28:46.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.655+0000 7f013065e640 1 -- 10.20.193.5:0/1933901417 wait complete. 2026-02-17T21:28:46.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f013065e640 10 monclient: build_initial_monmap 2026-02-17T21:28:46.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f013065e640 10 monclient: monmap: 2026-02-17T21:28:46.667 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:46.667 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:28:46.667 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:28:46.667 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:28:46.668 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:46.668 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:46.668 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:28:46.668 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:28:46.668 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:28:46.668 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:46.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f013065e640 1 librados: starting msgr at 2026-02-17T21:28:46.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f013065e640 1 librados: starting objecter 2026-02-17T21:28:46.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f013065e640 1 Processor -- start 2026-02-17T21:28:46.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f013065e640 1 -- start start 2026-02-17T21:28:46.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f013065e640 1 librados: setting wanted keys 2026-02-17T21:28:46.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f013065e640 1 librados: calling monclient init 2026-02-17T21:28:46.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f013065e640 10 monclient: init 2026-02-17T21:28:46.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f013065e640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:46.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f013065e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:28:46.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f013065e640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f01280c59c0 0x7f01281f74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:46.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f013065e640 10 monclient(hunting): picked mon.noname-b con 0x7f01280c59c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:28:46.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f013065e640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f01280c7e20 0x7f0128073df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:46.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f013065e640 10 monclient(hunting): picked mon.noname-a con 0x7f01280c7e20 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:28:46.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f013065e640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f012815d370 0x7f01281495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:46.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f013065e640 10 monclient(hunting): picked mon.noname-c con 0x7f012815d370 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:28:46.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f013065e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:46.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f013065e640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f01280c8ed0 con 0x7f01280c7e20 2026-02-17T21:28:46.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f013065e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:46.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f013065e640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f01280c9240 con 0x7f01280c59c0 2026-02-17T21:28:46.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f013065e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:46.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f013065e640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f01280c96d0 con 0x7f012815d370 2026-02-17T21:28:46.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f013065e640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:46.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f013065e640 10 monclient(hunting): authenticate will time out at 1232.221705s 2026-02-17T21:28:46.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f012dbd2640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f01280c7e20 0x7f0128073df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:46.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.656+0000 7f012e3d3640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f01280c59c0 0x7f01281f74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:46.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.657+0000 7f012e3d3640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f01280c59c0 0x7f01281f74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:55296/0 (socket says 10.20.193.5:55296) 2026-02-17T21:28:46.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.657+0000 7f012e3d3640 1 -- 10.20.193.5:0/1518790204 learned_addr learned my addr 10.20.193.5:0/1518790204 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:28:46.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.657+0000 7f012e3d3640 10 monclient(hunting): get_auth_request con 0x7f01280c59c0 auth_method 0 2026-02-17T21:28:46.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.657+0000 7f012e3d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:46.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.657+0000 7f012e3d3640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:46.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.657+0000 7f012e3d3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:46.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.657+0000 7f012dbd2640 10 monclient(hunting): get_auth_request con 0x7f01280c7e20 auth_method 0 2026-02-17T21:28:46.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.657+0000 7f012dbd2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:46.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.657+0000 7f012dbd2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:46.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.657+0000 7f012dbd2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:46.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.657+0000 7f012ebd4640 1 --2- 10.20.193.5:0/1518790204 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f012815d370 0x7f01281495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:46.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.657+0000 7f012dbd2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:46.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.657+0000 7f012dbd2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:46.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.657+0000 7f012dbd2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:46.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.657+0000 7f012e3d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:46.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.657+0000 7f012e3d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:46.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.657+0000 7f012e3d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:46.671 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.657+0000 7f012ebd4640 10 monclient(hunting): get_auth_request con 0x7f012815d370 auth_method 0 2026-02-17T21:28:46.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.657+0000 7f012ebd4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:46.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.657+0000 7f012ebd4640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:46.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.657+0000 7f012ebd4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:46.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.657+0000 7f012ebd4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:46.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.657+0000 7f012ebd4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:46.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.657+0000 7f012ebd4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:46.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.658+0000 7f012dbd2640 10 monclient(hunting): handle_auth_done global_id 4917 payload 824 2026-02-17T21:28:46.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.658+0000 7f012dbd2640 1 -- 10.20.193.5:0/1518790204 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f012815d370 msgr2=0x7f01281495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:46.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.658+0000 7f012dbd2640 1 --2- 10.20.193.5:0/1518790204 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f012815d370 0x7f01281495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:46.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.658+0000 7f012dbd2640 1 -- 10.20.193.5:0/1518790204 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f01280c59c0 msgr2=0x7f01281f74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:46.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.658+0000 7f012dbd2640 1 --2- 10.20.193.5:0/1518790204 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f01280c59c0 0x7f01281f74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:46.672 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.658+0000 7f012dbd2640 10 monclient: _finish_hunting 0 2026-02-17T21:28:46.673 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.658+0000 7f012dbd2640 1 monclient: found mon.noname-a 2026-02-17T21:28:46.673 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.658+0000 7f012dbd2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:46.673 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.658+0000 7f012dbd2640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:28:46.673 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.658+0000 7f012dbd2640 1 -- 10.20.193.5:0/1518790204 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01281490d0 con 0x7f01280c7e20 2026-02-17T21:28:46.673 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.659+0000 7f012dbd2640 1 --2- 10.20.193.5:0/1518790204 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f01280c7e20 0x7f0128073df0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f011c00c4d0 tx=0x7f011c00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:46.673 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.659+0000 7f010effd640 10 client.?.objecter ms_handle_connect 0x7f01280c7e20 2026-02-17T21:28:46.673 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.659+0000 7f010effd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:28:46.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.661+0000 7f010effd640 1 -- 10.20.193.5:0/1518790204 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011c017070 con 0x7f01280c7e20 2026-02-17T21:28:46.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.661+0000 7f010effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:46.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.661+0000 7f010effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:28:46.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.661+0000 7f010effd640 10 monclient: dump: 2026-02-17T21:28:46.676 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:46.676 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:46.676 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:46.676 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:46.676 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:46.676 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:46.677 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:46.677 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:46.677 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:46.677 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:46.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.661+0000 7f010effd640 10 monclient: _finish_auth 0 2026-02-17T21:28:46.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.661+0000 7f010effd640 10 monclient: _check_auth_tickets 2026-02-17T21:28:46.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.661+0000 7f010effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:46.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.661+0000 7f010effd640 1 -- 10.20.193.5:0/1518790204 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f011c005de0 con 0x7f01280c7e20 2026-02-17T21:28:46.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.661+0000 7f013065e640 5 monclient: authenticate success, global_id 4917 2026-02-17T21:28:46.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.661+0000 7f013065e640 10 monclient: _renew_subs 2026-02-17T21:28:46.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.661+0000 7f013065e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:46.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.661+0000 7f013065e640 1 -- 10.20.193.5:0/1518790204 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f012814cc70 con 0x7f01280c7e20 2026-02-17T21:28:46.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.661+0000 7f010effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:46.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.661+0000 7f010effd640 1 -- 10.20.193.5:0/1518790204 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011c007290 con 0x7f01280c7e20 2026-02-17T21:28:46.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.661+0000 7f010effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:46.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.661+0000 7f010effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:28:46.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.661+0000 7f012cbd0640 4 set_mon_vals no callback set 2026-02-17T21:28:46.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.661+0000 7f010effd640 10 monclient: dump: 2026-02-17T21:28:46.678 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:46.678 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:46.678 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:46.678 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:46.679 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:46.679 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:46.679 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:46.679 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:46.679 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:46.679 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:46.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.661+0000 7f013065e640 10 client.4917.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:28:46.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.661+0000 7f013065e640 10 monclient: _renew_subs 2026-02-17T21:28:46.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.661+0000 7f013065e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:46.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.661+0000 7f013065e640 1 -- 10.20.193.5:0/1518790204 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f012814d230 con 0x7f01280c7e20 2026-02-17T21:28:46.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.661+0000 7f013065e640 1 librados: init done 2026-02-17T21:28:46.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.661+0000 7f013065e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:46.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.662+0000 7f013065e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:46.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.662+0000 7f013065e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:46.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.662+0000 7f013065e640 1 -- 10.20.193.5:0/1518790204 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01281492a0 con 0x7f01280c7e20 2026-02-17T21:28:46.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.672+0000 7f010effd640 1 -- 10.20.193.5:0/1518790204 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f011c007430 con 0x7f01280c7e20 2026-02-17T21:28:46.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.673+0000 7f010effd640 1 --2- 10.20.193.5:0/1518790204 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f00f8079280 0x7f00f807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:46.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.673+0000 7f012e3d3640 1 --2- 10.20.193.5:0/1518790204 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f00f8079280 0x7f00f807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:46.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.673+0000 7f012e3d3640 10 monclient: get_auth_request con 0x7f00f8079280 auth_method 0 2026-02-17T21:28:46.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.674+0000 7f012e3d3640 1 --2- 10.20.193.5:0/1518790204 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f00f8079280 0x7f00f807b740 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0118002410 tx=0x7f0118002a30 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:46.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.674+0000 7f010effd640 10 client.4917.objecter ms_handle_connect 0x7f00f8079280 2026-02-17T21:28:46.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.675+0000 7f010effd640 1 -- 10.20.193.5:0/1518790204 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f011c05d7b0 con 0x7f01280c7e20 2026-02-17T21:28:46.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.675+0000 7f010effd640 10 client.4917.objecter ms_dispatch2 0x7f0128000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:28:46.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.675+0000 7f010effd640 3 client.4917.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:28:46.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.675+0000 7f010effd640 3 client.4917.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:28:46.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.675+0000 7f010effd640 20 client.4917.objecter dump_active .. 0 homeless 2026-02-17T21:28:46.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.775+0000 7f010effd640 1 -- 10.20.193.5:0/1518790204 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f011c021020 con 0x7f01280c7e20 2026-02-17T21:28:46.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.776+0000 7f010effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:46.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.776+0000 7f010effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:28:46.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.880+0000 7f013065e640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:28:46.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.880+0000 7f013065e640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:46.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.880+0000 7f013065e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:28:46.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.880+0000 7f013065e640 1 -- 10.20.193.5:0/1518790204 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f012815d750 con 0x7f01280c7e20 2026-02-17T21:28:46.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.882+0000 7f010effd640 1 -- 10.20.193.5:0/1518790204 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f011c061770 con 0x7f01280c7e20 2026-02-17T21:28:46.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.882+0000 7f010effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:46.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.882+0000 7f010effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:28:46.884 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:28:46.884 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:28:46.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.883+0000 7f013065e640 10 librados: watch_flush enter 2026-02-17T21:28:46.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.883+0000 7f013065e640 10 librados: watch_flush exit 2026-02-17T21:28:46.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.883+0000 7f013065e640 20 client.4917.objecter shutdown clearing up homeless session... 2026-02-17T21:28:46.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.883+0000 7f013065e640 10 client.4917.objecter successfully canceled tick 2026-02-17T21:28:46.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.884+0000 7f013065e640 1 -- 10.20.193.5:0/1518790204 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f00f8079280 msgr2=0x7f00f807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:46.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.884+0000 7f013065e640 1 --2- 10.20.193.5:0/1518790204 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f00f8079280 0x7f00f807b740 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0118002410 tx=0x7f0118002a30 comp rx=0 tx=0).stop 2026-02-17T21:28:46.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.884+0000 7f013065e640 10 monclient: shutdown 2026-02-17T21:28:46.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.884+0000 7f013065e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:46.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.884+0000 7f013065e640 1 -- 10.20.193.5:0/1518790204 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f01280c7e20 msgr2=0x7f0128073df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:46.888 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.884+0000 7f013065e640 1 --2- 10.20.193.5:0/1518790204 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f01280c7e20 0x7f0128073df0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f011c00c4d0 tx=0x7f011c00c9a0 comp rx=0 tx=0).stop 2026-02-17T21:28:46.888 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.884+0000 7f013065e640 1 -- 10.20.193.5:0/1518790204 shutdown_connections 2026-02-17T21:28:46.888 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.884+0000 7f013065e640 1 --2- 10.20.193.5:0/1518790204 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f00f8079280 0x7f00f807b740 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:46.888 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.884+0000 7f013065e640 1 --2- 10.20.193.5:0/1518790204 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f012815d370 0x7f01281495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:46.888 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.884+0000 7f013065e640 1 --2- 10.20.193.5:0/1518790204 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f01280c7e20 0x7f0128073df0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:46.888 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.884+0000 7f013065e640 1 --2- 10.20.193.5:0/1518790204 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f01280c59c0 0x7f01281f74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:46.888 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.884+0000 7f013065e640 1 -- 10.20.193.5:0/1518790204 >> 10.20.193.5:0/1518790204 conn(0x7f01280c9f20 msgr2=0x7f0128150f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:46.888 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.884+0000 7f013065e640 1 -- 10.20.193.5:0/1518790204 shutdown_connections 2026-02-17T21:28:46.888 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.884+0000 7f013065e640 1 -- 10.20.193.5:0/1518790204 wait complete. 2026-02-17T21:28:46.888 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:46.884+0000 7f013065e640 1 librados: shutdown 2026-02-17T21:28:49.895 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:28:49.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.962+0000 7f7b3b961640 10 monclient: get_monmap_and_config 2026-02-17T21:28:49.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.962+0000 7f7b3b961640 10 monclient: build_initial_monmap 2026-02-17T21:28:49.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.962+0000 7f7b3b961640 10 monclient: monmap: 2026-02-17T21:28:49.965 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:49.965 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:49.965 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:28:49.963547+0000 2026-02-17T21:28:49.965 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:28:49.963547+0000 2026-02-17T21:28:49.965 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:49.966 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:49.966 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:28:49.966 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:28:49.966 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:28:49.966 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:28:49.966 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:28:49.966 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:28:49.966 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:49.966 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.963+0000 7f7b3b961640 1 Processor -- start 2026-02-17T21:28:49.966 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.963+0000 7f7b3b961640 1 -- start start 2026-02-17T21:28:49.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.963+0000 7f7b3b961640 10 monclient: init 2026-02-17T21:28:49.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.963+0000 7f7b3b961640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:49.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.963+0000 7f7b3b961640 10 monclient: _add_conns ranks=[5,0,1,4,2,3] 2026-02-17T21:28:49.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.963+0000 7f7b3b961640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f7b340c7170 0x7f7b340c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:49.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.963+0000 7f7b3b961640 10 monclient(hunting): picked mon.noname-c con 0x7f7b340c7170 addr v2:10.20.193.135:3300/0 2026-02-17T21:28:49.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.963+0000 7f7b3b961640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7b340c48c0 addr v1:10.20.193.5:6789/0 2026-02-17T21:28:49.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.963+0000 7f7b3b961640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f7b340c4d10 addr v1:10.20.193.119:6789/0 2026-02-17T21:28:49.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.963+0000 7f7b3b961640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b3415a9a0 con 0x7f7b340c48c0 2026-02-17T21:28:49.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.963+0000 7f7b3b961640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b340c5270 con 0x7f7b340c4d10 2026-02-17T21:28:49.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.963+0000 7f7b3b961640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:49.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.963+0000 7f7b3b961640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f7b340c8530 con 0x7f7b340c7170 2026-02-17T21:28:49.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.963+0000 7f7b3b961640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:49.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.963+0000 7f7b3b961640 10 monclient(hunting): authenticate will time out at 1235.528830s 2026-02-17T21:28:49.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.964+0000 7f7b39ed7640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f7b340c4d10 0x7f7b340c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:45994/0 (socket says 10.20.193.5:45994) 2026-02-17T21:28:49.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.964+0000 7f7b39ed7640 1 -- 10.20.193.5:0/2679243544 learned_addr learned my addr 10.20.193.5:0/2679243544 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:28:49.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.964+0000 7f7b38ed5640 1 --1- 10.20.193.5:0/2679243544 >> v1:10.20.193.5:6789/0 conn(0x7f7b340c48c0 0x7f7b340749b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:56490/0 (socket says 10.20.193.5:56490) 2026-02-17T21:28:49.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.964+0000 7f7b396d6640 1 --2- 10.20.193.5:0/2679243544 >> v2:10.20.193.135:3300/0 conn(0x7f7b340c7170 0x7f7b340c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:49.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.964+0000 7f7b396d6640 10 monclient(hunting): get_auth_request con 0x7f7b340c7170 auth_method 0 2026-02-17T21:28:49.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.964+0000 7f7b396d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:49.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.964+0000 7f7b396d6640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:49.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.964+0000 7f7b396d6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:49.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.965+0000 7f7b396d6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:49.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.965+0000 7f7b396d6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:49.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.965+0000 7f7b396d6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:49.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.965+0000 7f7b23fff640 1 -- 10.20.193.5:0/2679243544 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 551302793 0 0) 0x7f7b340c5270 con 0x7f7b340c4d10 2026-02-17T21:28:49.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.965+0000 7f7b23fff640 10 monclient(hunting): _negotiate 2026-02-17T21:28:49.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.965+0000 7f7b23fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:49.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.965+0000 7f7b23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:49.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.965+0000 7f7b23fff640 10 monclient(hunting): my global_id is 4954 2026-02-17T21:28:49.979 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.965+0000 7f7b23fff640 1 -- 10.20.193.5:0/2679243544 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b1c003620 con 0x7f7b340c4d10 2026-02-17T21:28:49.979 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.965+0000 7f7b23fff640 1 -- 10.20.193.5:0/2679243544 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3316740598 0 0) 0x7f7b3415a9a0 con 0x7f7b340c48c0 2026-02-17T21:28:49.979 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.965+0000 7f7b23fff640 10 monclient(hunting): _negotiate 2026-02-17T21:28:49.979 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.965+0000 7f7b23fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:49.979 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.965+0000 7f7b23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:49.979 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.965+0000 7f7b23fff640 10 monclient(hunting): my global_id is 4920 2026-02-17T21:28:49.979 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.965+0000 7f7b23fff640 1 -- 10.20.193.5:0/2679243544 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b340c5270 con 0x7f7b340c48c0 2026-02-17T21:28:49.979 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.966+0000 7f7b396d6640 10 monclient(hunting): handle_auth_done global_id 4940 payload 274 2026-02-17T21:28:49.979 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.966+0000 7f7b396d6640 1 -- 10.20.193.5:0/2679243544 >> v1:10.20.193.119:6789/0 conn(0x7f7b340c4d10 legacy=0x7f7b340c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:49.979 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.966+0000 7f7b396d6640 1 -- 10.20.193.5:0/2679243544 >> v1:10.20.193.5:6789/0 conn(0x7f7b340c48c0 legacy=0x7f7b340749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:49.979 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.966+0000 7f7b396d6640 10 monclient: _finish_hunting 0 2026-02-17T21:28:49.979 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.966+0000 7f7b396d6640 1 monclient: found mon.noname-c 2026-02-17T21:28:49.980 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.966+0000 7f7b396d6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:49.980 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.966+0000 7f7b396d6640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:28:49.980 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.966+0000 7f7b396d6640 1 -- 10.20.193.5:0/2679243544 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b340c5550 con 0x7f7b340c7170 2026-02-17T21:28:49.980 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.967+0000 7f7b396d6640 1 --2- 10.20.193.5:0/2679243544 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7b340c7170 0x7f7b340c7550 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7b240098a0 tx=0x7f7b2402ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16064c7a16f4e182 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:49.980 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.969+0000 7f7b23fff640 1 -- 10.20.193.5:0/2679243544 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b2403c070 con 0x7f7b340c7170 2026-02-17T21:28:49.980 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.969+0000 7f7b23fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:49.980 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.969+0000 7f7b23fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:28:49.980 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.969+0000 7f7b23fff640 10 monclient: dump: 2026-02-17T21:28:49.980 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:49.980 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:49.981 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:49.981 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:49.981 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:49.981 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:49.981 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:49.981 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:49.981 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:49.981 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:49.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.969+0000 7f7b23fff640 10 monclient: _finish_auth 0 2026-02-17T21:28:49.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.969+0000 7f7b23fff640 10 monclient: _check_auth_tickets 2026-02-17T21:28:49.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.969+0000 7f7b23fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:49.982 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.969+0000 7f7b23fff640 1 -- 10.20.193.5:0/2679243544 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b2402fb70 con 0x7f7b340c7170 2026-02-17T21:28:49.982 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.969+0000 7f7b23fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:49.982 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.969+0000 7f7b3b961640 5 monclient: authenticate success, global_id 4940 2026-02-17T21:28:49.982 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.969+0000 7f7b23fff640 1 -- 10.20.193.5:0/2679243544 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b24037440 con 0x7f7b340c7170 2026-02-17T21:28:49.982 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.969+0000 7f7b23fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:49.982 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.969+0000 7f7b23fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:28:49.982 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.969+0000 7f7b23fff640 10 monclient: dump: 2026-02-17T21:28:49.982 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:49.982 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:49.982 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:49.983 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:49.983 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:49.983 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:49.983 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:49.983 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:49.983 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:49.983 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:49.983 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.969+0000 7f7b3b961640 10 monclient: get_monmap_and_config success 2026-02-17T21:28:49.983 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.969+0000 7f7b3b961640 4 set_mon_vals no callback set 2026-02-17T21:28:49.983 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.969+0000 7f7b3b961640 10 monclient: shutdown 2026-02-17T21:28:49.984 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.969+0000 7f7b3b961640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:49.984 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.969+0000 7f7b3b961640 1 -- 10.20.193.5:0/2679243544 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7b340c7170 msgr2=0x7f7b340c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:49.984 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.969+0000 7f7b3b961640 1 --2- 10.20.193.5:0/2679243544 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7b340c7170 0x7f7b340c7550 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7b240098a0 tx=0x7f7b2402ee60 comp rx=0 tx=0).stop 2026-02-17T21:28:49.984 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.969+0000 7f7b3b961640 1 -- 10.20.193.5:0/2679243544 shutdown_connections 2026-02-17T21:28:49.984 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.969+0000 7f7b3b961640 1 --2- 10.20.193.5:0/2679243544 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7b340c7170 0x7f7b340c7550 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:49.984 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.969+0000 7f7b3b961640 1 -- 10.20.193.5:0/2679243544 >> 10.20.193.5:0/2679243544 conn(0x7f7b340c9f40 msgr2=0x7f7b340ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:49.984 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.969+0000 7f7b3b961640 1 -- 10.20.193.5:0/2679243544 shutdown_connections 2026-02-17T21:28:49.984 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.969+0000 7f7b3b961640 1 -- 10.20.193.5:0/2679243544 wait complete. 2026-02-17T21:28:49.984 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.970+0000 7f7b3b961640 10 monclient: build_initial_monmap 2026-02-17T21:28:49.984 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.970+0000 7f7b3b961640 10 monclient: monmap: 2026-02-17T21:28:49.985 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:49.985 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:28:49.985 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:28:49.985 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:28:49.985 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:49.985 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:49.985 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:28:49.985 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:28:49.985 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:28:49.985 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:49.985 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.970+0000 7f7b3b961640 1 librados: starting msgr at 2026-02-17T21:28:49.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.970+0000 7f7b3b961640 1 librados: starting objecter 2026-02-17T21:28:49.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.970+0000 7f7b3b961640 1 Processor -- start 2026-02-17T21:28:49.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.970+0000 7f7b3b961640 1 -- start start 2026-02-17T21:28:49.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.970+0000 7f7b3b961640 1 librados: setting wanted keys 2026-02-17T21:28:49.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.970+0000 7f7b3b961640 1 librados: calling monclient init 2026-02-17T21:28:49.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.970+0000 7f7b3b961640 10 monclient: init 2026-02-17T21:28:49.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.970+0000 7f7b3b961640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:49.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.970+0000 7f7b3b961640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:28:49.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.970+0000 7f7b3b961640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7b340c48c0 0x7f7b340c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:49.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.970+0000 7f7b3b961640 10 monclient(hunting): picked mon.noname-a con 0x7f7b340c48c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:28:49.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.970+0000 7f7b3b961640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7b340c4d10 0x7f7b340c0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:49.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.970+0000 7f7b3b961640 10 monclient(hunting): picked mon.noname-c con 0x7f7b340c4d10 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:28:49.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.970+0000 7f7b3b961640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7b340c7170 0x7f7b341f3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:49.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.970+0000 7f7b3b961640 10 monclient(hunting): picked mon.noname-b con 0x7f7b340c7170 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:28:49.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.970+0000 7f7b3b961640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:49.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.970+0000 7f7b3b961640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7b340c81c0 con 0x7f7b340c48c0 2026-02-17T21:28:49.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.970+0000 7f7b3b961640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:49.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.970+0000 7f7b3b961640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7b340c7ee0 con 0x7f7b340c7170 2026-02-17T21:28:49.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.970+0000 7f7b3b961640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:49.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.970+0000 7f7b3b961640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7b340750c0 con 0x7f7b340c4d10 2026-02-17T21:28:49.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.970+0000 7f7b3b961640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:49.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.970+0000 7f7b3b961640 10 monclient(hunting): authenticate will time out at 1235.535804s 2026-02-17T21:28:49.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b39ed7640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7b340c7170 0x7f7b341f3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:49.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b38ed5640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7b340c4d10 0x7f7b340c0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:49.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b396d6640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7b340c48c0 0x7f7b340c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:49.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b39ed7640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7b340c7170 0x7f7b341f3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:57758/0 (socket says 10.20.193.5:57758) 2026-02-17T21:28:49.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b39ed7640 1 -- 10.20.193.5:0/2080917785 learned_addr learned my addr 10.20.193.5:0/2080917785 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:28:49.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b39ed7640 10 monclient(hunting): get_auth_request con 0x7f7b340c7170 auth_method 0 2026-02-17T21:28:49.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b39ed7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:49.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b39ed7640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:49.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b39ed7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:49.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b38ed5640 10 monclient(hunting): get_auth_request con 0x7f7b340c4d10 auth_method 0 2026-02-17T21:28:49.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b38ed5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:49.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b38ed5640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:49.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b38ed5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:49.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b396d6640 10 monclient(hunting): get_auth_request con 0x7f7b340c48c0 auth_method 0 2026-02-17T21:28:49.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b396d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:49.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b396d6640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:49.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b396d6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:49.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b39ed7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:49.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b39ed7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:49.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b39ed7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:49.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b38ed5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:49.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b38ed5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:49.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b38ed5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:49.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b396d6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:49.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b396d6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:49.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.971+0000 7f7b396d6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:49.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.972+0000 7f7b39ed7640 10 monclient(hunting): handle_auth_done global_id 4957 payload 824 2026-02-17T21:28:49.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.972+0000 7f7b39ed7640 1 -- 10.20.193.5:0/2080917785 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7b340c4d10 msgr2=0x7f7b340c0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:49.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.972+0000 7f7b39ed7640 1 --2- 10.20.193.5:0/2080917785 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7b340c4d10 0x7f7b340c0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:49.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.972+0000 7f7b39ed7640 1 -- 10.20.193.5:0/2080917785 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7b340c48c0 msgr2=0x7f7b340c2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:49.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.972+0000 7f7b39ed7640 1 --2- 10.20.193.5:0/2080917785 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7b340c48c0 0x7f7b340c2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:49.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.972+0000 7f7b39ed7640 10 monclient: _finish_hunting 0 2026-02-17T21:28:49.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.972+0000 7f7b39ed7640 1 monclient: found mon.noname-b 2026-02-17T21:28:49.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.972+0000 7f7b39ed7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:49.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.972+0000 7f7b39ed7640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:28:49.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.972+0000 7f7b39ed7640 1 -- 10.20.193.5:0/2080917785 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b340bf8c0 con 0x7f7b340c7170 2026-02-17T21:28:49.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.973+0000 7f7b39ed7640 1 --2- 10.20.193.5:0/2080917785 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7b340c7170 0x7f7b341f3820 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000caa0 tx=0x7f7b3000cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:49.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.973+0000 7f7b21ffb640 10 client.?.objecter ms_handle_connect 0x7f7b340c7170 2026-02-17T21:28:49.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.973+0000 7f7b21ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:28:49.994 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b21ffb640 1 -- 10.20.193.5:0/2080917785 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3000ac40 con 0x7f7b340c7170 2026-02-17T21:28:49.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b21ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:49.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b21ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:28:49.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b21ffb640 10 monclient: dump: 2026-02-17T21:28:49.995 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:49.995 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:49.995 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:49.995 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:49.995 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:49.995 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:49.996 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:49.996 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:49.996 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:49.996 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:49.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b21ffb640 10 monclient: _finish_auth 0 2026-02-17T21:28:49.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b21ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:28:49.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b21ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:49.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b3b961640 5 monclient: authenticate success, global_id 4957 2026-02-17T21:28:49.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b3b961640 10 monclient: _renew_subs 2026-02-17T21:28:49.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b3b961640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:49.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b3b961640 1 -- 10.20.193.5:0/2080917785 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b341f4050 con 0x7f7b340c7170 2026-02-17T21:28:49.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b3b961640 10 client.4957.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:28:49.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b3b961640 10 monclient: _renew_subs 2026-02-17T21:28:49.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b3b961640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:49.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b3b961640 1 -- 10.20.193.5:0/2080917785 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b341f4610 con 0x7f7b340c7170 2026-02-17T21:28:49.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b3b961640 1 librados: init done 2026-02-17T21:28:49.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b21ffb640 1 -- 10.20.193.5:0/2080917785 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b3000ade0 con 0x7f7b340c7170 2026-02-17T21:28:49.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b21ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:49.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b21ffb640 1 -- 10.20.193.5:0/2080917785 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3001b600 con 0x7f7b340c7170 2026-02-17T21:28:49.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b21ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:49.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b21ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:28:49.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b21ffb640 10 monclient: dump: 2026-02-17T21:28:49.998 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:49.998 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:49.998 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:49.998 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:49.998 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:49.998 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:49.998 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:49.998 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:49.998 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:49.998 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:49.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b237fe640 4 set_mon_vals no callback set 2026-02-17T21:28:49.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b3b961640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:49.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b3b961640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:49.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b3b961640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:49.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.975+0000 7f7b3b961640 1 -- 10.20.193.5:0/2080917785 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b340c7550 con 0x7f7b340c7170 2026-02-17T21:28:49.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.987+0000 7f7b21ffb640 1 -- 10.20.193.5:0/2080917785 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f7b3001b7a0 con 0x7f7b340c7170 2026-02-17T21:28:49.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.987+0000 7f7b21ffb640 1 --2- 10.20.193.5:0/2080917785 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7b04079280 0x7f7b0407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:49.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.988+0000 7f7b396d6640 1 --2- 10.20.193.5:0/2080917785 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7b04079280 0x7f7b0407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:49.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.988+0000 7f7b396d6640 10 monclient: get_auth_request con 0x7f7b04079280 auth_method 0 2026-02-17T21:28:49.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.988+0000 7f7b396d6640 1 --2- 10.20.193.5:0/2080917785 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7b04079280 0x7f7b0407b740 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7b24039000 tx=0x7f7b24033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:49.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.988+0000 7f7b21ffb640 10 client.4957.objecter ms_handle_connect 0x7f7b04079280 2026-02-17T21:28:49.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.989+0000 7f7b21ffb640 1 -- 10.20.193.5:0/2080917785 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f7b3005ec00 con 0x7f7b340c7170 2026-02-17T21:28:49.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.989+0000 7f7b21ffb640 10 client.4957.objecter ms_dispatch2 0x7f7b34000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:28:50.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.989+0000 7f7b21ffb640 3 client.4957.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:28:50.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.989+0000 7f7b21ffb640 3 client.4957.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:28:50.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:49.989+0000 7f7b21ffb640 20 client.4957.objecter dump_active .. 0 homeless 2026-02-17T21:28:50.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.089+0000 7f7b21ffb640 1 -- 10.20.193.5:0/2080917785 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7b30062bc0 con 0x7f7b340c7170 2026-02-17T21:28:50.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.089+0000 7f7b21ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:50.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.089+0000 7f7b21ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:28:50.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.190+0000 7f7b3b961640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:28:50.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.190+0000 7f7b3b961640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:50.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.190+0000 7f7b3b961640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:50.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.190+0000 7f7b3b961640 1 -- 10.20.193.5:0/2080917785 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7b340737b0 con 0x7f7b340c7170 2026-02-17T21:28:50.194 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.192+0000 7f7b21ffb640 1 -- 10.20.193.5:0/2080917785 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f7b30066ec0 con 0x7f7b340c7170 2026-02-17T21:28:50.194 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.192+0000 7f7b21ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:50.194 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.192+0000 7f7b21ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:28:50.194 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:28:50.194 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:28:50.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.194+0000 7f7b3b961640 10 librados: watch_flush enter 2026-02-17T21:28:50.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.194+0000 7f7b3b961640 10 librados: watch_flush exit 2026-02-17T21:28:50.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.194+0000 7f7b3b961640 20 client.4957.objecter shutdown clearing up homeless session... 2026-02-17T21:28:50.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.194+0000 7f7b3b961640 10 client.4957.objecter successfully canceled tick 2026-02-17T21:28:50.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.194+0000 7f7b3b961640 1 -- 10.20.193.5:0/2080917785 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7b04079280 msgr2=0x7f7b0407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:50.196 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.194+0000 7f7b3b961640 1 --2- 10.20.193.5:0/2080917785 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7b04079280 0x7f7b0407b740 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7b24039000 tx=0x7f7b24033000 comp rx=0 tx=0).stop 2026-02-17T21:28:50.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.194+0000 7f7b3b961640 10 monclient: shutdown 2026-02-17T21:28:50.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.194+0000 7f7b3b961640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:50.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.194+0000 7f7b3b961640 1 -- 10.20.193.5:0/2080917785 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7b340c7170 msgr2=0x7f7b341f3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:50.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.194+0000 7f7b3b961640 1 --2- 10.20.193.5:0/2080917785 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7b340c7170 0x7f7b341f3820 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000caa0 tx=0x7f7b3000cf70 comp rx=0 tx=0).stop 2026-02-17T21:28:50.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.194+0000 7f7b3b961640 1 -- 10.20.193.5:0/2080917785 shutdown_connections 2026-02-17T21:28:50.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.194+0000 7f7b3b961640 1 --2- 10.20.193.5:0/2080917785 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7b04079280 0x7f7b0407b740 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:50.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.194+0000 7f7b3b961640 1 --2- 10.20.193.5:0/2080917785 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7b340c7170 0x7f7b341f3820 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:50.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.194+0000 7f7b3b961640 1 --2- 10.20.193.5:0/2080917785 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7b340c4d10 0x7f7b340c0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:50.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.194+0000 7f7b3b961640 1 --2- 10.20.193.5:0/2080917785 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7b340c48c0 0x7f7b340c2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:50.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.194+0000 7f7b3b961640 1 -- 10.20.193.5:0/2080917785 >> 10.20.193.5:0/2080917785 conn(0x7f7b340c9f40 msgr2=0x7f7b340ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:50.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.194+0000 7f7b3b961640 1 -- 10.20.193.5:0/2080917785 shutdown_connections 2026-02-17T21:28:50.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.194+0000 7f7b3b961640 1 -- 10.20.193.5:0/2080917785 wait complete. 2026-02-17T21:28:50.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:50.194+0000 7f7b3b961640 1 librados: shutdown 2026-02-17T21:28:53.205 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:28:53.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.271+0000 7f268192c640 10 monclient: get_monmap_and_config 2026-02-17T21:28:53.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.271+0000 7f268192c640 10 monclient: build_initial_monmap 2026-02-17T21:28:53.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.271+0000 7f268192c640 10 monclient: monmap: 2026-02-17T21:28:53.273 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:53.274 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:53.274 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:28:53.272141+0000 2026-02-17T21:28:53.274 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:28:53.272141+0000 2026-02-17T21:28:53.274 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:53.274 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:53.274 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:28:53.274 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:28:53.274 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:28:53.274 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:28:53.274 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:28:53.275 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:28:53.275 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:53.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.271+0000 7f268192c640 1 Processor -- start 2026-02-17T21:28:53.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.271+0000 7f268192c640 1 -- start start 2026-02-17T21:28:53.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.271+0000 7f268192c640 10 monclient: init 2026-02-17T21:28:53.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.272+0000 7f268192c640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:53.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.272+0000 7f268192c640 10 monclient: _add_conns ranks=[2,4,1,0,3,5] 2026-02-17T21:28:53.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.272+0000 7f268192c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f267c15f570 addr v1:10.20.193.135:6789/0 2026-02-17T21:28:53.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.272+0000 7f268192c640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f267c15f950 0x7f267c0be810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:53.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.272+0000 7f268192c640 10 monclient(hunting): picked mon.noname-b con 0x7f267c15f950 addr v2:10.20.193.119:3300/0 2026-02-17T21:28:53.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.272+0000 7f268192c640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f267c155770 addr v1:10.20.193.119:6789/0 2026-02-17T21:28:53.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.272+0000 7f268192c640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f267c0bee70 con 0x7f267c155770 2026-02-17T21:28:53.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.272+0000 7f268192c640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f267c0bf150 con 0x7f267c15f570 2026-02-17T21:28:53.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.272+0000 7f268192c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:53.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.272+0000 7f268192c640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f267c0bfd60 con 0x7f267c15f950 2026-02-17T21:28:53.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.272+0000 7f268192c640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:53.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.272+0000 7f268192c640 10 monclient(hunting): authenticate will time out at 1238.837444s 2026-02-17T21:28:53.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.272+0000 7f267affd640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f267c15f570 0x7f267c15d200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:43328/0 (socket says 10.20.193.5:43328) 2026-02-17T21:28:53.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.272+0000 7f267affd640 1 -- 10.20.193.5:0/355265830 learned_addr learned my addr 10.20.193.5:0/355265830 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:28:53.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.272+0000 7f267a7fc640 1 --2- 10.20.193.5:0/355265830 >> v2:10.20.193.119:3300/0 conn(0x7f267c15f950 0x7f267c0be810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:53.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.273+0000 7f267a7fc640 10 monclient(hunting): get_auth_request con 0x7f267c15f950 auth_method 0 2026-02-17T21:28:53.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.273+0000 7f267a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:53.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.273+0000 7f267a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:53.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.273+0000 7f267a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:53.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.273+0000 7f267a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:53.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.273+0000 7f267a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:53.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.273+0000 7f267a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:53.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.274+0000 7f2679ffb640 1 -- 10.20.193.5:0/355265830 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1722646512 0 0) 0x7f267c0bf150 con 0x7f267c15f570 2026-02-17T21:28:53.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.274+0000 7f2679ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:28:53.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.274+0000 7f2679ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:53.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.274+0000 7f2679ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:53.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.274+0000 7f2679ffb640 10 monclient(hunting): my global_id is 4946 2026-02-17T21:28:53.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.274+0000 7f2679ffb640 1 -- 10.20.193.5:0/355265830 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2668003620 con 0x7f267c15f570 2026-02-17T21:28:53.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.274+0000 7f267a7fc640 10 monclient(hunting): handle_auth_done global_id 4960 payload 274 2026-02-17T21:28:53.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.274+0000 7f267a7fc640 1 -- 10.20.193.5:0/355265830 >> v1:10.20.193.135:6789/0 conn(0x7f267c15f570 legacy=0x7f267c15d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:53.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.274+0000 7f267a7fc640 1 -- 10.20.193.5:0/355265830 >> v1:10.20.193.119:6789/0 conn(0x7f267c155770 legacy=0x7f267c155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:53.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.274+0000 7f267a7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:28:53.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.274+0000 7f267a7fc640 1 monclient: found mon.noname-b 2026-02-17T21:28:53.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.274+0000 7f267a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:53.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.274+0000 7f267a7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:28:53.280 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.274+0000 7f267a7fc640 1 -- 10.20.193.5:0/355265830 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267c0bf430 con 0x7f267c15f950 2026-02-17T21:28:53.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.276+0000 7f267a7fc640 1 --2- 10.20.193.5:0/355265830 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f267c15f950 0x7f267c0be810 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f26640098a0 tx=0x7f266402ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=911af7fb3eb3c196 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:53.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f2679ffb640 1 -- 10.20.193.5:0/355265830 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266403c070 con 0x7f267c15f950 2026-02-17T21:28:53.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f2679ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:53.285 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f2679ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:28:53.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f2679ffb640 10 monclient: dump: 2026-02-17T21:28:53.286 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:53.286 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:53.286 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:53.286 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:53.286 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:53.286 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:53.286 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:53.286 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:53.286 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:53.286 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:53.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f2679ffb640 10 monclient: _finish_auth 0 2026-02-17T21:28:53.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f2679ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:28:53.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f2679ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:53.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f2679ffb640 1 -- 10.20.193.5:0/355265830 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266402fb70 con 0x7f267c15f950 2026-02-17T21:28:53.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f2679ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:53.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f268192c640 5 monclient: authenticate success, global_id 4960 2026-02-17T21:28:53.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f2679ffb640 1 -- 10.20.193.5:0/355265830 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2664037440 con 0x7f267c15f950 2026-02-17T21:28:53.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f268192c640 10 monclient: get_monmap_and_config success 2026-02-17T21:28:53.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f268192c640 4 set_mon_vals no callback set 2026-02-17T21:28:53.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f2679ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:53.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f2679ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:28:53.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f2679ffb640 10 monclient: dump: 2026-02-17T21:28:53.288 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:53.288 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:53.288 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:53.288 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:53.288 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:53.288 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:53.288 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:53.288 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:53.288 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:53.288 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:53.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f268192c640 10 monclient: shutdown 2026-02-17T21:28:53.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f268192c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:53.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f268192c640 1 -- 10.20.193.5:0/355265830 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f267c15f950 msgr2=0x7f267c0be810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:53.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f268192c640 1 --2- 10.20.193.5:0/355265830 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f267c15f950 0x7f267c0be810 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f26640098a0 tx=0x7f266402ee60 comp rx=0 tx=0).stop 2026-02-17T21:28:53.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f268192c640 1 -- 10.20.193.5:0/355265830 shutdown_connections 2026-02-17T21:28:53.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f268192c640 1 --2- 10.20.193.5:0/355265830 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f267c15f950 0x7f267c0be810 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:53.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f268192c640 1 -- 10.20.193.5:0/355265830 >> 10.20.193.5:0/355265830 conn(0x7f267c0c9f40 msgr2=0x7f267c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:53.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f268192c640 1 -- 10.20.193.5:0/355265830 shutdown_connections 2026-02-17T21:28:53.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f268192c640 1 -- 10.20.193.5:0/355265830 wait complete. 2026-02-17T21:28:53.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f268192c640 10 monclient: build_initial_monmap 2026-02-17T21:28:53.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.279+0000 7f268192c640 10 monclient: monmap: 2026-02-17T21:28:53.289 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:53.289 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:28:53.289 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:28:53.289 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:28:53.290 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:53.290 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:53.290 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:28:53.290 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:28:53.290 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:28:53.290 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:53.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.280+0000 7f268192c640 1 librados: starting msgr at 2026-02-17T21:28:53.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.280+0000 7f268192c640 1 librados: starting objecter 2026-02-17T21:28:53.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.280+0000 7f268192c640 1 Processor -- start 2026-02-17T21:28:53.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.280+0000 7f268192c640 1 -- start start 2026-02-17T21:28:53.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.280+0000 7f268192c640 1 librados: setting wanted keys 2026-02-17T21:28:53.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.280+0000 7f268192c640 1 librados: calling monclient init 2026-02-17T21:28:53.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.280+0000 7f268192c640 10 monclient: init 2026-02-17T21:28:53.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.280+0000 7f268192c640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:53.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.280+0000 7f268192c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:28:53.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.280+0000 7f268192c640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f267c155770 0x7f267c06b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:53.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.280+0000 7f268192c640 10 monclient(hunting): picked mon.noname-a con 0x7f267c155770 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:28:53.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.280+0000 7f268192c640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f267c15f570 0x7f267c15b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:53.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.280+0000 7f268192c640 10 monclient(hunting): picked mon.noname-b con 0x7f267c15f570 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:28:53.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.280+0000 7f268192c640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f267c15f950 0x7f267c15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:53.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.280+0000 7f268192c640 10 monclient(hunting): picked mon.noname-c con 0x7f267c15f950 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:28:53.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.280+0000 7f268192c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:53.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.280+0000 7f268192c640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f267c15d910 con 0x7f267c155770 2026-02-17T21:28:53.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.280+0000 7f268192c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:53.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.280+0000 7f268192c640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f267c0bf9f0 con 0x7f267c15f570 2026-02-17T21:28:53.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.280+0000 7f268192c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:53.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.280+0000 7f268192c640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f267c0c01f0 con 0x7f267c15f950 2026-02-17T21:28:53.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.280+0000 7f268192c640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:53.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.280+0000 7f268192c640 10 monclient(hunting): authenticate will time out at 1238.845740s 2026-02-17T21:28:53.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267a7fc640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f267c15f570 0x7f267c15b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:53.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267b7fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f267c15f950 0x7f267c15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:53.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267affd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f267c155770 0x7f267c06b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:53.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267a7fc640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f267c15f570 0x7f267c15b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:57780/0 (socket says 10.20.193.5:57780) 2026-02-17T21:28:53.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267a7fc640 1 -- 10.20.193.5:0/255908568 learned_addr learned my addr 10.20.193.5:0/255908568 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:28:53.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267a7fc640 10 monclient(hunting): get_auth_request con 0x7f267c15f570 auth_method 0 2026-02-17T21:28:53.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:53.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:53.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:53.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267affd640 10 monclient(hunting): get_auth_request con 0x7f267c155770 auth_method 0 2026-02-17T21:28:53.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:53.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:53.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:53.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267b7fe640 10 monclient(hunting): get_auth_request con 0x7f267c15f950 auth_method 0 2026-02-17T21:28:53.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:53.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:53.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:53.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:53.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:53.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:53.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:53.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:53.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:53.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:53.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:53.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.281+0000 7f267affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:53.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.282+0000 7f267a7fc640 10 monclient(hunting): handle_auth_done global_id 4966 payload 824 2026-02-17T21:28:53.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.282+0000 7f267a7fc640 1 -- 10.20.193.5:0/255908568 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f267c15f950 msgr2=0x7f267c15baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:53.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.282+0000 7f267a7fc640 1 --2- 10.20.193.5:0/255908568 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f267c15f950 0x7f267c15baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:53.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.282+0000 7f267a7fc640 1 -- 10.20.193.5:0/255908568 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f267c155770 msgr2=0x7f267c06b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:53.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.282+0000 7f267a7fc640 1 --2- 10.20.193.5:0/255908568 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f267c155770 0x7f267c06b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:53.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.282+0000 7f267a7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:28:53.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.282+0000 7f267a7fc640 1 monclient: found mon.noname-b 2026-02-17T21:28:53.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.282+0000 7f267a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:53.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.282+0000 7f267a7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:28:53.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.282+0000 7f267a7fc640 1 -- 10.20.193.5:0/255908568 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267c06ec60 con 0x7f267c15f570 2026-02-17T21:28:53.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.283+0000 7f267a7fc640 1 --2- 10.20.193.5:0/255908568 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f267c15f570 0x7f267c15b560 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2664009130 tx=0x7f26640047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:53.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.283+0000 7f2653fff640 10 client.?.objecter ms_handle_connect 0x7f267c15f570 2026-02-17T21:28:53.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.283+0000 7f2653fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:28:53.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.284+0000 7f2653fff640 1 -- 10.20.193.5:0/255908568 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266403c040 con 0x7f267c15f570 2026-02-17T21:28:53.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.284+0000 7f2653fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:53.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.284+0000 7f2653fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:28:53.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.284+0000 7f2653fff640 10 monclient: dump: 2026-02-17T21:28:53.297 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:53.297 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:53.297 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:53.297 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:53.298 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:53.298 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:53.298 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:53.298 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:53.298 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:53.298 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:53.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.284+0000 7f2653fff640 10 monclient: _finish_auth 0 2026-02-17T21:28:53.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.284+0000 7f2653fff640 10 monclient: _check_auth_tickets 2026-02-17T21:28:53.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.284+0000 7f2653fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:53.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.284+0000 7f268192c640 5 monclient: authenticate success, global_id 4966 2026-02-17T21:28:53.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.284+0000 7f268192c640 10 monclient: _renew_subs 2026-02-17T21:28:53.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.284+0000 7f268192c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:53.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.284+0000 7f268192c640 1 -- 10.20.193.5:0/255908568 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f267c06ef40 con 0x7f267c15f570 2026-02-17T21:28:53.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.284+0000 7f268192c640 10 client.4966.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:28:53.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.284+0000 7f268192c640 10 monclient: _renew_subs 2026-02-17T21:28:53.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.284+0000 7f268192c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:53.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.284+0000 7f268192c640 1 -- 10.20.193.5:0/255908568 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f267c06f500 con 0x7f267c15f570 2026-02-17T21:28:53.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.284+0000 7f268192c640 1 librados: init done 2026-02-17T21:28:53.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.285+0000 7f268192c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:53.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.285+0000 7f268192c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:53.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.285+0000 7f268192c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:53.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.285+0000 7f268192c640 1 -- 10.20.193.5:0/255908568 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f267c154820 con 0x7f267c15f570 2026-02-17T21:28:53.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.285+0000 7f2653fff640 1 -- 10.20.193.5:0/255908568 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266402fab0 con 0x7f267c15f570 2026-02-17T21:28:53.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.285+0000 7f2653fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:53.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.285+0000 7f2653fff640 1 -- 10.20.193.5:0/255908568 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2664042830 con 0x7f267c15f570 2026-02-17T21:28:53.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.285+0000 7f2653fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:53.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.285+0000 7f2653fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:28:53.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.285+0000 7f26797fa640 4 set_mon_vals no callback set 2026-02-17T21:28:53.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.285+0000 7f2653fff640 10 monclient: dump: 2026-02-17T21:28:53.300 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:53.300 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:53.300 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:53.300 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:53.300 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:53.300 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:53.300 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:53.301 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:53.301 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:53.301 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:53.393 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.391+0000 7f2653fff640 1 -- 10.20.193.5:0/255908568 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f266404b450 con 0x7f267c15f570 2026-02-17T21:28:53.394 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.392+0000 7f2653fff640 1 --2- 10.20.193.5:0/255908568 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f264c079280 0x7f264c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:53.394 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.392+0000 7f267affd640 1 --2- 10.20.193.5:0/255908568 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f264c079280 0x7f264c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:53.394 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.392+0000 7f267affd640 10 monclient: get_auth_request con 0x7f264c079280 auth_method 0 2026-02-17T21:28:53.394 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.392+0000 7f267affd640 1 --2- 10.20.193.5:0/255908568 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f264c079280 0x7f264c07b740 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2670005980 tx=0x7f2670007dd0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:53.394 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.392+0000 7f2653fff640 10 client.4966.objecter ms_handle_connect 0x7f264c079280 2026-02-17T21:28:53.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.393+0000 7f2653fff640 1 -- 10.20.193.5:0/255908568 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f26640bc640 con 0x7f267c15f570 2026-02-17T21:28:53.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.393+0000 7f2653fff640 10 client.4966.objecter ms_dispatch2 0x7f267c000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:28:53.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.393+0000 7f2653fff640 3 client.4966.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:28:53.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.393+0000 7f2653fff640 3 client.4966.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:28:53.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.393+0000 7f2653fff640 20 client.4966.objecter dump_active .. 0 homeless 2026-02-17T21:28:53.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.400+0000 7f2653fff640 1 -- 10.20.193.5:0/255908568 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f267c154820 con 0x7f267c15f570 2026-02-17T21:28:53.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.400+0000 7f2653fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:53.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.400+0000 7f2653fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:28:53.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.503+0000 7f268192c640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:28:53.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.503+0000 7f268192c640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:53.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.503+0000 7f268192c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:53.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.503+0000 7f268192c640 1 -- 10.20.193.5:0/255908568 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f267c0be810 con 0x7f267c15f570 2026-02-17T21:28:53.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.505+0000 7f2653fff640 1 -- 10.20.193.5:0/255908568 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f2664086ce0 con 0x7f267c15f570 2026-02-17T21:28:53.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.505+0000 7f2653fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:53.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.505+0000 7f2653fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:28:53.507 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:28:53.507 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:28:53.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.507+0000 7f268192c640 10 librados: watch_flush enter 2026-02-17T21:28:53.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.507+0000 7f268192c640 10 librados: watch_flush exit 2026-02-17T21:28:53.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.507+0000 7f268192c640 20 client.4966.objecter shutdown clearing up homeless session... 2026-02-17T21:28:53.509 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.507+0000 7f268192c640 10 client.4966.objecter successfully canceled tick 2026-02-17T21:28:53.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.507+0000 7f268192c640 1 -- 10.20.193.5:0/255908568 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f264c079280 msgr2=0x7f264c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:53.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.507+0000 7f268192c640 1 --2- 10.20.193.5:0/255908568 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f264c079280 0x7f264c07b740 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2670005980 tx=0x7f2670007dd0 comp rx=0 tx=0).stop 2026-02-17T21:28:53.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.507+0000 7f268192c640 10 monclient: shutdown 2026-02-17T21:28:53.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.507+0000 7f268192c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:53.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.507+0000 7f268192c640 1 -- 10.20.193.5:0/255908568 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f267c15f570 msgr2=0x7f267c15b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:53.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.507+0000 7f268192c640 1 --2- 10.20.193.5:0/255908568 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f267c15f570 0x7f267c15b560 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2664009130 tx=0x7f26640047c0 comp rx=0 tx=0).stop 2026-02-17T21:28:53.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.507+0000 7f268192c640 1 -- 10.20.193.5:0/255908568 shutdown_connections 2026-02-17T21:28:53.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.507+0000 7f268192c640 1 --2- 10.20.193.5:0/255908568 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f264c079280 0x7f264c07b740 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:53.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.507+0000 7f268192c640 1 --2- 10.20.193.5:0/255908568 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f267c15f950 0x7f267c15baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:53.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.507+0000 7f268192c640 1 --2- 10.20.193.5:0/255908568 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f267c15f570 0x7f267c15b560 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:53.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.507+0000 7f268192c640 1 --2- 10.20.193.5:0/255908568 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f267c155770 0x7f267c06b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:53.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.507+0000 7f268192c640 1 -- 10.20.193.5:0/255908568 >> 10.20.193.5:0/255908568 conn(0x7f267c0c9f40 msgr2=0x7f267c153200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:53.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.507+0000 7f268192c640 1 -- 10.20.193.5:0/255908568 shutdown_connections 2026-02-17T21:28:53.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.507+0000 7f268192c640 1 -- 10.20.193.5:0/255908568 wait complete. 2026-02-17T21:28:53.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:53.507+0000 7f268192c640 1 librados: shutdown 2026-02-17T21:28:56.519 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:28:56.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.586+0000 7f3a3db40640 10 monclient: get_monmap_and_config 2026-02-17T21:28:56.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.586+0000 7f3a3db40640 10 monclient: build_initial_monmap 2026-02-17T21:28:56.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.586+0000 7f3a3db40640 10 monclient: monmap: 2026-02-17T21:28:56.589 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:56.589 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:56.589 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:28:56.587549+0000 2026-02-17T21:28:56.589 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:28:56.587549+0000 2026-02-17T21:28:56.589 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:56.589 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:56.589 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:28:56.589 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:28:56.590 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:28:56.590 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:28:56.590 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:28:56.590 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:28:56.590 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:56.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.587+0000 7f3a3db40640 1 Processor -- start 2026-02-17T21:28:56.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.587+0000 7f3a3db40640 1 -- start start 2026-02-17T21:28:56.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.587+0000 7f3a3db40640 10 monclient: init 2026-02-17T21:28:56.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.587+0000 7f3a3db40640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:56.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.587+0000 7f3a3db40640 10 monclient: _add_conns ranks=[2,5,4,0,1,3] 2026-02-17T21:28:56.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.587+0000 7f3a3db40640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3a380c7170 addr v1:10.20.193.135:6789/0 2026-02-17T21:28:56.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.587+0000 7f3a3db40640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f3a380c7550 0x7f3a380749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:56.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.587+0000 7f3a3db40640 10 monclient(hunting): picked mon.noname-c con 0x7f3a380c7550 addr v2:10.20.193.135:3300/0 2026-02-17T21:28:56.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.587+0000 7f3a3db40640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f3a38074ef0 0x7f3a380c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:56.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.587+0000 7f3a3db40640 10 monclient(hunting): picked mon.noname-b con 0x7f3a38074ef0 addr v2:10.20.193.119:3300/0 2026-02-17T21:28:56.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.587+0000 7f3a3db40640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a380c4fd0 con 0x7f3a380c7170 2026-02-17T21:28:56.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.587+0000 7f3a3db40640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:56.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.587+0000 7f3a3db40640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f3a380c8530 con 0x7f3a38074ef0 2026-02-17T21:28:56.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.587+0000 7f3a3db40640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:56.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.587+0000 7f3a3db40640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f3a3815a9a0 con 0x7f3a380c7550 2026-02-17T21:28:56.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.587+0000 7f3a3db40640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:56.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.587+0000 7f3a3db40640 10 monclient(hunting): authenticate will time out at 1242.152952s 2026-02-17T21:28:56.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.588+0000 7f3a37fff640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f3a38074ef0 0x7f3a380c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:56.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.588+0000 7f3a36ffd640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f3a380c7550 0x7f3a380749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:56.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.588+0000 7f3a37fff640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f3a38074ef0 0x7f3a380c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:57796/0 (socket says 10.20.193.5:57796) 2026-02-17T21:28:56.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.588+0000 7f3a37fff640 1 -- 10.20.193.5:0/3465337828 learned_addr learned my addr 10.20.193.5:0/3465337828 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:28:56.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.588+0000 7f3a37fff640 10 monclient(hunting): get_auth_request con 0x7f3a38074ef0 auth_method 0 2026-02-17T21:28:56.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.588+0000 7f3a37fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:56.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.588+0000 7f3a37fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:56.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.588+0000 7f3a37fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:56.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.588+0000 7f3a36ffd640 10 monclient(hunting): get_auth_request con 0x7f3a380c7550 auth_method 0 2026-02-17T21:28:56.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.588+0000 7f3a36ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:56.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.588+0000 7f3a36ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:56.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.588+0000 7f3a36ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:56.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.588+0000 7f3a37fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:56.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.588+0000 7f3a37fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:56.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.588+0000 7f3a37fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:56.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.589+0000 7f3a36ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:56.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.589+0000 7f3a36ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:56.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.589+0000 7f3a36ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:56.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.589+0000 7f3a37fff640 10 monclient(hunting): handle_auth_done global_id 4969 payload 274 2026-02-17T21:28:56.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.589+0000 7f3a37fff640 1 -- 10.20.193.5:0/3465337828 >> v2:10.20.193.135:3300/0 conn(0x7f3a380c7550 msgr2=0x7f3a380749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:28:56.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.589+0000 7f3a37fff640 1 --2- 10.20.193.5:0/3465337828 >> v2:10.20.193.135:3300/0 conn(0x7f3a380c7550 0x7f3a380749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:56.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.589+0000 7f3a37fff640 1 -- 10.20.193.5:0/3465337828 >> v1:10.20.193.135:6789/0 conn(0x7f3a380c7170 legacy=0x7f3a380c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:56.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.589+0000 7f3a37fff640 10 monclient: _finish_hunting 0 2026-02-17T21:28:56.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.589+0000 7f3a37fff640 1 monclient: found mon.noname-b 2026-02-17T21:28:56.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.589+0000 7f3a37fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:56.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.589+0000 7f3a37fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:28:56.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.589+0000 7f3a37fff640 1 -- 10.20.193.5:0/3465337828 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a380c5270 con 0x7f3a38074ef0 2026-02-17T21:28:56.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.590+0000 7f3a37fff640 1 --2- 10.20.193.5:0/3465337828 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3a38074ef0 0x7f3a380c89c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3a380c6e90 tx=0x7f3a2c02f270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e2cffa4dfd50df4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:56.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.592+0000 7f3a367fc640 1 -- 10.20.193.5:0/3465337828 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c02fd70 con 0x7f3a38074ef0 2026-02-17T21:28:56.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.592+0000 7f3a367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:56.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.592+0000 7f3a367fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:28:56.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.592+0000 7f3a367fc640 10 monclient: dump: 2026-02-17T21:28:56.603 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:56.603 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:56.603 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:56.603 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:56.603 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:56.603 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:56.603 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:56.603 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:56.603 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:56.603 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:56.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.592+0000 7f3a367fc640 10 monclient: _finish_auth 0 2026-02-17T21:28:56.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.592+0000 7f3a367fc640 10 monclient: _check_auth_tickets 2026-02-17T21:28:56.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.592+0000 7f3a367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:56.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.592+0000 7f3a367fc640 1 -- 10.20.193.5:0/3465337828 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a2c0373f0 con 0x7f3a38074ef0 2026-02-17T21:28:56.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.592+0000 7f3a3db40640 5 monclient: authenticate success, global_id 4969 2026-02-17T21:28:56.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.592+0000 7f3a367fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:56.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.592+0000 7f3a367fc640 1 -- 10.20.193.5:0/3465337828 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c0377c0 con 0x7f3a38074ef0 2026-02-17T21:28:56.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.592+0000 7f3a367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:56.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.592+0000 7f3a367fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:28:56.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.592+0000 7f3a367fc640 10 monclient: dump: 2026-02-17T21:28:56.604 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:56.604 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:56.605 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:56.605 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:56.605 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:56.605 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:56.605 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:56.605 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:56.605 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:56.605 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:56.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.592+0000 7f3a3db40640 10 monclient: get_monmap_and_config success 2026-02-17T21:28:56.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.592+0000 7f3a3db40640 4 set_mon_vals no callback set 2026-02-17T21:28:56.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.593+0000 7f3a3db40640 10 monclient: shutdown 2026-02-17T21:28:56.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.593+0000 7f3a3db40640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:56.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.593+0000 7f3a3db40640 1 -- 10.20.193.5:0/3465337828 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3a38074ef0 msgr2=0x7f3a380c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:56.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.593+0000 7f3a3db40640 1 --2- 10.20.193.5:0/3465337828 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3a38074ef0 0x7f3a380c89c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3a380c6e90 tx=0x7f3a2c02f270 comp rx=0 tx=0).stop 2026-02-17T21:28:56.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.593+0000 7f3a3db40640 1 -- 10.20.193.5:0/3465337828 shutdown_connections 2026-02-17T21:28:56.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.593+0000 7f3a3db40640 1 --2- 10.20.193.5:0/3465337828 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3a38074ef0 0x7f3a380c89c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:56.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.593+0000 7f3a3db40640 1 --2- 10.20.193.5:0/3465337828 >> v2:10.20.193.135:3300/0 conn(0x7f3a380c7550 0x7f3a380749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:56.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.593+0000 7f3a3db40640 1 -- 10.20.193.5:0/3465337828 >> 10.20.193.5:0/3465337828 conn(0x7f3a380c9f40 msgr2=0x7f3a380ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:56.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.593+0000 7f3a3db40640 1 -- 10.20.193.5:0/3465337828 shutdown_connections 2026-02-17T21:28:56.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.593+0000 7f3a3db40640 1 -- 10.20.193.5:0/3465337828 wait complete. 2026-02-17T21:28:56.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.593+0000 7f3a3db40640 10 monclient: build_initial_monmap 2026-02-17T21:28:56.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.593+0000 7f3a3db40640 10 monclient: monmap: 2026-02-17T21:28:56.606 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:56.606 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:28:56.607 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:28:56.607 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:28:56.607 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:56.607 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:56.607 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:28:56.607 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:28:56.607 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:28:56.607 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:56.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.593+0000 7f3a3db40640 1 librados: starting msgr at 2026-02-17T21:28:56.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.593+0000 7f3a3db40640 1 librados: starting objecter 2026-02-17T21:28:56.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a3db40640 1 Processor -- start 2026-02-17T21:28:56.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a3db40640 1 -- start start 2026-02-17T21:28:56.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a3db40640 1 librados: setting wanted keys 2026-02-17T21:28:56.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a3db40640 1 librados: calling monclient init 2026-02-17T21:28:56.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a3db40640 10 monclient: init 2026-02-17T21:28:56.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a3db40640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:56.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a3db40640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:28:56.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a3db40640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3a38074ef0 0x7f3a38159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:56.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a3db40640 10 monclient(hunting): picked mon.noname-b con 0x7f3a38074ef0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:28:56.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a3db40640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3a380c7170 0x7f3a381f1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:56.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a3db40640 10 monclient(hunting): picked mon.noname-a con 0x7f3a380c7170 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:28:56.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a3db40640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3a380c7550 0x7f3a381f1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:56.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a3db40640 10 monclient(hunting): picked mon.noname-c con 0x7f3a380c7550 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:28:56.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a3db40640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:56.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a3db40640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3a380c7ee0 con 0x7f3a380c7170 2026-02-17T21:28:56.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a3db40640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:56.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a3db40640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3a380c5830 con 0x7f3a38074ef0 2026-02-17T21:28:56.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a3db40640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:56.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a3db40640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3a380c81c0 con 0x7f3a380c7550 2026-02-17T21:28:56.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a3db40640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:56.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a3db40640 10 monclient(hunting): authenticate will time out at 1242.159519s 2026-02-17T21:28:56.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a377fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3a38074ef0 0x7f3a38159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:56.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a37fff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3a380c7550 0x7f3a381f1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:56.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a377fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3a38074ef0 0x7f3a38159e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:57812/0 (socket says 10.20.193.5:57812) 2026-02-17T21:28:56.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a377fe640 1 -- 10.20.193.5:0/2138322609 learned_addr learned my addr 10.20.193.5:0/2138322609 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:28:56.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a377fe640 10 monclient(hunting): get_auth_request con 0x7f3a38074ef0 auth_method 0 2026-02-17T21:28:56.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:56.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a377fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:56.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:56.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.594+0000 7f3a36ffd640 1 --2- 10.20.193.5:0/2138322609 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3a380c7170 0x7f3a381f1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:56.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.595+0000 7f3a37fff640 10 monclient(hunting): get_auth_request con 0x7f3a380c7550 auth_method 0 2026-02-17T21:28:56.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.595+0000 7f3a37fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:56.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.595+0000 7f3a37fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:56.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.595+0000 7f3a37fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:56.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.595+0000 7f3a377fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:56.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.595+0000 7f3a377fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:56.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.595+0000 7f3a377fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:56.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.595+0000 7f3a36ffd640 10 monclient(hunting): get_auth_request con 0x7f3a380c7170 auth_method 0 2026-02-17T21:28:56.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.595+0000 7f3a36ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:56.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.595+0000 7f3a36ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:56.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.595+0000 7f3a36ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:56.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.595+0000 7f3a37fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:56.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.595+0000 7f3a37fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:56.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.595+0000 7f3a37fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:56.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.595+0000 7f3a36ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:56.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.595+0000 7f3a36ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:56.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.595+0000 7f3a36ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:56.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.596+0000 7f3a377fe640 10 monclient(hunting): handle_auth_done global_id 4972 payload 824 2026-02-17T21:28:56.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.596+0000 7f3a377fe640 1 -- 10.20.193.5:0/2138322609 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3a380c7550 msgr2=0x7f3a381f1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:56.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.596+0000 7f3a377fe640 1 --2- 10.20.193.5:0/2138322609 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3a380c7550 0x7f3a381f1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:56.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.596+0000 7f3a377fe640 1 -- 10.20.193.5:0/2138322609 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3a380c7170 msgr2=0x7f3a381f1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:56.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.596+0000 7f3a377fe640 1 --2- 10.20.193.5:0/2138322609 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3a380c7170 0x7f3a381f1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:56.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.596+0000 7f3a377fe640 10 monclient: _finish_hunting 0 2026-02-17T21:28:56.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.596+0000 7f3a377fe640 1 monclient: found mon.noname-b 2026-02-17T21:28:56.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.596+0000 7f3a377fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:56.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.596+0000 7f3a377fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:28:56.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.596+0000 7f3a377fe640 1 -- 10.20.193.5:0/2138322609 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a381f51d0 con 0x7f3a38074ef0 2026-02-17T21:28:56.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.597+0000 7f3a377fe640 1 --2- 10.20.193.5:0/2138322609 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3a38074ef0 0x7f3a38159e90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400c520 tx=0x7f3a2400c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:56.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.597+0000 7f3a13fff640 10 client.?.objecter ms_handle_connect 0x7f3a38074ef0 2026-02-17T21:28:56.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.597+0000 7f3a13fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:28:56.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a13fff640 1 -- 10.20.193.5:0/2138322609 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24016020 con 0x7f3a38074ef0 2026-02-17T21:28:56.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a13fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:56.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a13fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:28:56.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a13fff640 10 monclient: dump: 2026-02-17T21:28:56.614 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:56.615 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:56.615 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:56.615 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:56.615 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:56.615 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:56.615 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:56.615 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:56.615 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:56.615 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:56.615 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a13fff640 10 monclient: _finish_auth 0 2026-02-17T21:28:56.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a13fff640 10 monclient: _check_auth_tickets 2026-02-17T21:28:56.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a13fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:56.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a13fff640 1 -- 10.20.193.5:0/2138322609 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a240052f0 con 0x7f3a38074ef0 2026-02-17T21:28:56.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a13fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:56.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a13fff640 1 -- 10.20.193.5:0/2138322609 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a240068d0 con 0x7f3a38074ef0 2026-02-17T21:28:56.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a13fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:56.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a13fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:28:56.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a35ffb640 4 set_mon_vals no callback set 2026-02-17T21:28:56.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a13fff640 10 monclient: dump: 2026-02-17T21:28:56.617 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:56.617 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:56.617 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:56.617 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:56.617 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:56.618 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:56.618 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:56.618 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:56.618 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:56.618 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:56.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a3db40640 5 monclient: authenticate success, global_id 4972 2026-02-17T21:28:56.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a3db40640 10 monclient: _renew_subs 2026-02-17T21:28:56.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a3db40640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:56.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a3db40640 1 -- 10.20.193.5:0/2138322609 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a381f54b0 con 0x7f3a38074ef0 2026-02-17T21:28:56.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a3db40640 10 client.4972.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:28:56.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a3db40640 10 monclient: _renew_subs 2026-02-17T21:28:56.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a3db40640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:56.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a3db40640 1 -- 10.20.193.5:0/2138322609 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a381f5a70 con 0x7f3a38074ef0 2026-02-17T21:28:56.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a3db40640 1 librados: init done 2026-02-17T21:28:56.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a3db40640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:56.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a3db40640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:56.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a3db40640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:56.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.599+0000 7f3a3db40640 1 -- 10.20.193.5:0/2138322609 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a380749b0 con 0x7f3a38074ef0 2026-02-17T21:28:56.707 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.705+0000 7f3a13fff640 1 -- 10.20.193.5:0/2138322609 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f3a24023070 con 0x7f3a38074ef0 2026-02-17T21:28:56.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.706+0000 7f3a13fff640 1 --2- 10.20.193.5:0/2138322609 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3a08079300 0x7f3a0807b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:56.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.706+0000 7f3a36ffd640 1 --2- 10.20.193.5:0/2138322609 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3a08079300 0x7f3a0807b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:56.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.706+0000 7f3a36ffd640 10 monclient: get_auth_request con 0x7f3a08079300 auth_method 0 2026-02-17T21:28:56.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.707+0000 7f3a36ffd640 1 --2- 10.20.193.5:0/2138322609 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3a08079300 0x7f3a0807b7c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3a3815a4b0 tx=0x7f3a28009290 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:56.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.707+0000 7f3a13fff640 10 client.4972.objecter ms_handle_connect 0x7f3a08079300 2026-02-17T21:28:56.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.707+0000 7f3a13fff640 1 -- 10.20.193.5:0/2138322609 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f3a2405e1d0 con 0x7f3a38074ef0 2026-02-17T21:28:56.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.707+0000 7f3a13fff640 10 client.4972.objecter ms_dispatch2 0x7f3a38000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:28:56.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.707+0000 7f3a13fff640 3 client.4972.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:28:56.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.707+0000 7f3a13fff640 3 client.4972.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:28:56.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.707+0000 7f3a13fff640 20 client.4972.objecter dump_active .. 0 homeless 2026-02-17T21:28:56.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.713+0000 7f3a13fff640 1 -- 10.20.193.5:0/2138322609 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3a24020020 con 0x7f3a38074ef0 2026-02-17T21:28:56.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.713+0000 7f3a13fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:56.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.713+0000 7f3a13fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:28:56.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.813+0000 7f3a3db40640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:28:56.815 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.813+0000 7f3a3db40640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:56.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.813+0000 7f3a3db40640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:56.816 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.813+0000 7f3a3db40640 1 -- 10.20.193.5:0/2138322609 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3a380c4b40 con 0x7f3a38074ef0 2026-02-17T21:28:56.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.816+0000 7f3a13fff640 1 -- 10.20.193.5:0/2138322609 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f3a24062190 con 0x7f3a38074ef0 2026-02-17T21:28:56.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.816+0000 7f3a13fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:28:56.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.816+0000 7f3a13fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:28:56.818 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:28:56.818 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:28:56.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.817+0000 7f3a3db40640 10 librados: watch_flush enter 2026-02-17T21:28:56.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.817+0000 7f3a3db40640 10 librados: watch_flush exit 2026-02-17T21:28:56.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.817+0000 7f3a3db40640 20 client.4972.objecter shutdown clearing up homeless session... 2026-02-17T21:28:56.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.817+0000 7f3a3db40640 10 client.4972.objecter successfully canceled tick 2026-02-17T21:28:56.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.817+0000 7f3a3db40640 1 -- 10.20.193.5:0/2138322609 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3a08079300 msgr2=0x7f3a0807b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:56.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.817+0000 7f3a3db40640 1 --2- 10.20.193.5:0/2138322609 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3a08079300 0x7f3a0807b7c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3a3815a4b0 tx=0x7f3a28009290 comp rx=0 tx=0).stop 2026-02-17T21:28:56.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.817+0000 7f3a3db40640 10 monclient: shutdown 2026-02-17T21:28:56.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.817+0000 7f3a3db40640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:56.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.817+0000 7f3a3db40640 1 -- 10.20.193.5:0/2138322609 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3a38074ef0 msgr2=0x7f3a38159e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:56.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.817+0000 7f3a3db40640 1 --2- 10.20.193.5:0/2138322609 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3a38074ef0 0x7f3a38159e90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400c520 tx=0x7f3a2400c9f0 comp rx=0 tx=0).stop 2026-02-17T21:28:56.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.817+0000 7f3a3db40640 1 -- 10.20.193.5:0/2138322609 shutdown_connections 2026-02-17T21:28:56.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.817+0000 7f3a3db40640 1 --2- 10.20.193.5:0/2138322609 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3a08079300 0x7f3a0807b7c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:56.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.817+0000 7f3a3db40640 1 --2- 10.20.193.5:0/2138322609 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3a380c7550 0x7f3a381f1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:56.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.817+0000 7f3a3db40640 1 --2- 10.20.193.5:0/2138322609 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3a380c7170 0x7f3a381f1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:56.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.817+0000 7f3a3db40640 1 --2- 10.20.193.5:0/2138322609 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3a38074ef0 0x7f3a38159e90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:56.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.817+0000 7f3a3db40640 1 -- 10.20.193.5:0/2138322609 >> 10.20.193.5:0/2138322609 conn(0x7f3a380c9f40 msgr2=0x7f3a38159180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:56.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.817+0000 7f3a3db40640 1 -- 10.20.193.5:0/2138322609 shutdown_connections 2026-02-17T21:28:56.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.817+0000 7f3a3db40640 1 -- 10.20.193.5:0/2138322609 wait complete. 2026-02-17T21:28:56.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:56.817+0000 7f3a3db40640 1 librados: shutdown 2026-02-17T21:28:57.581 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:05:37.206 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:57.608 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:05:37.234 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:57.617 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:05:37.242 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:57.637 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:05:37.260 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:57.638 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:05:37.223 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:57.638 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:05:37.261 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:57.638 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:05:37.224 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:57.646 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:05:37.270 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:57.648 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:05:37.234 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:28:59.827 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:28:59.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.896+0000 7f0eb7236640 10 monclient: get_monmap_and_config 2026-02-17T21:28:59.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.896+0000 7f0eb7236640 10 monclient: build_initial_monmap 2026-02-17T21:28:59.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.896+0000 7f0eb7236640 10 monclient: monmap: 2026-02-17T21:28:59.898 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:59.898 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:59.898 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:28:59.896713+0000 2026-02-17T21:28:59.898 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:28:59.896713+0000 2026-02-17T21:28:59.898 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:59.899 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:59.899 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:28:59.899 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:28:59.899 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:28:59.899 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:28:59.899 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:28:59.899 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:28:59.899 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:59.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.896+0000 7f0eb7236640 1 Processor -- start 2026-02-17T21:28:59.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.896+0000 7f0eb7236640 1 -- start start 2026-02-17T21:28:59.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.896+0000 7f0eb7236640 10 monclient: init 2026-02-17T21:28:59.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.896+0000 7f0eb7236640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:59.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.896+0000 7f0eb7236640 10 monclient: _add_conns ranks=[2,4,5,1,3,0] 2026-02-17T21:28:59.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.896+0000 7f0eb7236640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0eb015d370 addr v1:10.20.193.135:6789/0 2026-02-17T21:28:59.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.896+0000 7f0eb7236640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0eb00c7e20 0x7f0eb015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:59.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.896+0000 7f0eb7236640 10 monclient(hunting): picked mon.noname-b con 0x7f0eb00c7e20 addr v2:10.20.193.119:3300/0 2026-02-17T21:28:59.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.896+0000 7f0eb7236640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f0eb00c74c0 0x7f0eb00c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:59.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.896+0000 7f0eb7236640 10 monclient(hunting): picked mon.noname-c con 0x7f0eb00c74c0 addr v2:10.20.193.135:3300/0 2026-02-17T21:28:59.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.896+0000 7f0eb7236640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0eb00c8350 con 0x7f0eb015d370 2026-02-17T21:28:59.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.896+0000 7f0eb7236640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:59.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.896+0000 7f0eb7236640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f0eb015b710 con 0x7f0eb00c7e20 2026-02-17T21:28:59.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.896+0000 7f0eb7236640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:59.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.896+0000 7f0eb7236640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0eb00c9240 con 0x7f0eb00c74c0 2026-02-17T21:28:59.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.896+0000 7f0eb7236640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:59.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.896+0000 7f0eb7236640 10 monclient(hunting): authenticate will time out at 1245.461996s 2026-02-17T21:28:59.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.897+0000 7f0ea7fff640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0eb00c7e20 0x7f0eb015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:59.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.897+0000 7f0eb4fab640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f0eb015d370 0x7f0eb015b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:35506/0 (socket says 10.20.193.5:35506) 2026-02-17T21:28:59.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.897+0000 7f0eb4fab640 1 -- 10.20.193.5:0/3760399094 learned_addr learned my addr 10.20.193.5:0/3760399094 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:28:59.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.897+0000 7f0ea7fff640 10 monclient(hunting): get_auth_request con 0x7f0eb00c7e20 auth_method 0 2026-02-17T21:28:59.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.897+0000 7f0ea7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:59.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.897+0000 7f0ea7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:59.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.897+0000 7f0ea7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:59.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.897+0000 7f0eb57ac640 1 --2- 10.20.193.5:0/3760399094 >> v2:10.20.193.135:3300/0 conn(0x7f0eb00c74c0 0x7f0eb00c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:59.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.898+0000 7f0ea7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:59.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.898+0000 7f0ea7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:59.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.898+0000 7f0ea7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:59.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.898+0000 7f0eb57ac640 10 monclient(hunting): get_auth_request con 0x7f0eb00c74c0 auth_method 0 2026-02-17T21:28:59.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.898+0000 7f0eb57ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:59.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.898+0000 7f0eb57ac640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:59.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.898+0000 7f0eb57ac640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:59.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.898+0000 7f0ea77fe640 1 -- 10.20.193.5:0/3760399094 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2902195585 0 0) 0x7f0eb00c8350 con 0x7f0eb015d370 2026-02-17T21:28:59.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.898+0000 7f0ea77fe640 10 monclient(hunting): _negotiate 2026-02-17T21:28:59.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.898+0000 7f0ea77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:59.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.898+0000 7f0ea77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:59.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.898+0000 7f0ea77fe640 10 monclient(hunting): my global_id is 4961 2026-02-17T21:28:59.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.898+0000 7f0ea77fe640 1 -- 10.20.193.5:0/3760399094 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e9c003620 con 0x7f0eb015d370 2026-02-17T21:28:59.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.899+0000 7f0ea7fff640 10 monclient(hunting): handle_auth_done global_id 4975 payload 274 2026-02-17T21:28:59.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.899+0000 7f0ea7fff640 1 -- 10.20.193.5:0/3760399094 >> v2:10.20.193.135:3300/0 conn(0x7f0eb00c74c0 msgr2=0x7f0eb00c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:28:59.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.899+0000 7f0ea7fff640 1 --2- 10.20.193.5:0/3760399094 >> v2:10.20.193.135:3300/0 conn(0x7f0eb00c74c0 0x7f0eb00c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:59.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.899+0000 7f0ea7fff640 1 -- 10.20.193.5:0/3760399094 >> v1:10.20.193.135:6789/0 conn(0x7f0eb015d370 legacy=0x7f0eb015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:59.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.899+0000 7f0ea7fff640 10 monclient: _finish_hunting 0 2026-02-17T21:28:59.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.899+0000 7f0ea7fff640 1 monclient: found mon.noname-b 2026-02-17T21:28:59.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.899+0000 7f0ea7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:59.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.899+0000 7f0ea7fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:28:59.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.899+0000 7f0ea7fff640 1 -- 10.20.193.5:0/3760399094 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb00c8630 con 0x7f0eb00c7e20 2026-02-17T21:28:59.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.899+0000 7f0ea7fff640 1 --2- 10.20.193.5:0/3760399094 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0eb00c7e20 0x7f0eb015d750 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0eb015dcf0 tx=0x7f0e9802ede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f0bf31d96de08c4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:59.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.901+0000 7f0ea77fe640 1 -- 10.20.193.5:0/3760399094 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9803c070 con 0x7f0eb00c7e20 2026-02-17T21:28:59.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.901+0000 7f0ea77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:59.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.901+0000 7f0ea77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:28:59.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.901+0000 7f0ea77fe640 10 monclient: dump: 2026-02-17T21:28:59.913 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:59.913 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:59.913 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:59.913 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:59.913 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:59.913 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:59.913 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:59.913 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:59.914 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:59.914 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:59.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.901+0000 7f0ea77fe640 10 monclient: _finish_auth 0 2026-02-17T21:28:59.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.901+0000 7f0ea77fe640 10 monclient: _check_auth_tickets 2026-02-17T21:28:59.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.901+0000 7f0ea77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:59.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.901+0000 7f0ea77fe640 1 -- 10.20.193.5:0/3760399094 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e9802faf0 con 0x7f0eb00c7e20 2026-02-17T21:28:59.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.901+0000 7f0ea77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:59.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.901+0000 7f0ea77fe640 1 -- 10.20.193.5:0/3760399094 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e98037440 con 0x7f0eb00c7e20 2026-02-17T21:28:59.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.901+0000 7f0eb7236640 5 monclient: authenticate success, global_id 4975 2026-02-17T21:28:59.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.901+0000 7f0ea77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:59.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.901+0000 7f0ea77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:28:59.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.901+0000 7f0ea77fe640 10 monclient: dump: 2026-02-17T21:28:59.915 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:59.915 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:59.915 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:59.915 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:59.915 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:59.915 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:59.915 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:59.915 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:59.915 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:59.915 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:59.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.901+0000 7f0eb7236640 10 monclient: get_monmap_and_config success 2026-02-17T21:28:59.915 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.901+0000 7f0eb7236640 4 set_mon_vals no callback set 2026-02-17T21:28:59.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.902+0000 7f0eb7236640 10 monclient: shutdown 2026-02-17T21:28:59.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.902+0000 7f0eb7236640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:28:59.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.902+0000 7f0eb7236640 1 -- 10.20.193.5:0/3760399094 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0eb00c7e20 msgr2=0x7f0eb015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:59.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.902+0000 7f0eb7236640 1 --2- 10.20.193.5:0/3760399094 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0eb00c7e20 0x7f0eb015d750 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0eb015dcf0 tx=0x7f0e9802ede0 comp rx=0 tx=0).stop 2026-02-17T21:28:59.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.902+0000 7f0eb7236640 1 -- 10.20.193.5:0/3760399094 shutdown_connections 2026-02-17T21:28:59.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.902+0000 7f0eb7236640 1 --2- 10.20.193.5:0/3760399094 >> v2:10.20.193.135:3300/0 conn(0x7f0eb00c74c0 0x7f0eb00c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:59.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.902+0000 7f0eb7236640 1 --2- 10.20.193.5:0/3760399094 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0eb00c7e20 0x7f0eb015d750 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:59.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.902+0000 7f0eb7236640 1 -- 10.20.193.5:0/3760399094 >> 10.20.193.5:0/3760399094 conn(0x7f0eb00c9f20 msgr2=0x7f0eb00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:28:59.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.902+0000 7f0eb7236640 1 -- 10.20.193.5:0/3760399094 shutdown_connections 2026-02-17T21:28:59.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.902+0000 7f0eb7236640 1 -- 10.20.193.5:0/3760399094 wait complete. 2026-02-17T21:28:59.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.902+0000 7f0eb7236640 10 monclient: build_initial_monmap 2026-02-17T21:28:59.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.902+0000 7f0eb7236640 10 monclient: monmap: 2026-02-17T21:28:59.917 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:28:59.917 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:28:59.917 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:28:59.917 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:28:59.917 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:28:59.917 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:59.917 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:28:59.917 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:28:59.917 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:28:59.917 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:59.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0eb7236640 1 librados: starting msgr at 2026-02-17T21:28:59.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0eb7236640 1 librados: starting objecter 2026-02-17T21:28:59.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0eb7236640 1 Processor -- start 2026-02-17T21:28:59.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0eb7236640 1 -- start start 2026-02-17T21:28:59.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0eb7236640 1 librados: setting wanted keys 2026-02-17T21:28:59.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0eb7236640 1 librados: calling monclient init 2026-02-17T21:28:59.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0eb7236640 10 monclient: init 2026-02-17T21:28:59.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0eb7236640 10 monclient: _reopen_session rank -1 2026-02-17T21:28:59.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0eb7236640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:28:59.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0eb7236640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0eb00c74c0 0x7f0eb014d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:59.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0eb7236640 10 monclient(hunting): picked mon.noname-a con 0x7f0eb00c74c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:28:59.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0eb7236640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0eb00c7e20 0x7f0eb0159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:59.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0eb7236640 10 monclient(hunting): picked mon.noname-b con 0x7f0eb00c7e20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:28:59.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0eb7236640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0eb015d370 0x7f0eb0159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:28:59.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0eb7236640 10 monclient(hunting): picked mon.noname-c con 0x7f0eb015d370 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:28:59.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0eb7236640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:59.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0eb7236640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb00c8ed0 con 0x7f0eb00c74c0 2026-02-17T21:28:59.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0eb7236640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:59.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0eb7236640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb00c8bf0 con 0x7f0eb00c7e20 2026-02-17T21:28:59.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0eb7236640 10 monclient(hunting): start opening mon connection 2026-02-17T21:28:59.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0eb7236640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb00c96d0 con 0x7f0eb015d370 2026-02-17T21:28:59.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0eb7236640 10 monclient(hunting): _renew_subs 2026-02-17T21:28:59.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0eb7236640 10 monclient(hunting): authenticate will time out at 1245.468484s 2026-02-17T21:28:59.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0ea7fff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0eb00c7e20 0x7f0eb0159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:59.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0eb57ac640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0eb015d370 0x7f0eb0159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:59.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0eb4fab640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0eb00c74c0 0x7f0eb014d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:28:59.919 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0ea7fff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0eb00c7e20 0x7f0eb0159760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:46756/0 (socket says 10.20.193.5:46756) 2026-02-17T21:28:59.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0ea7fff640 1 -- 10.20.193.5:0/3730104103 learned_addr learned my addr 10.20.193.5:0/3730104103 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:28:59.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0ea7fff640 10 monclient(hunting): get_auth_request con 0x7f0eb00c7e20 auth_method 0 2026-02-17T21:28:59.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0ea7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:59.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0ea7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:59.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.903+0000 7f0ea7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:59.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.904+0000 7f0eb57ac640 10 monclient(hunting): get_auth_request con 0x7f0eb015d370 auth_method 0 2026-02-17T21:28:59.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.904+0000 7f0eb57ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:59.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.904+0000 7f0eb57ac640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:59.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.904+0000 7f0eb57ac640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:59.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.904+0000 7f0ea7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:59.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.904+0000 7f0ea7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:59.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.904+0000 7f0ea7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:59.920 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.904+0000 7f0eb4fab640 10 monclient(hunting): get_auth_request con 0x7f0eb00c74c0 auth_method 0 2026-02-17T21:28:59.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.904+0000 7f0eb4fab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:28:59.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.904+0000 7f0eb4fab640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:28:59.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.904+0000 7f0eb4fab640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:28:59.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.904+0000 7f0eb57ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:59.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.904+0000 7f0eb57ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:59.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.904+0000 7f0eb57ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:59.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.904+0000 7f0eb4fab640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:28:59.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.904+0000 7f0eb4fab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:28:59.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.904+0000 7f0eb4fab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:28:59.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.905+0000 7f0ea7fff640 10 monclient(hunting): handle_auth_done global_id 4978 payload 824 2026-02-17T21:28:59.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.905+0000 7f0ea7fff640 1 -- 10.20.193.5:0/3730104103 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0eb015d370 msgr2=0x7f0eb0159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:59.921 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.905+0000 7f0ea7fff640 1 --2- 10.20.193.5:0/3730104103 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0eb015d370 0x7f0eb0159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:59.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.905+0000 7f0ea7fff640 1 -- 10.20.193.5:0/3730104103 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0eb00c74c0 msgr2=0x7f0eb014d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:28:59.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.905+0000 7f0ea7fff640 1 --2- 10.20.193.5:0/3730104103 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0eb00c74c0 0x7f0eb014d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:28:59.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.905+0000 7f0ea7fff640 10 monclient: _finish_hunting 0 2026-02-17T21:28:59.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.905+0000 7f0ea7fff640 1 monclient: found mon.noname-b 2026-02-17T21:28:59.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.905+0000 7f0ea7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:28:59.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.905+0000 7f0ea7fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:28:59.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.905+0000 7f0ea7fff640 1 -- 10.20.193.5:0/3730104103 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb0150550 con 0x7f0eb00c7e20 2026-02-17T21:28:59.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.906+0000 7f0ea7fff640 1 --2- 10.20.193.5:0/3730104103 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0eb00c7e20 0x7f0eb0159760 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0e98009130 tx=0x7f0e980047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:28:59.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.906+0000 7f0ea57fa640 10 client.?.objecter ms_handle_connect 0x7f0eb00c7e20 2026-02-17T21:28:59.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.906+0000 7f0ea57fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:28:59.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0ea57fa640 1 -- 10.20.193.5:0/3730104103 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9803c040 con 0x7f0eb00c7e20 2026-02-17T21:28:59.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0ea57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:59.922 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0ea57fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:28:59.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0ea57fa640 10 monclient: dump: 2026-02-17T21:28:59.923 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:59.923 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:59.923 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:59.923 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:59.923 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:59.923 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:59.923 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:59.923 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:59.923 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:59.923 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:59.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0ea57fa640 10 monclient: _finish_auth 0 2026-02-17T21:28:59.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0ea57fa640 10 monclient: _check_auth_tickets 2026-02-17T21:28:59.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0ea57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:28:59.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0ea57fa640 1 -- 10.20.193.5:0/3730104103 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e98042610 con 0x7f0eb00c7e20 2026-02-17T21:28:59.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0ea57fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:28:59.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0ea57fa640 1 -- 10.20.193.5:0/3730104103 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e980429e0 con 0x7f0eb00c7e20 2026-02-17T21:28:59.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0ea57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:28:59.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0ea57fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:28:59.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0ea57fa640 10 monclient: dump: 2026-02-17T21:28:59.924 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:28:59.924 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:28:59.924 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:59.924 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:28:59.924 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:28:59.924 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:28:59.925 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:28:59.925 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:28:59.925 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:28:59.925 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:28:59.925 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0ea6ffd640 4 set_mon_vals no callback set 2026-02-17T21:28:59.925 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0eb7236640 5 monclient: authenticate success, global_id 4978 2026-02-17T21:28:59.925 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0eb7236640 10 monclient: _renew_subs 2026-02-17T21:28:59.925 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0eb7236640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:59.925 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0eb7236640 1 -- 10.20.193.5:0/3730104103 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eb014f9d0 con 0x7f0eb00c7e20 2026-02-17T21:28:59.925 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0eb7236640 10 client.4978.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:28:59.925 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0eb7236640 10 monclient: _renew_subs 2026-02-17T21:28:59.925 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0eb7236640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:59.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0eb7236640 1 -- 10.20.193.5:0/3730104103 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eb014ff90 con 0x7f0eb00c7e20 2026-02-17T21:28:59.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0eb7236640 1 librados: init done 2026-02-17T21:28:59.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0eb7236640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:59.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0eb7236640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:28:59.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0eb7236640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:28:59.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:28:59.908+0000 7f0eb7236640 1 -- 10.20.193.5:0/3730104103 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eb015d750 con 0x7f0eb00c7e20 2026-02-17T21:29:00.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.014+0000 7f0ea57fa640 1 -- 10.20.193.5:0/3730104103 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f0e9804b450 con 0x7f0eb00c7e20 2026-02-17T21:29:00.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.015+0000 7f0ea57fa640 1 --2- 10.20.193.5:0/3730104103 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0e800792d0 0x7f0e8007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:00.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.015+0000 7f0eb4fab640 1 --2- 10.20.193.5:0/3730104103 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0e800792d0 0x7f0e8007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:00.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.015+0000 7f0eb4fab640 10 monclient: get_auth_request con 0x7f0e800792d0 auth_method 0 2026-02-17T21:29:00.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.016+0000 7f0eb4fab640 1 --2- 10.20.193.5:0/3730104103 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0e800792d0 0x7f0e8007b790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0007b60 tx=0x7f0ea0007ab0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:00.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.016+0000 7f0ea57fa640 10 client.4978.objecter ms_handle_connect 0x7f0e800792d0 2026-02-17T21:29:00.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.018+0000 7f0ea57fa640 1 -- 10.20.193.5:0/3730104103 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f0e9802fa70 con 0x7f0eb00c7e20 2026-02-17T21:29:00.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.018+0000 7f0ea57fa640 10 client.4978.objecter ms_dispatch2 0x7f0eb0000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:29:00.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.018+0000 7f0ea57fa640 3 client.4978.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:29:00.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.018+0000 7f0ea57fa640 3 client.4978.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:29:00.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.018+0000 7f0ea57fa640 20 client.4978.objecter dump_active .. 0 homeless 2026-02-17T21:29:00.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.024+0000 7f0ea57fa640 1 -- 10.20.193.5:0/3730104103 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0eb0150550 con 0x7f0eb00c7e20 2026-02-17T21:29:00.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.024+0000 7f0ea57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:00.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.024+0000 7f0ea57fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:29:00.127 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.125+0000 7f0eb7236640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:29:00.127 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.125+0000 7f0eb7236640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:00.127 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.125+0000 7f0eb7236640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:29:00.127 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.125+0000 7f0eb7236640 1 -- 10.20.193.5:0/3730104103 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0eb006ffb0 con 0x7f0eb00c7e20 2026-02-17T21:29:00.129 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.128+0000 7f0ea57fa640 1 -- 10.20.193.5:0/3730104103 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f0e98086c20 con 0x7f0eb00c7e20 2026-02-17T21:29:00.129 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.128+0000 7f0ea57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:00.130 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.128+0000 7f0ea57fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:29:00.130 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:29:00.130 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:29:00.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.129+0000 7f0eb7236640 10 librados: watch_flush enter 2026-02-17T21:29:00.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.129+0000 7f0eb7236640 10 librados: watch_flush exit 2026-02-17T21:29:00.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.129+0000 7f0eb7236640 20 client.4978.objecter shutdown clearing up homeless session... 2026-02-17T21:29:00.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.129+0000 7f0eb7236640 10 client.4978.objecter successfully canceled tick 2026-02-17T21:29:00.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.129+0000 7f0eb7236640 1 -- 10.20.193.5:0/3730104103 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0e800792d0 msgr2=0x7f0e8007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:00.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.129+0000 7f0eb7236640 1 --2- 10.20.193.5:0/3730104103 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0e800792d0 0x7f0e8007b790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0007b60 tx=0x7f0ea0007ab0 comp rx=0 tx=0).stop 2026-02-17T21:29:00.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.129+0000 7f0eb7236640 10 monclient: shutdown 2026-02-17T21:29:00.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.129+0000 7f0eb7236640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:00.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.129+0000 7f0eb7236640 1 -- 10.20.193.5:0/3730104103 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0eb00c7e20 msgr2=0x7f0eb0159760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:00.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.129+0000 7f0eb7236640 1 --2- 10.20.193.5:0/3730104103 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0eb00c7e20 0x7f0eb0159760 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0e98009130 tx=0x7f0e980047c0 comp rx=0 tx=0).stop 2026-02-17T21:29:00.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.129+0000 7f0eb7236640 1 -- 10.20.193.5:0/3730104103 shutdown_connections 2026-02-17T21:29:00.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.129+0000 7f0eb7236640 1 --2- 10.20.193.5:0/3730104103 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0e800792d0 0x7f0e8007b790 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:00.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.129+0000 7f0eb7236640 1 --2- 10.20.193.5:0/3730104103 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0eb015d370 0x7f0eb0159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:00.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.129+0000 7f0eb7236640 1 --2- 10.20.193.5:0/3730104103 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0eb00c7e20 0x7f0eb0159760 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:00.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.129+0000 7f0eb7236640 1 --2- 10.20.193.5:0/3730104103 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0eb00c74c0 0x7f0eb014d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:00.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.129+0000 7f0eb7236640 1 -- 10.20.193.5:0/3730104103 >> 10.20.193.5:0/3730104103 conn(0x7f0eb00c9f20 msgr2=0x7f0eb01510d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:00.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.129+0000 7f0eb7236640 1 -- 10.20.193.5:0/3730104103 shutdown_connections 2026-02-17T21:29:00.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.129+0000 7f0eb7236640 1 -- 10.20.193.5:0/3730104103 wait complete. 2026-02-17T21:29:00.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:00.130+0000 7f0eb7236640 1 librados: shutdown 2026-02-17T21:29:03.141 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:29:03.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.208+0000 7fc00325b640 10 monclient: get_monmap_and_config 2026-02-17T21:29:03.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.208+0000 7fc00325b640 10 monclient: build_initial_monmap 2026-02-17T21:29:03.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.208+0000 7fc00325b640 10 monclient: monmap: 2026-02-17T21:29:03.211 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:03.211 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:03.211 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:29:03.210350+0000 2026-02-17T21:29:03.211 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:29:03.210350+0000 2026-02-17T21:29:03.211 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:03.211 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:03.211 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:29:03.211 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:29:03.211 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:29:03.211 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:29:03.211 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:29:03.211 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:29:03.211 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:03.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.209+0000 7fc00325b640 1 Processor -- start 2026-02-17T21:29:03.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.209+0000 7fc00325b640 1 -- start start 2026-02-17T21:29:03.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.209+0000 7fc00325b640 10 monclient: init 2026-02-17T21:29:03.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.209+0000 7fc00325b640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:03.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.209+0000 7fc00325b640 10 monclient: _add_conns ranks=[1,2,5,0,4,3] 2026-02-17T21:29:03.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.209+0000 7fc00325b640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fbffc0d1b60 addr v1:10.20.193.119:6789/0 2026-02-17T21:29:03.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.209+0000 7fc00325b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbffc0d1f40 addr v1:10.20.193.135:6789/0 2026-02-17T21:29:03.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.209+0000 7fc00325b640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fbffc15e060 0x7fbffc15c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:03.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.209+0000 7fc00325b640 10 monclient(hunting): picked mon.noname-c con 0x7fbffc15e060 addr v2:10.20.193.135:3300/0 2026-02-17T21:29:03.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.209+0000 7fc00325b640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbffc0c98e0 con 0x7fbffc0d1b60 2026-02-17T21:29:03.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.209+0000 7fc00325b640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbffc0c9bc0 con 0x7fbffc0d1f40 2026-02-17T21:29:03.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.209+0000 7fc00325b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:03.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.209+0000 7fc00325b640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fbffc15cd80 con 0x7fbffc15e060 2026-02-17T21:29:03.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.209+0000 7fc00325b640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:03.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.209+0000 7fc00325b640 10 monclient(hunting): authenticate will time out at 1248.775853s 2026-02-17T21:29:03.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.210+0000 7fc000fd0640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7fbffc0d1b60 0x7fbffc0c8d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:49030/0 (socket says 10.20.193.5:49030) 2026-02-17T21:29:03.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.210+0000 7fc000fd0640 1 -- 10.20.193.5:0/1137498754 learned_addr learned my addr 10.20.193.5:0/1137498754 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:29:03.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.210+0000 7fc0017d1640 1 --2- 10.20.193.5:0/1137498754 >> v2:10.20.193.135:3300/0 conn(0x7fbffc15e060 0x7fbffc15c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:03.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.210+0000 7fc0017d1640 10 monclient(hunting): get_auth_request con 0x7fbffc15e060 auth_method 0 2026-02-17T21:29:03.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.210+0000 7fc0017d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:03.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.210+0000 7fc0017d1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:03.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.210+0000 7fc0017d1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:03.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.211+0000 7fc0017d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:03.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.211+0000 7fc0017d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:03.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.211+0000 7fc0017d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:03.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.211+0000 7fbff37fe640 1 -- 10.20.193.5:0/1137498754 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1231219124 0 0) 0x7fbffc0c98e0 con 0x7fbffc0d1b60 2026-02-17T21:29:03.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.211+0000 7fbff37fe640 10 monclient(hunting): _negotiate 2026-02-17T21:29:03.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.211+0000 7fbff37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:03.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.211+0000 7fbff37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:03.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.211+0000 7fbff37fe640 10 monclient(hunting): my global_id is 4981 2026-02-17T21:29:03.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.211+0000 7fbff37fe640 1 -- 10.20.193.5:0/1137498754 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfe8003620 con 0x7fbffc0d1b60 2026-02-17T21:29:03.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.213+0000 7fc0017d1640 10 monclient(hunting): handle_auth_done global_id 4970 payload 274 2026-02-17T21:29:03.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.213+0000 7fc0017d1640 1 -- 10.20.193.5:0/1137498754 >> v1:10.20.193.135:6789/0 conn(0x7fbffc0d1f40 legacy=0x7fbffc15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:03.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.213+0000 7fc0017d1640 1 -- 10.20.193.5:0/1137498754 >> v1:10.20.193.119:6789/0 conn(0x7fbffc0d1b60 legacy=0x7fbffc0c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:03.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.213+0000 7fc0017d1640 10 monclient: _finish_hunting 0 2026-02-17T21:29:03.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.213+0000 7fc0017d1640 1 monclient: found mon.noname-c 2026-02-17T21:29:03.216 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.213+0000 7fc0017d1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:03.216 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.213+0000 7fc0017d1640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:29:03.216 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.213+0000 7fc0017d1640 1 -- 10.20.193.5:0/1137498754 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbffc0c9ea0 con 0x7fbffc15e060 2026-02-17T21:29:03.217 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.215+0000 7fc0017d1640 1 --2- 10.20.193.5:0/1137498754 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbffc15e060 0x7fbffc15c840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbff8009d90 tx=0x7fbff802f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1f50ad21561fe8e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:03.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fbff37fe640 1 -- 10.20.193.5:0/1137498754 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff803c070 con 0x7fbffc15e060 2026-02-17T21:29:03.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fbff37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:03.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fbff37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:29:03.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fbff37fe640 10 monclient: dump: 2026-02-17T21:29:03.220 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:03.220 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:03.220 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:03.220 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:03.220 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:03.220 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:03.220 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:03.220 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:03.220 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:03.220 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:03.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fbff37fe640 10 monclient: _finish_auth 0 2026-02-17T21:29:03.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fbff37fe640 10 monclient: _check_auth_tickets 2026-02-17T21:29:03.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fbff37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:03.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fc00325b640 5 monclient: authenticate success, global_id 4970 2026-02-17T21:29:03.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fbff37fe640 1 -- 10.20.193.5:0/1137498754 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff8037440 con 0x7fbffc15e060 2026-02-17T21:29:03.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fc00325b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:29:03.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fbff37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:03.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fbff37fe640 1 -- 10.20.193.5:0/1137498754 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8037810 con 0x7fbffc15e060 2026-02-17T21:29:03.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fc00325b640 10 monclient: get_monmap_and_config success 2026-02-17T21:29:03.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fc00325b640 4 set_mon_vals no callback set 2026-02-17T21:29:03.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fbff37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:03.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fbff37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:29:03.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fbff37fe640 10 monclient: dump: 2026-02-17T21:29:03.221 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:03.221 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:03.221 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:03.221 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:03.221 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:03.221 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:03.221 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:03.221 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:03.221 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:03.221 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:03.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fc00325b640 10 monclient: shutdown 2026-02-17T21:29:03.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fc00325b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:03.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fc00325b640 1 -- 10.20.193.5:0/1137498754 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbffc15e060 msgr2=0x7fbffc15c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:03.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fc00325b640 1 --2- 10.20.193.5:0/1137498754 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbffc15e060 0x7fbffc15c840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbff8009d90 tx=0x7fbff802f230 comp rx=0 tx=0).stop 2026-02-17T21:29:03.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fc00325b640 1 -- 10.20.193.5:0/1137498754 shutdown_connections 2026-02-17T21:29:03.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fc00325b640 1 --2- 10.20.193.5:0/1137498754 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbffc15e060 0x7fbffc15c840 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:03.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fc00325b640 1 -- 10.20.193.5:0/1137498754 >> 10.20.193.5:0/1137498754 conn(0x7fbffc06d9b0 msgr2=0x7fbffc06ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:03.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fc00325b640 1 -- 10.20.193.5:0/1137498754 shutdown_connections 2026-02-17T21:29:03.223 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.218+0000 7fc00325b640 1 -- 10.20.193.5:0/1137498754 wait complete. 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.219+0000 7fc00325b640 10 monclient: build_initial_monmap 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.219+0000 7fc00325b640 10 monclient: monmap: 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.219+0000 7fc00325b640 1 librados: starting msgr at 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.219+0000 7fc00325b640 1 librados: starting objecter 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.219+0000 7fc00325b640 1 Processor -- start 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.219+0000 7fc00325b640 1 -- start start 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.219+0000 7fc00325b640 1 librados: setting wanted keys 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.219+0000 7fc00325b640 1 librados: calling monclient init 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.219+0000 7fc00325b640 10 monclient: init 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.219+0000 7fc00325b640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.219+0000 7fc00325b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.219+0000 7fc00325b640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbffc0d1b60 0x7fbffc1f7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.219+0000 7fc00325b640 10 monclient(hunting): picked mon.noname-a con 0x7fbffc0d1b60 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.219+0000 7fc00325b640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbffc0d1f40 0x7fbffc15b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.219+0000 7fc00325b640 10 monclient(hunting): picked mon.noname-c con 0x7fbffc0d1f40 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:29:03.224 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.219+0000 7fc00325b640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbffc15e060 0x7fbffc1478f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:03.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.219+0000 7fc00325b640 10 monclient(hunting): picked mon.noname-b con 0x7fbffc15e060 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:29:03.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.219+0000 7fc00325b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:03.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.219+0000 7fc00325b640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbffc15d4c0 con 0x7fbffc0d1b60 2026-02-17T21:29:03.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.219+0000 7fc00325b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:03.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.219+0000 7fc00325b640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbffc0ca460 con 0x7fbffc15e060 2026-02-17T21:29:03.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.219+0000 7fc00325b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:03.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.219+0000 7fc00325b640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbffc06e7b0 con 0x7fbffc0d1f40 2026-02-17T21:29:03.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.219+0000 7fc00325b640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:03.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.219+0000 7fc00325b640 10 monclient(hunting): authenticate will time out at 1248.785830s 2026-02-17T21:29:03.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fbff3fff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbffc0d1f40 0x7fbffc15b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:03.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fc0017d1640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbffc15e060 0x7fbffc1478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:03.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fbff3fff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbffc0d1f40 0x7fbffc15b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:39894/0 (socket says 10.20.193.5:39894) 2026-02-17T21:29:03.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fbff3fff640 1 -- 10.20.193.5:0/1625674153 learned_addr learned my addr 10.20.193.5:0/1625674153 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:29:03.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fbff3fff640 10 monclient(hunting): get_auth_request con 0x7fbffc0d1f40 auth_method 0 2026-02-17T21:29:03.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fbff3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:03.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fbff3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:03.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fbff3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:03.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fc000fd0640 1 --2- 10.20.193.5:0/1625674153 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbffc0d1b60 0x7fbffc1f7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:03.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fc0017d1640 10 monclient(hunting): get_auth_request con 0x7fbffc15e060 auth_method 0 2026-02-17T21:29:03.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fc0017d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:03.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fc0017d1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:03.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fc0017d1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:03.225 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fc000fd0640 10 monclient(hunting): get_auth_request con 0x7fbffc0d1b60 auth_method 0 2026-02-17T21:29:03.226 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fc000fd0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:03.226 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fc000fd0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:03.226 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fc000fd0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:03.226 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fbff3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:03.226 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fbff3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:03.226 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fbff3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:03.226 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fc0017d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:03.226 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fc0017d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:03.226 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fc0017d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:03.226 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fc000fd0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:03.226 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fc000fd0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:03.226 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.220+0000 7fc000fd0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:03.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.221+0000 7fbff3fff640 10 monclient(hunting): handle_auth_done global_id 4976 payload 824 2026-02-17T21:29:03.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.221+0000 7fbff3fff640 1 -- 10.20.193.5:0/1625674153 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbffc15e060 msgr2=0x7fbffc1478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:03.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.221+0000 7fbff3fff640 1 --2- 10.20.193.5:0/1625674153 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbffc15e060 0x7fbffc1478f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:03.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.221+0000 7fbff3fff640 1 -- 10.20.193.5:0/1625674153 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbffc0d1b60 msgr2=0x7fbffc1f7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:03.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.221+0000 7fbff3fff640 1 --2- 10.20.193.5:0/1625674153 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbffc0d1b60 0x7fbffc1f7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:03.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.221+0000 7fbff3fff640 10 monclient: _finish_hunting 0 2026-02-17T21:29:03.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.221+0000 7fbff3fff640 1 monclient: found mon.noname-c 2026-02-17T21:29:03.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.221+0000 7fbff3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:03.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.221+0000 7fbff3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:29:03.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.221+0000 7fbff3fff640 1 -- 10.20.193.5:0/1625674153 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbffc15bc80 con 0x7fbffc0d1f40 2026-02-17T21:29:03.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.222+0000 7fbff3fff640 1 --2- 10.20.193.5:0/1625674153 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbffc0d1f40 0x7fbffc15b740 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbfe400c730 tx=0x7fbfe400cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:03.227 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.222+0000 7fbff17fa640 10 client.?.objecter ms_handle_connect 0x7fbffc0d1f40 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.222+0000 7fbff17fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fbff17fa640 1 -- 10.20.193.5:0/1625674153 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe40052d0 con 0x7fbffc0d1f40 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fbff17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fbff17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fbff17fa640 10 monclient: dump: 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fbff17fa640 10 monclient: _finish_auth 0 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fbff17fa640 10 monclient: _check_auth_tickets 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fbff17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fc00325b640 5 monclient: authenticate success, global_id 4976 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fc00325b640 10 monclient: _renew_subs 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fc00325b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fc00325b640 1 -- 10.20.193.5:0/1625674153 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbffc15a6a0 con 0x7fbffc0d1f40 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fc00325b640 10 client.4976.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fc00325b640 10 monclient: _renew_subs 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fc00325b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fc00325b640 1 -- 10.20.193.5:0/1625674153 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbffc15ac60 con 0x7fbffc0d1f40 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fc00325b640 1 librados: init done 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fbff17fa640 1 -- 10.20.193.5:0/1625674153 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfe4005470 con 0x7fbffc0d1f40 2026-02-17T21:29:03.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fbff17fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:03.229 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fbff17fa640 1 -- 10.20.193.5:0/1625674153 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe400a840 con 0x7fbffc0d1f40 2026-02-17T21:29:03.229 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fbff17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:03.229 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fbff17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:29:03.229 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fbff17fa640 10 monclient: dump: 2026-02-17T21:29:03.229 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:03.229 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:03.229 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:03.229 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:03.229 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:03.229 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:03.229 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:03.229 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:03.229 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:03.229 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:03.229 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fbff2ffd640 4 set_mon_vals no callback set 2026-02-17T21:29:03.229 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fc00325b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:03.229 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fc00325b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:03.229 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fc00325b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:29:03.229 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.224+0000 7fc00325b640 1 -- 10.20.193.5:0/1625674153 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbffc15c840 con 0x7fbffc0d1f40 2026-02-17T21:29:03.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.235+0000 7fbff17fa640 1 -- 10.20.193.5:0/1625674153 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fbfe400a9e0 con 0x7fbffc0d1f40 2026-02-17T21:29:03.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.236+0000 7fbff17fa640 1 --2- 10.20.193.5:0/1625674153 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbfcc079280 0x7fbfcc07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:03.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.236+0000 7fc000fd0640 1 --2- 10.20.193.5:0/1625674153 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbfcc079280 0x7fbfcc07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:03.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.236+0000 7fc000fd0640 10 monclient: get_auth_request con 0x7fbfcc079280 auth_method 0 2026-02-17T21:29:03.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.236+0000 7fbff17fa640 1 -- 10.20.193.5:0/1625674153 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fbfe400ad00 con 0x7fbffc0d1f40 2026-02-17T21:29:03.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.236+0000 7fbff17fa640 10 client.4976.objecter ms_dispatch2 0x7fbffc000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:29:03.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.236+0000 7fbff17fa640 3 client.4976.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:29:03.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.236+0000 7fbff17fa640 3 client.4976.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:29:03.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.237+0000 7fbff17fa640 20 client.4976.objecter dump_active .. 0 homeless 2026-02-17T21:29:03.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.237+0000 7fc000fd0640 1 --2- 10.20.193.5:0/1625674153 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbfcc079280 0x7fbfcc07b740 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbfec007b60 tx=0x7fbfec007ab0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:03.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.237+0000 7fbff17fa640 10 client.4976.objecter ms_handle_connect 0x7fbfcc079280 2026-02-17T21:29:03.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.336+0000 7fbff17fa640 1 -- 10.20.193.5:0/1625674153 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbfe4062370 con 0x7fbffc0d1f40 2026-02-17T21:29:03.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.336+0000 7fbff17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:03.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.336+0000 7fbff17fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:29:03.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.438+0000 7fc00325b640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:29:03.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.438+0000 7fc00325b640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:03.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.438+0000 7fc00325b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:29:03.441 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.438+0000 7fc00325b640 1 -- 10.20.193.5:0/1625674153 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbffc1597e0 con 0x7fbffc0d1f40 2026-02-17T21:29:03.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.440+0000 7fbff17fa640 1 -- 10.20.193.5:0/1625674153 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fbfe4066670 con 0x7fbffc0d1f40 2026-02-17T21:29:03.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.440+0000 7fbff17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:03.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.440+0000 7fbff17fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:29:03.443 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:29:03.443 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:29:03.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.441+0000 7fc00325b640 10 librados: watch_flush enter 2026-02-17T21:29:03.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.441+0000 7fc00325b640 10 librados: watch_flush exit 2026-02-17T21:29:03.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.441+0000 7fc00325b640 20 client.4976.objecter shutdown clearing up homeless session... 2026-02-17T21:29:03.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.441+0000 7fc00325b640 10 client.4976.objecter successfully canceled tick 2026-02-17T21:29:03.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.441+0000 7fc00325b640 1 -- 10.20.193.5:0/1625674153 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbfcc079280 msgr2=0x7fbfcc07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:03.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.441+0000 7fc00325b640 1 --2- 10.20.193.5:0/1625674153 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbfcc079280 0x7fbfcc07b740 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbfec007b60 tx=0x7fbfec007ab0 comp rx=0 tx=0).stop 2026-02-17T21:29:03.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.441+0000 7fc00325b640 10 monclient: shutdown 2026-02-17T21:29:03.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.441+0000 7fc00325b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:03.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.441+0000 7fc00325b640 1 -- 10.20.193.5:0/1625674153 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbffc0d1f40 msgr2=0x7fbffc15b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:03.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.441+0000 7fc00325b640 1 --2- 10.20.193.5:0/1625674153 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbffc0d1f40 0x7fbffc15b740 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbfe400c730 tx=0x7fbfe400cc00 comp rx=0 tx=0).stop 2026-02-17T21:29:03.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.441+0000 7fc00325b640 1 -- 10.20.193.5:0/1625674153 shutdown_connections 2026-02-17T21:29:03.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.441+0000 7fc00325b640 1 --2- 10.20.193.5:0/1625674153 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fbfcc079280 0x7fbfcc07b740 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:03.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.441+0000 7fc00325b640 1 --2- 10.20.193.5:0/1625674153 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbffc15e060 0x7fbffc1478f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:03.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.441+0000 7fc00325b640 1 --2- 10.20.193.5:0/1625674153 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fbffc0d1f40 0x7fbffc15b740 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:03.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.441+0000 7fc00325b640 1 --2- 10.20.193.5:0/1625674153 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fbffc0d1b60 0x7fbffc1f7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:03.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.441+0000 7fc00325b640 1 -- 10.20.193.5:0/1625674153 >> 10.20.193.5:0/1625674153 conn(0x7fbffc06d9b0 msgr2=0x7fbffc0d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:03.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.441+0000 7fc00325b640 1 -- 10.20.193.5:0/1625674153 shutdown_connections 2026-02-17T21:29:03.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.441+0000 7fc00325b640 1 -- 10.20.193.5:0/1625674153 wait complete. 2026-02-17T21:29:03.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:03.441+0000 7fc00325b640 1 librados: shutdown 2026-02-17T21:29:06.453 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:29:06.522 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.519+0000 7f1a3135b640 10 monclient: get_monmap_and_config 2026-02-17T21:29:06.522 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.519+0000 7f1a3135b640 10 monclient: build_initial_monmap 2026-02-17T21:29:06.522 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.519+0000 7f1a3135b640 10 monclient: monmap: 2026-02-17T21:29:06.522 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:06.522 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:06.523 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:29:06.521170+0000 2026-02-17T21:29:06.523 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:29:06.521170+0000 2026-02-17T21:29:06.523 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:06.523 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:06.523 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:29:06.523 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:29:06.523 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:29:06.523 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:29:06.523 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:29:06.523 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:29:06.523 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:06.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.519+0000 7f1a3135b640 1 Processor -- start 2026-02-17T21:29:06.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.519+0000 7f1a3135b640 1 -- start start 2026-02-17T21:29:06.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.519+0000 7f1a3135b640 10 monclient: init 2026-02-17T21:29:06.526 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.520+0000 7f1a3135b640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:06.526 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.520+0000 7f1a3135b640 10 monclient: _add_conns ranks=[5,2,1,4,0,3] 2026-02-17T21:29:06.526 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.520+0000 7f1a3135b640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f1a2c0c7170 0x7f1a2c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:06.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.520+0000 7f1a3135b640 10 monclient(hunting): picked mon.noname-c con 0x7f1a2c0c7170 addr v2:10.20.193.135:3300/0 2026-02-17T21:29:06.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.520+0000 7f1a3135b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1a2c0c48c0 addr v1:10.20.193.135:6789/0 2026-02-17T21:29:06.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.520+0000 7f1a3135b640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f1a2c0c4d10 addr v1:10.20.193.119:6789/0 2026-02-17T21:29:06.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.520+0000 7f1a3135b640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a2c15a9a0 con 0x7f1a2c0c4d10 2026-02-17T21:29:06.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.520+0000 7f1a3135b640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a2c0c5270 con 0x7f1a2c0c48c0 2026-02-17T21:29:06.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.520+0000 7f1a3135b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:06.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.520+0000 7f1a3135b640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f1a2c0c8530 con 0x7f1a2c0c7170 2026-02-17T21:29:06.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.520+0000 7f1a3135b640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:06.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.520+0000 7f1a3135b640 10 monclient(hunting): authenticate will time out at 1252.086470s 2026-02-17T21:29:06.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.520+0000 7f1a2affd640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f1a2c0c7170 0x7f1a2c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:06.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.520+0000 7f1a2b7fe640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f1a2c0c4d10 0x7f1a2c0c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:49036/0 (socket says 10.20.193.5:49036) 2026-02-17T21:29:06.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.520+0000 7f1a2b7fe640 1 -- 10.20.193.5:0/773032941 learned_addr learned my addr 10.20.193.5:0/773032941 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:29:06.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.521+0000 7f1a2affd640 10 monclient(hunting): get_auth_request con 0x7f1a2c0c7170 auth_method 0 2026-02-17T21:29:06.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.521+0000 7f1a2affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:06.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.521+0000 7f1a2affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:06.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.521+0000 7f1a2affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:06.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.521+0000 7f1a2affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:06.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.521+0000 7f1a2affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:06.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.521+0000 7f1a2affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:06.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.522+0000 7f1a29ffb640 1 -- 10.20.193.5:0/773032941 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4015999959 0 0) 0x7f1a2c15a9a0 con 0x7f1a2c0c4d10 2026-02-17T21:29:06.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.522+0000 7f1a29ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:29:06.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.522+0000 7f1a29ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:06.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.522+0000 7f1a29ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:06.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.522+0000 7f1a29ffb640 10 monclient(hunting): my global_id is 4987 2026-02-17T21:29:06.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.522+0000 7f1a29ffb640 1 -- 10.20.193.5:0/773032941 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a18003620 con 0x7f1a2c0c4d10 2026-02-17T21:29:06.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.522+0000 7f1a2affd640 10 monclient(hunting): handle_auth_done global_id 4979 payload 274 2026-02-17T21:29:06.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.522+0000 7f1a2affd640 1 -- 10.20.193.5:0/773032941 >> v1:10.20.193.135:6789/0 conn(0x7f1a2c0c48c0 legacy=0x7f1a2c0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:06.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.522+0000 7f1a2affd640 1 -- 10.20.193.5:0/773032941 >> v1:10.20.193.119:6789/0 conn(0x7f1a2c0c4d10 legacy=0x7f1a2c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:06.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.522+0000 7f1a2affd640 10 monclient: _finish_hunting 0 2026-02-17T21:29:06.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.522+0000 7f1a2affd640 1 monclient: found mon.noname-c 2026-02-17T21:29:06.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.522+0000 7f1a2affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:06.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.522+0000 7f1a2affd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:29:06.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.522+0000 7f1a2affd640 1 -- 10.20.193.5:0/773032941 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2c0c5550 con 0x7f1a2c0c7170 2026-02-17T21:29:06.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.525+0000 7f1a2affd640 1 --2- 10.20.193.5:0/773032941 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1a2c0c7170 0x7f1a2c0c7550 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1a200098a0 tx=0x7f1a2002ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c35d5da23fea4fb6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:06.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.526+0000 7f1a29ffb640 1 -- 10.20.193.5:0/773032941 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2003c070 con 0x7f1a2c0c7170 2026-02-17T21:29:06.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.526+0000 7f1a29ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:06.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.526+0000 7f1a29ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:29:06.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.526+0000 7f1a29ffb640 10 monclient: dump: 2026-02-17T21:29:06.535 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:06.535 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:06.535 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:06.536 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:06.536 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:06.536 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:06.536 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:06.536 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:06.536 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:06.536 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:06.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.526+0000 7f1a29ffb640 10 monclient: _finish_auth 0 2026-02-17T21:29:06.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.526+0000 7f1a29ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:29:06.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.526+0000 7f1a29ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:06.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.526+0000 7f1a29ffb640 1 -- 10.20.193.5:0/773032941 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a2002fb70 con 0x7f1a2c0c7170 2026-02-17T21:29:06.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.526+0000 7f1a29ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:06.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.526+0000 7f1a3135b640 5 monclient: authenticate success, global_id 4979 2026-02-17T21:29:06.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.526+0000 7f1a29ffb640 1 -- 10.20.193.5:0/773032941 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a20037440 con 0x7f1a2c0c7170 2026-02-17T21:29:06.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.526+0000 7f1a3135b640 10 monclient: get_monmap_and_config success 2026-02-17T21:29:06.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.526+0000 7f1a3135b640 4 set_mon_vals no callback set 2026-02-17T21:29:06.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.526+0000 7f1a29ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:06.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.526+0000 7f1a29ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:29:06.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.526+0000 7f1a29ffb640 10 monclient: dump: 2026-02-17T21:29:06.537 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:06.537 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:06.537 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:06.537 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:06.538 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:06.538 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:06.538 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:06.538 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:06.538 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:06.538 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:06.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.527+0000 7f1a3135b640 10 monclient: shutdown 2026-02-17T21:29:06.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.527+0000 7f1a3135b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:06.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.527+0000 7f1a3135b640 1 -- 10.20.193.5:0/773032941 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1a2c0c7170 msgr2=0x7f1a2c0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:06.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.527+0000 7f1a3135b640 1 --2- 10.20.193.5:0/773032941 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1a2c0c7170 0x7f1a2c0c7550 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1a200098a0 tx=0x7f1a2002ee60 comp rx=0 tx=0).stop 2026-02-17T21:29:06.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.527+0000 7f1a3135b640 1 -- 10.20.193.5:0/773032941 shutdown_connections 2026-02-17T21:29:06.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.527+0000 7f1a3135b640 1 --2- 10.20.193.5:0/773032941 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1a2c0c7170 0x7f1a2c0c7550 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:06.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.527+0000 7f1a3135b640 1 -- 10.20.193.5:0/773032941 >> 10.20.193.5:0/773032941 conn(0x7f1a2c0c9f40 msgr2=0x7f1a2c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:06.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.527+0000 7f1a3135b640 1 -- 10.20.193.5:0/773032941 shutdown_connections 2026-02-17T21:29:06.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.527+0000 7f1a3135b640 1 -- 10.20.193.5:0/773032941 wait complete. 2026-02-17T21:29:06.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.527+0000 7f1a3135b640 10 monclient: build_initial_monmap 2026-02-17T21:29:06.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.527+0000 7f1a3135b640 10 monclient: monmap: 2026-02-17T21:29:06.539 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:06.539 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:29:06.539 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:29:06.539 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:29:06.539 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:06.539 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:06.539 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:29:06.540 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:29:06.540 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:29:06.540 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:06.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.527+0000 7f1a3135b640 1 librados: starting msgr at 2026-02-17T21:29:06.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.527+0000 7f1a3135b640 1 librados: starting objecter 2026-02-17T21:29:06.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.527+0000 7f1a3135b640 1 Processor -- start 2026-02-17T21:29:06.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.527+0000 7f1a3135b640 1 -- start start 2026-02-17T21:29:06.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.527+0000 7f1a3135b640 1 librados: setting wanted keys 2026-02-17T21:29:06.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.527+0000 7f1a3135b640 1 librados: calling monclient init 2026-02-17T21:29:06.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.527+0000 7f1a3135b640 10 monclient: init 2026-02-17T21:29:06.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a3135b640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:06.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a3135b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:29:06.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a3135b640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1a2c0c48c0 0x7f1a2c06efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:06.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a3135b640 10 monclient(hunting): picked mon.noname-b con 0x7f1a2c0c48c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:29:06.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a3135b640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1a2c0c4d10 0x7f1a2c072c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:06.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a3135b640 10 monclient(hunting): picked mon.noname-c con 0x7f1a2c0c4d10 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:29:06.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a3135b640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1a2c0c7170 0x7f1a2c15aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:06.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a3135b640 10 monclient(hunting): picked mon.noname-a con 0x7f1a2c0c7170 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:29:06.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a3135b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:06.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a3135b640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c0c81c0 con 0x7f1a2c0c7170 2026-02-17T21:29:06.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a3135b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:06.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a3135b640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c0c7ee0 con 0x7f1a2c0c48c0 2026-02-17T21:29:06.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a3135b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:06.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a3135b640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c0750c0 con 0x7f1a2c0c4d10 2026-02-17T21:29:06.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a3135b640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:06.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a3135b640 10 monclient(hunting): authenticate will time out at 1252.094262s 2026-02-17T21:29:06.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a2a7fc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1a2c0c4d10 0x7f1a2c072c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:06.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a2b7fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1a2c0c7170 0x7f1a2c15aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:06.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a2affd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1a2c0c48c0 0x7f1a2c06efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:06.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a2a7fc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1a2c0c4d10 0x7f1a2c072c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:39912/0 (socket says 10.20.193.5:39912) 2026-02-17T21:29:06.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a2a7fc640 1 -- 10.20.193.5:0/1494807093 learned_addr learned my addr 10.20.193.5:0/1494807093 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:29:06.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a2a7fc640 10 monclient(hunting): get_auth_request con 0x7f1a2c0c4d10 auth_method 0 2026-02-17T21:29:06.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a2a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:06.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a2a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:06.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a2a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:06.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a2b7fe640 10 monclient(hunting): get_auth_request con 0x7f1a2c0c7170 auth_method 0 2026-02-17T21:29:06.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a2b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:06.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a2b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:06.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a2b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:06.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a2affd640 10 monclient(hunting): get_auth_request con 0x7f1a2c0c48c0 auth_method 0 2026-02-17T21:29:06.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a2affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:06.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a2affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:06.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a2affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:06.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a2a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:06.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a2a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:06.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.528+0000 7f1a2a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:06.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.529+0000 7f1a2b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:06.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.529+0000 7f1a2b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:06.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.529+0000 7f1a2b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:06.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.529+0000 7f1a2affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:06.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.529+0000 7f1a2affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:06.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.529+0000 7f1a2affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:06.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.530+0000 7f1a2a7fc640 10 monclient(hunting): handle_auth_done global_id 4985 payload 824 2026-02-17T21:29:06.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.530+0000 7f1a2a7fc640 1 -- 10.20.193.5:0/1494807093 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1a2c0c48c0 msgr2=0x7f1a2c06efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:06.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.530+0000 7f1a2a7fc640 1 --2- 10.20.193.5:0/1494807093 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1a2c0c48c0 0x7f1a2c06efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:06.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.530+0000 7f1a2a7fc640 1 -- 10.20.193.5:0/1494807093 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1a2c0c7170 msgr2=0x7f1a2c15aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:06.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.530+0000 7f1a2a7fc640 1 --2- 10.20.193.5:0/1494807093 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1a2c0c7170 0x7f1a2c15aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:06.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.530+0000 7f1a2a7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:29:06.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.530+0000 7f1a2a7fc640 1 monclient: found mon.noname-c 2026-02-17T21:29:06.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.530+0000 7f1a2a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:06.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.530+0000 7f1a2a7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:29:06.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.530+0000 7f1a2a7fc640 1 -- 10.20.193.5:0/1494807093 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2c1f7870 con 0x7f1a2c0c4d10 2026-02-17T21:29:06.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.531+0000 7f1a2a7fc640 1 --2- 10.20.193.5:0/1494807093 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1a2c0c4d10 0x7f1a2c072c30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1a1400c700 tx=0x7f1a1400cbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:06.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.531+0000 7f1a0b7fe640 10 client.?.objecter ms_handle_connect 0x7f1a2c0c4d10 2026-02-17T21:29:06.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.531+0000 7f1a0b7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:29:06.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a0b7fe640 1 -- 10.20.193.5:0/1494807093 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a140052d0 con 0x7f1a2c0c4d10 2026-02-17T21:29:06.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:06.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a0b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:29:06.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a0b7fe640 10 monclient: dump: 2026-02-17T21:29:06.547 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:06.547 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:06.547 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:06.547 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:06.548 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:06.548 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:06.548 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:06.548 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:06.548 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:06.548 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:06.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a0b7fe640 10 monclient: _finish_auth 0 2026-02-17T21:29:06.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a0b7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:29:06.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a0b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:06.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a0b7fe640 1 -- 10.20.193.5:0/1494807093 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a14005470 con 0x7f1a2c0c4d10 2026-02-17T21:29:06.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a3135b640 5 monclient: authenticate success, global_id 4985 2026-02-17T21:29:06.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a3135b640 10 monclient: _renew_subs 2026-02-17T21:29:06.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a3135b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:29:06.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a3135b640 1 -- 10.20.193.5:0/1494807093 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a2c1f37d0 con 0x7f1a2c0c4d10 2026-02-17T21:29:06.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a0b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:06.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a0b7fe640 1 -- 10.20.193.5:0/1494807093 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1400a860 con 0x7f1a2c0c4d10 2026-02-17T21:29:06.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:06.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a0b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:29:06.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a0b7fe640 10 monclient: dump: 2026-02-17T21:29:06.549 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:06.549 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:06.549 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:06.550 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:06.550 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:06.550 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:06.550 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:06.550 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:06.550 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:06.550 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:06.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a297fa640 4 set_mon_vals no callback set 2026-02-17T21:29:06.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a3135b640 10 client.4985.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:29:06.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a3135b640 10 monclient: _renew_subs 2026-02-17T21:29:06.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a3135b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:29:06.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a3135b640 1 -- 10.20.193.5:0/1494807093 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a2c1f3d90 con 0x7f1a2c0c4d10 2026-02-17T21:29:06.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a3135b640 1 librados: init done 2026-02-17T21:29:06.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a3135b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:06.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a3135b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:06.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a3135b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:29:06.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.533+0000 7f1a3135b640 1 -- 10.20.193.5:0/1494807093 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a2c0c7550 con 0x7f1a2c0c4d10 2026-02-17T21:29:06.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.544+0000 7f1a0b7fe640 1 -- 10.20.193.5:0/1494807093 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f1a1400aa00 con 0x7f1a2c0c4d10 2026-02-17T21:29:06.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.545+0000 7f1a0b7fe640 1 --2- 10.20.193.5:0/1494807093 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f19f8079280 0x7f19f807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:06.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.545+0000 7f1a2affd640 1 --2- 10.20.193.5:0/1494807093 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f19f8079280 0x7f19f807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:06.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.545+0000 7f1a2affd640 10 monclient: get_auth_request con 0x7f19f8079280 auth_method 0 2026-02-17T21:29:06.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.546+0000 7f1a0b7fe640 10 client.4985.objecter ms_handle_connect 0x7f19f8079280 2026-02-17T21:29:06.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.546+0000 7f1a2affd640 1 --2- 10.20.193.5:0/1494807093 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f19f8079280 0x7f19f807b740 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1a20039000 tx=0x7f1a20033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:06.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.547+0000 7f1a0b7fe640 1 -- 10.20.193.5:0/1494807093 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f1a1400ad20 con 0x7f1a2c0c4d10 2026-02-17T21:29:06.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.547+0000 7f1a0b7fe640 10 client.4985.objecter ms_dispatch2 0x7f1a2c000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:29:06.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.547+0000 7f1a0b7fe640 3 client.4985.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:29:06.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.547+0000 7f1a0b7fe640 3 client.4985.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:29:06.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.547+0000 7f1a0b7fe640 20 client.4985.objecter dump_active .. 0 homeless 2026-02-17T21:29:06.650 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.648+0000 7f1a0b7fe640 1 -- 10.20.193.5:0/1494807093 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1a14097e20 con 0x7f1a2c0c4d10 2026-02-17T21:29:06.650 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.648+0000 7f1a0b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:06.650 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.648+0000 7f1a0b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:29:06.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.747+0000 7f1a3135b640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:29:06.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.747+0000 7f1a3135b640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:06.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.747+0000 7f1a3135b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:29:06.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.747+0000 7f1a3135b640 1 -- 10.20.193.5:0/1494807093 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1a2c14ed60 con 0x7f1a2c0c4d10 2026-02-17T21:29:06.752 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.750+0000 7f1a0b7fe640 1 -- 10.20.193.5:0/1494807093 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f1a140623b0 con 0x7f1a2c0c4d10 2026-02-17T21:29:06.752 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.750+0000 7f1a0b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:06.752 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.750+0000 7f1a0b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:29:06.752 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:29:06.752 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:29:06.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.751+0000 7f1a3135b640 10 librados: watch_flush enter 2026-02-17T21:29:06.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.751+0000 7f1a3135b640 10 librados: watch_flush exit 2026-02-17T21:29:06.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.751+0000 7f1a3135b640 20 client.4985.objecter shutdown clearing up homeless session... 2026-02-17T21:29:06.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.751+0000 7f1a3135b640 10 client.4985.objecter successfully canceled tick 2026-02-17T21:29:06.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.751+0000 7f1a3135b640 1 -- 10.20.193.5:0/1494807093 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f19f8079280 msgr2=0x7f19f807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:06.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.751+0000 7f1a3135b640 1 --2- 10.20.193.5:0/1494807093 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f19f8079280 0x7f19f807b740 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1a20039000 tx=0x7f1a20033000 comp rx=0 tx=0).stop 2026-02-17T21:29:06.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.751+0000 7f1a3135b640 10 monclient: shutdown 2026-02-17T21:29:06.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.751+0000 7f1a3135b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:06.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.751+0000 7f1a3135b640 1 -- 10.20.193.5:0/1494807093 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1a2c0c4d10 msgr2=0x7f1a2c072c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:06.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.751+0000 7f1a3135b640 1 --2- 10.20.193.5:0/1494807093 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1a2c0c4d10 0x7f1a2c072c30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1a1400c700 tx=0x7f1a1400cbd0 comp rx=0 tx=0).stop 2026-02-17T21:29:06.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.751+0000 7f1a3135b640 1 -- 10.20.193.5:0/1494807093 shutdown_connections 2026-02-17T21:29:06.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.751+0000 7f1a3135b640 1 --2- 10.20.193.5:0/1494807093 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f19f8079280 0x7f19f807b740 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:06.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.751+0000 7f1a3135b640 1 --2- 10.20.193.5:0/1494807093 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1a2c0c7170 0x7f1a2c15aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:06.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.751+0000 7f1a3135b640 1 --2- 10.20.193.5:0/1494807093 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1a2c0c4d10 0x7f1a2c072c30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:06.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.751+0000 7f1a3135b640 1 --2- 10.20.193.5:0/1494807093 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1a2c0c48c0 0x7f1a2c06efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:06.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.751+0000 7f1a3135b640 1 -- 10.20.193.5:0/1494807093 >> 10.20.193.5:0/1494807093 conn(0x7f1a2c0c9f40 msgr2=0x7f1a2c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:06.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.751+0000 7f1a3135b640 1 -- 10.20.193.5:0/1494807093 shutdown_connections 2026-02-17T21:29:06.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.751+0000 7f1a3135b640 1 -- 10.20.193.5:0/1494807093 wait complete. 2026-02-17T21:29:06.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:06.751+0000 7f1a3135b640 1 librados: shutdown 2026-02-17T21:29:09.762 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:29:09.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.826+0000 7fae8ed48640 10 monclient: get_monmap_and_config 2026-02-17T21:29:09.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.826+0000 7fae8ed48640 10 monclient: build_initial_monmap 2026-02-17T21:29:09.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.826+0000 7fae8ed48640 10 monclient: monmap: 2026-02-17T21:29:09.830 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:09.830 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:09.830 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:29:09.828489+0000 2026-02-17T21:29:09.830 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:29:09.828489+0000 2026-02-17T21:29:09.830 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:09.830 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:09.830 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:29:09.830 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:29:09.831 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:29:09.831 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:29:09.831 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:29:09.831 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:29:09.831 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:09.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.827+0000 7fae8ed48640 1 Processor -- start 2026-02-17T21:29:09.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.827+0000 7fae8ed48640 1 -- start start 2026-02-17T21:29:09.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.827+0000 7fae8ed48640 10 monclient: init 2026-02-17T21:29:09.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.828+0000 7fae8ed48640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:09.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.828+0000 7fae8ed48640 10 monclient: _add_conns ranks=[0,1,3,2,5,4] 2026-02-17T21:29:09.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.828+0000 7fae8ed48640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fae8815d370 addr v1:10.20.193.5:6789/0 2026-02-17T21:29:09.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.828+0000 7fae8ed48640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fae880c7e20 addr v1:10.20.193.119:6789/0 2026-02-17T21:29:09.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.828+0000 7fae8ed48640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fae880c59c0 0x7fae8815d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:09.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.828+0000 7fae8ed48640 10 monclient(hunting): picked mon.noname-a con 0x7fae880c59c0 addr v2:10.20.193.5:3300/0 2026-02-17T21:29:09.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.828+0000 7fae8ed48640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae880c8350 con 0x7fae8815d370 2026-02-17T21:29:09.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.828+0000 7fae8ed48640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae880c8630 con 0x7fae880c7e20 2026-02-17T21:29:09.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.828+0000 7fae8ed48640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:09.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.828+0000 7fae8ed48640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fae8815b710 con 0x7fae880c59c0 2026-02-17T21:29:09.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.828+0000 7fae8ed48640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:09.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.828+0000 7fae8ed48640 10 monclient(hunting): authenticate will time out at 1255.394108s 2026-02-17T21:29:09.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.828+0000 7fae7ffff640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7fae880c7e20 0x7fae880c52b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:51172/0 (socket says 10.20.193.5:51172) 2026-02-17T21:29:09.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.828+0000 7fae7ffff640 1 -- 10.20.193.5:0/2612495530 learned_addr learned my addr 10.20.193.5:0/2612495530 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:29:09.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.828+0000 7fae8d2be640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fae880c59c0 0x7fae8815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:09.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.828+0000 7fae8d2be640 10 monclient(hunting): get_auth_request con 0x7fae880c59c0 auth_method 0 2026-02-17T21:29:09.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.828+0000 7fae8d2be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:09.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.828+0000 7fae8d2be640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:09.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.828+0000 7fae8d2be640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:09.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.829+0000 7fae8d2be640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:09.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.829+0000 7fae8d2be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:09.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.829+0000 7fae8d2be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:09.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.829+0000 7fae7f7fe640 1 -- 10.20.193.5:0/2612495530 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4238350106 0 0) 0x7fae880c8630 con 0x7fae880c7e20 2026-02-17T21:29:09.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.829+0000 7fae7f7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:29:09.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.829+0000 7fae7f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:09.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.829+0000 7fae7f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:09.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.829+0000 7fae7f7fe640 10 monclient(hunting): my global_id is 4993 2026-02-17T21:29:09.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.829+0000 7fae7f7fe640 1 -- 10.20.193.5:0/2612495530 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae74003620 con 0x7fae880c7e20 2026-02-17T21:29:09.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.831+0000 7fae8d2be640 10 monclient(hunting): handle_auth_done global_id 4941 payload 274 2026-02-17T21:29:09.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.831+0000 7fae8d2be640 1 -- 10.20.193.5:0/2612495530 >> v1:10.20.193.119:6789/0 conn(0x7fae880c7e20 legacy=0x7fae880c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:09.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.831+0000 7fae8d2be640 1 -- 10.20.193.5:0/2612495530 >> v1:10.20.193.5:6789/0 conn(0x7fae8815d370 legacy=0x7fae8815b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:09.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.831+0000 7fae8d2be640 10 monclient: _finish_hunting 0 2026-02-17T21:29:09.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.831+0000 7fae8d2be640 1 monclient: found mon.noname-a 2026-02-17T21:29:09.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.831+0000 7fae8d2be640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:09.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.831+0000 7fae8d2be640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:29:09.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.831+0000 7fae8d2be640 1 -- 10.20.193.5:0/2612495530 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae880c8910 con 0x7fae880c59c0 2026-02-17T21:29:09.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.832+0000 7fae8d2be640 1 --2- 10.20.193.5:0/2612495530 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fae880c59c0 0x7fae8815d750 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fae84009d90 tx=0x7fae8402f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47354fcbdd3f82f6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:09.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.834+0000 7fae7f7fe640 1 -- 10.20.193.5:0/2612495530 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8403c070 con 0x7fae880c59c0 2026-02-17T21:29:09.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.834+0000 7fae7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:09.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.834+0000 7fae7f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:29:09.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.834+0000 7fae7f7fe640 10 monclient: dump: 2026-02-17T21:29:09.843 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:09.843 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:09.843 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:09.843 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:09.843 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:09.843 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:09.843 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:09.843 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:09.843 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:09.843 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:09.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.834+0000 7fae7f7fe640 10 monclient: _finish_auth 0 2026-02-17T21:29:09.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.834+0000 7fae7f7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:29:09.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.834+0000 7fae7f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:09.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.834+0000 7fae8ed48640 5 monclient: authenticate success, global_id 4941 2026-02-17T21:29:09.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.834+0000 7fae7f7fe640 1 -- 10.20.193.5:0/2612495530 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae84037440 con 0x7fae880c59c0 2026-02-17T21:29:09.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.834+0000 7fae8ed48640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:29:09.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.834+0000 7fae7f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:09.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.834+0000 7fae7f7fe640 1 -- 10.20.193.5:0/2612495530 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae84037810 con 0x7fae880c59c0 2026-02-17T21:29:09.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.834+0000 7fae8ed48640 10 monclient: get_monmap_and_config success 2026-02-17T21:29:09.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.834+0000 7fae8ed48640 4 set_mon_vals no callback set 2026-02-17T21:29:09.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.834+0000 7fae7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:09.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.834+0000 7fae7f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:29:09.845 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.834+0000 7fae7f7fe640 10 monclient: dump: 2026-02-17T21:29:09.845 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:09.845 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:09.845 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:09.845 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:09.845 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:09.845 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:09.845 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:09.845 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:09.845 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:09.845 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:09.845 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.835+0000 7fae8ed48640 10 monclient: shutdown 2026-02-17T21:29:09.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.835+0000 7fae8ed48640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:09.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.835+0000 7fae8ed48640 1 -- 10.20.193.5:0/2612495530 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fae880c59c0 msgr2=0x7fae8815d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:09.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.835+0000 7fae8ed48640 1 --2- 10.20.193.5:0/2612495530 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fae880c59c0 0x7fae8815d750 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fae84009d90 tx=0x7fae8402f230 comp rx=0 tx=0).stop 2026-02-17T21:29:09.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.835+0000 7fae8ed48640 1 -- 10.20.193.5:0/2612495530 shutdown_connections 2026-02-17T21:29:09.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.835+0000 7fae8ed48640 1 --2- 10.20.193.5:0/2612495530 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fae880c59c0 0x7fae8815d750 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:09.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.835+0000 7fae8ed48640 1 -- 10.20.193.5:0/2612495530 >> 10.20.193.5:0/2612495530 conn(0x7fae880c9f20 msgr2=0x7fae880ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:09.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.835+0000 7fae8ed48640 1 -- 10.20.193.5:0/2612495530 shutdown_connections 2026-02-17T21:29:09.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.835+0000 7fae8ed48640 1 -- 10.20.193.5:0/2612495530 wait complete. 2026-02-17T21:29:09.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.835+0000 7fae8ed48640 10 monclient: build_initial_monmap 2026-02-17T21:29:09.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.835+0000 7fae8ed48640 10 monclient: monmap: 2026-02-17T21:29:09.846 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:09.847 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:29:09.847 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:29:09.847 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:29:09.847 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:09.847 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:09.847 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:29:09.847 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:29:09.847 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:29:09.847 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:09.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.835+0000 7fae8ed48640 1 librados: starting msgr at 2026-02-17T21:29:09.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.835+0000 7fae8ed48640 1 librados: starting objecter 2026-02-17T21:29:09.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.835+0000 7fae8ed48640 1 Processor -- start 2026-02-17T21:29:09.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.835+0000 7fae8ed48640 1 -- start start 2026-02-17T21:29:09.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.835+0000 7fae8ed48640 1 librados: setting wanted keys 2026-02-17T21:29:09.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.835+0000 7fae8ed48640 1 librados: calling monclient init 2026-02-17T21:29:09.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.835+0000 7fae8ed48640 10 monclient: init 2026-02-17T21:29:09.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae8ed48640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:09.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae8ed48640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:29:09.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae8ed48640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fae880c59c0 0x7fae8806ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:09.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae8ed48640 10 monclient(hunting): picked mon.noname-a con 0x7fae880c59c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:29:09.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae8ed48640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fae880c7e20 0x7fae8806d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:09.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae8ed48640 10 monclient(hunting): picked mon.noname-c con 0x7fae880c7e20 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:29:09.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae8ed48640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fae8815d370 0x7fae8806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:09.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae8ed48640 10 monclient(hunting): picked mon.noname-b con 0x7fae8815d370 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:29:09.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae8ed48640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:09.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae8ed48640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fae880c8ed0 con 0x7fae880c59c0 2026-02-17T21:29:09.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae8ed48640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:09.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae8ed48640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fae880c9240 con 0x7fae8815d370 2026-02-17T21:29:09.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae8ed48640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:09.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae8ed48640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fae880c96d0 con 0x7fae880c7e20 2026-02-17T21:29:09.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae8ed48640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:09.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae8ed48640 10 monclient(hunting): authenticate will time out at 1255.402389s 2026-02-17T21:29:09.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae8cabd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fae880c59c0 0x7fae8806ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:09.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae8cabd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fae880c59c0 0x7fae8806ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:32786/0 (socket says 10.20.193.5:32786) 2026-02-17T21:29:09.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae8cabd640 1 -- 10.20.193.5:0/438529867 learned_addr learned my addr 10.20.193.5:0/438529867 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:29:09.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae8cabd640 10 monclient(hunting): get_auth_request con 0x7fae880c59c0 auth_method 0 2026-02-17T21:29:09.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae8cabd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:09.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae8cabd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:09.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae8cabd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:09.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae7ffff640 1 --2- 10.20.193.5:0/438529867 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fae880c7e20 0x7fae8806d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:09.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae8cabd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:09.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.836+0000 7fae8cabd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:09.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.837+0000 7fae8cabd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:09.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.837+0000 7fae7ffff640 10 monclient(hunting): get_auth_request con 0x7fae880c7e20 auth_method 0 2026-02-17T21:29:09.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.837+0000 7fae7ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:09.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.837+0000 7fae7ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:09.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.837+0000 7fae7ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:09.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.837+0000 7fae8d2be640 1 --2- 10.20.193.5:0/438529867 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fae8815d370 0x7fae8806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:09.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.837+0000 7fae7ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:09.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.837+0000 7fae7ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:09.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.837+0000 7fae7ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:09.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.837+0000 7fae8d2be640 10 monclient(hunting): get_auth_request con 0x7fae8815d370 auth_method 0 2026-02-17T21:29:09.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.837+0000 7fae8d2be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:09.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.837+0000 7fae8d2be640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:09.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.837+0000 7fae8d2be640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:09.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.837+0000 7fae8d2be640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:09.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.837+0000 7fae8d2be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:09.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.837+0000 7fae8d2be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:09.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.838+0000 7fae8cabd640 10 monclient(hunting): handle_auth_done global_id 4947 payload 824 2026-02-17T21:29:09.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.838+0000 7fae8cabd640 1 -- 10.20.193.5:0/438529867 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fae880c7e20 msgr2=0x7fae8806d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:09.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.838+0000 7fae8cabd640 1 --2- 10.20.193.5:0/438529867 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fae880c7e20 0x7fae8806d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:09.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.838+0000 7fae8cabd640 1 -- 10.20.193.5:0/438529867 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fae8815d370 msgr2=0x7fae8806dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:09.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.838+0000 7fae8cabd640 1 --2- 10.20.193.5:0/438529867 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fae8815d370 0x7fae8806dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:09.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.838+0000 7fae8cabd640 10 monclient: _finish_hunting 0 2026-02-17T21:29:09.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.838+0000 7fae8cabd640 1 monclient: found mon.noname-a 2026-02-17T21:29:09.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.838+0000 7fae8cabd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:09.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.838+0000 7fae8cabd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:29:09.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.838+0000 7fae8cabd640 1 -- 10.20.193.5:0/438529867 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae88073cf0 con 0x7fae880c59c0 2026-02-17T21:29:09.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.839+0000 7fae8cabd640 1 --2- 10.20.193.5:0/438529867 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fae880c59c0 0x7fae8806ecc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fae7800c730 tx=0x7fae7800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:09.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.839+0000 7fae7d7fa640 10 client.?.objecter ms_handle_connect 0x7fae880c59c0 2026-02-17T21:29:09.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.839+0000 7fae7d7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:29:09.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae7d7fa640 1 -- 10.20.193.5:0/438529867 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae780052d0 con 0x7fae880c59c0 2026-02-17T21:29:09.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae7d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:09.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae7d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:29:09.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae7d7fa640 10 monclient: dump: 2026-02-17T21:29:09.855 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:09.855 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:09.855 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:09.855 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:09.855 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:09.855 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:09.855 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:09.855 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:09.855 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:09.856 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:09.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae7d7fa640 10 monclient: _finish_auth 0 2026-02-17T21:29:09.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae7d7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:29:09.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae7d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:09.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae7d7fa640 1 -- 10.20.193.5:0/438529867 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae78005470 con 0x7fae880c59c0 2026-02-17T21:29:09.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae8ed48640 5 monclient: authenticate success, global_id 4947 2026-02-17T21:29:09.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae8ed48640 10 monclient: _renew_subs 2026-02-17T21:29:09.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae8ed48640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:09.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae8ed48640 1 -- 10.20.193.5:0/438529867 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae88073fd0 con 0x7fae880c59c0 2026-02-17T21:29:09.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae7d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:09.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae7d7fa640 1 -- 10.20.193.5:0/438529867 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae780038d0 con 0x7fae880c59c0 2026-02-17T21:29:09.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae7d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:09.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae7effd640 4 set_mon_vals no callback set 2026-02-17T21:29:09.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae7d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:29:09.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae7d7fa640 10 monclient: dump: 2026-02-17T21:29:09.857 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:09.857 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:09.857 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:09.857 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:09.857 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:09.857 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:09.857 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:09.857 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:09.857 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:09.858 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:09.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae8ed48640 10 client.4947.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:29:09.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae8ed48640 10 monclient: _renew_subs 2026-02-17T21:29:09.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae8ed48640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:09.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae8ed48640 1 -- 10.20.193.5:0/438529867 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae88074590 con 0x7fae880c59c0 2026-02-17T21:29:09.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae8ed48640 1 librados: init done 2026-02-17T21:29:09.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae8ed48640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:09.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae8ed48640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:09.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae8ed48640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:09.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.841+0000 7fae8ed48640 1 -- 10.20.193.5:0/438529867 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae8815d750 con 0x7fae880c59c0 2026-02-17T21:29:09.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.854+0000 7fae7d7fa640 1 -- 10.20.193.5:0/438529867 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fae78003a70 con 0x7fae880c59c0 2026-02-17T21:29:09.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.854+0000 7fae7d7fa640 1 --2- 10.20.193.5:0/438529867 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fae58079280 0x7fae5807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:09.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.854+0000 7fae7ffff640 1 --2- 10.20.193.5:0/438529867 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fae58079280 0x7fae5807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:09.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.854+0000 7fae7ffff640 10 monclient: get_auth_request con 0x7fae58079280 auth_method 0 2026-02-17T21:29:09.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.855+0000 7fae7d7fa640 10 client.4947.objecter ms_handle_connect 0x7fae58079280 2026-02-17T21:29:09.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.855+0000 7fae7ffff640 1 --2- 10.20.193.5:0/438529867 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fae58079280 0x7fae5807b740 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fae70007b60 tx=0x7fae70007ab0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:09.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.958+0000 7fae7d7fa640 1 -- 10.20.193.5:0/438529867 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fae7805e440 con 0x7fae880c59c0 2026-02-17T21:29:09.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.958+0000 7fae7d7fa640 10 client.4947.objecter ms_dispatch2 0x7fae88000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:29:09.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.958+0000 7fae7d7fa640 3 client.4947.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:29:09.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.958+0000 7fae7d7fa640 3 client.4947.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:29:09.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.958+0000 7fae7d7fa640 20 client.4947.objecter dump_active .. 0 homeless 2026-02-17T21:29:09.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.958+0000 7fae7d7fa640 1 -- 10.20.193.5:0/438529867 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fae78062400 con 0x7fae880c59c0 2026-02-17T21:29:09.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.958+0000 7fae7d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:09.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:09.958+0000 7fae7d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:29:10.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.061+0000 7fae8ed48640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:29:10.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.061+0000 7fae8ed48640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:10.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.061+0000 7fae8ed48640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:10.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.061+0000 7fae8ed48640 1 -- 10.20.193.5:0/438529867 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fae8814f990 con 0x7fae880c59c0 2026-02-17T21:29:10.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.063+0000 7fae7d7fa640 1 -- 10.20.193.5:0/438529867 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fae78066700 con 0x7fae880c59c0 2026-02-17T21:29:10.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.063+0000 7fae7d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:10.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.063+0000 7fae7d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:29:10.066 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:29:10.066 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:29:10.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.065+0000 7fae8ed48640 10 librados: watch_flush enter 2026-02-17T21:29:10.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.065+0000 7fae8ed48640 10 librados: watch_flush exit 2026-02-17T21:29:10.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.065+0000 7fae8ed48640 20 client.4947.objecter shutdown clearing up homeless session... 2026-02-17T21:29:10.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.065+0000 7fae8ed48640 10 client.4947.objecter successfully canceled tick 2026-02-17T21:29:10.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.065+0000 7fae8ed48640 1 -- 10.20.193.5:0/438529867 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fae58079280 msgr2=0x7fae5807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:10.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.065+0000 7fae8ed48640 1 --2- 10.20.193.5:0/438529867 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fae58079280 0x7fae5807b740 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fae70007b60 tx=0x7fae70007ab0 comp rx=0 tx=0).stop 2026-02-17T21:29:10.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.065+0000 7fae8ed48640 10 monclient: shutdown 2026-02-17T21:29:10.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.065+0000 7fae8ed48640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:10.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.065+0000 7fae8ed48640 1 -- 10.20.193.5:0/438529867 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fae880c59c0 msgr2=0x7fae8806ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:10.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.065+0000 7fae8ed48640 1 --2- 10.20.193.5:0/438529867 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fae880c59c0 0x7fae8806ecc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fae7800c730 tx=0x7fae7800cc00 comp rx=0 tx=0).stop 2026-02-17T21:29:10.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.065+0000 7fae8ed48640 1 -- 10.20.193.5:0/438529867 shutdown_connections 2026-02-17T21:29:10.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.065+0000 7fae8ed48640 1 --2- 10.20.193.5:0/438529867 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fae58079280 0x7fae5807b740 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:10.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.065+0000 7fae8ed48640 1 --2- 10.20.193.5:0/438529867 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fae8815d370 0x7fae8806dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:10.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.065+0000 7fae8ed48640 1 --2- 10.20.193.5:0/438529867 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fae880c7e20 0x7fae8806d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:10.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.065+0000 7fae8ed48640 1 --2- 10.20.193.5:0/438529867 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fae880c59c0 0x7fae8806ecc0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:10.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.065+0000 7fae8ed48640 1 -- 10.20.193.5:0/438529867 >> 10.20.193.5:0/438529867 conn(0x7fae880c9f20 msgr2=0x7fae880ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:10.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.065+0000 7fae8ed48640 1 -- 10.20.193.5:0/438529867 shutdown_connections 2026-02-17T21:29:10.070 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.065+0000 7fae8ed48640 1 -- 10.20.193.5:0/438529867 wait complete. 2026-02-17T21:29:10.070 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:10.065+0000 7fae8ed48640 1 librados: shutdown 2026-02-17T21:29:13.077 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:29:13.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.146+0000 7f542afed640 10 monclient: get_monmap_and_config 2026-02-17T21:29:13.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.146+0000 7f542afed640 10 monclient: build_initial_monmap 2026-02-17T21:29:13.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.146+0000 7f542afed640 10 monclient: monmap: 2026-02-17T21:29:13.149 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:13.149 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:13.149 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:29:13.148022+0000 2026-02-17T21:29:13.149 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:29:13.148022+0000 2026-02-17T21:29:13.150 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:13.150 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:13.150 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:29:13.150 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:29:13.150 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:29:13.150 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:29:13.150 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:29:13.150 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:29:13.150 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:13.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.146+0000 7f542afed640 1 Processor -- start 2026-02-17T21:29:13.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.146+0000 7f542afed640 1 -- start start 2026-02-17T21:29:13.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.146+0000 7f542afed640 10 monclient: init 2026-02-17T21:29:13.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.147+0000 7f542afed640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:13.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.147+0000 7f542afed640 10 monclient: _add_conns ranks=[3,0,5,1,4,2] 2026-02-17T21:29:13.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.147+0000 7f542afed640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f54240c7170 0x7f54240c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:13.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.147+0000 7f542afed640 10 monclient(hunting): picked mon.noname-a con 0x7f54240c7170 addr v2:10.20.193.5:3300/0 2026-02-17T21:29:13.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.147+0000 7f542afed640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f54240c48c0 addr v1:10.20.193.5:6789/0 2026-02-17T21:29:13.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.147+0000 7f542afed640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f54240c4d10 0x7f54240c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:13.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.147+0000 7f542afed640 10 monclient(hunting): picked mon.noname-c con 0x7f54240c4d10 addr v2:10.20.193.135:3300/0 2026-02-17T21:29:13.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.147+0000 7f542afed640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f542415a9a0 con 0x7f54240c48c0 2026-02-17T21:29:13.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.147+0000 7f542afed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:13.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.147+0000 7f542afed640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f54240c8530 con 0x7f54240c7170 2026-02-17T21:29:13.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.147+0000 7f542afed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:13.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.147+0000 7f542afed640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f54240c5270 con 0x7f54240c4d10 2026-02-17T21:29:13.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.147+0000 7f542afed640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:13.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.147+0000 7f542afed640 10 monclient(hunting): authenticate will time out at 1258.713323s 2026-02-17T21:29:13.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.147+0000 7f5428d62640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f54240c7170 0x7f54240c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:13.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.147+0000 7f5429563640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f54240c4d10 0x7f54240c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:13.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.148+0000 7f5428d62640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f54240c7170 0x7f54240c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:32802/0 (socket says 10.20.193.5:32802) 2026-02-17T21:29:13.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.148+0000 7f5428d62640 1 -- 10.20.193.5:0/3335704194 learned_addr learned my addr 10.20.193.5:0/3335704194 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:29:13.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.148+0000 7f5429563640 10 monclient(hunting): get_auth_request con 0x7f54240c4d10 auth_method 0 2026-02-17T21:29:13.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.148+0000 7f5429563640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:13.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.148+0000 7f5429563640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:13.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.148+0000 7f5429563640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:13.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.148+0000 7f5428d62640 10 monclient(hunting): get_auth_request con 0x7f54240c7170 auth_method 0 2026-02-17T21:29:13.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.148+0000 7f5428d62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:13.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.148+0000 7f5428d62640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:13.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.148+0000 7f5428d62640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:13.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.148+0000 7f5428d62640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:13.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.148+0000 7f5428d62640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:13.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.148+0000 7f5428d62640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:13.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.148+0000 7f5429563640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:13.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.148+0000 7f5429563640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:13.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.148+0000 7f5429563640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:13.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.149+0000 7f5429563640 10 monclient(hunting): handle_auth_done global_id 4991 payload 274 2026-02-17T21:29:13.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.149+0000 7f5429563640 1 -- 10.20.193.5:0/3335704194 >> v2:10.20.193.5:3300/0 conn(0x7f54240c7170 msgr2=0x7f54240c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:29:13.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.149+0000 7f5429563640 1 --2- 10.20.193.5:0/3335704194 >> v2:10.20.193.5:3300/0 conn(0x7f54240c7170 0x7f54240c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:13.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.149+0000 7f5429563640 1 -- 10.20.193.5:0/3335704194 >> v1:10.20.193.5:6789/0 conn(0x7f54240c48c0 legacy=0x7f54240749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:13.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.149+0000 7f5429563640 10 monclient: _finish_hunting 0 2026-02-17T21:29:13.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.149+0000 7f5429563640 1 monclient: found mon.noname-c 2026-02-17T21:29:13.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.149+0000 7f5429563640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:13.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.149+0000 7f5429563640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:29:13.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.149+0000 7f5429563640 1 -- 10.20.193.5:0/3335704194 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54240c5550 con 0x7f54240c4d10 2026-02-17T21:29:13.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.150+0000 7f5429563640 1 --2- 10.20.193.5:0/3335704194 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f54240c4d10 0x7f54240c89c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f54240c6e90 tx=0x7f542002f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5b9881b184a841c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:13.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f541b7fe640 1 -- 10.20.193.5:0/3335704194 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542003c070 con 0x7f54240c4d10 2026-02-17T21:29:13.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f541b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:13.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f541b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:29:13.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f541b7fe640 10 monclient: dump: 2026-02-17T21:29:13.163 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:13.163 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:13.164 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:13.164 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:13.164 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:13.164 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:13.164 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:13.164 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:13.164 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:13.164 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:13.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f541b7fe640 10 monclient: _finish_auth 0 2026-02-17T21:29:13.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f541b7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:29:13.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f541b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:13.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f542afed640 5 monclient: authenticate success, global_id 4991 2026-02-17T21:29:13.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f542afed640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:29:13.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f541b7fe640 1 -- 10.20.193.5:0/3335704194 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5420037440 con 0x7f54240c4d10 2026-02-17T21:29:13.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f541b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:13.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f541b7fe640 1 -- 10.20.193.5:0/3335704194 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5420037810 con 0x7f54240c4d10 2026-02-17T21:29:13.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f541b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:13.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f541b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:29:13.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f541b7fe640 10 monclient: dump: 2026-02-17T21:29:13.165 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:13.165 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:13.165 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:13.165 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:13.165 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:13.166 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:13.166 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:13.166 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:13.166 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:13.166 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:13.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f542afed640 10 monclient: get_monmap_and_config success 2026-02-17T21:29:13.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f542afed640 4 set_mon_vals no callback set 2026-02-17T21:29:13.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f542afed640 10 monclient: shutdown 2026-02-17T21:29:13.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f542afed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:13.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f542afed640 1 -- 10.20.193.5:0/3335704194 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f54240c4d10 msgr2=0x7f54240c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:13.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f542afed640 1 --2- 10.20.193.5:0/3335704194 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f54240c4d10 0x7f54240c89c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f54240c6e90 tx=0x7f542002f1c0 comp rx=0 tx=0).stop 2026-02-17T21:29:13.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f542afed640 1 -- 10.20.193.5:0/3335704194 shutdown_connections 2026-02-17T21:29:13.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f542afed640 1 --2- 10.20.193.5:0/3335704194 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f54240c4d10 0x7f54240c89c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:13.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f542afed640 1 --2- 10.20.193.5:0/3335704194 >> v2:10.20.193.5:3300/0 conn(0x7f54240c7170 0x7f54240c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:13.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f542afed640 1 -- 10.20.193.5:0/3335704194 >> 10.20.193.5:0/3335704194 conn(0x7f54240c9f40 msgr2=0x7f54240ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:13.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f542afed640 1 -- 10.20.193.5:0/3335704194 shutdown_connections 2026-02-17T21:29:13.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.152+0000 7f542afed640 1 -- 10.20.193.5:0/3335704194 wait complete. 2026-02-17T21:29:13.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.153+0000 7f542afed640 10 monclient: build_initial_monmap 2026-02-17T21:29:13.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.153+0000 7f542afed640 10 monclient: monmap: 2026-02-17T21:29:13.167 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:13.167 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:29:13.167 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:29:13.167 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:29:13.168 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:13.168 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:13.168 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:29:13.168 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:29:13.168 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:29:13.168 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:13.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.153+0000 7f542afed640 1 librados: starting msgr at 2026-02-17T21:29:13.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.153+0000 7f542afed640 1 librados: starting objecter 2026-02-17T21:29:13.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.153+0000 7f542afed640 1 Processor -- start 2026-02-17T21:29:13.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.153+0000 7f542afed640 1 -- start start 2026-02-17T21:29:13.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.153+0000 7f542afed640 1 librados: setting wanted keys 2026-02-17T21:29:13.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.153+0000 7f542afed640 1 librados: calling monclient init 2026-02-17T21:29:13.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.153+0000 7f542afed640 10 monclient: init 2026-02-17T21:29:13.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.153+0000 7f542afed640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:13.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.153+0000 7f542afed640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:29:13.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.153+0000 7f542afed640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f54240c48c0 0x7f54241f70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:13.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.153+0000 7f542afed640 10 monclient(hunting): picked mon.noname-c con 0x7f54240c48c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:29:13.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.153+0000 7f542afed640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f54240c4d10 0x7f542414a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:13.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.153+0000 7f542afed640 10 monclient(hunting): picked mon.noname-b con 0x7f54240c4d10 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:29:13.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f542afed640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f54240c7170 0x7f542414bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:13.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f542afed640 10 monclient(hunting): picked mon.noname-a con 0x7f54240c7170 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:29:13.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f542afed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:13.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f542afed640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f54240c81c0 con 0x7f54240c7170 2026-02-17T21:29:13.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f542afed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:13.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f542afed640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f54240c7ee0 con 0x7f54240c4d10 2026-02-17T21:29:13.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f542afed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:13.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f542afed640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f54240750c0 con 0x7f54240c48c0 2026-02-17T21:29:13.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f542afed640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:13.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f542afed640 10 monclient(hunting): authenticate will time out at 1258.720013s 2026-02-17T21:29:13.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f5428d62640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f54240c48c0 0x7f54241f70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:13.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f5429563640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f54240c7170 0x7f542414bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:13.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f5428d62640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f54240c48c0 0x7f54241f70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:36104/0 (socket says 10.20.193.5:36104) 2026-02-17T21:29:13.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f5428d62640 1 -- 10.20.193.5:0/402502348 learned_addr learned my addr 10.20.193.5:0/402502348 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:29:13.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f5428d62640 10 monclient(hunting): get_auth_request con 0x7f54240c48c0 auth_method 0 2026-02-17T21:29:13.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f5428d62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:13.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f5428d62640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:13.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f5428d62640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:13.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f541bfff640 1 --2- 10.20.193.5:0/402502348 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f54240c4d10 0x7f542414a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:13.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f5429563640 10 monclient(hunting): get_auth_request con 0x7f54240c7170 auth_method 0 2026-02-17T21:29:13.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f5429563640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:13.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f5429563640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:13.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f5429563640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:13.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f5428d62640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:13.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f5428d62640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:13.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f5428d62640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:13.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f541bfff640 10 monclient(hunting): get_auth_request con 0x7f54240c4d10 auth_method 0 2026-02-17T21:29:13.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f541bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:13.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f541bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:13.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f541bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:13.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f5429563640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:13.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f5429563640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:13.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.154+0000 7f5429563640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:13.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.155+0000 7f541bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:13.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.155+0000 7f541bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:13.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.155+0000 7f541bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:13.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.156+0000 7f5428d62640 10 monclient(hunting): handle_auth_done global_id 4994 payload 824 2026-02-17T21:29:13.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.156+0000 7f5428d62640 1 -- 10.20.193.5:0/402502348 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f54240c4d10 msgr2=0x7f542414a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:13.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.156+0000 7f5428d62640 1 --2- 10.20.193.5:0/402502348 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f54240c4d10 0x7f542414a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:13.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.156+0000 7f5428d62640 1 -- 10.20.193.5:0/402502348 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f54240c7170 msgr2=0x7f542414bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:13.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.156+0000 7f5428d62640 1 --2- 10.20.193.5:0/402502348 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f54240c7170 0x7f542414bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:13.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.156+0000 7f5428d62640 10 monclient: _finish_hunting 0 2026-02-17T21:29:13.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.156+0000 7f5428d62640 1 monclient: found mon.noname-c 2026-02-17T21:29:13.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.156+0000 7f5428d62640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:13.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.156+0000 7f5428d62640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:29:13.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.156+0000 7f5428d62640 1 -- 10.20.193.5:0/402502348 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f542414ae20 con 0x7f54240c48c0 2026-02-17T21:29:13.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.157+0000 7f5428d62640 1 --2- 10.20.193.5:0/402502348 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f54240c48c0 0x7f54241f70e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f541400e960 tx=0x7f541400ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:13.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.157+0000 7f54197fa640 10 client.?.objecter ms_handle_connect 0x7f54240c48c0 2026-02-17T21:29:13.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.157+0000 7f54197fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:29:13.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.158+0000 7f54197fa640 1 -- 10.20.193.5:0/402502348 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5414017070 con 0x7f54240c48c0 2026-02-17T21:29:13.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.158+0000 7f54197fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:13.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.158+0000 7f54197fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:29:13.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.158+0000 7f54197fa640 10 monclient: dump: 2026-02-17T21:29:13.173 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:13.173 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:13.174 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:13.174 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:13.174 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:13.174 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:13.174 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:13.174 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:13.174 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:13.174 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:13.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.158+0000 7f54197fa640 10 monclient: _finish_auth 0 2026-02-17T21:29:13.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.158+0000 7f54197fa640 10 monclient: _check_auth_tickets 2026-02-17T21:29:13.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.158+0000 7f54197fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:13.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.158+0000 7f54197fa640 1 -- 10.20.193.5:0/402502348 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f541400ca00 con 0x7f54240c48c0 2026-02-17T21:29:13.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.158+0000 7f542afed640 5 monclient: authenticate success, global_id 4994 2026-02-17T21:29:13.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.158+0000 7f542afed640 10 monclient: _renew_subs 2026-02-17T21:29:13.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.158+0000 7f542afed640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:29:13.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.158+0000 7f542afed640 1 -- 10.20.193.5:0/402502348 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54241f3bd0 con 0x7f54240c48c0 2026-02-17T21:29:13.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.158+0000 7f54197fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:13.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.158+0000 7f54197fa640 1 -- 10.20.193.5:0/402502348 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541400cdf0 con 0x7f54240c48c0 2026-02-17T21:29:13.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.158+0000 7f54197fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:13.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.158+0000 7f54197fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:29:13.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.158+0000 7f54197fa640 10 monclient: dump: 2026-02-17T21:29:13.175 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:13.175 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:13.175 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:13.175 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:13.176 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:13.176 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:13.176 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:13.176 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:13.176 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:13.176 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:13.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.158+0000 7f541affd640 4 set_mon_vals no callback set 2026-02-17T21:29:13.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.158+0000 7f542afed640 10 client.4994.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:29:13.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.158+0000 7f542afed640 10 monclient: _renew_subs 2026-02-17T21:29:13.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.158+0000 7f542afed640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:29:13.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.158+0000 7f542afed640 1 -- 10.20.193.5:0/402502348 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f542414b280 con 0x7f54240c48c0 2026-02-17T21:29:13.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.158+0000 7f542afed640 1 librados: init done 2026-02-17T21:29:13.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.159+0000 7f542afed640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:13.177 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.159+0000 7f542afed640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:13.177 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.159+0000 7f542afed640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:29:13.177 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.159+0000 7f542afed640 1 -- 10.20.193.5:0/402502348 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54240ca850 con 0x7f54240c48c0 2026-02-17T21:29:13.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.170+0000 7f54197fa640 1 -- 10.20.193.5:0/402502348 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f5414024060 con 0x7f54240c48c0 2026-02-17T21:29:13.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.170+0000 7f54197fa640 1 --2- 10.20.193.5:0/402502348 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f53f40792d0 0x7f53f407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:13.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.170+0000 7f541bfff640 1 --2- 10.20.193.5:0/402502348 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f53f40792d0 0x7f53f407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:13.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.170+0000 7f541bfff640 10 monclient: get_auth_request con 0x7f53f40792d0 auth_method 0 2026-02-17T21:29:13.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.171+0000 7f541bfff640 1 --2- 10.20.193.5:0/402502348 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f53f40792d0 0x7f53f407b790 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f542415a8e0 tx=0x7f540c007f30 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:13.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.171+0000 7f54197fa640 10 client.4994.objecter ms_handle_connect 0x7f53f40792d0 2026-02-17T21:29:13.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.172+0000 7f54197fa640 1 -- 10.20.193.5:0/402502348 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f541405e4a0 con 0x7f54240c48c0 2026-02-17T21:29:13.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.172+0000 7f54197fa640 10 client.4994.objecter ms_dispatch2 0x7f5424000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:29:13.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.172+0000 7f54197fa640 3 client.4994.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:29:13.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.172+0000 7f54197fa640 3 client.4994.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:29:13.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.172+0000 7f54197fa640 20 client.4994.objecter dump_active .. 0 homeless 2026-02-17T21:29:13.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.272+0000 7f54197fa640 1 -- 10.20.193.5:0/402502348 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f54240ca850 con 0x7f54240c48c0 2026-02-17T21:29:13.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.272+0000 7f54197fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:13.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.272+0000 7f54197fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:29:13.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.371+0000 7f542afed640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:29:13.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.371+0000 7f542afed640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:13.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.371+0000 7f542afed640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:29:13.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.371+0000 7f542afed640 1 -- 10.20.193.5:0/402502348 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f54240c7550 con 0x7f54240c48c0 2026-02-17T21:29:13.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.374+0000 7f54197fa640 1 -- 10.20.193.5:0/402502348 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f5414062460 con 0x7f54240c48c0 2026-02-17T21:29:13.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.374+0000 7f54197fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:13.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.374+0000 7f54197fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:29:13.377 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:29:13.377 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:29:13.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.376+0000 7f542afed640 10 librados: watch_flush enter 2026-02-17T21:29:13.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.376+0000 7f542afed640 10 librados: watch_flush exit 2026-02-17T21:29:13.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.376+0000 7f542afed640 20 client.4994.objecter shutdown clearing up homeless session... 2026-02-17T21:29:13.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.376+0000 7f542afed640 10 client.4994.objecter successfully canceled tick 2026-02-17T21:29:13.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.376+0000 7f542afed640 1 -- 10.20.193.5:0/402502348 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f53f40792d0 msgr2=0x7f53f407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:13.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.376+0000 7f542afed640 1 --2- 10.20.193.5:0/402502348 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f53f40792d0 0x7f53f407b790 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f542415a8e0 tx=0x7f540c007f30 comp rx=0 tx=0).stop 2026-02-17T21:29:13.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.376+0000 7f542afed640 10 monclient: shutdown 2026-02-17T21:29:13.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.376+0000 7f542afed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:13.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.376+0000 7f542afed640 1 -- 10.20.193.5:0/402502348 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f54240c48c0 msgr2=0x7f54241f70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:13.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.376+0000 7f542afed640 1 --2- 10.20.193.5:0/402502348 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f54240c48c0 0x7f54241f70e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f541400e960 tx=0x7f541400ee30 comp rx=0 tx=0).stop 2026-02-17T21:29:13.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.376+0000 7f542afed640 1 -- 10.20.193.5:0/402502348 shutdown_connections 2026-02-17T21:29:13.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.376+0000 7f542afed640 1 --2- 10.20.193.5:0/402502348 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f53f40792d0 0x7f53f407b790 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:13.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.376+0000 7f542afed640 1 --2- 10.20.193.5:0/402502348 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f54240c7170 0x7f542414bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:13.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.376+0000 7f542afed640 1 --2- 10.20.193.5:0/402502348 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f54240c4d10 0x7f542414a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:13.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.376+0000 7f542afed640 1 --2- 10.20.193.5:0/402502348 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f54240c48c0 0x7f54241f70e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:13.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.376+0000 7f542afed640 1 -- 10.20.193.5:0/402502348 >> 10.20.193.5:0/402502348 conn(0x7f54240c9f40 msgr2=0x7f54240cc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:13.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.376+0000 7f542afed640 1 -- 10.20.193.5:0/402502348 shutdown_connections 2026-02-17T21:29:13.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.376+0000 7f542afed640 1 -- 10.20.193.5:0/402502348 wait complete. 2026-02-17T21:29:13.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:13.376+0000 7f542afed640 1 librados: shutdown 2026-02-17T21:29:16.388 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:29:16.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.454+0000 7fb8a8751640 10 monclient: get_monmap_and_config 2026-02-17T21:29:16.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.454+0000 7fb8a8751640 10 monclient: build_initial_monmap 2026-02-17T21:29:16.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.454+0000 7fb8a8751640 10 monclient: monmap: 2026-02-17T21:29:16.457 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:16.457 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:16.458 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:29:16.456227+0000 2026-02-17T21:29:16.458 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:29:16.456227+0000 2026-02-17T21:29:16.458 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:16.458 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:16.458 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:29:16.458 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:29:16.458 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:29:16.458 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:29:16.458 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:29:16.458 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:29:16.458 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:16.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.454+0000 7fb8a8751640 1 Processor -- start 2026-02-17T21:29:16.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.455+0000 7fb8a8751640 1 -- start start 2026-02-17T21:29:16.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.455+0000 7fb8a8751640 10 monclient: init 2026-02-17T21:29:16.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.455+0000 7fb8a8751640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:16.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.455+0000 7fb8a8751640 10 monclient: _add_conns ranks=[4,5,2,1,3,0] 2026-02-17T21:29:16.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.455+0000 7fb8a8751640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fb8a015d370 0x7fb8a015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:16.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.455+0000 7fb8a8751640 10 monclient(hunting): picked mon.noname-b con 0x7fb8a015d370 addr v2:10.20.193.119:3300/0 2026-02-17T21:29:16.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.455+0000 7fb8a8751640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fb8a00c7e20 0x7fb8a00c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:16.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.455+0000 7fb8a8751640 10 monclient(hunting): picked mon.noname-c con 0x7fb8a00c7e20 addr v2:10.20.193.135:3300/0 2026-02-17T21:29:16.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.455+0000 7fb8a8751640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb8a015b000 addr v1:10.20.193.135:6789/0 2026-02-17T21:29:16.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.455+0000 7fb8a8751640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8a00c8350 con 0x7fb8a015b000 2026-02-17T21:29:16.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.455+0000 7fb8a8751640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:16.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.455+0000 7fb8a8751640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fb8a00c9240 con 0x7fb8a015d370 2026-02-17T21:29:16.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.455+0000 7fb8a8751640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:16.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.455+0000 7fb8a8751640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb8a00c8630 con 0x7fb8a00c7e20 2026-02-17T21:29:16.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.455+0000 7fb8a8751640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:16.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.455+0000 7fb8a8751640 10 monclient(hunting): authenticate will time out at 1262.021533s 2026-02-17T21:29:16.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.456+0000 7fb8a64c6640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fb8a015d370 0x7fb8a015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:16.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.456+0000 7fb8a5cc5640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fb8a00c7e20 0x7fb8a00c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:16.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.456+0000 7fb8a64c6640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fb8a015d370 0x7fb8a015d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:39292/0 (socket says 10.20.193.5:39292) 2026-02-17T21:29:16.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.456+0000 7fb8a64c6640 1 -- 10.20.193.5:0/1007864953 learned_addr learned my addr 10.20.193.5:0/1007864953 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:29:16.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.456+0000 7fb8a64c6640 10 monclient(hunting): get_auth_request con 0x7fb8a015d370 auth_method 0 2026-02-17T21:29:16.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.456+0000 7fb8a64c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:16.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.456+0000 7fb8a64c6640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:16.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.456+0000 7fb8a64c6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:16.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.456+0000 7fb8a5cc5640 10 monclient(hunting): get_auth_request con 0x7fb8a00c7e20 auth_method 0 2026-02-17T21:29:16.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.456+0000 7fb8a5cc5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:16.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.456+0000 7fb8a5cc5640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:16.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.456+0000 7fb8a5cc5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:16.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.456+0000 7fb8a64c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:16.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.456+0000 7fb8a64c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:16.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.456+0000 7fb8a64c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:16.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.457+0000 7fb8a5cc5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:16.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.457+0000 7fb8a5cc5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:16.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.457+0000 7fb8a5cc5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:16.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.457+0000 7fb8a64c6640 10 monclient(hunting): handle_auth_done global_id 5002 payload 274 2026-02-17T21:29:16.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.457+0000 7fb8a64c6640 1 -- 10.20.193.5:0/1007864953 >> v2:10.20.193.135:3300/0 conn(0x7fb8a00c7e20 msgr2=0x7fb8a00c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:29:16.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.457+0000 7fb8a64c6640 1 --2- 10.20.193.5:0/1007864953 >> v2:10.20.193.135:3300/0 conn(0x7fb8a00c7e20 0x7fb8a00c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:16.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.457+0000 7fb8a64c6640 1 -- 10.20.193.5:0/1007864953 >> v1:10.20.193.135:6789/0 conn(0x7fb8a015b000 legacy=0x7fb8a00c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:16.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.457+0000 7fb8a64c6640 10 monclient: _finish_hunting 0 2026-02-17T21:29:16.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.457+0000 7fb8a64c6640 1 monclient: found mon.noname-b 2026-02-17T21:29:16.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.457+0000 7fb8a64c6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:16.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.457+0000 7fb8a64c6640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:29:16.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.457+0000 7fb8a64c6640 1 -- 10.20.193.5:0/1007864953 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a00c8910 con 0x7fb8a015d370 2026-02-17T21:29:16.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.459+0000 7fb8a64c6640 1 --2- 10.20.193.5:0/1007864953 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb8a015d370 0x7fb8a015d750 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb8a015d060 tx=0x7fb89002eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ebed9f70cb9655 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:16.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a54c4640 1 -- 10.20.193.5:0/1007864953 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89003c070 con 0x7fb8a015d370 2026-02-17T21:29:16.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a54c4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:16.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a54c4640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:29:16.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a54c4640 10 monclient: dump: 2026-02-17T21:29:16.471 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:16.471 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:16.471 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:16.471 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:16.472 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:16.472 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:16.472 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:16.472 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:16.472 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:16.472 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:16.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a54c4640 10 monclient: _finish_auth 0 2026-02-17T21:29:16.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a54c4640 10 monclient: _check_auth_tickets 2026-02-17T21:29:16.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a54c4640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:16.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a54c4640 1 -- 10.20.193.5:0/1007864953 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb89002fbe0 con 0x7fb8a015d370 2026-02-17T21:29:16.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a8751640 5 monclient: authenticate success, global_id 5002 2026-02-17T21:29:16.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a8751640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:29:16.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a54c4640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:16.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a54c4640 1 -- 10.20.193.5:0/1007864953 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb890037440 con 0x7fb8a015d370 2026-02-17T21:29:16.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a8751640 10 monclient: get_monmap_and_config success 2026-02-17T21:29:16.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a8751640 4 set_mon_vals no callback set 2026-02-17T21:29:16.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a54c4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:16.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a54c4640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:29:16.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a54c4640 10 monclient: dump: 2026-02-17T21:29:16.473 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:16.473 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:16.473 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:16.473 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:16.473 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:16.474 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:16.474 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:16.474 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:16.474 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:16.474 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:16.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a8751640 10 monclient: shutdown 2026-02-17T21:29:16.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a8751640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:16.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a8751640 1 -- 10.20.193.5:0/1007864953 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb8a015d370 msgr2=0x7fb8a015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:16.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a8751640 1 --2- 10.20.193.5:0/1007864953 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb8a015d370 0x7fb8a015d750 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb8a015d060 tx=0x7fb89002eed0 comp rx=0 tx=0).stop 2026-02-17T21:29:16.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a8751640 1 -- 10.20.193.5:0/1007864953 shutdown_connections 2026-02-17T21:29:16.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a8751640 1 --2- 10.20.193.5:0/1007864953 >> v2:10.20.193.135:3300/0 conn(0x7fb8a00c7e20 0x7fb8a00c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:16.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a8751640 1 --2- 10.20.193.5:0/1007864953 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb8a015d370 0x7fb8a015d750 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:16.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a8751640 1 -- 10.20.193.5:0/1007864953 >> 10.20.193.5:0/1007864953 conn(0x7fb8a00c9f20 msgr2=0x7fb8a00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:16.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a8751640 1 -- 10.20.193.5:0/1007864953 shutdown_connections 2026-02-17T21:29:16.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.461+0000 7fb8a8751640 1 -- 10.20.193.5:0/1007864953 wait complete. 2026-02-17T21:29:16.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.462+0000 7fb8a8751640 10 monclient: build_initial_monmap 2026-02-17T21:29:16.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.462+0000 7fb8a8751640 10 monclient: monmap: 2026-02-17T21:29:16.475 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:16.475 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:29:16.475 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:29:16.475 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:29:16.475 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:16.475 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:16.475 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:29:16.476 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:29:16.476 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:29:16.476 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:16.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.462+0000 7fb8a8751640 1 librados: starting msgr at 2026-02-17T21:29:16.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.462+0000 7fb8a8751640 1 librados: starting objecter 2026-02-17T21:29:16.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.462+0000 7fb8a8751640 1 Processor -- start 2026-02-17T21:29:16.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.462+0000 7fb8a8751640 1 -- start start 2026-02-17T21:29:16.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.462+0000 7fb8a8751640 1 librados: setting wanted keys 2026-02-17T21:29:16.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.462+0000 7fb8a8751640 1 librados: calling monclient init 2026-02-17T21:29:16.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.462+0000 7fb8a8751640 10 monclient: init 2026-02-17T21:29:16.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a8751640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:16.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a8751640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:29:16.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a8751640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb8a00c7e20 0x7fb8a0147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:16.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a8751640 10 monclient(hunting): picked mon.noname-a con 0x7fb8a00c7e20 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:29:16.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a8751640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb8a015b000 0x7fb8a01463d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:16.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a8751640 10 monclient(hunting): picked mon.noname-c con 0x7fb8a015b000 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:29:16.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a8751640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb8a015d370 0x7fb8a0146910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:16.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a8751640 10 monclient(hunting): picked mon.noname-b con 0x7fb8a015d370 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:29:16.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a8751640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:16.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a8751640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a00c96d0 con 0x7fb8a00c7e20 2026-02-17T21:29:16.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a8751640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:16.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a8751640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a00c8ed0 con 0x7fb8a015d370 2026-02-17T21:29:16.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a8751640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:16.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a8751640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a0145f40 con 0x7fb8a015b000 2026-02-17T21:29:16.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a8751640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:16.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a8751640 10 monclient(hunting): authenticate will time out at 1262.029062s 2026-02-17T21:29:16.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a5cc5640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb8a015b000 0x7fb8a01463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:16.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a6cc7640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb8a015d370 0x7fb8a0146910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:16.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a6cc7640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb8a015d370 0x7fb8a0146910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:39300/0 (socket says 10.20.193.5:39300) 2026-02-17T21:29:16.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a6cc7640 1 -- 10.20.193.5:0/2114399096 learned_addr learned my addr 10.20.193.5:0/2114399096 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:29:16.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a6cc7640 10 monclient(hunting): get_auth_request con 0x7fb8a015d370 auth_method 0 2026-02-17T21:29:16.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a6cc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:16.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a6cc7640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:16.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a6cc7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:16.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a5cc5640 1 --2- 10.20.193.5:0/2114399096 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb8a015b000 0x7fb8a01463d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:36116/0 (socket says 10.20.193.5:36116) 2026-02-17T21:29:16.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a5cc5640 10 monclient(hunting): get_auth_request con 0x7fb8a015b000 auth_method 0 2026-02-17T21:29:16.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a5cc5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:16.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a5cc5640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:16.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a5cc5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:16.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a64c6640 1 --2- 10.20.193.5:0/2114399096 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb8a00c7e20 0x7fb8a0147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:16.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a6cc7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:16.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a6cc7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:16.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a6cc7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:16.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a5cc5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:16.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a5cc5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:16.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a5cc5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:16.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a64c6640 10 monclient(hunting): get_auth_request con 0x7fb8a00c7e20 auth_method 0 2026-02-17T21:29:16.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a64c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:16.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a64c6640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:16.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.463+0000 7fb8a64c6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:16.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.464+0000 7fb8a64c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:16.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.464+0000 7fb8a64c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:16.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.464+0000 7fb8a64c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:16.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.465+0000 7fb8a6cc7640 10 monclient(hunting): handle_auth_done global_id 5005 payload 824 2026-02-17T21:29:16.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.465+0000 7fb8a6cc7640 1 -- 10.20.193.5:0/2114399096 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb8a015b000 msgr2=0x7fb8a01463d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:16.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.465+0000 7fb8a6cc7640 1 --2- 10.20.193.5:0/2114399096 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb8a015b000 0x7fb8a01463d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:16.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.465+0000 7fb8a6cc7640 1 -- 10.20.193.5:0/2114399096 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb8a00c7e20 msgr2=0x7fb8a0147410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:16.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.465+0000 7fb8a6cc7640 1 --2- 10.20.193.5:0/2114399096 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb8a00c7e20 0x7fb8a0147410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:16.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.465+0000 7fb8a6cc7640 10 monclient: _finish_hunting 0 2026-02-17T21:29:16.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.465+0000 7fb8a6cc7640 1 monclient: found mon.noname-b 2026-02-17T21:29:16.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.465+0000 7fb8a6cc7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:16.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.465+0000 7fb8a6cc7640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:29:16.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.465+0000 7fb8a6cc7640 1 -- 10.20.193.5:0/2114399096 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a014d840 con 0x7fb8a015d370 2026-02-17T21:29:16.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.466+0000 7fb8a6cc7640 1 --2- 10.20.193.5:0/2114399096 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb8a015d370 0x7fb8a0146910 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00cc50 tx=0x7fb89c00a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:16.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.466+0000 7fb886ffd640 10 client.?.objecter ms_handle_connect 0x7fb8a015d370 2026-02-17T21:29:16.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.466+0000 7fb886ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:29:16.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.467+0000 7fb886ffd640 1 -- 10.20.193.5:0/2114399096 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c003a70 con 0x7fb8a015d370 2026-02-17T21:29:16.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.467+0000 7fb886ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:16.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.467+0000 7fb886ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:29:16.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.467+0000 7fb886ffd640 10 monclient: dump: 2026-02-17T21:29:16.481 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:16.481 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:16.481 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:16.481 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:16.481 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:16.482 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:16.482 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:16.482 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:16.482 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:16.482 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:16.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.467+0000 7fb886ffd640 10 monclient: _finish_auth 0 2026-02-17T21:29:16.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.467+0000 7fb886ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:29:16.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.467+0000 7fb886ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:16.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.467+0000 7fb8a8751640 5 monclient: authenticate success, global_id 5005 2026-02-17T21:29:16.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.467+0000 7fb8a8751640 10 monclient: _renew_subs 2026-02-17T21:29:16.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.467+0000 7fb8a8751640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:29:16.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.467+0000 7fb8a8751640 1 -- 10.20.193.5:0/2114399096 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a014ccc0 con 0x7fb8a015d370 2026-02-17T21:29:16.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.467+0000 7fb8a8751640 10 client.5005.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:29:16.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.467+0000 7fb8a8751640 10 monclient: _renew_subs 2026-02-17T21:29:16.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.467+0000 7fb8a8751640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:29:16.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.467+0000 7fb8a8751640 1 -- 10.20.193.5:0/2114399096 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8a014d280 con 0x7fb8a015d370 2026-02-17T21:29:16.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.467+0000 7fb8a8751640 1 librados: init done 2026-02-17T21:29:16.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.467+0000 7fb886ffd640 1 -- 10.20.193.5:0/2114399096 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb89c003c10 con 0x7fb8a015d370 2026-02-17T21:29:16.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.467+0000 7fb886ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:16.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.467+0000 7fb886ffd640 1 -- 10.20.193.5:0/2114399096 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c0050d0 con 0x7fb8a015d370 2026-02-17T21:29:16.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.467+0000 7fb886ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:16.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.467+0000 7fb886ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:29:16.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.467+0000 7fb886ffd640 10 monclient: dump: 2026-02-17T21:29:16.483 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:16.483 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:16.484 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:16.484 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:16.484 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:16.484 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:16.484 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:16.484 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:16.484 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:16.484 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:16.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.467+0000 7fb8a4cc3640 4 set_mon_vals no callback set 2026-02-17T21:29:16.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.467+0000 7fb8a8751640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:16.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.468+0000 7fb8a8751640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:16.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.468+0000 7fb8a8751640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:29:16.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.468+0000 7fb8a8751640 1 -- 10.20.193.5:0/2114399096 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8a015b490 con 0x7fb8a015d370 2026-02-17T21:29:16.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.479+0000 7fb886ffd640 1 -- 10.20.193.5:0/2114399096 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fb89c005270 con 0x7fb8a015d370 2026-02-17T21:29:16.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.479+0000 7fb886ffd640 1 --2- 10.20.193.5:0/2114399096 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb870079280 0x7fb87007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:16.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.479+0000 7fb8a64c6640 1 --2- 10.20.193.5:0/2114399096 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb870079280 0x7fb87007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:16.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.479+0000 7fb8a64c6640 10 monclient: get_auth_request con 0x7fb870079280 auth_method 0 2026-02-17T21:29:16.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.480+0000 7fb8a64c6640 1 --2- 10.20.193.5:0/2114399096 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb870079280 0x7fb87007b740 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb8a015dcf0 tx=0x7fb890039040 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:16.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.480+0000 7fb886ffd640 10 client.5005.objecter ms_handle_connect 0x7fb870079280 2026-02-17T21:29:16.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.481+0000 7fb886ffd640 1 -- 10.20.193.5:0/2114399096 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fb89c05ebc0 con 0x7fb8a015d370 2026-02-17T21:29:16.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.481+0000 7fb886ffd640 10 client.5005.objecter ms_dispatch2 0x7fb8a0000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:29:16.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.481+0000 7fb886ffd640 3 client.5005.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:29:16.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.481+0000 7fb886ffd640 3 client.5005.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:29:16.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.481+0000 7fb886ffd640 20 client.5005.objecter dump_active .. 0 homeless 2026-02-17T21:29:16.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.583+0000 7fb886ffd640 1 -- 10.20.193.5:0/2114399096 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb89c062b80 con 0x7fb8a015d370 2026-02-17T21:29:16.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.583+0000 7fb886ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:16.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.583+0000 7fb886ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:29:16.682 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.680+0000 7fb8a8751640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:29:16.683 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.680+0000 7fb8a8751640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:16.683 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.680+0000 7fb8a8751640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:29:16.683 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.680+0000 7fb8a8751640 1 -- 10.20.193.5:0/2114399096 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb8a01508b0 con 0x7fb8a015d370 2026-02-17T21:29:16.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.683+0000 7fb886ffd640 1 -- 10.20.193.5:0/2114399096 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fb89c066e80 con 0x7fb8a015d370 2026-02-17T21:29:16.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.683+0000 7fb886ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:16.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.683+0000 7fb886ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:29:16.685 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:29:16.685 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:29:16.687 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.683+0000 7fb8a8751640 10 librados: watch_flush enter 2026-02-17T21:29:16.687 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.683+0000 7fb8a8751640 10 librados: watch_flush exit 2026-02-17T21:29:16.687 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.683+0000 7fb8a8751640 20 client.5005.objecter shutdown clearing up homeless session... 2026-02-17T21:29:16.687 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.683+0000 7fb8a8751640 10 client.5005.objecter successfully canceled tick 2026-02-17T21:29:16.687 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.683+0000 7fb8a8751640 1 -- 10.20.193.5:0/2114399096 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb870079280 msgr2=0x7fb87007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:16.687 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.683+0000 7fb8a8751640 1 --2- 10.20.193.5:0/2114399096 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb870079280 0x7fb87007b740 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb8a015dcf0 tx=0x7fb890039040 comp rx=0 tx=0).stop 2026-02-17T21:29:16.687 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.683+0000 7fb8a8751640 10 monclient: shutdown 2026-02-17T21:29:16.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.683+0000 7fb8a8751640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:16.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.683+0000 7fb8a8751640 1 -- 10.20.193.5:0/2114399096 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb8a015d370 msgr2=0x7fb8a0146910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:16.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.683+0000 7fb8a8751640 1 --2- 10.20.193.5:0/2114399096 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb8a015d370 0x7fb8a0146910 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00cc50 tx=0x7fb89c00a430 comp rx=0 tx=0).stop 2026-02-17T21:29:16.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.684+0000 7fb8a8751640 1 -- 10.20.193.5:0/2114399096 shutdown_connections 2026-02-17T21:29:16.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.684+0000 7fb8a8751640 1 --2- 10.20.193.5:0/2114399096 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb870079280 0x7fb87007b740 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:16.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.684+0000 7fb8a8751640 1 --2- 10.20.193.5:0/2114399096 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb8a015d370 0x7fb8a0146910 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:16.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.684+0000 7fb8a8751640 1 --2- 10.20.193.5:0/2114399096 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb8a015b000 0x7fb8a01463d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:16.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.684+0000 7fb8a8751640 1 --2- 10.20.193.5:0/2114399096 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb8a00c7e20 0x7fb8a0147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:16.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.684+0000 7fb8a8751640 1 -- 10.20.193.5:0/2114399096 >> 10.20.193.5:0/2114399096 conn(0x7fb8a00c9f20 msgr2=0x7fb8a00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:16.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.684+0000 7fb8a8751640 1 -- 10.20.193.5:0/2114399096 shutdown_connections 2026-02-17T21:29:16.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.684+0000 7fb8a8751640 1 -- 10.20.193.5:0/2114399096 wait complete. 2026-02-17T21:29:16.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:16.684+0000 7fb8a8751640 1 librados: shutdown 2026-02-17T21:29:17.633 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:05:57.258 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:17.634 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:05:57.259 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:17.634 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:05:57.220 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:17.636 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:05:57.222 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:17.643 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:05:57.268 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:17.644 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:05:57.230 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:17.662 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:05:57.286 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:17.663 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:05:57.287 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:17.672 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:05:57.296 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:19.695 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:29:19.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.761+0000 7fc6064a9640 10 monclient: get_monmap_and_config 2026-02-17T21:29:19.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.761+0000 7fc6064a9640 10 monclient: build_initial_monmap 2026-02-17T21:29:19.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.761+0000 7fc6064a9640 10 monclient: monmap: 2026-02-17T21:29:19.763 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:19.763 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:19.763 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:29:19.762190+0000 2026-02-17T21:29:19.764 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:29:19.762190+0000 2026-02-17T21:29:19.764 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:19.764 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:19.764 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:29:19.764 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:29:19.764 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:29:19.764 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:29:19.764 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:29:19.764 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:29:19.764 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:19.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.761+0000 7fc6064a9640 1 Processor -- start 2026-02-17T21:29:19.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.761+0000 7fc6064a9640 1 -- start start 2026-02-17T21:29:19.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.761+0000 7fc6064a9640 10 monclient: init 2026-02-17T21:29:19.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.762+0000 7fc6064a9640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:19.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.762+0000 7fc6064a9640 10 monclient: _add_conns ranks=[1,0,4,2,3,5] 2026-02-17T21:29:19.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.762+0000 7fc6064a9640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fc60015d370 addr v1:10.20.193.119:6789/0 2026-02-17T21:29:19.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.762+0000 7fc6064a9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc6000c7e20 addr v1:10.20.193.5:6789/0 2026-02-17T21:29:19.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.762+0000 7fc6064a9640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fc6000c59c0 0x7fc60015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:19.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.762+0000 7fc6064a9640 10 monclient(hunting): picked mon.noname-b con 0x7fc6000c59c0 addr v2:10.20.193.119:3300/0 2026-02-17T21:29:19.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.762+0000 7fc6064a9640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6000c8350 con 0x7fc6000c7e20 2026-02-17T21:29:19.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.762+0000 7fc6064a9640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6000c8630 con 0x7fc60015d370 2026-02-17T21:29:19.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.762+0000 7fc6064a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:19.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.762+0000 7fc6064a9640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fc60015b710 con 0x7fc6000c59c0 2026-02-17T21:29:19.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.762+0000 7fc6064a9640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:19.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.762+0000 7fc6064a9640 10 monclient(hunting): authenticate will time out at 1265.327473s 2026-02-17T21:29:19.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.762+0000 7fc5ff7fe640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7fc6000c7e20 0x7fc6000c52b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:32778/0 (socket says 10.20.193.5:32778) 2026-02-17T21:29:19.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.762+0000 7fc5ff7fe640 1 -- 10.20.193.5:0/3411898317 learned_addr learned my addr 10.20.193.5:0/3411898317 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:29:19.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.763+0000 7fc604a1f640 1 --2- 10.20.193.5:0/3411898317 >> v2:10.20.193.119:3300/0 conn(0x7fc6000c59c0 0x7fc60015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:19.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.763+0000 7fc604a1f640 10 monclient(hunting): get_auth_request con 0x7fc6000c59c0 auth_method 0 2026-02-17T21:29:19.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.763+0000 7fc604a1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:19.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.763+0000 7fc604a1f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:19.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.763+0000 7fc604a1f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:19.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.763+0000 7fc604a1f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:19.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.763+0000 7fc604a1f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:19.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.763+0000 7fc604a1f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:19.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.764+0000 7fc5feffd640 1 -- 10.20.193.5:0/3411898317 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2585258264 0 0) 0x7fc6000c8350 con 0x7fc6000c7e20 2026-02-17T21:29:19.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.764+0000 7fc5feffd640 10 monclient(hunting): _negotiate 2026-02-17T21:29:19.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.764+0000 7fc5feffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:19.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.764+0000 7fc5feffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:19.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.764+0000 7fc5feffd640 10 monclient(hunting): my global_id is 4962 2026-02-17T21:29:19.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.764+0000 7fc5feffd640 1 -- 10.20.193.5:0/3411898317 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5e4003620 con 0x7fc6000c7e20 2026-02-17T21:29:19.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.765+0000 7fc604a1f640 10 monclient(hunting): handle_auth_done global_id 5008 payload 274 2026-02-17T21:29:19.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.765+0000 7fc604a1f640 1 -- 10.20.193.5:0/3411898317 >> v1:10.20.193.119:6789/0 conn(0x7fc60015d370 legacy=0x7fc60015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:19.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.765+0000 7fc604a1f640 1 -- 10.20.193.5:0/3411898317 >> v1:10.20.193.5:6789/0 conn(0x7fc6000c7e20 legacy=0x7fc6000c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:19.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.765+0000 7fc604a1f640 10 monclient: _finish_hunting 0 2026-02-17T21:29:19.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.765+0000 7fc604a1f640 1 monclient: found mon.noname-b 2026-02-17T21:29:19.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.765+0000 7fc604a1f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:19.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.765+0000 7fc604a1f640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:29:19.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.765+0000 7fc604a1f640 1 -- 10.20.193.5:0/3411898317 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6000c8910 con 0x7fc6000c59c0 2026-02-17T21:29:19.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.766+0000 7fc604a1f640 1 --2- 10.20.193.5:0/3411898317 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc6000c59c0 0x7fc60015d750 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4009d90 tx=0x7fc5f402f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc4f27e9f05115fd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:19.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.768+0000 7fc5feffd640 1 -- 10.20.193.5:0/3411898317 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f403c070 con 0x7fc6000c59c0 2026-02-17T21:29:19.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.768+0000 7fc5feffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:19.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.768+0000 7fc5feffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:29:19.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.768+0000 7fc5feffd640 10 monclient: dump: 2026-02-17T21:29:19.777 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:19.777 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:19.777 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:19.777 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:19.777 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:19.777 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:19.777 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:19.777 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:19.777 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:19.777 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:19.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.768+0000 7fc5feffd640 10 monclient: _finish_auth 0 2026-02-17T21:29:19.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.768+0000 7fc5feffd640 10 monclient: _check_auth_tickets 2026-02-17T21:29:19.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.768+0000 7fc5feffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:19.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.768+0000 7fc5feffd640 1 -- 10.20.193.5:0/3411898317 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f4037440 con 0x7fc6000c59c0 2026-02-17T21:29:19.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.768+0000 7fc5feffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:19.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.768+0000 7fc6064a9640 5 monclient: authenticate success, global_id 5008 2026-02-17T21:29:19.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.768+0000 7fc5feffd640 1 -- 10.20.193.5:0/3411898317 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4037810 con 0x7fc6000c59c0 2026-02-17T21:29:19.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.768+0000 7fc6064a9640 10 monclient: get_monmap_and_config success 2026-02-17T21:29:19.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.768+0000 7fc6064a9640 4 set_mon_vals no callback set 2026-02-17T21:29:19.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.768+0000 7fc5feffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:19.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.768+0000 7fc5feffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:29:19.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.768+0000 7fc5feffd640 10 monclient: dump: 2026-02-17T21:29:19.778 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:19.779 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:19.779 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:19.779 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:19.779 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:19.779 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:19.779 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:19.779 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:19.779 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:19.779 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:19.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.769+0000 7fc6064a9640 10 monclient: shutdown 2026-02-17T21:29:19.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.769+0000 7fc6064a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:19.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.769+0000 7fc6064a9640 1 -- 10.20.193.5:0/3411898317 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc6000c59c0 msgr2=0x7fc60015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:19.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.769+0000 7fc6064a9640 1 --2- 10.20.193.5:0/3411898317 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc6000c59c0 0x7fc60015d750 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4009d90 tx=0x7fc5f402f230 comp rx=0 tx=0).stop 2026-02-17T21:29:19.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.769+0000 7fc6064a9640 1 -- 10.20.193.5:0/3411898317 shutdown_connections 2026-02-17T21:29:19.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.769+0000 7fc6064a9640 1 --2- 10.20.193.5:0/3411898317 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc6000c59c0 0x7fc60015d750 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:19.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.769+0000 7fc6064a9640 1 -- 10.20.193.5:0/3411898317 >> 10.20.193.5:0/3411898317 conn(0x7fc6000c9f20 msgr2=0x7fc6000ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:19.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.769+0000 7fc6064a9640 1 -- 10.20.193.5:0/3411898317 shutdown_connections 2026-02-17T21:29:19.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.769+0000 7fc6064a9640 1 -- 10.20.193.5:0/3411898317 wait complete. 2026-02-17T21:29:19.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.769+0000 7fc6064a9640 10 monclient: build_initial_monmap 2026-02-17T21:29:19.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.769+0000 7fc6064a9640 10 monclient: monmap: 2026-02-17T21:29:19.780 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:19.780 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:29:19.780 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:29:19.780 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:29:19.780 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:19.781 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:19.781 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:29:19.781 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:29:19.781 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:29:19.781 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:19.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.769+0000 7fc6064a9640 1 librados: starting msgr at 2026-02-17T21:29:19.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.769+0000 7fc6064a9640 1 librados: starting objecter 2026-02-17T21:29:19.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.769+0000 7fc6064a9640 1 Processor -- start 2026-02-17T21:29:19.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.769+0000 7fc6064a9640 1 -- start start 2026-02-17T21:29:19.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.769+0000 7fc6064a9640 1 librados: setting wanted keys 2026-02-17T21:29:19.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.769+0000 7fc6064a9640 1 librados: calling monclient init 2026-02-17T21:29:19.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.769+0000 7fc6064a9640 10 monclient: init 2026-02-17T21:29:19.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc6064a9640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:19.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc6064a9640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:29:19.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc6064a9640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc6000c59c0 0x7fc6000cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:19.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc6064a9640 10 monclient(hunting): picked mon.noname-c con 0x7fc6000c59c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:29:19.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc6064a9640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc6000c7e20 0x7fc600149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:19.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc6064a9640 10 monclient(hunting): picked mon.noname-a con 0x7fc6000c7e20 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:29:19.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc6064a9640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc60015d370 0x7fc600149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:19.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc6064a9640 10 monclient(hunting): picked mon.noname-b con 0x7fc60015d370 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:29:19.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc6064a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:19.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc6064a9640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc6000c8ed0 con 0x7fc6000c7e20 2026-02-17T21:29:19.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc6064a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:19.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc6064a9640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc6000c9240 con 0x7fc60015d370 2026-02-17T21:29:19.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc6064a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:19.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc6064a9640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc6000c96d0 con 0x7fc6000c59c0 2026-02-17T21:29:19.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc6064a9640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:19.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc6064a9640 10 monclient(hunting): authenticate will time out at 1265.335316s 2026-02-17T21:29:19.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc604a1f640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc60015d370 0x7fc600149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:19.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc5ff7fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc6000c7e20 0x7fc600149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:19.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc604a1f640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc60015d370 0x7fc600149780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:57140/0 (socket says 10.20.193.5:57140) 2026-02-17T21:29:19.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc604a1f640 1 -- 10.20.193.5:0/1195727091 learned_addr learned my addr 10.20.193.5:0/1195727091 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:29:19.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc604a1f640 10 monclient(hunting): get_auth_request con 0x7fc60015d370 auth_method 0 2026-02-17T21:29:19.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc604a1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:19.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc604a1f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:19.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc604a1f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:19.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc5fffff640 1 --2- 10.20.193.5:0/1195727091 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc6000c59c0 0x7fc6000cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:19.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc5ff7fe640 10 monclient(hunting): get_auth_request con 0x7fc6000c7e20 auth_method 0 2026-02-17T21:29:19.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc5ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:19.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc5ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:19.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc5ff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:19.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc604a1f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:19.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc604a1f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:19.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.770+0000 7fc604a1f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:19.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.771+0000 7fc5fffff640 10 monclient(hunting): get_auth_request con 0x7fc6000c59c0 auth_method 0 2026-02-17T21:29:19.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.771+0000 7fc5fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:19.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.771+0000 7fc5fffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:19.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.771+0000 7fc5fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:19.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.771+0000 7fc5ff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:19.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.771+0000 7fc5ff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:19.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.771+0000 7fc5ff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:19.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.771+0000 7fc5fffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:19.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.771+0000 7fc5fffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:19.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.771+0000 7fc5fffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:19.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.772+0000 7fc604a1f640 10 monclient(hunting): handle_auth_done global_id 5014 payload 824 2026-02-17T21:29:19.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.772+0000 7fc604a1f640 1 -- 10.20.193.5:0/1195727091 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc6000c59c0 msgr2=0x7fc6000cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:19.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.772+0000 7fc604a1f640 1 --2- 10.20.193.5:0/1195727091 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc6000c59c0 0x7fc6000cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:19.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.772+0000 7fc604a1f640 1 -- 10.20.193.5:0/1195727091 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc6000c7e20 msgr2=0x7fc600149240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:19.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.772+0000 7fc604a1f640 1 --2- 10.20.193.5:0/1195727091 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc6000c7e20 0x7fc600149240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:19.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.772+0000 7fc604a1f640 10 monclient: _finish_hunting 0 2026-02-17T21:29:19.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.772+0000 7fc604a1f640 1 monclient: found mon.noname-b 2026-02-17T21:29:19.785 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.772+0000 7fc604a1f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:19.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.772+0000 7fc604a1f640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:29:19.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.772+0000 7fc604a1f640 1 -- 10.20.193.5:0/1195727091 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc600148d90 con 0x7fc60015d370 2026-02-17T21:29:19.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.773+0000 7fc604a1f640 1 --2- 10.20.193.5:0/1195727091 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc60015d370 0x7fc600149780 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc5f403a040 tx=0x7fc5f4004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:19.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.773+0000 7fc5fcff9640 10 client.?.objecter ms_handle_connect 0x7fc60015d370 2026-02-17T21:29:19.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.773+0000 7fc5fcff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:29:19.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.774+0000 7fc5fcff9640 1 -- 10.20.193.5:0/1195727091 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f403c050 con 0x7fc60015d370 2026-02-17T21:29:19.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.774+0000 7fc5fcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:19.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.774+0000 7fc5fcff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:29:19.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.774+0000 7fc5fcff9640 10 monclient: dump: 2026-02-17T21:29:19.786 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:19.786 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:19.786 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:19.787 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:19.787 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:19.787 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:19.787 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:19.787 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:19.787 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:19.787 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:19.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.774+0000 7fc5fcff9640 10 monclient: _finish_auth 0 2026-02-17T21:29:19.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.774+0000 7fc5fcff9640 10 monclient: _check_auth_tickets 2026-02-17T21:29:19.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.774+0000 7fc5fcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:19.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.774+0000 7fc6064a9640 5 monclient: authenticate success, global_id 5014 2026-02-17T21:29:19.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.774+0000 7fc6064a9640 10 monclient: _renew_subs 2026-02-17T21:29:19.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.774+0000 7fc6064a9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:29:19.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.774+0000 7fc6064a9640 1 -- 10.20.193.5:0/1195727091 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6001f3580 con 0x7fc60015d370 2026-02-17T21:29:19.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.774+0000 7fc6064a9640 10 client.5014.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:29:19.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.774+0000 7fc6064a9640 10 monclient: _renew_subs 2026-02-17T21:29:19.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.774+0000 7fc6064a9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:29:19.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.774+0000 7fc6064a9640 1 -- 10.20.193.5:0/1195727091 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6001f3b20 con 0x7fc60015d370 2026-02-17T21:29:19.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.774+0000 7fc6064a9640 1 librados: init done 2026-02-17T21:29:19.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.774+0000 7fc6064a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:19.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.774+0000 7fc6064a9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:19.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.774+0000 7fc6064a9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:29:19.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.774+0000 7fc6064a9640 1 -- 10.20.193.5:0/1195727091 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc60015d750 con 0x7fc60015d370 2026-02-17T21:29:19.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.775+0000 7fc5fcff9640 1 -- 10.20.193.5:0/1195727091 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f4048070 con 0x7fc60015d370 2026-02-17T21:29:19.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.775+0000 7fc5fcff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:19.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.775+0000 7fc5fcff9640 1 -- 10.20.193.5:0/1195727091 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4041a10 con 0x7fc60015d370 2026-02-17T21:29:19.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.775+0000 7fc5fcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:19.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.775+0000 7fc5fcff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:29:19.789 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.775+0000 7fc5fcff9640 10 monclient: dump: 2026-02-17T21:29:19.789 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:19.789 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:19.789 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:19.789 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:19.789 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:19.789 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:19.789 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:19.789 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:19.789 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:19.790 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:19.790 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.775+0000 7fc5fe7fc640 4 set_mon_vals no callback set 2026-02-17T21:29:19.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.882+0000 7fc5fcff9640 1 -- 10.20.193.5:0/1195727091 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fc5f4041bb0 con 0x7fc60015d370 2026-02-17T21:29:19.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.883+0000 7fc5fcff9640 1 --2- 10.20.193.5:0/1195727091 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc5d0079280 0x7fc5d007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:19.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.883+0000 7fc5fffff640 1 --2- 10.20.193.5:0/1195727091 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc5d0079280 0x7fc5d007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:19.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.883+0000 7fc5fffff640 10 monclient: get_auth_request con 0x7fc5d0079280 auth_method 0 2026-02-17T21:29:19.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.883+0000 7fc5fffff640 1 --2- 10.20.193.5:0/1195727091 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc5d0079280 0x7fc5d007b740 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec002770 tx=0x7fc5ec007ef0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:19.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.883+0000 7fc5fcff9640 10 client.5014.objecter ms_handle_connect 0x7fc5d0079280 2026-02-17T21:29:19.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.885+0000 7fc5fcff9640 1 -- 10.20.193.5:0/1195727091 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fc5f40847b0 con 0x7fc60015d370 2026-02-17T21:29:19.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.885+0000 7fc5fcff9640 10 client.5014.objecter ms_dispatch2 0x7fc600000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:29:19.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.885+0000 7fc5fcff9640 3 client.5014.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:29:19.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.885+0000 7fc5fcff9640 3 client.5014.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:29:19.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.885+0000 7fc5fcff9640 20 client.5014.objecter dump_active .. 0 homeless 2026-02-17T21:29:19.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.891+0000 7fc5fcff9640 1 -- 10.20.193.5:0/1195727091 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc5f4088770 con 0x7fc60015d370 2026-02-17T21:29:19.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.891+0000 7fc5fcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:19.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.891+0000 7fc5fcff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:29:19.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.991+0000 7fc6064a9640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:29:19.993 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.991+0000 7fc6064a9640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:19.993 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.991+0000 7fc6064a9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:29:19.993 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.991+0000 7fc6064a9640 1 -- 10.20.193.5:0/1195727091 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc60015df90 con 0x7fc60015d370 2026-02-17T21:29:19.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.994+0000 7fc5fcff9640 1 -- 10.20.193.5:0/1195727091 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fc5f408ca70 con 0x7fc60015d370 2026-02-17T21:29:19.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.994+0000 7fc5fcff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:19.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.994+0000 7fc5fcff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:29:19.996 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:29:19.996 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:29:19.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.995+0000 7fc6064a9640 10 librados: watch_flush enter 2026-02-17T21:29:19.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.995+0000 7fc6064a9640 10 librados: watch_flush exit 2026-02-17T21:29:19.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.995+0000 7fc6064a9640 20 client.5014.objecter shutdown clearing up homeless session... 2026-02-17T21:29:19.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.995+0000 7fc6064a9640 10 client.5014.objecter successfully canceled tick 2026-02-17T21:29:19.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.995+0000 7fc6064a9640 1 -- 10.20.193.5:0/1195727091 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc5d0079280 msgr2=0x7fc5d007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:19.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.995+0000 7fc6064a9640 1 --2- 10.20.193.5:0/1195727091 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc5d0079280 0x7fc5d007b740 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec002770 tx=0x7fc5ec007ef0 comp rx=0 tx=0).stop 2026-02-17T21:29:19.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.995+0000 7fc6064a9640 10 monclient: shutdown 2026-02-17T21:29:19.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.995+0000 7fc6064a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:19.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.995+0000 7fc6064a9640 1 -- 10.20.193.5:0/1195727091 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc60015d370 msgr2=0x7fc600149780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:19.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.995+0000 7fc6064a9640 1 --2- 10.20.193.5:0/1195727091 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc60015d370 0x7fc600149780 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc5f403a040 tx=0x7fc5f4004b40 comp rx=0 tx=0).stop 2026-02-17T21:29:19.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.995+0000 7fc6064a9640 1 -- 10.20.193.5:0/1195727091 shutdown_connections 2026-02-17T21:29:19.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.995+0000 7fc6064a9640 1 --2- 10.20.193.5:0/1195727091 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc5d0079280 0x7fc5d007b740 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:19.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.995+0000 7fc6064a9640 1 --2- 10.20.193.5:0/1195727091 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc60015d370 0x7fc600149780 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:19.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.995+0000 7fc6064a9640 1 --2- 10.20.193.5:0/1195727091 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc6000c7e20 0x7fc600149240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:19.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.995+0000 7fc6064a9640 1 --2- 10.20.193.5:0/1195727091 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc6000c59c0 0x7fc6000cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:19.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.995+0000 7fc6064a9640 1 -- 10.20.193.5:0/1195727091 >> 10.20.193.5:0/1195727091 conn(0x7fc6000c9f20 msgr2=0x7fc600150070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:19.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.995+0000 7fc6064a9640 1 -- 10.20.193.5:0/1195727091 shutdown_connections 2026-02-17T21:29:19.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.995+0000 7fc6064a9640 1 -- 10.20.193.5:0/1195727091 wait complete. 2026-02-17T21:29:19.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:19.995+0000 7fc6064a9640 1 librados: shutdown 2026-02-17T21:29:23.004 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:29:23.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.072+0000 7f01af9e7640 10 monclient: get_monmap_and_config 2026-02-17T21:29:23.074 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.072+0000 7f01af9e7640 10 monclient: build_initial_monmap 2026-02-17T21:29:23.074 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.072+0000 7f01af9e7640 10 monclient: monmap: 2026-02-17T21:29:23.074 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:23.074 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:23.074 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:29:23.072865+0000 2026-02-17T21:29:23.074 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:29:23.072865+0000 2026-02-17T21:29:23.074 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:23.075 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:23.075 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:29:23.075 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:29:23.075 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:29:23.075 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:29:23.075 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:29:23.075 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:29:23.075 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:23.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.072+0000 7f01af9e7640 1 Processor -- start 2026-02-17T21:29:23.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.072+0000 7f01af9e7640 1 -- start start 2026-02-17T21:29:23.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.072+0000 7f01af9e7640 10 monclient: init 2026-02-17T21:29:23.084 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01af9e7640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:23.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01af9e7640 10 monclient: _add_conns ranks=[4,3,0,5,1,2] 2026-02-17T21:29:23.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01af9e7640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f01a815d370 0x7f01a815d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:23.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01af9e7640 10 monclient(hunting): picked mon.noname-b con 0x7f01a815d370 addr v2:10.20.193.119:3300/0 2026-02-17T21:29:23.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01af9e7640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f01a80c7e20 0x7f01a80c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:23.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01af9e7640 10 monclient(hunting): picked mon.noname-a con 0x7f01a80c7e20 addr v2:10.20.193.5:3300/0 2026-02-17T21:29:23.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01af9e7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f01a815b000 addr v1:10.20.193.5:6789/0 2026-02-17T21:29:23.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01af9e7640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01a80c8350 con 0x7f01a815b000 2026-02-17T21:29:23.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01af9e7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:23.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01af9e7640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f01a80c9240 con 0x7f01a80c7e20 2026-02-17T21:29:23.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01af9e7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:23.085 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01af9e7640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f01a80c8630 con 0x7f01a815d370 2026-02-17T21:29:23.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01af9e7640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:23.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01af9e7640 10 monclient(hunting): authenticate will time out at 1268.638171s 2026-02-17T21:29:23.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01ad75c640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f01a815d370 0x7f01a815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:23.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01acf5b640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f01a80c7e20 0x7f01a80c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:23.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01acf5b640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f01a80c7e20 0x7f01a80c74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:52336/0 (socket says 10.20.193.5:52336) 2026-02-17T21:29:23.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01acf5b640 1 -- 10.20.193.5:0/3856787726 learned_addr learned my addr 10.20.193.5:0/3856787726 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:29:23.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01acf5b640 10 monclient(hunting): get_auth_request con 0x7f01a80c7e20 auth_method 0 2026-02-17T21:29:23.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01acf5b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:23.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01acf5b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:23.086 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01acf5b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:23.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01ad75c640 10 monclient(hunting): get_auth_request con 0x7f01a815d370 auth_method 0 2026-02-17T21:29:23.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01ad75c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:23.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01ad75c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:23.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.073+0000 7f01ad75c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:23.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.074+0000 7f01ad75c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:23.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.074+0000 7f01ad75c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:23.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.074+0000 7f01ad75c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:23.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.074+0000 7f01acf5b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:23.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.074+0000 7f01acf5b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:23.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.074+0000 7f01acf5b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:23.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.075+0000 7f01ad75c640 10 monclient(hunting): handle_auth_done global_id 5017 payload 274 2026-02-17T21:29:23.087 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.075+0000 7f01ad75c640 1 -- 10.20.193.5:0/3856787726 >> v2:10.20.193.5:3300/0 conn(0x7f01a80c7e20 msgr2=0x7f01a80c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:29:23.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.075+0000 7f01ad75c640 1 --2- 10.20.193.5:0/3856787726 >> v2:10.20.193.5:3300/0 conn(0x7f01a80c7e20 0x7f01a80c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:23.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.075+0000 7f01ad75c640 1 -- 10.20.193.5:0/3856787726 >> v1:10.20.193.5:6789/0 conn(0x7f01a815b000 legacy=0x7f01a80c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:29:23.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.075+0000 7f01ad75c640 10 monclient: _finish_hunting 0 2026-02-17T21:29:23.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.075+0000 7f01ad75c640 1 monclient: found mon.noname-b 2026-02-17T21:29:23.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.075+0000 7f01ad75c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:23.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.075+0000 7f01ad75c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:29:23.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.075+0000 7f01ad75c640 1 -- 10.20.193.5:0/3856787726 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a80c8910 con 0x7f01a815d370 2026-02-17T21:29:23.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.076+0000 7f01ad75c640 1 --2- 10.20.193.5:0/3856787726 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f01a815d370 0x7f01a815d750 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f01a80698d0 tx=0x7f019802ede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bf307cdb14072ef server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:23.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f0197fff640 1 -- 10.20.193.5:0/3856787726 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019803c070 con 0x7f01a815d370 2026-02-17T21:29:23.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f0197fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:23.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f0197fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:29:23.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f0197fff640 10 monclient: dump: 2026-02-17T21:29:23.089 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:23.089 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:23.089 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:23.089 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:23.089 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:23.089 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:23.089 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:23.089 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:23.089 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:23.089 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:23.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f0197fff640 10 monclient: _finish_auth 0 2026-02-17T21:29:23.089 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f0197fff640 10 monclient: _check_auth_tickets 2026-02-17T21:29:23.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f0197fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:23.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f0197fff640 1 -- 10.20.193.5:0/3856787726 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f019802fa50 con 0x7f01a815d370 2026-02-17T21:29:23.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f0197fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:23.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f0197fff640 1 -- 10.20.193.5:0/3856787726 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019802fe20 con 0x7f01a815d370 2026-02-17T21:29:23.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f0197fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:23.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f0197fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:29:23.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f0197fff640 10 monclient: dump: 2026-02-17T21:29:23.090 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:23.090 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:23.090 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:23.090 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:23.090 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:23.091 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:23.091 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:23.091 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:23.091 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:23.091 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:23.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f01af9e7640 5 monclient: authenticate success, global_id 5017 2026-02-17T21:29:23.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f01af9e7640 10 monclient: get_monmap_and_config success 2026-02-17T21:29:23.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f01af9e7640 4 set_mon_vals no callback set 2026-02-17T21:29:23.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f01af9e7640 10 monclient: shutdown 2026-02-17T21:29:23.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f01af9e7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:23.091 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f01af9e7640 1 -- 10.20.193.5:0/3856787726 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f01a815d370 msgr2=0x7f01a815d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:23.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f01af9e7640 1 --2- 10.20.193.5:0/3856787726 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f01a815d370 0x7f01a815d750 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f01a80698d0 tx=0x7f019802ede0 comp rx=0 tx=0).stop 2026-02-17T21:29:23.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f01af9e7640 1 -- 10.20.193.5:0/3856787726 shutdown_connections 2026-02-17T21:29:23.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f01af9e7640 1 --2- 10.20.193.5:0/3856787726 >> v2:10.20.193.5:3300/0 conn(0x7f01a80c7e20 0x7f01a80c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:23.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f01af9e7640 1 --2- 10.20.193.5:0/3856787726 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f01a815d370 0x7f01a815d750 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:23.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f01af9e7640 1 -- 10.20.193.5:0/3856787726 >> 10.20.193.5:0/3856787726 conn(0x7f01a80c9f20 msgr2=0x7f01a80ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:23.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f01af9e7640 1 -- 10.20.193.5:0/3856787726 shutdown_connections 2026-02-17T21:29:23.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.078+0000 7f01af9e7640 1 -- 10.20.193.5:0/3856787726 wait complete. 2026-02-17T21:29:23.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01af9e7640 10 monclient: build_initial_monmap 2026-02-17T21:29:23.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01af9e7640 10 monclient: monmap: 2026-02-17T21:29:23.092 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:23.092 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:29:23.092 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:29:23.093 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:29:23.093 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:23.093 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:23.093 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:29:23.093 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:29:23.093 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:29:23.093 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:23.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01af9e7640 1 librados: starting msgr at 2026-02-17T21:29:23.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01af9e7640 1 librados: starting objecter 2026-02-17T21:29:23.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01af9e7640 1 Processor -- start 2026-02-17T21:29:23.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01af9e7640 1 -- start start 2026-02-17T21:29:23.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01af9e7640 1 librados: setting wanted keys 2026-02-17T21:29:23.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01af9e7640 1 librados: calling monclient init 2026-02-17T21:29:23.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01af9e7640 10 monclient: init 2026-02-17T21:29:23.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01af9e7640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:23.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01af9e7640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:29:23.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01af9e7640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f01a80c7e20 0x7f01a8074730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:23.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01af9e7640 10 monclient(hunting): picked mon.noname-c con 0x7f01a80c7e20 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:29:23.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01af9e7640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f01a815b000 0x7f01a80cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:23.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01af9e7640 10 monclient(hunting): picked mon.noname-a con 0x7f01a815b000 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:29:23.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01af9e7640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f01a815d370 0x7f01a80cc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:23.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01af9e7640 10 monclient(hunting): picked mon.noname-b con 0x7f01a815d370 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:29:23.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01af9e7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:23.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01af9e7640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f01a80c96d0 con 0x7f01a815b000 2026-02-17T21:29:23.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01af9e7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:23.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01af9e7640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f01a80c8ed0 con 0x7f01a815d370 2026-02-17T21:29:23.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01af9e7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:23.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01af9e7640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f01a81f1800 con 0x7f01a80c7e20 2026-02-17T21:29:23.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01af9e7640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:23.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01af9e7640 10 monclient(hunting): authenticate will time out at 1268.644726s 2026-02-17T21:29:23.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.079+0000 7f01acf5b640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f01a815b000 0x7f01a80cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:23.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.080+0000 7f01adf5d640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f01a815d370 0x7f01a80cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:23.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.080+0000 7f01acf5b640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f01a815b000 0x7f01a80cc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:52338/0 (socket says 10.20.193.5:52338) 2026-02-17T21:29:23.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.080+0000 7f01acf5b640 1 -- 10.20.193.5:0/638311505 learned_addr learned my addr 10.20.193.5:0/638311505 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:29:23.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.080+0000 7f01acf5b640 10 monclient(hunting): get_auth_request con 0x7f01a815b000 auth_method 0 2026-02-17T21:29:23.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.080+0000 7f01acf5b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:23.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.080+0000 7f01acf5b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:23.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.080+0000 7f01acf5b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:23.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.080+0000 7f01adf5d640 10 monclient(hunting): get_auth_request con 0x7f01a815d370 auth_method 0 2026-02-17T21:29:23.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.080+0000 7f01adf5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:23.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.080+0000 7f01adf5d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:23.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.080+0000 7f01adf5d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:23.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.080+0000 7f01ad75c640 1 --2- 10.20.193.5:0/638311505 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f01a80c7e20 0x7f01a8074730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:23.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.080+0000 7f01acf5b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:23.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.080+0000 7f01acf5b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:23.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.080+0000 7f01acf5b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:23.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.080+0000 7f01adf5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:23.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.080+0000 7f01adf5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:23.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.080+0000 7f01adf5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:23.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.080+0000 7f01ad75c640 10 monclient(hunting): get_auth_request con 0x7f01a80c7e20 auth_method 0 2026-02-17T21:29:23.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.080+0000 7f01ad75c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:23.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.080+0000 7f01ad75c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:23.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.080+0000 7f01ad75c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:23.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.080+0000 7f01ad75c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:23.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.080+0000 7f01ad75c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:23.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.080+0000 7f01ad75c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:23.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.081+0000 7f01acf5b640 10 monclient(hunting): handle_auth_done global_id 4971 payload 824 2026-02-17T21:29:23.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.081+0000 7f01acf5b640 1 -- 10.20.193.5:0/638311505 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f01a80c7e20 msgr2=0x7f01a8074730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:23.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.081+0000 7f01acf5b640 1 --2- 10.20.193.5:0/638311505 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f01a80c7e20 0x7f01a8074730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:23.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.081+0000 7f01acf5b640 1 -- 10.20.193.5:0/638311505 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f01a815d370 msgr2=0x7f01a80cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:23.097 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.081+0000 7f01acf5b640 1 --2- 10.20.193.5:0/638311505 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f01a815d370 0x7f01a80cc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:23.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.081+0000 7f01acf5b640 10 monclient: _finish_hunting 0 2026-02-17T21:29:23.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.081+0000 7f01acf5b640 1 monclient: found mon.noname-a 2026-02-17T21:29:23.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.081+0000 7f01acf5b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:23.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.081+0000 7f01acf5b640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:29:23.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.081+0000 7f01acf5b640 1 -- 10.20.193.5:0/638311505 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a8159e10 con 0x7f01a815b000 2026-02-17T21:29:23.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.082+0000 7f01acf5b640 1 --2- 10.20.193.5:0/638311505 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f01a815b000 0x7f01a80cc200 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f019c00e930 tx=0x7f019c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:23.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.082+0000 7f0195ffb640 10 client.?.objecter ms_handle_connect 0x7f01a815b000 2026-02-17T21:29:23.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.082+0000 7f0195ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:29:23.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.084+0000 7f0195ffb640 1 -- 10.20.193.5:0/638311505 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019c017070 con 0x7f01a815b000 2026-02-17T21:29:23.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.084+0000 7f0195ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:23.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.084+0000 7f0195ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:29:23.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.084+0000 7f0195ffb640 10 monclient: dump: 2026-02-17T21:29:23.101 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:23.101 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:23.101 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:23.101 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:23.101 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:23.101 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:23.101 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:23.101 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:23.101 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:23.101 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:23.101 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.084+0000 7f0195ffb640 10 monclient: _finish_auth 0 2026-02-17T21:29:23.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.084+0000 7f0195ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:29:23.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.084+0000 7f0195ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:23.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.084+0000 7f0195ffb640 1 -- 10.20.193.5:0/638311505 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f019c00ca00 con 0x7f01a815b000 2026-02-17T21:29:23.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.084+0000 7f01af9e7640 5 monclient: authenticate success, global_id 4971 2026-02-17T21:29:23.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.084+0000 7f01af9e7640 10 monclient: _renew_subs 2026-02-17T21:29:23.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.084+0000 7f01af9e7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:23.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.084+0000 7f01af9e7640 1 -- 10.20.193.5:0/638311505 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01a8159b30 con 0x7f01a815b000 2026-02-17T21:29:23.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.084+0000 7f0195ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:23.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.084+0000 7f0195ffb640 1 -- 10.20.193.5:0/638311505 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019c00cdf0 con 0x7f01a815b000 2026-02-17T21:29:23.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.084+0000 7f0195ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:23.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.084+0000 7f0195ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:29:23.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.084+0000 7f0195ffb640 10 monclient: dump: 2026-02-17T21:29:23.102 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:23.103 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:23.103 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:23.103 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:23.103 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:23.103 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:23.103 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:23.103 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:23.103 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:23.103 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:23.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.084+0000 7f01977fe640 4 set_mon_vals no callback set 2026-02-17T21:29:23.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.084+0000 7f01af9e7640 10 client.4971.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:29:23.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.084+0000 7f01af9e7640 10 monclient: _renew_subs 2026-02-17T21:29:23.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.084+0000 7f01af9e7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:23.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.084+0000 7f01af9e7640 1 -- 10.20.193.5:0/638311505 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01a80cb720 con 0x7f01a815b000 2026-02-17T21:29:23.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.084+0000 7f01af9e7640 1 librados: init done 2026-02-17T21:29:23.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.085+0000 7f01af9e7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:23.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.085+0000 7f01af9e7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:23.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.085+0000 7f01af9e7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:23.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.085+0000 7f01af9e7640 1 -- 10.20.193.5:0/638311505 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01a815b490 con 0x7f01a815b000 2026-02-17T21:29:23.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.188+0000 7f0195ffb640 1 -- 10.20.193.5:0/638311505 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f019c024060 con 0x7f01a815b000 2026-02-17T21:29:23.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.189+0000 7f0195ffb640 1 --2- 10.20.193.5:0/638311505 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0178079280 0x7f017807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:23.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.189+0000 7f01ad75c640 1 --2- 10.20.193.5:0/638311505 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0178079280 0x7f017807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:23.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.189+0000 7f01ad75c640 10 monclient: get_auth_request con 0x7f0178079280 auth_method 0 2026-02-17T21:29:23.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.190+0000 7f01ad75c640 1 --2- 10.20.193.5:0/638311505 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0178079280 0x7f017807b740 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0198039000 tx=0x7f0198033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:23.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.190+0000 7f0195ffb640 10 client.4971.objecter ms_handle_connect 0x7f0178079280 2026-02-17T21:29:23.197 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.196+0000 7f0195ffb640 1 -- 10.20.193.5:0/638311505 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f019c05e510 con 0x7f01a815b000 2026-02-17T21:29:23.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.196+0000 7f0195ffb640 10 client.4971.objecter ms_dispatch2 0x7f01a8000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:29:23.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.196+0000 7f0195ffb640 3 client.4971.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:29:23.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.196+0000 7f0195ffb640 3 client.4971.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:29:23.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.196+0000 7f0195ffb640 20 client.4971.objecter dump_active .. 0 homeless 2026-02-17T21:29:23.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.196+0000 7f0195ffb640 1 -- 10.20.193.5:0/638311505 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f019c0624d0 con 0x7f01a815b000 2026-02-17T21:29:23.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.196+0000 7f0195ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:23.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.196+0000 7f0195ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:29:23.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.297+0000 7f01af9e7640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:29:23.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.297+0000 7f01af9e7640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:23.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.297+0000 7f01af9e7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:23.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.297+0000 7f01af9e7640 1 -- 10.20.193.5:0/638311505 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f01a8070250 con 0x7f01a815b000 2026-02-17T21:29:23.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.301+0000 7f0195ffb640 1 -- 10.20.193.5:0/638311505 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f019c0667d0 con 0x7f01a815b000 2026-02-17T21:29:23.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.301+0000 7f0195ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:23.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.301+0000 7f0195ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:29:23.302 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:29:23.303 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:29:23.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.302+0000 7f01af9e7640 10 librados: watch_flush enter 2026-02-17T21:29:23.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.302+0000 7f01af9e7640 10 librados: watch_flush exit 2026-02-17T21:29:23.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.302+0000 7f01af9e7640 20 client.4971.objecter shutdown clearing up homeless session... 2026-02-17T21:29:23.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.302+0000 7f01af9e7640 10 client.4971.objecter successfully canceled tick 2026-02-17T21:29:23.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.302+0000 7f01af9e7640 1 -- 10.20.193.5:0/638311505 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0178079280 msgr2=0x7f017807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:23.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.302+0000 7f01af9e7640 1 --2- 10.20.193.5:0/638311505 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0178079280 0x7f017807b740 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0198039000 tx=0x7f0198033000 comp rx=0 tx=0).stop 2026-02-17T21:29:23.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.302+0000 7f01af9e7640 10 monclient: shutdown 2026-02-17T21:29:23.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.302+0000 7f01af9e7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:23.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.302+0000 7f01af9e7640 1 -- 10.20.193.5:0/638311505 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f01a815b000 msgr2=0x7f01a80cc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:23.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.302+0000 7f01af9e7640 1 --2- 10.20.193.5:0/638311505 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f01a815b000 0x7f01a80cc200 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f019c00e930 tx=0x7f019c00ee00 comp rx=0 tx=0).stop 2026-02-17T21:29:23.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.302+0000 7f01af9e7640 1 -- 10.20.193.5:0/638311505 shutdown_connections 2026-02-17T21:29:23.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.302+0000 7f01af9e7640 1 --2- 10.20.193.5:0/638311505 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0178079280 0x7f017807b740 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:23.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.302+0000 7f01af9e7640 1 --2- 10.20.193.5:0/638311505 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f01a815d370 0x7f01a80cc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:23.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.302+0000 7f01af9e7640 1 --2- 10.20.193.5:0/638311505 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f01a815b000 0x7f01a80cc200 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:23.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.302+0000 7f01af9e7640 1 --2- 10.20.193.5:0/638311505 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f01a80c7e20 0x7f01a8074730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:23.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.302+0000 7f01af9e7640 1 -- 10.20.193.5:0/638311505 >> 10.20.193.5:0/638311505 conn(0x7f01a80c9f20 msgr2=0x7f01a815dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:23.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.302+0000 7f01af9e7640 1 -- 10.20.193.5:0/638311505 shutdown_connections 2026-02-17T21:29:23.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.302+0000 7f01af9e7640 1 -- 10.20.193.5:0/638311505 wait complete. 2026-02-17T21:29:23.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:23.302+0000 7f01af9e7640 1 librados: shutdown 2026-02-17T21:29:26.313 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:29:26.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.381+0000 7f1deebce640 10 monclient: get_monmap_and_config 2026-02-17T21:29:26.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.381+0000 7f1deebce640 10 monclient: build_initial_monmap 2026-02-17T21:29:26.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.381+0000 7f1deebce640 10 monclient: monmap: 2026-02-17T21:29:26.384 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:26.384 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:26.384 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:29:26.382481+0000 2026-02-17T21:29:26.384 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:29:26.382481+0000 2026-02-17T21:29:26.384 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:26.384 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:26.384 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:29:26.384 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:29:26.384 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:29:26.385 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:29:26.385 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:29:26.385 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:29:26.385 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:26.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.382+0000 7f1deebce640 1 Processor -- start 2026-02-17T21:29:26.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.382+0000 7f1deebce640 1 -- start start 2026-02-17T21:29:26.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.382+0000 7f1deebce640 10 monclient: init 2026-02-17T21:29:26.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.382+0000 7f1deebce640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:26.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.382+0000 7f1deebce640 10 monclient: _add_conns ranks=[1,3,4,5,0,2] 2026-02-17T21:29:26.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.382+0000 7f1deebce640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f1de815d370 addr v1:10.20.193.119:6789/0 2026-02-17T21:29:26.388 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.382+0000 7f1deebce640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f1de80c7e20 0x7f1de815d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:26.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.382+0000 7f1deebce640 10 monclient(hunting): picked mon.noname-a con 0x7f1de80c7e20 addr v2:10.20.193.5:3300/0 2026-02-17T21:29:26.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.382+0000 7f1deebce640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f1de80c74c0 0x7f1de80c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:26.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.382+0000 7f1deebce640 10 monclient(hunting): picked mon.noname-b con 0x7f1de80c74c0 addr v2:10.20.193.119:3300/0 2026-02-17T21:29:26.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.382+0000 7f1deebce640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1de80c8350 con 0x7f1de815d370 2026-02-17T21:29:26.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.382+0000 7f1deebce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:26.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.382+0000 7f1deebce640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f1de815b710 con 0x7f1de80c7e20 2026-02-17T21:29:26.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.382+0000 7f1deebce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:26.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.382+0000 7f1deebce640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f1de80c9240 con 0x7f1de80c74c0 2026-02-17T21:29:26.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.382+0000 7f1deebce640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:26.389 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.382+0000 7f1deebce640 10 monclient(hunting): authenticate will time out at 1271.947769s 2026-02-17T21:29:26.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.383+0000 7f1ddffff640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f1de80c7e20 0x7f1de815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:26.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.383+0000 7f1ded144640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f1de80c74c0 0x7f1de80c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:26.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.383+0000 7f1ddffff640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f1de80c7e20 0x7f1de815d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:52352/0 (socket says 10.20.193.5:52352) 2026-02-17T21:29:26.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.383+0000 7f1ddffff640 1 -- 10.20.193.5:0/2996868492 learned_addr learned my addr 10.20.193.5:0/2996868492 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:29:26.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.383+0000 7f1ddffff640 10 monclient(hunting): get_auth_request con 0x7f1de80c7e20 auth_method 0 2026-02-17T21:29:26.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.383+0000 7f1ddffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:26.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.383+0000 7f1ddffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:26.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.383+0000 7f1ddffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:26.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.383+0000 7f1ded144640 10 monclient(hunting): get_auth_request con 0x7f1de80c74c0 auth_method 0 2026-02-17T21:29:26.390 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.383+0000 7f1ded144640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:26.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.383+0000 7f1ded144640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:26.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.383+0000 7f1ded144640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:26.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.383+0000 7f1ddffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:26.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.383+0000 7f1ddffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:26.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.383+0000 7f1ddffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:26.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.384+0000 7f1ded144640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:26.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.384+0000 7f1ded144640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:26.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.384+0000 7f1ded144640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:26.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.384+0000 7f1ddffff640 10 monclient(hunting): handle_auth_done global_id 4974 payload 274 2026-02-17T21:29:26.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.384+0000 7f1ddffff640 1 -- 10.20.193.5:0/2996868492 >> v2:10.20.193.119:3300/0 conn(0x7f1de80c74c0 msgr2=0x7f1de80c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:29:26.391 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.384+0000 7f1ddffff640 1 --2- 10.20.193.5:0/2996868492 >> v2:10.20.193.119:3300/0 conn(0x7f1de80c74c0 0x7f1de80c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:26.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.384+0000 7f1ddffff640 1 -- 10.20.193.5:0/2996868492 >> v1:10.20.193.119:6789/0 conn(0x7f1de815d370 legacy=0x7f1de815b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:26.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.384+0000 7f1ddffff640 10 monclient: _finish_hunting 0 2026-02-17T21:29:26.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.384+0000 7f1ddffff640 1 monclient: found mon.noname-a 2026-02-17T21:29:26.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.384+0000 7f1ddffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:26.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.384+0000 7f1ddffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:29:26.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.384+0000 7f1ddffff640 1 -- 10.20.193.5:0/2996868492 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de80c8630 con 0x7f1de80c7e20 2026-02-17T21:29:26.392 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.385+0000 7f1ddffff640 1 --2- 10.20.193.5:0/2996868492 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1de80c7e20 0x7f1de815d750 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1de815dcf0 tx=0x7f1dd002eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df2f03f992ba9e1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:26.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.387+0000 7f1ddf7fe640 1 -- 10.20.193.5:0/2996868492 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd003c070 con 0x7f1de80c7e20 2026-02-17T21:29:26.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.387+0000 7f1ddf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:26.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.387+0000 7f1ddf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:29:26.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.387+0000 7f1ddf7fe640 10 monclient: dump: 2026-02-17T21:29:26.400 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:26.400 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:26.400 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:26.400 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:26.400 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:26.400 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:26.401 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:26.401 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:26.401 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:26.401 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:26.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.387+0000 7f1ddf7fe640 10 monclient: _finish_auth 0 2026-02-17T21:29:26.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.387+0000 7f1ddf7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:29:26.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.387+0000 7f1ddf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:26.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.387+0000 7f1ddf7fe640 1 -- 10.20.193.5:0/2996868492 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dd002fbe0 con 0x7f1de80c7e20 2026-02-17T21:29:26.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.387+0000 7f1ddf7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:26.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.387+0000 7f1ddf7fe640 1 -- 10.20.193.5:0/2996868492 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0037440 con 0x7f1de80c7e20 2026-02-17T21:29:26.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.387+0000 7f1ddf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:26.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.387+0000 7f1ddf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:29:26.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.387+0000 7f1ddf7fe640 10 monclient: dump: 2026-02-17T21:29:26.402 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:26.402 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:26.402 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:26.402 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:26.402 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:26.402 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:26.402 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:26.402 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:26.402 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:26.403 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:26.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.387+0000 7f1deebce640 5 monclient: authenticate success, global_id 4974 2026-02-17T21:29:26.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.387+0000 7f1deebce640 10 monclient: get_monmap_and_config success 2026-02-17T21:29:26.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.387+0000 7f1deebce640 4 set_mon_vals no callback set 2026-02-17T21:29:26.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.388+0000 7f1deebce640 10 monclient: shutdown 2026-02-17T21:29:26.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.388+0000 7f1deebce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:26.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.388+0000 7f1deebce640 1 -- 10.20.193.5:0/2996868492 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1de80c7e20 msgr2=0x7f1de815d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:26.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.388+0000 7f1deebce640 1 --2- 10.20.193.5:0/2996868492 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1de80c7e20 0x7f1de815d750 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1de815dcf0 tx=0x7f1dd002eed0 comp rx=0 tx=0).stop 2026-02-17T21:29:26.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.388+0000 7f1deebce640 1 -- 10.20.193.5:0/2996868492 shutdown_connections 2026-02-17T21:29:26.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.388+0000 7f1deebce640 1 --2- 10.20.193.5:0/2996868492 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1de80c7e20 0x7f1de815d750 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:26.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.388+0000 7f1deebce640 1 --2- 10.20.193.5:0/2996868492 >> v2:10.20.193.119:3300/0 conn(0x7f1de80c74c0 0x7f1de80c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:26.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.388+0000 7f1deebce640 1 -- 10.20.193.5:0/2996868492 >> 10.20.193.5:0/2996868492 conn(0x7f1de80c9f20 msgr2=0x7f1de80ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:26.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.388+0000 7f1deebce640 1 -- 10.20.193.5:0/2996868492 shutdown_connections 2026-02-17T21:29:26.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.388+0000 7f1deebce640 1 -- 10.20.193.5:0/2996868492 wait complete. 2026-02-17T21:29:26.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.388+0000 7f1deebce640 10 monclient: build_initial_monmap 2026-02-17T21:29:26.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.388+0000 7f1deebce640 10 monclient: monmap: 2026-02-17T21:29:26.404 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:26.404 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:29:26.404 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:29:26.404 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:29:26.405 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:26.405 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:26.405 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:29:26.405 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:29:26.405 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:29:26.405 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:26.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.389+0000 7f1deebce640 1 librados: starting msgr at 2026-02-17T21:29:26.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.389+0000 7f1deebce640 1 librados: starting objecter 2026-02-17T21:29:26.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.389+0000 7f1deebce640 1 Processor -- start 2026-02-17T21:29:26.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.389+0000 7f1deebce640 1 -- start start 2026-02-17T21:29:26.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.389+0000 7f1deebce640 1 librados: setting wanted keys 2026-02-17T21:29:26.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.389+0000 7f1deebce640 1 librados: calling monclient init 2026-02-17T21:29:26.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.389+0000 7f1deebce640 10 monclient: init 2026-02-17T21:29:26.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.389+0000 7f1deebce640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:26.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.389+0000 7f1deebce640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:29:26.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.389+0000 7f1deebce640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1de80c74c0 0x7f1de81439a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:26.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.389+0000 7f1deebce640 10 monclient(hunting): picked mon.noname-a con 0x7f1de80c74c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:29:26.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.389+0000 7f1deebce640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1de80c7e20 0x7f1de8159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:26.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.389+0000 7f1deebce640 10 monclient(hunting): picked mon.noname-c con 0x7f1de80c7e20 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:29:26.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.389+0000 7f1deebce640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1de815d370 0x7f1de8159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:26.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.389+0000 7f1deebce640 10 monclient(hunting): picked mon.noname-b con 0x7f1de815d370 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:29:26.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.389+0000 7f1deebce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:26.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.389+0000 7f1deebce640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1de80c8ed0 con 0x7f1de80c74c0 2026-02-17T21:29:26.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.389+0000 7f1deebce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:26.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.389+0000 7f1deebce640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1de80c8bf0 con 0x7f1de815d370 2026-02-17T21:29:26.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.389+0000 7f1deebce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:26.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.389+0000 7f1deebce640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1de80c96d0 con 0x7f1de80c7e20 2026-02-17T21:29:26.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.389+0000 7f1deebce640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:26.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.389+0000 7f1deebce640 10 monclient(hunting): authenticate will time out at 1271.954599s 2026-02-17T21:29:26.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.389+0000 7f1dec943640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1de80c74c0 0x7f1de81439a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:26.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.390+0000 7f1dec943640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1de80c74c0 0x7f1de81439a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:52356/0 (socket says 10.20.193.5:52356) 2026-02-17T21:29:26.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.390+0000 7f1dec943640 1 -- 10.20.193.5:0/2067152125 learned_addr learned my addr 10.20.193.5:0/2067152125 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:29:26.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.390+0000 7f1dec943640 10 monclient(hunting): get_auth_request con 0x7f1de80c74c0 auth_method 0 2026-02-17T21:29:26.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.390+0000 7f1dec943640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:26.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.390+0000 7f1dec943640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:26.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.390+0000 7f1dec943640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:26.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.390+0000 7f1ddffff640 1 --2- 10.20.193.5:0/2067152125 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1de80c7e20 0x7f1de8159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:26.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.390+0000 7f1ded144640 1 --2- 10.20.193.5:0/2067152125 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1de815d370 0x7f1de8159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:26.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.390+0000 7f1ded144640 10 monclient(hunting): get_auth_request con 0x7f1de815d370 auth_method 0 2026-02-17T21:29:26.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.390+0000 7f1ded144640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:26.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.390+0000 7f1ded144640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:26.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.390+0000 7f1ded144640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:26.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.390+0000 7f1dec943640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:26.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.390+0000 7f1dec943640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:26.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.390+0000 7f1dec943640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:26.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.390+0000 7f1ddffff640 10 monclient(hunting): get_auth_request con 0x7f1de80c7e20 auth_method 0 2026-02-17T21:29:26.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.390+0000 7f1ddffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:26.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.390+0000 7f1ddffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:26.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.390+0000 7f1ddffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:26.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.390+0000 7f1ded144640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:26.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.390+0000 7f1ded144640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:26.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.390+0000 7f1ded144640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:26.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.390+0000 7f1ddffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:26.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.390+0000 7f1ddffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:26.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.390+0000 7f1ddffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:26.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.391+0000 7f1dec943640 10 monclient(hunting): handle_auth_done global_id 4977 payload 824 2026-02-17T21:29:26.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.391+0000 7f1dec943640 1 -- 10.20.193.5:0/2067152125 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1de80c7e20 msgr2=0x7f1de8159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:26.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.391+0000 7f1dec943640 1 --2- 10.20.193.5:0/2067152125 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1de80c7e20 0x7f1de8159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:26.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.391+0000 7f1dec943640 1 -- 10.20.193.5:0/2067152125 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1de815d370 msgr2=0x7f1de8159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:26.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.391+0000 7f1dec943640 1 --2- 10.20.193.5:0/2067152125 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1de815d370 0x7f1de8159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:26.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.391+0000 7f1dec943640 10 monclient: _finish_hunting 0 2026-02-17T21:29:26.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.391+0000 7f1dec943640 1 monclient: found mon.noname-a 2026-02-17T21:29:26.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.391+0000 7f1dec943640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:26.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.391+0000 7f1dec943640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:29:26.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.391+0000 7f1dec943640 1 -- 10.20.193.5:0/2067152125 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de80736d0 con 0x7f1de80c74c0 2026-02-17T21:29:26.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.392+0000 7f1dec943640 1 --2- 10.20.193.5:0/2067152125 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1de80c74c0 0x7f1de81439a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800c5b0 tx=0x7f1dd800ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:26.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.392+0000 7f1ddd7fa640 10 client.?.objecter ms_handle_connect 0x7f1de80c74c0 2026-02-17T21:29:26.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.392+0000 7f1ddd7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:29:26.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.394+0000 7f1ddd7fa640 1 -- 10.20.193.5:0/2067152125 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd80052d0 con 0x7f1de80c74c0 2026-02-17T21:29:26.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.394+0000 7f1ddd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:26.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.394+0000 7f1ddd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:29:26.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.394+0000 7f1ddd7fa640 10 monclient: dump: 2026-02-17T21:29:26.411 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:26.411 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:26.411 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:26.411 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:26.412 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:26.412 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:26.412 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:26.412 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:26.412 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:26.412 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:26.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.394+0000 7f1ddd7fa640 10 monclient: _finish_auth 0 2026-02-17T21:29:26.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.394+0000 7f1ddd7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:29:26.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.394+0000 7f1ddd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:26.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.394+0000 7f1ddd7fa640 1 -- 10.20.193.5:0/2067152125 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dd8005470 con 0x7f1de80c74c0 2026-02-17T21:29:26.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.394+0000 7f1deebce640 5 monclient: authenticate success, global_id 4977 2026-02-17T21:29:26.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.394+0000 7f1deebce640 10 monclient: _renew_subs 2026-02-17T21:29:26.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.394+0000 7f1deebce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:26.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.394+0000 7f1deebce640 1 -- 10.20.193.5:0/2067152125 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1de8072870 con 0x7f1de80c74c0 2026-02-17T21:29:26.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.394+0000 7f1ddd7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:26.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.394+0000 7f1ddd7fa640 1 -- 10.20.193.5:0/2067152125 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd80038f0 con 0x7f1de80c74c0 2026-02-17T21:29:26.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.394+0000 7f1ddd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:26.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.394+0000 7f1ddd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:29:26.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.394+0000 7f1ddeffd640 4 set_mon_vals no callback set 2026-02-17T21:29:26.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.394+0000 7f1ddd7fa640 10 monclient: dump: 2026-02-17T21:29:26.413 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:26.413 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:26.414 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:26.414 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:26.414 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:26.414 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:26.414 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:26.414 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:26.414 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:26.414 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:26.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.394+0000 7f1deebce640 10 client.4977.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:29:26.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.394+0000 7f1deebce640 10 monclient: _renew_subs 2026-02-17T21:29:26.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.394+0000 7f1deebce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:26.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.394+0000 7f1deebce640 1 -- 10.20.193.5:0/2067152125 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1de8072e30 con 0x7f1de80c74c0 2026-02-17T21:29:26.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.394+0000 7f1deebce640 1 librados: init done 2026-02-17T21:29:26.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.395+0000 7f1deebce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:26.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.395+0000 7f1deebce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:26.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.395+0000 7f1deebce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:26.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.395+0000 7f1deebce640 1 -- 10.20.193.5:0/2067152125 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1de815d750 con 0x7f1de80c74c0 2026-02-17T21:29:26.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.407+0000 7f1ddd7fa640 1 -- 10.20.193.5:0/2067152125 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f1dd8003a90 con 0x7f1de80c74c0 2026-02-17T21:29:26.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.407+0000 7f1ddd7fa640 1 --2- 10.20.193.5:0/2067152125 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1db80792d0 0x7f1db807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:26.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.408+0000 7f1ddffff640 1 --2- 10.20.193.5:0/2067152125 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1db80792d0 0x7f1db807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:26.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.408+0000 7f1ddffff640 10 monclient: get_auth_request con 0x7f1db80792d0 auth_method 0 2026-02-17T21:29:26.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.408+0000 7f1ddffff640 1 --2- 10.20.193.5:0/2067152125 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1db80792d0 0x7f1db807b790 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1de80698d0 tx=0x7f1dd0039040 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:26.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.408+0000 7f1ddd7fa640 10 client.4977.objecter ms_handle_connect 0x7f1db80792d0 2026-02-17T21:29:26.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.409+0000 7f1ddd7fa640 1 -- 10.20.193.5:0/2067152125 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f1dd805e3e0 con 0x7f1de80c74c0 2026-02-17T21:29:26.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.409+0000 7f1ddd7fa640 10 client.4977.objecter ms_dispatch2 0x7f1de8000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:29:26.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.409+0000 7f1ddd7fa640 3 client.4977.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:29:26.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.409+0000 7f1ddd7fa640 3 client.4977.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:29:26.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.409+0000 7f1ddd7fa640 20 client.4977.objecter dump_active .. 0 homeless 2026-02-17T21:29:26.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.511+0000 7f1ddd7fa640 1 -- 10.20.193.5:0/2067152125 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1dd80623a0 con 0x7f1de80c74c0 2026-02-17T21:29:26.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.511+0000 7f1ddd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:26.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.511+0000 7f1ddd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:29:26.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.612+0000 7f1deebce640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:29:26.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.612+0000 7f1deebce640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:26.615 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.612+0000 7f1deebce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:26.615 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.612+0000 7f1deebce640 1 -- 10.20.193.5:0/2067152125 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1de8157530 con 0x7f1de80c74c0 2026-02-17T21:29:26.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.615+0000 7f1ddd7fa640 1 -- 10.20.193.5:0/2067152125 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f1dd80666a0 con 0x7f1de80c74c0 2026-02-17T21:29:26.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.615+0000 7f1ddd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:26.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.615+0000 7f1ddd7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:29:26.616 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:29:26.617 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:29:26.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.616+0000 7f1deebce640 10 librados: watch_flush enter 2026-02-17T21:29:26.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.616+0000 7f1deebce640 10 librados: watch_flush exit 2026-02-17T21:29:26.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.616+0000 7f1deebce640 20 client.4977.objecter shutdown clearing up homeless session... 2026-02-17T21:29:26.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.616+0000 7f1deebce640 10 client.4977.objecter successfully canceled tick 2026-02-17T21:29:26.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.616+0000 7f1deebce640 1 -- 10.20.193.5:0/2067152125 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1db80792d0 msgr2=0x7f1db807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:26.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.616+0000 7f1deebce640 1 --2- 10.20.193.5:0/2067152125 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1db80792d0 0x7f1db807b790 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1de80698d0 tx=0x7f1dd0039040 comp rx=0 tx=0).stop 2026-02-17T21:29:26.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.616+0000 7f1deebce640 10 monclient: shutdown 2026-02-17T21:29:26.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.616+0000 7f1deebce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:26.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.616+0000 7f1deebce640 1 -- 10.20.193.5:0/2067152125 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1de80c74c0 msgr2=0x7f1de81439a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:26.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.616+0000 7f1deebce640 1 --2- 10.20.193.5:0/2067152125 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1de80c74c0 0x7f1de81439a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800c5b0 tx=0x7f1dd800ca80 comp rx=0 tx=0).stop 2026-02-17T21:29:26.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.616+0000 7f1deebce640 1 -- 10.20.193.5:0/2067152125 shutdown_connections 2026-02-17T21:29:26.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.616+0000 7f1deebce640 1 --2- 10.20.193.5:0/2067152125 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1db80792d0 0x7f1db807b790 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:26.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.616+0000 7f1deebce640 1 --2- 10.20.193.5:0/2067152125 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1de815d370 0x7f1de8159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:26.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.616+0000 7f1deebce640 1 --2- 10.20.193.5:0/2067152125 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f1de80c7e20 0x7f1de8159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:26.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.616+0000 7f1deebce640 1 --2- 10.20.193.5:0/2067152125 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f1de80c74c0 0x7f1de81439a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:26.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.616+0000 7f1deebce640 1 -- 10.20.193.5:0/2067152125 >> 10.20.193.5:0/2067152125 conn(0x7f1de80c9f20 msgr2=0x7f1de80ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:26.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.616+0000 7f1deebce640 1 -- 10.20.193.5:0/2067152125 shutdown_connections 2026-02-17T21:29:26.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.617+0000 7f1deebce640 1 -- 10.20.193.5:0/2067152125 wait complete. 2026-02-17T21:29:26.621 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:26.617+0000 7f1deebce640 1 librados: shutdown 2026-02-17T21:29:29.628 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:29:29.697 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.695+0000 7f8794bdc640 10 monclient: get_monmap_and_config 2026-02-17T21:29:29.697 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.695+0000 7f8794bdc640 10 monclient: build_initial_monmap 2026-02-17T21:29:29.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.695+0000 7f8794bdc640 10 monclient: monmap: 2026-02-17T21:29:29.698 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:29.698 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:29.698 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:29:29.696472+0000 2026-02-17T21:29:29.698 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:29:29.696472+0000 2026-02-17T21:29:29.698 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:29.698 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:29.698 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:29:29.698 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:29:29.699 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:29:29.699 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:29:29.699 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:29:29.699 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:29:29.699 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:29.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.696+0000 7f8794bdc640 1 Processor -- start 2026-02-17T21:29:29.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.696+0000 7f8794bdc640 1 -- start start 2026-02-17T21:29:29.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.696+0000 7f8794bdc640 10 monclient: init 2026-02-17T21:29:29.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.696+0000 7f8794bdc640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:29.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.696+0000 7f8794bdc640 10 monclient: _add_conns ranks=[1,4,3,5,0,2] 2026-02-17T21:29:29.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.696+0000 7f8794bdc640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f879015d370 addr v1:10.20.193.119:6789/0 2026-02-17T21:29:29.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.696+0000 7f8794bdc640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f87900c7e20 0x7f879015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:29.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.696+0000 7f8794bdc640 10 monclient(hunting): picked mon.noname-b con 0x7f87900c7e20 addr v2:10.20.193.119:3300/0 2026-02-17T21:29:29.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.696+0000 7f8794bdc640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f87900c74c0 0x7f87900c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:29.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.696+0000 7f8794bdc640 10 monclient(hunting): picked mon.noname-a con 0x7f87900c74c0 addr v2:10.20.193.5:3300/0 2026-02-17T21:29:29.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.696+0000 7f8794bdc640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87900c8350 con 0x7f879015d370 2026-02-17T21:29:29.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.696+0000 7f8794bdc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:29.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.696+0000 7f8794bdc640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f879015b710 con 0x7f87900c74c0 2026-02-17T21:29:29.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.696+0000 7f8794bdc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:29.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.696+0000 7f8794bdc640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f87900c9240 con 0x7f87900c7e20 2026-02-17T21:29:29.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.696+0000 7f8794bdc640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:29.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.696+0000 7f8794bdc640 10 monclient(hunting): authenticate will time out at 1275.261811s 2026-02-17T21:29:29.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.697+0000 7f878ed76640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f87900c74c0 0x7f87900c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:29.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.697+0000 7f878dd74640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f87900c7e20 0x7f879015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:29.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.697+0000 7f878ed76640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f87900c74c0 0x7f87900c52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:53264/0 (socket says 10.20.193.5:53264) 2026-02-17T21:29:29.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.697+0000 7f878ed76640 1 -- 10.20.193.5:0/3073271703 learned_addr learned my addr 10.20.193.5:0/3073271703 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:29:29.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.697+0000 7f878ed76640 10 monclient(hunting): get_auth_request con 0x7f87900c74c0 auth_method 0 2026-02-17T21:29:29.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.697+0000 7f878ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:29.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.697+0000 7f878ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:29.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.697+0000 7f878ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:29.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.697+0000 7f878dd74640 10 monclient(hunting): get_auth_request con 0x7f87900c7e20 auth_method 0 2026-02-17T21:29:29.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.697+0000 7f878dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:29.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.697+0000 7f878dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:29.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.697+0000 7f878dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:29.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.697+0000 7f878ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:29.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.697+0000 7f878ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:29.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.697+0000 7f878ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:29.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.698+0000 7f878dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:29.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.698+0000 7f878dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:29.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.698+0000 7f878dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:29.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.698+0000 7f878ed76640 10 monclient(hunting): handle_auth_done global_id 4980 payload 274 2026-02-17T21:29:29.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.698+0000 7f878ed76640 1 -- 10.20.193.5:0/3073271703 >> v2:10.20.193.119:3300/0 conn(0x7f87900c7e20 msgr2=0x7f879015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:29:29.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.698+0000 7f878ed76640 1 --2- 10.20.193.5:0/3073271703 >> v2:10.20.193.119:3300/0 conn(0x7f87900c7e20 0x7f879015d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:29.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.698+0000 7f878ed76640 1 -- 10.20.193.5:0/3073271703 >> v1:10.20.193.119:6789/0 conn(0x7f879015d370 legacy=0x7f879015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:29.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.698+0000 7f878ed76640 10 monclient: _finish_hunting 0 2026-02-17T21:29:29.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.698+0000 7f878ed76640 1 monclient: found mon.noname-a 2026-02-17T21:29:29.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.698+0000 7f878ed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:29.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.698+0000 7f878ed76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:29:29.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.698+0000 7f878ed76640 1 -- 10.20.193.5:0/3073271703 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87900c8630 con 0x7f87900c74c0 2026-02-17T21:29:29.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.699+0000 7f878ed76640 1 --2- 10.20.193.5:0/3073271703 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f87900c74c0 0x7f87900c52b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f879015d060 tx=0x7f878002f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7033ccb6f454ea server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:29.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f878d573640 1 -- 10.20.193.5:0/3073271703 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878002fd70 con 0x7f87900c74c0 2026-02-17T21:29:29.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f878d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:29.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f878d573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:29:29.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f878d573640 10 monclient: dump: 2026-02-17T21:29:29.712 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:29.712 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:29.712 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:29.712 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:29.712 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:29.713 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:29.713 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:29.713 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:29.713 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:29.713 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:29.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f878d573640 10 monclient: _finish_auth 0 2026-02-17T21:29:29.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f878d573640 10 monclient: _check_auth_tickets 2026-02-17T21:29:29.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f878d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:29.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f878d573640 1 -- 10.20.193.5:0/3073271703 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87800373f0 con 0x7f87900c74c0 2026-02-17T21:29:29.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f8794bdc640 5 monclient: authenticate success, global_id 4980 2026-02-17T21:29:29.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f8794bdc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:29:29.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f878d573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:29.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f878d573640 1 -- 10.20.193.5:0/3073271703 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87800377c0 con 0x7f87900c74c0 2026-02-17T21:29:29.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f878d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:29.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f878d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:29:29.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f878d573640 10 monclient: dump: 2026-02-17T21:29:29.714 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:29.714 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:29.714 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:29.714 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:29.714 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:29.715 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:29.715 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:29.715 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:29.715 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:29.715 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:29.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f8794bdc640 10 monclient: get_monmap_and_config success 2026-02-17T21:29:29.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f8794bdc640 4 set_mon_vals no callback set 2026-02-17T21:29:29.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f8794bdc640 10 monclient: shutdown 2026-02-17T21:29:29.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f8794bdc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:29.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f8794bdc640 1 -- 10.20.193.5:0/3073271703 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f87900c74c0 msgr2=0x7f87900c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:29.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f8794bdc640 1 --2- 10.20.193.5:0/3073271703 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f87900c74c0 0x7f87900c52b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f879015d060 tx=0x7f878002f270 comp rx=0 tx=0).stop 2026-02-17T21:29:29.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f8794bdc640 1 -- 10.20.193.5:0/3073271703 shutdown_connections 2026-02-17T21:29:29.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f8794bdc640 1 --2- 10.20.193.5:0/3073271703 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f87900c74c0 0x7f87900c52b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:29.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f8794bdc640 1 --2- 10.20.193.5:0/3073271703 >> v2:10.20.193.119:3300/0 conn(0x7f87900c7e20 0x7f879015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:29.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f8794bdc640 1 -- 10.20.193.5:0/3073271703 >> 10.20.193.5:0/3073271703 conn(0x7f87900c9f20 msgr2=0x7f87900ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:29.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f8794bdc640 1 -- 10.20.193.5:0/3073271703 shutdown_connections 2026-02-17T21:29:29.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.701+0000 7f8794bdc640 1 -- 10.20.193.5:0/3073271703 wait complete. 2026-02-17T21:29:29.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.702+0000 7f8794bdc640 10 monclient: build_initial_monmap 2026-02-17T21:29:29.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.702+0000 7f8794bdc640 10 monclient: monmap: 2026-02-17T21:29:29.716 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:29.716 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:29:29.716 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:29:29.717 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:29:29.717 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:29.717 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:29.717 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:29:29.717 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:29:29.717 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:29:29.717 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:29.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.702+0000 7f8794bdc640 1 librados: starting msgr at 2026-02-17T21:29:29.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.702+0000 7f8794bdc640 1 librados: starting objecter 2026-02-17T21:29:29.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.702+0000 7f8794bdc640 1 Processor -- start 2026-02-17T21:29:29.718 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.702+0000 7f8794bdc640 1 -- start start 2026-02-17T21:29:29.718 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.702+0000 7f8794bdc640 1 librados: setting wanted keys 2026-02-17T21:29:29.718 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.702+0000 7f8794bdc640 1 librados: calling monclient init 2026-02-17T21:29:29.718 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.702+0000 7f8794bdc640 10 monclient: init 2026-02-17T21:29:29.718 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f8794bdc640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:29.718 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f8794bdc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:29:29.718 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f8794bdc640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f87900c74c0 0x7f87901f3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:29.718 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f8794bdc640 10 monclient(hunting): picked mon.noname-b con 0x7f87900c74c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:29:29.718 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f8794bdc640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f87900c7e20 0x7f879006d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:29.718 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f8794bdc640 10 monclient(hunting): picked mon.noname-a con 0x7f87900c7e20 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:29:29.718 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f8794bdc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f879015d370 0x7f87900cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:29.719 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f8794bdc640 10 monclient(hunting): picked mon.noname-c con 0x7f879015d370 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:29:29.719 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f8794bdc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:29.719 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f8794bdc640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f87900c8ed0 con 0x7f87900c7e20 2026-02-17T21:29:29.719 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f8794bdc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:29.719 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f8794bdc640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f87900c8bf0 con 0x7f87900c74c0 2026-02-17T21:29:29.719 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f8794bdc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:29.719 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f8794bdc640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f87900c96d0 con 0x7f879015d370 2026-02-17T21:29:29.719 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f8794bdc640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:29.719 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f8794bdc640 10 monclient(hunting): authenticate will time out at 1275.268240s 2026-02-17T21:29:29.719 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f878dd74640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f87900c7e20 0x7f879006d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:29.719 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f878dd74640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f87900c7e20 0x7f879006d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:53270/0 (socket says 10.20.193.5:53270) 2026-02-17T21:29:29.719 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f878dd74640 1 -- 10.20.193.5:0/2204466965 learned_addr learned my addr 10.20.193.5:0/2204466965 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:29:29.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f878dd74640 10 monclient(hunting): get_auth_request con 0x7f87900c7e20 auth_method 0 2026-02-17T21:29:29.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f878dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:29.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f878dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:29.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f878dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:29.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f878e575640 1 --2- 10.20.193.5:0/2204466965 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f87900c74c0 0x7f87901f3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:29.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f878ed76640 1 --2- 10.20.193.5:0/2204466965 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f879015d370 0x7f87900cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:29.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f878dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:29.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f878dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:29.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f878dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:29.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f878e575640 10 monclient(hunting): get_auth_request con 0x7f87900c74c0 auth_method 0 2026-02-17T21:29:29.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f878e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:29.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f878e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:29.721 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f878e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:29.721 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f878ed76640 10 monclient(hunting): get_auth_request con 0x7f879015d370 auth_method 0 2026-02-17T21:29:29.721 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f878ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:29.721 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f878ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:29.721 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.703+0000 7f878ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:29.721 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.704+0000 7f878e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:29.721 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.704+0000 7f878e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:29.721 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.704+0000 7f878e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:29.721 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.704+0000 7f878ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:29.721 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.704+0000 7f878ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:29.721 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.704+0000 7f878ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:29.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.705+0000 7f878dd74640 10 monclient(hunting): handle_auth_done global_id 4983 payload 824 2026-02-17T21:29:29.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.705+0000 7f878dd74640 1 -- 10.20.193.5:0/2204466965 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f879015d370 msgr2=0x7f87900cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:29.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.705+0000 7f878dd74640 1 --2- 10.20.193.5:0/2204466965 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f879015d370 0x7f87900cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:29.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.705+0000 7f878dd74640 1 -- 10.20.193.5:0/2204466965 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f87900c74c0 msgr2=0x7f87901f3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:29.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.705+0000 7f878dd74640 1 --2- 10.20.193.5:0/2204466965 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f87900c74c0 0x7f87901f3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:29.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.705+0000 7f878dd74640 10 monclient: _finish_hunting 0 2026-02-17T21:29:29.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.705+0000 7f878dd74640 1 monclient: found mon.noname-a 2026-02-17T21:29:29.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.705+0000 7f878dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:29.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.705+0000 7f878dd74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:29:29.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.705+0000 7f878dd74640 1 -- 10.20.193.5:0/2204466965 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879006ecc0 con 0x7f87900c7e20 2026-02-17T21:29:29.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.706+0000 7f878dd74640 1 --2- 10.20.193.5:0/2204466965 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f87900c7e20 0x7f879006d4f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f877800ec10 tx=0x7f877800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:29.723 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.706+0000 7f8776ffd640 10 client.?.objecter ms_handle_connect 0x7f87900c7e20 2026-02-17T21:29:29.723 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.706+0000 7f8776ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:29:29.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8776ffd640 1 -- 10.20.193.5:0/2204466965 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8778017070 con 0x7f87900c7e20 2026-02-17T21:29:29.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8776ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:29.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8776ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:29:29.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8776ffd640 10 monclient: dump: 2026-02-17T21:29:29.726 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:29.726 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:29.726 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:29.726 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:29.726 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:29.727 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:29.727 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:29.727 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:29.727 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:29.727 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:29.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8776ffd640 10 monclient: _finish_auth 0 2026-02-17T21:29:29.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8776ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:29:29.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8776ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:29.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8776ffd640 1 -- 10.20.193.5:0/2204466965 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f877800cc40 con 0x7f87900c7e20 2026-02-17T21:29:29.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8776ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:29.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8776ffd640 1 -- 10.20.193.5:0/2204466965 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8778013470 con 0x7f87900c7e20 2026-02-17T21:29:29.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8776ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:29.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8776ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:29:29.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8776ffd640 10 monclient: dump: 2026-02-17T21:29:29.728 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:29.728 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:29.728 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:29.728 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:29.728 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:29.728 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:29.729 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:29.729 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:29.729 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:29.729 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:29.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f878cd72640 4 set_mon_vals no callback set 2026-02-17T21:29:29.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8794bdc640 5 monclient: authenticate success, global_id 4983 2026-02-17T21:29:29.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8794bdc640 10 monclient: _renew_subs 2026-02-17T21:29:29.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8794bdc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:29.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8794bdc640 1 -- 10.20.193.5:0/2204466965 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f879006efa0 con 0x7f87900c7e20 2026-02-17T21:29:29.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8794bdc640 10 client.4983.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:29:29.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8794bdc640 10 monclient: _renew_subs 2026-02-17T21:29:29.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8794bdc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:29.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8794bdc640 1 -- 10.20.193.5:0/2204466965 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87900cb3d0 con 0x7f87900c7e20 2026-02-17T21:29:29.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8794bdc640 1 librados: init done 2026-02-17T21:29:29.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8794bdc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:29.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8794bdc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:29.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8794bdc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:29.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.708+0000 7f8794bdc640 1 -- 10.20.193.5:0/2204466965 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f879015d750 con 0x7f87900c7e20 2026-02-17T21:29:29.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.720+0000 7f8776ffd640 1 -- 10.20.193.5:0/2204466965 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f8778013630 con 0x7f87900c7e20 2026-02-17T21:29:29.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.720+0000 7f8776ffd640 1 --2- 10.20.193.5:0/2204466965 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f875c079280 0x7f875c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:29.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.720+0000 7f878e575640 1 --2- 10.20.193.5:0/2204466965 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f875c079280 0x7f875c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:29.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.720+0000 7f878e575640 10 monclient: get_auth_request con 0x7f875c079280 auth_method 0 2026-02-17T21:29:29.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.721+0000 7f8776ffd640 1 -- 10.20.193.5:0/2204466965 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f877805e8c0 con 0x7f87900c7e20 2026-02-17T21:29:29.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.721+0000 7f8776ffd640 10 client.4983.objecter ms_dispatch2 0x7f8790000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:29:29.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.721+0000 7f8776ffd640 3 client.4983.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:29:29.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.721+0000 7f8776ffd640 3 client.4983.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:29:29.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.721+0000 7f8776ffd640 20 client.4983.objecter dump_active .. 0 homeless 2026-02-17T21:29:29.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.721+0000 7f8776ffd640 10 client.4983.objecter ms_handle_connect 0x7f875c079280 2026-02-17T21:29:29.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.721+0000 7f878e575640 1 --2- 10.20.193.5:0/2204466965 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f875c079280 0x7f875c07b740 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f87840051f0 tx=0x7f8784007f30 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:29.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.821+0000 7f8776ffd640 1 -- 10.20.193.5:0/2204466965 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8778062880 con 0x7f87900c7e20 2026-02-17T21:29:29.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.821+0000 7f8776ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:29.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.821+0000 7f8776ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:29:29.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.922+0000 7f8794bdc640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:29:29.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.922+0000 7f8794bdc640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:29.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.922+0000 7f8794bdc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:29.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.922+0000 7f8794bdc640 1 -- 10.20.193.5:0/2204466965 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8790151910 con 0x7f87900c7e20 2026-02-17T21:29:29.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.924+0000 7f8776ffd640 1 -- 10.20.193.5:0/2204466965 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f8778066b80 con 0x7f87900c7e20 2026-02-17T21:29:29.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.924+0000 7f8776ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:29.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.924+0000 7f8776ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:29:29.926 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:29:29.926 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:29:29.928 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.926+0000 7f8794bdc640 10 librados: watch_flush enter 2026-02-17T21:29:29.928 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.926+0000 7f8794bdc640 10 librados: watch_flush exit 2026-02-17T21:29:29.928 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.926+0000 7f8794bdc640 20 client.4983.objecter shutdown clearing up homeless session... 2026-02-17T21:29:29.929 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.926+0000 7f8794bdc640 10 client.4983.objecter successfully canceled tick 2026-02-17T21:29:29.929 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.926+0000 7f8794bdc640 1 -- 10.20.193.5:0/2204466965 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f875c079280 msgr2=0x7f875c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:29.929 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.926+0000 7f8794bdc640 1 --2- 10.20.193.5:0/2204466965 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f875c079280 0x7f875c07b740 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f87840051f0 tx=0x7f8784007f30 comp rx=0 tx=0).stop 2026-02-17T21:29:29.929 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.926+0000 7f8794bdc640 10 monclient: shutdown 2026-02-17T21:29:29.929 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.926+0000 7f8794bdc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:29.929 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.926+0000 7f8794bdc640 1 -- 10.20.193.5:0/2204466965 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f87900c7e20 msgr2=0x7f879006d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:29.929 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.926+0000 7f8794bdc640 1 --2- 10.20.193.5:0/2204466965 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f87900c7e20 0x7f879006d4f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f877800ec10 tx=0x7f877800c520 comp rx=0 tx=0).stop 2026-02-17T21:29:29.929 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.926+0000 7f8794bdc640 1 -- 10.20.193.5:0/2204466965 shutdown_connections 2026-02-17T21:29:29.929 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.926+0000 7f8794bdc640 1 --2- 10.20.193.5:0/2204466965 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f875c079280 0x7f875c07b740 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:29.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.926+0000 7f8794bdc640 1 --2- 10.20.193.5:0/2204466965 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f879015d370 0x7f87900cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:29.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.926+0000 7f8794bdc640 1 --2- 10.20.193.5:0/2204466965 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f87900c7e20 0x7f879006d4f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:29.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.926+0000 7f8794bdc640 1 --2- 10.20.193.5:0/2204466965 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f87900c74c0 0x7f87901f3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:29.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.926+0000 7f8794bdc640 1 -- 10.20.193.5:0/2204466965 >> 10.20.193.5:0/2204466965 conn(0x7f87900c9f20 msgr2=0x7f87900ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:29.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.926+0000 7f8794bdc640 1 -- 10.20.193.5:0/2204466965 shutdown_connections 2026-02-17T21:29:29.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.926+0000 7f8794bdc640 1 -- 10.20.193.5:0/2204466965 wait complete. 2026-02-17T21:29:29.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:29.926+0000 7f8794bdc640 1 librados: shutdown 2026-02-17T21:29:32.938 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:29:33.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.006+0000 7f38d1888640 10 monclient: get_monmap_and_config 2026-02-17T21:29:33.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.006+0000 7f38d1888640 10 monclient: build_initial_monmap 2026-02-17T21:29:33.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.006+0000 7f38d1888640 10 monclient: monmap: 2026-02-17T21:29:33.008 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:33.008 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:33.008 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:29:33.006975+0000 2026-02-17T21:29:33.008 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:29:33.006975+0000 2026-02-17T21:29:33.009 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:33.009 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:33.009 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:29:33.009 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:29:33.009 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:29:33.009 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:29:33.009 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:29:33.009 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:29:33.009 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:33.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.006+0000 7f38d1888640 1 Processor -- start 2026-02-17T21:29:33.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.006+0000 7f38d1888640 1 -- start start 2026-02-17T21:29:33.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.006+0000 7f38d1888640 10 monclient: init 2026-02-17T21:29:33.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.007+0000 7f38d1888640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:33.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.007+0000 7f38d1888640 10 monclient: _add_conns ranks=[0,2,4,5,3,1] 2026-02-17T21:29:33.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.007+0000 7f38d1888640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f38cc0c7170 addr v1:10.20.193.5:6789/0 2026-02-17T21:29:33.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.007+0000 7f38d1888640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f38cc0c7550 addr v1:10.20.193.135:6789/0 2026-02-17T21:29:33.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.007+0000 7f38d1888640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f38cc0c89c0 0x7f38cc0c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:33.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.007+0000 7f38d1888640 10 monclient(hunting): picked mon.noname-b con 0x7f38cc0c89c0 addr v2:10.20.193.119:3300/0 2026-02-17T21:29:33.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.007+0000 7f38d1888640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38cc0c4fd0 con 0x7f38cc0c7170 2026-02-17T21:29:33.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.007+0000 7f38d1888640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38cc15a9a0 con 0x7f38cc0c7550 2026-02-17T21:29:33.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.007+0000 7f38d1888640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:33.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.007+0000 7f38d1888640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f38cc0c8530 con 0x7f38cc0c89c0 2026-02-17T21:29:33.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.007+0000 7f38d1888640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:33.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.007+0000 7f38d1888640 10 monclient(hunting): authenticate will time out at 1278.572275s 2026-02-17T21:29:33.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.007+0000 7f38caffd640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f38cc0c7170 0x7f38cc0c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:47730/0 (socket says 10.20.193.5:47730) 2026-02-17T21:29:33.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.007+0000 7f38caffd640 1 -- 10.20.193.5:0/2530728076 learned_addr learned my addr 10.20.193.5:0/2530728076 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:29:33.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.007+0000 7f38cb7fe640 1 --2- 10.20.193.5:0/2530728076 >> v2:10.20.193.119:3300/0 conn(0x7f38cc0c89c0 0x7f38cc0c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:33.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.008+0000 7f38cb7fe640 10 monclient(hunting): get_auth_request con 0x7f38cc0c89c0 auth_method 0 2026-02-17T21:29:33.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.008+0000 7f38cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:33.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.008+0000 7f38cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:33.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.008+0000 7f38cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:33.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.008+0000 7f38cb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:33.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.008+0000 7f38cb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:33.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.008+0000 7f38cb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:33.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.009+0000 7f38c9ffb640 1 -- 10.20.193.5:0/2530728076 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4129056281 0 0) 0x7f38cc0c4fd0 con 0x7f38cc0c7170 2026-02-17T21:29:33.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.009+0000 7f38c9ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:29:33.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.009+0000 7f38c9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:33.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.009+0000 7f38c9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:33.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.009+0000 7f38c9ffb640 10 monclient(hunting): my global_id is 4986 2026-02-17T21:29:33.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.009+0000 7f38c9ffb640 1 -- 10.20.193.5:0/2530728076 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38b8003620 con 0x7f38cc0c7170 2026-02-17T21:29:33.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.009+0000 7f38c9ffb640 1 -- 10.20.193.5:0/2530728076 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 739077076 0 0) 0x7f38cc15a9a0 con 0x7f38cc0c7550 2026-02-17T21:29:33.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.009+0000 7f38c9ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:29:33.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.009+0000 7f38c9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:33.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.009+0000 7f38c9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:33.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.009+0000 7f38c9ffb640 10 monclient(hunting): my global_id is 5018 2026-02-17T21:29:33.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.009+0000 7f38c9ffb640 1 -- 10.20.193.5:0/2530728076 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38cc0c4fd0 con 0x7f38cc0c7550 2026-02-17T21:29:33.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.009+0000 7f38cb7fe640 10 monclient(hunting): handle_auth_done global_id 5041 payload 274 2026-02-17T21:29:33.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.009+0000 7f38cb7fe640 1 -- 10.20.193.5:0/2530728076 >> v1:10.20.193.135:6789/0 conn(0x7f38cc0c7550 legacy=0x7f38cc0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:33.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.009+0000 7f38cb7fe640 1 -- 10.20.193.5:0/2530728076 >> v1:10.20.193.5:6789/0 conn(0x7f38cc0c7170 legacy=0x7f38cc0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:33.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.009+0000 7f38cb7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:29:33.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.009+0000 7f38cb7fe640 1 monclient: found mon.noname-b 2026-02-17T21:29:33.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.009+0000 7f38cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:33.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.009+0000 7f38cb7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:29:33.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.009+0000 7f38cb7fe640 1 -- 10.20.193.5:0/2530728076 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38cc0c5270 con 0x7f38cc0c89c0 2026-02-17T21:29:33.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.010+0000 7f38cb7fe640 1 --2- 10.20.193.5:0/2530728076 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f38cc0c89c0 0x7f38cc0c8e70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009d90 tx=0x7f38bc02f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a61e222af0349904 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:33.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38c9ffb640 1 -- 10.20.193.5:0/2530728076 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc03c070 con 0x7f38cc0c89c0 2026-02-17T21:29:33.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:33.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38c9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:29:33.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38c9ffb640 10 monclient: dump: 2026-02-17T21:29:33.023 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:33.023 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:33.023 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:33.023 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:33.023 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:33.023 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:33.023 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:33.024 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:33.024 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:33.024 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:33.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38c9ffb640 10 monclient: _finish_auth 0 2026-02-17T21:29:33.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38c9ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:29:33.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38c9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:33.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38c9ffb640 1 -- 10.20.193.5:0/2530728076 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38bc037440 con 0x7f38cc0c89c0 2026-02-17T21:29:33.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38d1888640 5 monclient: authenticate success, global_id 5041 2026-02-17T21:29:33.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38d1888640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:29:33.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38c9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:33.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38c9ffb640 1 -- 10.20.193.5:0/2530728076 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc037810 con 0x7f38cc0c89c0 2026-02-17T21:29:33.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38d1888640 10 monclient: get_monmap_and_config success 2026-02-17T21:29:33.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38d1888640 4 set_mon_vals no callback set 2026-02-17T21:29:33.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:33.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38c9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:29:33.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38c9ffb640 10 monclient: dump: 2026-02-17T21:29:33.025 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:33.025 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:33.025 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:33.025 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:33.025 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:33.025 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:33.025 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:33.026 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:33.026 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:33.026 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:33.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38d1888640 10 monclient: shutdown 2026-02-17T21:29:33.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38d1888640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:33.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38d1888640 1 -- 10.20.193.5:0/2530728076 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f38cc0c89c0 msgr2=0x7f38cc0c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:33.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38d1888640 1 --2- 10.20.193.5:0/2530728076 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f38cc0c89c0 0x7f38cc0c8e70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009d90 tx=0x7f38bc02f230 comp rx=0 tx=0).stop 2026-02-17T21:29:33.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38d1888640 1 -- 10.20.193.5:0/2530728076 shutdown_connections 2026-02-17T21:29:33.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38d1888640 1 --2- 10.20.193.5:0/2530728076 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f38cc0c89c0 0x7f38cc0c8e70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:33.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38d1888640 1 -- 10.20.193.5:0/2530728076 >> 10.20.193.5:0/2530728076 conn(0x7f38cc0c9f40 msgr2=0x7f38cc0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:33.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38d1888640 1 -- 10.20.193.5:0/2530728076 shutdown_connections 2026-02-17T21:29:33.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.012+0000 7f38d1888640 1 -- 10.20.193.5:0/2530728076 wait complete. 2026-02-17T21:29:33.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.013+0000 7f38d1888640 10 monclient: build_initial_monmap 2026-02-17T21:29:33.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.013+0000 7f38d1888640 10 monclient: monmap: 2026-02-17T21:29:33.027 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:33.027 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:29:33.027 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:29:33.027 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:29:33.027 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:33.027 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:33.027 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:29:33.027 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:29:33.027 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:29:33.028 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:33.028 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.013+0000 7f38d1888640 1 librados: starting msgr at 2026-02-17T21:29:33.028 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.013+0000 7f38d1888640 1 librados: starting objecter 2026-02-17T21:29:33.028 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.013+0000 7f38d1888640 1 Processor -- start 2026-02-17T21:29:33.028 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.013+0000 7f38d1888640 1 -- start start 2026-02-17T21:29:33.028 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.013+0000 7f38d1888640 1 librados: setting wanted keys 2026-02-17T21:29:33.028 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.013+0000 7f38d1888640 1 librados: calling monclient init 2026-02-17T21:29:33.028 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.013+0000 7f38d1888640 10 monclient: init 2026-02-17T21:29:33.028 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38d1888640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:33.028 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38d1888640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:29:33.028 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38d1888640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f38cc0c7170 0x7f38cc1544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:33.029 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38d1888640 10 monclient(hunting): picked mon.noname-b con 0x7f38cc0c7170 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:29:33.029 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38d1888640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f38cc0c7550 0x7f38cc1f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:33.029 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38d1888640 10 monclient(hunting): picked mon.noname-c con 0x7f38cc0c7550 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:29:33.029 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38d1888640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f38cc0c89c0 0x7f38cc149480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:33.029 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38d1888640 10 monclient(hunting): picked mon.noname-a con 0x7f38cc0c89c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:29:33.029 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38d1888640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:33.029 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38d1888640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f38cc0c5830 con 0x7f38cc0c89c0 2026-02-17T21:29:33.029 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38d1888640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:33.029 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38d1888640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f38cc0c93b0 con 0x7f38cc0c7170 2026-02-17T21:29:33.029 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38d1888640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:33.029 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38d1888640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f38cc0c7ee0 con 0x7f38cc0c7550 2026-02-17T21:29:33.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38d1888640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:33.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38d1888640 10 monclient(hunting): authenticate will time out at 1278.579237s 2026-02-17T21:29:33.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38cb7fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f38cc0c89c0 0x7f38cc149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:33.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38ca7fc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f38cc0c7550 0x7f38cc1f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:33.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38ca7fc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f38cc0c7550 0x7f38cc1f7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:55748/0 (socket says 10.20.193.5:55748) 2026-02-17T21:29:33.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38ca7fc640 1 -- 10.20.193.5:0/4219288440 learned_addr learned my addr 10.20.193.5:0/4219288440 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:29:33.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38ca7fc640 10 monclient(hunting): get_auth_request con 0x7f38cc0c7550 auth_method 0 2026-02-17T21:29:33.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38ca7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:33.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38ca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:33.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38ca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:33.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38caffd640 1 --2- 10.20.193.5:0/4219288440 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f38cc0c7170 0x7f38cc1544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:33.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38cb7fe640 10 monclient(hunting): get_auth_request con 0x7f38cc0c89c0 auth_method 0 2026-02-17T21:29:33.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:33.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:33.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.014+0000 7f38cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:33.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.015+0000 7f38cb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:33.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.015+0000 7f38cb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:33.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.015+0000 7f38cb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:33.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.015+0000 7f38caffd640 10 monclient(hunting): get_auth_request con 0x7f38cc0c7170 auth_method 0 2026-02-17T21:29:33.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.015+0000 7f38caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:33.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.015+0000 7f38caffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:33.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.015+0000 7f38caffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:33.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.015+0000 7f38ca7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:33.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.015+0000 7f38ca7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:33.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.015+0000 7f38ca7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:33.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.015+0000 7f38caffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:33.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.015+0000 7f38caffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:33.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.015+0000 7f38caffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:33.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.016+0000 7f38cb7fe640 10 monclient(hunting): handle_auth_done global_id 4989 payload 824 2026-02-17T21:29:33.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.016+0000 7f38cb7fe640 1 -- 10.20.193.5:0/4219288440 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f38cc0c7550 msgr2=0x7f38cc1f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:33.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.016+0000 7f38cb7fe640 1 --2- 10.20.193.5:0/4219288440 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f38cc0c7550 0x7f38cc1f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:33.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.016+0000 7f38cb7fe640 1 -- 10.20.193.5:0/4219288440 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f38cc0c7170 msgr2=0x7f38cc1544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:33.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.016+0000 7f38cb7fe640 1 --2- 10.20.193.5:0/4219288440 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f38cc0c7170 0x7f38cc1544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:33.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.016+0000 7f38cb7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:29:33.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.016+0000 7f38cb7fe640 1 monclient: found mon.noname-a 2026-02-17T21:29:33.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.016+0000 7f38cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:33.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.016+0000 7f38cb7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:29:33.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.016+0000 7f38cb7fe640 1 -- 10.20.193.5:0/4219288440 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38cc149d20 con 0x7f38cc0c89c0 2026-02-17T21:29:33.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.017+0000 7f38cb7fe640 1 --2- 10.20.193.5:0/4219288440 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f38cc0c89c0 0x7f38cc149480 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f38bc036000 tx=0x7f38bc004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:33.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.017+0000 7f38a3fff640 10 client.?.objecter ms_handle_connect 0x7f38cc0c89c0 2026-02-17T21:29:33.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.017+0000 7f38a3fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:29:33.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38a3fff640 1 -- 10.20.193.5:0/4219288440 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc03c050 con 0x7f38cc0c89c0 2026-02-17T21:29:33.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38a3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:33.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38a3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:29:33.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38a3fff640 10 monclient: dump: 2026-02-17T21:29:33.033 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:33.033 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:33.034 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:33.034 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:33.034 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:33.034 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:33.034 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:33.034 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:33.034 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:33.034 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:33.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38a3fff640 10 monclient: _finish_auth 0 2026-02-17T21:29:33.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38a3fff640 10 monclient: _check_auth_tickets 2026-02-17T21:29:33.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38a3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:33.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38a3fff640 1 -- 10.20.193.5:0/4219288440 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38bc03d040 con 0x7f38cc0c89c0 2026-02-17T21:29:33.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38d1888640 5 monclient: authenticate success, global_id 4989 2026-02-17T21:29:33.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38d1888640 10 monclient: _renew_subs 2026-02-17T21:29:33.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38d1888640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:33.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38d1888640 1 -- 10.20.193.5:0/4219288440 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38cc14a000 con 0x7f38cc0c89c0 2026-02-17T21:29:33.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38a3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:33.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38a3fff640 1 -- 10.20.193.5:0/4219288440 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc041810 con 0x7f38cc0c89c0 2026-02-17T21:29:33.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38a3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:33.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38a3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:29:33.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38c97fa640 4 set_mon_vals no callback set 2026-02-17T21:29:33.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38a3fff640 10 monclient: dump: 2026-02-17T21:29:33.035 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:33.035 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:33.035 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:33.035 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:33.036 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:33.036 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:33.036 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:33.036 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:33.036 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:33.036 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:33.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38d1888640 10 client.4989.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:29:33.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38d1888640 10 monclient: _renew_subs 2026-02-17T21:29:33.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38d1888640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:33.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38d1888640 1 -- 10.20.193.5:0/4219288440 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38cc14a5c0 con 0x7f38cc0c89c0 2026-02-17T21:29:33.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38d1888640 1 librados: init done 2026-02-17T21:29:33.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38d1888640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:33.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38d1888640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:33.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38d1888640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:33.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.019+0000 7f38d1888640 1 -- 10.20.193.5:0/4219288440 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38cc0c81c0 con 0x7f38cc0c89c0 2026-02-17T21:29:33.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.031+0000 7f38a3fff640 1 -- 10.20.193.5:0/4219288440 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f38bc0419b0 con 0x7f38cc0c89c0 2026-02-17T21:29:33.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.032+0000 7f38a3fff640 1 --2- 10.20.193.5:0/4219288440 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f389c079300 0x7f389c07b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:33.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.032+0000 7f38caffd640 1 --2- 10.20.193.5:0/4219288440 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f389c079300 0x7f389c07b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:33.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.032+0000 7f38caffd640 10 monclient: get_auth_request con 0x7f389c079300 auth_method 0 2026-02-17T21:29:33.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.032+0000 7f38caffd640 1 --2- 10.20.193.5:0/4219288440 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f389c079300 0x7f389c07b7c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f38c0007b60 tx=0x7f38c0007ab0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:33.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.032+0000 7f38a3fff640 10 client.4989.objecter ms_handle_connect 0x7f389c079300 2026-02-17T21:29:33.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.034+0000 7f38a3fff640 1 -- 10.20.193.5:0/4219288440 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f38bc0840f0 con 0x7f38cc0c89c0 2026-02-17T21:29:33.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.034+0000 7f38a3fff640 10 client.4989.objecter ms_dispatch2 0x7f38cc000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:29:33.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.034+0000 7f38a3fff640 3 client.4989.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:29:33.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.034+0000 7f38a3fff640 3 client.4989.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:29:33.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.034+0000 7f38a3fff640 20 client.4989.objecter dump_active .. 0 homeless 2026-02-17T21:29:33.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.135+0000 7f38a3fff640 1 -- 10.20.193.5:0/4219288440 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f38bc0880b0 con 0x7f38cc0c89c0 2026-02-17T21:29:33.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.135+0000 7f38a3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:33.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.135+0000 7f38a3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:29:33.236 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.235+0000 7f38d1888640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:29:33.236 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.235+0000 7f38d1888640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:33.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.235+0000 7f38d1888640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:33.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.235+0000 7f38d1888640 1 -- 10.20.193.5:0/4219288440 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f38cc076630 con 0x7f38cc0c89c0 2026-02-17T21:29:33.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.237+0000 7f38a3fff640 1 -- 10.20.193.5:0/4219288440 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f38bc08c3b0 con 0x7f38cc0c89c0 2026-02-17T21:29:33.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.237+0000 7f38a3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:33.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.237+0000 7f38a3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:29:33.239 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:29:33.239 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:29:33.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.238+0000 7f38d1888640 10 librados: watch_flush enter 2026-02-17T21:29:33.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.238+0000 7f38d1888640 10 librados: watch_flush exit 2026-02-17T21:29:33.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.238+0000 7f38d1888640 20 client.4989.objecter shutdown clearing up homeless session... 2026-02-17T21:29:33.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.238+0000 7f38d1888640 10 client.4989.objecter successfully canceled tick 2026-02-17T21:29:33.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.239+0000 7f38d1888640 1 -- 10.20.193.5:0/4219288440 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f389c079300 msgr2=0x7f389c07b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:33.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.239+0000 7f38d1888640 1 --2- 10.20.193.5:0/4219288440 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f389c079300 0x7f389c07b7c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f38c0007b60 tx=0x7f38c0007ab0 comp rx=0 tx=0).stop 2026-02-17T21:29:33.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.239+0000 7f38d1888640 10 monclient: shutdown 2026-02-17T21:29:33.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.239+0000 7f38d1888640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:33.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.239+0000 7f38d1888640 1 -- 10.20.193.5:0/4219288440 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f38cc0c89c0 msgr2=0x7f38cc149480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:33.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.239+0000 7f38d1888640 1 --2- 10.20.193.5:0/4219288440 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f38cc0c89c0 0x7f38cc149480 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f38bc036000 tx=0x7f38bc004b40 comp rx=0 tx=0).stop 2026-02-17T21:29:33.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.239+0000 7f38d1888640 1 -- 10.20.193.5:0/4219288440 shutdown_connections 2026-02-17T21:29:33.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.239+0000 7f38d1888640 1 --2- 10.20.193.5:0/4219288440 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f389c079300 0x7f389c07b7c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:33.241 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.239+0000 7f38d1888640 1 --2- 10.20.193.5:0/4219288440 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f38cc0c89c0 0x7f38cc149480 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:33.241 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.239+0000 7f38d1888640 1 --2- 10.20.193.5:0/4219288440 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f38cc0c7550 0x7f38cc1f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:33.241 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.239+0000 7f38d1888640 1 --2- 10.20.193.5:0/4219288440 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f38cc0c7170 0x7f38cc1544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:33.241 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.239+0000 7f38d1888640 1 -- 10.20.193.5:0/4219288440 >> 10.20.193.5:0/4219288440 conn(0x7f38cc0c9f40 msgr2=0x7f38cc0cb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:33.241 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.239+0000 7f38d1888640 1 -- 10.20.193.5:0/4219288440 shutdown_connections 2026-02-17T21:29:33.241 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.239+0000 7f38d1888640 1 -- 10.20.193.5:0/4219288440 wait complete. 2026-02-17T21:29:33.241 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:33.239+0000 7f38d1888640 1 librados: shutdown 2026-02-17T21:29:36.250 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:29:36.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.318+0000 7fc93cd61640 10 monclient: get_monmap_and_config 2026-02-17T21:29:36.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.318+0000 7fc93cd61640 10 monclient: build_initial_monmap 2026-02-17T21:29:36.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.318+0000 7fc93cd61640 10 monclient: monmap: 2026-02-17T21:29:36.321 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:36.321 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:36.321 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:29:36.319613+0000 2026-02-17T21:29:36.321 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:29:36.319613+0000 2026-02-17T21:29:36.321 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:36.321 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:36.321 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:29:36.321 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:29:36.321 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:29:36.321 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:29:36.321 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:29:36.322 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:29:36.322 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:36.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.319+0000 7fc93cd61640 1 Processor -- start 2026-02-17T21:29:36.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.319+0000 7fc93cd61640 1 -- start start 2026-02-17T21:29:36.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.319+0000 7fc93cd61640 10 monclient: init 2026-02-17T21:29:36.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.319+0000 7fc93cd61640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:36.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.319+0000 7fc93cd61640 10 monclient: _add_conns ranks=[4,0,5,1,2,3] 2026-02-17T21:29:36.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.319+0000 7fc93cd61640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fc938152820 0x7fc9381593f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:36.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.320+0000 7fc93cd61640 10 monclient(hunting): picked mon.noname-b con 0x7fc938152820 addr v2:10.20.193.119:3300/0 2026-02-17T21:29:36.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.320+0000 7fc93cd61640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc938152c00 addr v1:10.20.193.5:6789/0 2026-02-17T21:29:36.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.320+0000 7fc93cd61640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fc9380738f0 0x7fc9380c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:36.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.320+0000 7fc93cd61640 10 monclient(hunting): picked mon.noname-c con 0x7fc9380738f0 addr v2:10.20.193.135:3300/0 2026-02-17T21:29:36.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.320+0000 7fc93cd61640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc938073e90 con 0x7fc938152c00 2026-02-17T21:29:36.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.320+0000 7fc93cd61640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:36.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.320+0000 7fc93cd61640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fc938159930 con 0x7fc938152820 2026-02-17T21:29:36.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.320+0000 7fc93cd61640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.320+0000 7fc93cd61640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fc9380c8550 con 0x7fc9380738f0 2026-02-17T21:29:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.320+0000 7fc93cd61640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.320+0000 7fc93cd61640 10 monclient(hunting): authenticate will time out at 1281.885047s 2026-02-17T21:29:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.320+0000 7fc936575640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fc938152820 0x7fc9381593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.320+0000 7fc935d74640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7fc938152c00 0x7fc9380c7e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:47746/0 (socket says 10.20.193.5:47746) 2026-02-17T21:29:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.320+0000 7fc935d74640 1 -- 10.20.193.5:0/3266884983 learned_addr learned my addr 10.20.193.5:0/3266884983 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:29:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.320+0000 7fc936d76640 1 --2- 10.20.193.5:0/3266884983 >> v2:10.20.193.135:3300/0 conn(0x7fc9380738f0 0x7fc9380c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.320+0000 7fc936575640 10 monclient(hunting): get_auth_request con 0x7fc938152820 auth_method 0 2026-02-17T21:29:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.320+0000 7fc936575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.320+0000 7fc936575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.320+0000 7fc936575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:36.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.320+0000 7fc936d76640 10 monclient(hunting): get_auth_request con 0x7fc9380738f0 auth_method 0 2026-02-17T21:29:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.320+0000 7fc936d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.320+0000 7fc936d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.320+0000 7fc936d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.321+0000 7fc936575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.321+0000 7fc936575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.321+0000 7fc936575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.321+0000 7fc936d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.321+0000 7fc936d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.321+0000 7fc936d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.321+0000 7fc935573640 1 -- 10.20.193.5:0/3266884983 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1094073608 0 0) 0x7fc938073e90 con 0x7fc938152c00 2026-02-17T21:29:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.322+0000 7fc935573640 10 monclient(hunting): _negotiate 2026-02-17T21:29:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.322+0000 7fc935573640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:36.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.322+0000 7fc935573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.322+0000 7fc935573640 10 monclient(hunting): my global_id is 4992 2026-02-17T21:29:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.322+0000 7fc935573640 1 -- 10.20.193.5:0/3266884983 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc924003620 con 0x7fc938152c00 2026-02-17T21:29:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.322+0000 7fc936575640 10 monclient(hunting): handle_auth_done global_id 5047 payload 274 2026-02-17T21:29:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.322+0000 7fc936575640 1 -- 10.20.193.5:0/3266884983 >> v2:10.20.193.135:3300/0 conn(0x7fc9380738f0 msgr2=0x7fc9380c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:29:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.322+0000 7fc936575640 1 --2- 10.20.193.5:0/3266884983 >> v2:10.20.193.135:3300/0 conn(0x7fc9380738f0 0x7fc9380c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.322+0000 7fc936575640 1 -- 10.20.193.5:0/3266884983 >> v1:10.20.193.5:6789/0 conn(0x7fc938152c00 legacy=0x7fc9380c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.322+0000 7fc936575640 10 monclient: _finish_hunting 0 2026-02-17T21:29:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.322+0000 7fc936575640 1 monclient: found mon.noname-b 2026-02-17T21:29:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.322+0000 7fc936575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.322+0000 7fc936575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:29:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.322+0000 7fc936575640 1 -- 10.20.193.5:0/3266884983 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc938074170 con 0x7fc938152820 2026-02-17T21:29:36.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.323+0000 7fc936575640 1 --2- 10.20.193.5:0/3266884983 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc938152820 0x7fc9381593f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc938069ce0 tx=0x7fc92c02eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b068a6528b64f37 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:36.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.324+0000 7fc935573640 1 -- 10.20.193.5:0/3266884983 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c03c070 con 0x7fc938152820 2026-02-17T21:29:36.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.324+0000 7fc935573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:36.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.324+0000 7fc935573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:29:36.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.324+0000 7fc935573640 10 monclient: dump: 2026-02-17T21:29:36.336 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:36.336 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:36.337 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:36.337 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:36.337 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:36.337 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:36.337 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:36.337 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:36.337 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:36.337 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:36.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.324+0000 7fc935573640 10 monclient: _finish_auth 0 2026-02-17T21:29:36.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.324+0000 7fc935573640 10 monclient: _check_auth_tickets 2026-02-17T21:29:36.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.324+0000 7fc935573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.324+0000 7fc935573640 1 -- 10.20.193.5:0/3266884983 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc92c02fb80 con 0x7fc938152820 2026-02-17T21:29:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.324+0000 7fc935573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.324+0000 7fc935573640 1 -- 10.20.193.5:0/3266884983 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c037440 con 0x7fc938152820 2026-02-17T21:29:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.324+0000 7fc93cd61640 5 monclient: authenticate success, global_id 5047 2026-02-17T21:29:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.324+0000 7fc93cd61640 10 monclient: get_monmap_and_config success 2026-02-17T21:29:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.324+0000 7fc93cd61640 4 set_mon_vals no callback set 2026-02-17T21:29:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.324+0000 7fc935573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.324+0000 7fc935573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:29:36.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.324+0000 7fc935573640 10 monclient: dump: 2026-02-17T21:29:36.338 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:36.338 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:36.339 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:36.339 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:36.339 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:36.339 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:36.339 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:36.339 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:36.339 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.325+0000 7fc93cd61640 10 monclient: shutdown 2026-02-17T21:29:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.325+0000 7fc93cd61640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:36.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.325+0000 7fc93cd61640 1 -- 10.20.193.5:0/3266884983 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc938152820 msgr2=0x7fc9381593f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.325+0000 7fc93cd61640 1 --2- 10.20.193.5:0/3266884983 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc938152820 0x7fc9381593f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc938069ce0 tx=0x7fc92c02eeb0 comp rx=0 tx=0).stop 2026-02-17T21:29:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.325+0000 7fc93cd61640 1 -- 10.20.193.5:0/3266884983 shutdown_connections 2026-02-17T21:29:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.325+0000 7fc93cd61640 1 --2- 10.20.193.5:0/3266884983 >> v2:10.20.193.135:3300/0 conn(0x7fc9380738f0 0x7fc9380c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.325+0000 7fc93cd61640 1 --2- 10.20.193.5:0/3266884983 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc938152820 0x7fc9381593f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.325+0000 7fc93cd61640 1 -- 10.20.193.5:0/3266884983 >> 10.20.193.5:0/3266884983 conn(0x7fc9380c9f40 msgr2=0x7fc9380ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.325+0000 7fc93cd61640 1 -- 10.20.193.5:0/3266884983 shutdown_connections 2026-02-17T21:29:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.325+0000 7fc93cd61640 1 -- 10.20.193.5:0/3266884983 wait complete. 2026-02-17T21:29:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.325+0000 7fc93cd61640 10 monclient: build_initial_monmap 2026-02-17T21:29:36.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.325+0000 7fc93cd61640 10 monclient: monmap: 2026-02-17T21:29:36.340 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:36.340 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:29:36.340 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:29:36.341 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:29:36.341 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:36.341 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:36.341 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:29:36.341 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:29:36.341 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:29:36.341 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:36.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.326+0000 7fc93cd61640 1 librados: starting msgr at 2026-02-17T21:29:36.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.326+0000 7fc93cd61640 1 librados: starting objecter 2026-02-17T21:29:36.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.326+0000 7fc93cd61640 1 Processor -- start 2026-02-17T21:29:36.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.326+0000 7fc93cd61640 1 -- start start 2026-02-17T21:29:36.341 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.326+0000 7fc93cd61640 1 librados: setting wanted keys 2026-02-17T21:29:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.326+0000 7fc93cd61640 1 librados: calling monclient init 2026-02-17T21:29:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.326+0000 7fc93cd61640 10 monclient: init 2026-02-17T21:29:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.326+0000 7fc93cd61640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.326+0000 7fc93cd61640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:29:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.326+0000 7fc93cd61640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc9380738f0 0x7fc93814e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.326+0000 7fc93cd61640 10 monclient(hunting): picked mon.noname-a con 0x7fc9380738f0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:29:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.326+0000 7fc93cd61640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc938152820 0x7fc9380cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.326+0000 7fc93cd61640 10 monclient(hunting): picked mon.noname-b con 0x7fc938152820 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:29:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.326+0000 7fc93cd61640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc938152c00 0x7fc9380cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.326+0000 7fc93cd61640 10 monclient(hunting): picked mon.noname-c con 0x7fc938152c00 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:29:36.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.326+0000 7fc93cd61640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.326+0000 7fc93cd61640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc938074a10 con 0x7fc9380738f0 2026-02-17T21:29:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.326+0000 7fc93cd61640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.326+0000 7fc93cd61640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc938074730 con 0x7fc938152820 2026-02-17T21:29:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.326+0000 7fc93cd61640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.326+0000 7fc93cd61640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc938074cf0 con 0x7fc938152c00 2026-02-17T21:29:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.326+0000 7fc93cd61640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.326+0000 7fc93cd61640 10 monclient(hunting): authenticate will time out at 1281.891556s 2026-02-17T21:29:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.326+0000 7fc935d74640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc938152820 0x7fc9380cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.327+0000 7fc936575640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc9380738f0 0x7fc93814e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.327+0000 7fc936d76640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc938152c00 0x7fc9380cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.327+0000 7fc935d74640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc938152820 0x7fc9380cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:56226/0 (socket says 10.20.193.5:56226) 2026-02-17T21:29:36.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.327+0000 7fc935d74640 1 -- 10.20.193.5:0/3956034469 learned_addr learned my addr 10.20.193.5:0/3956034469 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:29:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.327+0000 7fc935d74640 10 monclient(hunting): get_auth_request con 0x7fc938152820 auth_method 0 2026-02-17T21:29:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.327+0000 7fc935d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.327+0000 7fc935d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.327+0000 7fc935d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.327+0000 7fc936575640 10 monclient(hunting): get_auth_request con 0x7fc9380738f0 auth_method 0 2026-02-17T21:29:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.327+0000 7fc936575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.327+0000 7fc936575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.327+0000 7fc936575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.327+0000 7fc936d76640 10 monclient(hunting): get_auth_request con 0x7fc938152c00 auth_method 0 2026-02-17T21:29:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.327+0000 7fc936d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.327+0000 7fc936d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:36.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.327+0000 7fc936d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.327+0000 7fc935d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.327+0000 7fc935d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.327+0000 7fc935d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.327+0000 7fc936575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.327+0000 7fc936575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.327+0000 7fc936575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.327+0000 7fc936d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.327+0000 7fc936d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.327+0000 7fc936d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.328+0000 7fc935d74640 10 monclient(hunting): handle_auth_done global_id 5050 payload 824 2026-02-17T21:29:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.328+0000 7fc935d74640 1 -- 10.20.193.5:0/3956034469 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc938152c00 msgr2=0x7fc9380cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:36.345 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.328+0000 7fc935d74640 1 --2- 10.20.193.5:0/3956034469 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc938152c00 0x7fc9380cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.328+0000 7fc935d74640 1 -- 10.20.193.5:0/3956034469 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc9380738f0 msgr2=0x7fc93814e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.328+0000 7fc935d74640 1 --2- 10.20.193.5:0/3956034469 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc9380738f0 0x7fc93814e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.328+0000 7fc935d74640 10 monclient: _finish_hunting 0 2026-02-17T21:29:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.328+0000 7fc935d74640 1 monclient: found mon.noname-b 2026-02-17T21:29:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.328+0000 7fc935d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.328+0000 7fc935d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:29:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.328+0000 7fc935d74640 1 -- 10.20.193.5:0/3956034469 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93806e1f0 con 0x7fc938152820 2026-02-17T21:29:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.329+0000 7fc935d74640 1 --2- 10.20.193.5:0/3956034469 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc938152820 0x7fc9380cb330 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc92000c700 tx=0x7fc92000cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.329+0000 7fc91effd640 10 client.?.objecter ms_handle_connect 0x7fc938152820 2026-02-17T21:29:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.329+0000 7fc91effd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:29:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.331+0000 7fc91effd640 1 -- 10.20.193.5:0/3956034469 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc920017070 con 0x7fc938152820 2026-02-17T21:29:36.346 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.331+0000 7fc91effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:36.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.331+0000 7fc91effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:29:36.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.331+0000 7fc91effd640 10 monclient: dump: 2026-02-17T21:29:36.347 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:36.347 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:36.347 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:36.347 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:36.347 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:36.347 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:36.347 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:36.347 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:36.347 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:36.347 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.331+0000 7fc91effd640 10 monclient: _finish_auth 0 2026-02-17T21:29:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.331+0000 7fc91effd640 10 monclient: _check_auth_tickets 2026-02-17T21:29:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.331+0000 7fc91effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.331+0000 7fc91effd640 1 -- 10.20.193.5:0/3956034469 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc920005bb0 con 0x7fc938152820 2026-02-17T21:29:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.331+0000 7fc93cd61640 5 monclient: authenticate success, global_id 5050 2026-02-17T21:29:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.331+0000 7fc93cd61640 10 monclient: _renew_subs 2026-02-17T21:29:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.331+0000 7fc93cd61640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:29:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.331+0000 7fc93cd61640 1 -- 10.20.193.5:0/3956034469 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc93806e4d0 con 0x7fc938152820 2026-02-17T21:29:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.331+0000 7fc91effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.331+0000 7fc91effd640 1 -- 10.20.193.5:0/3956034469 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc920007070 con 0x7fc938152820 2026-02-17T21:29:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.331+0000 7fc91effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:36.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.331+0000 7fc91effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:29:36.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.331+0000 7fc934d72640 4 set_mon_vals no callback set 2026-02-17T21:29:36.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.331+0000 7fc91effd640 10 monclient: dump: 2026-02-17T21:29:36.349 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:36.349 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:36.349 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:36.349 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:36.349 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:36.349 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:36.349 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:36.349 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:36.349 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:36.349 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.331+0000 7fc93cd61640 10 client.5050.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:29:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.331+0000 7fc93cd61640 10 monclient: _renew_subs 2026-02-17T21:29:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.331+0000 7fc93cd61640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:29:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.331+0000 7fc93cd61640 1 -- 10.20.193.5:0/3956034469 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc93806ea90 con 0x7fc938152820 2026-02-17T21:29:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.331+0000 7fc93cd61640 1 librados: init done 2026-02-17T21:29:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.332+0000 7fc93cd61640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.332+0000 7fc93cd61640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.332+0000 7fc93cd61640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:29:36.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.332+0000 7fc93cd61640 1 -- 10.20.193.5:0/3956034469 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9381593f0 con 0x7fc938152820 2026-02-17T21:29:36.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.437+0000 7fc91effd640 1 -- 10.20.193.5:0/3956034469 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fc920007210 con 0x7fc938152820 2026-02-17T21:29:36.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.437+0000 7fc91effd640 1 --2- 10.20.193.5:0/3956034469 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc9040792b0 0x7fc90407b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:36.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.437+0000 7fc936575640 1 --2- 10.20.193.5:0/3956034469 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc9040792b0 0x7fc90407b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:36.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.437+0000 7fc936575640 10 monclient: get_auth_request con 0x7fc9040792b0 auth_method 0 2026-02-17T21:29:36.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.438+0000 7fc936575640 1 --2- 10.20.193.5:0/3956034469 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc9040792b0 0x7fc90407b770 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc92c039000 tx=0x7fc92c033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:36.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.438+0000 7fc91effd640 10 client.5050.objecter ms_handle_connect 0x7fc9040792b0 2026-02-17T21:29:36.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.439+0000 7fc91effd640 1 -- 10.20.193.5:0/3956034469 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fc92005d7d0 con 0x7fc938152820 2026-02-17T21:29:36.441 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.439+0000 7fc91effd640 10 client.5050.objecter ms_dispatch2 0x7fc938000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:29:36.441 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.439+0000 7fc91effd640 3 client.5050.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:29:36.441 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.439+0000 7fc91effd640 3 client.5050.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:29:36.441 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.439+0000 7fc91effd640 20 client.5050.objecter dump_active .. 0 homeless 2026-02-17T21:29:36.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.445+0000 7fc91effd640 1 -- 10.20.193.5:0/3956034469 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc920021020 con 0x7fc938152820 2026-02-17T21:29:36.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.445+0000 7fc91effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:36.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.445+0000 7fc91effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:29:36.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.547+0000 7fc93cd61640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:29:36.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.547+0000 7fc93cd61640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:36.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.547+0000 7fc93cd61640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:29:36.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.547+0000 7fc93cd61640 1 -- 10.20.193.5:0/3956034469 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc93814a360 con 0x7fc938152820 2026-02-17T21:29:36.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.550+0000 7fc91effd640 1 -- 10.20.193.5:0/3956034469 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fc920061790 con 0x7fc938152820 2026-02-17T21:29:36.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.550+0000 7fc91effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:36.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.550+0000 7fc91effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:29:36.552 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:29:36.552 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:29:36.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.551+0000 7fc93cd61640 10 librados: watch_flush enter 2026-02-17T21:29:36.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.551+0000 7fc93cd61640 10 librados: watch_flush exit 2026-02-17T21:29:36.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.551+0000 7fc93cd61640 20 client.5050.objecter shutdown clearing up homeless session... 2026-02-17T21:29:36.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.551+0000 7fc93cd61640 10 client.5050.objecter successfully canceled tick 2026-02-17T21:29:36.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.551+0000 7fc93cd61640 1 -- 10.20.193.5:0/3956034469 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc9040792b0 msgr2=0x7fc90407b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:36.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.551+0000 7fc93cd61640 1 --2- 10.20.193.5:0/3956034469 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc9040792b0 0x7fc90407b770 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc92c039000 tx=0x7fc92c033000 comp rx=0 tx=0).stop 2026-02-17T21:29:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.551+0000 7fc93cd61640 10 monclient: shutdown 2026-02-17T21:29:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.551+0000 7fc93cd61640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.551+0000 7fc93cd61640 1 -- 10.20.193.5:0/3956034469 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc938152820 msgr2=0x7fc9380cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.551+0000 7fc93cd61640 1 --2- 10.20.193.5:0/3956034469 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc938152820 0x7fc9380cb330 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc92000c700 tx=0x7fc92000cbd0 comp rx=0 tx=0).stop 2026-02-17T21:29:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.551+0000 7fc93cd61640 1 -- 10.20.193.5:0/3956034469 shutdown_connections 2026-02-17T21:29:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.551+0000 7fc93cd61640 1 --2- 10.20.193.5:0/3956034469 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc9040792b0 0x7fc90407b770 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.552+0000 7fc93cd61640 1 --2- 10.20.193.5:0/3956034469 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc938152c00 0x7fc9380cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.552+0000 7fc93cd61640 1 --2- 10.20.193.5:0/3956034469 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc938152820 0x7fc9380cb330 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.552+0000 7fc93cd61640 1 --2- 10.20.193.5:0/3956034469 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc9380738f0 0x7fc93814e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.552+0000 7fc93cd61640 1 -- 10.20.193.5:0/3956034469 >> 10.20.193.5:0/3956034469 conn(0x7fc9380c9f40 msgr2=0x7fc9380c86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.552+0000 7fc93cd61640 1 -- 10.20.193.5:0/3956034469 shutdown_connections 2026-02-17T21:29:36.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.552+0000 7fc93cd61640 1 -- 10.20.193.5:0/3956034469 wait complete. 2026-02-17T21:29:36.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:36.552+0000 7fc93cd61640 1 librados: shutdown 2026-02-17T21:29:37.658 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:06:17.283 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:37.660 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:06:17.285 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:37.668 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:06:17.293 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:37.688 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:06:17.274 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:37.689 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:06:17.313 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:37.689 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:06:17.276 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:37.690 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:06:17.314 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:37.697 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:06:17.321 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:37.698 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:06:17.283 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:39.562 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:29:39.631 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.630+0000 7f3278bd5640 10 monclient: get_monmap_and_config 2026-02-17T21:29:39.631 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.630+0000 7f3278bd5640 10 monclient: build_initial_monmap 2026-02-17T21:29:39.631 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.630+0000 7f3278bd5640 10 monclient: monmap: 2026-02-17T21:29:39.631 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:39.632 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:39.632 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:29:39.631317+0000 2026-02-17T21:29:39.632 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:29:39.631317+0000 2026-02-17T21:29:39.632 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:39.632 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:39.632 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:29:39.632 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:29:39.632 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:29:39.632 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:29:39.632 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:29:39.632 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:29:39.632 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:39.632 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.631+0000 7f3278bd5640 1 Processor -- start 2026-02-17T21:29:39.632 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.631+0000 7f3278bd5640 1 -- start start 2026-02-17T21:29:39.632 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.631+0000 7f3278bd5640 10 monclient: init 2026-02-17T21:29:39.632 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.631+0000 7f3278bd5640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:39.632 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.631+0000 7f3278bd5640 10 monclient: _add_conns ranks=[1,5,3,4,2,0] 2026-02-17T21:29:39.632 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.631+0000 7f3278bd5640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f32740c7170 addr v1:10.20.193.119:6789/0 2026-02-17T21:29:39.632 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.631+0000 7f3278bd5640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f32740c7550 0x7f32740749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:39.632 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.631+0000 7f3278bd5640 10 monclient(hunting): picked mon.noname-c con 0x7f32740c7550 addr v2:10.20.193.135:3300/0 2026-02-17T21:29:39.632 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.631+0000 7f3278bd5640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f3274074ef0 0x7f32740c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:39.632 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.631+0000 7f3278bd5640 10 monclient(hunting): picked mon.noname-a con 0x7f3274074ef0 addr v2:10.20.193.5:3300/0 2026-02-17T21:29:39.632 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.631+0000 7f3278bd5640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32740c4fd0 con 0x7f32740c7170 2026-02-17T21:29:39.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.631+0000 7f3278bd5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:39.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.631+0000 7f3278bd5640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f32740c8530 con 0x7f3274074ef0 2026-02-17T21:29:39.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.631+0000 7f3278bd5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:39.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.631+0000 7f3278bd5640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f327415a9a0 con 0x7f32740c7550 2026-02-17T21:29:39.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.631+0000 7f3278bd5640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:39.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.631+0000 7f3278bd5640 10 monclient(hunting): authenticate will time out at 1285.196611s 2026-02-17T21:29:39.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.632+0000 7f3271d74640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f32740c7550 0x7f32740749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:39.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.632+0000 7f3272575640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f32740c7170 0x7f32740c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:33562/0 (socket says 10.20.193.5:33562) 2026-02-17T21:29:39.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.632+0000 7f3272575640 1 -- 10.20.193.5:0/60179873 learned_addr learned my addr 10.20.193.5:0/60179873 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:29:39.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.632+0000 7f3271d74640 10 monclient(hunting): get_auth_request con 0x7f32740c7550 auth_method 0 2026-02-17T21:29:39.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.632+0000 7f3271d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:39.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.632+0000 7f3271d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:39.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.632+0000 7f3271d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:39.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.632+0000 7f3271d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:39.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.632+0000 7f3271d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:39.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.632+0000 7f3271d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:39.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.632+0000 7f3272d76640 1 --2- 10.20.193.5:0/60179873 >> v2:10.20.193.5:3300/0 conn(0x7f3274074ef0 0x7f32740c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:39.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.632+0000 7f3272d76640 10 monclient(hunting): get_auth_request con 0x7f3274074ef0 auth_method 0 2026-02-17T21:29:39.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.632+0000 7f3272d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.632+0000 7f3272d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.632+0000 7f3272d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.633+0000 7f3272d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.633+0000 7f3272d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.633+0000 7f3272d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.633+0000 7f3271573640 1 -- 10.20.193.5:0/60179873 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2607214631 0 0) 0x7f32740c4fd0 con 0x7f32740c7170 2026-02-17T21:29:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.633+0000 7f3271573640 10 monclient(hunting): _negotiate 2026-02-17T21:29:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.633+0000 7f3271573640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.633+0000 7f3271573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.633+0000 7f3271573640 10 monclient(hunting): my global_id is 5053 2026-02-17T21:29:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.633+0000 7f3271573640 1 -- 10.20.193.5:0/60179873 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3260003620 con 0x7f32740c7170 2026-02-17T21:29:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.633+0000 7f3271d74640 10 monclient(hunting): handle_auth_done global_id 5030 payload 274 2026-02-17T21:29:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.633+0000 7f3271d74640 1 -- 10.20.193.5:0/60179873 >> v2:10.20.193.5:3300/0 conn(0x7f3274074ef0 msgr2=0x7f32740c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:29:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.633+0000 7f3271d74640 1 --2- 10.20.193.5:0/60179873 >> v2:10.20.193.5:3300/0 conn(0x7f3274074ef0 0x7f32740c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.633+0000 7f3271d74640 1 -- 10.20.193.5:0/60179873 >> v1:10.20.193.119:6789/0 conn(0x7f32740c7170 legacy=0x7f32740c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.633+0000 7f3271d74640 10 monclient: _finish_hunting 0 2026-02-17T21:29:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.633+0000 7f3271d74640 1 monclient: found mon.noname-c 2026-02-17T21:29:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.633+0000 7f3271d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.633+0000 7f3271d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:29:39.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.633+0000 7f3271d74640 1 -- 10.20.193.5:0/60179873 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32740c5270 con 0x7f32740c7550 2026-02-17T21:29:39.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.634+0000 7f3271d74640 1 --2- 10.20.193.5:0/60179873 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f32740c7550 0x7f32740749b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f32740c6e90 tx=0x7f325c02ede0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=992c4bfa71b18e92 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:39.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.635+0000 7f3271573640 1 -- 10.20.193.5:0/60179873 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325c03c070 con 0x7f32740c7550 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.635+0000 7f3271573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.635+0000 7f3271573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.635+0000 7f3271573640 10 monclient: dump: 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.635+0000 7f3271573640 10 monclient: _finish_auth 0 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.635+0000 7f3271573640 10 monclient: _check_auth_tickets 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.635+0000 7f3271573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.635+0000 7f3278bd5640 5 monclient: authenticate success, global_id 5030 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.635+0000 7f3278bd5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.636+0000 7f3271573640 1 -- 10.20.193.5:0/60179873 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f325c02faf0 con 0x7f32740c7550 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.636+0000 7f3271573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.636+0000 7f3271573640 1 -- 10.20.193.5:0/60179873 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325c037440 con 0x7f32740c7550 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.636+0000 7f3271573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.636+0000 7f3271573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.636+0000 7f3271573640 10 monclient: dump: 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:39.637 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.636+0000 7f3278bd5640 10 monclient: get_monmap_and_config success 2026-02-17T21:29:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.636+0000 7f3278bd5640 4 set_mon_vals no callback set 2026-02-17T21:29:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.636+0000 7f3278bd5640 10 monclient: shutdown 2026-02-17T21:29:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.636+0000 7f3278bd5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.636+0000 7f3278bd5640 1 -- 10.20.193.5:0/60179873 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f32740c7550 msgr2=0x7f32740749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.636+0000 7f3278bd5640 1 --2- 10.20.193.5:0/60179873 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f32740c7550 0x7f32740749b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f32740c6e90 tx=0x7f325c02ede0 comp rx=0 tx=0).stop 2026-02-17T21:29:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.636+0000 7f3278bd5640 1 -- 10.20.193.5:0/60179873 shutdown_connections 2026-02-17T21:29:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.636+0000 7f3278bd5640 1 --2- 10.20.193.5:0/60179873 >> v2:10.20.193.5:3300/0 conn(0x7f3274074ef0 0x7f32740c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.636+0000 7f3278bd5640 1 --2- 10.20.193.5:0/60179873 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f32740c7550 0x7f32740749b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.636+0000 7f3278bd5640 1 -- 10.20.193.5:0/60179873 >> 10.20.193.5:0/60179873 conn(0x7f32740c9f40 msgr2=0x7f32740ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.636+0000 7f3278bd5640 1 -- 10.20.193.5:0/60179873 shutdown_connections 2026-02-17T21:29:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.636+0000 7f3278bd5640 1 -- 10.20.193.5:0/60179873 wait complete. 2026-02-17T21:29:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.637+0000 7f3278bd5640 10 monclient: build_initial_monmap 2026-02-17T21:29:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.637+0000 7f3278bd5640 10 monclient: monmap: 2026-02-17T21:29:39.638 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:39.638 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:29:39.638 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:29:39.638 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:29:39.638 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:39.638 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:39.638 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:29:39.638 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:29:39.638 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:29:39.638 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:39.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.637+0000 7f3278bd5640 1 librados: starting msgr at 2026-02-17T21:29:39.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.637+0000 7f3278bd5640 1 librados: starting objecter 2026-02-17T21:29:39.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.637+0000 7f3278bd5640 1 Processor -- start 2026-02-17T21:29:39.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3278bd5640 1 -- start start 2026-02-17T21:29:39.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3278bd5640 1 librados: setting wanted keys 2026-02-17T21:29:39.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3278bd5640 1 librados: calling monclient init 2026-02-17T21:29:39.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3278bd5640 10 monclient: init 2026-02-17T21:29:39.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3278bd5640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:39.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3278bd5640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:29:39.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3278bd5640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3274074ef0 0x7f32740c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:39.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3278bd5640 10 monclient(hunting): picked mon.noname-c con 0x7f3274074ef0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:29:39.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3278bd5640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f32740c7170 0x7f32740cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:39.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3278bd5640 10 monclient(hunting): picked mon.noname-b con 0x7f32740c7170 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:29:39.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3278bd5640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f32740c7550 0x7f32740c2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:39.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3278bd5640 10 monclient(hunting): picked mon.noname-a con 0x7f32740c7550 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:29:39.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3278bd5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:39.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3278bd5640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f32740c7ee0 con 0x7f32740c7550 2026-02-17T21:29:39.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3278bd5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:39.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3278bd5640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f32740c5830 con 0x7f32740c7170 2026-02-17T21:29:39.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3278bd5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:39.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3278bd5640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f32740c81c0 con 0x7f3274074ef0 2026-02-17T21:29:39.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3278bd5640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:39.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3278bd5640 10 monclient(hunting): authenticate will time out at 1285.203516s 2026-02-17T21:29:39.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3272d76640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f32740c7550 0x7f32740c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:39.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3271d74640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f32740c7170 0x7f32740cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:39.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3272575640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3274074ef0 0x7f32740c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:39.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3272d76640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f32740c7550 0x7f32740c2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:46486/0 (socket says 10.20.193.5:46486) 2026-02-17T21:29:39.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3272d76640 1 -- 10.20.193.5:0/3328158509 learned_addr learned my addr 10.20.193.5:0/3328158509 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:29:39.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3272d76640 10 monclient(hunting): get_auth_request con 0x7f32740c7550 auth_method 0 2026-02-17T21:29:39.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3272d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:39.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3272d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:39.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.638+0000 7f3272d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:39.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.639+0000 7f3272575640 10 monclient(hunting): get_auth_request con 0x7f3274074ef0 auth_method 0 2026-02-17T21:29:39.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.639+0000 7f3272575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:39.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.639+0000 7f3272575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:39.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.639+0000 7f3272575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:39.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.639+0000 7f3271d74640 10 monclient(hunting): get_auth_request con 0x7f32740c7170 auth_method 0 2026-02-17T21:29:39.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.639+0000 7f3271d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:39.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.639+0000 7f3271d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:39.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.639+0000 7f3271d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:39.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.639+0000 7f3272d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:39.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.639+0000 7f3272d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:39.640 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.639+0000 7f3272d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:39.641 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.639+0000 7f3272575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:39.641 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.639+0000 7f3272575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:39.641 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.639+0000 7f3272575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:39.641 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.639+0000 7f3271d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:39.641 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.639+0000 7f3271d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:39.641 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.639+0000 7f3271d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:39.641 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.640+0000 7f3272d76640 10 monclient(hunting): handle_auth_done global_id 5001 payload 824 2026-02-17T21:29:39.641 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.640+0000 7f3272d76640 1 -- 10.20.193.5:0/3328158509 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3274074ef0 msgr2=0x7f32740c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:39.641 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.640+0000 7f3272d76640 1 --2- 10.20.193.5:0/3328158509 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3274074ef0 0x7f32740c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:39.641 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.640+0000 7f3272d76640 1 -- 10.20.193.5:0/3328158509 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f32740c7170 msgr2=0x7f32740cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:39.641 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.640+0000 7f3272d76640 1 --2- 10.20.193.5:0/3328158509 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f32740c7170 0x7f32740cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:39.641 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.640+0000 7f3272d76640 10 monclient: _finish_hunting 0 2026-02-17T21:29:39.641 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.640+0000 7f3272d76640 1 monclient: found mon.noname-a 2026-02-17T21:29:39.641 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.640+0000 7f3272d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:39.641 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.640+0000 7f3272d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:29:39.641 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.640+0000 7f3272d76640 1 -- 10.20.193.5:0/3328158509 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32741f5400 con 0x7f32740c7550 2026-02-17T21:29:39.642 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.641+0000 7f3272d76640 1 --2- 10.20.193.5:0/3328158509 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f32740c7550 0x7f32740c2dc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f326400efc0 tx=0x7f326400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:39.642 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.641+0000 7f325affd640 10 client.?.objecter ms_handle_connect 0x7f32740c7550 2026-02-17T21:29:39.642 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.641+0000 7f325affd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:29:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f325affd640 1 -- 10.20.193.5:0/3328158509 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3264018020 con 0x7f32740c7550 2026-02-17T21:29:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f325affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f325affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:29:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f325affd640 10 monclient: dump: 2026-02-17T21:29:39.644 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:39.644 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:39.644 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:39.644 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:39.644 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:39.644 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:39.644 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:39.644 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:39.644 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f325affd640 10 monclient: _finish_auth 0 2026-02-17T21:29:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f325affd640 10 monclient: _check_auth_tickets 2026-02-17T21:29:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f325affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:39.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f325affd640 1 -- 10.20.193.5:0/3328158509 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3264014480 con 0x7f32740c7550 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f325affd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f325affd640 1 -- 10.20.193.5:0/3328158509 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3264014870 con 0x7f32740c7550 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f325affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f3270d72640 4 set_mon_vals no callback set 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f325affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f325affd640 10 monclient: dump: 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f3278bd5640 5 monclient: authenticate success, global_id 5001 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f3278bd5640 10 monclient: _renew_subs 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f3278bd5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f3278bd5640 1 -- 10.20.193.5:0/3328158509 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32741f27b0 con 0x7f32740c7550 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f3278bd5640 10 client.5001.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f3278bd5640 10 monclient: _renew_subs 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f3278bd5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f3278bd5640 1 -- 10.20.193.5:0/3328158509 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32741f2d70 con 0x7f32740c7550 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f3278bd5640 1 librados: init done 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f3278bd5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f3278bd5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f3278bd5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:39.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.643+0000 7f3278bd5640 1 -- 10.20.193.5:0/3328158509 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f327415a300 con 0x7f32740c7550 2026-02-17T21:29:39.656 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.655+0000 7f325affd640 1 -- 10.20.193.5:0/3328158509 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f3264014a10 con 0x7f32740c7550 2026-02-17T21:29:39.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.656+0000 7f325affd640 1 --2- 10.20.193.5:0/3328158509 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f324007d790 0x7f324007fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:39.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.656+0000 7f3272575640 1 --2- 10.20.193.5:0/3328158509 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f324007d790 0x7f324007fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:39.657 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.656+0000 7f3272575640 10 monclient: get_auth_request con 0x7f324007d790 auth_method 0 2026-02-17T21:29:39.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.657+0000 7f3272575640 1 --2- 10.20.193.5:0/3328158509 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f324007d790 0x7f324007fc50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3268007b60 tx=0x7f3268007ab0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:39.658 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.657+0000 7f325affd640 10 client.5001.objecter ms_handle_connect 0x7f324007d790 2026-02-17T21:29:39.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.658+0000 7f325affd640 1 -- 10.20.193.5:0/3328158509 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f326405f160 con 0x7f32740c7550 2026-02-17T21:29:39.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.658+0000 7f325affd640 10 client.5001.objecter ms_dispatch2 0x7f3274000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:29:39.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.658+0000 7f325affd640 3 client.5001.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:29:39.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.658+0000 7f325affd640 3 client.5001.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:29:39.659 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.658+0000 7f325affd640 20 client.5001.objecter dump_active .. 0 homeless 2026-02-17T21:29:39.760 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.759+0000 7f325affd640 1 -- 10.20.193.5:0/3328158509 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f327415a300 con 0x7f32740c7550 2026-02-17T21:29:39.760 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.759+0000 7f325affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:39.760 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.759+0000 7f325affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:29:39.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.859+0000 7f3278bd5640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:29:39.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.859+0000 7f3278bd5640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:39.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.859+0000 7f3278bd5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:39.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.859+0000 7f3278bd5640 1 -- 10.20.193.5:0/3328158509 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f32740c7b10 con 0x7f32740c7550 2026-02-17T21:29:39.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.862+0000 7f325affd640 1 -- 10.20.193.5:0/3328158509 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f32740c7b10 con 0x7f32740c7550 2026-02-17T21:29:39.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.862+0000 7f325affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:39.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.862+0000 7f325affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:29:39.863 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:29:39.863 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:29:39.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.863+0000 7f3278bd5640 10 librados: watch_flush enter 2026-02-17T21:29:39.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.863+0000 7f3278bd5640 10 librados: watch_flush exit 2026-02-17T21:29:39.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.863+0000 7f3278bd5640 20 client.5001.objecter shutdown clearing up homeless session... 2026-02-17T21:29:39.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.863+0000 7f3278bd5640 10 client.5001.objecter successfully canceled tick 2026-02-17T21:29:39.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.863+0000 7f3278bd5640 1 -- 10.20.193.5:0/3328158509 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f324007d790 msgr2=0x7f324007fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:39.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.863+0000 7f3278bd5640 1 --2- 10.20.193.5:0/3328158509 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f324007d790 0x7f324007fc50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3268007b60 tx=0x7f3268007ab0 comp rx=0 tx=0).stop 2026-02-17T21:29:39.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.863+0000 7f3278bd5640 10 monclient: shutdown 2026-02-17T21:29:39.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.863+0000 7f3278bd5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:39.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.863+0000 7f3278bd5640 1 -- 10.20.193.5:0/3328158509 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f32740c7550 msgr2=0x7f32740c2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:39.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.863+0000 7f3278bd5640 1 --2- 10.20.193.5:0/3328158509 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f32740c7550 0x7f32740c2dc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f326400efc0 tx=0x7f326400c490 comp rx=0 tx=0).stop 2026-02-17T21:29:39.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.863+0000 7f3278bd5640 1 -- 10.20.193.5:0/3328158509 shutdown_connections 2026-02-17T21:29:39.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.863+0000 7f3278bd5640 1 --2- 10.20.193.5:0/3328158509 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f324007d790 0x7f324007fc50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:39.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.863+0000 7f3278bd5640 1 --2- 10.20.193.5:0/3328158509 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f32740c7550 0x7f32740c2dc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:39.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.863+0000 7f3278bd5640 1 --2- 10.20.193.5:0/3328158509 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f32740c7170 0x7f32740cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:39.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.863+0000 7f3278bd5640 1 --2- 10.20.193.5:0/3328158509 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f3274074ef0 0x7f32740c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:39.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.863+0000 7f3278bd5640 1 -- 10.20.193.5:0/3328158509 >> 10.20.193.5:0/3328158509 conn(0x7f32740c9f40 msgr2=0x7f3274158910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:39.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.863+0000 7f3278bd5640 1 -- 10.20.193.5:0/3328158509 shutdown_connections 2026-02-17T21:29:39.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.863+0000 7f3278bd5640 1 -- 10.20.193.5:0/3328158509 wait complete. 2026-02-17T21:29:39.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:39.864+0000 7f3278bd5640 1 librados: shutdown 2026-02-17T21:29:42.874 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:29:42.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.939+0000 7efcbeb1b640 10 monclient: get_monmap_and_config 2026-02-17T21:29:42.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.939+0000 7efcbeb1b640 10 monclient: build_initial_monmap 2026-02-17T21:29:42.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.939+0000 7efcbeb1b640 10 monclient: monmap: 2026-02-17T21:29:42.941 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:42.941 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:42.941 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:29:42.940494+0000 2026-02-17T21:29:42.941 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:29:42.940494+0000 2026-02-17T21:29:42.942 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:42.942 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:42.942 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:29:42.942 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:29:42.942 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:29:42.942 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:29:42.942 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:29:42.942 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:29:42.942 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:42.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.940+0000 7efcbeb1b640 1 Processor -- start 2026-02-17T21:29:42.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.940+0000 7efcbeb1b640 1 -- start start 2026-02-17T21:29:42.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.940+0000 7efcbeb1b640 10 monclient: init 2026-02-17T21:29:42.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.940+0000 7efcbeb1b640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:42.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.940+0000 7efcbeb1b640 10 monclient: _add_conns ranks=[2,5,0,1,3,4] 2026-02-17T21:29:42.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.940+0000 7efcbeb1b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7efcb80c7170 addr v1:10.20.193.135:6789/0 2026-02-17T21:29:42.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.940+0000 7efcbeb1b640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7efcb80c7550 0x7efcb80749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:42.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.940+0000 7efcbeb1b640 10 monclient(hunting): picked mon.noname-c con 0x7efcb80c7550 addr v2:10.20.193.135:3300/0 2026-02-17T21:29:42.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.940+0000 7efcbeb1b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7efcb8074ef0 addr v1:10.20.193.5:6789/0 2026-02-17T21:29:42.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.940+0000 7efcbeb1b640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcb80c4fd0 con 0x7efcb8074ef0 2026-02-17T21:29:42.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.940+0000 7efcbeb1b640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcb815a9a0 con 0x7efcb80c7170 2026-02-17T21:29:42.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.940+0000 7efcbeb1b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:42.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.940+0000 7efcbeb1b640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7efcb80c8530 con 0x7efcb80c7550 2026-02-17T21:29:42.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.940+0000 7efcbeb1b640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:42.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.940+0000 7efcbeb1b640 10 monclient(hunting): authenticate will time out at 1288.505876s 2026-02-17T21:29:42.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.941+0000 7efcbc890640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7efcb80c7170 0x7efcb80c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:39880/0 (socket says 10.20.193.5:39880) 2026-02-17T21:29:42.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.941+0000 7efcbc890640 1 -- 10.20.193.5:0/1176098077 learned_addr learned my addr 10.20.193.5:0/1176098077 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:29:42.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.941+0000 7efcaffff640 1 --2- 10.20.193.5:0/1176098077 >> v2:10.20.193.135:3300/0 conn(0x7efcb80c7550 0x7efcb80749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:42.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.942+0000 7efcaffff640 10 monclient(hunting): get_auth_request con 0x7efcb80c7550 auth_method 0 2026-02-17T21:29:42.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.942+0000 7efcaffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:42.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.942+0000 7efcaffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:42.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.942+0000 7efcaffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:42.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.942+0000 7efcaf7fe640 1 -- 10.20.193.5:0/1176098077 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2988415565 0 0) 0x7efcb80c4fd0 con 0x7efcb8074ef0 2026-02-17T21:29:42.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.942+0000 7efcaf7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:29:42.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.942+0000 7efcaf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:42.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.942+0000 7efcaf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:42.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.942+0000 7efcaf7fe640 10 monclient(hunting): my global_id is 5004 2026-02-17T21:29:42.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.942+0000 7efcaf7fe640 1 -- 10.20.193.5:0/1176098077 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efca4003620 con 0x7efcb8074ef0 2026-02-17T21:29:42.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.942+0000 7efcaffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:42.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.942+0000 7efcaffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:42.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.942+0000 7efcaffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:42.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 1 -- 10.20.193.5:0/1176098077 <== mon.0 v1:10.20.193.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2788330808 0 0) 0x7efca4003620 con 0x7efcb8074ef0 2026-02-17T21:29:42.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 1 -- 10.20.193.5:0/1176098077 >> v2:10.20.193.135:3300/0 conn(0x7efcb80c7550 msgr2=0x7efcb80749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:29:42.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 1 --2- 10.20.193.5:0/1176098077 >> v2:10.20.193.135:3300/0 conn(0x7efcb80c7550 0x7efcb80749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:42.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 1 -- 10.20.193.5:0/1176098077 >> v1:10.20.193.135:6789/0 conn(0x7efcb80c7170 legacy=0x7efcb80c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:42.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:29:42.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 1 monclient: found mon.noname-a-legacy 2026-02-17T21:29:42.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:42.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.5:6789/0 2026-02-17T21:29:42.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 1 -- 10.20.193.5:0/1176098077 --> v1:10.20.193.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb80c5270 con 0x7efcb8074ef0 2026-02-17T21:29:42.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 10 monclient: _finish_auth 0 2026-02-17T21:29:42.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:29:42.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:42.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcbeb1b640 5 monclient: authenticate success, global_id 5004 2026-02-17T21:29:42.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 1 -- 10.20.193.5:0/1176098077 <== mon.0 v1:10.20.193.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3880376286 0 0) 0x7efcb40032a0 con 0x7efcb8074ef0 2026-02-17T21:29:42.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcbeb1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:29:42.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:42.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T21:29:42.957 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 10 monclient: dump: 2026-02-17T21:29:42.957 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:42.957 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:42.957 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:42.957 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:42.957 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:42.957 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:42.957 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:42.958 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:42.958 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:42.958 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:42.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] but i'm connected to v1:10.20.193.5:6789/0, reconnecting 2026-02-17T21:29:42.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:42.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 1 -- 10.20.193.5:0/1176098077 >> v1:10.20.193.5:6789/0 conn(0x7efcb8074ef0 legacy=0x7efcb80c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:42.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:29:42.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 1 --2- 10.20.193.5:0/1176098077 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7efca4003bf0 0x7efca4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:42.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 10 monclient(hunting): picked mon.c con 0x7efca4003bf0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:29:42.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 1 --2- 10.20.193.5:0/1176098077 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7efca4004900 0x7efca4004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:42.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 10 monclient(hunting): picked mon.a con 0x7efca4004900 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:29:42.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 1 --2- 10.20.193.5:0/1176098077 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efca40054c0 0x7efca400bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:42.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 10 monclient(hunting): picked mon.b con 0x7efca40054c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:29:42.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:42.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 1 -- 10.20.193.5:0/1176098077 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7efcb80c8530 con 0x7efca4004900 2026-02-17T21:29:42.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:42.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 1 -- 10.20.193.5:0/1176098077 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7efca400c330 con 0x7efca40054c0 2026-02-17T21:29:42.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:42.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 1 -- 10.20.193.5:0/1176098077 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7efca400c530 con 0x7efca4003bf0 2026-02-17T21:29:42.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:42.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcaf7fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:29:42.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.944+0000 7efcbeb1b640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T21:29:42.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.945+0000 7efcbd091640 1 --2- 10.20.193.5:0/1176098077 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efca40054c0 0x7efca400bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:42.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.945+0000 7efcbd091640 10 monclient(hunting): get_auth_request con 0x7efca40054c0 auth_method 0 2026-02-17T21:29:42.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.945+0000 7efcbd091640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:42.960 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.945+0000 7efcbd091640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:42.960 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.945+0000 7efcbd091640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:29:42.960 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.945+0000 7efcaffff640 1 --2- 10.20.193.5:0/1176098077 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7efca4004900 0x7efca4004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:42.960 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.945+0000 7efcbd091640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:42.960 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.945+0000 7efcbd091640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:42.960 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.945+0000 7efcbd091640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:29:42.960 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.945+0000 7efcaffff640 10 monclient(hunting): get_auth_request con 0x7efca4004900 auth_method 0 2026-02-17T21:29:42.960 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.945+0000 7efcaffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:42.960 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.945+0000 7efcaffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:42.960 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.945+0000 7efcaffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:29:42.960 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.946+0000 7efcbc890640 1 --2- 10.20.193.5:0/1176098077 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7efca4003bf0 0x7efca4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:42.960 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.946+0000 7efcbc890640 10 monclient(hunting): get_auth_request con 0x7efca4003bf0 auth_method 0 2026-02-17T21:29:42.960 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.946+0000 7efcbc890640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:42.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.946+0000 7efcbc890640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:42.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.946+0000 7efcbc890640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:29:42.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.946+0000 7efcaffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:42.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.946+0000 7efcaffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:42.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.946+0000 7efcaffff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:29:42.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.946+0000 7efcbc890640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:42.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.946+0000 7efcbc890640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:42.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.946+0000 7efcbc890640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:29:42.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.946+0000 7efcbd091640 10 monclient(hunting): handle_auth_done global_id 5004 payload 293 2026-02-17T21:29:42.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.946+0000 7efcbd091640 1 -- 10.20.193.5:0/1176098077 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7efca4003bf0 msgr2=0x7efca4004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:29:42.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.946+0000 7efcbd091640 1 --2- 10.20.193.5:0/1176098077 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7efca4003bf0 0x7efca4004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:42.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.946+0000 7efcbd091640 1 -- 10.20.193.5:0/1176098077 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7efca4004900 msgr2=0x7efca4004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:29:42.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.946+0000 7efcbd091640 1 --2- 10.20.193.5:0/1176098077 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7efca4004900 0x7efca4004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:42.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.946+0000 7efcbd091640 10 monclient: _finish_hunting 0 2026-02-17T21:29:42.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.946+0000 7efcbd091640 1 monclient: found mon.b 2026-02-17T21:29:42.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.946+0000 7efcbd091640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:42.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.946+0000 7efcbd091640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:29:42.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.946+0000 7efcbd091640 1 -- 10.20.193.5:0/1176098077 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca4003620 con 0x7efca40054c0 2026-02-17T21:29:42.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.946+0000 7efcbd091640 10 monclient: _finish_auth 0 2026-02-17T21:29:42.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.946+0000 7efcbd091640 10 monclient: _check_auth_tickets 2026-02-17T21:29:42.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.946+0000 7efcbd091640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:42.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.947+0000 7efcbd091640 1 -- 10.20.193.5:0/1176098077 reap_dead start 2026-02-17T21:29:42.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.948+0000 7efcbd091640 1 --2- 10.20.193.5:0/1176098077 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efca40054c0 0x7efca400bac0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7efcb400a7e0 tx=0x7efcb402fba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60b75e99ca6b9052 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:42.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.950+0000 7efcaf7fe640 1 -- 10.20.193.5:0/1176098077 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb400a430 con 0x7efca40054c0 2026-02-17T21:29:42.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.950+0000 7efcaf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:42.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.950+0000 7efcaf7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:29:42.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.950+0000 7efcaf7fe640 10 monclient: dump: 2026-02-17T21:29:42.963 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:42.963 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:42.963 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:42.963 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:42.963 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:42.963 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:42.963 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:42.963 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:42.963 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:42.963 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:42.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.950+0000 7efcaf7fe640 1 -- 10.20.193.5:0/1176098077 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb4031630 con 0x7efca40054c0 2026-02-17T21:29:42.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.950+0000 7efcbeb1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:29:42.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.950+0000 7efcaf7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:42.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.950+0000 7efcbeb1b640 10 monclient: get_monmap_and_config success 2026-02-17T21:29:42.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.950+0000 7efcaf7fe640 1 -- 10.20.193.5:0/1176098077 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4031a20 con 0x7efca40054c0 2026-02-17T21:29:42.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.950+0000 7efcbeb1b640 4 set_mon_vals no callback set 2026-02-17T21:29:42.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.950+0000 7efcaf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:42.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.950+0000 7efcaf7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:29:42.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.950+0000 7efcaf7fe640 10 monclient: dump: 2026-02-17T21:29:42.964 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:42.964 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:42.964 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:42.965 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:42.965 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:42.965 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:42.965 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:42.965 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:42.965 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:42.965 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:42.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.950+0000 7efcbeb1b640 10 monclient: shutdown 2026-02-17T21:29:42.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.950+0000 7efcbeb1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:42.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.950+0000 7efcbeb1b640 1 -- 10.20.193.5:0/1176098077 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efca40054c0 msgr2=0x7efca400bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:42.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.950+0000 7efcbeb1b640 1 --2- 10.20.193.5:0/1176098077 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efca40054c0 0x7efca400bac0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7efcb400a7e0 tx=0x7efcb402fba0 comp rx=0 tx=0).stop 2026-02-17T21:29:42.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.950+0000 7efcbeb1b640 1 -- 10.20.193.5:0/1176098077 shutdown_connections 2026-02-17T21:29:42.965 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.950+0000 7efcbeb1b640 1 --2- 10.20.193.5:0/1176098077 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efca40054c0 0x7efca400bac0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:42.966 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.950+0000 7efcbeb1b640 1 -- 10.20.193.5:0/1176098077 >> 10.20.193.5:0/1176098077 conn(0x7efcb80c9f40 msgr2=0x7efcb80ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:42.966 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.950+0000 7efcbeb1b640 1 -- 10.20.193.5:0/1176098077 shutdown_connections 2026-02-17T21:29:42.966 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.950+0000 7efcbeb1b640 1 -- 10.20.193.5:0/1176098077 wait complete. 2026-02-17T21:29:42.966 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.950+0000 7efcbeb1b640 10 monclient: build_initial_monmap 2026-02-17T21:29:42.966 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.950+0000 7efcbeb1b640 10 monclient: monmap: 2026-02-17T21:29:42.966 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:42.966 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:29:42.966 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:29:42.966 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:29:42.966 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:42.966 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:42.966 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:29:42.967 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:29:42.967 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:29:42.967 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:42.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.951+0000 7efcbeb1b640 1 librados: starting msgr at 2026-02-17T21:29:42.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.951+0000 7efcbeb1b640 1 librados: starting objecter 2026-02-17T21:29:42.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.951+0000 7efcbeb1b640 1 Processor -- start 2026-02-17T21:29:42.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.951+0000 7efcbeb1b640 1 -- start start 2026-02-17T21:29:42.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.951+0000 7efcbeb1b640 1 librados: setting wanted keys 2026-02-17T21:29:42.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.951+0000 7efcbeb1b640 1 librados: calling monclient init 2026-02-17T21:29:42.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.951+0000 7efcbeb1b640 10 monclient: init 2026-02-17T21:29:42.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.951+0000 7efcbeb1b640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:42.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.951+0000 7efcbeb1b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:29:42.967 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.951+0000 7efcbeb1b640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7efca40054c0 0x7efcb81f6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:42.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.951+0000 7efcbeb1b640 10 monclient(hunting): picked mon.noname-a con 0x7efca40054c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:29:42.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.951+0000 7efcbeb1b640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7efcb8073360 0x7efcb8154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:42.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.951+0000 7efcbeb1b640 10 monclient(hunting): picked mon.noname-c con 0x7efcb8073360 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:29:42.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.951+0000 7efcbeb1b640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efcb80737e0 0x7efcb8155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:42.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.951+0000 7efcbeb1b640 10 monclient(hunting): picked mon.noname-b con 0x7efcb80737e0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:29:42.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.951+0000 7efcbeb1b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:42.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.951+0000 7efcbeb1b640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7efcb80c7ee0 con 0x7efca40054c0 2026-02-17T21:29:42.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.951+0000 7efcbeb1b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:42.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.951+0000 7efcbeb1b640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7efcb80c5830 con 0x7efcb80737e0 2026-02-17T21:29:42.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.951+0000 7efcbeb1b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:42.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.951+0000 7efcbeb1b640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7efcb80c81c0 con 0x7efcb8073360 2026-02-17T21:29:42.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.951+0000 7efcbeb1b640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:42.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.951+0000 7efcbeb1b640 10 monclient(hunting): authenticate will time out at 1288.516623s 2026-02-17T21:29:42.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.951+0000 7efcbc890640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7efca40054c0 0x7efcb81f6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:42.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.951+0000 7efcbd091640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efcb80737e0 0x7efcb8155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:42.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.952+0000 7efcaffff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7efcb8073360 0x7efcb8154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:42.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.952+0000 7efcbd091640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efcb80737e0 0x7efcb8155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:47890/0 (socket says 10.20.193.5:47890) 2026-02-17T21:29:42.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.952+0000 7efcbd091640 1 -- 10.20.193.5:0/3921454368 learned_addr learned my addr 10.20.193.5:0/3921454368 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:29:42.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.952+0000 7efcbd091640 10 monclient(hunting): get_auth_request con 0x7efcb80737e0 auth_method 0 2026-02-17T21:29:42.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.952+0000 7efcbd091640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:42.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.952+0000 7efcbd091640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:42.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.952+0000 7efcbd091640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:42.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.952+0000 7efcbc890640 10 monclient(hunting): get_auth_request con 0x7efca40054c0 auth_method 0 2026-02-17T21:29:42.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.952+0000 7efcbc890640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:42.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.952+0000 7efcbc890640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:42.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.952+0000 7efcbc890640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:42.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.952+0000 7efcaffff640 10 monclient(hunting): get_auth_request con 0x7efcb8073360 auth_method 0 2026-02-17T21:29:42.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.952+0000 7efcaffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:42.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.952+0000 7efcaffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:42.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.952+0000 7efcaffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:42.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.952+0000 7efcbd091640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:42.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.952+0000 7efcbd091640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:42.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.952+0000 7efcbd091640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:42.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.952+0000 7efcbc890640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:42.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.952+0000 7efcbc890640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:42.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.952+0000 7efcbc890640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:42.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.952+0000 7efcaffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:42.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.952+0000 7efcaffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:42.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.952+0000 7efcaffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:42.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.953+0000 7efcbc890640 10 monclient(hunting): handle_auth_done global_id 5007 payload 824 2026-02-17T21:29:42.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.953+0000 7efcbc890640 1 -- 10.20.193.5:0/3921454368 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7efcb8073360 msgr2=0x7efcb8154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:42.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.953+0000 7efcbc890640 1 --2- 10.20.193.5:0/3921454368 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7efcb8073360 0x7efcb8154ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:42.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.953+0000 7efcbc890640 1 -- 10.20.193.5:0/3921454368 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efcb80737e0 msgr2=0x7efcb8155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:42.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.953+0000 7efcbc890640 1 --2- 10.20.193.5:0/3921454368 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efcb80737e0 0x7efcb8155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:42.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.953+0000 7efcbc890640 10 monclient: _finish_hunting 0 2026-02-17T21:29:42.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.953+0000 7efcbc890640 1 monclient: found mon.noname-a 2026-02-17T21:29:42.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.953+0000 7efcbc890640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:42.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.953+0000 7efcbc890640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:29:42.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.953+0000 7efcbc890640 1 -- 10.20.193.5:0/3921454368 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb81f7390 con 0x7efca40054c0 2026-02-17T21:29:42.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.954+0000 7efcbc890640 1 --2- 10.20.193.5:0/3921454368 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7efca40054c0 0x7efcb81f6af0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efca8002cc0 tx=0x7efca8003190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:42.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.954+0000 7efcad7fa640 10 client.?.objecter ms_handle_connect 0x7efca40054c0 2026-02-17T21:29:42.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.954+0000 7efcad7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:29:42.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.955+0000 7efcad7fa640 1 -- 10.20.193.5:0/3921454368 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca801a070 con 0x7efca40054c0 2026-02-17T21:29:42.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.955+0000 7efcad7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:42.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.955+0000 7efcad7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:29:42.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.955+0000 7efcad7fa640 10 monclient: dump: 2026-02-17T21:29:42.974 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:42.974 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:42.974 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:42.974 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:42.974 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:42.974 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:42.974 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:42.974 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:42.974 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:42.974 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:42.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.955+0000 7efcad7fa640 10 monclient: _finish_auth 0 2026-02-17T21:29:42.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.955+0000 7efcad7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:29:42.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.955+0000 7efcad7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:42.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.955+0000 7efcbeb1b640 5 monclient: authenticate success, global_id 5007 2026-02-17T21:29:42.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.955+0000 7efcbeb1b640 10 monclient: _renew_subs 2026-02-17T21:29:42.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.955+0000 7efcbeb1b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:42.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.955+0000 7efcbeb1b640 1 -- 10.20.193.5:0/3921454368 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcb81f7670 con 0x7efca40054c0 2026-02-17T21:29:42.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.955+0000 7efcbeb1b640 10 client.5007.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:29:42.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.955+0000 7efcbeb1b640 10 monclient: _renew_subs 2026-02-17T21:29:42.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.955+0000 7efcbeb1b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:42.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.955+0000 7efcbeb1b640 1 -- 10.20.193.5:0/3921454368 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb81542c0 con 0x7efca40054c0 2026-02-17T21:29:42.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.955+0000 7efcbeb1b640 1 librados: init done 2026-02-17T21:29:42.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.956+0000 7efcbeb1b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:42.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.956+0000 7efcbeb1b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:42.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.956+0000 7efcbeb1b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:42.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.956+0000 7efcbeb1b640 1 -- 10.20.193.5:0/3921454368 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb80749b0 con 0x7efca40054c0 2026-02-17T21:29:42.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.956+0000 7efcad7fa640 1 -- 10.20.193.5:0/3921454368 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efca800f620 con 0x7efca40054c0 2026-02-17T21:29:42.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.956+0000 7efcad7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:42.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.956+0000 7efcad7fa640 1 -- 10.20.193.5:0/3921454368 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca8024060 con 0x7efca40054c0 2026-02-17T21:29:42.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.956+0000 7efcad7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:42.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.956+0000 7efcaeffd640 4 set_mon_vals no callback set 2026-02-17T21:29:42.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.956+0000 7efcad7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:29:42.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:42.956+0000 7efcad7fa640 10 monclient: dump: 2026-02-17T21:29:42.976 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:42.976 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:42.976 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:42.976 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:42.976 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:42.976 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:42.976 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:42.977 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:42.977 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:42.977 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:43.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.062+0000 7efcad7fa640 1 -- 10.20.193.5:0/3921454368 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7efca800f9d0 con 0x7efca40054c0 2026-02-17T21:29:43.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.062+0000 7efcad7fa640 1 --2- 10.20.193.5:0/3921454368 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7efc88079280 0x7efc8807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:43.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.062+0000 7efcaffff640 1 --2- 10.20.193.5:0/3921454368 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7efc88079280 0x7efc8807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:43.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.062+0000 7efcaffff640 10 monclient: get_auth_request con 0x7efc88079280 auth_method 0 2026-02-17T21:29:43.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.063+0000 7efcaffff640 1 --2- 10.20.193.5:0/3921454368 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7efc88079280 0x7efc8807b740 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efcb81ede80 tx=0x7efca0009290 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:43.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.063+0000 7efcad7fa640 10 client.5007.objecter ms_handle_connect 0x7efc88079280 2026-02-17T21:29:43.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.070+0000 7efcad7fa640 1 -- 10.20.193.5:0/3921454368 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7efca8097340 con 0x7efca40054c0 2026-02-17T21:29:43.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.070+0000 7efcad7fa640 10 client.5007.objecter ms_dispatch2 0x7efcb8000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:29:43.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.070+0000 7efcad7fa640 3 client.5007.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:29:43.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.070+0000 7efcad7fa640 3 client.5007.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:29:43.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.070+0000 7efcad7fa640 20 client.5007.objecter dump_active .. 0 homeless 2026-02-17T21:29:43.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.070+0000 7efcad7fa640 1 -- 10.20.193.5:0/3921454368 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7efca80619e0 con 0x7efca40054c0 2026-02-17T21:29:43.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.070+0000 7efcad7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:43.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.070+0000 7efcad7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:29:43.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.169+0000 7efcbeb1b640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:29:43.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.169+0000 7efcbeb1b640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:43.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.169+0000 7efcbeb1b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:43.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.169+0000 7efcbeb1b640 1 -- 10.20.193.5:0/3921454368 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7efcb80cbbd0 con 0x7efca40054c0 2026-02-17T21:29:43.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.171+0000 7efcad7fa640 1 -- 10.20.193.5:0/3921454368 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7efca8065ce0 con 0x7efca40054c0 2026-02-17T21:29:43.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.171+0000 7efcad7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:43.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.171+0000 7efcad7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:29:43.173 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:29:43.173 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:29:43.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.172+0000 7efcbeb1b640 10 librados: watch_flush enter 2026-02-17T21:29:43.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.172+0000 7efcbeb1b640 10 librados: watch_flush exit 2026-02-17T21:29:43.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.172+0000 7efcbeb1b640 20 client.5007.objecter shutdown clearing up homeless session... 2026-02-17T21:29:43.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.172+0000 7efcbeb1b640 10 client.5007.objecter successfully canceled tick 2026-02-17T21:29:43.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.173+0000 7efcbeb1b640 1 -- 10.20.193.5:0/3921454368 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7efc88079280 msgr2=0x7efc8807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:43.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.173+0000 7efcbeb1b640 1 --2- 10.20.193.5:0/3921454368 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7efc88079280 0x7efc8807b740 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efcb81ede80 tx=0x7efca0009290 comp rx=0 tx=0).stop 2026-02-17T21:29:43.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.173+0000 7efcbeb1b640 10 monclient: shutdown 2026-02-17T21:29:43.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.173+0000 7efcbeb1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:43.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.173+0000 7efcbeb1b640 1 -- 10.20.193.5:0/3921454368 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7efca40054c0 msgr2=0x7efcb81f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:43.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.173+0000 7efcbeb1b640 1 --2- 10.20.193.5:0/3921454368 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7efca40054c0 0x7efcb81f6af0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efca8002cc0 tx=0x7efca8003190 comp rx=0 tx=0).stop 2026-02-17T21:29:43.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.173+0000 7efcbeb1b640 1 -- 10.20.193.5:0/3921454368 shutdown_connections 2026-02-17T21:29:43.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.173+0000 7efcbeb1b640 1 --2- 10.20.193.5:0/3921454368 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7efc88079280 0x7efc8807b740 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:43.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.173+0000 7efcbeb1b640 1 --2- 10.20.193.5:0/3921454368 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efcb80737e0 0x7efcb8155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:43.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.173+0000 7efcbeb1b640 1 --2- 10.20.193.5:0/3921454368 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7efcb8073360 0x7efcb8154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:43.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.173+0000 7efcbeb1b640 1 --2- 10.20.193.5:0/3921454368 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7efca40054c0 0x7efcb81f6af0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:43.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.173+0000 7efcbeb1b640 1 -- 10.20.193.5:0/3921454368 >> 10.20.193.5:0/3921454368 conn(0x7efcb80c9f40 msgr2=0x7efcb806fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:43.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.173+0000 7efcbeb1b640 1 -- 10.20.193.5:0/3921454368 shutdown_connections 2026-02-17T21:29:43.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.173+0000 7efcbeb1b640 1 -- 10.20.193.5:0/3921454368 wait complete. 2026-02-17T21:29:43.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:43.173+0000 7efcbeb1b640 1 librados: shutdown 2026-02-17T21:29:46.183 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:29:46.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.249+0000 7f8d6c755640 10 monclient: get_monmap_and_config 2026-02-17T21:29:46.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.249+0000 7f8d6c755640 10 monclient: build_initial_monmap 2026-02-17T21:29:46.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.249+0000 7f8d6c755640 10 monclient: monmap: 2026-02-17T21:29:46.250 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:46.250 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:46.250 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:29:46.249743+0000 2026-02-17T21:29:46.250 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:29:46.249743+0000 2026-02-17T21:29:46.250 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:46.250 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:46.250 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:29:46.250 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:29:46.250 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:29:46.250 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:29:46.250 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:29:46.250 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:29:46.250 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:46.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.249+0000 7f8d6c755640 1 Processor -- start 2026-02-17T21:29:46.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.249+0000 7f8d6c755640 1 -- start start 2026-02-17T21:29:46.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.249+0000 7f8d6c755640 10 monclient: init 2026-02-17T21:29:46.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.249+0000 7f8d6c755640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:46.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.250+0000 7f8d6c755640 10 monclient: _add_conns ranks=[0,3,1,5,2,4] 2026-02-17T21:29:46.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.250+0000 7f8d6c755640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8d6415f570 addr v1:10.20.193.5:6789/0 2026-02-17T21:29:46.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.250+0000 7f8d6c755640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f8d6415f950 0x7f8d640be810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:46.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.250+0000 7f8d6c755640 10 monclient(hunting): picked mon.noname-a con 0x7f8d6415f950 addr v2:10.20.193.5:3300/0 2026-02-17T21:29:46.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.250+0000 7f8d6c755640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f8d64155770 addr v1:10.20.193.119:6789/0 2026-02-17T21:29:46.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.250+0000 7f8d6c755640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d640bee70 con 0x7f8d6415f570 2026-02-17T21:29:46.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.250+0000 7f8d6c755640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d640bf150 con 0x7f8d64155770 2026-02-17T21:29:46.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.250+0000 7f8d6c755640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:46.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.250+0000 7f8d6c755640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f8d640bfd60 con 0x7f8d6415f950 2026-02-17T21:29:46.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.250+0000 7f8d6c755640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:46.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.250+0000 7f8d6c755640 10 monclient(hunting): authenticate will time out at 1291.815066s 2026-02-17T21:29:46.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.250+0000 7f8d69cc9640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f8d6415f950 0x7f8d640be810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:46.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.250+0000 7f8d6accb640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f8d64155770 0x7f8d64155c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:33570/0 (socket says 10.20.193.5:33570) 2026-02-17T21:29:46.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.250+0000 7f8d6accb640 1 -- 10.20.193.5:0/1129244923 learned_addr learned my addr 10.20.193.5:0/1129244923 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:29:46.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.250+0000 7f8d69cc9640 10 monclient(hunting): get_auth_request con 0x7f8d6415f950 auth_method 0 2026-02-17T21:29:46.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.250+0000 7f8d69cc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:46.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.250+0000 7f8d69cc9640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:46.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.250+0000 7f8d69cc9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:46.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.251+0000 7f8d69cc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:46.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.251+0000 7f8d69cc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:46.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.251+0000 7f8d69cc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:46.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.251+0000 7f8d694c8640 1 -- 10.20.193.5:0/1129244923 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 281566754 0 0) 0x7f8d640bf150 con 0x7f8d64155770 2026-02-17T21:29:46.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.251+0000 7f8d694c8640 10 monclient(hunting): _negotiate 2026-02-17T21:29:46.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.251+0000 7f8d694c8640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:46.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.251+0000 7f8d694c8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:46.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.251+0000 7f8d694c8640 10 monclient(hunting): my global_id is 5062 2026-02-17T21:29:46.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.251+0000 7f8d694c8640 1 -- 10.20.193.5:0/1129244923 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d50003620 con 0x7f8d64155770 2026-02-17T21:29:46.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.251+0000 7f8d69cc9640 10 monclient(hunting): handle_auth_done global_id 5010 payload 274 2026-02-17T21:29:46.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.252+0000 7f8d69cc9640 1 -- 10.20.193.5:0/1129244923 >> v1:10.20.193.119:6789/0 conn(0x7f8d64155770 legacy=0x7f8d64155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:46.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.252+0000 7f8d69cc9640 1 -- 10.20.193.5:0/1129244923 >> v1:10.20.193.5:6789/0 conn(0x7f8d6415f570 legacy=0x7f8d6415d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:29:46.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.252+0000 7f8d69cc9640 10 monclient: _finish_hunting 0 2026-02-17T21:29:46.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.252+0000 7f8d69cc9640 1 monclient: found mon.noname-a 2026-02-17T21:29:46.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.252+0000 7f8d69cc9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:46.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.252+0000 7f8d69cc9640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:29:46.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.252+0000 7f8d69cc9640 1 -- 10.20.193.5:0/1129244923 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d640bf430 con 0x7f8d6415f950 2026-02-17T21:29:46.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.252+0000 7f8d69cc9640 1 --2- 10.20.193.5:0/1129244923 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8d6415f950 0x7f8d640be810 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c0098a0 tx=0x7f8d4c02ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967f3bf79c7961f5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.255+0000 7f8d694c8640 1 -- 10.20.193.5:0/1129244923 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c03c070 con 0x7f8d6415f950 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.255+0000 7f8d694c8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.255+0000 7f8d694c8640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.255+0000 7f8d694c8640 10 monclient: dump: 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.255+0000 7f8d694c8640 10 monclient: _finish_auth 0 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.255+0000 7f8d694c8640 10 monclient: _check_auth_tickets 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.255+0000 7f8d694c8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.255+0000 7f8d694c8640 1 -- 10.20.193.5:0/1129244923 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d4c02fad0 con 0x7f8d6415f950 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.255+0000 7f8d694c8640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.255+0000 7f8d694c8640 1 -- 10.20.193.5:0/1129244923 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c037440 con 0x7f8d6415f950 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.255+0000 7f8d6c755640 5 monclient: authenticate success, global_id 5010 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.255+0000 7f8d6c755640 10 monclient: get_monmap_and_config success 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.255+0000 7f8d6c755640 4 set_mon_vals no callback set 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.255+0000 7f8d694c8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.255+0000 7f8d694c8640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.255+0000 7f8d694c8640 10 monclient: dump: 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:46.256 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:46.257 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:46.257 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:46.257 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:46.257 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:46.257 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:46.257 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:46.257 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:46.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.255+0000 7f8d6c755640 10 monclient: shutdown 2026-02-17T21:29:46.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.255+0000 7f8d6c755640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:46.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.255+0000 7f8d6c755640 1 -- 10.20.193.5:0/1129244923 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8d6415f950 msgr2=0x7f8d640be810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:46.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.255+0000 7f8d6c755640 1 --2- 10.20.193.5:0/1129244923 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8d6415f950 0x7f8d640be810 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c0098a0 tx=0x7f8d4c02ee10 comp rx=0 tx=0).stop 2026-02-17T21:29:46.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.255+0000 7f8d6c755640 1 -- 10.20.193.5:0/1129244923 shutdown_connections 2026-02-17T21:29:46.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.255+0000 7f8d6c755640 1 --2- 10.20.193.5:0/1129244923 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8d6415f950 0x7f8d640be810 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:46.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.255+0000 7f8d6c755640 1 -- 10.20.193.5:0/1129244923 >> 10.20.193.5:0/1129244923 conn(0x7f8d640c9f40 msgr2=0x7f8d640ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:46.257 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.255+0000 7f8d6c755640 1 -- 10.20.193.5:0/1129244923 shutdown_connections 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.255+0000 7f8d6c755640 1 -- 10.20.193.5:0/1129244923 wait complete. 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6c755640 10 monclient: build_initial_monmap 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6c755640 10 monclient: monmap: 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6c755640 1 librados: starting msgr at 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6c755640 1 librados: starting objecter 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6c755640 1 Processor -- start 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6c755640 1 -- start start 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6c755640 1 librados: setting wanted keys 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6c755640 1 librados: calling monclient init 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6c755640 10 monclient: init 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6c755640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6c755640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6c755640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8d64155770 0x7f8d641f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6c755640 10 monclient(hunting): picked mon.noname-a con 0x7f8d64155770 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6c755640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8d6415f570 0x7f8d64073d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6c755640 10 monclient(hunting): picked mon.noname-c con 0x7f8d6415f570 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6c755640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8d6415f950 0x7f8d641f4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6c755640 10 monclient(hunting): picked mon.noname-b con 0x7f8d6415f950 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6c755640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6c755640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6415d910 con 0x7f8d64155770 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6c755640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6c755640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8d640bf9f0 con 0x7f8d6415f950 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6c755640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6c755640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8d640c01f0 con 0x7f8d6415f570 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6c755640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:46.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6c755640 10 monclient(hunting): authenticate will time out at 1291.821708s 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.256+0000 7f8d6a4ca640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8d64155770 0x7f8d641f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.257+0000 7f8d69cc9640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8d6415f570 0x7f8d64073d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.257+0000 7f8d6accb640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8d6415f950 0x7f8d641f4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.257+0000 7f8d6a4ca640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8d64155770 0x7f8d641f30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:46544/0 (socket says 10.20.193.5:46544) 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.257+0000 7f8d6a4ca640 1 -- 10.20.193.5:0/2940570498 learned_addr learned my addr 10.20.193.5:0/2940570498 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.257+0000 7f8d6a4ca640 10 monclient(hunting): get_auth_request con 0x7f8d64155770 auth_method 0 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.257+0000 7f8d6a4ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.257+0000 7f8d6a4ca640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.257+0000 7f8d6a4ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.257+0000 7f8d69cc9640 10 monclient(hunting): get_auth_request con 0x7f8d6415f570 auth_method 0 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.257+0000 7f8d69cc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.257+0000 7f8d69cc9640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.257+0000 7f8d69cc9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.257+0000 7f8d6accb640 10 monclient(hunting): get_auth_request con 0x7f8d6415f950 auth_method 0 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.257+0000 7f8d6accb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.257+0000 7f8d6accb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.257+0000 7f8d6accb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.257+0000 7f8d6a4ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.257+0000 7f8d6a4ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.257+0000 7f8d6a4ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.257+0000 7f8d6accb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.257+0000 7f8d6accb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.257+0000 7f8d6accb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.257+0000 7f8d69cc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.257+0000 7f8d69cc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:46.259 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.257+0000 7f8d69cc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:46.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.258+0000 7f8d6a4ca640 10 monclient(hunting): handle_auth_done global_id 5013 payload 824 2026-02-17T21:29:46.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.258+0000 7f8d6a4ca640 1 -- 10.20.193.5:0/2940570498 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8d6415f570 msgr2=0x7f8d64073d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:46.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.258+0000 7f8d6a4ca640 1 --2- 10.20.193.5:0/2940570498 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8d6415f570 0x7f8d64073d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:46.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.258+0000 7f8d6a4ca640 1 -- 10.20.193.5:0/2940570498 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8d6415f950 msgr2=0x7f8d641f4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:46.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.258+0000 7f8d6a4ca640 1 --2- 10.20.193.5:0/2940570498 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8d6415f950 0x7f8d641f4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:46.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.258+0000 7f8d6a4ca640 10 monclient: _finish_hunting 0 2026-02-17T21:29:46.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.258+0000 7f8d6a4ca640 1 monclient: found mon.noname-a 2026-02-17T21:29:46.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.258+0000 7f8d6a4ca640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:46.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.258+0000 7f8d6a4ca640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:29:46.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.258+0000 7f8d6a4ca640 1 -- 10.20.193.5:0/2940570498 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d641f37c0 con 0x7f8d64155770 2026-02-17T21:29:46.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.259+0000 7f8d6a4ca640 1 --2- 10.20.193.5:0/2940570498 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8d64155770 0x7f8d641f30a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400b570 tx=0x7f8d5400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:46.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.259+0000 7f8d5affd640 10 client.?.objecter ms_handle_connect 0x7f8d64155770 2026-02-17T21:29:46.260 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.259+0000 7f8d5affd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:29:46.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.260+0000 7f8d5affd640 1 -- 10.20.193.5:0/2940570498 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54013020 con 0x7f8d64155770 2026-02-17T21:29:46.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.260+0000 7f8d5affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:46.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.260+0000 7f8d5affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:29:46.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.260+0000 7f8d5affd640 10 monclient: dump: 2026-02-17T21:29:46.261 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:46.261 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:46.261 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:46.261 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:46.261 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:46.261 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:46.261 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:46.261 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:46.261 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:46.261 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:46.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.260+0000 7f8d5affd640 10 monclient: _finish_auth 0 2026-02-17T21:29:46.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.260+0000 7f8d5affd640 10 monclient: _check_auth_tickets 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.260+0000 7f8d5affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.260+0000 7f8d6c755640 5 monclient: authenticate success, global_id 5013 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.260+0000 7f8d6c755640 10 monclient: _renew_subs 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.260+0000 7f8d6c755640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.260+0000 7f8d6c755640 1 -- 10.20.193.5:0/2940570498 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d641f3aa0 con 0x7f8d64155770 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.260+0000 7f8d6c755640 10 client.5013.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.260+0000 7f8d6c755640 10 monclient: _renew_subs 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.260+0000 7f8d6c755640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.260+0000 7f8d6c755640 1 -- 10.20.193.5:0/2940570498 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d641f46c0 con 0x7f8d64155770 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.260+0000 7f8d6c755640 1 librados: init done 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.260+0000 7f8d6c755640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.260+0000 7f8d6c755640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.260+0000 7f8d6c755640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.260+0000 7f8d6c755640 1 -- 10.20.193.5:0/2940570498 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d640be810 con 0x7f8d64155770 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.261+0000 7f8d5affd640 1 -- 10.20.193.5:0/2940570498 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d54004480 con 0x7f8d64155770 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.261+0000 7f8d5affd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.261+0000 7f8d5affd640 1 -- 10.20.193.5:0/2940570498 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54009380 con 0x7f8d64155770 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.261+0000 7f8d5affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.261+0000 7f8d5affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.261+0000 7f8d5affd640 10 monclient: dump: 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:46.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.261+0000 7f8d68cc7640 4 set_mon_vals no callback set 2026-02-17T21:29:46.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.366+0000 7f8d5affd640 1 -- 10.20.193.5:0/2940570498 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f8d5400f460 con 0x7f8d64155770 2026-02-17T21:29:46.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.367+0000 7f8d5affd640 1 --2- 10.20.193.5:0/2940570498 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8d34079280 0x7f8d3407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:46.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.367+0000 7f8d69cc9640 1 --2- 10.20.193.5:0/2940570498 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8d34079280 0x7f8d3407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:46.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.367+0000 7f8d69cc9640 10 monclient: get_auth_request con 0x7f8d34079280 auth_method 0 2026-02-17T21:29:46.369 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.368+0000 7f8d69cc9640 1 --2- 10.20.193.5:0/2940570498 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8d34079280 0x7f8d3407b740 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c039000 tx=0x7f8d4c033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:46.369 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.368+0000 7f8d5affd640 10 client.5013.objecter ms_handle_connect 0x7f8d34079280 2026-02-17T21:29:46.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.374+0000 7f8d5affd640 1 -- 10.20.193.5:0/2940570498 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f8d5405e360 con 0x7f8d64155770 2026-02-17T21:29:46.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.374+0000 7f8d5affd640 10 client.5013.objecter ms_dispatch2 0x7f8d64000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:29:46.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.374+0000 7f8d5affd640 3 client.5013.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:29:46.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.374+0000 7f8d5affd640 3 client.5013.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:29:46.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.375+0000 7f8d5affd640 20 client.5013.objecter dump_active .. 0 homeless 2026-02-17T21:29:46.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.375+0000 7f8d5affd640 1 -- 10.20.193.5:0/2940570498 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8d5401d020 con 0x7f8d64155770 2026-02-17T21:29:46.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.375+0000 7f8d5affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:46.376 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.375+0000 7f8d5affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:29:46.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.473+0000 7f8d6c755640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:29:46.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.473+0000 7f8d6c755640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:46.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.473+0000 7f8d6c755640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:46.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.473+0000 7f8d6c755640 1 -- 10.20.193.5:0/2940570498 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8d64154e90 con 0x7f8d64155770 2026-02-17T21:29:46.477 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.477+0000 7f8d5affd640 1 -- 10.20.193.5:0/2940570498 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f8d54062320 con 0x7f8d64155770 2026-02-17T21:29:46.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.477+0000 7f8d5affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:46.478 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.477+0000 7f8d5affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:29:46.478 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:29:46.478 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:29:46.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.478+0000 7f8d6c755640 10 librados: watch_flush enter 2026-02-17T21:29:46.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.478+0000 7f8d6c755640 10 librados: watch_flush exit 2026-02-17T21:29:46.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.478+0000 7f8d6c755640 20 client.5013.objecter shutdown clearing up homeless session... 2026-02-17T21:29:46.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.478+0000 7f8d6c755640 10 client.5013.objecter successfully canceled tick 2026-02-17T21:29:46.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.478+0000 7f8d6c755640 1 -- 10.20.193.5:0/2940570498 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8d34079280 msgr2=0x7f8d3407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:46.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.478+0000 7f8d6c755640 1 --2- 10.20.193.5:0/2940570498 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8d34079280 0x7f8d3407b740 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c039000 tx=0x7f8d4c033000 comp rx=0 tx=0).stop 2026-02-17T21:29:46.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.478+0000 7f8d6c755640 10 monclient: shutdown 2026-02-17T21:29:46.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.478+0000 7f8d6c755640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:46.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.478+0000 7f8d6c755640 1 -- 10.20.193.5:0/2940570498 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8d64155770 msgr2=0x7f8d641f30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:46.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.478+0000 7f8d6c755640 1 --2- 10.20.193.5:0/2940570498 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8d64155770 0x7f8d641f30a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400b570 tx=0x7f8d5400ba40 comp rx=0 tx=0).stop 2026-02-17T21:29:46.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.478+0000 7f8d6c755640 1 -- 10.20.193.5:0/2940570498 shutdown_connections 2026-02-17T21:29:46.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.478+0000 7f8d6c755640 1 --2- 10.20.193.5:0/2940570498 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8d34079280 0x7f8d3407b740 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:46.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.478+0000 7f8d6c755640 1 --2- 10.20.193.5:0/2940570498 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8d6415f950 0x7f8d641f4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:46.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.478+0000 7f8d6c755640 1 --2- 10.20.193.5:0/2940570498 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8d6415f570 0x7f8d64073d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:46.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.478+0000 7f8d6c755640 1 --2- 10.20.193.5:0/2940570498 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8d64155770 0x7f8d641f30a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:46.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.478+0000 7f8d6c755640 1 -- 10.20.193.5:0/2940570498 >> 10.20.193.5:0/2940570498 conn(0x7f8d640c9f40 msgr2=0x7f8d64155c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:46.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.478+0000 7f8d6c755640 1 -- 10.20.193.5:0/2940570498 shutdown_connections 2026-02-17T21:29:46.479 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.478+0000 7f8d6c755640 1 -- 10.20.193.5:0/2940570498 wait complete. 2026-02-17T21:29:46.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:46.478+0000 7f8d6c755640 1 librados: shutdown 2026-02-17T21:29:49.488 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:29:49.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.555+0000 7fb444fff640 10 monclient: get_monmap_and_config 2026-02-17T21:29:49.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.555+0000 7fb444fff640 10 monclient: build_initial_monmap 2026-02-17T21:29:49.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.555+0000 7fb444fff640 10 monclient: monmap: 2026-02-17T21:29:49.557 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:49.557 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:49.557 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:29:49.555920+0000 2026-02-17T21:29:49.557 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:29:49.555920+0000 2026-02-17T21:29:49.558 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:49.558 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:49.558 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:29:49.558 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:29:49.558 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:29:49.558 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:29:49.558 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:29:49.558 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:29:49.558 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:49.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.555+0000 7fb444fff640 1 Processor -- start 2026-02-17T21:29:49.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.555+0000 7fb444fff640 1 -- start start 2026-02-17T21:29:49.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.555+0000 7fb444fff640 10 monclient: init 2026-02-17T21:29:49.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.556+0000 7fb444fff640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:49.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.556+0000 7fb444fff640 10 monclient: _add_conns ranks=[3,0,2,1,4,5] 2026-02-17T21:29:49.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.556+0000 7fb444fff640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fb44015d370 0x7fb44015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:49.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.556+0000 7fb444fff640 10 monclient(hunting): picked mon.noname-a con 0x7fb44015d370 addr v2:10.20.193.5:3300/0 2026-02-17T21:29:49.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.556+0000 7fb444fff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb4400c7e20 addr v1:10.20.193.5:6789/0 2026-02-17T21:29:49.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.556+0000 7fb444fff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb4400c74c0 addr v1:10.20.193.135:6789/0 2026-02-17T21:29:49.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.556+0000 7fb444fff640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4400c8350 con 0x7fb4400c7e20 2026-02-17T21:29:49.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.556+0000 7fb444fff640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4400c8630 con 0x7fb4400c74c0 2026-02-17T21:29:49.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.556+0000 7fb444fff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:49.561 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.556+0000 7fb444fff640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb44015b710 con 0x7fb44015d370 2026-02-17T21:29:49.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.556+0000 7fb444fff640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:49.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.556+0000 7fb444fff640 10 monclient(hunting): authenticate will time out at 1295.121257s 2026-02-17T21:29:49.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.556+0000 7fb43ed76640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7fb4400c74c0 0x7fb4400c52b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:37668/0 (socket says 10.20.193.5:37668) 2026-02-17T21:29:49.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.556+0000 7fb43ed76640 1 -- 10.20.193.5:0/345720540 learned_addr learned my addr 10.20.193.5:0/345720540 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:29:49.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.556+0000 7fb43e575640 1 --2- 10.20.193.5:0/345720540 >> v2:10.20.193.5:3300/0 conn(0x7fb44015d370 0x7fb44015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:49.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.557+0000 7fb43e575640 10 monclient(hunting): get_auth_request con 0x7fb44015d370 auth_method 0 2026-02-17T21:29:49.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.557+0000 7fb43e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:49.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.557+0000 7fb43e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:49.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.557+0000 7fb43e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:49.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.557+0000 7fb43e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:49.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.557+0000 7fb43e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:49.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.557+0000 7fb43e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:49.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.558+0000 7fb43e575640 10 monclient(hunting): handle_auth_done global_id 5016 payload 274 2026-02-17T21:29:49.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.558+0000 7fb43e575640 1 -- 10.20.193.5:0/345720540 >> v1:10.20.193.135:6789/0 conn(0x7fb4400c74c0 legacy=0x7fb4400c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:49.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.558+0000 7fb43e575640 1 -- 10.20.193.5:0/345720540 >> v1:10.20.193.5:6789/0 conn(0x7fb4400c7e20 legacy=0x7fb44015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:29:49.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.558+0000 7fb43e575640 10 monclient: _finish_hunting 0 2026-02-17T21:29:49.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.558+0000 7fb43e575640 1 monclient: found mon.noname-a 2026-02-17T21:29:49.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.558+0000 7fb43e575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:49.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.558+0000 7fb43e575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:29:49.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.558+0000 7fb43e575640 1 -- 10.20.193.5:0/345720540 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4400c8910 con 0x7fb44015d370 2026-02-17T21:29:49.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.559+0000 7fb43e575640 1 --2- 10.20.193.5:0/345720540 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb44015d370 0x7fb44015d750 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb4340098a0 tx=0x7fb43402ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25d979b53a4d78a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:49.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.568+0000 7fb43d573640 1 -- 10.20.193.5:0/345720540 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43403c070 con 0x7fb44015d370 2026-02-17T21:29:49.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.568+0000 7fb43d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:49.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.568+0000 7fb43d573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:29:49.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.568+0000 7fb43d573640 10 monclient: dump: 2026-02-17T21:29:49.575 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:49.575 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:49.575 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:49.575 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:49.575 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:49.575 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:49.575 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:49.575 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:49.576 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:49.576 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:49.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.568+0000 7fb43d573640 10 monclient: _finish_auth 0 2026-02-17T21:29:49.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.568+0000 7fb43d573640 10 monclient: _check_auth_tickets 2026-02-17T21:29:49.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.568+0000 7fb43d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:49.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.568+0000 7fb444fff640 5 monclient: authenticate success, global_id 5016 2026-02-17T21:29:49.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.568+0000 7fb43d573640 1 -- 10.20.193.5:0/345720540 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb43402fad0 con 0x7fb44015d370 2026-02-17T21:29:49.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.568+0000 7fb444fff640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:29:49.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.568+0000 7fb43d573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:49.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.568+0000 7fb43d573640 1 -- 10.20.193.5:0/345720540 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb434037440 con 0x7fb44015d370 2026-02-17T21:29:49.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.568+0000 7fb444fff640 10 monclient: get_monmap_and_config success 2026-02-17T21:29:49.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.568+0000 7fb444fff640 4 set_mon_vals no callback set 2026-02-17T21:29:49.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.568+0000 7fb43d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:49.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.568+0000 7fb43d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:29:49.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.568+0000 7fb43d573640 10 monclient: dump: 2026-02-17T21:29:49.577 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:49.577 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:49.577 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:49.577 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:49.577 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:49.577 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:49.577 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:49.577 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:49.578 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:49.578 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:49.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.568+0000 7fb444fff640 10 monclient: shutdown 2026-02-17T21:29:49.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.568+0000 7fb444fff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:49.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.568+0000 7fb444fff640 1 -- 10.20.193.5:0/345720540 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb44015d370 msgr2=0x7fb44015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:49.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.568+0000 7fb444fff640 1 --2- 10.20.193.5:0/345720540 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb44015d370 0x7fb44015d750 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb4340098a0 tx=0x7fb43402ee10 comp rx=0 tx=0).stop 2026-02-17T21:29:49.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.569+0000 7fb444fff640 1 -- 10.20.193.5:0/345720540 shutdown_connections 2026-02-17T21:29:49.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.569+0000 7fb444fff640 1 --2- 10.20.193.5:0/345720540 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb44015d370 0x7fb44015d750 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:49.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.569+0000 7fb444fff640 1 -- 10.20.193.5:0/345720540 >> 10.20.193.5:0/345720540 conn(0x7fb4400c9f20 msgr2=0x7fb4400ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:49.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.569+0000 7fb444fff640 1 -- 10.20.193.5:0/345720540 shutdown_connections 2026-02-17T21:29:49.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.569+0000 7fb444fff640 1 -- 10.20.193.5:0/345720540 wait complete. 2026-02-17T21:29:49.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.569+0000 7fb444fff640 10 monclient: build_initial_monmap 2026-02-17T21:29:49.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.569+0000 7fb444fff640 10 monclient: monmap: 2026-02-17T21:29:49.579 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:49.579 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:29:49.579 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:29:49.579 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:29:49.579 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:49.579 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:49.579 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:29:49.579 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:29:49.579 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:29:49.579 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:49.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.569+0000 7fb444fff640 1 librados: starting msgr at 2026-02-17T21:29:49.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.569+0000 7fb444fff640 1 librados: starting objecter 2026-02-17T21:29:49.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.569+0000 7fb444fff640 1 Processor -- start 2026-02-17T21:29:49.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.569+0000 7fb444fff640 1 -- start start 2026-02-17T21:29:49.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.569+0000 7fb444fff640 1 librados: setting wanted keys 2026-02-17T21:29:49.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.569+0000 7fb444fff640 1 librados: calling monclient init 2026-02-17T21:29:49.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.569+0000 7fb444fff640 10 monclient: init 2026-02-17T21:29:49.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb444fff640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:49.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb444fff640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:29:49.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb444fff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb4400c74c0 0x7fb44014d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:49.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb444fff640 10 monclient(hunting): picked mon.noname-c con 0x7fb4400c74c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:29:49.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb444fff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb4400c7e20 0x7fb4401f4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:49.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb444fff640 10 monclient(hunting): picked mon.noname-b con 0x7fb4400c7e20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:29:49.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb444fff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb44015d370 0x7fb4401f3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:49.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb444fff640 10 monclient(hunting): picked mon.noname-a con 0x7fb44015d370 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:29:49.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb444fff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:49.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb444fff640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb4400c8ed0 con 0x7fb44015d370 2026-02-17T21:29:49.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb444fff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:49.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb444fff640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb4400c9240 con 0x7fb4400c7e20 2026-02-17T21:29:49.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb444fff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:49.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb444fff640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb4400c96d0 con 0x7fb4400c74c0 2026-02-17T21:29:49.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb444fff640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:49.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb444fff640 10 monclient(hunting): authenticate will time out at 1295.135400s 2026-02-17T21:29:49.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb43ed76640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb44015d370 0x7fb4401f3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:49.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb43e575640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb4400c74c0 0x7fb44014d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:49.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb43ed76640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb44015d370 0x7fb4401f3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:37228/0 (socket says 10.20.193.5:37228) 2026-02-17T21:29:49.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb43ed76640 1 -- 10.20.193.5:0/3087365005 learned_addr learned my addr 10.20.193.5:0/3087365005 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:29:49.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb43ed76640 10 monclient(hunting): get_auth_request con 0x7fb44015d370 auth_method 0 2026-02-17T21:29:49.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb43ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:49.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb43ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:49.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb43ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:49.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb43dd74640 1 --2- 10.20.193.5:0/3087365005 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb4400c7e20 0x7fb4401f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:49.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb43e575640 10 monclient(hunting): get_auth_request con 0x7fb4400c74c0 auth_method 0 2026-02-17T21:29:49.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb43e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:49.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb43e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:49.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.570+0000 7fb43e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:49.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.571+0000 7fb43ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:49.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.571+0000 7fb43ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:49.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.571+0000 7fb43ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:49.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.571+0000 7fb43dd74640 10 monclient(hunting): get_auth_request con 0x7fb4400c7e20 auth_method 0 2026-02-17T21:29:49.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.571+0000 7fb43dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:49.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.571+0000 7fb43dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:49.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.571+0000 7fb43dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:49.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.571+0000 7fb43e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:49.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.571+0000 7fb43e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:49.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.571+0000 7fb43e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:49.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.571+0000 7fb43dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:49.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.571+0000 7fb43dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:49.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.571+0000 7fb43dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:49.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.572+0000 7fb43ed76640 10 monclient(hunting): handle_auth_done global_id 5019 payload 824 2026-02-17T21:29:49.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.572+0000 7fb43ed76640 1 -- 10.20.193.5:0/3087365005 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb4400c74c0 msgr2=0x7fb44014d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:49.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.572+0000 7fb43ed76640 1 --2- 10.20.193.5:0/3087365005 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb4400c74c0 0x7fb44014d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:49.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.572+0000 7fb43ed76640 1 -- 10.20.193.5:0/3087365005 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb4400c7e20 msgr2=0x7fb4401f4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:49.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.572+0000 7fb43ed76640 1 --2- 10.20.193.5:0/3087365005 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb4400c7e20 0x7fb4401f4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:49.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.572+0000 7fb43ed76640 10 monclient: _finish_hunting 0 2026-02-17T21:29:49.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.572+0000 7fb43ed76640 1 monclient: found mon.noname-a 2026-02-17T21:29:49.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.572+0000 7fb43ed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:49.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.572+0000 7fb43ed76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:29:49.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.572+0000 7fb43ed76640 1 -- 10.20.193.5:0/3087365005 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb44014bc00 con 0x7fb44015d370 2026-02-17T21:29:49.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.573+0000 7fb43ed76640 1 --2- 10.20.193.5:0/3087365005 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb44015d370 0x7fb4401f3880 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb43000cb50 tx=0x7fb43000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:49.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.573+0000 7fb426ffd640 10 client.?.objecter ms_handle_connect 0x7fb44015d370 2026-02-17T21:29:49.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.573+0000 7fb426ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:29:49.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.574+0000 7fb426ffd640 1 -- 10.20.193.5:0/3087365005 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb430017070 con 0x7fb44015d370 2026-02-17T21:29:49.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.574+0000 7fb426ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:49.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.574+0000 7fb426ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:29:49.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.574+0000 7fb426ffd640 10 monclient: dump: 2026-02-17T21:29:49.587 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:49.587 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:49.587 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:49.587 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:49.587 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:49.587 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:49.587 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:49.587 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:49.587 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:49.587 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:49.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.574+0000 7fb426ffd640 10 monclient: _finish_auth 0 2026-02-17T21:29:49.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.574+0000 7fb426ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:29:49.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.574+0000 7fb426ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:49.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.574+0000 7fb426ffd640 1 -- 10.20.193.5:0/3087365005 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb43000ad50 con 0x7fb44015d370 2026-02-17T21:29:49.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.574+0000 7fb426ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:49.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.574+0000 7fb426ffd640 1 -- 10.20.193.5:0/3087365005 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb430012600 con 0x7fb44015d370 2026-02-17T21:29:49.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.574+0000 7fb444fff640 5 monclient: authenticate success, global_id 5019 2026-02-17T21:29:49.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.574+0000 7fb426ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:49.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.574+0000 7fb43cd72640 4 set_mon_vals no callback set 2026-02-17T21:29:49.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.574+0000 7fb426ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:29:49.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.574+0000 7fb426ffd640 10 monclient: dump: 2026-02-17T21:29:49.589 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:49.589 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:49.589 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:49.589 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:49.589 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:49.589 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:49.589 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:49.589 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:49.589 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:49.589 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:49.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.574+0000 7fb444fff640 10 monclient: _renew_subs 2026-02-17T21:29:49.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.574+0000 7fb444fff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:49.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.574+0000 7fb444fff640 1 -- 10.20.193.5:0/3087365005 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb44014bee0 con 0x7fb44015d370 2026-02-17T21:29:49.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.574+0000 7fb444fff640 10 client.5019.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:29:49.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.574+0000 7fb444fff640 10 monclient: _renew_subs 2026-02-17T21:29:49.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.574+0000 7fb444fff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:49.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.574+0000 7fb444fff640 1 -- 10.20.193.5:0/3087365005 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb44014c4a0 con 0x7fb44015d370 2026-02-17T21:29:49.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.574+0000 7fb444fff640 1 librados: init done 2026-02-17T21:29:49.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.575+0000 7fb444fff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:49.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.575+0000 7fb444fff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:49.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.575+0000 7fb444fff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:49.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.575+0000 7fb444fff640 1 -- 10.20.193.5:0/3087365005 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb44015d750 con 0x7fb44015d370 2026-02-17T21:29:49.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.586+0000 7fb426ffd640 1 -- 10.20.193.5:0/3087365005 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fb43001b3b0 con 0x7fb44015d370 2026-02-17T21:29:49.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.587+0000 7fb426ffd640 1 --2- 10.20.193.5:0/3087365005 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb40c079300 0x7fb40c07b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:49.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.587+0000 7fb43e575640 1 --2- 10.20.193.5:0/3087365005 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb40c079300 0x7fb40c07b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:49.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.587+0000 7fb43e575640 10 monclient: get_auth_request con 0x7fb40c079300 auth_method 0 2026-02-17T21:29:49.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.588+0000 7fb43e575640 1 --2- 10.20.193.5:0/3087365005 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb40c079300 0x7fb40c07b7c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb434039000 tx=0x7fb434033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:49.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.588+0000 7fb426ffd640 10 client.5019.objecter ms_handle_connect 0x7fb40c079300 2026-02-17T21:29:49.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.588+0000 7fb426ffd640 1 -- 10.20.193.5:0/3087365005 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fb43005df00 con 0x7fb44015d370 2026-02-17T21:29:49.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.588+0000 7fb426ffd640 10 client.5019.objecter ms_dispatch2 0x7fb440000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:29:49.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.588+0000 7fb426ffd640 3 client.5019.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:29:49.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.588+0000 7fb426ffd640 3 client.5019.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:29:49.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.589+0000 7fb426ffd640 20 client.5019.objecter dump_active .. 0 homeless 2026-02-17T21:29:49.691 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.690+0000 7fb426ffd640 1 -- 10.20.193.5:0/3087365005 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb430022080 con 0x7fb44015d370 2026-02-17T21:29:49.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.690+0000 7fb426ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:49.692 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.690+0000 7fb426ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:29:49.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.789+0000 7fb444fff640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:29:49.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.789+0000 7fb444fff640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:49.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.789+0000 7fb444fff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:49.791 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.789+0000 7fb444fff640 1 -- 10.20.193.5:0/3087365005 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb440070e40 con 0x7fb44015d370 2026-02-17T21:29:49.793 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.791+0000 7fb426ffd640 1 -- 10.20.193.5:0/3087365005 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fb430061ec0 con 0x7fb44015d370 2026-02-17T21:29:49.793 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.792+0000 7fb426ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:49.793 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.792+0000 7fb426ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:29:49.794 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:29:49.794 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:29:49.795 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.792+0000 7fb444fff640 10 librados: watch_flush enter 2026-02-17T21:29:49.795 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.792+0000 7fb444fff640 10 librados: watch_flush exit 2026-02-17T21:29:49.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.792+0000 7fb444fff640 20 client.5019.objecter shutdown clearing up homeless session... 2026-02-17T21:29:49.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.792+0000 7fb444fff640 10 client.5019.objecter successfully canceled tick 2026-02-17T21:29:49.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.792+0000 7fb444fff640 1 -- 10.20.193.5:0/3087365005 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb40c079300 msgr2=0x7fb40c07b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:49.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.792+0000 7fb444fff640 1 --2- 10.20.193.5:0/3087365005 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb40c079300 0x7fb40c07b7c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb434039000 tx=0x7fb434033000 comp rx=0 tx=0).stop 2026-02-17T21:29:49.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.792+0000 7fb444fff640 10 monclient: shutdown 2026-02-17T21:29:49.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.792+0000 7fb444fff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:49.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.792+0000 7fb444fff640 1 -- 10.20.193.5:0/3087365005 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb44015d370 msgr2=0x7fb4401f3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:49.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.792+0000 7fb444fff640 1 --2- 10.20.193.5:0/3087365005 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb44015d370 0x7fb4401f3880 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb43000cb50 tx=0x7fb43000a430 comp rx=0 tx=0).stop 2026-02-17T21:29:49.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.793+0000 7fb444fff640 1 -- 10.20.193.5:0/3087365005 shutdown_connections 2026-02-17T21:29:49.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.793+0000 7fb444fff640 1 --2- 10.20.193.5:0/3087365005 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb40c079300 0x7fb40c07b7c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:49.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.793+0000 7fb444fff640 1 --2- 10.20.193.5:0/3087365005 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb44015d370 0x7fb4401f3880 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:49.797 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.793+0000 7fb444fff640 1 --2- 10.20.193.5:0/3087365005 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb4400c7e20 0x7fb4401f4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:49.797 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.793+0000 7fb444fff640 1 --2- 10.20.193.5:0/3087365005 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb4400c74c0 0x7fb44014d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:49.797 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.793+0000 7fb444fff640 1 -- 10.20.193.5:0/3087365005 >> 10.20.193.5:0/3087365005 conn(0x7fb4400c9f20 msgr2=0x7fb4400ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:49.797 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.793+0000 7fb444fff640 1 -- 10.20.193.5:0/3087365005 shutdown_connections 2026-02-17T21:29:49.797 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.793+0000 7fb444fff640 1 -- 10.20.193.5:0/3087365005 wait complete. 2026-02-17T21:29:49.797 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:49.793+0000 7fb444fff640 1 librados: shutdown 2026-02-17T21:29:52.804 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:29:52.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.871+0000 7f09ac81b640 10 monclient: get_monmap_and_config 2026-02-17T21:29:52.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.871+0000 7f09ac81b640 10 monclient: build_initial_monmap 2026-02-17T21:29:52.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.871+0000 7f09ac81b640 10 monclient: monmap: 2026-02-17T21:29:52.874 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:52.874 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:52.874 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:29:52.872761+0000 2026-02-17T21:29:52.874 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:29:52.872761+0000 2026-02-17T21:29:52.874 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:52.874 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:52.874 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:29:52.874 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:29:52.874 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:29:52.874 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:29:52.874 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:29:52.875 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:29:52.875 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:52.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.871+0000 7f09ac81b640 1 Processor -- start 2026-02-17T21:29:52.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.871+0000 7f09ac81b640 1 -- start start 2026-02-17T21:29:52.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.871+0000 7f09ac81b640 10 monclient: init 2026-02-17T21:29:52.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.872+0000 7f09ac81b640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:52.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.872+0000 7f09ac81b640 10 monclient: _add_conns ranks=[4,0,2,1,5,3] 2026-02-17T21:29:52.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.872+0000 7f09ac81b640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f09a40c7170 0x7f09a40c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:52.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.872+0000 7f09ac81b640 10 monclient(hunting): picked mon.noname-b con 0x7f09a40c7170 addr v2:10.20.193.119:3300/0 2026-02-17T21:29:52.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.872+0000 7f09ac81b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f09a40c48c0 addr v1:10.20.193.5:6789/0 2026-02-17T21:29:52.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.872+0000 7f09ac81b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f09a40c4d10 addr v1:10.20.193.135:6789/0 2026-02-17T21:29:52.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.872+0000 7f09ac81b640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09a415a9a0 con 0x7f09a40c48c0 2026-02-17T21:29:52.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.872+0000 7f09ac81b640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09a40c5270 con 0x7f09a40c4d10 2026-02-17T21:29:52.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.872+0000 7f09ac81b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:52.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.872+0000 7f09ac81b640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f09a40c8530 con 0x7f09a40c7170 2026-02-17T21:29:52.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.872+0000 7f09ac81b640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:52.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.872+0000 7f09ac81b640 10 monclient(hunting): authenticate will time out at 1298.438176s 2026-02-17T21:29:52.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.872+0000 7f09aad91640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f09a40c4d10 0x7f09a40c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:37684/0 (socket says 10.20.193.5:37684) 2026-02-17T21:29:52.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.872+0000 7f09aad91640 1 -- 10.20.193.5:0/2001197303 learned_addr learned my addr 10.20.193.5:0/2001197303 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:29:52.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.872+0000 7f09aa590640 1 --2- 10.20.193.5:0/2001197303 >> v2:10.20.193.119:3300/0 conn(0x7f09a40c7170 0x7f09a40c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:52.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.872+0000 7f09aa590640 10 monclient(hunting): get_auth_request con 0x7f09a40c7170 auth_method 0 2026-02-17T21:29:52.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.872+0000 7f09aa590640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:52.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.872+0000 7f09aa590640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:52.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.872+0000 7f09aa590640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:52.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.873+0000 7f09aa590640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:52.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.873+0000 7f09aa590640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:52.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.873+0000 7f09aa590640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:52.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.873+0000 7f09a958e640 1 -- 10.20.193.5:0/2001197303 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1537456886 0 0) 0x7f09a415a9a0 con 0x7f09a40c48c0 2026-02-17T21:29:52.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.873+0000 7f09a958e640 10 monclient(hunting): _negotiate 2026-02-17T21:29:52.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.873+0000 7f09a958e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:52.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.873+0000 7f09a958e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:52.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.873+0000 7f09a958e640 10 monclient(hunting): my global_id is 5022 2026-02-17T21:29:52.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.873+0000 7f09a958e640 1 -- 10.20.193.5:0/2001197303 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0994003620 con 0x7f09a40c48c0 2026-02-17T21:29:52.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.873+0000 7f09a958e640 1 -- 10.20.193.5:0/2001197303 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2078389337 0 0) 0x7f09a40c5270 con 0x7f09a40c4d10 2026-02-17T21:29:52.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.873+0000 7f09a958e640 10 monclient(hunting): _negotiate 2026-02-17T21:29:52.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.873+0000 7f09a958e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:52.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.873+0000 7f09a958e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:52.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.873+0000 7f09a958e640 10 monclient(hunting): my global_id is 5054 2026-02-17T21:29:52.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.873+0000 7f09a958e640 1 -- 10.20.193.5:0/2001197303 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09a415a9a0 con 0x7f09a40c4d10 2026-02-17T21:29:52.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.874+0000 7f09aa590640 10 monclient(hunting): handle_auth_done global_id 5071 payload 274 2026-02-17T21:29:52.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.874+0000 7f09aa590640 1 -- 10.20.193.5:0/2001197303 >> v1:10.20.193.135:6789/0 conn(0x7f09a40c4d10 legacy=0x7f09a40c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:52.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.874+0000 7f09aa590640 1 -- 10.20.193.5:0/2001197303 >> v1:10.20.193.5:6789/0 conn(0x7f09a40c48c0 legacy=0x7f09a40749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:52.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.874+0000 7f09aa590640 10 monclient: _finish_hunting 0 2026-02-17T21:29:52.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.874+0000 7f09aa590640 1 monclient: found mon.noname-b 2026-02-17T21:29:52.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.874+0000 7f09aa590640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:52.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.874+0000 7f09aa590640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:29:52.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.874+0000 7f09aa590640 1 -- 10.20.193.5:0/2001197303 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a40c5550 con 0x7f09a40c7170 2026-02-17T21:29:52.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.875+0000 7f09aa590640 1 --2- 10.20.193.5:0/2001197303 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f09a40c7170 0x7f09a40c7550 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f099c0098a0 tx=0x7f099c02ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6d1e1801f14b63 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:52.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.876+0000 7f09a958e640 1 -- 10.20.193.5:0/2001197303 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099c03c070 con 0x7f09a40c7170 2026-02-17T21:29:52.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.876+0000 7f09a958e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:52.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.876+0000 7f09a958e640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:29:52.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.876+0000 7f09a958e640 10 monclient: dump: 2026-02-17T21:29:52.890 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:52.890 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:52.890 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:52.890 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:52.890 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:52.890 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:52.890 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:52.890 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:52.890 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:52.891 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:52.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.876+0000 7f09a958e640 10 monclient: _finish_auth 0 2026-02-17T21:29:52.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.876+0000 7f09a958e640 10 monclient: _check_auth_tickets 2026-02-17T21:29:52.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.876+0000 7f09a958e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:52.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.876+0000 7f09ac81b640 5 monclient: authenticate success, global_id 5071 2026-02-17T21:29:52.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.876+0000 7f09ac81b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:29:52.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.877+0000 7f09a958e640 1 -- 10.20.193.5:0/2001197303 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f099c02fb70 con 0x7f09a40c7170 2026-02-17T21:29:52.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.877+0000 7f09a958e640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:52.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.877+0000 7f09a958e640 1 -- 10.20.193.5:0/2001197303 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099c037440 con 0x7f09a40c7170 2026-02-17T21:29:52.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.877+0000 7f09ac81b640 10 monclient: get_monmap_and_config success 2026-02-17T21:29:52.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.877+0000 7f09a958e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:52.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.877+0000 7f09ac81b640 4 set_mon_vals no callback set 2026-02-17T21:29:52.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.877+0000 7f09a958e640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:29:52.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.877+0000 7f09a958e640 10 monclient: dump: 2026-02-17T21:29:52.892 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:52.892 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:52.892 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:52.892 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:52.892 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:52.892 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:52.892 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:52.892 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:52.892 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:52.892 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:52.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.877+0000 7f09ac81b640 10 monclient: shutdown 2026-02-17T21:29:52.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.877+0000 7f09ac81b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:52.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.877+0000 7f09ac81b640 1 -- 10.20.193.5:0/2001197303 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f09a40c7170 msgr2=0x7f09a40c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:52.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.877+0000 7f09ac81b640 1 --2- 10.20.193.5:0/2001197303 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f09a40c7170 0x7f09a40c7550 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f099c0098a0 tx=0x7f099c02ee60 comp rx=0 tx=0).stop 2026-02-17T21:29:52.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.878+0000 7f09ac81b640 1 -- 10.20.193.5:0/2001197303 shutdown_connections 2026-02-17T21:29:52.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.878+0000 7f09ac81b640 1 --2- 10.20.193.5:0/2001197303 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f09a40c7170 0x7f09a40c7550 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:52.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.878+0000 7f09ac81b640 1 -- 10.20.193.5:0/2001197303 >> 10.20.193.5:0/2001197303 conn(0x7f09a40c9f40 msgr2=0x7f09a40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:52.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.878+0000 7f09ac81b640 1 -- 10.20.193.5:0/2001197303 shutdown_connections 2026-02-17T21:29:52.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.878+0000 7f09ac81b640 1 -- 10.20.193.5:0/2001197303 wait complete. 2026-02-17T21:29:52.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.878+0000 7f09ac81b640 10 monclient: build_initial_monmap 2026-02-17T21:29:52.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.878+0000 7f09ac81b640 10 monclient: monmap: 2026-02-17T21:29:52.894 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:52.894 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:29:52.894 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:29:52.894 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:29:52.894 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:52.894 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:52.894 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:29:52.894 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:29:52.894 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:29:52.894 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:52.894 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.878+0000 7f09ac81b640 1 librados: starting msgr at 2026-02-17T21:29:52.895 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.878+0000 7f09ac81b640 1 librados: starting objecter 2026-02-17T21:29:52.895 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.878+0000 7f09ac81b640 1 Processor -- start 2026-02-17T21:29:52.895 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.878+0000 7f09ac81b640 1 -- start start 2026-02-17T21:29:52.895 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.878+0000 7f09ac81b640 1 librados: setting wanted keys 2026-02-17T21:29:52.895 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.878+0000 7f09ac81b640 1 librados: calling monclient init 2026-02-17T21:29:52.895 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.878+0000 7f09ac81b640 10 monclient: init 2026-02-17T21:29:52.895 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09ac81b640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:52.895 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09ac81b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:29:52.895 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09ac81b640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09a40c48c0 0x7f09a41f3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:52.895 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09ac81b640 10 monclient(hunting): picked mon.noname-a con 0x7f09a40c48c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:29:52.895 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09ac81b640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f09a40c4d10 0x7f09a4159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:52.895 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09ac81b640 10 monclient(hunting): picked mon.noname-b con 0x7f09a40c4d10 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:29:52.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09ac81b640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f09a40c7170 0x7f09a406ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:52.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09ac81b640 10 monclient(hunting): picked mon.noname-c con 0x7f09a40c7170 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:29:52.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09ac81b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:52.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09ac81b640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f09a40c81c0 con 0x7f09a40c48c0 2026-02-17T21:29:52.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09ac81b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:52.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09ac81b640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f09a40c7ee0 con 0x7f09a40c4d10 2026-02-17T21:29:52.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09ac81b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:52.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09ac81b640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f09a40750c0 con 0x7f09a40c7170 2026-02-17T21:29:52.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09ac81b640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:52.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09ac81b640 10 monclient(hunting): authenticate will time out at 1298.445182s 2026-02-17T21:29:52.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09aad91640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f09a40c7170 0x7f09a406ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:52.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09a9d8f640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f09a40c4d10 0x7f09a4159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:52.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09aad91640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f09a40c7170 0x7f09a406ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:48048/0 (socket says 10.20.193.5:48048) 2026-02-17T21:29:52.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09aad91640 1 -- 10.20.193.5:0/3526878045 learned_addr learned my addr 10.20.193.5:0/3526878045 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:29:52.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09aad91640 10 monclient(hunting): get_auth_request con 0x7f09a40c7170 auth_method 0 2026-02-17T21:29:52.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09aad91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:52.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09aad91640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:52.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09aad91640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:52.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09aa590640 1 --2- 10.20.193.5:0/3526878045 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09a40c48c0 0x7f09a41f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:52.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09a9d8f640 10 monclient(hunting): get_auth_request con 0x7f09a40c4d10 auth_method 0 2026-02-17T21:29:52.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09a9d8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:52.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09a9d8f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:52.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09a9d8f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:52.897 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09aa590640 10 monclient(hunting): get_auth_request con 0x7f09a40c48c0 auth_method 0 2026-02-17T21:29:52.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09aa590640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:52.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09aa590640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:52.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09aa590640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:52.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09aad91640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:52.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09aad91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:52.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09aad91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:52.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09a9d8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:52.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09a9d8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:52.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.879+0000 7f09a9d8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:52.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.880+0000 7f09aa590640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:52.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.880+0000 7f09aa590640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:52.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.880+0000 7f09aa590640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:52.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.881+0000 7f09aad91640 10 monclient(hunting): handle_auth_done global_id 5057 payload 824 2026-02-17T21:29:52.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.881+0000 7f09aad91640 1 -- 10.20.193.5:0/3526878045 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f09a40c4d10 msgr2=0x7f09a4159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:52.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.881+0000 7f09aad91640 1 --2- 10.20.193.5:0/3526878045 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f09a40c4d10 0x7f09a4159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:52.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.881+0000 7f09aad91640 1 -- 10.20.193.5:0/3526878045 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09a40c48c0 msgr2=0x7f09a41f3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:52.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.881+0000 7f09aad91640 1 --2- 10.20.193.5:0/3526878045 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09a40c48c0 0x7f09a41f3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:52.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.881+0000 7f09aad91640 10 monclient: _finish_hunting 0 2026-02-17T21:29:52.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.881+0000 7f09aad91640 1 monclient: found mon.noname-c 2026-02-17T21:29:52.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.881+0000 7f09aad91640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:52.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.881+0000 7f09aad91640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:29:52.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.881+0000 7f09aad91640 1 -- 10.20.193.5:0/3526878045 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a41f3b60 con 0x7f09a40c7170 2026-02-17T21:29:52.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.882+0000 7f09aad91640 1 --2- 10.20.193.5:0/3526878045 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f09a40c7170 0x7f09a406ed70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f099800ca70 tx=0x7f099800cf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:52.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.882+0000 7f098effd640 10 client.?.objecter ms_handle_connect 0x7f09a40c7170 2026-02-17T21:29:52.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.882+0000 7f098effd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:29:52.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.883+0000 7f098effd640 1 -- 10.20.193.5:0/3526878045 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099800ac40 con 0x7f09a40c7170 2026-02-17T21:29:52.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.883+0000 7f098effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:52.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.883+0000 7f098effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:29:52.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.883+0000 7f098effd640 10 monclient: dump: 2026-02-17T21:29:52.900 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:52.900 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:52.900 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:52.900 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:52.900 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:52.900 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:52.900 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:52.901 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:52.901 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:52.901 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:52.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.883+0000 7f098effd640 10 monclient: _finish_auth 0 2026-02-17T21:29:52.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.883+0000 7f098effd640 10 monclient: _check_auth_tickets 2026-02-17T21:29:52.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.883+0000 7f098effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:52.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.883+0000 7f09ac81b640 5 monclient: authenticate success, global_id 5057 2026-02-17T21:29:52.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.883+0000 7f09ac81b640 10 monclient: _renew_subs 2026-02-17T21:29:52.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.883+0000 7f09ac81b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:29:52.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.883+0000 7f09ac81b640 1 -- 10.20.193.5:0/3526878045 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09a41f3e40 con 0x7f09a40c7170 2026-02-17T21:29:52.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.883+0000 7f09ac81b640 10 client.5057.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:29:52.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.883+0000 7f09ac81b640 10 monclient: _renew_subs 2026-02-17T21:29:52.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.883+0000 7f09ac81b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:29:52.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.883+0000 7f09ac81b640 1 -- 10.20.193.5:0/3526878045 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09a40c24c0 con 0x7f09a40c7170 2026-02-17T21:29:52.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.883+0000 7f09ac81b640 1 librados: init done 2026-02-17T21:29:52.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.883+0000 7f09ac81b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:52.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.883+0000 7f09ac81b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:52.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.883+0000 7f09ac81b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:29:52.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.883+0000 7f09ac81b640 1 -- 10.20.193.5:0/3526878045 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09a40c7550 con 0x7f09a40c7170 2026-02-17T21:29:52.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.884+0000 7f098effd640 1 -- 10.20.193.5:0/3526878045 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f099800ade0 con 0x7f09a40c7170 2026-02-17T21:29:52.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.884+0000 7f098effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:52.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.884+0000 7f098effd640 1 -- 10.20.193.5:0/3526878045 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0998025630 con 0x7f09a40c7170 2026-02-17T21:29:52.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.884+0000 7f098effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:52.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.884+0000 7f098effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:29:52.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.884+0000 7f09a8d8d640 4 set_mon_vals no callback set 2026-02-17T21:29:52.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.884+0000 7f098effd640 10 monclient: dump: 2026-02-17T21:29:52.903 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:52.903 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:52.903 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:52.903 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:52.903 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:52.903 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:52.903 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:52.903 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:52.903 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:52.903 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:52.994 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.991+0000 7f098effd640 1 -- 10.20.193.5:0/3526878045 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f09980257d0 con 0x7f09a40c7170 2026-02-17T21:29:52.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.992+0000 7f098effd640 1 --2- 10.20.193.5:0/3526878045 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0974079280 0x7f097407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:52.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.993+0000 7f09aa590640 1 --2- 10.20.193.5:0/3526878045 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0974079280 0x7f097407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:52.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.993+0000 7f09aa590640 10 monclient: get_auth_request con 0x7f0974079280 auth_method 0 2026-02-17T21:29:52.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.993+0000 7f09aa590640 1 --2- 10.20.193.5:0/3526878045 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0974079280 0x7f097407b740 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f099c039000 tx=0x7f099c033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:52.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.993+0000 7f098effd640 10 client.5057.objecter ms_handle_connect 0x7f0974079280 2026-02-17T21:29:52.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.994+0000 7f098effd640 1 -- 10.20.193.5:0/3526878045 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f09980987a0 con 0x7f09a40c7170 2026-02-17T21:29:52.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.994+0000 7f098effd640 10 client.5057.objecter ms_dispatch2 0x7f09a4000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:29:52.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.994+0000 7f098effd640 3 client.5057.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:29:52.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.994+0000 7f098effd640 3 client.5057.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:29:52.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:52.994+0000 7f098effd640 20 client.5057.objecter dump_active .. 0 homeless 2026-02-17T21:29:53.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.000+0000 7f098effd640 1 -- 10.20.193.5:0/3526878045 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0998062c20 con 0x7f09a40c7170 2026-02-17T21:29:53.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.000+0000 7f098effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:53.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.000+0000 7f098effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:29:53.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.100+0000 7f09ac81b640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:29:53.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.100+0000 7f09ac81b640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:53.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.100+0000 7f09ac81b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:29:53.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.100+0000 7f09ac81b640 1 -- 10.20.193.5:0/3526878045 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f09a40c2290 con 0x7f09a40c7170 2026-02-17T21:29:53.105 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.104+0000 7f098effd640 1 -- 10.20.193.5:0/3526878045 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f0998066f20 con 0x7f09a40c7170 2026-02-17T21:29:53.105 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.104+0000 7f098effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:53.105 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.104+0000 7f098effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:29:53.106 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:29:53.106 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:29:53.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.104+0000 7f09ac81b640 10 librados: watch_flush enter 2026-02-17T21:29:53.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.104+0000 7f09ac81b640 10 librados: watch_flush exit 2026-02-17T21:29:53.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.104+0000 7f09ac81b640 20 client.5057.objecter shutdown clearing up homeless session... 2026-02-17T21:29:53.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.104+0000 7f09ac81b640 10 client.5057.objecter successfully canceled tick 2026-02-17T21:29:53.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.104+0000 7f09ac81b640 1 -- 10.20.193.5:0/3526878045 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0974079280 msgr2=0x7f097407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:53.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.104+0000 7f09ac81b640 1 --2- 10.20.193.5:0/3526878045 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0974079280 0x7f097407b740 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f099c039000 tx=0x7f099c033000 comp rx=0 tx=0).stop 2026-02-17T21:29:53.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.104+0000 7f09ac81b640 10 monclient: shutdown 2026-02-17T21:29:53.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.104+0000 7f09ac81b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:53.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.104+0000 7f09ac81b640 1 -- 10.20.193.5:0/3526878045 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f09a40c7170 msgr2=0x7f09a406ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:53.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.104+0000 7f09ac81b640 1 --2- 10.20.193.5:0/3526878045 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f09a40c7170 0x7f09a406ed70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f099800ca70 tx=0x7f099800cf40 comp rx=0 tx=0).stop 2026-02-17T21:29:53.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.104+0000 7f09ac81b640 1 -- 10.20.193.5:0/3526878045 shutdown_connections 2026-02-17T21:29:53.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.104+0000 7f09ac81b640 1 --2- 10.20.193.5:0/3526878045 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0974079280 0x7f097407b740 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:53.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.104+0000 7f09ac81b640 1 --2- 10.20.193.5:0/3526878045 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f09a40c7170 0x7f09a406ed70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:53.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.104+0000 7f09ac81b640 1 --2- 10.20.193.5:0/3526878045 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f09a40c4d10 0x7f09a4159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:53.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.104+0000 7f09ac81b640 1 --2- 10.20.193.5:0/3526878045 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09a40c48c0 0x7f09a41f3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:53.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.104+0000 7f09ac81b640 1 -- 10.20.193.5:0/3526878045 >> 10.20.193.5:0/3526878045 conn(0x7f09a40c9f40 msgr2=0x7f09a414d380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:53.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.104+0000 7f09ac81b640 1 -- 10.20.193.5:0/3526878045 shutdown_connections 2026-02-17T21:29:53.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.104+0000 7f09ac81b640 1 -- 10.20.193.5:0/3526878045 wait complete. 2026-02-17T21:29:53.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:53.104+0000 7f09ac81b640 1 librados: shutdown 2026-02-17T21:29:56.116 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:29:56.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.183+0000 7f3484256640 10 monclient: get_monmap_and_config 2026-02-17T21:29:56.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.183+0000 7f3484256640 10 monclient: build_initial_monmap 2026-02-17T21:29:56.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.183+0000 7f3484256640 10 monclient: monmap: 2026-02-17T21:29:56.186 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:56.186 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:56.187 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:29:56.185233+0000 2026-02-17T21:29:56.187 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:29:56.185233+0000 2026-02-17T21:29:56.187 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:56.187 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:56.187 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:29:56.187 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:29:56.187 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:29:56.187 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:29:56.187 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:29:56.187 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:29:56.187 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:56.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.183+0000 7f3484256640 1 Processor -- start 2026-02-17T21:29:56.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.184+0000 7f3484256640 1 -- start start 2026-02-17T21:29:56.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.184+0000 7f3484256640 10 monclient: init 2026-02-17T21:29:56.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.184+0000 7f3484256640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:56.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.184+0000 7f3484256640 10 monclient: _add_conns ranks=[2,5,1,3,4,0] 2026-02-17T21:29:56.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.184+0000 7f3484256640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f347c0c7170 addr v1:10.20.193.135:6789/0 2026-02-17T21:29:56.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.184+0000 7f3484256640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f347c0c7550 0x7f347c0749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:56.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.184+0000 7f3484256640 10 monclient(hunting): picked mon.noname-c con 0x7f347c0c7550 addr v2:10.20.193.135:3300/0 2026-02-17T21:29:56.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.184+0000 7f3484256640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f347c074ef0 addr v1:10.20.193.119:6789/0 2026-02-17T21:29:56.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.184+0000 7f3484256640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f347c0c4fd0 con 0x7f347c074ef0 2026-02-17T21:29:56.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.184+0000 7f3484256640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f347c15a9a0 con 0x7f347c0c7170 2026-02-17T21:29:56.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.184+0000 7f3484256640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:56.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.184+0000 7f3484256640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f347c0c8530 con 0x7f347c0c7550 2026-02-17T21:29:56.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.184+0000 7f3484256640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:56.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.184+0000 7f3484256640 10 monclient(hunting): authenticate will time out at 1301.750515s 2026-02-17T21:29:56.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.185+0000 7f34827cc640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f347c074ef0 0x7f347c0c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:60500/0 (socket says 10.20.193.5:60500) 2026-02-17T21:29:56.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.185+0000 7f34827cc640 1 -- 10.20.193.5:0/3147833742 learned_addr learned my addr 10.20.193.5:0/3147833742 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:29:56.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.185+0000 7f34817ca640 1 --2- 10.20.193.5:0/3147833742 >> v2:10.20.193.135:3300/0 conn(0x7f347c0c7550 0x7f347c0749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:56.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.185+0000 7f34817ca640 10 monclient(hunting): get_auth_request con 0x7f347c0c7550 auth_method 0 2026-02-17T21:29:56.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.185+0000 7f34817ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:56.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.185+0000 7f34817ca640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:56.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.185+0000 7f34817ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:56.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.185+0000 7f34817ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:56.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.185+0000 7f34817ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:56.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.185+0000 7f34817ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:56.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.186+0000 7f3480fc9640 1 -- 10.20.193.5:0/3147833742 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1856076661 0 0) 0x7f347c0c4fd0 con 0x7f347c074ef0 2026-02-17T21:29:56.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.186+0000 7f3480fc9640 10 monclient(hunting): _negotiate 2026-02-17T21:29:56.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.186+0000 7f3480fc9640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:56.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.186+0000 7f3480fc9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:56.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.186+0000 7f3480fc9640 10 monclient(hunting): my global_id is 5077 2026-02-17T21:29:56.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.186+0000 7f3480fc9640 1 -- 10.20.193.5:0/3147833742 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3464003620 con 0x7f347c074ef0 2026-02-17T21:29:56.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.186+0000 7f34817ca640 10 monclient(hunting): handle_auth_done global_id 5060 payload 274 2026-02-17T21:29:56.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.187+0000 7f34817ca640 1 -- 10.20.193.5:0/3147833742 >> v1:10.20.193.135:6789/0 conn(0x7f347c0c7170 legacy=0x7f347c0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:56.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.187+0000 7f34817ca640 1 -- 10.20.193.5:0/3147833742 >> v1:10.20.193.119:6789/0 conn(0x7f347c074ef0 legacy=0x7f347c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:56.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.187+0000 7f34817ca640 10 monclient: _finish_hunting 0 2026-02-17T21:29:56.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.187+0000 7f34817ca640 1 monclient: found mon.noname-c 2026-02-17T21:29:56.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.187+0000 7f34817ca640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:56.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.187+0000 7f34817ca640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:29:56.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.187+0000 7f34817ca640 1 -- 10.20.193.5:0/3147833742 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347c0c5270 con 0x7f347c0c7550 2026-02-17T21:29:56.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.189+0000 7f34817ca640 1 --2- 10.20.193.5:0/3147833742 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f347c0c7550 0x7f347c0749b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f34700098a0 tx=0x7f347002ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce2451472c1a3776 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:56.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.190+0000 7f3480fc9640 1 -- 10.20.193.5:0/3147833742 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347003c070 con 0x7f347c0c7550 2026-02-17T21:29:56.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.190+0000 7f3480fc9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:56.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.190+0000 7f3480fc9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:29:56.198 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.190+0000 7f3480fc9640 10 monclient: dump: 2026-02-17T21:29:56.199 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:56.199 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:56.199 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:56.199 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:56.199 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:56.199 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:56.199 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:56.199 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:56.199 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:56.199 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:56.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.190+0000 7f3480fc9640 10 monclient: _finish_auth 0 2026-02-17T21:29:56.199 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.190+0000 7f3480fc9640 10 monclient: _check_auth_tickets 2026-02-17T21:29:56.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.190+0000 7f3480fc9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:56.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.190+0000 7f3480fc9640 1 -- 10.20.193.5:0/3147833742 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f347002fb70 con 0x7f347c0c7550 2026-02-17T21:29:56.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.190+0000 7f3480fc9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:56.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.190+0000 7f3480fc9640 1 -- 10.20.193.5:0/3147833742 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3470037440 con 0x7f347c0c7550 2026-02-17T21:29:56.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.190+0000 7f3484256640 5 monclient: authenticate success, global_id 5060 2026-02-17T21:29:56.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.190+0000 7f3484256640 10 monclient: get_monmap_and_config success 2026-02-17T21:29:56.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.190+0000 7f3484256640 4 set_mon_vals no callback set 2026-02-17T21:29:56.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.190+0000 7f3480fc9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:56.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.190+0000 7f3480fc9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:29:56.200 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.190+0000 7f3480fc9640 10 monclient: dump: 2026-02-17T21:29:56.200 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:56.200 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:56.201 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:56.201 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:56.201 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:56.201 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:56.201 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:56.201 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:56.201 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:56.201 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:56.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.191+0000 7f3484256640 10 monclient: shutdown 2026-02-17T21:29:56.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.191+0000 7f3484256640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:56.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.191+0000 7f3484256640 1 -- 10.20.193.5:0/3147833742 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f347c0c7550 msgr2=0x7f347c0749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:56.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.191+0000 7f3484256640 1 --2- 10.20.193.5:0/3147833742 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f347c0c7550 0x7f347c0749b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f34700098a0 tx=0x7f347002ee60 comp rx=0 tx=0).stop 2026-02-17T21:29:56.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.191+0000 7f3484256640 1 -- 10.20.193.5:0/3147833742 shutdown_connections 2026-02-17T21:29:56.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.191+0000 7f3484256640 1 --2- 10.20.193.5:0/3147833742 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f347c0c7550 0x7f347c0749b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:56.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.191+0000 7f3484256640 1 -- 10.20.193.5:0/3147833742 >> 10.20.193.5:0/3147833742 conn(0x7f347c0c9f40 msgr2=0x7f347c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:56.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.191+0000 7f3484256640 1 -- 10.20.193.5:0/3147833742 shutdown_connections 2026-02-17T21:29:56.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.191+0000 7f3484256640 1 -- 10.20.193.5:0/3147833742 wait complete. 2026-02-17T21:29:56.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.191+0000 7f3484256640 10 monclient: build_initial_monmap 2026-02-17T21:29:56.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.191+0000 7f3484256640 10 monclient: monmap: 2026-02-17T21:29:56.202 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:56.202 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:29:56.202 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:29:56.202 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:29:56.202 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:56.202 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:56.203 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:29:56.203 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:29:56.203 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:29:56.203 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:56.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.191+0000 7f3484256640 1 librados: starting msgr at 2026-02-17T21:29:56.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.191+0000 7f3484256640 1 librados: starting objecter 2026-02-17T21:29:56.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.192+0000 7f3484256640 1 Processor -- start 2026-02-17T21:29:56.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.192+0000 7f3484256640 1 -- start start 2026-02-17T21:29:56.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.192+0000 7f3484256640 1 librados: setting wanted keys 2026-02-17T21:29:56.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.192+0000 7f3484256640 1 librados: calling monclient init 2026-02-17T21:29:56.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.192+0000 7f3484256640 10 monclient: init 2026-02-17T21:29:56.203 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.192+0000 7f3484256640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:56.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.192+0000 7f3484256640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:29:56.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.192+0000 7f3484256640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f347c074ef0 0x7f347c158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:56.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.192+0000 7f3484256640 10 monclient(hunting): picked mon.noname-c con 0x7f347c074ef0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:29:56.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.192+0000 7f3484256640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f347c0c7170 0x7f347c0c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:56.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.192+0000 7f3484256640 10 monclient(hunting): picked mon.noname-a con 0x7f347c0c7170 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:29:56.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.192+0000 7f3484256640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f347c0c7550 0x7f347c0c2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:56.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.192+0000 7f3484256640 10 monclient(hunting): picked mon.noname-b con 0x7f347c0c7550 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:29:56.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.192+0000 7f3484256640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:56.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.192+0000 7f3484256640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f347c0c7ee0 con 0x7f347c0c7170 2026-02-17T21:29:56.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.192+0000 7f3484256640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:56.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.192+0000 7f3484256640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f347c0c5830 con 0x7f347c0c7550 2026-02-17T21:29:56.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.192+0000 7f3484256640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:56.204 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.192+0000 7f3484256640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f347c0c81c0 con 0x7f347c074ef0 2026-02-17T21:29:56.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.192+0000 7f3484256640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:56.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.192+0000 7f3484256640 10 monclient(hunting): authenticate will time out at 1301.758491s 2026-02-17T21:29:56.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.192+0000 7f3481fcb640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f347c074ef0 0x7f347c158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:56.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.192+0000 7f34817ca640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f347c0c7170 0x7f347c0c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:56.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.192+0000 7f34827cc640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f347c0c7550 0x7f347c0c2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:56.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.193+0000 7f3481fcb640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f347c074ef0 0x7f347c158fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:48060/0 (socket says 10.20.193.5:48060) 2026-02-17T21:29:56.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.193+0000 7f3481fcb640 1 -- 10.20.193.5:0/1660097699 learned_addr learned my addr 10.20.193.5:0/1660097699 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:29:56.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.193+0000 7f3481fcb640 10 monclient(hunting): get_auth_request con 0x7f347c074ef0 auth_method 0 2026-02-17T21:29:56.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.193+0000 7f3481fcb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:56.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.193+0000 7f3481fcb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:56.205 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.193+0000 7f3481fcb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:56.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.193+0000 7f34827cc640 10 monclient(hunting): get_auth_request con 0x7f347c0c7550 auth_method 0 2026-02-17T21:29:56.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.193+0000 7f34827cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:56.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.193+0000 7f34827cc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:56.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.193+0000 7f34827cc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:56.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.193+0000 7f34817ca640 10 monclient(hunting): get_auth_request con 0x7f347c0c7170 auth_method 0 2026-02-17T21:29:56.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.193+0000 7f34817ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:56.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.193+0000 7f34817ca640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:56.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.193+0000 7f34817ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:56.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.193+0000 7f3481fcb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:56.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.193+0000 7f3481fcb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:56.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.193+0000 7f3481fcb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:56.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.193+0000 7f34827cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:56.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.193+0000 7f34827cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:56.206 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.193+0000 7f34827cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:56.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.193+0000 7f34817ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:56.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.193+0000 7f34817ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:56.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.193+0000 7f34817ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:56.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.194+0000 7f34827cc640 10 monclient(hunting): handle_auth_done global_id 5080 payload 824 2026-02-17T21:29:56.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.194+0000 7f34827cc640 1 -- 10.20.193.5:0/1660097699 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f347c074ef0 msgr2=0x7f347c158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:56.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.194+0000 7f34827cc640 1 --2- 10.20.193.5:0/1660097699 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f347c074ef0 0x7f347c158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:56.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.194+0000 7f34827cc640 1 -- 10.20.193.5:0/1660097699 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f347c0c7170 msgr2=0x7f347c0c2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:56.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.194+0000 7f34827cc640 1 --2- 10.20.193.5:0/1660097699 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f347c0c7170 0x7f347c0c2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:56.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.194+0000 7f34827cc640 10 monclient: _finish_hunting 0 2026-02-17T21:29:56.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.194+0000 7f34827cc640 1 monclient: found mon.noname-b 2026-02-17T21:29:56.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.194+0000 7f34827cc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:56.207 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.194+0000 7f34827cc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:29:56.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.194+0000 7f34827cc640 1 -- 10.20.193.5:0/1660097699 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347c070cc0 con 0x7f347c0c7550 2026-02-17T21:29:56.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.195+0000 7f34827cc640 1 --2- 10.20.193.5:0/1660097699 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f347c0c7550 0x7f347c0c2fa0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f347800ca70 tx=0x7f347800cf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:56.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.195+0000 7f346a7fc640 10 client.?.objecter ms_handle_connect 0x7f347c0c7550 2026-02-17T21:29:56.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.195+0000 7f346a7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:29:56.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.197+0000 7f346a7fc640 1 -- 10.20.193.5:0/1660097699 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347800ac40 con 0x7f347c0c7550 2026-02-17T21:29:56.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.197+0000 7f346a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:56.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.197+0000 7f346a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:29:56.210 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.197+0000 7f346a7fc640 10 monclient: dump: 2026-02-17T21:29:56.210 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:56.210 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:56.210 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:56.210 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:56.211 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:56.211 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:56.211 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:56.211 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:56.211 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:56.211 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:56.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.197+0000 7f346a7fc640 10 monclient: _finish_auth 0 2026-02-17T21:29:56.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.197+0000 7f346a7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:29:56.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.197+0000 7f346a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:56.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.197+0000 7f346a7fc640 1 -- 10.20.193.5:0/1660097699 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f347800ade0 con 0x7f347c0c7550 2026-02-17T21:29:56.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.197+0000 7f346a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:56.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.197+0000 7f346a7fc640 1 -- 10.20.193.5:0/1660097699 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3478012600 con 0x7f347c0c7550 2026-02-17T21:29:56.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.197+0000 7f3484256640 5 monclient: authenticate success, global_id 5080 2026-02-17T21:29:56.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.197+0000 7f346bfff640 4 set_mon_vals no callback set 2026-02-17T21:29:56.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.197+0000 7f3484256640 10 monclient: _renew_subs 2026-02-17T21:29:56.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.197+0000 7f3484256640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:29:56.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.197+0000 7f3484256640 1 -- 10.20.193.5:0/1660097699 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f347c155e20 con 0x7f347c0c7550 2026-02-17T21:29:56.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.197+0000 7f346a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:56.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.197+0000 7f346a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:29:56.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.197+0000 7f346a7fc640 10 monclient: dump: 2026-02-17T21:29:56.212 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:56.212 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:56.212 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:56.212 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:56.212 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:56.213 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:56.213 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:56.213 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:56.213 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:56.213 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:56.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.197+0000 7f3484256640 10 client.5080.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:29:56.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.197+0000 7f3484256640 10 monclient: _renew_subs 2026-02-17T21:29:56.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.197+0000 7f3484256640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:29:56.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.197+0000 7f3484256640 1 -- 10.20.193.5:0/1660097699 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f347c1563a0 con 0x7f347c0c7550 2026-02-17T21:29:56.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.197+0000 7f3484256640 1 librados: init done 2026-02-17T21:29:56.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.198+0000 7f3484256640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:56.213 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.198+0000 7f3484256640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:56.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.198+0000 7f3484256640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:29:56.214 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.198+0000 7f3484256640 1 -- 10.20.193.5:0/1660097699 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f347c0749b0 con 0x7f347c0c7550 2026-02-17T21:29:56.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.209+0000 7f346a7fc640 1 -- 10.20.193.5:0/1660097699 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f34780127a0 con 0x7f347c0c7550 2026-02-17T21:29:56.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.210+0000 7f346a7fc640 1 --2- 10.20.193.5:0/1660097699 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f344c079300 0x7f344c07b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:56.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.210+0000 7f3481fcb640 1 --2- 10.20.193.5:0/1660097699 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f344c079300 0x7f344c07b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:56.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.210+0000 7f3481fcb640 10 monclient: get_auth_request con 0x7f344c079300 auth_method 0 2026-02-17T21:29:56.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.211+0000 7f346a7fc640 10 client.5080.objecter ms_handle_connect 0x7f344c079300 2026-02-17T21:29:56.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.211+0000 7f3481fcb640 1 --2- 10.20.193.5:0/1660097699 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f344c079300 0x7f344c07b7c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f346c002410 tx=0x7f346c002a30 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:56.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.212+0000 7f346a7fc640 1 -- 10.20.193.5:0/1660097699 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f347805ebb0 con 0x7f347c0c7550 2026-02-17T21:29:56.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.212+0000 7f346a7fc640 10 client.5080.objecter ms_dispatch2 0x7f347c000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:29:56.216 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.212+0000 7f346a7fc640 3 client.5080.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:29:56.216 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.212+0000 7f346a7fc640 3 client.5080.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:29:56.216 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.212+0000 7f346a7fc640 20 client.5080.objecter dump_active .. 0 homeless 2026-02-17T21:29:56.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.313+0000 7f346a7fc640 1 -- 10.20.193.5:0/1660097699 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3478062b70 con 0x7f347c0c7550 2026-02-17T21:29:56.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.313+0000 7f346a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:56.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.313+0000 7f346a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:29:56.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.418+0000 7f3484256640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:29:56.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.418+0000 7f3484256640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:56.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.418+0000 7f3484256640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:29:56.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.418+0000 7f3484256640 1 -- 10.20.193.5:0/1660097699 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f347c14c2b0 con 0x7f347c0c7550 2026-02-17T21:29:56.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.422+0000 7f346a7fc640 1 -- 10.20.193.5:0/1660097699 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f3478066e70 con 0x7f347c0c7550 2026-02-17T21:29:56.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.422+0000 7f346a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:56.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.422+0000 7f346a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:29:56.424 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:29:56.424 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:29:56.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.422+0000 7f3484256640 10 librados: watch_flush enter 2026-02-17T21:29:56.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.422+0000 7f3484256640 10 librados: watch_flush exit 2026-02-17T21:29:56.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.422+0000 7f3484256640 20 client.5080.objecter shutdown clearing up homeless session... 2026-02-17T21:29:56.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.422+0000 7f3484256640 10 client.5080.objecter successfully canceled tick 2026-02-17T21:29:56.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.422+0000 7f3484256640 1 -- 10.20.193.5:0/1660097699 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f344c079300 msgr2=0x7f344c07b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:56.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.422+0000 7f3484256640 1 --2- 10.20.193.5:0/1660097699 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f344c079300 0x7f344c07b7c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f346c002410 tx=0x7f346c002a30 comp rx=0 tx=0).stop 2026-02-17T21:29:56.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.422+0000 7f3484256640 10 monclient: shutdown 2026-02-17T21:29:56.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.422+0000 7f3484256640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:56.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.422+0000 7f3484256640 1 -- 10.20.193.5:0/1660097699 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f347c0c7550 msgr2=0x7f347c0c2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:56.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.422+0000 7f3484256640 1 --2- 10.20.193.5:0/1660097699 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f347c0c7550 0x7f347c0c2fa0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f347800ca70 tx=0x7f347800cf40 comp rx=0 tx=0).stop 2026-02-17T21:29:56.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.422+0000 7f3484256640 1 -- 10.20.193.5:0/1660097699 shutdown_connections 2026-02-17T21:29:56.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.422+0000 7f3484256640 1 --2- 10.20.193.5:0/1660097699 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f344c079300 0x7f344c07b7c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:56.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.422+0000 7f3484256640 1 --2- 10.20.193.5:0/1660097699 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f347c0c7550 0x7f347c0c2fa0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:56.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.422+0000 7f3484256640 1 --2- 10.20.193.5:0/1660097699 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f347c0c7170 0x7f347c0c2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:56.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.422+0000 7f3484256640 1 --2- 10.20.193.5:0/1660097699 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f347c074ef0 0x7f347c158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:56.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.422+0000 7f3484256640 1 -- 10.20.193.5:0/1660097699 >> 10.20.193.5:0/1660097699 conn(0x7f347c0c9f40 msgr2=0x7f347c14e390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:56.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.422+0000 7f3484256640 1 -- 10.20.193.5:0/1660097699 shutdown_connections 2026-02-17T21:29:56.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.422+0000 7f3484256640 1 -- 10.20.193.5:0/1660097699 wait complete. 2026-02-17T21:29:56.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:56.422+0000 7f3484256640 1 librados: shutdown 2026-02-17T21:29:57.682 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:06:37.308 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:57.684 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:06:37.309 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:57.685 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:06:37.309 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:57.687 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:06:37.311 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:57.691 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:06:37.317 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:57.695 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:06:37.319 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:57.713 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:06:37.299 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:57.714 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:06:37.300 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:57.722 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:06:37.308 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:29:59.434 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:29:59.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.500+0000 7faba0bdd640 10 monclient: get_monmap_and_config 2026-02-17T21:29:59.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.500+0000 7faba0bdd640 10 monclient: build_initial_monmap 2026-02-17T21:29:59.502 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.500+0000 7faba0bdd640 10 monclient: monmap: 2026-02-17T21:29:59.502 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:59.502 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:59.502 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:29:59.501712+0000 2026-02-17T21:29:59.502 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:29:59.501712+0000 2026-02-17T21:29:59.502 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:59.502 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:59.502 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:29:59.502 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:29:59.502 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:29:59.502 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:29:59.502 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:29:59.503 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:29:59.503 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:59.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.500+0000 7faba0bdd640 1 Processor -- start 2026-02-17T21:29:59.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.500+0000 7faba0bdd640 1 -- start start 2026-02-17T21:29:59.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.500+0000 7faba0bdd640 10 monclient: init 2026-02-17T21:29:59.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.500+0000 7faba0bdd640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:59.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.500+0000 7faba0bdd640 10 monclient: _add_conns ranks=[1,4,3,2,5,0] 2026-02-17T21:29:59.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.501+0000 7faba0bdd640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fab9c0c7170 addr v1:10.20.193.119:6789/0 2026-02-17T21:29:59.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.501+0000 7faba0bdd640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fab9c0c7550 0x7fab9c0749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:59.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.501+0000 7faba0bdd640 10 monclient(hunting): picked mon.noname-b con 0x7fab9c0c7550 addr v2:10.20.193.119:3300/0 2026-02-17T21:29:59.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.501+0000 7faba0bdd640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fab9c074ef0 0x7fab9c0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:59.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.501+0000 7faba0bdd640 10 monclient(hunting): picked mon.noname-a con 0x7fab9c074ef0 addr v2:10.20.193.5:3300/0 2026-02-17T21:29:59.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.501+0000 7faba0bdd640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab9c0c4fd0 con 0x7fab9c0c7170 2026-02-17T21:29:59.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.501+0000 7faba0bdd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:59.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.501+0000 7faba0bdd640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fab9c0c8530 con 0x7fab9c074ef0 2026-02-17T21:29:59.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.501+0000 7faba0bdd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:59.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.501+0000 7faba0bdd640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fab9c15a9a0 con 0x7fab9c0c7550 2026-02-17T21:29:59.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.501+0000 7faba0bdd640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:59.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.501+0000 7faba0bdd640 10 monclient(hunting): authenticate will time out at 1305.067086s 2026-02-17T21:29:59.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.501+0000 7fab9ad76640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fab9c074ef0 0x7fab9c0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:59.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.501+0000 7fab9ad76640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fab9c074ef0 0x7fab9c0c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:39684/0 (socket says 10.20.193.5:39684) 2026-02-17T21:29:59.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.501+0000 7fab9ad76640 1 -- 10.20.193.5:0/1188765350 learned_addr learned my addr 10.20.193.5:0/1188765350 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:29:59.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.501+0000 7fab9ad76640 10 monclient(hunting): get_auth_request con 0x7fab9c074ef0 auth_method 0 2026-02-17T21:29:59.504 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.501+0000 7fab9ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:59.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.501+0000 7fab9ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:59.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.501+0000 7fab9ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:59.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.501+0000 7fab9ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:59.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.501+0000 7fab9ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:59.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.501+0000 7fab9ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:59.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.501+0000 7fab99d74640 1 --2- 10.20.193.5:0/1188765350 >> v2:10.20.193.119:3300/0 conn(0x7fab9c0c7550 0x7fab9c0749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:59.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.502+0000 7fab99d74640 10 monclient(hunting): get_auth_request con 0x7fab9c0c7550 auth_method 0 2026-02-17T21:29:59.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.502+0000 7fab99d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:59.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.502+0000 7fab99d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:59.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.502+0000 7fab99d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:59.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.502+0000 7fab9ad76640 10 monclient(hunting): handle_auth_done global_id 5031 payload 274 2026-02-17T21:29:59.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.502+0000 7fab9ad76640 1 -- 10.20.193.5:0/1188765350 >> v2:10.20.193.119:3300/0 conn(0x7fab9c0c7550 msgr2=0x7fab9c0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:29:59.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.502+0000 7fab9ad76640 1 --2- 10.20.193.5:0/1188765350 >> v2:10.20.193.119:3300/0 conn(0x7fab9c0c7550 0x7fab9c0749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:59.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.502+0000 7fab9ad76640 1 -- 10.20.193.5:0/1188765350 >> v1:10.20.193.119:6789/0 conn(0x7fab9c0c7170 legacy=0x7fab9c0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:59.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.502+0000 7fab9ad76640 10 monclient: _finish_hunting 0 2026-02-17T21:29:59.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.502+0000 7fab9ad76640 1 monclient: found mon.noname-a 2026-02-17T21:29:59.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.502+0000 7fab9ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:59.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.502+0000 7fab9ad76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:29:59.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.502+0000 7fab9ad76640 1 -- 10.20.193.5:0/1188765350 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab9c0c5270 con 0x7fab9c074ef0 2026-02-17T21:29:59.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.503+0000 7fab9ad76640 1 --2- 10.20.193.5:0/1188765350 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fab9c074ef0 0x7fab9c0c89c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0c6e90 tx=0x7fab8c02f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b012b814799e7539 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:59.507 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7fab99573640 1 -- 10.20.193.5:0/1188765350 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8c02fd70 con 0x7fab9c074ef0 2026-02-17T21:29:59.507 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7fab99573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:59.507 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7fab99573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:29:59.507 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7fab99573640 10 monclient: dump: 2026-02-17T21:29:59.507 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7fab99573640 10 monclient: _finish_auth 0 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7fab99573640 10 monclient: _check_auth_tickets 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7fab99573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7fab99573640 1 -- 10.20.193.5:0/1188765350 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab8c0373f0 con 0x7fab9c074ef0 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7faba0bdd640 5 monclient: authenticate success, global_id 5031 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7faba0bdd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7fab99573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7faba0bdd640 10 monclient: get_monmap_and_config success 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7fab99573640 1 -- 10.20.193.5:0/1188765350 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8c0377c0 con 0x7fab9c074ef0 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7fab99573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7faba0bdd640 4 set_mon_vals no callback set 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7fab99573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7fab99573640 10 monclient: dump: 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:59.508 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:59.509 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:59.509 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:59.509 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:59.509 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:59.509 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:59.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7faba0bdd640 10 monclient: shutdown 2026-02-17T21:29:59.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7faba0bdd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:59.510 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7faba0bdd640 1 -- 10.20.193.5:0/1188765350 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fab9c074ef0 msgr2=0x7fab9c0c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7faba0bdd640 1 --2- 10.20.193.5:0/1188765350 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fab9c074ef0 0x7fab9c0c89c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0c6e90 tx=0x7fab8c02f270 comp rx=0 tx=0).stop 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7faba0bdd640 1 -- 10.20.193.5:0/1188765350 shutdown_connections 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7faba0bdd640 1 --2- 10.20.193.5:0/1188765350 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fab9c074ef0 0x7fab9c0c89c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7faba0bdd640 1 --2- 10.20.193.5:0/1188765350 >> v2:10.20.193.119:3300/0 conn(0x7fab9c0c7550 0x7fab9c0749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7faba0bdd640 1 -- 10.20.193.5:0/1188765350 >> 10.20.193.5:0/1188765350 conn(0x7fab9c0c9f40 msgr2=0x7fab9c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7faba0bdd640 1 -- 10.20.193.5:0/1188765350 shutdown_connections 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.505+0000 7faba0bdd640 1 -- 10.20.193.5:0/1188765350 wait complete. 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.506+0000 7faba0bdd640 10 monclient: build_initial_monmap 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.506+0000 7faba0bdd640 10 monclient: monmap: 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.506+0000 7faba0bdd640 1 librados: starting msgr at 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.506+0000 7faba0bdd640 1 librados: starting objecter 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.506+0000 7faba0bdd640 1 Processor -- start 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.506+0000 7faba0bdd640 1 -- start start 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.506+0000 7faba0bdd640 1 librados: setting wanted keys 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.506+0000 7faba0bdd640 1 librados: calling monclient init 2026-02-17T21:29:59.511 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.506+0000 7faba0bdd640 10 monclient: init 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7faba0bdd640 10 monclient: _reopen_session rank -1 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7faba0bdd640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7faba0bdd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fab9c074ef0 0x7fab9c06d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7faba0bdd640 10 monclient(hunting): picked mon.noname-c con 0x7fab9c074ef0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7faba0bdd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fab9c0c7170 0x7fab9c0bf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7faba0bdd640 10 monclient(hunting): picked mon.noname-a con 0x7fab9c0c7170 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7faba0bdd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fab9c0c7550 0x7fab9c0bfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7faba0bdd640 10 monclient(hunting): picked mon.noname-b con 0x7fab9c0c7550 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7faba0bdd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7faba0bdd640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fab9c0c7ee0 con 0x7fab9c0c7170 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7faba0bdd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7faba0bdd640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fab9c0c5830 con 0x7fab9c0c7550 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7faba0bdd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7faba0bdd640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fab9c0c81c0 con 0x7fab9c074ef0 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7faba0bdd640 10 monclient(hunting): _renew_subs 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7faba0bdd640 10 monclient(hunting): authenticate will time out at 1305.073361s 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7fab99d74640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fab9c0c7170 0x7fab9c0bf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7fab9ad76640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fab9c0c7550 0x7fab9c0bfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7fab99d74640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fab9c0c7170 0x7fab9c0bf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:39692/0 (socket says 10.20.193.5:39692) 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7fab99d74640 1 -- 10.20.193.5:0/1026867098 learned_addr learned my addr 10.20.193.5:0/1026867098 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7fab99d74640 10 monclient(hunting): get_auth_request con 0x7fab9c0c7170 auth_method 0 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7fab99d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7fab99d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7fab99d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7fab9ad76640 10 monclient(hunting): get_auth_request con 0x7fab9c0c7550 auth_method 0 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7fab9ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7fab9ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:59.512 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.507+0000 7fab9ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:59.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.508+0000 7fab9a575640 1 --2- 10.20.193.5:0/1026867098 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fab9c074ef0 0x7fab9c06d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:59.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.508+0000 7fab99d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:59.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.508+0000 7fab99d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:59.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.508+0000 7fab99d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:59.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.508+0000 7fab9ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:59.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.508+0000 7fab9ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:59.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.508+0000 7fab9ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:59.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.508+0000 7fab9a575640 10 monclient(hunting): get_auth_request con 0x7fab9c074ef0 auth_method 0 2026-02-17T21:29:59.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.508+0000 7fab9a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:29:59.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.508+0000 7fab9a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:29:59.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.508+0000 7fab9a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:29:59.514 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.508+0000 7fab9a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:29:59.514 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.508+0000 7fab9a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:29:59.514 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.508+0000 7fab9a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:29:59.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.509+0000 7fab99d74640 10 monclient(hunting): handle_auth_done global_id 5034 payload 824 2026-02-17T21:29:59.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.509+0000 7fab99d74640 1 -- 10.20.193.5:0/1026867098 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fab9c074ef0 msgr2=0x7fab9c06d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:59.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.509+0000 7fab99d74640 1 --2- 10.20.193.5:0/1026867098 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fab9c074ef0 0x7fab9c06d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:59.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.509+0000 7fab99d74640 1 -- 10.20.193.5:0/1026867098 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fab9c0c7550 msgr2=0x7fab9c0bfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:59.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.509+0000 7fab99d74640 1 --2- 10.20.193.5:0/1026867098 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fab9c0c7550 0x7fab9c0bfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:59.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.509+0000 7fab99d74640 10 monclient: _finish_hunting 0 2026-02-17T21:29:59.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.509+0000 7fab99d74640 1 monclient: found mon.noname-a 2026-02-17T21:29:59.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.509+0000 7fab99d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:29:59.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.509+0000 7fab99d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:29:59.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.509+0000 7fab99d74640 1 -- 10.20.193.5:0/1026867098 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab9c0be810 con 0x7fab9c0c7170 2026-02-17T21:29:59.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.510+0000 7fab99d74640 1 --2- 10.20.193.5:0/1026867098 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fab9c0c7170 0x7fab9c0bf870 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fab8400e7f0 tx=0x7fab8400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:59.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.510+0000 7fab82ffd640 10 client.?.objecter ms_handle_connect 0x7fab9c0c7170 2026-02-17T21:29:59.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.510+0000 7fab82ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:29:59.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7fab82ffd640 1 -- 10.20.193.5:0/1026867098 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab84017070 con 0x7fab9c0c7170 2026-02-17T21:29:59.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7fab82ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:59.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7fab82ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:29:59.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7fab82ffd640 10 monclient: dump: 2026-02-17T21:29:59.517 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:59.518 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:59.518 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:59.518 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:59.518 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:59.518 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:59.518 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:59.518 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:59.518 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:59.518 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:59.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7fab82ffd640 10 monclient: _finish_auth 0 2026-02-17T21:29:59.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7fab82ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:29:59.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7fab82ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:29:59.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7fab82ffd640 1 -- 10.20.193.5:0/1026867098 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab8400c8d0 con 0x7fab9c0c7170 2026-02-17T21:29:59.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7fab82ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:29:59.518 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7fab82ffd640 1 -- 10.20.193.5:0/1026867098 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8400f040 con 0x7fab9c0c7170 2026-02-17T21:29:59.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7fab82ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:29:59.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7fab82ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:29:59.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7fab82ffd640 10 monclient: dump: 2026-02-17T21:29:59.519 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:29:59.519 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:29:59.519 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:59.519 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:29:59.519 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:29:59.519 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:29:59.519 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:29:59.519 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:29:59.519 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:29:59.519 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:29:59.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7fab98d72640 4 set_mon_vals no callback set 2026-02-17T21:29:59.519 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7faba0bdd640 5 monclient: authenticate success, global_id 5034 2026-02-17T21:29:59.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7faba0bdd640 10 monclient: _renew_subs 2026-02-17T21:29:59.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7faba0bdd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:59.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7faba0bdd640 1 -- 10.20.193.5:0/1026867098 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab9c06f560 con 0x7fab9c0c7170 2026-02-17T21:29:59.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7faba0bdd640 10 client.5034.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:29:59.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7faba0bdd640 10 monclient: _renew_subs 2026-02-17T21:29:59.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7faba0bdd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:59.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7faba0bdd640 1 -- 10.20.193.5:0/1026867098 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab9c0bed90 con 0x7fab9c0c7170 2026-02-17T21:29:59.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7faba0bdd640 1 librados: init done 2026-02-17T21:29:59.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7faba0bdd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:59.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7faba0bdd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:59.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7faba0bdd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:59.520 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.512+0000 7faba0bdd640 1 -- 10.20.193.5:0/1026867098 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab9c0749b0 con 0x7fab9c0c7170 2026-02-17T21:29:59.526 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.524+0000 7fab82ffd640 1 -- 10.20.193.5:0/1026867098 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fab84012050 con 0x7fab9c0c7170 2026-02-17T21:29:59.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.524+0000 7fab82ffd640 1 --2- 10.20.193.5:0/1026867098 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fab68079280 0x7fab6807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:29:59.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.525+0000 7fab9a575640 1 --2- 10.20.193.5:0/1026867098 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fab68079280 0x7fab6807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:29:59.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.525+0000 7fab9a575640 10 monclient: get_auth_request con 0x7fab68079280 auth_method 0 2026-02-17T21:29:59.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.525+0000 7fab82ffd640 10 client.5034.objecter ms_handle_connect 0x7fab68079280 2026-02-17T21:29:59.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.525+0000 7fab9a575640 1 --2- 10.20.193.5:0/1026867098 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fab68079280 0x7fab6807b740 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fab90002770 tx=0x7fab90007f30 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:29:59.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.526+0000 7fab82ffd640 1 -- 10.20.193.5:0/1026867098 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fab8405dfa0 con 0x7fab9c0c7170 2026-02-17T21:29:59.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.526+0000 7fab82ffd640 10 client.5034.objecter ms_dispatch2 0x7fab9c000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:29:59.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.526+0000 7fab82ffd640 3 client.5034.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:29:59.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.526+0000 7fab82ffd640 3 client.5034.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:29:59.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.526+0000 7fab82ffd640 20 client.5034.objecter dump_active .. 0 homeless 2026-02-17T21:29:59.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.635+0000 7fab82ffd640 1 -- 10.20.193.5:0/1026867098 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fab84061f60 con 0x7fab9c0c7170 2026-02-17T21:29:59.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.635+0000 7fab82ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:29:59.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.635+0000 7fab82ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:29:59.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.736+0000 7faba0bdd640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:29:59.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.736+0000 7faba0bdd640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:59.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.736+0000 7faba0bdd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:29:59.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.736+0000 7faba0bdd640 1 -- 10.20.193.5:0/1026867098 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fab9c0c4cb0 con 0x7fab9c0c7170 2026-02-17T21:29:59.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.739+0000 7fab82ffd640 1 -- 10.20.193.5:0/1026867098 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fab84066260 con 0x7fab9c0c7170 2026-02-17T21:29:59.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.739+0000 7fab82ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:29:59.742 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.739+0000 7fab82ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:29:59.742 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:29:59.742 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:29:59.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.740+0000 7faba0bdd640 10 librados: watch_flush enter 2026-02-17T21:29:59.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.740+0000 7faba0bdd640 10 librados: watch_flush exit 2026-02-17T21:29:59.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.740+0000 7faba0bdd640 20 client.5034.objecter shutdown clearing up homeless session... 2026-02-17T21:29:59.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.740+0000 7faba0bdd640 10 client.5034.objecter successfully canceled tick 2026-02-17T21:29:59.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.740+0000 7faba0bdd640 1 -- 10.20.193.5:0/1026867098 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fab68079280 msgr2=0x7fab6807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:59.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.740+0000 7faba0bdd640 1 --2- 10.20.193.5:0/1026867098 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fab68079280 0x7fab6807b740 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fab90002770 tx=0x7fab90007f30 comp rx=0 tx=0).stop 2026-02-17T21:29:59.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.740+0000 7faba0bdd640 10 monclient: shutdown 2026-02-17T21:29:59.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.740+0000 7faba0bdd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:29:59.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.740+0000 7faba0bdd640 1 -- 10.20.193.5:0/1026867098 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fab9c0c7170 msgr2=0x7fab9c0bf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:29:59.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.740+0000 7faba0bdd640 1 --2- 10.20.193.5:0/1026867098 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fab9c0c7170 0x7fab9c0bf870 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fab8400e7f0 tx=0x7fab8400ecc0 comp rx=0 tx=0).stop 2026-02-17T21:29:59.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.740+0000 7faba0bdd640 1 -- 10.20.193.5:0/1026867098 shutdown_connections 2026-02-17T21:29:59.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.740+0000 7faba0bdd640 1 --2- 10.20.193.5:0/1026867098 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fab68079280 0x7fab6807b740 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:59.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.740+0000 7faba0bdd640 1 --2- 10.20.193.5:0/1026867098 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fab9c0c7550 0x7fab9c0bfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:59.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.740+0000 7faba0bdd640 1 --2- 10.20.193.5:0/1026867098 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fab9c0c7170 0x7fab9c0bf870 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:59.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.740+0000 7faba0bdd640 1 --2- 10.20.193.5:0/1026867098 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fab9c074ef0 0x7fab9c06d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:29:59.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.740+0000 7faba0bdd640 1 -- 10.20.193.5:0/1026867098 >> 10.20.193.5:0/1026867098 conn(0x7fab9c0c9f40 msgr2=0x7fab9c14ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:29:59.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.740+0000 7faba0bdd640 1 -- 10.20.193.5:0/1026867098 shutdown_connections 2026-02-17T21:29:59.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.740+0000 7faba0bdd640 1 -- 10.20.193.5:0/1026867098 wait complete. 2026-02-17T21:29:59.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:29:59.740+0000 7faba0bdd640 1 librados: shutdown 2026-02-17T21:30:02.752 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:30:02.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.820+0000 7fafbee99640 10 monclient: get_monmap_and_config 2026-02-17T21:30:02.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.820+0000 7fafbee99640 10 monclient: build_initial_monmap 2026-02-17T21:30:02.823 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.820+0000 7fafbee99640 10 monclient: monmap: 2026-02-17T21:30:02.823 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:02.823 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:02.823 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:02.821924+0000 2026-02-17T21:30:02.823 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:02.821924+0000 2026-02-17T21:30:02.824 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:02.824 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:02.824 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:02.824 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:02.824 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:02.824 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:02.824 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:02.825 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:02.825 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:02.825 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.820+0000 7fafbee99640 1 Processor -- start 2026-02-17T21:30:02.825 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.820+0000 7fafbee99640 1 -- start start 2026-02-17T21:30:02.825 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.820+0000 7fafbee99640 10 monclient: init 2026-02-17T21:30:02.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.821+0000 7fafbee99640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:02.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.821+0000 7fafbee99640 10 monclient: _add_conns ranks=[5,4,2,3,0,1] 2026-02-17T21:30:02.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.821+0000 7fafbee99640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fafb81536a0 0x7fafb80c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:02.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.821+0000 7fafbee99640 10 monclient(hunting): picked mon.noname-c con 0x7fafb81536a0 addr v2:10.20.193.135:3300/0 2026-02-17T21:30:02.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.821+0000 7fafbee99640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fafb815ad70 0x7fafb8153a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:02.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.821+0000 7fafbee99640 10 monclient(hunting): picked mon.noname-b con 0x7fafb815ad70 addr v2:10.20.193.119:3300/0 2026-02-17T21:30:02.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.821+0000 7fafbee99640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fafb81598f0 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:02.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.821+0000 7fafbee99640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafb815b1c0 con 0x7fafb81598f0 2026-02-17T21:30:02.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.821+0000 7fafbee99640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:02.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.821+0000 7fafbee99640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fafb80c7b70 con 0x7fafb815ad70 2026-02-17T21:30:02.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.821+0000 7fafbee99640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:02.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.821+0000 7fafbee99640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fafb8153fc0 con 0x7fafb81536a0 2026-02-17T21:30:02.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.821+0000 7fafbee99640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:02.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.821+0000 7fafbee99640 10 monclient(hunting): authenticate will time out at 1308.387308s 2026-02-17T21:30:02.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.821+0000 7fafbd696640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fafb815ad70 0x7fafb8153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:02.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.821+0000 7fafbde97640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fafb81536a0 0x7fafb80c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:02.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.821+0000 7fafbe698640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7fafb81598f0 0x7fafb80c4ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:52624/0 (socket says 10.20.193.5:52624) 2026-02-17T21:30:02.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.821+0000 7fafbe698640 1 -- 10.20.193.5:0/2214366042 learned_addr learned my addr 10.20.193.5:0/2214366042 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:02.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.822+0000 7fafbd696640 10 monclient(hunting): get_auth_request con 0x7fafb815ad70 auth_method 0 2026-02-17T21:30:02.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.822+0000 7fafbd696640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:02.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.822+0000 7fafbd696640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:02.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.822+0000 7fafbd696640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:02.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.822+0000 7fafbde97640 10 monclient(hunting): get_auth_request con 0x7fafb81536a0 auth_method 0 2026-02-17T21:30:02.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.822+0000 7fafbde97640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:02.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.822+0000 7fafbde97640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:02.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.822+0000 7fafbde97640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:02.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.822+0000 7fafbd696640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:02.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.822+0000 7fafbd696640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:02.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.822+0000 7fafbd696640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:02.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.822+0000 7fafbde97640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:02.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.822+0000 7fafbde97640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:02.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.822+0000 7fafbde97640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:02.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.823+0000 7fafbd696640 10 monclient(hunting): handle_auth_done global_id 5092 payload 274 2026-02-17T21:30:02.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.823+0000 7fafbd696640 1 -- 10.20.193.5:0/2214366042 >> v2:10.20.193.135:3300/0 conn(0x7fafb81536a0 msgr2=0x7fafb80c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:02.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.823+0000 7fafbd696640 1 --2- 10.20.193.5:0/2214366042 >> v2:10.20.193.135:3300/0 conn(0x7fafb81536a0 0x7fafb80c88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:02.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.823+0000 7fafbd696640 1 -- 10.20.193.5:0/2214366042 >> v1:10.20.193.135:6789/0 conn(0x7fafb81598f0 legacy=0x7fafb80c4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:02.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.823+0000 7fafbd696640 10 monclient: _finish_hunting 0 2026-02-17T21:30:02.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.823+0000 7fafbd696640 1 monclient: found mon.noname-b 2026-02-17T21:30:02.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.823+0000 7fafbd696640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:02.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.823+0000 7fafbd696640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:30:02.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.823+0000 7fafbd696640 1 -- 10.20.193.5:0/2214366042 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb815a100 con 0x7fafb815ad70 2026-02-17T21:30:02.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.824+0000 7fafbd696640 1 --2- 10.20.193.5:0/2214366042 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fafb815ad70 0x7fafb8153a80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fafb8070a30 tx=0x7fafac02ede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73c8b9cf2f1c61d8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:02.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.825+0000 7fafbce95640 1 -- 10.20.193.5:0/2214366042 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac03c070 con 0x7fafb815ad70 2026-02-17T21:30:02.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.825+0000 7fafbce95640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:02.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.825+0000 7fafbce95640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:30:02.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.825+0000 7fafbce95640 10 monclient: dump: 2026-02-17T21:30:02.836 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:02.836 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:02.836 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:02.836 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:02.836 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:02.836 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:02.836 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:02.836 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:02.836 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:02.836 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:02.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.825+0000 7fafbce95640 10 monclient: _finish_auth 0 2026-02-17T21:30:02.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.825+0000 7fafbce95640 10 monclient: _check_auth_tickets 2026-02-17T21:30:02.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.825+0000 7fafbce95640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:02.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.825+0000 7fafbce95640 1 -- 10.20.193.5:0/2214366042 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafac02faf0 con 0x7fafb815ad70 2026-02-17T21:30:02.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.826+0000 7fafbce95640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:02.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.826+0000 7fafbce95640 1 -- 10.20.193.5:0/2214366042 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac037440 con 0x7fafb815ad70 2026-02-17T21:30:02.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.826+0000 7fafbee99640 5 monclient: authenticate success, global_id 5092 2026-02-17T21:30:02.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.826+0000 7fafbce95640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:02.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.826+0000 7fafbce95640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:30:02.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.826+0000 7fafbce95640 10 monclient: dump: 2026-02-17T21:30:02.837 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:02.837 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:02.837 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:02.837 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:02.838 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:02.838 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:02.838 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:02.838 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:02.838 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:02.838 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:02.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.826+0000 7fafbee99640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:02.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.826+0000 7fafbee99640 4 set_mon_vals no callback set 2026-02-17T21:30:02.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.826+0000 7fafbee99640 10 monclient: shutdown 2026-02-17T21:30:02.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.826+0000 7fafbee99640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:02.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.826+0000 7fafbee99640 1 -- 10.20.193.5:0/2214366042 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fafb815ad70 msgr2=0x7fafb8153a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:02.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.826+0000 7fafbee99640 1 --2- 10.20.193.5:0/2214366042 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fafb815ad70 0x7fafb8153a80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fafb8070a30 tx=0x7fafac02ede0 comp rx=0 tx=0).stop 2026-02-17T21:30:02.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.826+0000 7fafbee99640 1 -- 10.20.193.5:0/2214366042 shutdown_connections 2026-02-17T21:30:02.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.826+0000 7fafbee99640 1 --2- 10.20.193.5:0/2214366042 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fafb815ad70 0x7fafb8153a80 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:02.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.826+0000 7fafbee99640 1 --2- 10.20.193.5:0/2214366042 >> v2:10.20.193.135:3300/0 conn(0x7fafb81536a0 0x7fafb80c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:02.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.826+0000 7fafbee99640 1 -- 10.20.193.5:0/2214366042 >> 10.20.193.5:0/2214366042 conn(0x7fafb80cd5e0 msgr2=0x7fafb80cd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:02.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.826+0000 7fafbee99640 1 -- 10.20.193.5:0/2214366042 shutdown_connections 2026-02-17T21:30:02.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.826+0000 7fafbee99640 1 -- 10.20.193.5:0/2214366042 wait complete. 2026-02-17T21:30:02.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.827+0000 7fafbee99640 10 monclient: build_initial_monmap 2026-02-17T21:30:02.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.827+0000 7fafbee99640 10 monclient: monmap: 2026-02-17T21:30:02.839 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:02.839 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:02.839 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:02.839 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:02.840 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:02.840 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:02.840 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:02.840 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:02.840 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:02.840 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:02.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.827+0000 7fafbee99640 1 librados: starting msgr at 2026-02-17T21:30:02.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.827+0000 7fafbee99640 1 librados: starting objecter 2026-02-17T21:30:02.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.827+0000 7fafbee99640 1 Processor -- start 2026-02-17T21:30:02.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.827+0000 7fafbee99640 1 -- start start 2026-02-17T21:30:02.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.827+0000 7fafbee99640 1 librados: setting wanted keys 2026-02-17T21:30:02.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.827+0000 7fafbee99640 1 librados: calling monclient init 2026-02-17T21:30:02.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.827+0000 7fafbee99640 10 monclient: init 2026-02-17T21:30:02.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.827+0000 7fafbee99640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:02.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.827+0000 7fafbee99640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:30:02.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.827+0000 7fafbee99640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fafb81536a0 0x7fafb806ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:02.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.827+0000 7fafbee99640 10 monclient(hunting): picked mon.noname-a con 0x7fafb81536a0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:02.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.827+0000 7fafbee99640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fafb81598f0 0x7fafb81f6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:02.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.827+0000 7fafbee99640 10 monclient(hunting): picked mon.noname-b con 0x7fafb81598f0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:02.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.827+0000 7fafbee99640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fafb815ad70 0x7fafb8147890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:02.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.827+0000 7fafbee99640 10 monclient(hunting): picked mon.noname-c con 0x7fafb815ad70 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:02.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.827+0000 7fafbee99640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:02.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.827+0000 7fafbee99640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fafb80c7dc0 con 0x7fafb81536a0 2026-02-17T21:30:02.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.827+0000 7fafbee99640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:02.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.827+0000 7fafbee99640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fafb815a6c0 con 0x7fafb81598f0 2026-02-17T21:30:02.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.827+0000 7fafbee99640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:02.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.827+0000 7fafbee99640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fafb80c80a0 con 0x7fafb815ad70 2026-02-17T21:30:02.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.827+0000 7fafbee99640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:02.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.827+0000 7fafbee99640 10 monclient(hunting): authenticate will time out at 1308.393925s 2026-02-17T21:30:02.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.828+0000 7fafbd696640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fafb81598f0 0x7fafb81f6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:02.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.828+0000 7fafbe698640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fafb815ad70 0x7fafb8147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:02.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.828+0000 7fafbd696640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fafb81598f0 0x7fafb81f6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:50956/0 (socket says 10.20.193.5:50956) 2026-02-17T21:30:02.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.828+0000 7fafbd696640 1 -- 10.20.193.5:0/2291573912 learned_addr learned my addr 10.20.193.5:0/2291573912 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:02.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.828+0000 7fafbd696640 10 monclient(hunting): get_auth_request con 0x7fafb81598f0 auth_method 0 2026-02-17T21:30:02.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.828+0000 7fafbd696640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:02.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.828+0000 7fafbd696640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:02.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.828+0000 7fafbd696640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:02.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.828+0000 7fafbe698640 10 monclient(hunting): get_auth_request con 0x7fafb815ad70 auth_method 0 2026-02-17T21:30:02.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.828+0000 7fafbe698640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:02.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.828+0000 7fafbe698640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:02.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.828+0000 7fafbe698640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:02.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.829+0000 7fafbe698640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:02.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.829+0000 7fafbe698640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:02.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.829+0000 7fafbe698640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:02.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.829+0000 7fafbde97640 1 --2- 10.20.193.5:0/2291573912 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fafb81536a0 0x7fafb806ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:02.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.829+0000 7fafbd696640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:02.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.829+0000 7fafbd696640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:02.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.829+0000 7fafbd696640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:02.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.829+0000 7fafbde97640 10 monclient(hunting): get_auth_request con 0x7fafb81536a0 auth_method 0 2026-02-17T21:30:02.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.829+0000 7fafbde97640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:02.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.829+0000 7fafbde97640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:02.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.829+0000 7fafbde97640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:02.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.830+0000 7fafbde97640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:02.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.830+0000 7fafbde97640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:02.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.830+0000 7fafbde97640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:02.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.830+0000 7fafbe698640 10 monclient(hunting): handle_auth_done global_id 5078 payload 824 2026-02-17T21:30:02.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.830+0000 7fafbe698640 1 -- 10.20.193.5:0/2291573912 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fafb81598f0 msgr2=0x7fafb81f6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:02.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.830+0000 7fafbe698640 1 --2- 10.20.193.5:0/2291573912 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fafb81598f0 0x7fafb81f6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:02.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.830+0000 7fafbe698640 1 -- 10.20.193.5:0/2291573912 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fafb81536a0 msgr2=0x7fafb806ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:02.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.830+0000 7fafbe698640 1 --2- 10.20.193.5:0/2291573912 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fafb81536a0 0x7fafb806ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:02.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.830+0000 7fafbe698640 10 monclient: _finish_hunting 0 2026-02-17T21:30:02.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.830+0000 7fafbe698640 1 monclient: found mon.noname-c 2026-02-17T21:30:02.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.830+0000 7fafbe698640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:02.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.830+0000 7fafbe698640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:02.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.830+0000 7fafbe698640 1 -- 10.20.193.5:0/2291573912 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb81f3650 con 0x7fafb815ad70 2026-02-17T21:30:02.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.831+0000 7fafbe698640 1 --2- 10.20.193.5:0/2291573912 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fafb815ad70 0x7fafb8147890 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fafb400caa0 tx=0x7fafb400cf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:02.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.831+0000 7fafa67fc640 10 client.?.objecter ms_handle_connect 0x7fafb815ad70 2026-02-17T21:30:02.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.831+0000 7fafa67fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:02.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafa67fc640 1 -- 10.20.193.5:0/2291573912 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb4017070 con 0x7fafb815ad70 2026-02-17T21:30:02.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafa67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:02.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafa67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:02.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafa67fc640 10 monclient: dump: 2026-02-17T21:30:02.849 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:02.849 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:02.849 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:02.849 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:02.849 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:02.849 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:02.849 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:02.849 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:02.849 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:02.849 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:02.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafa67fc640 10 monclient: _finish_auth 0 2026-02-17T21:30:02.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafa67fc640 10 monclient: _check_auth_tickets 2026-02-17T21:30:02.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafa67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:02.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafa67fc640 1 -- 10.20.193.5:0/2291573912 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb400ab40 con 0x7fafb815ad70 2026-02-17T21:30:02.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafa67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:02.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafa67fc640 1 -- 10.20.193.5:0/2291573912 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb4012400 con 0x7fafb815ad70 2026-02-17T21:30:02.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafa67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:02.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafa67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:02.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafa7fff640 4 set_mon_vals no callback set 2026-02-17T21:30:02.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafa67fc640 10 monclient: dump: 2026-02-17T21:30:02.850 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:02.850 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:02.851 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:02.851 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:02.851 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:02.851 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:02.851 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:02.851 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:02.851 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:02.851 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:02.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafbee99640 5 monclient: authenticate success, global_id 5078 2026-02-17T21:30:02.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafbee99640 10 monclient: _renew_subs 2026-02-17T21:30:02.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafbee99640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:02.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafbee99640 1 -- 10.20.193.5:0/2291573912 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb81f7090 con 0x7fafb815ad70 2026-02-17T21:30:02.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafbee99640 10 client.5078.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:02.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafbee99640 10 monclient: _renew_subs 2026-02-17T21:30:02.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafbee99640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:02.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafbee99640 1 -- 10.20.193.5:0/2291573912 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb81f7640 con 0x7fafb815ad70 2026-02-17T21:30:02.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafbee99640 1 librados: init done 2026-02-17T21:30:02.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafbee99640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:02.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafbee99640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:02.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafbee99640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:02.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.834+0000 7fafbee99640 1 -- 10.20.193.5:0/2291573912 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb80c8380 con 0x7fafb815ad70 2026-02-17T21:30:02.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.845+0000 7fafa67fc640 1 -- 10.20.193.5:0/2291573912 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fafb401b3b0 con 0x7fafb815ad70 2026-02-17T21:30:02.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.846+0000 7fafa67fc640 1 --2- 10.20.193.5:0/2291573912 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7faf88079280 0x7faf8807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:02.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.846+0000 7fafbde97640 1 --2- 10.20.193.5:0/2291573912 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7faf88079280 0x7faf8807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:02.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.846+0000 7fafbde97640 10 monclient: get_auth_request con 0x7faf88079280 auth_method 0 2026-02-17T21:30:02.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.847+0000 7fafa67fc640 10 client.5078.objecter ms_handle_connect 0x7faf88079280 2026-02-17T21:30:02.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.847+0000 7fafbde97640 1 --2- 10.20.193.5:0/2291573912 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7faf88079280 0x7faf8807b740 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fafa8009ba0 tx=0x7fafa8009290 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:02.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.939+0000 7fafa67fc640 1 -- 10.20.193.5:0/2291573912 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fafb405df90 con 0x7fafb815ad70 2026-02-17T21:30:02.942 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.939+0000 7fafa67fc640 10 client.5078.objecter ms_dispatch2 0x7fafb8000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:02.942 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.939+0000 7fafa67fc640 3 client.5078.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:02.942 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.939+0000 7fafa67fc640 3 client.5078.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:02.942 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.939+0000 7fafa67fc640 20 client.5078.objecter dump_active .. 0 homeless 2026-02-17T21:30:02.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.946+0000 7fafa67fc640 1 -- 10.20.193.5:0/2291573912 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fafb4021020 con 0x7fafb815ad70 2026-02-17T21:30:02.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.946+0000 7fafa67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:02.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:02.946+0000 7fafa67fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:03.047 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.045+0000 7fafbee99640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:30:03.048 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.045+0000 7fafbee99640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:03.048 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.045+0000 7fafbee99640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:03.048 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.045+0000 7fafbee99640 1 -- 10.20.193.5:0/2291573912 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fafb80c58f0 con 0x7fafb815ad70 2026-02-17T21:30:03.049 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.048+0000 7fafa67fc640 1 -- 10.20.193.5:0/2291573912 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fafb4061f50 con 0x7fafb815ad70 2026-02-17T21:30:03.049 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.048+0000 7fafa67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:03.050 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.048+0000 7fafa67fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:30:03.050 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:30:03.050 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:30:03.051 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.048+0000 7fafbee99640 10 librados: watch_flush enter 2026-02-17T21:30:03.052 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.048+0000 7fafbee99640 10 librados: watch_flush exit 2026-02-17T21:30:03.052 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.048+0000 7fafbee99640 20 client.5078.objecter shutdown clearing up homeless session... 2026-02-17T21:30:03.052 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.048+0000 7fafbee99640 10 client.5078.objecter successfully canceled tick 2026-02-17T21:30:03.052 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.048+0000 7fafbee99640 1 -- 10.20.193.5:0/2291573912 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7faf88079280 msgr2=0x7faf8807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:03.052 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.048+0000 7fafbee99640 1 --2- 10.20.193.5:0/2291573912 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7faf88079280 0x7faf8807b740 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fafa8009ba0 tx=0x7fafa8009290 comp rx=0 tx=0).stop 2026-02-17T21:30:03.052 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.048+0000 7fafbee99640 10 monclient: shutdown 2026-02-17T21:30:03.052 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.048+0000 7fafbee99640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:03.052 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.048+0000 7fafbee99640 1 -- 10.20.193.5:0/2291573912 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fafb815ad70 msgr2=0x7fafb8147890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:03.052 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.048+0000 7fafbee99640 1 --2- 10.20.193.5:0/2291573912 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fafb815ad70 0x7fafb8147890 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fafb400caa0 tx=0x7fafb400cf70 comp rx=0 tx=0).stop 2026-02-17T21:30:03.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.048+0000 7fafbee99640 1 -- 10.20.193.5:0/2291573912 shutdown_connections 2026-02-17T21:30:03.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.048+0000 7fafbee99640 1 --2- 10.20.193.5:0/2291573912 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7faf88079280 0x7faf8807b740 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:03.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.048+0000 7fafbee99640 1 --2- 10.20.193.5:0/2291573912 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fafb815ad70 0x7fafb8147890 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:03.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.048+0000 7fafbee99640 1 --2- 10.20.193.5:0/2291573912 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fafb81598f0 0x7fafb81f6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:03.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.048+0000 7fafbee99640 1 --2- 10.20.193.5:0/2291573912 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fafb81536a0 0x7fafb806ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:03.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.048+0000 7fafbee99640 1 -- 10.20.193.5:0/2291573912 >> 10.20.193.5:0/2291573912 conn(0x7fafb80cd5e0 msgr2=0x7fafb806b600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:03.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.048+0000 7fafbee99640 1 -- 10.20.193.5:0/2291573912 shutdown_connections 2026-02-17T21:30:03.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.048+0000 7fafbee99640 1 -- 10.20.193.5:0/2291573912 wait complete. 2026-02-17T21:30:03.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:03.048+0000 7fafbee99640 1 librados: shutdown 2026-02-17T21:30:06.061 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:30:06.131 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.128+0000 7f7e561d3640 10 monclient: get_monmap_and_config 2026-02-17T21:30:06.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.128+0000 7f7e561d3640 10 monclient: build_initial_monmap 2026-02-17T21:30:06.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.128+0000 7f7e561d3640 10 monclient: monmap: 2026-02-17T21:30:06.132 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:06.132 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:06.132 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:06.130019+0000 2026-02-17T21:30:06.132 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:06.130019+0000 2026-02-17T21:30:06.132 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:06.132 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:06.133 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:06.133 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:06.133 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:06.133 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:06.133 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:06.133 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:06.133 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:06.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.128+0000 7f7e561d3640 1 Processor -- start 2026-02-17T21:30:06.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.128+0000 7f7e561d3640 1 -- start start 2026-02-17T21:30:06.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.128+0000 7f7e561d3640 10 monclient: init 2026-02-17T21:30:06.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.129+0000 7f7e561d3640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:06.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.129+0000 7f7e561d3640 10 monclient: _add_conns ranks=[2,1,5,4,0,3] 2026-02-17T21:30:06.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.129+0000 7f7e561d3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7e5015d370 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:06.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.129+0000 7f7e561d3640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f7e500c7e20 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:06.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.129+0000 7f7e561d3640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f7e500c59c0 0x7f7e5015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:06.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.129+0000 7f7e561d3640 10 monclient(hunting): picked mon.noname-c con 0x7f7e500c59c0 addr v2:10.20.193.135:3300/0 2026-02-17T21:30:06.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.129+0000 7f7e561d3640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e500c8350 con 0x7f7e500c7e20 2026-02-17T21:30:06.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.129+0000 7f7e561d3640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e500c8630 con 0x7f7e5015d370 2026-02-17T21:30:06.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.129+0000 7f7e561d3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:06.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.129+0000 7f7e561d3640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f7e5015b710 con 0x7f7e500c59c0 2026-02-17T21:30:06.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.129+0000 7f7e561d3640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:06.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.129+0000 7f7e561d3640 10 monclient(hunting): authenticate will time out at 1311.695292s 2026-02-17T21:30:06.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.129+0000 7f7e4effd640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f7e500c7e20 0x7f7e500c52b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:39042/0 (socket says 10.20.193.5:39042) 2026-02-17T21:30:06.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.129+0000 7f7e4effd640 1 -- 10.20.193.5:0/1658310159 learned_addr learned my addr 10.20.193.5:0/1658310159 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:06.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.129+0000 7f7e4ffff640 1 --2- 10.20.193.5:0/1658310159 >> v2:10.20.193.135:3300/0 conn(0x7f7e500c59c0 0x7f7e5015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:06.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.130+0000 7f7e4ffff640 10 monclient(hunting): get_auth_request con 0x7f7e500c59c0 auth_method 0 2026-02-17T21:30:06.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.130+0000 7f7e4ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:06.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.130+0000 7f7e4ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:06.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.130+0000 7f7e4ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:06.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.130+0000 7f7e4ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:06.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.130+0000 7f7e4ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:06.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.130+0000 7f7e4ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:06.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.131+0000 7f7e4e7fc640 1 -- 10.20.193.5:0/1658310159 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1216995966 0 0) 0x7f7e500c8350 con 0x7f7e500c7e20 2026-02-17T21:30:06.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.131+0000 7f7e4e7fc640 10 monclient(hunting): _negotiate 2026-02-17T21:30:06.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.131+0000 7f7e4e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:06.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.131+0000 7f7e4e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:06.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.131+0000 7f7e4e7fc640 10 monclient(hunting): my global_id is 5098 2026-02-17T21:30:06.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.131+0000 7f7e4e7fc640 1 -- 10.20.193.5:0/1658310159 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e34003620 con 0x7f7e500c7e20 2026-02-17T21:30:06.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.131+0000 7f7e4ffff640 10 monclient(hunting): handle_auth_done global_id 5081 payload 274 2026-02-17T21:30:06.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.131+0000 7f7e4ffff640 1 -- 10.20.193.5:0/1658310159 >> v1:10.20.193.135:6789/0 conn(0x7f7e5015d370 legacy=0x7f7e5015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:06.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.131+0000 7f7e4ffff640 1 -- 10.20.193.5:0/1658310159 >> v1:10.20.193.119:6789/0 conn(0x7f7e500c7e20 legacy=0x7f7e500c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:06.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.131+0000 7f7e4ffff640 10 monclient: _finish_hunting 0 2026-02-17T21:30:06.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.131+0000 7f7e4ffff640 1 monclient: found mon.noname-c 2026-02-17T21:30:06.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.131+0000 7f7e4ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:06.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.131+0000 7f7e4ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:06.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.131+0000 7f7e4ffff640 1 -- 10.20.193.5:0/1658310159 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e500c8910 con 0x7f7e500c59c0 2026-02-17T21:30:06.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.134+0000 7f7e4ffff640 1 --2- 10.20.193.5:0/1658310159 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7e500c59c0 0x7f7e5015d750 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009d90 tx=0x7f7e4402f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13efd30b7c5239ed server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:06.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.136+0000 7f7e4e7fc640 1 -- 10.20.193.5:0/1658310159 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4403c070 con 0x7f7e500c59c0 2026-02-17T21:30:06.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.136+0000 7f7e4e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:06.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.136+0000 7f7e4e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:06.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.136+0000 7f7e4e7fc640 10 monclient: dump: 2026-02-17T21:30:06.147 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:06.147 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:06.147 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:06.147 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:06.148 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:06.148 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:06.148 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:06.148 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:06.148 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:06.148 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:06.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.136+0000 7f7e4e7fc640 10 monclient: _finish_auth 0 2026-02-17T21:30:06.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.136+0000 7f7e4e7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:30:06.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.136+0000 7f7e4e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:06.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.136+0000 7f7e4e7fc640 1 -- 10.20.193.5:0/1658310159 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e44037440 con 0x7f7e500c59c0 2026-02-17T21:30:06.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.136+0000 7f7e4e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:06.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.136+0000 7f7e561d3640 5 monclient: authenticate success, global_id 5081 2026-02-17T21:30:06.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.136+0000 7f7e4e7fc640 1 -- 10.20.193.5:0/1658310159 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e44037810 con 0x7f7e500c59c0 2026-02-17T21:30:06.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.136+0000 7f7e561d3640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:06.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.136+0000 7f7e4e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:06.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.136+0000 7f7e561d3640 4 set_mon_vals no callback set 2026-02-17T21:30:06.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.136+0000 7f7e4e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:06.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.136+0000 7f7e4e7fc640 10 monclient: dump: 2026-02-17T21:30:06.150 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:06.150 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:06.151 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:06.151 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:06.151 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:06.151 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:06.151 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:06.151 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:06.152 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:06.152 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:06.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.136+0000 7f7e561d3640 10 monclient: shutdown 2026-02-17T21:30:06.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.136+0000 7f7e561d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:06.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.136+0000 7f7e561d3640 1 -- 10.20.193.5:0/1658310159 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7e500c59c0 msgr2=0x7f7e5015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:06.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.136+0000 7f7e561d3640 1 --2- 10.20.193.5:0/1658310159 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7e500c59c0 0x7f7e5015d750 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009d90 tx=0x7f7e4402f230 comp rx=0 tx=0).stop 2026-02-17T21:30:06.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.136+0000 7f7e561d3640 1 -- 10.20.193.5:0/1658310159 shutdown_connections 2026-02-17T21:30:06.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.136+0000 7f7e561d3640 1 --2- 10.20.193.5:0/1658310159 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7e500c59c0 0x7f7e5015d750 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:06.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.136+0000 7f7e561d3640 1 -- 10.20.193.5:0/1658310159 >> 10.20.193.5:0/1658310159 conn(0x7f7e500c9f20 msgr2=0x7f7e500ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:06.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.136+0000 7f7e561d3640 1 -- 10.20.193.5:0/1658310159 shutdown_connections 2026-02-17T21:30:06.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.136+0000 7f7e561d3640 1 -- 10.20.193.5:0/1658310159 wait complete. 2026-02-17T21:30:06.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.137+0000 7f7e561d3640 10 monclient: build_initial_monmap 2026-02-17T21:30:06.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.137+0000 7f7e561d3640 10 monclient: monmap: 2026-02-17T21:30:06.153 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:06.154 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:06.154 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:06.154 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:06.154 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:06.154 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:06.154 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:06.154 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:06.155 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:06.155 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:06.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.137+0000 7f7e561d3640 1 librados: starting msgr at 2026-02-17T21:30:06.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.137+0000 7f7e561d3640 1 librados: starting objecter 2026-02-17T21:30:06.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.137+0000 7f7e561d3640 1 Processor -- start 2026-02-17T21:30:06.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.137+0000 7f7e561d3640 1 -- start start 2026-02-17T21:30:06.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.137+0000 7f7e561d3640 1 librados: setting wanted keys 2026-02-17T21:30:06.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.137+0000 7f7e561d3640 1 librados: calling monclient init 2026-02-17T21:30:06.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.137+0000 7f7e561d3640 10 monclient: init 2026-02-17T21:30:06.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e561d3640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:06.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e561d3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:30:06.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e561d3640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7e500c59c0 0x7f7e5014a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:06.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e561d3640 10 monclient(hunting): picked mon.noname-c con 0x7f7e500c59c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:06.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e561d3640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7e500c7e20 0x7f7e501f3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:06.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e561d3640 10 monclient(hunting): picked mon.noname-a con 0x7f7e500c7e20 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:06.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e561d3640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7e5015d370 0x7f7e501f4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:06.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e561d3640 10 monclient(hunting): picked mon.noname-b con 0x7f7e5015d370 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:06.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e561d3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:06.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e561d3640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7e500c8ed0 con 0x7f7e500c7e20 2026-02-17T21:30:06.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e561d3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:06.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e561d3640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7e500c9240 con 0x7f7e5015d370 2026-02-17T21:30:06.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e561d3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:06.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e561d3640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7e500c96d0 con 0x7f7e500c59c0 2026-02-17T21:30:06.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e561d3640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:06.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e561d3640 10 monclient(hunting): authenticate will time out at 1311.704166s 2026-02-17T21:30:06.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e4f7fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7e500c59c0 0x7f7e5014a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:06.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e4ffff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7e5015d370 0x7f7e501f4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:06.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e4effd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7e500c7e20 0x7f7e501f3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:06.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e4f7fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7e500c59c0 0x7f7e5014a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:34636/0 (socket says 10.20.193.5:34636) 2026-02-17T21:30:06.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e4f7fe640 1 -- 10.20.193.5:0/1457783287 learned_addr learned my addr 10.20.193.5:0/1457783287 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:06.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e4f7fe640 10 monclient(hunting): get_auth_request con 0x7f7e500c59c0 auth_method 0 2026-02-17T21:30:06.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e4f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:06.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e4f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:06.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e4f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:06.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e4ffff640 10 monclient(hunting): get_auth_request con 0x7f7e5015d370 auth_method 0 2026-02-17T21:30:06.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e4ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:06.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e4ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:06.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e4ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:06.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e4f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:06.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e4f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:06.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e4f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:06.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e4effd640 10 monclient(hunting): get_auth_request con 0x7f7e500c7e20 auth_method 0 2026-02-17T21:30:06.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e4effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:06.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e4effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:06.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.138+0000 7f7e4effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:06.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.139+0000 7f7e4ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:06.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.139+0000 7f7e4ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:06.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.139+0000 7f7e4ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:06.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.139+0000 7f7e4effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:06.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.139+0000 7f7e4effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:06.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.139+0000 7f7e4effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:06.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.140+0000 7f7e4f7fe640 10 monclient(hunting): handle_auth_done global_id 5087 payload 824 2026-02-17T21:30:06.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.140+0000 7f7e4f7fe640 1 -- 10.20.193.5:0/1457783287 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7e5015d370 msgr2=0x7f7e501f4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:06.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.140+0000 7f7e4f7fe640 1 --2- 10.20.193.5:0/1457783287 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7e5015d370 0x7f7e501f4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:06.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.140+0000 7f7e4f7fe640 1 -- 10.20.193.5:0/1457783287 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7e500c7e20 msgr2=0x7f7e501f3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:06.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.140+0000 7f7e4f7fe640 1 --2- 10.20.193.5:0/1457783287 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7e500c7e20 0x7f7e501f3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:06.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.140+0000 7f7e4f7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:30:06.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.140+0000 7f7e4f7fe640 1 monclient: found mon.noname-c 2026-02-17T21:30:06.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.140+0000 7f7e4f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:06.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.140+0000 7f7e4f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:06.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.140+0000 7f7e4f7fe640 1 -- 10.20.193.5:0/1457783287 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e501492b0 con 0x7f7e500c59c0 2026-02-17T21:30:06.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.141+0000 7f7e4f7fe640 1 --2- 10.20.193.5:0/1457783287 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7e500c59c0 0x7f7e5014a630 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00c700 tx=0x7f7e3c00cbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:06.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.141+0000 7f7e2bfff640 10 client.?.objecter ms_handle_connect 0x7f7e500c59c0 2026-02-17T21:30:06.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.141+0000 7f7e2bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:06.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.142+0000 7f7e2bfff640 1 -- 10.20.193.5:0/1457783287 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c0052d0 con 0x7f7e500c59c0 2026-02-17T21:30:06.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.142+0000 7f7e2bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:06.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.142+0000 7f7e2bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:06.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.142+0000 7f7e2bfff640 10 monclient: dump: 2026-02-17T21:30:06.164 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:06.164 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:06.164 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:06.164 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:06.164 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:06.164 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:06.165 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:06.165 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:06.165 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:06.165 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:06.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.142+0000 7f7e2bfff640 10 monclient: _finish_auth 0 2026-02-17T21:30:06.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.142+0000 7f7e2bfff640 10 monclient: _check_auth_tickets 2026-02-17T21:30:06.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.142+0000 7f7e2bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:06.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.142+0000 7f7e561d3640 5 monclient: authenticate success, global_id 5087 2026-02-17T21:30:06.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.142+0000 7f7e561d3640 10 monclient: _renew_subs 2026-02-17T21:30:06.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.142+0000 7f7e561d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:06.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.142+0000 7f7e561d3640 1 -- 10.20.193.5:0/1457783287 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e50149590 con 0x7f7e500c59c0 2026-02-17T21:30:06.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.142+0000 7f7e561d3640 10 client.5087.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:06.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.142+0000 7f7e561d3640 10 monclient: _renew_subs 2026-02-17T21:30:06.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.142+0000 7f7e561d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:06.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.142+0000 7f7e561d3640 1 -- 10.20.193.5:0/1457783287 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e50149b50 con 0x7f7e500c59c0 2026-02-17T21:30:06.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.142+0000 7f7e561d3640 1 librados: init done 2026-02-17T21:30:06.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.142+0000 7f7e2bfff640 1 -- 10.20.193.5:0/1457783287 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e3c005470 con 0x7f7e500c59c0 2026-02-17T21:30:06.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.142+0000 7f7e2bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:06.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.142+0000 7f7e2bfff640 1 -- 10.20.193.5:0/1457783287 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c0038b0 con 0x7f7e500c59c0 2026-02-17T21:30:06.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.142+0000 7f7e2bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:06.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.142+0000 7f7e2bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:06.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.142+0000 7f7e4dffb640 4 set_mon_vals no callback set 2026-02-17T21:30:06.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.142+0000 7f7e2bfff640 10 monclient: dump: 2026-02-17T21:30:06.168 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:06.168 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:06.168 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:06.168 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:06.168 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:06.168 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:06.168 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:06.169 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:06.169 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:06.169 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:06.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.142+0000 7f7e561d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:06.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.143+0000 7f7e561d3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:06.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.143+0000 7f7e561d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:06.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.143+0000 7f7e561d3640 1 -- 10.20.193.5:0/1457783287 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e5015d750 con 0x7f7e500c59c0 2026-02-17T21:30:06.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.154+0000 7f7e2bfff640 1 -- 10.20.193.5:0/1457783287 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f7e3c003a50 con 0x7f7e500c59c0 2026-02-17T21:30:06.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.154+0000 7f7e2bfff640 1 --2- 10.20.193.5:0/1457783287 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7e200792b0 0x7f7e2007b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:06.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.154+0000 7f7e4effd640 1 --2- 10.20.193.5:0/1457783287 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7e200792b0 0x7f7e2007b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:06.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.154+0000 7f7e4effd640 10 monclient: get_auth_request con 0x7f7e200792b0 auth_method 0 2026-02-17T21:30:06.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.155+0000 7f7e2bfff640 10 client.5087.objecter ms_handle_connect 0x7f7e200792b0 2026-02-17T21:30:06.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.155+0000 7f7e4effd640 1 --2- 10.20.193.5:0/1457783287 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7e200792b0 0x7f7e2007b770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7e500c45c0 tx=0x7f7e40007dd0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:06.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.155+0000 7f7e2bfff640 1 -- 10.20.193.5:0/1457783287 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f7e3c05e450 con 0x7f7e500c59c0 2026-02-17T21:30:06.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.155+0000 7f7e2bfff640 10 client.5087.objecter ms_dispatch2 0x7f7e50000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:06.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.155+0000 7f7e2bfff640 3 client.5087.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:06.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.155+0000 7f7e2bfff640 3 client.5087.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:06.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.155+0000 7f7e2bfff640 20 client.5087.objecter dump_active .. 0 homeless 2026-02-17T21:30:06.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.256+0000 7f7e2bfff640 1 -- 10.20.193.5:0/1457783287 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7e3c062410 con 0x7f7e500c59c0 2026-02-17T21:30:06.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.256+0000 7f7e2bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:06.258 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.256+0000 7f7e2bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:06.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.358+0000 7f7e561d3640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:30:06.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.358+0000 7f7e561d3640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:06.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.358+0000 7f7e561d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:06.361 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.358+0000 7f7e561d3640 1 -- 10.20.193.5:0/1457783287 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7e5015b430 con 0x7f7e500c59c0 2026-02-17T21:30:06.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.361+0000 7f7e2bfff640 1 -- 10.20.193.5:0/1457783287 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f7e3c066710 con 0x7f7e500c59c0 2026-02-17T21:30:06.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.361+0000 7f7e2bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:06.363 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.361+0000 7f7e2bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:30:06.363 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:30:06.363 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:30:06.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.361+0000 7f7e561d3640 10 librados: watch_flush enter 2026-02-17T21:30:06.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.361+0000 7f7e561d3640 10 librados: watch_flush exit 2026-02-17T21:30:06.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.361+0000 7f7e561d3640 20 client.5087.objecter shutdown clearing up homeless session... 2026-02-17T21:30:06.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.361+0000 7f7e561d3640 10 client.5087.objecter successfully canceled tick 2026-02-17T21:30:06.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.362+0000 7f7e561d3640 1 -- 10.20.193.5:0/1457783287 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7e200792b0 msgr2=0x7f7e2007b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:06.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.362+0000 7f7e561d3640 1 --2- 10.20.193.5:0/1457783287 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7e200792b0 0x7f7e2007b770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7e500c45c0 tx=0x7f7e40007dd0 comp rx=0 tx=0).stop 2026-02-17T21:30:06.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.362+0000 7f7e561d3640 10 monclient: shutdown 2026-02-17T21:30:06.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.362+0000 7f7e561d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:06.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.362+0000 7f7e561d3640 1 -- 10.20.193.5:0/1457783287 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7e500c59c0 msgr2=0x7f7e5014a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:06.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.362+0000 7f7e561d3640 1 --2- 10.20.193.5:0/1457783287 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7e500c59c0 0x7f7e5014a630 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00c700 tx=0x7f7e3c00cbd0 comp rx=0 tx=0).stop 2026-02-17T21:30:06.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.362+0000 7f7e561d3640 1 -- 10.20.193.5:0/1457783287 shutdown_connections 2026-02-17T21:30:06.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.362+0000 7f7e561d3640 1 --2- 10.20.193.5:0/1457783287 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f7e200792b0 0x7f7e2007b770 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:06.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.362+0000 7f7e561d3640 1 --2- 10.20.193.5:0/1457783287 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7e5015d370 0x7f7e501f4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:06.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.362+0000 7f7e561d3640 1 --2- 10.20.193.5:0/1457783287 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f7e500c7e20 0x7f7e501f3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:06.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.362+0000 7f7e561d3640 1 --2- 10.20.193.5:0/1457783287 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f7e500c59c0 0x7f7e5014a630 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:06.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.362+0000 7f7e561d3640 1 -- 10.20.193.5:0/1457783287 >> 10.20.193.5:0/1457783287 conn(0x7f7e500c9f20 msgr2=0x7f7e50150f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:06.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.362+0000 7f7e561d3640 1 -- 10.20.193.5:0/1457783287 shutdown_connections 2026-02-17T21:30:06.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.362+0000 7f7e561d3640 1 -- 10.20.193.5:0/1457783287 wait complete. 2026-02-17T21:30:06.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:06.362+0000 7f7e561d3640 1 librados: shutdown 2026-02-17T21:30:09.374 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:30:09.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.441+0000 7f03ab8da640 10 monclient: get_monmap_and_config 2026-02-17T21:30:09.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.441+0000 7f03ab8da640 10 monclient: build_initial_monmap 2026-02-17T21:30:09.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.441+0000 7f03ab8da640 10 monclient: monmap: 2026-02-17T21:30:09.443 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:09.443 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:09.443 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:09.442190+0000 2026-02-17T21:30:09.444 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:09.442190+0000 2026-02-17T21:30:09.444 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:09.444 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:09.444 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:09.444 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:09.444 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:09.444 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:09.444 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:09.444 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:09.444 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:09.444 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.441+0000 7f03ab8da640 1 Processor -- start 2026-02-17T21:30:09.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.441+0000 7f03ab8da640 1 -- start start 2026-02-17T21:30:09.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.441+0000 7f03ab8da640 10 monclient: init 2026-02-17T21:30:09.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.442+0000 7f03ab8da640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:09.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.442+0000 7f03ab8da640 10 monclient: _add_conns ranks=[1,3,5,4,2,0] 2026-02-17T21:30:09.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.442+0000 7f03ab8da640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f03a40c7170 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:09.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.442+0000 7f03ab8da640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f03a40c7550 0x7f03a40749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:09.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.442+0000 7f03ab8da640 10 monclient(hunting): picked mon.noname-a con 0x7f03a40c7550 addr v2:10.20.193.5:3300/0 2026-02-17T21:30:09.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.442+0000 7f03ab8da640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f03a4074ef0 0x7f03a40c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:09.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.442+0000 7f03ab8da640 10 monclient(hunting): picked mon.noname-c con 0x7f03a4074ef0 addr v2:10.20.193.135:3300/0 2026-02-17T21:30:09.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.442+0000 7f03ab8da640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03a40c4fd0 con 0x7f03a40c7170 2026-02-17T21:30:09.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.442+0000 7f03ab8da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:09.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.442+0000 7f03ab8da640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f03a40c8530 con 0x7f03a40c7550 2026-02-17T21:30:09.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.442+0000 7f03ab8da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:09.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.442+0000 7f03ab8da640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f03a415a9a0 con 0x7f03a4074ef0 2026-02-17T21:30:09.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.442+0000 7f03ab8da640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:09.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.442+0000 7f03ab8da640 10 monclient(hunting): authenticate will time out at 1315.007493s 2026-02-17T21:30:09.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.442+0000 7f03a8e4e640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f03a40c7550 0x7f03a40749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:09.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.443+0000 7f03a8e4e640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f03a40c7550 0x7f03a40749b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:49918/0 (socket says 10.20.193.5:49918) 2026-02-17T21:30:09.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.443+0000 7f03a8e4e640 1 -- 10.20.193.5:0/3232396192 learned_addr learned my addr 10.20.193.5:0/3232396192 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:09.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.443+0000 7f03a8e4e640 10 monclient(hunting): get_auth_request con 0x7f03a40c7550 auth_method 0 2026-02-17T21:30:09.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.443+0000 7f03a8e4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:09.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.443+0000 7f03a8e4e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:09.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.443+0000 7f03a8e4e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:09.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.443+0000 7f03a9e50640 1 --2- 10.20.193.5:0/3232396192 >> v2:10.20.193.135:3300/0 conn(0x7f03a4074ef0 0x7f03a40c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:09.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.443+0000 7f03a9e50640 10 monclient(hunting): get_auth_request con 0x7f03a4074ef0 auth_method 0 2026-02-17T21:30:09.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.443+0000 7f03a9e50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:09.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.443+0000 7f03a9e50640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:09.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.443+0000 7f03a9e50640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:09.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.443+0000 7f03a8e4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:09.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.443+0000 7f03a8e4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:09.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.443+0000 7f03a8e4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:09.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.443+0000 7f03a9e50640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:09.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.443+0000 7f03a9e50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:09.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.443+0000 7f03a9e50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:09.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.444+0000 7f03a8e4e640 10 monclient(hunting): handle_auth_done global_id 5043 payload 274 2026-02-17T21:30:09.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.444+0000 7f03a8e4e640 1 -- 10.20.193.5:0/3232396192 >> v2:10.20.193.135:3300/0 conn(0x7f03a4074ef0 msgr2=0x7f03a40c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:09.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.444+0000 7f03a8e4e640 1 --2- 10.20.193.5:0/3232396192 >> v2:10.20.193.135:3300/0 conn(0x7f03a4074ef0 0x7f03a40c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:09.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.444+0000 7f03a8e4e640 1 -- 10.20.193.5:0/3232396192 >> v1:10.20.193.119:6789/0 conn(0x7f03a40c7170 legacy=0x7f03a40c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:09.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.444+0000 7f03a8e4e640 10 monclient: _finish_hunting 0 2026-02-17T21:30:09.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.444+0000 7f03a8e4e640 1 monclient: found mon.noname-a 2026-02-17T21:30:09.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.444+0000 7f03a8e4e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:09.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.444+0000 7f03a8e4e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:09.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.444+0000 7f03a8e4e640 1 -- 10.20.193.5:0/3232396192 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a40c5270 con 0x7f03a40c7550 2026-02-17T21:30:09.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.445+0000 7f03a8e4e640 1 --2- 10.20.193.5:0/3232396192 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f03a40c7550 0x7f03a40749b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f03a40c6e90 tx=0x7f039802eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48511b40686532ec server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:09.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.447+0000 7f0393fff640 1 -- 10.20.193.5:0/3232396192 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039803c070 con 0x7f03a40c7550 2026-02-17T21:30:09.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.447+0000 7f0393fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:09.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.447+0000 7f0393fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:09.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.447+0000 7f0393fff640 10 monclient: dump: 2026-02-17T21:30:09.458 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:09.458 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:09.458 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:09.458 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:09.458 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:09.458 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:09.458 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:09.458 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:09.458 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:09.458 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:09.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.447+0000 7f0393fff640 10 monclient: _finish_auth 0 2026-02-17T21:30:09.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.447+0000 7f0393fff640 10 monclient: _check_auth_tickets 2026-02-17T21:30:09.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.447+0000 7f0393fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:09.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.447+0000 7f0393fff640 1 -- 10.20.193.5:0/3232396192 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f039802fb20 con 0x7f03a40c7550 2026-02-17T21:30:09.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.447+0000 7f03ab8da640 5 monclient: authenticate success, global_id 5043 2026-02-17T21:30:09.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.447+0000 7f03ab8da640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:09.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.447+0000 7f0393fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:09.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.447+0000 7f0393fff640 1 -- 10.20.193.5:0/3232396192 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0398037440 con 0x7f03a40c7550 2026-02-17T21:30:09.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.447+0000 7f03ab8da640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:09.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.447+0000 7f03ab8da640 4 set_mon_vals no callback set 2026-02-17T21:30:09.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.447+0000 7f0393fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:09.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.447+0000 7f0393fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:09.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.447+0000 7f0393fff640 10 monclient: dump: 2026-02-17T21:30:09.460 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:09.460 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:09.460 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:09.460 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:09.460 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:09.460 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:09.460 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:09.460 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:09.460 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:09.460 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:09.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.448+0000 7f03ab8da640 10 monclient: shutdown 2026-02-17T21:30:09.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.448+0000 7f03ab8da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:09.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.448+0000 7f03ab8da640 1 -- 10.20.193.5:0/3232396192 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f03a40c7550 msgr2=0x7f03a40749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:09.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.448+0000 7f03ab8da640 1 --2- 10.20.193.5:0/3232396192 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f03a40c7550 0x7f03a40749b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f03a40c6e90 tx=0x7f039802eeb0 comp rx=0 tx=0).stop 2026-02-17T21:30:09.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.448+0000 7f03ab8da640 1 -- 10.20.193.5:0/3232396192 shutdown_connections 2026-02-17T21:30:09.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.448+0000 7f03ab8da640 1 --2- 10.20.193.5:0/3232396192 >> v2:10.20.193.135:3300/0 conn(0x7f03a4074ef0 0x7f03a40c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:09.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.448+0000 7f03ab8da640 1 --2- 10.20.193.5:0/3232396192 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f03a40c7550 0x7f03a40749b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:09.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.448+0000 7f03ab8da640 1 -- 10.20.193.5:0/3232396192 >> 10.20.193.5:0/3232396192 conn(0x7f03a40c9f40 msgr2=0x7f03a40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:09.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.448+0000 7f03ab8da640 1 -- 10.20.193.5:0/3232396192 shutdown_connections 2026-02-17T21:30:09.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.448+0000 7f03ab8da640 1 -- 10.20.193.5:0/3232396192 wait complete. 2026-02-17T21:30:09.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.448+0000 7f03ab8da640 10 monclient: build_initial_monmap 2026-02-17T21:30:09.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.448+0000 7f03ab8da640 10 monclient: monmap: 2026-02-17T21:30:09.462 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:09.462 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:09.462 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:09.462 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:09.462 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:09.462 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:09.462 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:09.462 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:09.462 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:09.463 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:09.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.448+0000 7f03ab8da640 1 librados: starting msgr at 2026-02-17T21:30:09.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.448+0000 7f03ab8da640 1 librados: starting objecter 2026-02-17T21:30:09.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.448+0000 7f03ab8da640 1 Processor -- start 2026-02-17T21:30:09.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.448+0000 7f03ab8da640 1 -- start start 2026-02-17T21:30:09.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.448+0000 7f03ab8da640 1 librados: setting wanted keys 2026-02-17T21:30:09.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.448+0000 7f03ab8da640 1 librados: calling monclient init 2026-02-17T21:30:09.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.448+0000 7f03ab8da640 10 monclient: init 2026-02-17T21:30:09.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03ab8da640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:09.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03ab8da640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:30:09.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03ab8da640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f03a4074ef0 0x7f03a4156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:09.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03ab8da640 10 monclient(hunting): picked mon.noname-c con 0x7f03a4074ef0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:09.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03ab8da640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f03a40c7170 0x7f03a406ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:09.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03ab8da640 10 monclient(hunting): picked mon.noname-b con 0x7f03a40c7170 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:09.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03ab8da640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f03a40c7550 0x7f03a415aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:09.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03ab8da640 10 monclient(hunting): picked mon.noname-a con 0x7f03a40c7550 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:09.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03ab8da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:09.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03ab8da640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f03a40c7ee0 con 0x7f03a40c7550 2026-02-17T21:30:09.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03ab8da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:09.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03ab8da640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f03a40c5830 con 0x7f03a40c7170 2026-02-17T21:30:09.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03ab8da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:09.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03ab8da640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f03a40c81c0 con 0x7f03a4074ef0 2026-02-17T21:30:09.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03ab8da640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:09.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03ab8da640 10 monclient(hunting): authenticate will time out at 1315.014366s 2026-02-17T21:30:09.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03a8e4e640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f03a40c7170 0x7f03a406ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:09.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03a964f640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f03a4074ef0 0x7f03a4156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:09.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03a8e4e640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f03a40c7170 0x7f03a406ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:32976/0 (socket says 10.20.193.5:32976) 2026-02-17T21:30:09.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03a8e4e640 1 -- 10.20.193.5:0/109295371 learned_addr learned my addr 10.20.193.5:0/109295371 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:09.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03a8e4e640 10 monclient(hunting): get_auth_request con 0x7f03a40c7170 auth_method 0 2026-02-17T21:30:09.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03a8e4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:09.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03a8e4e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:09.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03a8e4e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:09.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03a964f640 10 monclient(hunting): get_auth_request con 0x7f03a4074ef0 auth_method 0 2026-02-17T21:30:09.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03a964f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:09.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03a964f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:09.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.449+0000 7f03a964f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:09.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.450+0000 7f03a8e4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:09.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.450+0000 7f03a8e4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:09.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.450+0000 7f03a8e4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:09.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.450+0000 7f03a964f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:09.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.450+0000 7f03a964f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:09.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.450+0000 7f03a964f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:09.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.451+0000 7f03a8e4e640 10 monclient(hunting): handle_auth_done global_id 5104 payload 824 2026-02-17T21:30:09.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.451+0000 7f03a8e4e640 1 -- 10.20.193.5:0/109295371 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f03a4074ef0 msgr2=0x7f03a4156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:09.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.451+0000 7f03a8e4e640 1 --2- 10.20.193.5:0/109295371 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f03a4074ef0 0x7f03a4156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:09.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.451+0000 7f03a8e4e640 1 -- 10.20.193.5:0/109295371 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f03a40c7550 msgr2=0x7f03a415aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:09.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.451+0000 7f03a8e4e640 1 --2- 10.20.193.5:0/109295371 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f03a40c7550 0x7f03a415aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:09.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.451+0000 7f03a8e4e640 10 monclient: _finish_hunting 0 2026-02-17T21:30:09.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.451+0000 7f03a8e4e640 1 monclient: found mon.noname-b 2026-02-17T21:30:09.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.451+0000 7f03a8e4e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:09.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.451+0000 7f03a8e4e640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:30:09.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.451+0000 7f03a8e4e640 1 -- 10.20.193.5:0/109295371 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a4156b30 con 0x7f03a40c7170 2026-02-17T21:30:09.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.452+0000 7f03a8e4e640 1 --2- 10.20.193.5:0/109295371 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f03a40c7170 0x7f03a406ecd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f039802f3c0 tx=0x7f03980047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:09.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.452+0000 7f0391ffb640 10 client.?.objecter ms_handle_connect 0x7f03a40c7170 2026-02-17T21:30:09.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.452+0000 7f0391ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:09.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.454+0000 7f0391ffb640 1 -- 10.20.193.5:0/109295371 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039803c040 con 0x7f03a40c7170 2026-02-17T21:30:09.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.454+0000 7f0391ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:09.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.454+0000 7f0391ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:30:09.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.454+0000 7f0391ffb640 10 monclient: dump: 2026-02-17T21:30:09.468 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:09.468 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:09.468 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:09.468 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:09.468 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:09.468 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:09.468 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:09.468 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:09.468 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:09.468 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:09.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.454+0000 7f0391ffb640 10 monclient: _finish_auth 0 2026-02-17T21:30:09.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.454+0000 7f0391ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:30:09.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.454+0000 7f0391ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:09.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.454+0000 7f0391ffb640 1 -- 10.20.193.5:0/109295371 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0398042430 con 0x7f03a40c7170 2026-02-17T21:30:09.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.454+0000 7f03ab8da640 5 monclient: authenticate success, global_id 5104 2026-02-17T21:30:09.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.454+0000 7f03ab8da640 10 monclient: _renew_subs 2026-02-17T21:30:09.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.454+0000 7f03ab8da640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:09.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.454+0000 7f03ab8da640 1 -- 10.20.193.5:0/109295371 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03a4156e10 con 0x7f03a40c7170 2026-02-17T21:30:09.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.454+0000 7f0391ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:09.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.454+0000 7f0391ffb640 1 -- 10.20.193.5:0/109295371 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0398042800 con 0x7f03a40c7170 2026-02-17T21:30:09.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.454+0000 7f0391ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:09.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.454+0000 7f0391ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:30:09.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.454+0000 7f0391ffb640 10 monclient: dump: 2026-02-17T21:30:09.469 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:09.470 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:09.470 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:09.470 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:09.470 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:09.470 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:09.470 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:09.470 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:09.470 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:09.470 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:09.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.454+0000 7f03937fe640 4 set_mon_vals no callback set 2026-02-17T21:30:09.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.454+0000 7f03ab8da640 10 client.5104.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:09.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.454+0000 7f03ab8da640 10 monclient: _renew_subs 2026-02-17T21:30:09.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.454+0000 7f03ab8da640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:09.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.454+0000 7f03ab8da640 1 -- 10.20.193.5:0/109295371 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03a41573d0 con 0x7f03a40c7170 2026-02-17T21:30:09.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.454+0000 7f03ab8da640 1 librados: init done 2026-02-17T21:30:09.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.454+0000 7f03ab8da640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:09.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.455+0000 7f03ab8da640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:09.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.455+0000 7f03ab8da640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:09.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.455+0000 7f03ab8da640 1 -- 10.20.193.5:0/109295371 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03a40749b0 con 0x7f03a40c7170 2026-02-17T21:30:09.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.467+0000 7f0391ffb640 1 -- 10.20.193.5:0/109295371 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f03980429a0 con 0x7f03a40c7170 2026-02-17T21:30:09.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.467+0000 7f0391ffb640 1 --2- 10.20.193.5:0/109295371 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0374079280 0x7f037407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:09.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.467+0000 7f03a964f640 1 --2- 10.20.193.5:0/109295371 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0374079280 0x7f037407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:09.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.467+0000 7f03a964f640 10 monclient: get_auth_request con 0x7f0374079280 auth_method 0 2026-02-17T21:30:09.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.468+0000 7f0391ffb640 10 client.5104.objecter ms_handle_connect 0x7f0374079280 2026-02-17T21:30:09.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.468+0000 7f03a964f640 1 --2- 10.20.193.5:0/109295371 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0374079280 0x7f037407b740 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f03940046e0 tx=0x7f03940091c0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:09.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.469+0000 7f0391ffb640 1 -- 10.20.193.5:0/109295371 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f0398083a50 con 0x7f03a40c7170 2026-02-17T21:30:09.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.469+0000 7f0391ffb640 10 client.5104.objecter ms_dispatch2 0x7f03a4000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:09.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.469+0000 7f0391ffb640 3 client.5104.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:09.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.469+0000 7f0391ffb640 3 client.5104.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:09.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.469+0000 7f0391ffb640 20 client.5104.objecter dump_active .. 0 homeless 2026-02-17T21:30:09.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.570+0000 7f0391ffb640 1 -- 10.20.193.5:0/109295371 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0398088110 con 0x7f03a40c7170 2026-02-17T21:30:09.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.570+0000 7f0391ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:09.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.570+0000 7f0391ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:09.673 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.671+0000 7f03ab8da640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:30:09.673 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.671+0000 7f03ab8da640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:09.673 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.671+0000 7f03ab8da640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:09.673 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.671+0000 7f03ab8da640 1 -- 10.20.193.5:0/109295371 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f03a4076dc0 con 0x7f03a40c7170 2026-02-17T21:30:09.675 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.674+0000 7f0391ffb640 1 -- 10.20.193.5:0/109295371 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f0398087a10 con 0x7f03a40c7170 2026-02-17T21:30:09.675 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.674+0000 7f0391ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:09.675 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.674+0000 7f0391ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:30:09.675 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:30:09.676 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:30:09.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.675+0000 7f03ab8da640 10 librados: watch_flush enter 2026-02-17T21:30:09.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.675+0000 7f03ab8da640 10 librados: watch_flush exit 2026-02-17T21:30:09.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.675+0000 7f03ab8da640 20 client.5104.objecter shutdown clearing up homeless session... 2026-02-17T21:30:09.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.675+0000 7f03ab8da640 10 client.5104.objecter successfully canceled tick 2026-02-17T21:30:09.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.675+0000 7f03ab8da640 1 -- 10.20.193.5:0/109295371 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0374079280 msgr2=0x7f037407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:09.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.675+0000 7f03ab8da640 1 --2- 10.20.193.5:0/109295371 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0374079280 0x7f037407b740 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f03940046e0 tx=0x7f03940091c0 comp rx=0 tx=0).stop 2026-02-17T21:30:09.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.675+0000 7f03ab8da640 10 monclient: shutdown 2026-02-17T21:30:09.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.675+0000 7f03ab8da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:09.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.675+0000 7f03ab8da640 1 -- 10.20.193.5:0/109295371 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f03a40c7170 msgr2=0x7f03a406ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:09.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.675+0000 7f03ab8da640 1 --2- 10.20.193.5:0/109295371 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f03a40c7170 0x7f03a406ecd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f039802f3c0 tx=0x7f03980047c0 comp rx=0 tx=0).stop 2026-02-17T21:30:09.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.675+0000 7f03ab8da640 1 -- 10.20.193.5:0/109295371 shutdown_connections 2026-02-17T21:30:09.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.675+0000 7f03ab8da640 1 --2- 10.20.193.5:0/109295371 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0374079280 0x7f037407b740 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:09.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.675+0000 7f03ab8da640 1 --2- 10.20.193.5:0/109295371 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f03a40c7550 0x7f03a415aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:09.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.675+0000 7f03ab8da640 1 --2- 10.20.193.5:0/109295371 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f03a40c7170 0x7f03a406ecd0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:09.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.675+0000 7f03ab8da640 1 --2- 10.20.193.5:0/109295371 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f03a4074ef0 0x7f03a4156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:09.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.675+0000 7f03ab8da640 1 -- 10.20.193.5:0/109295371 >> 10.20.193.5:0/109295371 conn(0x7f03a40c9f40 msgr2=0x7f03a4073ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:09.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.675+0000 7f03ab8da640 1 -- 10.20.193.5:0/109295371 shutdown_connections 2026-02-17T21:30:09.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.675+0000 7f03ab8da640 1 -- 10.20.193.5:0/109295371 wait complete. 2026-02-17T21:30:09.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:09.675+0000 7f03ab8da640 1 librados: shutdown 2026-02-17T21:30:12.685 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:30:12.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.751+0000 7f052b26f640 10 monclient: get_monmap_and_config 2026-02-17T21:30:12.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.751+0000 7f052b26f640 10 monclient: build_initial_monmap 2026-02-17T21:30:12.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.751+0000 7f052b26f640 10 monclient: monmap: 2026-02-17T21:30:12.754 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:12.754 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:12.754 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:12.752510+0000 2026-02-17T21:30:12.754 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:12.752510+0000 2026-02-17T21:30:12.754 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:12.754 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:12.754 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:12.754 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:12.754 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:12.754 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:12.754 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:12.755 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:12.755 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:12.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.752+0000 7f052b26f640 1 Processor -- start 2026-02-17T21:30:12.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.752+0000 7f052b26f640 1 -- start start 2026-02-17T21:30:12.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.752+0000 7f052b26f640 10 monclient: init 2026-02-17T21:30:12.757 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.752+0000 7f052b26f640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:12.757 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.752+0000 7f052b26f640 10 monclient: _add_conns ranks=[2,0,3,4,1,5] 2026-02-17T21:30:12.757 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.752+0000 7f052b26f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f05240c7170 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:12.757 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.752+0000 7f052b26f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f05240c7550 addr v1:10.20.193.5:6789/0 2026-02-17T21:30:12.757 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.752+0000 7f052b26f640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f05240c89c0 0x7f05240c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:12.757 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.752+0000 7f052b26f640 10 monclient(hunting): picked mon.noname-a con 0x7f05240c89c0 addr v2:10.20.193.5:3300/0 2026-02-17T21:30:12.757 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.752+0000 7f052b26f640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05240c4fd0 con 0x7f05240c7550 2026-02-17T21:30:12.758 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.752+0000 7f052b26f640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f052415a9a0 con 0x7f05240c7170 2026-02-17T21:30:12.758 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.752+0000 7f052b26f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:12.758 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.752+0000 7f052b26f640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f05240c8530 con 0x7f05240c89c0 2026-02-17T21:30:12.758 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.752+0000 7f052b26f640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:12.758 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.752+0000 7f052b26f640 10 monclient(hunting): authenticate will time out at 1318.317801s 2026-02-17T21:30:12.758 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.753+0000 7f05297e5640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f05240c89c0 0x7f05240c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:12.758 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.753+0000 7f0528fe4640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f05240c7170 0x7f05240c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:58602/0 (socket says 10.20.193.5:58602) 2026-02-17T21:30:12.758 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.753+0000 7f0528fe4640 1 -- 10.20.193.5:0/551362595 learned_addr learned my addr 10.20.193.5:0/551362595 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:12.758 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.753+0000 7f05297e5640 10 monclient(hunting): get_auth_request con 0x7f05240c89c0 auth_method 0 2026-02-17T21:30:12.758 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.753+0000 7f05297e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:12.758 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.753+0000 7f05297e5640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:12.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.753+0000 7f05297e5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:12.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.753+0000 7f05297e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:12.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.753+0000 7f05297e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:12.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.753+0000 7f05297e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:12.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.754+0000 7f05297e5640 10 monclient(hunting): handle_auth_done global_id 5046 payload 274 2026-02-17T21:30:12.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.754+0000 7f05297e5640 1 -- 10.20.193.5:0/551362595 >> v1:10.20.193.135:6789/0 conn(0x7f05240c7170 legacy=0x7f05240c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:12.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.754+0000 7f05297e5640 1 -- 10.20.193.5:0/551362595 >> v1:10.20.193.5:6789/0 conn(0x7f05240c7550 legacy=0x7f05240749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:12.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.754+0000 7f05297e5640 10 monclient: _finish_hunting 0 2026-02-17T21:30:12.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.754+0000 7f05297e5640 1 monclient: found mon.noname-a 2026-02-17T21:30:12.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.754+0000 7f05297e5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:12.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.754+0000 7f05297e5640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:12.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.754+0000 7f05297e5640 1 -- 10.20.193.5:0/551362595 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05240c5270 con 0x7f05240c89c0 2026-02-17T21:30:12.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.755+0000 7f05297e5640 1 --2- 10.20.193.5:0/551362595 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f05240c89c0 0x7f05240c8e70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0520009d90 tx=0x7f052002f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7146746c4bf2e94d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:12.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.757+0000 7f051b7fe640 1 -- 10.20.193.5:0/551362595 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052003c070 con 0x7f05240c89c0 2026-02-17T21:30:12.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.757+0000 7f051b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:12.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.757+0000 7f051b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:12.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.757+0000 7f051b7fe640 10 monclient: dump: 2026-02-17T21:30:12.764 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:12.765 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:12.765 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:12.765 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:12.765 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:12.765 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:12.765 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:12.765 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:12.765 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:12.765 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:12.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.757+0000 7f051b7fe640 10 monclient: _finish_auth 0 2026-02-17T21:30:12.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.757+0000 7f051b7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:30:12.766 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.757+0000 7f051b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:12.766 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.757+0000 7f052b26f640 5 monclient: authenticate success, global_id 5046 2026-02-17T21:30:12.766 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.757+0000 7f051b7fe640 1 -- 10.20.193.5:0/551362595 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0520037440 con 0x7f05240c89c0 2026-02-17T21:30:12.766 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.757+0000 7f052b26f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:12.766 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.757+0000 7f051b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:12.766 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.757+0000 7f051b7fe640 1 -- 10.20.193.5:0/551362595 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0520037810 con 0x7f05240c89c0 2026-02-17T21:30:12.766 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.757+0000 7f052b26f640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:12.766 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.757+0000 7f052b26f640 4 set_mon_vals no callback set 2026-02-17T21:30:12.766 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.757+0000 7f051b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:12.766 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.757+0000 7f051b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:12.766 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.757+0000 7f051b7fe640 10 monclient: dump: 2026-02-17T21:30:12.766 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:12.767 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:12.767 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:12.767 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:12.767 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:12.767 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:12.767 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:12.767 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:12.767 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:12.767 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:12.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.758+0000 7f052b26f640 10 monclient: shutdown 2026-02-17T21:30:12.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.758+0000 7f052b26f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:12.767 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.758+0000 7f052b26f640 1 -- 10.20.193.5:0/551362595 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f05240c89c0 msgr2=0x7f05240c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:12.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.758+0000 7f052b26f640 1 --2- 10.20.193.5:0/551362595 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f05240c89c0 0x7f05240c8e70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0520009d90 tx=0x7f052002f1e0 comp rx=0 tx=0).stop 2026-02-17T21:30:12.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.758+0000 7f052b26f640 1 -- 10.20.193.5:0/551362595 shutdown_connections 2026-02-17T21:30:12.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.758+0000 7f052b26f640 1 --2- 10.20.193.5:0/551362595 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f05240c89c0 0x7f05240c8e70 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:12.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.758+0000 7f052b26f640 1 -- 10.20.193.5:0/551362595 >> 10.20.193.5:0/551362595 conn(0x7f05240c9f40 msgr2=0x7f05240ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:12.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.758+0000 7f052b26f640 1 -- 10.20.193.5:0/551362595 shutdown_connections 2026-02-17T21:30:12.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.758+0000 7f052b26f640 1 -- 10.20.193.5:0/551362595 wait complete. 2026-02-17T21:30:12.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.758+0000 7f052b26f640 10 monclient: build_initial_monmap 2026-02-17T21:30:12.768 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.758+0000 7f052b26f640 10 monclient: monmap: 2026-02-17T21:30:12.768 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:12.768 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:12.768 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:12.768 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:12.768 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:12.769 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:12.769 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:12.769 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:12.769 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:12.769 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:12.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.758+0000 7f052b26f640 1 librados: starting msgr at 2026-02-17T21:30:12.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.758+0000 7f052b26f640 1 librados: starting objecter 2026-02-17T21:30:12.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f052b26f640 1 Processor -- start 2026-02-17T21:30:12.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f052b26f640 1 -- start start 2026-02-17T21:30:12.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f052b26f640 1 librados: setting wanted keys 2026-02-17T21:30:12.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f052b26f640 1 librados: calling monclient init 2026-02-17T21:30:12.769 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f052b26f640 10 monclient: init 2026-02-17T21:30:12.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f052b26f640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:12.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f052b26f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:30:12.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f052b26f640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f05240c7170 0x7f0524155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:12.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f052b26f640 10 monclient(hunting): picked mon.noname-a con 0x7f05240c7170 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:12.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f052b26f640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f05240c7550 0x7f052406e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:12.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f052b26f640 10 monclient(hunting): picked mon.noname-c con 0x7f05240c7550 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:12.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f052b26f640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f05240c89c0 0x7f0524154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:12.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f052b26f640 10 monclient(hunting): picked mon.noname-b con 0x7f05240c89c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:12.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f052b26f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:12.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f052b26f640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f05240c5830 con 0x7f05240c7170 2026-02-17T21:30:12.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f052b26f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:12.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f052b26f640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f05240c93b0 con 0x7f05240c89c0 2026-02-17T21:30:12.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f052b26f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:12.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f052b26f640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f05240c7ee0 con 0x7f05240c7550 2026-02-17T21:30:12.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f052b26f640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:12.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f052b26f640 10 monclient(hunting): authenticate will time out at 1318.324470s 2026-02-17T21:30:12.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f0528fe4640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f05240c7170 0x7f0524155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:12.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f0528fe4640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f05240c7170 0x7f0524155c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:49940/0 (socket says 10.20.193.5:49940) 2026-02-17T21:30:12.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f0528fe4640 1 -- 10.20.193.5:0/4143797492 learned_addr learned my addr 10.20.193.5:0/4143797492 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:12.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f0528fe4640 10 monclient(hunting): get_auth_request con 0x7f05240c7170 auth_method 0 2026-02-17T21:30:12.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f0528fe4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:12.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f0528fe4640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:12.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f0528fe4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:12.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.759+0000 7f05297e5640 1 --2- 10.20.193.5:0/4143797492 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f05240c89c0 0x7f0524154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:12.771 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.760+0000 7f051bfff640 1 --2- 10.20.193.5:0/4143797492 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f05240c7550 0x7f052406e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:12.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.760+0000 7f0528fe4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:12.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.760+0000 7f0528fe4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:12.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.760+0000 7f0528fe4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:12.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.760+0000 7f05297e5640 10 monclient(hunting): get_auth_request con 0x7f05240c89c0 auth_method 0 2026-02-17T21:30:12.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.760+0000 7f05297e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:12.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.760+0000 7f05297e5640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:12.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.760+0000 7f05297e5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:12.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.760+0000 7f051bfff640 10 monclient(hunting): get_auth_request con 0x7f05240c7550 auth_method 0 2026-02-17T21:30:12.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.760+0000 7f051bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:12.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.760+0000 7f051bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:12.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.760+0000 7f051bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:12.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.760+0000 7f051bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:12.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.760+0000 7f051bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:12.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.760+0000 7f051bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:12.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.760+0000 7f05297e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:12.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.760+0000 7f05297e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:12.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.760+0000 7f05297e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:12.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.761+0000 7f0528fe4640 10 monclient(hunting): handle_auth_done global_id 5049 payload 824 2026-02-17T21:30:12.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.761+0000 7f0528fe4640 1 -- 10.20.193.5:0/4143797492 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f05240c7550 msgr2=0x7f052406e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:12.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.761+0000 7f0528fe4640 1 --2- 10.20.193.5:0/4143797492 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f05240c7550 0x7f052406e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:12.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.761+0000 7f0528fe4640 1 -- 10.20.193.5:0/4143797492 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f05240c89c0 msgr2=0x7f0524154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:12.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.761+0000 7f0528fe4640 1 --2- 10.20.193.5:0/4143797492 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f05240c89c0 0x7f0524154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:12.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.761+0000 7f0528fe4640 10 monclient: _finish_hunting 0 2026-02-17T21:30:12.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.761+0000 7f0528fe4640 1 monclient: found mon.noname-a 2026-02-17T21:30:12.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.761+0000 7f0528fe4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:12.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.761+0000 7f0528fe4640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:12.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.761+0000 7f0528fe4640 1 -- 10.20.193.5:0/4143797492 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05241565f0 con 0x7f05240c7170 2026-02-17T21:30:12.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.762+0000 7f0528fe4640 1 --2- 10.20.193.5:0/4143797492 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f05240c7170 0x7f0524155c90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f051400c500 tx=0x7f051400c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:12.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.762+0000 7f05197fa640 10 client.?.objecter ms_handle_connect 0x7f05240c7170 2026-02-17T21:30:12.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.762+0000 7f05197fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:12.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f05197fa640 1 -- 10.20.193.5:0/4143797492 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0514017070 con 0x7f05240c7170 2026-02-17T21:30:12.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f05197fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:12.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f05197fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:12.776 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f05197fa640 10 monclient: dump: 2026-02-17T21:30:12.776 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:12.776 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:12.776 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:12.777 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:12.777 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:12.777 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:12.777 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:12.777 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:12.777 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:12.777 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:12.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f05197fa640 10 monclient: _finish_auth 0 2026-02-17T21:30:12.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f05197fa640 10 monclient: _check_auth_tickets 2026-02-17T21:30:12.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f05197fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:12.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f05197fa640 1 -- 10.20.193.5:0/4143797492 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0514005e00 con 0x7f05240c7170 2026-02-17T21:30:12.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f052b26f640 5 monclient: authenticate success, global_id 5049 2026-02-17T21:30:12.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f052b26f640 10 monclient: _renew_subs 2026-02-17T21:30:12.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f052b26f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:12.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f052b26f640 1 -- 10.20.193.5:0/4143797492 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05241568d0 con 0x7f05240c7170 2026-02-17T21:30:12.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f05197fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:12.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f05197fa640 1 -- 10.20.193.5:0/4143797492 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05140072b0 con 0x7f05240c7170 2026-02-17T21:30:12.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f05197fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:12.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f05197fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:12.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f051affd640 4 set_mon_vals no callback set 2026-02-17T21:30:12.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f05197fa640 10 monclient: dump: 2026-02-17T21:30:12.778 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:12.778 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:12.779 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:12.779 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:12.779 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:12.779 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:12.779 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:12.779 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:12.779 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:12.779 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:12.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f052b26f640 10 client.5049.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:12.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f052b26f640 10 monclient: _renew_subs 2026-02-17T21:30:12.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f052b26f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:12.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f052b26f640 1 -- 10.20.193.5:0/4143797492 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0524156e90 con 0x7f05240c7170 2026-02-17T21:30:12.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f052b26f640 1 librados: init done 2026-02-17T21:30:12.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f052b26f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:12.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f052b26f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:12.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f052b26f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:12.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.764+0000 7f052b26f640 1 -- 10.20.193.5:0/4143797492 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05240c81c0 con 0x7f05240c7170 2026-02-17T21:30:12.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.776+0000 7f05197fa640 1 -- 10.20.193.5:0/4143797492 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f0514007510 con 0x7f05240c7170 2026-02-17T21:30:12.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.776+0000 7f05197fa640 1 --2- 10.20.193.5:0/4143797492 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f04f40792d0 0x7f04f407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:12.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.777+0000 7f051bfff640 1 --2- 10.20.193.5:0/4143797492 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f04f40792d0 0x7f04f407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:12.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.777+0000 7f051bfff640 10 monclient: get_auth_request con 0x7f04f40792d0 auth_method 0 2026-02-17T21:30:12.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.777+0000 7f051bfff640 1 --2- 10.20.193.5:0/4143797492 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f04f40792d0 0x7f04f407b790 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f05241493b0 tx=0x7f050c0091c0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:12.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.777+0000 7f05197fa640 10 client.5049.objecter ms_handle_connect 0x7f04f40792d0 2026-02-17T21:30:12.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.778+0000 7f05197fa640 1 -- 10.20.193.5:0/4143797492 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f051405d5d0 con 0x7f05240c7170 2026-02-17T21:30:12.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.778+0000 7f05197fa640 10 client.5049.objecter ms_dispatch2 0x7f0524000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:12.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.778+0000 7f05197fa640 3 client.5049.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:12.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.778+0000 7f05197fa640 3 client.5049.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:12.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.778+0000 7f05197fa640 20 client.5049.objecter dump_active .. 0 homeless 2026-02-17T21:30:12.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.878+0000 7f05197fa640 1 -- 10.20.193.5:0/4143797492 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0514021080 con 0x7f05240c7170 2026-02-17T21:30:12.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.878+0000 7f05197fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:12.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.878+0000 7f05197fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:12.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.979+0000 7f052b26f640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:30:12.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.979+0000 7f052b26f640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:12.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.979+0000 7f052b26f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:12.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.979+0000 7f052b26f640 1 -- 10.20.193.5:0/4143797492 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f05240c47c0 con 0x7f05240c7170 2026-02-17T21:30:12.983 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.981+0000 7f05197fa640 1 -- 10.20.193.5:0/4143797492 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f0514061590 con 0x7f05240c7170 2026-02-17T21:30:12.983 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.981+0000 7f05197fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:12.983 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.981+0000 7f05197fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:30:12.984 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:30:12.984 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:30:12.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.983+0000 7f052b26f640 10 librados: watch_flush enter 2026-02-17T21:30:12.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.983+0000 7f052b26f640 10 librados: watch_flush exit 2026-02-17T21:30:12.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.983+0000 7f052b26f640 20 client.5049.objecter shutdown clearing up homeless session... 2026-02-17T21:30:12.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.983+0000 7f052b26f640 10 client.5049.objecter successfully canceled tick 2026-02-17T21:30:12.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.983+0000 7f052b26f640 1 -- 10.20.193.5:0/4143797492 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f04f40792d0 msgr2=0x7f04f407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:12.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.983+0000 7f052b26f640 1 --2- 10.20.193.5:0/4143797492 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f04f40792d0 0x7f04f407b790 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f05241493b0 tx=0x7f050c0091c0 comp rx=0 tx=0).stop 2026-02-17T21:30:12.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.983+0000 7f052b26f640 10 monclient: shutdown 2026-02-17T21:30:12.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.983+0000 7f052b26f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:12.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.983+0000 7f052b26f640 1 -- 10.20.193.5:0/4143797492 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f05240c7170 msgr2=0x7f0524155c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:12.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.983+0000 7f052b26f640 1 --2- 10.20.193.5:0/4143797492 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f05240c7170 0x7f0524155c90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f051400c500 tx=0x7f051400c9d0 comp rx=0 tx=0).stop 2026-02-17T21:30:12.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.983+0000 7f052b26f640 1 -- 10.20.193.5:0/4143797492 shutdown_connections 2026-02-17T21:30:12.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.983+0000 7f052b26f640 1 --2- 10.20.193.5:0/4143797492 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f04f40792d0 0x7f04f407b790 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:12.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.983+0000 7f052b26f640 1 --2- 10.20.193.5:0/4143797492 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f05240c89c0 0x7f0524154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:12.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.983+0000 7f052b26f640 1 --2- 10.20.193.5:0/4143797492 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f05240c7550 0x7f052406e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:12.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.983+0000 7f052b26f640 1 --2- 10.20.193.5:0/4143797492 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f05240c7170 0x7f0524155c90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:12.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.983+0000 7f052b26f640 1 -- 10.20.193.5:0/4143797492 >> 10.20.193.5:0/4143797492 conn(0x7f05240c9f40 msgr2=0x7f05240cb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:12.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.983+0000 7f052b26f640 1 -- 10.20.193.5:0/4143797492 shutdown_connections 2026-02-17T21:30:12.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.983+0000 7f052b26f640 1 -- 10.20.193.5:0/4143797492 wait complete. 2026-02-17T21:30:12.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:12.983+0000 7f052b26f640 1 librados: shutdown 2026-02-17T21:30:15.994 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:30:16.062 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.061+0000 7f5115934640 10 monclient: get_monmap_and_config 2026-02-17T21:30:16.062 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.061+0000 7f5115934640 10 monclient: build_initial_monmap 2026-02-17T21:30:16.062 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.061+0000 7f5115934640 10 monclient: monmap: 2026-02-17T21:30:16.062 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:16.062 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:16.062 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:16.061904+0000 2026-02-17T21:30:16.062 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:16.061904+0000 2026-02-17T21:30:16.062 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:16.062 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:16.062 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:16.062 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:16.062 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:16.062 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:16.063 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:16.063 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:16.063 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:16.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.061+0000 7f5115934640 1 Processor -- start 2026-02-17T21:30:16.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.061+0000 7f5115934640 1 -- start start 2026-02-17T21:30:16.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.061+0000 7f5115934640 10 monclient: init 2026-02-17T21:30:16.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.062+0000 7f5115934640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:16.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.062+0000 7f5115934640 10 monclient: _add_conns ranks=[1,0,5,3,4,2] 2026-02-17T21:30:16.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.062+0000 7f5115934640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f511015d370 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:16.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.062+0000 7f5115934640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f51100c7e20 addr v1:10.20.193.5:6789/0 2026-02-17T21:30:16.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.062+0000 7f5115934640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f51100c59c0 0x7f511015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:16.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.062+0000 7f5115934640 10 monclient(hunting): picked mon.noname-c con 0x7f51100c59c0 addr v2:10.20.193.135:3300/0 2026-02-17T21:30:16.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.062+0000 7f5115934640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51100c8350 con 0x7f51100c7e20 2026-02-17T21:30:16.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.062+0000 7f5115934640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51100c8630 con 0x7f511015d370 2026-02-17T21:30:16.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.062+0000 7f5115934640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:16.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.062+0000 7f5115934640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f511015b710 con 0x7f51100c59c0 2026-02-17T21:30:16.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.062+0000 7f5115934640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:16.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.062+0000 7f5115934640 10 monclient(hunting): authenticate will time out at 1321.627200s 2026-02-17T21:30:16.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.062+0000 7f510e7fc640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f51100c7e20 0x7f51100c52b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:56734/0 (socket says 10.20.193.5:56734) 2026-02-17T21:30:16.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.062+0000 7f510e7fc640 1 -- 10.20.193.5:0/1652177980 learned_addr learned my addr 10.20.193.5:0/1652177980 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:16.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.062+0000 7f510f7fe640 1 --2- 10.20.193.5:0/1652177980 >> v2:10.20.193.135:3300/0 conn(0x7f51100c59c0 0x7f511015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:16.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.062+0000 7f510f7fe640 10 monclient(hunting): get_auth_request con 0x7f51100c59c0 auth_method 0 2026-02-17T21:30:16.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.062+0000 7f510f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:16.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.062+0000 7f510f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:16.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.062+0000 7f510f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:16.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.063+0000 7f510f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:16.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.063+0000 7f510f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:16.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.063+0000 7f510f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:16.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.063+0000 7f510dffb640 1 -- 10.20.193.5:0/1652177980 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3200579418 0 0) 0x7f51100c8630 con 0x7f511015d370 2026-02-17T21:30:16.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.063+0000 7f510dffb640 10 monclient(hunting): _negotiate 2026-02-17T21:30:16.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.063+0000 7f510dffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:16.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.063+0000 7f510dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:16.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.063+0000 7f510dffb640 10 monclient(hunting): my global_id is 5110 2026-02-17T21:30:16.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.063+0000 7f510dffb640 1 -- 10.20.193.5:0/1652177980 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50fc003620 con 0x7f511015d370 2026-02-17T21:30:16.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.063+0000 7f510dffb640 1 -- 10.20.193.5:0/1652177980 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 876726760 0 0) 0x7f51100c8350 con 0x7f51100c7e20 2026-02-17T21:30:16.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.063+0000 7f510dffb640 10 monclient(hunting): _negotiate 2026-02-17T21:30:16.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.063+0000 7f510dffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:16.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.063+0000 7f510dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:16.066 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.063+0000 7f510dffb640 10 monclient(hunting): my global_id is 5052 2026-02-17T21:30:16.066 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.063+0000 7f510dffb640 1 -- 10.20.193.5:0/1652177980 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51100c8630 con 0x7f51100c7e20 2026-02-17T21:30:16.066 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.064+0000 7f510f7fe640 10 monclient(hunting): handle_auth_done global_id 5102 payload 274 2026-02-17T21:30:16.066 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.064+0000 7f510f7fe640 1 -- 10.20.193.5:0/1652177980 >> v1:10.20.193.119:6789/0 conn(0x7f511015d370 legacy=0x7f511015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:16.066 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.064+0000 7f510f7fe640 1 -- 10.20.193.5:0/1652177980 >> v1:10.20.193.5:6789/0 conn(0x7f51100c7e20 legacy=0x7f51100c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:16.066 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.064+0000 7f510f7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:30:16.066 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.064+0000 7f510f7fe640 1 monclient: found mon.noname-c 2026-02-17T21:30:16.066 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.064+0000 7f510f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:16.066 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.064+0000 7f510f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:16.066 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.064+0000 7f510f7fe640 1 -- 10.20.193.5:0/1652177980 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51100c8910 con 0x7f51100c59c0 2026-02-17T21:30:16.066 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.065+0000 7f510f7fe640 1 --2- 10.20.193.5:0/1652177980 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f51100c59c0 0x7f511015d750 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5100009d90 tx=0x7f510002f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33147fa6c14012f8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:16.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.066+0000 7f510dffb640 1 -- 10.20.193.5:0/1652177980 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510003c070 con 0x7f51100c59c0 2026-02-17T21:30:16.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.066+0000 7f510dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:16.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.066+0000 7f510dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:16.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.066+0000 7f510dffb640 10 monclient: dump: 2026-02-17T21:30:16.068 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:16.068 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:16.068 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:16.068 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:16.068 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:16.068 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:16.068 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:16.068 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:16.068 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:16.068 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:16.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.066+0000 7f510dffb640 10 monclient: _finish_auth 0 2026-02-17T21:30:16.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.066+0000 7f510dffb640 10 monclient: _check_auth_tickets 2026-02-17T21:30:16.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.066+0000 7f510dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:16.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.066+0000 7f5115934640 5 monclient: authenticate success, global_id 5102 2026-02-17T21:30:16.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.066+0000 7f5115934640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:16.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.066+0000 7f510dffb640 1 -- 10.20.193.5:0/1652177980 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5100037440 con 0x7f51100c59c0 2026-02-17T21:30:16.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.066+0000 7f510dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:16.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.066+0000 7f510dffb640 1 -- 10.20.193.5:0/1652177980 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51000377f0 con 0x7f51100c59c0 2026-02-17T21:30:16.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.066+0000 7f510dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:16.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.066+0000 7f510dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:16.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.066+0000 7f510dffb640 10 monclient: dump: 2026-02-17T21:30:16.069 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:16.069 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:16.069 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:16.069 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:16.069 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:16.069 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:16.069 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:16.069 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:16.069 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:16.069 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:16.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.066+0000 7f5115934640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:16.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.066+0000 7f5115934640 4 set_mon_vals no callback set 2026-02-17T21:30:16.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.067+0000 7f5115934640 10 monclient: shutdown 2026-02-17T21:30:16.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.067+0000 7f5115934640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:16.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.067+0000 7f5115934640 1 -- 10.20.193.5:0/1652177980 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f51100c59c0 msgr2=0x7f511015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:16.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.067+0000 7f5115934640 1 --2- 10.20.193.5:0/1652177980 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f51100c59c0 0x7f511015d750 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5100009d90 tx=0x7f510002f230 comp rx=0 tx=0).stop 2026-02-17T21:30:16.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.067+0000 7f5115934640 1 -- 10.20.193.5:0/1652177980 shutdown_connections 2026-02-17T21:30:16.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.067+0000 7f5115934640 1 --2- 10.20.193.5:0/1652177980 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f51100c59c0 0x7f511015d750 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:16.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.067+0000 7f5115934640 1 -- 10.20.193.5:0/1652177980 >> 10.20.193.5:0/1652177980 conn(0x7f51100c9f20 msgr2=0x7f51100ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:16.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.067+0000 7f5115934640 1 -- 10.20.193.5:0/1652177980 shutdown_connections 2026-02-17T21:30:16.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.067+0000 7f5115934640 1 -- 10.20.193.5:0/1652177980 wait complete. 2026-02-17T21:30:16.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.067+0000 7f5115934640 10 monclient: build_initial_monmap 2026-02-17T21:30:16.071 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.067+0000 7f5115934640 10 monclient: monmap: 2026-02-17T21:30:16.071 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:16.071 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:16.071 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:16.071 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:16.071 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:16.071 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:16.071 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:16.071 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:16.071 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:16.071 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.067+0000 7f5115934640 1 librados: starting msgr at 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.067+0000 7f5115934640 1 librados: starting objecter 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.067+0000 7f5115934640 1 Processor -- start 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.067+0000 7f5115934640 1 -- start start 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.067+0000 7f5115934640 1 librados: setting wanted keys 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.067+0000 7f5115934640 1 librados: calling monclient init 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.067+0000 7f5115934640 10 monclient: init 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f5115934640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f5115934640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f5115934640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f51100c59c0 0x7f51100cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f5115934640 10 monclient(hunting): picked mon.noname-b con 0x7f51100c59c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f5115934640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f51100c7e20 0x7f51101f3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f5115934640 10 monclient(hunting): picked mon.noname-c con 0x7f51100c7e20 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f5115934640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f511015d370 0x7f51101f4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f5115934640 10 monclient(hunting): picked mon.noname-a con 0x7f511015d370 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f5115934640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f5115934640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f51100c8ed0 con 0x7f511015d370 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f5115934640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f5115934640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f51100c9240 con 0x7f51100c59c0 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f5115934640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f5115934640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f51100c96d0 con 0x7f51100c7e20 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f5115934640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f5115934640 10 monclient(hunting): authenticate will time out at 1321.633370s 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f510f7fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f511015d370 0x7f51101f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f510effd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f51100c59c0 0x7f51100cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f510e7fc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f51100c7e20 0x7f51101f3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f510f7fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f511015d370 0x7f51101f4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:49952/0 (socket says 10.20.193.5:49952) 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f510f7fe640 1 -- 10.20.193.5:0/693561317 learned_addr learned my addr 10.20.193.5:0/693561317 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:16.072 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f510f7fe640 10 monclient(hunting): get_auth_request con 0x7f511015d370 auth_method 0 2026-02-17T21:30:16.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f510f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:16.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f510f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:16.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f510f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:16.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f510effd640 10 monclient(hunting): get_auth_request con 0x7f51100c59c0 auth_method 0 2026-02-17T21:30:16.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f510effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:16.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f510effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:16.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f510effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:16.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f510e7fc640 10 monclient(hunting): get_auth_request con 0x7f51100c7e20 auth_method 0 2026-02-17T21:30:16.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f510e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:16.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f510e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:16.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.068+0000 7f510e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:16.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.069+0000 7f510f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:16.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.069+0000 7f510f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:16.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.069+0000 7f510f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:16.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.069+0000 7f510effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:16.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.069+0000 7f510effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:16.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.069+0000 7f510effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:16.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.069+0000 7f510e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:16.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.069+0000 7f510e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:16.073 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.069+0000 7f510e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:16.074 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.070+0000 7f510e7fc640 10 monclient(hunting): handle_auth_done global_id 5105 payload 824 2026-02-17T21:30:16.074 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.070+0000 7f510e7fc640 1 -- 10.20.193.5:0/693561317 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f51100c59c0 msgr2=0x7f51100cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.070+0000 7f510e7fc640 1 --2- 10.20.193.5:0/693561317 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f51100c59c0 0x7f51100cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.070+0000 7f510e7fc640 1 -- 10.20.193.5:0/693561317 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f511015d370 msgr2=0x7f51101f4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.070+0000 7f510e7fc640 1 --2- 10.20.193.5:0/693561317 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f511015d370 0x7f51101f4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.070+0000 7f510e7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.070+0000 7f510e7fc640 1 monclient: found mon.noname-c 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.070+0000 7f510e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.070+0000 7f510e7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.070+0000 7f510e7fc640 1 -- 10.20.193.5:0/693561317 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51100cb6d0 con 0x7f51100c7e20 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.071+0000 7f510e7fc640 1 --2- 10.20.193.5:0/693561317 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f51100c7e20 0x7f51101f3e90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f50f800c500 tx=0x7f50f800c9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.071+0000 7f50e7fff640 10 client.?.objecter ms_handle_connect 0x7f51100c7e20 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.071+0000 7f50e7fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.072+0000 7f50e7fff640 1 -- 10.20.193.5:0/693561317 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f8017070 con 0x7f51100c7e20 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.072+0000 7f50e7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.072+0000 7f50e7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.072+0000 7f50e7fff640 10 monclient: dump: 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.072+0000 7f50e7fff640 10 monclient: _finish_auth 0 2026-02-17T21:30:16.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.072+0000 7f50e7fff640 10 monclient: _check_auth_tickets 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.072+0000 7f50e7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.072+0000 7f5115934640 5 monclient: authenticate success, global_id 5105 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.072+0000 7f5115934640 10 monclient: _renew_subs 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.072+0000 7f5115934640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.072+0000 7f5115934640 1 -- 10.20.193.5:0/693561317 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51100cb9b0 con 0x7f51100c7e20 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.072+0000 7f5115934640 10 client.5105.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.072+0000 7f5115934640 10 monclient: _renew_subs 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.072+0000 7f5115934640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.072+0000 7f5115934640 1 -- 10.20.193.5:0/693561317 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51100cbf70 con 0x7f51100c7e20 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.072+0000 7f5115934640 1 librados: init done 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.073+0000 7f5115934640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.073+0000 7f5115934640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.073+0000 7f5115934640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.073+0000 7f5115934640 1 -- 10.20.193.5:0/693561317 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f511015d750 con 0x7f51100c7e20 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.073+0000 7f50e7fff640 1 -- 10.20.193.5:0/693561317 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f8005de0 con 0x7f51100c7e20 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.073+0000 7f50e7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.073+0000 7f50e7fff640 1 -- 10.20.193.5:0/693561317 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f8021060 con 0x7f51100c7e20 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.073+0000 7f50e7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.073+0000 7f50e7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.073+0000 7f50e7fff640 10 monclient: dump: 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:16.076 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:16.077 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:16.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.073+0000 7f510d7fa640 4 set_mon_vals no callback set 2026-02-17T21:30:16.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.178+0000 7f50e7fff640 1 -- 10.20.193.5:0/693561317 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f50f8024080 con 0x7f51100c7e20 2026-02-17T21:30:16.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.179+0000 7f50e7fff640 1 --2- 10.20.193.5:0/693561317 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f50e00792b0 0x7f50e007b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:16.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.179+0000 7f510effd640 1 --2- 10.20.193.5:0/693561317 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f50e00792b0 0x7f50e007b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:16.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.179+0000 7f510effd640 10 monclient: get_auth_request con 0x7f50e00792b0 auth_method 0 2026-02-17T21:30:16.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.180+0000 7f50e7fff640 1 -- 10.20.193.5:0/693561317 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f50f805d8b0 con 0x7f51100c7e20 2026-02-17T21:30:16.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.180+0000 7f50e7fff640 10 client.5105.objecter ms_dispatch2 0x7f5110000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:16.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.180+0000 7f50e7fff640 3 client.5105.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:16.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.180+0000 7f50e7fff640 3 client.5105.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:16.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.180+0000 7f50e7fff640 20 client.5105.objecter dump_active .. 0 homeless 2026-02-17T21:30:16.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.180+0000 7f50e7fff640 10 client.5105.objecter ms_handle_connect 0x7f50e00792b0 2026-02-17T21:30:16.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.180+0000 7f510effd640 1 --2- 10.20.193.5:0/693561317 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f50e00792b0 0x7f50e007b770 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f51040052b0 tx=0x7f5104003d70 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:16.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.186+0000 7f50e7fff640 1 -- 10.20.193.5:0/693561317 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f50f8061870 con 0x7f51100c7e20 2026-02-17T21:30:16.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.186+0000 7f50e7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:16.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.186+0000 7f50e7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:16.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.286+0000 7f5115934640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:30:16.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.286+0000 7f5115934640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:16.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.286+0000 7f5115934640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:16.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.286+0000 7f5115934640 1 -- 10.20.193.5:0/693561317 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5110152c20 con 0x7f51100c7e20 2026-02-17T21:30:16.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.290+0000 7f50e7fff640 1 -- 10.20.193.5:0/693561317 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f50f8065b70 con 0x7f51100c7e20 2026-02-17T21:30:16.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.290+0000 7f50e7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:16.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.290+0000 7f50e7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:30:16.291 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:30:16.291 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:30:16.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.291+0000 7f5115934640 10 librados: watch_flush enter 2026-02-17T21:30:16.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.291+0000 7f5115934640 10 librados: watch_flush exit 2026-02-17T21:30:16.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.291+0000 7f5115934640 20 client.5105.objecter shutdown clearing up homeless session... 2026-02-17T21:30:16.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.291+0000 7f5115934640 10 client.5105.objecter successfully canceled tick 2026-02-17T21:30:16.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.291+0000 7f5115934640 1 -- 10.20.193.5:0/693561317 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f50e00792b0 msgr2=0x7f50e007b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:16.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.291+0000 7f5115934640 1 --2- 10.20.193.5:0/693561317 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f50e00792b0 0x7f50e007b770 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f51040052b0 tx=0x7f5104003d70 comp rx=0 tx=0).stop 2026-02-17T21:30:16.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.291+0000 7f5115934640 10 monclient: shutdown 2026-02-17T21:30:16.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.291+0000 7f5115934640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:16.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.291+0000 7f5115934640 1 -- 10.20.193.5:0/693561317 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f51100c7e20 msgr2=0x7f51101f3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:16.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.291+0000 7f5115934640 1 --2- 10.20.193.5:0/693561317 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f51100c7e20 0x7f51101f3e90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f50f800c500 tx=0x7f50f800c9d0 comp rx=0 tx=0).stop 2026-02-17T21:30:16.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.291+0000 7f5115934640 1 -- 10.20.193.5:0/693561317 shutdown_connections 2026-02-17T21:30:16.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.291+0000 7f5115934640 1 --2- 10.20.193.5:0/693561317 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f50e00792b0 0x7f50e007b770 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:16.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.291+0000 7f5115934640 1 --2- 10.20.193.5:0/693561317 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f511015d370 0x7f51101f4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:16.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.291+0000 7f5115934640 1 --2- 10.20.193.5:0/693561317 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f51100c7e20 0x7f51101f3e90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:16.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.291+0000 7f5115934640 1 --2- 10.20.193.5:0/693561317 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f51100c59c0 0x7f51100cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:16.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.291+0000 7f5115934640 1 -- 10.20.193.5:0/693561317 >> 10.20.193.5:0/693561317 conn(0x7f51100c9f20 msgr2=0x7f511015af00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:16.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.291+0000 7f5115934640 1 -- 10.20.193.5:0/693561317 shutdown_connections 2026-02-17T21:30:16.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.291+0000 7f5115934640 1 -- 10.20.193.5:0/693561317 wait complete. 2026-02-17T21:30:16.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:16.291+0000 7f5115934640 1 librados: shutdown 2026-02-17T21:30:17.707 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:06:57.333 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:17.709 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:06:57.335 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:17.721 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:06:57.346 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:17.735 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:06:57.359 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:17.737 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:06:57.361 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:17.738 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:06:57.324 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:17.740 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:06:57.326 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:17.747 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:06:57.371 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:17.751 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:06:57.337 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:19.301 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:30:19.369 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.368+0000 7f2cbbc7c640 10 monclient: get_monmap_and_config 2026-02-17T21:30:19.369 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.368+0000 7f2cbbc7c640 10 monclient: build_initial_monmap 2026-02-17T21:30:19.369 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.368+0000 7f2cbbc7c640 10 monclient: monmap: 2026-02-17T21:30:19.369 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:19.369 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:19.369 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:19.368778+0000 2026-02-17T21:30:19.369 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:19.368778+0000 2026-02-17T21:30:19.369 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:19.369 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:19.369 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:19.369 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:19.369 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:19.369 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:19.369 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:19.369 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:19.369 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:19.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.368+0000 7f2cbbc7c640 1 Processor -- start 2026-02-17T21:30:19.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.368+0000 7f2cbbc7c640 1 -- start start 2026-02-17T21:30:19.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.368+0000 7f2cbbc7c640 10 monclient: init 2026-02-17T21:30:19.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.369+0000 7f2cbbc7c640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:19.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.369+0000 7f2cbbc7c640 10 monclient: _add_conns ranks=[5,0,2,1,3,4] 2026-02-17T21:30:19.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.369+0000 7f2cbbc7c640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f2cb40c7170 0x7f2cb40c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:19.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.369+0000 7f2cbbc7c640 10 monclient(hunting): picked mon.noname-c con 0x7f2cb40c7170 addr v2:10.20.193.135:3300/0 2026-02-17T21:30:19.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.369+0000 7f2cbbc7c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2cb40c48c0 addr v1:10.20.193.5:6789/0 2026-02-17T21:30:19.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.369+0000 7f2cbbc7c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2cb40c4d10 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:19.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.369+0000 7f2cbbc7c640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cb415a9a0 con 0x7f2cb40c48c0 2026-02-17T21:30:19.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.369+0000 7f2cbbc7c640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cb40c5270 con 0x7f2cb40c4d10 2026-02-17T21:30:19.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.369+0000 7f2cbbc7c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:19.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.369+0000 7f2cbbc7c640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f2cb40c8530 con 0x7f2cb40c7170 2026-02-17T21:30:19.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.369+0000 7f2cbbc7c640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:19.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.369+0000 7f2cbbc7c640 10 monclient(hunting): authenticate will time out at 1324.934123s 2026-02-17T21:30:19.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.369+0000 7f2cb91f0640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f2cb40c48c0 0x7f2cb40749b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:38966/0 (socket says 10.20.193.5:38966) 2026-02-17T21:30:19.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.369+0000 7f2cb91f0640 1 -- 10.20.193.5:0/932390148 learned_addr learned my addr 10.20.193.5:0/932390148 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:19.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.369+0000 7f2cb99f1640 1 --2- 10.20.193.5:0/932390148 >> v2:10.20.193.135:3300/0 conn(0x7f2cb40c7170 0x7f2cb40c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:19.370 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.370+0000 7f2cb99f1640 10 monclient(hunting): get_auth_request con 0x7f2cb40c7170 auth_method 0 2026-02-17T21:30:19.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.370+0000 7f2cb99f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:19.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.370+0000 7f2cb99f1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:19.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.370+0000 7f2cb99f1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:19.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.370+0000 7f2cb99f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:19.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.370+0000 7f2cb99f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:19.371 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.370+0000 7f2cb99f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:19.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.371+0000 7f2cb89ef640 1 -- 10.20.193.5:0/932390148 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1574621363 0 0) 0x7f2cb415a9a0 con 0x7f2cb40c48c0 2026-02-17T21:30:19.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.371+0000 7f2cb89ef640 10 monclient(hunting): _negotiate 2026-02-17T21:30:19.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.371+0000 7f2cb89ef640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:19.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.371+0000 7f2cb89ef640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:19.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.371+0000 7f2cb89ef640 10 monclient(hunting): my global_id is 5058 2026-02-17T21:30:19.372 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.371+0000 7f2cb89ef640 1 -- 10.20.193.5:0/932390148 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c9c003620 con 0x7f2cb40c48c0 2026-02-17T21:30:19.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.372+0000 7f2cb99f1640 10 monclient(hunting): handle_auth_done global_id 5108 payload 274 2026-02-17T21:30:19.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.372+0000 7f2cb99f1640 1 -- 10.20.193.5:0/932390148 >> v1:10.20.193.135:6789/0 conn(0x7f2cb40c4d10 legacy=0x7f2cb40c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:19.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.372+0000 7f2cb99f1640 1 -- 10.20.193.5:0/932390148 >> v1:10.20.193.5:6789/0 conn(0x7f2cb40c48c0 legacy=0x7f2cb40749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:19.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.372+0000 7f2cb99f1640 10 monclient: _finish_hunting 0 2026-02-17T21:30:19.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.372+0000 7f2cb99f1640 1 monclient: found mon.noname-c 2026-02-17T21:30:19.373 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.372+0000 7f2cb99f1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:19.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.372+0000 7f2cb99f1640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:19.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.372+0000 7f2cb99f1640 1 -- 10.20.193.5:0/932390148 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb40c5550 con 0x7f2cb40c7170 2026-02-17T21:30:19.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.374+0000 7f2cb99f1640 1 --2- 10.20.193.5:0/932390148 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2cb40c7170 0x7f2cb40c7550 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40098a0 tx=0x7f2ca402ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb2270f7b7c65cd5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:19.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.376+0000 7f2cb89ef640 1 -- 10.20.193.5:0/932390148 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca403c070 con 0x7f2cb40c7170 2026-02-17T21:30:19.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.376+0000 7f2cb89ef640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:19.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.376+0000 7f2cb89ef640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:19.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.376+0000 7f2cb89ef640 10 monclient: dump: 2026-02-17T21:30:19.377 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:19.377 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:19.377 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:19.377 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:19.377 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:19.377 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:19.377 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.376+0000 7f2cb89ef640 10 monclient: _finish_auth 0 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.376+0000 7f2cb89ef640 10 monclient: _check_auth_tickets 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.376+0000 7f2cb89ef640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.376+0000 7f2cb89ef640 1 -- 10.20.193.5:0/932390148 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca402fb70 con 0x7f2cb40c7170 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.376+0000 7f2cb89ef640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.376+0000 7f2cb89ef640 1 -- 10.20.193.5:0/932390148 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4037440 con 0x7f2cb40c7170 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.376+0000 7f2cb89ef640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.376+0000 7f2cb89ef640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.376+0000 7f2cb89ef640 10 monclient: dump: 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.376+0000 7f2cbbc7c640 5 monclient: authenticate success, global_id 5108 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.376+0000 7f2cbbc7c640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.376+0000 7f2cbbc7c640 4 set_mon_vals no callback set 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.376+0000 7f2cbbc7c640 10 monclient: shutdown 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.376+0000 7f2cbbc7c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:19.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.376+0000 7f2cbbc7c640 1 -- 10.20.193.5:0/932390148 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2cb40c7170 msgr2=0x7f2cb40c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:19.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.376+0000 7f2cbbc7c640 1 --2- 10.20.193.5:0/932390148 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2cb40c7170 0x7f2cb40c7550 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40098a0 tx=0x7f2ca402ee60 comp rx=0 tx=0).stop 2026-02-17T21:30:19.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.377+0000 7f2cbbc7c640 1 -- 10.20.193.5:0/932390148 shutdown_connections 2026-02-17T21:30:19.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.377+0000 7f2cbbc7c640 1 --2- 10.20.193.5:0/932390148 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2cb40c7170 0x7f2cb40c7550 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:19.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.377+0000 7f2cbbc7c640 1 -- 10.20.193.5:0/932390148 >> 10.20.193.5:0/932390148 conn(0x7f2cb40c9f40 msgr2=0x7f2cb40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:19.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.377+0000 7f2cbbc7c640 1 -- 10.20.193.5:0/932390148 shutdown_connections 2026-02-17T21:30:19.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.377+0000 7f2cbbc7c640 1 -- 10.20.193.5:0/932390148 wait complete. 2026-02-17T21:30:19.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.377+0000 7f2cbbc7c640 10 monclient: build_initial_monmap 2026-02-17T21:30:19.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.377+0000 7f2cbbc7c640 10 monclient: monmap: 2026-02-17T21:30:19.379 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:19.379 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:19.379 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:19.379 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:19.379 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:19.379 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:19.379 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:19.379 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:19.379 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:19.379 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:19.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.377+0000 7f2cbbc7c640 1 librados: starting msgr at 2026-02-17T21:30:19.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.377+0000 7f2cbbc7c640 1 librados: starting objecter 2026-02-17T21:30:19.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.377+0000 7f2cbbc7c640 1 Processor -- start 2026-02-17T21:30:19.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.377+0000 7f2cbbc7c640 1 -- start start 2026-02-17T21:30:19.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.377+0000 7f2cbbc7c640 1 librados: setting wanted keys 2026-02-17T21:30:19.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.377+0000 7f2cbbc7c640 1 librados: calling monclient init 2026-02-17T21:30:19.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.377+0000 7f2cbbc7c640 10 monclient: init 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.378+0000 7f2cbbc7c640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.378+0000 7f2cbbc7c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.378+0000 7f2cbbc7c640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2cb40c48c0 0x7f2cb41f5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.378+0000 7f2cbbc7c640 10 monclient(hunting): picked mon.noname-c con 0x7f2cb40c48c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.378+0000 7f2cbbc7c640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2cb40c4d10 0x7f2cb415c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.378+0000 7f2cbbc7c640 10 monclient(hunting): picked mon.noname-a con 0x7f2cb40c4d10 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.378+0000 7f2cbbc7c640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2cb40c7170 0x7f2cb4159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.378+0000 7f2cbbc7c640 10 monclient(hunting): picked mon.noname-b con 0x7f2cb40c7170 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.378+0000 7f2cbbc7c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.378+0000 7f2cbbc7c640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb40c81c0 con 0x7f2cb40c4d10 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.378+0000 7f2cbbc7c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.378+0000 7f2cbbc7c640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb40c7ee0 con 0x7f2cb40c7170 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.378+0000 7f2cbbc7c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.378+0000 7f2cbbc7c640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb40750c0 con 0x7f2cb40c48c0 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.378+0000 7f2cbbc7c640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.378+0000 7f2cbbc7c640 10 monclient(hunting): authenticate will time out at 1324.943536s 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.378+0000 7f2cb99f1640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2cb40c48c0 0x7f2cb41f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.379+0000 7f2cb99f1640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2cb40c48c0 0x7f2cb41f5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:50856/0 (socket says 10.20.193.5:50856) 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.379+0000 7f2cb99f1640 1 -- 10.20.193.5:0/3459409187 learned_addr learned my addr 10.20.193.5:0/3459409187 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.379+0000 7f2cb99f1640 10 monclient(hunting): get_auth_request con 0x7f2cb40c48c0 auth_method 0 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.379+0000 7f2cb99f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.379+0000 7f2cb99f1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.379+0000 7f2cb99f1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.379+0000 7f2cba1f2640 1 --2- 10.20.193.5:0/3459409187 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2cb40c7170 0x7f2cb4159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.379+0000 7f2cb99f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.379+0000 7f2cb99f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:19.380 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.379+0000 7f2cb99f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:19.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.379+0000 7f2cba1f2640 10 monclient(hunting): get_auth_request con 0x7f2cb40c7170 auth_method 0 2026-02-17T21:30:19.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.379+0000 7f2cba1f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:19.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.379+0000 7f2cba1f2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:19.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.379+0000 7f2cba1f2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:19.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.379+0000 7f2cba1f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:19.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.379+0000 7f2cba1f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:19.381 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.379+0000 7f2cba1f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:19.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.381+0000 7f2cb99f1640 10 monclient(hunting): handle_auth_done global_id 5114 payload 824 2026-02-17T21:30:19.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.381+0000 7f2cb99f1640 1 -- 10.20.193.5:0/3459409187 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2cb40c7170 msgr2=0x7f2cb4159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:19.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.381+0000 7f2cb99f1640 1 --2- 10.20.193.5:0/3459409187 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2cb40c7170 0x7f2cb4159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:19.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.381+0000 7f2cb99f1640 1 -- 10.20.193.5:0/3459409187 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2cb40c4d10 msgr2=0x7f2cb415c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:19.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.381+0000 7f2cb99f1640 1 --2- 10.20.193.5:0/3459409187 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2cb40c4d10 0x7f2cb415c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:19.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.381+0000 7f2cb99f1640 10 monclient: _finish_hunting 0 2026-02-17T21:30:19.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.381+0000 7f2cb99f1640 1 monclient: found mon.noname-c 2026-02-17T21:30:19.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.381+0000 7f2cb99f1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:19.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.381+0000 7f2cb99f1640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:19.382 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.381+0000 7f2cb99f1640 1 -- 10.20.193.5:0/3459409187 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb41f5a70 con 0x7f2cb40c48c0 2026-02-17T21:30:19.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.382+0000 7f2cb99f1640 1 --2- 10.20.193.5:0/3459409187 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2cb40c48c0 0x7f2cb41f5530 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4009130 tx=0x7f2ca40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:19.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.382+0000 7f2ca27fc640 10 client.?.objecter ms_handle_connect 0x7f2cb40c48c0 2026-02-17T21:30:19.383 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.382+0000 7f2ca27fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:19.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.383+0000 7f2ca27fc640 1 -- 10.20.193.5:0/3459409187 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca403c040 con 0x7f2cb40c48c0 2026-02-17T21:30:19.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.383+0000 7f2ca27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:19.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.383+0000 7f2ca27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:19.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.383+0000 7f2ca27fc640 10 monclient: dump: 2026-02-17T21:30:19.384 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:19.384 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:19.384 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:19.384 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:19.384 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:19.384 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:19.384 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:19.384 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:19.384 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:19.384 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:19.384 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.383+0000 7f2ca27fc640 10 monclient: _finish_auth 0 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.383+0000 7f2ca27fc640 10 monclient: _check_auth_tickets 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.383+0000 7f2ca27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.383+0000 7f2cbbc7c640 5 monclient: authenticate success, global_id 5114 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.383+0000 7f2cbbc7c640 10 monclient: _renew_subs 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.383+0000 7f2cbbc7c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.383+0000 7f2cbbc7c640 1 -- 10.20.193.5:0/3459409187 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb415b290 con 0x7f2cb40c48c0 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.383+0000 7f2cbbc7c640 10 client.5114.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.383+0000 7f2cbbc7c640 10 monclient: _renew_subs 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.383+0000 7f2cbbc7c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.383+0000 7f2cbbc7c640 1 -- 10.20.193.5:0/3459409187 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb415b800 con 0x7f2cb40c48c0 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.383+0000 7f2cbbc7c640 1 librados: init done 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.383+0000 7f2ca27fc640 1 -- 10.20.193.5:0/3459409187 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca402fab0 con 0x7f2cb40c48c0 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.383+0000 7f2ca27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.383+0000 7f2ca27fc640 1 -- 10.20.193.5:0/3459409187 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4042810 con 0x7f2cb40c48c0 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.383+0000 7f2ca27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.383+0000 7f2ca27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.383+0000 7f2ca3fff640 4 set_mon_vals no callback set 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.383+0000 7f2ca27fc640 10 monclient: dump: 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.384+0000 7f2cbbc7c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.384+0000 7f2cbbc7c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.384+0000 7f2cbbc7c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:19.385 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.384+0000 7f2cbbc7c640 1 -- 10.20.193.5:0/3459409187 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cb40c7550 con 0x7f2cb40c48c0 2026-02-17T21:30:19.397 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.396+0000 7f2ca27fc640 1 -- 10.20.193.5:0/3459409187 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f2ca40429b0 con 0x7f2cb40c48c0 2026-02-17T21:30:19.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.396+0000 7f2ca27fc640 1 --2- 10.20.193.5:0/3459409187 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2c840792b0 0x7f2c8407b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:19.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.396+0000 7f2cb91f0640 1 --2- 10.20.193.5:0/3459409187 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2c840792b0 0x7f2c8407b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:19.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.396+0000 7f2cb91f0640 10 monclient: get_auth_request con 0x7f2c840792b0 auth_method 0 2026-02-17T21:30:19.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.397+0000 7f2ca27fc640 10 client.5114.objecter ms_handle_connect 0x7f2c840792b0 2026-02-17T21:30:19.398 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.397+0000 7f2cb91f0640 1 --2- 10.20.193.5:0/3459409187 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2c840792b0 0x7f2c8407b770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8002a30 tx=0x7f2ca80079f0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:19.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.398+0000 7f2ca27fc640 1 -- 10.20.193.5:0/3459409187 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f2ca4042cd0 con 0x7f2cb40c48c0 2026-02-17T21:30:19.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.398+0000 7f2ca27fc640 10 client.5114.objecter ms_dispatch2 0x7f2cb4000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:19.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.398+0000 7f2ca27fc640 3 client.5114.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:19.399 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.398+0000 7f2ca27fc640 3 client.5114.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:19.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.398+0000 7f2ca27fc640 20 client.5114.objecter dump_active .. 0 homeless 2026-02-17T21:30:19.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.498+0000 7f2ca27fc640 1 -- 10.20.193.5:0/3459409187 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2ca4051080 con 0x7f2cb40c48c0 2026-02-17T21:30:19.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.498+0000 7f2ca27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:19.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.498+0000 7f2ca27fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:19.597 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.596+0000 7f2cbbc7c640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:30:19.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.596+0000 7f2cbbc7c640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:19.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.596+0000 7f2cbbc7c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:19.598 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.596+0000 7f2cbbc7c640 1 -- 10.20.193.5:0/3459409187 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2cb40737b0 con 0x7f2cb40c48c0 2026-02-17T21:30:19.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.599+0000 7f2ca27fc640 1 -- 10.20.193.5:0/3459409187 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f2cb41f5a70 con 0x7f2cb40c48c0 2026-02-17T21:30:19.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.599+0000 7f2ca27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:19.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.599+0000 7f2ca27fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:30:19.600 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:30:19.600 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:30:19.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.599+0000 7f2cbbc7c640 10 librados: watch_flush enter 2026-02-17T21:30:19.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.599+0000 7f2cbbc7c640 10 librados: watch_flush exit 2026-02-17T21:30:19.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.599+0000 7f2cbbc7c640 20 client.5114.objecter shutdown clearing up homeless session... 2026-02-17T21:30:19.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.600+0000 7f2cbbc7c640 10 client.5114.objecter successfully canceled tick 2026-02-17T21:30:19.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.600+0000 7f2cbbc7c640 1 -- 10.20.193.5:0/3459409187 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2c840792b0 msgr2=0x7f2c8407b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:19.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.600+0000 7f2cbbc7c640 1 --2- 10.20.193.5:0/3459409187 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2c840792b0 0x7f2c8407b770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8002a30 tx=0x7f2ca80079f0 comp rx=0 tx=0).stop 2026-02-17T21:30:19.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.600+0000 7f2cbbc7c640 10 monclient: shutdown 2026-02-17T21:30:19.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.600+0000 7f2cbbc7c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:19.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.600+0000 7f2cbbc7c640 1 -- 10.20.193.5:0/3459409187 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2cb40c48c0 msgr2=0x7f2cb41f5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:19.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.600+0000 7f2cbbc7c640 1 --2- 10.20.193.5:0/3459409187 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2cb40c48c0 0x7f2cb41f5530 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4009130 tx=0x7f2ca40047c0 comp rx=0 tx=0).stop 2026-02-17T21:30:19.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.600+0000 7f2cbbc7c640 1 -- 10.20.193.5:0/3459409187 shutdown_connections 2026-02-17T21:30:19.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.600+0000 7f2cbbc7c640 1 --2- 10.20.193.5:0/3459409187 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2c840792b0 0x7f2c8407b770 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:19.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.600+0000 7f2cbbc7c640 1 --2- 10.20.193.5:0/3459409187 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2cb40c7170 0x7f2cb4159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:19.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.600+0000 7f2cbbc7c640 1 --2- 10.20.193.5:0/3459409187 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2cb40c4d10 0x7f2cb415c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:19.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.600+0000 7f2cbbc7c640 1 --2- 10.20.193.5:0/3459409187 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2cb40c48c0 0x7f2cb41f5530 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:19.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.600+0000 7f2cbbc7c640 1 -- 10.20.193.5:0/3459409187 >> 10.20.193.5:0/3459409187 conn(0x7f2cb40c9f40 msgr2=0x7f2cb40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:19.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.600+0000 7f2cbbc7c640 1 -- 10.20.193.5:0/3459409187 shutdown_connections 2026-02-17T21:30:19.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.600+0000 7f2cbbc7c640 1 -- 10.20.193.5:0/3459409187 wait complete. 2026-02-17T21:30:19.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:19.600+0000 7f2cbbc7c640 1 librados: shutdown 2026-02-17T21:30:22.611 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:30:22.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.677+0000 7f2c17cb0640 10 monclient: get_monmap_and_config 2026-02-17T21:30:22.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.677+0000 7f2c17cb0640 10 monclient: build_initial_monmap 2026-02-17T21:30:22.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.677+0000 7f2c17cb0640 10 monclient: monmap: 2026-02-17T21:30:22.680 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:22.680 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:22.680 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:22.678624+0000 2026-02-17T21:30:22.680 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:22.678624+0000 2026-02-17T21:30:22.680 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:22.680 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:22.680 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:22.680 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:22.680 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:22.680 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:22.681 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:22.681 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:22.681 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:22.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.678+0000 7f2c17cb0640 1 Processor -- start 2026-02-17T21:30:22.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.678+0000 7f2c17cb0640 1 -- start start 2026-02-17T21:30:22.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.678+0000 7f2c17cb0640 10 monclient: init 2026-02-17T21:30:22.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.678+0000 7f2c17cb0640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:22.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.678+0000 7f2c17cb0640 10 monclient: _add_conns ranks=[4,0,2,1,3,5] 2026-02-17T21:30:22.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.678+0000 7f2c17cb0640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f2c1015d370 0x7f2c1015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:22.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.678+0000 7f2c17cb0640 10 monclient(hunting): picked mon.noname-b con 0x7f2c1015d370 addr v2:10.20.193.119:3300/0 2026-02-17T21:30:22.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.678+0000 7f2c17cb0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2c100c7e20 addr v1:10.20.193.5:6789/0 2026-02-17T21:30:22.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.678+0000 7f2c17cb0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2c100c74c0 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:22.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.678+0000 7f2c17cb0640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c100c8350 con 0x7f2c100c7e20 2026-02-17T21:30:22.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.678+0000 7f2c17cb0640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c100c8630 con 0x7f2c100c74c0 2026-02-17T21:30:22.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.678+0000 7f2c17cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:22.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.678+0000 7f2c17cb0640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f2c1015b710 con 0x7f2c1015d370 2026-02-17T21:30:22.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.678+0000 7f2c17cb0640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:22.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.678+0000 7f2c17cb0640 10 monclient(hunting): authenticate will time out at 1328.243913s 2026-02-17T21:30:22.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.679+0000 7f2c15a25640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f2c1015d370 0x7f2c1015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:22.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.679+0000 7f2c16226640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f2c100c74c0 0x7f2c100c52b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:57972/0 (socket says 10.20.193.5:57972) 2026-02-17T21:30:22.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.679+0000 7f2c16226640 1 -- 10.20.193.5:0/2744967596 learned_addr learned my addr 10.20.193.5:0/2744967596 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:22.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.679+0000 7f2c15a25640 10 monclient(hunting): get_auth_request con 0x7f2c1015d370 auth_method 0 2026-02-17T21:30:22.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.679+0000 7f2c15a25640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:22.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.679+0000 7f2c15a25640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:22.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.679+0000 7f2c15a25640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:22.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.679+0000 7f2c15a25640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:22.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.679+0000 7f2c15a25640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:22.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.679+0000 7f2c15a25640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:22.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.680+0000 7f2c15a25640 10 monclient(hunting): handle_auth_done global_id 5119 payload 274 2026-02-17T21:30:22.686 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.680+0000 7f2c15a25640 1 -- 10.20.193.5:0/2744967596 >> v1:10.20.193.135:6789/0 conn(0x7f2c100c74c0 legacy=0x7f2c100c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:22.686 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.680+0000 7f2c15a25640 1 -- 10.20.193.5:0/2744967596 >> v1:10.20.193.5:6789/0 conn(0x7f2c100c7e20 legacy=0x7f2c1015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:22.686 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.680+0000 7f2c15a25640 10 monclient: _finish_hunting 0 2026-02-17T21:30:22.686 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.680+0000 7f2c15a25640 1 monclient: found mon.noname-b 2026-02-17T21:30:22.686 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.680+0000 7f2c15a25640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:22.686 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.680+0000 7f2c15a25640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:30:22.686 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.680+0000 7f2c15a25640 1 -- 10.20.193.5:0/2744967596 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c100c8910 con 0x7f2c1015d370 2026-02-17T21:30:22.686 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.681+0000 7f2c15a25640 1 --2- 10.20.193.5:0/2744967596 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2c1015d370 0x7f2c1015d750 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2c000098a0 tx=0x7f2c0002ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c12eaa9fb8d04740 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:22.693 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.683+0000 7f2c14a23640 1 -- 10.20.193.5:0/2744967596 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0003c070 con 0x7f2c1015d370 2026-02-17T21:30:22.693 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.683+0000 7f2c14a23640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:22.693 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.683+0000 7f2c14a23640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:30:22.693 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.683+0000 7f2c14a23640 10 monclient: dump: 2026-02-17T21:30:22.693 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:22.693 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:22.693 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:22.693 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:22.693 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:22.693 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:22.694 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:22.694 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:22.694 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:22.694 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:22.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.683+0000 7f2c14a23640 10 monclient: _finish_auth 0 2026-02-17T21:30:22.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.683+0000 7f2c14a23640 10 monclient: _check_auth_tickets 2026-02-17T21:30:22.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.683+0000 7f2c14a23640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:22.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.683+0000 7f2c14a23640 1 -- 10.20.193.5:0/2744967596 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c0002fad0 con 0x7f2c1015d370 2026-02-17T21:30:22.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.683+0000 7f2c17cb0640 5 monclient: authenticate success, global_id 5119 2026-02-17T21:30:22.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.683+0000 7f2c17cb0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:22.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.683+0000 7f2c14a23640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:22.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.683+0000 7f2c14a23640 1 -- 10.20.193.5:0/2744967596 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c00037440 con 0x7f2c1015d370 2026-02-17T21:30:22.695 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.683+0000 7f2c17cb0640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:22.695 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.683+0000 7f2c17cb0640 4 set_mon_vals no callback set 2026-02-17T21:30:22.695 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.683+0000 7f2c14a23640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:22.695 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.683+0000 7f2c14a23640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:30:22.695 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.683+0000 7f2c14a23640 10 monclient: dump: 2026-02-17T21:30:22.695 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:22.695 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:22.695 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:22.695 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:22.695 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:22.695 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:22.695 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:22.696 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:22.696 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:22.696 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:22.696 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.683+0000 7f2c17cb0640 10 monclient: shutdown 2026-02-17T21:30:22.696 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.683+0000 7f2c17cb0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:22.696 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.683+0000 7f2c17cb0640 1 -- 10.20.193.5:0/2744967596 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2c1015d370 msgr2=0x7f2c1015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:22.696 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.683+0000 7f2c17cb0640 1 --2- 10.20.193.5:0/2744967596 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2c1015d370 0x7f2c1015d750 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2c000098a0 tx=0x7f2c0002ee10 comp rx=0 tx=0).stop 2026-02-17T21:30:22.696 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.683+0000 7f2c17cb0640 1 -- 10.20.193.5:0/2744967596 shutdown_connections 2026-02-17T21:30:22.696 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.683+0000 7f2c17cb0640 1 --2- 10.20.193.5:0/2744967596 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2c1015d370 0x7f2c1015d750 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:22.696 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.683+0000 7f2c17cb0640 1 -- 10.20.193.5:0/2744967596 >> 10.20.193.5:0/2744967596 conn(0x7f2c100c9f20 msgr2=0x7f2c100ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:22.696 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.683+0000 7f2c17cb0640 1 -- 10.20.193.5:0/2744967596 shutdown_connections 2026-02-17T21:30:22.696 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.684+0000 7f2c17cb0640 1 -- 10.20.193.5:0/2744967596 wait complete. 2026-02-17T21:30:22.697 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.684+0000 7f2c17cb0640 10 monclient: build_initial_monmap 2026-02-17T21:30:22.697 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.684+0000 7f2c17cb0640 10 monclient: monmap: 2026-02-17T21:30:22.697 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:22.697 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:22.697 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:22.697 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:22.697 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:22.697 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:22.697 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:22.697 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:22.697 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:22.697 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:22.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.684+0000 7f2c17cb0640 1 librados: starting msgr at 2026-02-17T21:30:22.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.684+0000 7f2c17cb0640 1 librados: starting objecter 2026-02-17T21:30:22.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.684+0000 7f2c17cb0640 1 Processor -- start 2026-02-17T21:30:22.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.684+0000 7f2c17cb0640 1 -- start start 2026-02-17T21:30:22.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.684+0000 7f2c17cb0640 1 librados: setting wanted keys 2026-02-17T21:30:22.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.684+0000 7f2c17cb0640 1 librados: calling monclient init 2026-02-17T21:30:22.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.684+0000 7f2c17cb0640 10 monclient: init 2026-02-17T21:30:22.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c17cb0640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:22.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c17cb0640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:30:22.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c17cb0640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2c100c74c0 0x7f2c1006dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:22.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c17cb0640 10 monclient(hunting): picked mon.noname-c con 0x7f2c100c74c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:22.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c17cb0640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2c100c7e20 0x7f2c10158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:22.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c17cb0640 10 monclient(hunting): picked mon.noname-a con 0x7f2c100c7e20 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:22.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c17cb0640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2c1015d370 0x7f2c10158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:22.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c17cb0640 10 monclient(hunting): picked mon.noname-b con 0x7f2c1015d370 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:22.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c17cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:22.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c17cb0640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2c100c8ed0 con 0x7f2c100c7e20 2026-02-17T21:30:22.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c17cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:22.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c17cb0640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2c100c9240 con 0x7f2c1015d370 2026-02-17T21:30:22.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c17cb0640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:22.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c17cb0640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2c100c96d0 con 0x7f2c100c74c0 2026-02-17T21:30:22.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c17cb0640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:22.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c17cb0640 10 monclient(hunting): authenticate will time out at 1328.250351s 2026-02-17T21:30:22.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c15224640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2c100c7e20 0x7f2c10158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:22.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c16226640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2c1015d370 0x7f2c10158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:22.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c15224640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2c100c7e20 0x7f2c10158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:60022/0 (socket says 10.20.193.5:60022) 2026-02-17T21:30:22.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c15224640 1 -- 10.20.193.5:0/4152990181 learned_addr learned my addr 10.20.193.5:0/4152990181 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:22.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c15224640 10 monclient(hunting): get_auth_request con 0x7f2c100c7e20 auth_method 0 2026-02-17T21:30:22.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c15224640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:22.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c15224640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:22.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c15224640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:22.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c15a25640 1 --2- 10.20.193.5:0/4152990181 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2c100c74c0 0x7f2c1006dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:22.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c16226640 10 monclient(hunting): get_auth_request con 0x7f2c1015d370 auth_method 0 2026-02-17T21:30:22.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c16226640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:22.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c16226640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:22.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c16226640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:22.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c15a25640 10 monclient(hunting): get_auth_request con 0x7f2c100c74c0 auth_method 0 2026-02-17T21:30:22.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c15a25640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:22.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c15a25640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:22.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.685+0000 7f2c15a25640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:22.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.686+0000 7f2c15224640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:22.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.686+0000 7f2c15224640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:22.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.686+0000 7f2c15224640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:22.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.686+0000 7f2c16226640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:22.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.686+0000 7f2c16226640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:22.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.686+0000 7f2c16226640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:22.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.686+0000 7f2c15a25640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:22.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.686+0000 7f2c15a25640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:22.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.686+0000 7f2c15a25640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:22.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.687+0000 7f2c15224640 10 monclient(hunting): handle_auth_done global_id 5061 payload 824 2026-02-17T21:30:22.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.687+0000 7f2c15224640 1 -- 10.20.193.5:0/4152990181 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2c100c74c0 msgr2=0x7f2c1006dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:22.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.687+0000 7f2c15224640 1 --2- 10.20.193.5:0/4152990181 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2c100c74c0 0x7f2c1006dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:22.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.687+0000 7f2c15224640 1 -- 10.20.193.5:0/4152990181 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2c1015d370 msgr2=0x7f2c10158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:22.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.687+0000 7f2c15224640 1 --2- 10.20.193.5:0/4152990181 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2c1015d370 0x7f2c10158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:22.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.687+0000 7f2c15224640 10 monclient: _finish_hunting 0 2026-02-17T21:30:22.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.687+0000 7f2c15224640 1 monclient: found mon.noname-a 2026-02-17T21:30:22.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.687+0000 7f2c15224640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:22.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.687+0000 7f2c15224640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:22.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.687+0000 7f2c15224640 1 -- 10.20.193.5:0/4152990181 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1006e780 con 0x7f2c100c7e20 2026-02-17T21:30:22.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.687+0000 7f2c16226640 1 --2- 10.20.193.5:0/4152990181 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2c1015d370 0x7f2c10158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T21:30:22.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.688+0000 7f2c15224640 1 --2- 10.20.193.5:0/4152990181 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2c100c7e20 0x7f2c10158600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400b570 tx=0x7f2c0400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:22.703 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.688+0000 7f2bfe7fc640 10 client.?.objecter ms_handle_connect 0x7f2c100c7e20 2026-02-17T21:30:22.703 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.688+0000 7f2bfe7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:22.703 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.690+0000 7f2bfe7fc640 1 -- 10.20.193.5:0/4152990181 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c04013020 con 0x7f2c100c7e20 2026-02-17T21:30:22.703 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.690+0000 7f2bfe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:22.703 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.690+0000 7f2bfe7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:22.703 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.690+0000 7f2bfe7fc640 10 monclient: dump: 2026-02-17T21:30:22.703 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:22.703 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:22.703 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:22.703 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:22.703 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:22.703 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:22.704 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:22.704 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:22.704 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:22.704 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:22.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.690+0000 7f2bfe7fc640 10 monclient: _finish_auth 0 2026-02-17T21:30:22.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.690+0000 7f2bfe7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:30:22.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.690+0000 7f2bfe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:22.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.690+0000 7f2bfe7fc640 1 -- 10.20.193.5:0/4152990181 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c040044a0 con 0x7f2c100c7e20 2026-02-17T21:30:22.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.690+0000 7f2bfe7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:22.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.690+0000 7f2bfe7fc640 1 -- 10.20.193.5:0/4152990181 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c040029c0 con 0x7f2c100c7e20 2026-02-17T21:30:22.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.690+0000 7f2bfe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:22.704 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.690+0000 7f2bfe7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:22.705 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.690+0000 7f2bfe7fc640 10 monclient: dump: 2026-02-17T21:30:22.705 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:22.705 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:22.705 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:22.705 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:22.705 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:22.705 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:22.705 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:22.705 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:22.705 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:22.705 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:22.705 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.690+0000 7f2c17cb0640 5 monclient: authenticate success, global_id 5061 2026-02-17T21:30:22.705 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.690+0000 7f2c17cb0640 10 monclient: _renew_subs 2026-02-17T21:30:22.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.690+0000 7f2c17cb0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:22.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.690+0000 7f2bfffff640 4 set_mon_vals no callback set 2026-02-17T21:30:22.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.690+0000 7f2c17cb0640 1 -- 10.20.193.5:0/4152990181 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c1006ea60 con 0x7f2c100c7e20 2026-02-17T21:30:22.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.690+0000 7f2c17cb0640 10 client.5061.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:22.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.690+0000 7f2c17cb0640 10 monclient: _renew_subs 2026-02-17T21:30:22.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.690+0000 7f2c17cb0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:22.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.690+0000 7f2c17cb0640 1 -- 10.20.193.5:0/4152990181 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c10157e00 con 0x7f2c100c7e20 2026-02-17T21:30:22.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.690+0000 7f2c17cb0640 1 librados: init done 2026-02-17T21:30:22.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.691+0000 7f2c17cb0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:22.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.691+0000 7f2c17cb0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:22.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.691+0000 7f2c17cb0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:22.706 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.691+0000 7f2c17cb0640 1 -- 10.20.193.5:0/4152990181 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c1015d750 con 0x7f2c100c7e20 2026-02-17T21:30:22.796 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.795+0000 7f2bfe7fc640 1 -- 10.20.193.5:0/4152990181 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f2c04002b60 con 0x7f2c100c7e20 2026-02-17T21:30:22.797 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.795+0000 7f2bfe7fc640 1 --2- 10.20.193.5:0/4152990181 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2be00792b0 0x7f2be007b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:22.797 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.796+0000 7f2c15a25640 1 --2- 10.20.193.5:0/4152990181 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2be00792b0 0x7f2be007b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:22.797 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.796+0000 7f2c15a25640 10 monclient: get_auth_request con 0x7f2be00792b0 auth_method 0 2026-02-17T21:30:22.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.796+0000 7f2bfe7fc640 10 client.5061.objecter ms_handle_connect 0x7f2be00792b0 2026-02-17T21:30:22.798 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.796+0000 7f2c15a25640 1 --2- 10.20.193.5:0/4152990181 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2be00792b0 0x7f2be007b770 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2c00039000 tx=0x7f2c00033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:22.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.803+0000 7f2bfe7fc640 1 -- 10.20.193.5:0/4152990181 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f2c0405e3a0 con 0x7f2c100c7e20 2026-02-17T21:30:22.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.803+0000 7f2bfe7fc640 10 client.5061.objecter ms_dispatch2 0x7f2c10000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:22.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.803+0000 7f2bfe7fc640 3 client.5061.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:22.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.803+0000 7f2bfe7fc640 3 client.5061.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:22.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.803+0000 7f2bfe7fc640 20 client.5061.objecter dump_active .. 0 homeless 2026-02-17T21:30:22.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.803+0000 7f2bfe7fc640 1 -- 10.20.193.5:0/4152990181 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2c0401d020 con 0x7f2c100c7e20 2026-02-17T21:30:22.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.803+0000 7f2bfe7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:22.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.803+0000 7f2bfe7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:22.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.902+0000 7f2c17cb0640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:30:22.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.902+0000 7f2c17cb0640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:22.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.902+0000 7f2c17cb0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:22.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.902+0000 7f2c17cb0640 1 -- 10.20.193.5:0/4152990181 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2c1015bca0 con 0x7f2c100c7e20 2026-02-17T21:30:22.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.905+0000 7f2bfe7fc640 1 -- 10.20.193.5:0/4152990181 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f2c04062360 con 0x7f2c100c7e20 2026-02-17T21:30:22.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.905+0000 7f2bfe7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:22.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.905+0000 7f2bfe7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:30:22.907 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:30:22.908 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:30:22.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.907+0000 7f2c17cb0640 10 librados: watch_flush enter 2026-02-17T21:30:22.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.907+0000 7f2c17cb0640 10 librados: watch_flush exit 2026-02-17T21:30:22.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.907+0000 7f2c17cb0640 20 client.5061.objecter shutdown clearing up homeless session... 2026-02-17T21:30:22.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.907+0000 7f2c17cb0640 10 client.5061.objecter successfully canceled tick 2026-02-17T21:30:22.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.907+0000 7f2c17cb0640 1 -- 10.20.193.5:0/4152990181 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2be00792b0 msgr2=0x7f2be007b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:22.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.907+0000 7f2c17cb0640 1 --2- 10.20.193.5:0/4152990181 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2be00792b0 0x7f2be007b770 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2c00039000 tx=0x7f2c00033000 comp rx=0 tx=0).stop 2026-02-17T21:30:22.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.907+0000 7f2c17cb0640 10 monclient: shutdown 2026-02-17T21:30:22.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.907+0000 7f2c17cb0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:22.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.907+0000 7f2c17cb0640 1 -- 10.20.193.5:0/4152990181 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2c100c7e20 msgr2=0x7f2c10158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:22.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.907+0000 7f2c17cb0640 1 --2- 10.20.193.5:0/4152990181 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2c100c7e20 0x7f2c10158600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400b570 tx=0x7f2c0400ba40 comp rx=0 tx=0).stop 2026-02-17T21:30:22.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.907+0000 7f2c17cb0640 1 -- 10.20.193.5:0/4152990181 shutdown_connections 2026-02-17T21:30:22.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.907+0000 7f2c17cb0640 1 --2- 10.20.193.5:0/4152990181 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2be00792b0 0x7f2be007b770 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:22.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.907+0000 7f2c17cb0640 1 --2- 10.20.193.5:0/4152990181 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2c1015d370 0x7f2c10158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:22.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.907+0000 7f2c17cb0640 1 --2- 10.20.193.5:0/4152990181 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2c100c7e20 0x7f2c10158600 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:22.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.907+0000 7f2c17cb0640 1 --2- 10.20.193.5:0/4152990181 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2c100c74c0 0x7f2c1006dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:22.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.907+0000 7f2c17cb0640 1 -- 10.20.193.5:0/4152990181 >> 10.20.193.5:0/4152990181 conn(0x7f2c100c9f20 msgr2=0x7f2c10152990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:22.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.907+0000 7f2c17cb0640 1 -- 10.20.193.5:0/4152990181 shutdown_connections 2026-02-17T21:30:22.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.907+0000 7f2c17cb0640 1 -- 10.20.193.5:0/4152990181 wait complete. 2026-02-17T21:30:22.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:22.907+0000 7f2c17cb0640 1 librados: shutdown 2026-02-17T21:30:25.918 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:30:25.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.984+0000 7f07f5522640 10 monclient: get_monmap_and_config 2026-02-17T21:30:25.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.984+0000 7f07f5522640 10 monclient: build_initial_monmap 2026-02-17T21:30:25.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.984+0000 7f07f5522640 10 monclient: monmap: 2026-02-17T21:30:25.987 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:25.987 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:25.987 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:25.985433+0000 2026-02-17T21:30:25.987 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:25.985433+0000 2026-02-17T21:30:25.987 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:25.987 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:25.987 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:25.987 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:25.987 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:25.987 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:25.987 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:25.988 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:25.988 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:25.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.985+0000 7f07f5522640 1 Processor -- start 2026-02-17T21:30:25.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.985+0000 7f07f5522640 1 -- start start 2026-02-17T21:30:25.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.985+0000 7f07f5522640 10 monclient: init 2026-02-17T21:30:25.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.985+0000 7f07f5522640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:25.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.985+0000 7f07f5522640 10 monclient: _add_conns ranks=[1,2,4,5,3,0] 2026-02-17T21:30:25.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.985+0000 7f07f5522640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f07f015d370 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:25.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.985+0000 7f07f5522640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f07f00c7e20 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:25.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.985+0000 7f07f5522640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f07f00c59c0 0x7f07f015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:25.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.985+0000 7f07f5522640 10 monclient(hunting): picked mon.noname-b con 0x7f07f00c59c0 addr v2:10.20.193.119:3300/0 2026-02-17T21:30:25.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.985+0000 7f07f5522640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07f00c8350 con 0x7f07f015d370 2026-02-17T21:30:25.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.985+0000 7f07f5522640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07f00c8630 con 0x7f07f00c7e20 2026-02-17T21:30:25.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.985+0000 7f07f5522640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:25.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.985+0000 7f07f5522640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f07f015b710 con 0x7f07f00c59c0 2026-02-17T21:30:25.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.985+0000 7f07f5522640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:25.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.985+0000 7f07f5522640 10 monclient(hunting): authenticate will time out at 1331.550736s 2026-02-17T21:30:25.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.986+0000 7f07ef7fe640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f07f00c59c0 0x7f07f015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:25.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.986+0000 7f07ee7fc640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f07f00c7e20 0x7f07f00c52b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:57982/0 (socket says 10.20.193.5:57982) 2026-02-17T21:30:25.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.986+0000 7f07ee7fc640 1 -- 10.20.193.5:0/3150386441 learned_addr learned my addr 10.20.193.5:0/3150386441 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:25.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.986+0000 7f07ef7fe640 10 monclient(hunting): get_auth_request con 0x7f07f00c59c0 auth_method 0 2026-02-17T21:30:25.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.986+0000 7f07ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:25.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.986+0000 7f07ef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:25.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.986+0000 7f07ef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:25.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.987+0000 7f07ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:25.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.987+0000 7f07ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:25.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.987+0000 7f07ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:25.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.988+0000 7f07edffb640 1 -- 10.20.193.5:0/3150386441 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 367907431 0 0) 0x7f07f00c8630 con 0x7f07f00c7e20 2026-02-17T21:30:25.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.988+0000 7f07edffb640 10 monclient(hunting): _negotiate 2026-02-17T21:30:25.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.988+0000 7f07edffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:25.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.988+0000 7f07edffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:25.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.988+0000 7f07edffb640 10 monclient(hunting): my global_id is 5123 2026-02-17T21:30:25.993 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.988+0000 7f07edffb640 1 -- 10.20.193.5:0/3150386441 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07dc003620 con 0x7f07f00c7e20 2026-02-17T21:30:25.993 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.988+0000 7f07ef7fe640 10 monclient(hunting): handle_auth_done global_id 5125 payload 274 2026-02-17T21:30:25.993 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.988+0000 7f07ef7fe640 1 -- 10.20.193.5:0/3150386441 >> v1:10.20.193.135:6789/0 conn(0x7f07f00c7e20 legacy=0x7f07f00c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:25.993 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.988+0000 7f07ef7fe640 1 -- 10.20.193.5:0/3150386441 >> v1:10.20.193.119:6789/0 conn(0x7f07f015d370 legacy=0x7f07f015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:25.993 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.988+0000 7f07ef7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:30:25.993 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.988+0000 7f07ef7fe640 1 monclient: found mon.noname-b 2026-02-17T21:30:25.993 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.988+0000 7f07ef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:25.993 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.988+0000 7f07ef7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:30:25.993 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.988+0000 7f07ef7fe640 1 -- 10.20.193.5:0/3150386441 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f00c8910 con 0x7f07f00c59c0 2026-02-17T21:30:25.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.990+0000 7f07ef7fe640 1 --2- 10.20.193.5:0/3150386441 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f07f00c59c0 0x7f07f015d750 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f07e0009d90 tx=0x7f07e002f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45c208a87486085c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:25.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.992+0000 7f07edffb640 1 -- 10.20.193.5:0/3150386441 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e003c070 con 0x7f07f00c59c0 2026-02-17T21:30:25.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.992+0000 7f07edffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:25.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.992+0000 7f07edffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:30:26.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.992+0000 7f07edffb640 10 monclient: dump: 2026-02-17T21:30:26.000 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:26.000 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:26.000 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:26.000 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:26.000 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:26.000 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:26.000 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:26.000 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:26.000 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:26.000 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:26.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.992+0000 7f07edffb640 10 monclient: _finish_auth 0 2026-02-17T21:30:26.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.992+0000 7f07edffb640 10 monclient: _check_auth_tickets 2026-02-17T21:30:26.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.992+0000 7f07edffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:26.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.992+0000 7f07edffb640 1 -- 10.20.193.5:0/3150386441 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07e0037440 con 0x7f07f00c59c0 2026-02-17T21:30:26.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.992+0000 7f07edffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:26.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.992+0000 7f07edffb640 1 -- 10.20.193.5:0/3150386441 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e0037810 con 0x7f07f00c59c0 2026-02-17T21:30:26.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.992+0000 7f07edffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:26.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.992+0000 7f07edffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:30:26.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.992+0000 7f07edffb640 10 monclient: dump: 2026-02-17T21:30:26.001 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:26.001 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:26.001 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:26.002 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:26.002 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:26.002 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:26.002 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:26.002 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:26.002 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:26.002 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:26.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.992+0000 7f07f5522640 5 monclient: authenticate success, global_id 5125 2026-02-17T21:30:26.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.992+0000 7f07f5522640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:26.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.992+0000 7f07f5522640 4 set_mon_vals no callback set 2026-02-17T21:30:26.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.993+0000 7f07f5522640 10 monclient: shutdown 2026-02-17T21:30:26.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.993+0000 7f07f5522640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:26.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.993+0000 7f07f5522640 1 -- 10.20.193.5:0/3150386441 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f07f00c59c0 msgr2=0x7f07f015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:26.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.993+0000 7f07f5522640 1 --2- 10.20.193.5:0/3150386441 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f07f00c59c0 0x7f07f015d750 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f07e0009d90 tx=0x7f07e002f230 comp rx=0 tx=0).stop 2026-02-17T21:30:26.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.993+0000 7f07f5522640 1 -- 10.20.193.5:0/3150386441 shutdown_connections 2026-02-17T21:30:26.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.993+0000 7f07f5522640 1 --2- 10.20.193.5:0/3150386441 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f07f00c59c0 0x7f07f015d750 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:26.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.993+0000 7f07f5522640 1 -- 10.20.193.5:0/3150386441 >> 10.20.193.5:0/3150386441 conn(0x7f07f00c9f20 msgr2=0x7f07f00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:26.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.993+0000 7f07f5522640 1 -- 10.20.193.5:0/3150386441 shutdown_connections 2026-02-17T21:30:26.004 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.993+0000 7f07f5522640 1 -- 10.20.193.5:0/3150386441 wait complete. 2026-02-17T21:30:26.004 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.993+0000 7f07f5522640 10 monclient: build_initial_monmap 2026-02-17T21:30:26.004 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.993+0000 7f07f5522640 10 monclient: monmap: 2026-02-17T21:30:26.004 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:26.004 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:26.004 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:26.004 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:26.004 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:26.004 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:26.005 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:26.005 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:26.005 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:26.005 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:26.005 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.993+0000 7f07f5522640 1 librados: starting msgr at 2026-02-17T21:30:26.005 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.993+0000 7f07f5522640 1 librados: starting objecter 2026-02-17T21:30:26.005 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07f5522640 1 Processor -- start 2026-02-17T21:30:26.005 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07f5522640 1 -- start start 2026-02-17T21:30:26.005 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07f5522640 1 librados: setting wanted keys 2026-02-17T21:30:26.005 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07f5522640 1 librados: calling monclient init 2026-02-17T21:30:26.005 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07f5522640 10 monclient: init 2026-02-17T21:30:26.005 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07f5522640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:26.006 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07f5522640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:30:26.006 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07f5522640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f07f00c59c0 0x7f07f00744a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:26.006 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07f5522640 10 monclient(hunting): picked mon.noname-c con 0x7f07f00c59c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:26.006 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07f5522640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f07f00c7e20 0x7f07f01f2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:26.006 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07f5522640 10 monclient(hunting): picked mon.noname-b con 0x7f07f00c7e20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:26.006 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07f5522640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f07f015d370 0x7f07f01f4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:26.006 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07f5522640 10 monclient(hunting): picked mon.noname-a con 0x7f07f015d370 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:26.006 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07f5522640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:26.006 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07f5522640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f07f00c8ed0 con 0x7f07f015d370 2026-02-17T21:30:26.006 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07f5522640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:26.006 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07f5522640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f07f00c9240 con 0x7f07f00c7e20 2026-02-17T21:30:26.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07f5522640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:26.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07f5522640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f07f00c96d0 con 0x7f07f00c59c0 2026-02-17T21:30:26.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07f5522640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:26.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07f5522640 10 monclient(hunting): authenticate will time out at 1331.559480s 2026-02-17T21:30:26.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07ee7fc640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f07f00c7e20 0x7f07f01f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:26.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07ef7fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f07f015d370 0x7f07f01f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:26.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07eeffd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f07f00c59c0 0x7f07f00744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:26.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07ee7fc640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f07f00c7e20 0x7f07f01f2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:42522/0 (socket says 10.20.193.5:42522) 2026-02-17T21:30:26.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07ee7fc640 1 -- 10.20.193.5:0/3128001503 learned_addr learned my addr 10.20.193.5:0/3128001503 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:26.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07ee7fc640 10 monclient(hunting): get_auth_request con 0x7f07f00c7e20 auth_method 0 2026-02-17T21:30:26.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07ee7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:26.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07ee7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:26.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.994+0000 7f07ee7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:26.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.995+0000 7f07ef7fe640 10 monclient(hunting): get_auth_request con 0x7f07f015d370 auth_method 0 2026-02-17T21:30:26.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.995+0000 7f07ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:26.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.995+0000 7f07ef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:26.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.995+0000 7f07ef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:26.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.995+0000 7f07eeffd640 10 monclient(hunting): get_auth_request con 0x7f07f00c59c0 auth_method 0 2026-02-17T21:30:26.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.995+0000 7f07eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:26.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.995+0000 7f07eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:26.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.995+0000 7f07eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:26.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.995+0000 7f07ee7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:26.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.995+0000 7f07ee7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:26.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.995+0000 7f07ee7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:26.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.995+0000 7f07ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:26.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.995+0000 7f07ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:26.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.995+0000 7f07ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:26.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.995+0000 7f07eeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:26.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.995+0000 7f07eeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:26.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.995+0000 7f07eeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:26.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.996+0000 7f07ee7fc640 10 monclient(hunting): handle_auth_done global_id 5131 payload 824 2026-02-17T21:30:26.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.996+0000 7f07ee7fc640 1 -- 10.20.193.5:0/3128001503 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f07f00c59c0 msgr2=0x7f07f00744a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:26.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.996+0000 7f07ee7fc640 1 --2- 10.20.193.5:0/3128001503 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f07f00c59c0 0x7f07f00744a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:26.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.996+0000 7f07ee7fc640 1 -- 10.20.193.5:0/3128001503 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f07f015d370 msgr2=0x7f07f01f4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:26.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.996+0000 7f07ee7fc640 1 --2- 10.20.193.5:0/3128001503 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f07f015d370 0x7f07f01f4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:26.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.996+0000 7f07ee7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:30:26.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.996+0000 7f07ee7fc640 1 monclient: found mon.noname-b 2026-02-17T21:30:26.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.996+0000 7f07ee7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:26.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.996+0000 7f07ee7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:30:26.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.996+0000 7f07ee7fc640 1 -- 10.20.193.5:0/3128001503 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f0073120 con 0x7f07f00c7e20 2026-02-17T21:30:26.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.997+0000 7f07ee7fc640 1 --2- 10.20.193.5:0/3128001503 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f07f00c7e20 0x7f07f01f2740 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f07d800c700 tx=0x7f07d800cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:26.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.997+0000 7f07cf7fe640 10 client.?.objecter ms_handle_connect 0x7f07f00c7e20 2026-02-17T21:30:26.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.997+0000 7f07cf7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:26.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.999+0000 7f07cf7fe640 1 -- 10.20.193.5:0/3128001503 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8017070 con 0x7f07f00c7e20 2026-02-17T21:30:26.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.999+0000 7f07cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:26.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.999+0000 7f07cf7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:30:26.014 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.999+0000 7f07cf7fe640 10 monclient: dump: 2026-02-17T21:30:26.014 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:26.014 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:26.014 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:26.014 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:26.015 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:26.015 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:26.015 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:26.015 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:26.015 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:26.015 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:26.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.999+0000 7f07cf7fe640 10 monclient: _finish_auth 0 2026-02-17T21:30:26.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.999+0000 7f07cf7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:30:26.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.999+0000 7f07cf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:26.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.999+0000 7f07f5522640 5 monclient: authenticate success, global_id 5131 2026-02-17T21:30:26.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.999+0000 7f07cf7fe640 1 -- 10.20.193.5:0/3128001503 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d8005bf0 con 0x7f07f00c7e20 2026-02-17T21:30:26.015 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.999+0000 7f07f5522640 10 monclient: _renew_subs 2026-02-17T21:30:26.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.999+0000 7f07f5522640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:26.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.999+0000 7f07f5522640 1 -- 10.20.193.5:0/3128001503 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07f0073400 con 0x7f07f00c7e20 2026-02-17T21:30:26.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.999+0000 7f07cf7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:26.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.999+0000 7f07cf7fe640 1 -- 10.20.193.5:0/3128001503 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8007070 con 0x7f07f00c7e20 2026-02-17T21:30:26.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.999+0000 7f07cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:26.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.999+0000 7f07cf7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:30:26.016 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.999+0000 7f07cf7fe640 10 monclient: dump: 2026-02-17T21:30:26.016 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:26.016 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:26.016 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:26.016 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:26.016 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:26.017 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:26.017 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:26.017 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:26.017 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:26.017 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:26.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.999+0000 7f07ed7fa640 4 set_mon_vals no callback set 2026-02-17T21:30:26.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.999+0000 7f07f5522640 10 client.5131.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:26.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.999+0000 7f07f5522640 10 monclient: _renew_subs 2026-02-17T21:30:26.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.999+0000 7f07f5522640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:26.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.999+0000 7f07f5522640 1 -- 10.20.193.5:0/3128001503 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07f00739c0 con 0x7f07f00c7e20 2026-02-17T21:30:26.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:25.999+0000 7f07f5522640 1 librados: init done 2026-02-17T21:30:26.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.000+0000 7f07f5522640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:26.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.000+0000 7f07f5522640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:26.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.000+0000 7f07f5522640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:26.018 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.000+0000 7f07f5522640 1 -- 10.20.193.5:0/3128001503 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07f015d750 con 0x7f07f00c7e20 2026-02-17T21:30:26.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.011+0000 7f07cf7fe640 1 -- 10.20.193.5:0/3128001503 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f07d8007210 con 0x7f07f00c7e20 2026-02-17T21:30:26.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.011+0000 7f07cf7fe640 1 --2- 10.20.193.5:0/3128001503 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f07bc079300 0x7f07bc07b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:26.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.012+0000 7f07eeffd640 1 --2- 10.20.193.5:0/3128001503 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f07bc079300 0x7f07bc07b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:26.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.012+0000 7f07eeffd640 10 monclient: get_auth_request con 0x7f07bc079300 auth_method 0 2026-02-17T21:30:26.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.012+0000 7f07cf7fe640 10 client.5131.objecter ms_handle_connect 0x7f07bc079300 2026-02-17T21:30:26.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.012+0000 7f07eeffd640 1 --2- 10.20.193.5:0/3128001503 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f07bc079300 0x7f07bc07b7c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f07e4002410 tx=0x7f07e4007ef0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:26.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.012+0000 7f07cf7fe640 1 -- 10.20.193.5:0/3128001503 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f07d805d7f0 con 0x7f07f00c7e20 2026-02-17T21:30:26.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.012+0000 7f07cf7fe640 10 client.5131.objecter ms_dispatch2 0x7f07f0000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:26.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.012+0000 7f07cf7fe640 3 client.5131.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:26.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.012+0000 7f07cf7fe640 3 client.5131.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:26.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.012+0000 7f07cf7fe640 20 client.5131.objecter dump_active .. 0 homeless 2026-02-17T21:30:26.114 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.112+0000 7f07cf7fe640 1 -- 10.20.193.5:0/3128001503 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f07d8021020 con 0x7f07f00c7e20 2026-02-17T21:30:26.114 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.112+0000 7f07cf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:26.114 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.112+0000 7f07cf7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:26.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.213+0000 7f07f5522640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:30:26.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.213+0000 7f07f5522640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:26.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.213+0000 7f07f5522640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:26.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.213+0000 7f07f5522640 1 -- 10.20.193.5:0/3128001503 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f07f01506b0 con 0x7f07f00c7e20 2026-02-17T21:30:26.217 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.216+0000 7f07cf7fe640 1 -- 10.20.193.5:0/3128001503 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f07d80617b0 con 0x7f07f00c7e20 2026-02-17T21:30:26.217 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.216+0000 7f07cf7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:26.217 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.216+0000 7f07cf7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:30:26.217 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:30:26.218 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:30:26.220 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.217+0000 7f07f5522640 10 librados: watch_flush enter 2026-02-17T21:30:26.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.217+0000 7f07f5522640 10 librados: watch_flush exit 2026-02-17T21:30:26.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.217+0000 7f07f5522640 20 client.5131.objecter shutdown clearing up homeless session... 2026-02-17T21:30:26.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.217+0000 7f07f5522640 10 client.5131.objecter successfully canceled tick 2026-02-17T21:30:26.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.217+0000 7f07f5522640 1 -- 10.20.193.5:0/3128001503 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f07bc079300 msgr2=0x7f07bc07b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:26.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.217+0000 7f07f5522640 1 --2- 10.20.193.5:0/3128001503 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f07bc079300 0x7f07bc07b7c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f07e4002410 tx=0x7f07e4007ef0 comp rx=0 tx=0).stop 2026-02-17T21:30:26.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.217+0000 7f07f5522640 10 monclient: shutdown 2026-02-17T21:30:26.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.217+0000 7f07f5522640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:26.221 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.217+0000 7f07f5522640 1 -- 10.20.193.5:0/3128001503 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f07f00c7e20 msgr2=0x7f07f01f2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:26.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.217+0000 7f07f5522640 1 --2- 10.20.193.5:0/3128001503 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f07f00c7e20 0x7f07f01f2740 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f07d800c700 tx=0x7f07d800cbd0 comp rx=0 tx=0).stop 2026-02-17T21:30:26.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.217+0000 7f07f5522640 1 -- 10.20.193.5:0/3128001503 shutdown_connections 2026-02-17T21:30:26.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.217+0000 7f07f5522640 1 --2- 10.20.193.5:0/3128001503 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f07bc079300 0x7f07bc07b7c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:26.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.217+0000 7f07f5522640 1 --2- 10.20.193.5:0/3128001503 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f07f015d370 0x7f07f01f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:26.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.217+0000 7f07f5522640 1 --2- 10.20.193.5:0/3128001503 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f07f00c7e20 0x7f07f01f2740 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:26.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.217+0000 7f07f5522640 1 --2- 10.20.193.5:0/3128001503 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f07f00c59c0 0x7f07f00744a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:26.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.217+0000 7f07f5522640 1 -- 10.20.193.5:0/3128001503 >> 10.20.193.5:0/3128001503 conn(0x7f07f00c9f20 msgr2=0x7f07f00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:26.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.217+0000 7f07f5522640 1 -- 10.20.193.5:0/3128001503 shutdown_connections 2026-02-17T21:30:26.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.217+0000 7f07f5522640 1 -- 10.20.193.5:0/3128001503 wait complete. 2026-02-17T21:30:26.222 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:26.217+0000 7f07f5522640 1 librados: shutdown 2026-02-17T21:30:29.229 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:30:29.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.297+0000 7f2be65fe640 10 monclient: get_monmap_and_config 2026-02-17T21:30:29.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.297+0000 7f2be65fe640 10 monclient: build_initial_monmap 2026-02-17T21:30:29.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.297+0000 7f2be65fe640 10 monclient: monmap: 2026-02-17T21:30:29.299 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:29.300 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:29.300 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:29.298348+0000 2026-02-17T21:30:29.300 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:29.298348+0000 2026-02-17T21:30:29.300 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:29.300 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:29.300 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:29.300 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:29.300 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:29.300 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:29.300 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:29.300 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:29.300 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:29.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.298+0000 7f2be65fe640 1 Processor -- start 2026-02-17T21:30:29.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.298+0000 7f2be65fe640 1 -- start start 2026-02-17T21:30:29.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.298+0000 7f2be65fe640 10 monclient: init 2026-02-17T21:30:29.303 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.298+0000 7f2be65fe640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:29.303 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.298+0000 7f2be65fe640 10 monclient: _add_conns ranks=[5,1,2,4,0,3] 2026-02-17T21:30:29.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.298+0000 7f2be65fe640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f2be015d370 0x7f2be015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:29.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.298+0000 7f2be65fe640 10 monclient(hunting): picked mon.noname-c con 0x7f2be015d370 addr v2:10.20.193.135:3300/0 2026-02-17T21:30:29.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.298+0000 7f2be65fe640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f2be00c7e20 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:29.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.298+0000 7f2be65fe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2be00c74c0 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:29.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.298+0000 7f2be65fe640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2be00c8350 con 0x7f2be00c7e20 2026-02-17T21:30:29.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.298+0000 7f2be65fe640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2be00c8630 con 0x7f2be00c74c0 2026-02-17T21:30:29.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.298+0000 7f2be65fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:29.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.298+0000 7f2be65fe640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f2be015b710 con 0x7f2be015d370 2026-02-17T21:30:29.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.298+0000 7f2be65fe640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:29.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.298+0000 7f2be65fe640 10 monclient(hunting): authenticate will time out at 1334.863647s 2026-02-17T21:30:29.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.299+0000 7f2bdffff640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f2be015d370 0x7f2be015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:29.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.299+0000 7f2bdf7fe640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f2be00c7e20 0x7f2be015b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:51152/0 (socket says 10.20.193.5:51152) 2026-02-17T21:30:29.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.299+0000 7f2bdf7fe640 1 -- 10.20.193.5:0/1199158226 learned_addr learned my addr 10.20.193.5:0/1199158226 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:29.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.299+0000 7f2bdffff640 10 monclient(hunting): get_auth_request con 0x7f2be015d370 auth_method 0 2026-02-17T21:30:29.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.299+0000 7f2bdffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:29.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.299+0000 7f2bdffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:29.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.299+0000 7f2bdffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:29.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.300+0000 7f2bdffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:29.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.300+0000 7f2bdffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:29.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.300+0000 7f2bdffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:29.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.300+0000 7f2bdeffd640 1 -- 10.20.193.5:0/1199158226 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1803266446 0 0) 0x7f2be00c8350 con 0x7f2be00c7e20 2026-02-17T21:30:29.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.300+0000 7f2bdeffd640 10 monclient(hunting): _negotiate 2026-02-17T21:30:29.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.300+0000 7f2bdeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:29.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.300+0000 7f2bdeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:29.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.300+0000 7f2bdeffd640 10 monclient(hunting): my global_id is 5134 2026-02-17T21:30:29.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.300+0000 7f2bdeffd640 1 -- 10.20.193.5:0/1199158226 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bc4003620 con 0x7f2be00c7e20 2026-02-17T21:30:29.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.301+0000 7f2bdffff640 10 monclient(hunting): handle_auth_done global_id 5129 payload 274 2026-02-17T21:30:29.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.301+0000 7f2bdffff640 1 -- 10.20.193.5:0/1199158226 >> v1:10.20.193.135:6789/0 conn(0x7f2be00c74c0 legacy=0x7f2be00c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:29.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.301+0000 7f2bdffff640 1 -- 10.20.193.5:0/1199158226 >> v1:10.20.193.119:6789/0 conn(0x7f2be00c7e20 legacy=0x7f2be015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:29.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.301+0000 7f2bdffff640 10 monclient: _finish_hunting 0 2026-02-17T21:30:29.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.301+0000 7f2bdffff640 1 monclient: found mon.noname-c 2026-02-17T21:30:29.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.301+0000 7f2bdffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:29.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.301+0000 7f2bdffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:29.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.301+0000 7f2bdffff640 1 -- 10.20.193.5:0/1199158226 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be00c8910 con 0x7f2be015d370 2026-02-17T21:30:29.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.303+0000 7f2bdffff640 1 --2- 10.20.193.5:0/1199158226 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2be015d370 0x7f2be015d750 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0098a0 tx=0x7f2bcc02ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83418a19fa9f8bb2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:29.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2bdeffd640 1 -- 10.20.193.5:0/1199158226 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc03c070 con 0x7f2be015d370 2026-02-17T21:30:29.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2bdeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:29.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2bdeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:29.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2bdeffd640 10 monclient: dump: 2026-02-17T21:30:29.314 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:29.314 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:29.314 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:29.314 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:29.314 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:29.314 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:29.314 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:29.314 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:29.314 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:29.314 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:29.314 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2bdeffd640 10 monclient: _finish_auth 0 2026-02-17T21:30:29.314 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2bdeffd640 10 monclient: _check_auth_tickets 2026-02-17T21:30:29.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2bdeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:29.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2bdeffd640 1 -- 10.20.193.5:0/1199158226 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bcc02fb70 con 0x7f2be015d370 2026-02-17T21:30:29.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2bdeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:29.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2be65fe640 5 monclient: authenticate success, global_id 5129 2026-02-17T21:30:29.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2bdeffd640 1 -- 10.20.193.5:0/1199158226 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc037440 con 0x7f2be015d370 2026-02-17T21:30:29.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2bdeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:29.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2bdeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:29.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2bdeffd640 10 monclient: dump: 2026-02-17T21:30:29.315 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:29.315 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:29.315 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:29.315 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:29.316 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:29.316 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:29.316 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:29.316 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:29.316 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:29.316 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:29.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2be65fe640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:29.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2be65fe640 4 set_mon_vals no callback set 2026-02-17T21:30:29.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2be65fe640 10 monclient: shutdown 2026-02-17T21:30:29.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2be65fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:29.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2be65fe640 1 -- 10.20.193.5:0/1199158226 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2be015d370 msgr2=0x7f2be015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:29.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2be65fe640 1 --2- 10.20.193.5:0/1199158226 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2be015d370 0x7f2be015d750 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0098a0 tx=0x7f2bcc02ee60 comp rx=0 tx=0).stop 2026-02-17T21:30:29.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2be65fe640 1 -- 10.20.193.5:0/1199158226 shutdown_connections 2026-02-17T21:30:29.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2be65fe640 1 --2- 10.20.193.5:0/1199158226 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2be015d370 0x7f2be015d750 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:29.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2be65fe640 1 -- 10.20.193.5:0/1199158226 >> 10.20.193.5:0/1199158226 conn(0x7f2be00c9f20 msgr2=0x7f2be00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:29.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2be65fe640 1 -- 10.20.193.5:0/1199158226 shutdown_connections 2026-02-17T21:30:29.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2be65fe640 1 -- 10.20.193.5:0/1199158226 wait complete. 2026-02-17T21:30:29.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2be65fe640 10 monclient: build_initial_monmap 2026-02-17T21:30:29.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.305+0000 7f2be65fe640 10 monclient: monmap: 2026-02-17T21:30:29.318 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:29.318 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:29.318 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:29.318 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:29.318 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:29.318 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:29.319 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:29.319 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:29.319 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:29.319 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:29.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.306+0000 7f2be65fe640 1 librados: starting msgr at 2026-02-17T21:30:29.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.306+0000 7f2be65fe640 1 librados: starting objecter 2026-02-17T21:30:29.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.306+0000 7f2be65fe640 1 Processor -- start 2026-02-17T21:30:29.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.306+0000 7f2be65fe640 1 -- start start 2026-02-17T21:30:29.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.306+0000 7f2be65fe640 1 librados: setting wanted keys 2026-02-17T21:30:29.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.306+0000 7f2be65fe640 1 librados: calling monclient init 2026-02-17T21:30:29.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.306+0000 7f2be65fe640 10 monclient: init 2026-02-17T21:30:29.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.306+0000 7f2be65fe640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:29.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.306+0000 7f2be65fe640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:30:29.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.306+0000 7f2be65fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2be00c74c0 0x7f2be00c4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:29.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.306+0000 7f2be65fe640 10 monclient(hunting): picked mon.noname-a con 0x7f2be00c74c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:29.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.306+0000 7f2be65fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2be00c7e20 0x7f2be014d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:29.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.306+0000 7f2be65fe640 10 monclient(hunting): picked mon.noname-b con 0x7f2be00c7e20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:29.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.306+0000 7f2be65fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2be015d370 0x7f2be006e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:29.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.306+0000 7f2be65fe640 10 monclient(hunting): picked mon.noname-c con 0x7f2be015d370 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:29.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.306+0000 7f2be65fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:29.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.306+0000 7f2be65fe640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2be00c8ed0 con 0x7f2be00c74c0 2026-02-17T21:30:29.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.306+0000 7f2be65fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:29.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.306+0000 7f2be65fe640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2be00c9240 con 0x7f2be00c7e20 2026-02-17T21:30:29.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.306+0000 7f2be65fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:29.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.306+0000 7f2be65fe640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2be00c96d0 con 0x7f2be015d370 2026-02-17T21:30:29.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.306+0000 7f2be65fe640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:29.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.306+0000 7f2be65fe640 10 monclient(hunting): authenticate will time out at 1334.871884s 2026-02-17T21:30:29.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2be4b74640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2be015d370 0x7f2be006e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:29.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2bdffff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2be00c74c0 0x7f2be00c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:29.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2bdf7fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2be00c7e20 0x7f2be014d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:29.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2be4b74640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2be015d370 0x7f2be006e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:52162/0 (socket says 10.20.193.5:52162) 2026-02-17T21:30:29.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2be4b74640 1 -- 10.20.193.5:0/399265615 learned_addr learned my addr 10.20.193.5:0/399265615 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:29.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2be4b74640 10 monclient(hunting): get_auth_request con 0x7f2be015d370 auth_method 0 2026-02-17T21:30:29.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2be4b74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:29.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2be4b74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:29.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2be4b74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:29.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2bdf7fe640 10 monclient(hunting): get_auth_request con 0x7f2be00c7e20 auth_method 0 2026-02-17T21:30:29.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2bdf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:29.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2bdf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:29.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2bdf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:29.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2bdffff640 10 monclient(hunting): get_auth_request con 0x7f2be00c74c0 auth_method 0 2026-02-17T21:30:29.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2bdffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:29.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2bdffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:29.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2bdffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:29.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2be4b74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:29.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2be4b74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:29.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2be4b74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:29.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2bdf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:29.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2bdf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:29.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2bdf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:29.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2bdffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:29.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2bdffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:29.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.307+0000 7f2bdffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:29.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.308+0000 7f2be4b74640 10 monclient(hunting): handle_auth_done global_id 5135 payload 824 2026-02-17T21:30:29.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.308+0000 7f2be4b74640 1 -- 10.20.193.5:0/399265615 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2be00c7e20 msgr2=0x7f2be014d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:29.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.308+0000 7f2be4b74640 1 --2- 10.20.193.5:0/399265615 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2be00c7e20 0x7f2be014d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:29.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.308+0000 7f2be4b74640 1 -- 10.20.193.5:0/399265615 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2be00c74c0 msgr2=0x7f2be00c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:29.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.308+0000 7f2be4b74640 1 --2- 10.20.193.5:0/399265615 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2be00c74c0 0x7f2be00c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:29.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.308+0000 7f2be4b74640 10 monclient: _finish_hunting 0 2026-02-17T21:30:29.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.308+0000 7f2be4b74640 1 monclient: found mon.noname-c 2026-02-17T21:30:29.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.308+0000 7f2be4b74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:29.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.308+0000 7f2be4b74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:29.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.308+0000 7f2be4b74640 1 -- 10.20.193.5:0/399265615 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be006f390 con 0x7f2be015d370 2026-02-17T21:30:29.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.310+0000 7f2be4b74640 1 --2- 10.20.193.5:0/399265615 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2be015d370 0x7f2be006e810 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2bd400cc80 tx=0x7f2bd400a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:29.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.310+0000 7f2bdcff9640 10 client.?.objecter ms_handle_connect 0x7f2be015d370 2026-02-17T21:30:29.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.310+0000 7f2bdcff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:29.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.310+0000 7f2bdcff9640 1 -- 10.20.193.5:0/399265615 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4003a70 con 0x7f2be015d370 2026-02-17T21:30:29.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.310+0000 7f2bdcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:29.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.310+0000 7f2bdcff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:29.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.310+0000 7f2bdcff9640 10 monclient: dump: 2026-02-17T21:30:29.324 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:29.325 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:29.325 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:29.325 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:29.325 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:29.325 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:29.325 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:29.325 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:29.325 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:29.325 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:29.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.310+0000 7f2bdcff9640 10 monclient: _finish_auth 0 2026-02-17T21:30:29.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.310+0000 7f2bdcff9640 10 monclient: _check_auth_tickets 2026-02-17T21:30:29.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.310+0000 7f2bdcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:29.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.310+0000 7f2be65fe640 5 monclient: authenticate success, global_id 5135 2026-02-17T21:30:29.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.311+0000 7f2be65fe640 10 monclient: _renew_subs 2026-02-17T21:30:29.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.311+0000 7f2be65fe640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:29.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.311+0000 7f2be65fe640 1 -- 10.20.193.5:0/399265615 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2be0149ff0 con 0x7f2be015d370 2026-02-17T21:30:29.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.311+0000 7f2be65fe640 10 client.5135.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:29.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.311+0000 7f2be65fe640 10 monclient: _renew_subs 2026-02-17T21:30:29.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.311+0000 7f2be65fe640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:29.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.311+0000 7f2be65fe640 1 -- 10.20.193.5:0/399265615 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2be014a5b0 con 0x7f2be015d370 2026-02-17T21:30:29.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.311+0000 7f2be65fe640 1 librados: init done 2026-02-17T21:30:29.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.311+0000 7f2be65fe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:29.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.311+0000 7f2be65fe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:29.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.311+0000 7f2be65fe640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:29.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.311+0000 7f2be65fe640 1 -- 10.20.193.5:0/399265615 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2be015d750 con 0x7f2be015d370 2026-02-17T21:30:29.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.311+0000 7f2bdcff9640 1 -- 10.20.193.5:0/399265615 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bd4003c10 con 0x7f2be015d370 2026-02-17T21:30:29.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.311+0000 7f2bdcff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:29.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.311+0000 7f2bde7fc640 4 set_mon_vals no callback set 2026-02-17T21:30:29.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.311+0000 7f2bdcff9640 1 -- 10.20.193.5:0/399265615 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40050d0 con 0x7f2be015d370 2026-02-17T21:30:29.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.311+0000 7f2bdcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:29.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.311+0000 7f2bdcff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:29.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.311+0000 7f2bdcff9640 10 monclient: dump: 2026-02-17T21:30:29.327 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:29.327 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:29.327 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:29.327 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:29.327 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:29.328 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:29.328 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:29.328 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:29.328 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:29.328 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:29.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.417+0000 7f2bdcff9640 1 -- 10.20.193.5:0/399265615 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f2bd4005270 con 0x7f2be015d370 2026-02-17T21:30:29.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.418+0000 7f2bdcff9640 1 --2- 10.20.193.5:0/399265615 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2bb0079280 0x7f2bb007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:29.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.418+0000 7f2bdffff640 1 --2- 10.20.193.5:0/399265615 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2bb0079280 0x7f2bb007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:29.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.418+0000 7f2bdffff640 10 monclient: get_auth_request con 0x7f2bb0079280 auth_method 0 2026-02-17T21:30:29.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.418+0000 7f2bdffff640 1 --2- 10.20.193.5:0/399265615 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2bb0079280 0x7f2bb007b740 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc039000 tx=0x7f2bcc033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:29.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.418+0000 7f2bdcff9640 10 client.5135.objecter ms_handle_connect 0x7f2bb0079280 2026-02-17T21:30:29.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.419+0000 7f2bdcff9640 1 -- 10.20.193.5:0/399265615 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f2bd40986e0 con 0x7f2be015d370 2026-02-17T21:30:29.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.419+0000 7f2bdcff9640 10 client.5135.objecter ms_dispatch2 0x7f2be0000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:29.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.419+0000 7f2bdcff9640 3 client.5135.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:29.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.419+0000 7f2bdcff9640 3 client.5135.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:29.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.419+0000 7f2bdcff9640 20 client.5135.objecter dump_active .. 0 homeless 2026-02-17T21:30:29.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.425+0000 7f2bdcff9640 1 -- 10.20.193.5:0/399265615 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2bd4062ad0 con 0x7f2be015d370 2026-02-17T21:30:29.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.425+0000 7f2bdcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:29.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.425+0000 7f2bdcff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:29.526 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.525+0000 7f2be65fe640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:30:29.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.525+0000 7f2be65fe640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:29.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.525+0000 7f2be65fe640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:29.527 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.525+0000 7f2be65fe640 1 -- 10.20.193.5:0/399265615 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2be006ffb0 con 0x7f2be015d370 2026-02-17T21:30:29.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.528+0000 7f2bdcff9640 1 -- 10.20.193.5:0/399265615 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f2bd4066dd0 con 0x7f2be015d370 2026-02-17T21:30:29.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.528+0000 7f2bdcff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:29.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.528+0000 7f2bdcff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:30:29.529 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:30:29.529 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:30:29.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.528+0000 7f2be65fe640 10 librados: watch_flush enter 2026-02-17T21:30:29.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.528+0000 7f2be65fe640 10 librados: watch_flush exit 2026-02-17T21:30:29.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.528+0000 7f2be65fe640 20 client.5135.objecter shutdown clearing up homeless session... 2026-02-17T21:30:29.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.528+0000 7f2be65fe640 10 client.5135.objecter successfully canceled tick 2026-02-17T21:30:29.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.529+0000 7f2be65fe640 1 -- 10.20.193.5:0/399265615 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2bb0079280 msgr2=0x7f2bb007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:29.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.529+0000 7f2be65fe640 1 --2- 10.20.193.5:0/399265615 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2bb0079280 0x7f2bb007b740 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc039000 tx=0x7f2bcc033000 comp rx=0 tx=0).stop 2026-02-17T21:30:29.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.529+0000 7f2be65fe640 10 monclient: shutdown 2026-02-17T21:30:29.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.529+0000 7f2be65fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:29.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.529+0000 7f2be65fe640 1 -- 10.20.193.5:0/399265615 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2be015d370 msgr2=0x7f2be006e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:29.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.529+0000 7f2be65fe640 1 --2- 10.20.193.5:0/399265615 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2be015d370 0x7f2be006e810 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2bd400cc80 tx=0x7f2bd400a430 comp rx=0 tx=0).stop 2026-02-17T21:30:29.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.529+0000 7f2be65fe640 1 -- 10.20.193.5:0/399265615 shutdown_connections 2026-02-17T21:30:29.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.529+0000 7f2be65fe640 1 --2- 10.20.193.5:0/399265615 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2bb0079280 0x7f2bb007b740 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:29.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.529+0000 7f2be65fe640 1 --2- 10.20.193.5:0/399265615 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2be015d370 0x7f2be006e810 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:29.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.529+0000 7f2be65fe640 1 --2- 10.20.193.5:0/399265615 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2be00c7e20 0x7f2be014d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:29.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.529+0000 7f2be65fe640 1 --2- 10.20.193.5:0/399265615 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2be00c74c0 0x7f2be00c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:29.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.529+0000 7f2be65fe640 1 -- 10.20.193.5:0/399265615 >> 10.20.193.5:0/399265615 conn(0x7f2be00c9f20 msgr2=0x7f2be00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:29.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.529+0000 7f2be65fe640 1 -- 10.20.193.5:0/399265615 shutdown_connections 2026-02-17T21:30:29.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.529+0000 7f2be65fe640 1 -- 10.20.193.5:0/399265615 wait complete. 2026-02-17T21:30:29.533 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:29.529+0000 7f2be65fe640 1 librados: shutdown 2026-02-17T21:30:32.540 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:30:32.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.606+0000 7f0389fbc640 10 monclient: get_monmap_and_config 2026-02-17T21:30:32.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.606+0000 7f0389fbc640 10 monclient: build_initial_monmap 2026-02-17T21:30:32.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.606+0000 7f0389fbc640 10 monclient: monmap: 2026-02-17T21:30:32.608 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:32.608 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:32.608 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:32.607400+0000 2026-02-17T21:30:32.608 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:32.607400+0000 2026-02-17T21:30:32.608 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:32.609 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:32.609 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:32.609 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:32.609 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:32.609 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:32.609 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:32.609 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:32.609 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:32.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.607+0000 7f0389fbc640 1 Processor -- start 2026-02-17T21:30:32.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.607+0000 7f0389fbc640 1 -- start start 2026-02-17T21:30:32.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.607+0000 7f0389fbc640 10 monclient: init 2026-02-17T21:30:32.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.607+0000 7f0389fbc640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:32.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.607+0000 7f0389fbc640 10 monclient: _add_conns ranks=[0,1,2,3,5,4] 2026-02-17T21:30:32.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.607+0000 7f0389fbc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0384152820 addr v1:10.20.193.5:6789/0 2026-02-17T21:30:32.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.607+0000 7f0389fbc640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f0384152c00 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:32.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.607+0000 7f0389fbc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f03840c63f0 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:32.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.607+0000 7f0389fbc640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0384073e90 con 0x7f0384152820 2026-02-17T21:30:32.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.607+0000 7f0389fbc640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0384074170 con 0x7f0384152c00 2026-02-17T21:30:32.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.607+0000 7f0389fbc640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0384074450 con 0x7f03840c63f0 2026-02-17T21:30:32.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.607+0000 7f0389fbc640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:32.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.607+0000 7f0389fbc640 10 monclient(hunting): authenticate will time out at 1338.172846s 2026-02-17T21:30:32.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.608+0000 7f03837fe640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f0384152820 0x7f03840c7e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:43880/0 (socket says 10.20.193.5:43880) 2026-02-17T21:30:32.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.608+0000 7f03837fe640 1 -- 10.20.193.5:0/1989662246 learned_addr learned my addr 10.20.193.5:0/1989662246 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:32.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.609+0000 7f03827fc640 1 -- 10.20.193.5:0/1989662246 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2996476360 0 0) 0x7f0384074170 con 0x7f0384152c00 2026-02-17T21:30:32.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.609+0000 7f03827fc640 10 monclient(hunting): _negotiate 2026-02-17T21:30:32.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.609+0000 7f03827fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:32.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.609+0000 7f03827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:32.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.609+0000 7f03827fc640 10 monclient(hunting): my global_id is 5140 2026-02-17T21:30:32.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.609+0000 7f03827fc640 1 -- 10.20.193.5:0/1989662246 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0368003620 con 0x7f0384152c00 2026-02-17T21:30:32.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.609+0000 7f03827fc640 1 -- 10.20.193.5:0/1989662246 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 264652583 0 0) 0x7f0384073e90 con 0x7f0384152820 2026-02-17T21:30:32.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.609+0000 7f03827fc640 10 monclient(hunting): _negotiate 2026-02-17T21:30:32.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.609+0000 7f03827fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:32.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.609+0000 7f03827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:32.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.609+0000 7f03827fc640 10 monclient(hunting): my global_id is 5070 2026-02-17T21:30:32.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.609+0000 7f03827fc640 1 -- 10.20.193.5:0/1989662246 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0384074170 con 0x7f0384152820 2026-02-17T21:30:32.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.610+0000 7f03827fc640 1 -- 10.20.193.5:0/1989662246 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1918091715 0 0) 0x7f0384074450 con 0x7f03840c63f0 2026-02-17T21:30:32.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.610+0000 7f03827fc640 10 monclient(hunting): _negotiate 2026-02-17T21:30:32.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.610+0000 7f03827fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:32.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.610+0000 7f03827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:32.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.610+0000 7f03827fc640 10 monclient(hunting): my global_id is 5138 2026-02-17T21:30:32.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.610+0000 7f03827fc640 1 -- 10.20.193.5:0/1989662246 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0384073e90 con 0x7f03840c63f0 2026-02-17T21:30:32.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 1 -- 10.20.193.5:0/1989662246 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 453121379 0 0) 0x7f0368003620 con 0x7f0384152c00 2026-02-17T21:30:32.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 1 -- 10.20.193.5:0/1989662246 >> v1:10.20.193.135:6789/0 conn(0x7f03840c63f0 legacy=0x7f03840726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:32.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 1 -- 10.20.193.5:0/1989662246 >> v1:10.20.193.5:6789/0 conn(0x7f0384152820 legacy=0x7f03840c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:32.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 10 monclient: _finish_hunting 0 2026-02-17T21:30:32.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 1 monclient: found mon.noname-b-legacy 2026-02-17T21:30:32.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:32.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.119:6789/0 2026-02-17T21:30:32.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 1 -- 10.20.193.5:0/1989662246 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0384074730 con 0x7f0384152c00 2026-02-17T21:30:32.623 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 10 monclient: _finish_auth 0 2026-02-17T21:30:32.624 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 10 monclient: _check_auth_tickets 2026-02-17T21:30:32.624 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:32.624 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 1 -- 10.20.193.5:0/1989662246 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3880376286 0 0) 0x7f0374002f00 con 0x7f0384152c00 2026-02-17T21:30:32.624 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:32.624 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T21:30:32.624 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 10 monclient: dump: 2026-02-17T21:30:32.624 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:32.624 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:32.624 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:32.624 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:32.624 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:32.624 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:32.625 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:32.625 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:32.625 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:32.625 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:32.625 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] but i'm connected to v1:10.20.193.119:6789/0, reconnecting 2026-02-17T21:30:32.625 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:32.625 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 1 -- 10.20.193.5:0/1989662246 >> v1:10.20.193.119:6789/0 conn(0x7f0384152c00 legacy=0x7f03840c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:32.625 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:30:32.625 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 1 --2- 10.20.193.5:0/1989662246 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0368003fe0 0x7f0368004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:32.625 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 10 monclient(hunting): picked mon.a con 0x7f0368003fe0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:32.625 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 1 --2- 10.20.193.5:0/1989662246 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0368004e40 0x7f03680052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:32.625 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 10 monclient(hunting): picked mon.c con 0x7f0368004e40 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:32.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 1 --2- 10.20.193.5:0/1989662246 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f036800bd40 0x7f036800e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:32.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 10 monclient(hunting): picked mon.b con 0x7f036800bd40 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:32.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:32.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 1 -- 10.20.193.5:0/1989662246 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f036800e720 con 0x7f0368003fe0 2026-02-17T21:30:32.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:32.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 1 -- 10.20.193.5:0/1989662246 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f036800e8d0 con 0x7f036800bd40 2026-02-17T21:30:32.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:32.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 1 -- 10.20.193.5:0/1989662246 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f036800ead0 con 0x7f0368004e40 2026-02-17T21:30:32.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:32.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.611+0000 7f03827fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:30:32.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.612+0000 7f03837fe640 1 --2- 10.20.193.5:0/1989662246 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0368003fe0 0x7f0368004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:32.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.612+0000 7f0383fff640 1 --2- 10.20.193.5:0/1989662246 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f036800bd40 0x7f036800e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:32.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.612+0000 7f03837fe640 10 monclient(hunting): get_auth_request con 0x7f0368003fe0 auth_method 0 2026-02-17T21:30:32.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.612+0000 7f03837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:32.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.612+0000 7f03837fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:32.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.612+0000 7f03837fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:30:32.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.613+0000 7f0382ffd640 1 --2- 10.20.193.5:0/1989662246 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0368004e40 0x7f03680052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:32.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.613+0000 7f03837fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:32.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.613+0000 7f03837fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:32.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.613+0000 7f03837fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:30:32.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.613+0000 7f0382ffd640 10 monclient(hunting): get_auth_request con 0x7f0368004e40 auth_method 0 2026-02-17T21:30:32.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.613+0000 7f0382ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:32.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.613+0000 7f0382ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:32.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.613+0000 7f0382ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:30:32.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.613+0000 7f0383fff640 10 monclient(hunting): get_auth_request con 0x7f036800bd40 auth_method 0 2026-02-17T21:30:32.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.613+0000 7f0383fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:32.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.613+0000 7f0383fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:32.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.613+0000 7f0383fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:30:32.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.613+0000 7f0383fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:32.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.613+0000 7f0383fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:32.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.613+0000 7f0383fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:30:32.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.613+0000 7f0382ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:32.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.613+0000 7f0382ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:32.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.613+0000 7f0382ffd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:30:32.628 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.614+0000 7f03837fe640 10 monclient(hunting): handle_auth_done global_id 5140 payload 293 2026-02-17T21:30:32.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.614+0000 7f03837fe640 1 -- 10.20.193.5:0/1989662246 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0368004e40 msgr2=0x7f03680052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:32.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.614+0000 7f03837fe640 1 --2- 10.20.193.5:0/1989662246 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0368004e40 0x7f03680052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:32.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.614+0000 7f03837fe640 1 -- 10.20.193.5:0/1989662246 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f036800bd40 msgr2=0x7f036800e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:32.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.614+0000 7f03837fe640 1 --2- 10.20.193.5:0/1989662246 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f036800bd40 0x7f036800e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:32.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.614+0000 7f03837fe640 10 monclient: _finish_hunting 0 2026-02-17T21:30:32.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.614+0000 7f03837fe640 1 monclient: found mon.a 2026-02-17T21:30:32.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.614+0000 7f03837fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:32.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.614+0000 7f03837fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:32.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.614+0000 7f0383fff640 1 -- 10.20.193.5:0/1989662246 reap_dead start 2026-02-17T21:30:32.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.614+0000 7f03837fe640 1 -- 10.20.193.5:0/1989662246 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0368003620 con 0x7f0368003fe0 2026-02-17T21:30:32.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.614+0000 7f03837fe640 10 monclient: _finish_auth 0 2026-02-17T21:30:32.629 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.614+0000 7f03837fe640 10 monclient: _check_auth_tickets 2026-02-17T21:30:32.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.614+0000 7f03837fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:32.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.614+0000 7f0389fbc640 5 monclient: authenticate success, global_id 5140 2026-02-17T21:30:32.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.614+0000 7f0389fbc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:32.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.614+0000 7f03837fe640 1 --2- 10.20.193.5:0/1989662246 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0368003fe0 0x7f0368004900 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f03700032f0 tx=0x7f037002efe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0467e0606e041bd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:32.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.616+0000 7f03827fc640 1 -- 10.20.193.5:0/1989662246 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0370002f10 con 0x7f0368003fe0 2026-02-17T21:30:32.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.616+0000 7f03827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:32.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.616+0000 7f03827fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:32.630 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.616+0000 7f03827fc640 10 monclient: dump: 2026-02-17T21:30:32.630 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:32.630 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:32.630 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:32.630 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:32.631 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:32.631 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:32.631 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:32.631 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:32.631 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:32.631 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:32.631 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.616+0000 7f0389fbc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:32.631 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.616+0000 7f03827fc640 1 -- 10.20.193.5:0/1989662246 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0370033070 con 0x7f0368003fe0 2026-02-17T21:30:32.631 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.616+0000 7f03827fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:32.631 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.616+0000 7f03827fc640 1 -- 10.20.193.5:0/1989662246 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0370004de0 con 0x7f0368003fe0 2026-02-17T21:30:32.631 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.616+0000 7f03827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:32.631 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.616+0000 7f03827fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:32.632 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.616+0000 7f03827fc640 10 monclient: dump: 2026-02-17T21:30:32.632 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:32.632 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:32.632 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:32.632 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:32.632 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:32.632 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:32.632 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:32.632 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:32.632 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:32.632 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:32.632 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.616+0000 7f0389fbc640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:32.632 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.616+0000 7f0389fbc640 4 set_mon_vals no callback set 2026-02-17T21:30:32.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.617+0000 7f0389fbc640 10 monclient: shutdown 2026-02-17T21:30:32.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.617+0000 7f0389fbc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:32.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.617+0000 7f0389fbc640 1 -- 10.20.193.5:0/1989662246 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0368003fe0 msgr2=0x7f0368004900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:32.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.617+0000 7f0389fbc640 1 --2- 10.20.193.5:0/1989662246 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0368003fe0 0x7f0368004900 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f03700032f0 tx=0x7f037002efe0 comp rx=0 tx=0).stop 2026-02-17T21:30:32.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.617+0000 7f0389fbc640 1 -- 10.20.193.5:0/1989662246 shutdown_connections 2026-02-17T21:30:32.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.617+0000 7f0389fbc640 1 --2- 10.20.193.5:0/1989662246 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0368003fe0 0x7f0368004900 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:32.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.617+0000 7f0389fbc640 1 -- 10.20.193.5:0/1989662246 >> 10.20.193.5:0/1989662246 conn(0x7f03840c9f40 msgr2=0x7f03840ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:32.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.617+0000 7f0389fbc640 1 -- 10.20.193.5:0/1989662246 shutdown_connections 2026-02-17T21:30:32.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.617+0000 7f0389fbc640 1 -- 10.20.193.5:0/1989662246 wait complete. 2026-02-17T21:30:32.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.617+0000 7f0389fbc640 10 monclient: build_initial_monmap 2026-02-17T21:30:32.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.617+0000 7f0389fbc640 10 monclient: monmap: 2026-02-17T21:30:32.633 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:32.634 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:32.634 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:32.634 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:32.634 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:32.634 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:32.634 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:32.634 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:32.634 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:32.634 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:32.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.618+0000 7f0389fbc640 1 librados: starting msgr at 2026-02-17T21:30:32.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.618+0000 7f0389fbc640 1 librados: starting objecter 2026-02-17T21:30:32.634 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.618+0000 7f0389fbc640 1 Processor -- start 2026-02-17T21:30:32.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.618+0000 7f0389fbc640 1 -- start start 2026-02-17T21:30:32.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.618+0000 7f0389fbc640 1 librados: setting wanted keys 2026-02-17T21:30:32.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.618+0000 7f0389fbc640 1 librados: calling monclient init 2026-02-17T21:30:32.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.618+0000 7f0389fbc640 10 monclient: init 2026-02-17T21:30:32.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.618+0000 7f0389fbc640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:32.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.618+0000 7f0389fbc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:30:32.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.618+0000 7f0389fbc640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0368003fe0 0x7f0384154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:32.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.618+0000 7f0389fbc640 10 monclient(hunting): picked mon.noname-b con 0x7f0368003fe0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:32.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.618+0000 7f0389fbc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f03841f6fa0 0x7f03840c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:32.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.618+0000 7f0389fbc640 10 monclient(hunting): picked mon.noname-c con 0x7f03841f6fa0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:32.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.618+0000 7f0389fbc640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f03841f7420 0x7f03840c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:32.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.618+0000 7f0389fbc640 10 monclient(hunting): picked mon.noname-a con 0x7f03841f7420 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:32.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.618+0000 7f0389fbc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:32.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.618+0000 7f0389fbc640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f03840738f0 con 0x7f03841f7420 2026-02-17T21:30:32.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.618+0000 7f0389fbc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:32.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.618+0000 7f0389fbc640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0384074cf0 con 0x7f0368003fe0 2026-02-17T21:30:32.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.618+0000 7f0389fbc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:32.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.618+0000 7f0389fbc640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0384073a70 con 0x7f03841f6fa0 2026-02-17T21:30:32.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.618+0000 7f0389fbc640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:32.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.618+0000 7f0389fbc640 10 monclient(hunting): authenticate will time out at 1338.183530s 2026-02-17T21:30:32.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.618+0000 7f0382ffd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f03841f6fa0 0x7f03840c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:32.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.619+0000 7f0383fff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f03841f7420 0x7f03840c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:32.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.619+0000 7f0382ffd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f03841f6fa0 0x7f03840c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:52176/0 (socket says 10.20.193.5:52176) 2026-02-17T21:30:32.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.619+0000 7f0382ffd640 1 -- 10.20.193.5:0/1915706260 learned_addr learned my addr 10.20.193.5:0/1915706260 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:32.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.619+0000 7f0382ffd640 10 monclient(hunting): get_auth_request con 0x7f03841f6fa0 auth_method 0 2026-02-17T21:30:32.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.619+0000 7f0382ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:32.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.619+0000 7f0382ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:32.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.619+0000 7f0382ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:32.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.619+0000 7f0383fff640 10 monclient(hunting): get_auth_request con 0x7f03841f7420 auth_method 0 2026-02-17T21:30:32.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.619+0000 7f0383fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:32.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.619+0000 7f0383fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:32.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.619+0000 7f0383fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:32.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.619+0000 7f0382ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:32.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.619+0000 7f0382ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:32.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.619+0000 7f0382ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:32.637 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.619+0000 7f03837fe640 1 --2- 10.20.193.5:0/1915706260 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0368003fe0 0x7f0384154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:32.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.619+0000 7f03837fe640 10 monclient(hunting): get_auth_request con 0x7f0368003fe0 auth_method 0 2026-02-17T21:30:32.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.619+0000 7f03837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:32.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.619+0000 7f03837fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:32.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.619+0000 7f03837fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:32.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.619+0000 7f0383fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:32.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.619+0000 7f0383fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:32.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.619+0000 7f0383fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:32.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.619+0000 7f03837fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:32.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.619+0000 7f03837fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:32.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.619+0000 7f03837fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:32.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.620+0000 7f0382ffd640 10 monclient(hunting): handle_auth_done global_id 5141 payload 824 2026-02-17T21:30:32.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.620+0000 7f0382ffd640 1 -- 10.20.193.5:0/1915706260 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0368003fe0 msgr2=0x7f0384154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:32.638 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.620+0000 7f0382ffd640 1 --2- 10.20.193.5:0/1915706260 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0368003fe0 0x7f0384154c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:32.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.620+0000 7f0382ffd640 1 -- 10.20.193.5:0/1915706260 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f03841f7420 msgr2=0x7f03840c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:32.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.620+0000 7f0382ffd640 1 --2- 10.20.193.5:0/1915706260 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f03841f7420 0x7f03840c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:32.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.620+0000 7f0382ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:30:32.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.620+0000 7f0382ffd640 1 monclient: found mon.noname-c 2026-02-17T21:30:32.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.620+0000 7f0382ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:32.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.620+0000 7f0382ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:32.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.620+0000 7f0382ffd640 1 -- 10.20.193.5:0/1915706260 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0384155180 con 0x7f03841f6fa0 2026-02-17T21:30:32.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.621+0000 7f0382ffd640 1 --2- 10.20.193.5:0/1915706260 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f03841f6fa0 0x7f03840c81c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f037400f850 tx=0x7f037400fd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:32.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.621+0000 7f035ffff640 10 client.?.objecter ms_handle_connect 0x7f03841f6fa0 2026-02-17T21:30:32.639 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.621+0000 7f035ffff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:32.642 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.623+0000 7f035ffff640 1 -- 10.20.193.5:0/1915706260 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03740052e0 con 0x7f03841f6fa0 2026-02-17T21:30:32.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.623+0000 7f035ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:32.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.623+0000 7f035ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:32.643 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.623+0000 7f035ffff640 10 monclient: dump: 2026-02-17T21:30:32.643 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:32.643 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:32.643 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:32.643 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:32.643 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:32.643 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:32.644 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:32.644 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:32.644 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:32.644 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:32.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.623+0000 7f035ffff640 10 monclient: _finish_auth 0 2026-02-17T21:30:32.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.623+0000 7f035ffff640 10 monclient: _check_auth_tickets 2026-02-17T21:30:32.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.623+0000 7f035ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:32.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.623+0000 7f035ffff640 1 -- 10.20.193.5:0/1915706260 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0374018070 con 0x7f03841f6fa0 2026-02-17T21:30:32.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.623+0000 7f0389fbc640 5 monclient: authenticate success, global_id 5141 2026-02-17T21:30:32.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.623+0000 7f0389fbc640 10 monclient: _renew_subs 2026-02-17T21:30:32.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.623+0000 7f0389fbc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:32.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.623+0000 7f0389fbc640 1 -- 10.20.193.5:0/1915706260 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0384155430 con 0x7f03841f6fa0 2026-02-17T21:30:32.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.623+0000 7f035ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:32.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.623+0000 7f035ffff640 1 -- 10.20.193.5:0/1915706260 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03740036f0 con 0x7f03841f6fa0 2026-02-17T21:30:32.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.623+0000 7f035ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:32.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.623+0000 7f035ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:32.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.623+0000 7f0381ffb640 4 set_mon_vals no callback set 2026-02-17T21:30:32.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.623+0000 7f035ffff640 10 monclient: dump: 2026-02-17T21:30:32.645 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:32.646 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:32.646 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:32.646 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:32.646 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:32.646 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:32.646 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:32.646 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:32.646 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:32.646 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:32.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.623+0000 7f0389fbc640 10 client.5141.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:32.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.623+0000 7f0389fbc640 10 monclient: _renew_subs 2026-02-17T21:30:32.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.623+0000 7f0389fbc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:32.646 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.623+0000 7f0389fbc640 1 -- 10.20.193.5:0/1915706260 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03841559f0 con 0x7f03841f6fa0 2026-02-17T21:30:32.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.623+0000 7f0389fbc640 1 librados: init done 2026-02-17T21:30:32.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.624+0000 7f0389fbc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:32.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.624+0000 7f0389fbc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:32.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.624+0000 7f0389fbc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:32.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.624+0000 7f0389fbc640 1 -- 10.20.193.5:0/1915706260 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03841593f0 con 0x7f03841f6fa0 2026-02-17T21:30:32.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.637+0000 7f035ffff640 1 -- 10.20.193.5:0/1915706260 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f0374003890 con 0x7f03841f6fa0 2026-02-17T21:30:32.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.637+0000 7f035ffff640 1 --2- 10.20.193.5:0/1915706260 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0354079300 0x7f035407b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:32.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.637+0000 7f03837fe640 1 --2- 10.20.193.5:0/1915706260 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0354079300 0x7f035407b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:32.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.637+0000 7f03837fe640 10 monclient: get_auth_request con 0x7f0354079300 auth_method 0 2026-02-17T21:30:32.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.638+0000 7f035ffff640 10 client.5141.objecter ms_handle_connect 0x7f0354079300 2026-02-17T21:30:32.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.638+0000 7f03837fe640 1 --2- 10.20.193.5:0/1915706260 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0354079300 0x7f035407b7c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0370036000 tx=0x7f0370007000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:32.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.639+0000 7f035ffff640 1 -- 10.20.193.5:0/1915706260 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f037405e620 con 0x7f03841f6fa0 2026-02-17T21:30:32.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.639+0000 7f035ffff640 10 client.5141.objecter ms_dispatch2 0x7f0384000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:32.647 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.639+0000 7f035ffff640 3 client.5141.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:32.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.639+0000 7f035ffff640 3 client.5141.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:32.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.639+0000 7f035ffff640 20 client.5141.objecter dump_active .. 0 homeless 2026-02-17T21:30:32.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.741+0000 7f035ffff640 1 -- 10.20.193.5:0/1915706260 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0374062ce0 con 0x7f03841f6fa0 2026-02-17T21:30:32.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.741+0000 7f035ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:32.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.741+0000 7f035ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:32.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.840+0000 7f0389fbc640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:30:32.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.840+0000 7f0389fbc640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:32.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.840+0000 7f0389fbc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:32.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.840+0000 7f0389fbc640 1 -- 10.20.193.5:0/1915706260 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0384156320 con 0x7f03841f6fa0 2026-02-17T21:30:32.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.843+0000 7f035ffff640 1 -- 10.20.193.5:0/1915706260 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f037400fe60 con 0x7f03841f6fa0 2026-02-17T21:30:32.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.843+0000 7f035ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:32.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.843+0000 7f035ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:30:32.844 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:30:32.844 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:30:32.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.843+0000 7f0389fbc640 10 librados: watch_flush enter 2026-02-17T21:30:32.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.843+0000 7f0389fbc640 10 librados: watch_flush exit 2026-02-17T21:30:32.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.843+0000 7f0389fbc640 20 client.5141.objecter shutdown clearing up homeless session... 2026-02-17T21:30:32.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.843+0000 7f0389fbc640 10 client.5141.objecter successfully canceled tick 2026-02-17T21:30:32.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.843+0000 7f0389fbc640 1 -- 10.20.193.5:0/1915706260 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0354079300 msgr2=0x7f035407b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:32.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.843+0000 7f0389fbc640 1 --2- 10.20.193.5:0/1915706260 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0354079300 0x7f035407b7c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0370036000 tx=0x7f0370007000 comp rx=0 tx=0).stop 2026-02-17T21:30:32.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.843+0000 7f0389fbc640 10 monclient: shutdown 2026-02-17T21:30:32.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.843+0000 7f0389fbc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:32.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.843+0000 7f0389fbc640 1 -- 10.20.193.5:0/1915706260 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f03841f6fa0 msgr2=0x7f03840c81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:32.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.843+0000 7f0389fbc640 1 --2- 10.20.193.5:0/1915706260 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f03841f6fa0 0x7f03840c81c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f037400f850 tx=0x7f037400fd20 comp rx=0 tx=0).stop 2026-02-17T21:30:32.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.843+0000 7f0389fbc640 1 -- 10.20.193.5:0/1915706260 shutdown_connections 2026-02-17T21:30:32.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.843+0000 7f0389fbc640 1 --2- 10.20.193.5:0/1915706260 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0354079300 0x7f035407b7c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:32.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.843+0000 7f0389fbc640 1 --2- 10.20.193.5:0/1915706260 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f03841f7420 0x7f03840c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:32.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.843+0000 7f0389fbc640 1 --2- 10.20.193.5:0/1915706260 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f03841f6fa0 0x7f03840c81c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:32.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.843+0000 7f0389fbc640 1 --2- 10.20.193.5:0/1915706260 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0368003fe0 0x7f0384154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:32.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.843+0000 7f0389fbc640 1 -- 10.20.193.5:0/1915706260 >> 10.20.193.5:0/1915706260 conn(0x7f03840c9f40 msgr2=0x7f038414d540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:32.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.843+0000 7f0389fbc640 1 -- 10.20.193.5:0/1915706260 shutdown_connections 2026-02-17T21:30:32.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.843+0000 7f0389fbc640 1 -- 10.20.193.5:0/1915706260 wait complete. 2026-02-17T21:30:32.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:32.843+0000 7f0389fbc640 1 librados: shutdown 2026-02-17T21:30:35.855 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:30:35.925 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.923+0000 7fe4e947c640 10 monclient: get_monmap_and_config 2026-02-17T21:30:35.925 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.923+0000 7fe4e947c640 10 monclient: build_initial_monmap 2026-02-17T21:30:35.925 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.923+0000 7fe4e947c640 10 monclient: monmap: 2026-02-17T21:30:35.926 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:35.926 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:35.926 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:35.924378+0000 2026-02-17T21:30:35.926 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:35.924378+0000 2026-02-17T21:30:35.926 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:35.926 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:35.926 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:35.926 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:35.926 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:35.926 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:35.926 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:35.927 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:35.927 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:35.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.924+0000 7fe4e947c640 1 Processor -- start 2026-02-17T21:30:35.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.924+0000 7fe4e947c640 1 -- start start 2026-02-17T21:30:35.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.924+0000 7fe4e947c640 10 monclient: init 2026-02-17T21:30:35.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.924+0000 7fe4e947c640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:35.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.924+0000 7fe4e947c640 10 monclient: _add_conns ranks=[3,1,2,5,0,4] 2026-02-17T21:30:35.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.924+0000 7fe4e947c640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fe4e40c7170 0x7fe4e40c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:35.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.924+0000 7fe4e947c640 10 monclient(hunting): picked mon.noname-a con 0x7fe4e40c7170 addr v2:10.20.193.5:3300/0 2026-02-17T21:30:35.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.924+0000 7fe4e947c640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fe4e40c48c0 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:35.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.924+0000 7fe4e947c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe4e40c4d10 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:35.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.924+0000 7fe4e947c640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4e415a9a0 con 0x7fe4e40c48c0 2026-02-17T21:30:35.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.924+0000 7fe4e947c640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4e40c5270 con 0x7fe4e40c4d10 2026-02-17T21:30:35.930 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.924+0000 7fe4e947c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:35.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.924+0000 7fe4e947c640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe4e40c8530 con 0x7fe4e40c7170 2026-02-17T21:30:35.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.924+0000 7fe4e947c640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:35.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.924+0000 7fe4e947c640 10 monclient(hunting): authenticate will time out at 1341.489664s 2026-02-17T21:30:35.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.925+0000 7fe4e2ffd640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fe4e40c7170 0x7fe4e40c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:35.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.925+0000 7fe4e37fe640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7fe4e40c4d10 0x7fe4e40c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:53446/0 (socket says 10.20.193.5:53446) 2026-02-17T21:30:35.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.925+0000 7fe4e37fe640 1 -- 10.20.193.5:0/3861004502 learned_addr learned my addr 10.20.193.5:0/3861004502 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:35.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.925+0000 7fe4e2ffd640 10 monclient(hunting): get_auth_request con 0x7fe4e40c7170 auth_method 0 2026-02-17T21:30:35.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.925+0000 7fe4e2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:35.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.925+0000 7fe4e2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:35.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.925+0000 7fe4e2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:35.931 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.925+0000 7fe4e2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:35.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.925+0000 7fe4e2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:35.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.925+0000 7fe4e2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:35.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.926+0000 7fe4e1ffb640 1 -- 10.20.193.5:0/3861004502 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 281102409 0 0) 0x7fe4e40c5270 con 0x7fe4e40c4d10 2026-02-17T21:30:35.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.926+0000 7fe4e1ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:30:35.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.926+0000 7fe4e1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:35.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.926+0000 7fe4e1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:35.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.926+0000 7fe4e1ffb640 10 monclient(hunting): my global_id is 5144 2026-02-17T21:30:35.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.926+0000 7fe4e1ffb640 1 -- 10.20.193.5:0/3861004502 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4d0003620 con 0x7fe4e40c4d10 2026-02-17T21:30:35.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.926+0000 7fe4e2ffd640 10 monclient(hunting): handle_auth_done global_id 5076 payload 274 2026-02-17T21:30:35.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.926+0000 7fe4e2ffd640 1 -- 10.20.193.5:0/3861004502 >> v1:10.20.193.135:6789/0 conn(0x7fe4e40c4d10 legacy=0x7fe4e40c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:35.932 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.926+0000 7fe4e2ffd640 1 -- 10.20.193.5:0/3861004502 >> v1:10.20.193.119:6789/0 conn(0x7fe4e40c48c0 legacy=0x7fe4e40749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:35.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.926+0000 7fe4e2ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:30:35.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.926+0000 7fe4e1ffb640 1 -- 10.20.193.5:0/3861004502 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3258867463 0 0) 0x7fe4e415a9a0 con 0x7fe4e40c48c0 2026-02-17T21:30:35.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.926+0000 7fe4e2ffd640 1 monclient: found mon.noname-a 2026-02-17T21:30:35.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.926+0000 7fe4e2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:35.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.926+0000 7fe4e2ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:35.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.926+0000 7fe4e2ffd640 1 -- 10.20.193.5:0/3861004502 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e40c5550 con 0x7fe4e40c7170 2026-02-17T21:30:35.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.926+0000 7fe4e1ffb640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-17T21:30:35.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.927+0000 7fe4e2ffd640 1 --2- 10.20.193.5:0/3861004502 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe4e40c7170 0x7fe4e40c7550 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe4d80098a0 tx=0x7fe4d802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab99c32649519831 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:35.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.929+0000 7fe4e1ffb640 1 -- 10.20.193.5:0/3861004502 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d803c070 con 0x7fe4e40c7170 2026-02-17T21:30:35.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.929+0000 7fe4e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:35.939 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.929+0000 7fe4e1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:35.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.929+0000 7fe4e1ffb640 10 monclient: dump: 2026-02-17T21:30:35.940 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:35.940 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:35.940 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:35.940 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:35.940 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:35.940 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:35.940 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:35.940 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:35.940 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:35.940 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:35.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.929+0000 7fe4e1ffb640 10 monclient: _finish_auth 0 2026-02-17T21:30:35.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.929+0000 7fe4e1ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:30:35.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.929+0000 7fe4e1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:35.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.929+0000 7fe4e1ffb640 1 -- 10.20.193.5:0/3861004502 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d802fb70 con 0x7fe4e40c7170 2026-02-17T21:30:35.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.929+0000 7fe4e1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:35.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.929+0000 7fe4e947c640 5 monclient: authenticate success, global_id 5076 2026-02-17T21:30:35.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.929+0000 7fe4e1ffb640 1 -- 10.20.193.5:0/3861004502 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d8037440 con 0x7fe4e40c7170 2026-02-17T21:30:35.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.929+0000 7fe4e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:35.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.929+0000 7fe4e1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:35.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.929+0000 7fe4e1ffb640 10 monclient: dump: 2026-02-17T21:30:35.941 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:35.941 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:35.941 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:35.942 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:35.942 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:35.942 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:35.942 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:35.942 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:35.942 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:35.942 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:35.942 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.929+0000 7fe4e947c640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:35.942 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.929+0000 7fe4e947c640 4 set_mon_vals no callback set 2026-02-17T21:30:35.942 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.929+0000 7fe4e947c640 10 monclient: shutdown 2026-02-17T21:30:35.942 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.929+0000 7fe4e947c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:35.942 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.929+0000 7fe4e947c640 1 -- 10.20.193.5:0/3861004502 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe4e40c7170 msgr2=0x7fe4e40c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:35.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.929+0000 7fe4e947c640 1 --2- 10.20.193.5:0/3861004502 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe4e40c7170 0x7fe4e40c7550 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe4d80098a0 tx=0x7fe4d802ee60 comp rx=0 tx=0).stop 2026-02-17T21:30:35.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.929+0000 7fe4e947c640 1 -- 10.20.193.5:0/3861004502 shutdown_connections 2026-02-17T21:30:35.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.929+0000 7fe4e947c640 1 --2- 10.20.193.5:0/3861004502 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe4e40c7170 0x7fe4e40c7550 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:35.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.929+0000 7fe4e947c640 1 -- 10.20.193.5:0/3861004502 >> 10.20.193.5:0/3861004502 conn(0x7fe4e40c9f40 msgr2=0x7fe4e40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:35.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.929+0000 7fe4e947c640 1 -- 10.20.193.5:0/3861004502 shutdown_connections 2026-02-17T21:30:35.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.929+0000 7fe4e947c640 1 -- 10.20.193.5:0/3861004502 wait complete. 2026-02-17T21:30:35.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.930+0000 7fe4e947c640 10 monclient: build_initial_monmap 2026-02-17T21:30:35.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.930+0000 7fe4e947c640 10 monclient: monmap: 2026-02-17T21:30:35.943 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:35.943 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:35.943 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:35.943 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:35.944 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:35.944 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:35.944 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:35.944 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:35.944 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:35.944 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:35.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.930+0000 7fe4e947c640 1 librados: starting msgr at 2026-02-17T21:30:35.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.930+0000 7fe4e947c640 1 librados: starting objecter 2026-02-17T21:30:35.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.930+0000 7fe4e947c640 1 Processor -- start 2026-02-17T21:30:35.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.930+0000 7fe4e947c640 1 -- start start 2026-02-17T21:30:35.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.930+0000 7fe4e947c640 1 librados: setting wanted keys 2026-02-17T21:30:35.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.930+0000 7fe4e947c640 1 librados: calling monclient init 2026-02-17T21:30:35.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.930+0000 7fe4e947c640 10 monclient: init 2026-02-17T21:30:35.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e947c640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:35.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e947c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:30:35.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e947c640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe4e40c48c0 0x7fe4e41f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:35.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e947c640 10 monclient(hunting): picked mon.noname-c con 0x7fe4e40c48c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:35.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e947c640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe4e40c4d10 0x7fe4e415b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:35.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e947c640 10 monclient(hunting): picked mon.noname-a con 0x7fe4e40c4d10 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:35.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e947c640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe4e40c7170 0x7fe4e4155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:35.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e947c640 10 monclient(hunting): picked mon.noname-b con 0x7fe4e40c7170 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:35.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e947c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:35.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e947c640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e40c81c0 con 0x7fe4e40c4d10 2026-02-17T21:30:35.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e947c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:35.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e947c640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e40c7ee0 con 0x7fe4e40c7170 2026-02-17T21:30:35.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e947c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:35.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e947c640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e40750c0 con 0x7fe4e40c48c0 2026-02-17T21:30:35.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e947c640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:35.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e947c640 10 monclient(hunting): authenticate will time out at 1341.496341s 2026-02-17T21:30:35.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e27fc640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe4e40c4d10 0x7fe4e415b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:35.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e2ffd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe4e40c48c0 0x7fe4e41f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:35.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e37fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe4e40c7170 0x7fe4e4155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:35.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e27fc640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe4e40c4d10 0x7fe4e415b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:55564/0 (socket says 10.20.193.5:55564) 2026-02-17T21:30:35.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e27fc640 1 -- 10.20.193.5:0/1519908458 learned_addr learned my addr 10.20.193.5:0/1519908458 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:35.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e27fc640 10 monclient(hunting): get_auth_request con 0x7fe4e40c4d10 auth_method 0 2026-02-17T21:30:35.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:35.946 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:35.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:35.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e2ffd640 10 monclient(hunting): get_auth_request con 0x7fe4e40c48c0 auth_method 0 2026-02-17T21:30:35.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:35.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:35.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:35.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:35.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:35.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:35.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e37fe640 10 monclient(hunting): get_auth_request con 0x7fe4e40c7170 auth_method 0 2026-02-17T21:30:35.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:35.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:35.947 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.931+0000 7fe4e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:35.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.932+0000 7fe4e2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:35.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.932+0000 7fe4e2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:35.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.932+0000 7fe4e2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:35.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.932+0000 7fe4e37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:35.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.932+0000 7fe4e37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:35.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.932+0000 7fe4e37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:35.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.933+0000 7fe4e27fc640 10 monclient(hunting): handle_auth_done global_id 5079 payload 824 2026-02-17T21:30:35.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.933+0000 7fe4e27fc640 1 -- 10.20.193.5:0/1519908458 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe4e40c48c0 msgr2=0x7fe4e41f4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:35.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.933+0000 7fe4e27fc640 1 --2- 10.20.193.5:0/1519908458 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe4e40c48c0 0x7fe4e41f4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:35.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.933+0000 7fe4e27fc640 1 -- 10.20.193.5:0/1519908458 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe4e40c7170 msgr2=0x7fe4e4155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:35.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.933+0000 7fe4e27fc640 1 --2- 10.20.193.5:0/1519908458 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe4e40c7170 0x7fe4e4155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:35.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.933+0000 7fe4e27fc640 10 monclient: _finish_hunting 0 2026-02-17T21:30:35.948 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.933+0000 7fe4e27fc640 1 monclient: found mon.noname-a 2026-02-17T21:30:35.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.933+0000 7fe4e27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:35.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.933+0000 7fe4e27fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:35.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.933+0000 7fe4e27fc640 1 -- 10.20.193.5:0/1519908458 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e415dd40 con 0x7fe4e40c4d10 2026-02-17T21:30:35.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.934+0000 7fe4e27fc640 1 --2- 10.20.193.5:0/1519908458 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe4e40c4d10 0x7fe4e415b130 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00c530 tx=0x7fe4cc00ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:35.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.934+0000 7fe4c37fe640 10 client.?.objecter ms_handle_connect 0x7fe4e40c4d10 2026-02-17T21:30:35.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.934+0000 7fe4c37fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:35.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.935+0000 7fe4c37fe640 1 -- 10.20.193.5:0/1519908458 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc017070 con 0x7fe4e40c4d10 2026-02-17T21:30:35.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.935+0000 7fe4c37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:35.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.936+0000 7fe4c37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:35.949 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.936+0000 7fe4c37fe640 10 monclient: dump: 2026-02-17T21:30:35.949 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:35.949 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:35.949 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:35.950 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:35.950 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:35.950 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:35.950 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:35.950 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:35.950 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:35.950 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:35.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.936+0000 7fe4c37fe640 10 monclient: _finish_auth 0 2026-02-17T21:30:35.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.936+0000 7fe4c37fe640 10 monclient: _check_auth_tickets 2026-02-17T21:30:35.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.936+0000 7fe4c37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:35.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.936+0000 7fe4c37fe640 1 -- 10.20.193.5:0/1519908458 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4cc005480 con 0x7fe4e40c4d10 2026-02-17T21:30:35.950 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.936+0000 7fe4c37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:35.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.936+0000 7fe4c37fe640 1 -- 10.20.193.5:0/1519908458 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc0038f0 con 0x7fe4e40c4d10 2026-02-17T21:30:35.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.936+0000 7fe4e947c640 5 monclient: authenticate success, global_id 5079 2026-02-17T21:30:35.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.936+0000 7fe4e947c640 10 monclient: _renew_subs 2026-02-17T21:30:35.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.936+0000 7fe4e947c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:35.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.936+0000 7fe4e947c640 1 -- 10.20.193.5:0/1519908458 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4e415e020 con 0x7fe4e40c4d10 2026-02-17T21:30:35.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.936+0000 7fe4e17fa640 4 set_mon_vals no callback set 2026-02-17T21:30:35.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.936+0000 7fe4c37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:35.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.936+0000 7fe4c37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:35.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.936+0000 7fe4c37fe640 10 monclient: dump: 2026-02-17T21:30:35.951 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:35.951 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:35.951 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:35.952 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:35.952 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:35.952 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:35.952 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:35.952 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:35.952 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:35.952 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:35.952 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.936+0000 7fe4e947c640 10 client.5079.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:35.952 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.936+0000 7fe4e947c640 10 monclient: _renew_subs 2026-02-17T21:30:35.952 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.936+0000 7fe4e947c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:35.952 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.936+0000 7fe4e947c640 1 -- 10.20.193.5:0/1519908458 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4e4154a80 con 0x7fe4e40c4d10 2026-02-17T21:30:35.952 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.936+0000 7fe4e947c640 1 librados: init done 2026-02-17T21:30:35.952 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.936+0000 7fe4e947c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:35.953 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.936+0000 7fe4e947c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:35.953 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.936+0000 7fe4e947c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:35.953 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.936+0000 7fe4e947c640 1 -- 10.20.193.5:0/1519908458 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4e40c7550 con 0x7fe4e40c4d10 2026-02-17T21:30:35.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.948+0000 7fe4c37fe640 1 -- 10.20.193.5:0/1519908458 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fe4cc003a90 con 0x7fe4e40c4d10 2026-02-17T21:30:35.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.949+0000 7fe4c37fe640 1 --2- 10.20.193.5:0/1519908458 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe4b0079280 0x7fe4b007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:35.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.949+0000 7fe4e2ffd640 1 --2- 10.20.193.5:0/1519908458 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe4b0079280 0x7fe4b007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:35.954 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.949+0000 7fe4e2ffd640 10 monclient: get_auth_request con 0x7fe4b0079280 auth_method 0 2026-02-17T21:30:35.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.950+0000 7fe4e2ffd640 1 --2- 10.20.193.5:0/1519908458 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe4b0079280 0x7fe4b007b740 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8039000 tx=0x7fe4d8033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:35.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.950+0000 7fe4c37fe640 10 client.5079.objecter ms_handle_connect 0x7fe4b0079280 2026-02-17T21:30:35.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.952+0000 7fe4c37fe640 1 -- 10.20.193.5:0/1519908458 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fe4cc05d7f0 con 0x7fe4e40c4d10 2026-02-17T21:30:35.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.952+0000 7fe4c37fe640 10 client.5079.objecter ms_dispatch2 0x7fe4e4000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:35.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.952+0000 7fe4c37fe640 3 client.5079.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:35.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.952+0000 7fe4c37fe640 3 client.5079.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:35.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:35.952+0000 7fe4c37fe640 20 client.5079.objecter dump_active .. 0 homeless 2026-02-17T21:30:36.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.052+0000 7fe4c37fe640 1 -- 10.20.193.5:0/1519908458 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe4cc021020 con 0x7fe4e40c4d10 2026-02-17T21:30:36.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.052+0000 7fe4c37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:36.054 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.052+0000 7fe4c37fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:36.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.153+0000 7fe4e947c640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:30:36.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.153+0000 7fe4e947c640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:36.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.153+0000 7fe4e947c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:36.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.153+0000 7fe4e947c640 1 -- 10.20.193.5:0/1519908458 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe4e4073010 con 0x7fe4e40c4d10 2026-02-17T21:30:36.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.155+0000 7fe4c37fe640 1 -- 10.20.193.5:0/1519908458 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fe4cc0617b0 con 0x7fe4e40c4d10 2026-02-17T21:30:36.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.155+0000 7fe4c37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:36.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.155+0000 7fe4c37fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:30:36.157 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:30:36.157 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:30:36.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.157+0000 7fe4e947c640 10 librados: watch_flush enter 2026-02-17T21:30:36.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.157+0000 7fe4e947c640 10 librados: watch_flush exit 2026-02-17T21:30:36.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.157+0000 7fe4e947c640 20 client.5079.objecter shutdown clearing up homeless session... 2026-02-17T21:30:36.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.157+0000 7fe4e947c640 10 client.5079.objecter successfully canceled tick 2026-02-17T21:30:36.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.157+0000 7fe4e947c640 1 -- 10.20.193.5:0/1519908458 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe4b0079280 msgr2=0x7fe4b007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:36.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.157+0000 7fe4e947c640 1 --2- 10.20.193.5:0/1519908458 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe4b0079280 0x7fe4b007b740 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8039000 tx=0x7fe4d8033000 comp rx=0 tx=0).stop 2026-02-17T21:30:36.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.157+0000 7fe4e947c640 10 monclient: shutdown 2026-02-17T21:30:36.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.157+0000 7fe4e947c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:36.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.157+0000 7fe4e947c640 1 -- 10.20.193.5:0/1519908458 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe4e40c4d10 msgr2=0x7fe4e415b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:36.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.157+0000 7fe4e947c640 1 --2- 10.20.193.5:0/1519908458 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe4e40c4d10 0x7fe4e415b130 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00c530 tx=0x7fe4cc00ca00 comp rx=0 tx=0).stop 2026-02-17T21:30:36.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.157+0000 7fe4e947c640 1 -- 10.20.193.5:0/1519908458 shutdown_connections 2026-02-17T21:30:36.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.157+0000 7fe4e947c640 1 --2- 10.20.193.5:0/1519908458 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe4b0079280 0x7fe4b007b740 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:36.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.157+0000 7fe4e947c640 1 --2- 10.20.193.5:0/1519908458 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe4e40c7170 0x7fe4e4155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:36.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.157+0000 7fe4e947c640 1 --2- 10.20.193.5:0/1519908458 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe4e40c4d10 0x7fe4e415b130 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:36.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.157+0000 7fe4e947c640 1 --2- 10.20.193.5:0/1519908458 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe4e40c48c0 0x7fe4e41f4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:36.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.157+0000 7fe4e947c640 1 -- 10.20.193.5:0/1519908458 >> 10.20.193.5:0/1519908458 conn(0x7fe4e40c9f40 msgr2=0x7fe4e4073810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:36.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.157+0000 7fe4e947c640 1 -- 10.20.193.5:0/1519908458 shutdown_connections 2026-02-17T21:30:36.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.157+0000 7fe4e947c640 1 -- 10.20.193.5:0/1519908458 wait complete. 2026-02-17T21:30:36.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:36.157+0000 7fe4e947c640 1 librados: shutdown 2026-02-17T21:30:37.705 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:07:17.330 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:37.733 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:07:17.358 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:37.733 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:07:17.357 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:37.735 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:07:17.359 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:37.741 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:07:17.366 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:37.742 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:07:17.366 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:37.761 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:07:17.347 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:37.762 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:07:17.348 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:37.769 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:07:17.355 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:39.168 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:30:39.236 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.233+0000 7f68e11fe640 10 monclient: get_monmap_and_config 2026-02-17T21:30:39.236 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.233+0000 7f68e11fe640 10 monclient: build_initial_monmap 2026-02-17T21:30:39.236 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.233+0000 7f68e11fe640 10 monclient: monmap: 2026-02-17T21:30:39.236 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:39.236 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:39.236 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:39.235546+0000 2026-02-17T21:30:39.236 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:39.235546+0000 2026-02-17T21:30:39.236 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:39.236 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:39.236 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:39.236 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:39.236 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:39.236 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:39.236 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:39.236 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:39.236 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:39.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.234+0000 7f68e11fe640 1 Processor -- start 2026-02-17T21:30:39.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.234+0000 7f68e11fe640 1 -- start start 2026-02-17T21:30:39.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.234+0000 7f68e11fe640 10 monclient: init 2026-02-17T21:30:39.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.234+0000 7f68e11fe640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:39.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.234+0000 7f68e11fe640 10 monclient: _add_conns ranks=[1,5,0,3,2,4] 2026-02-17T21:30:39.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.234+0000 7f68e11fe640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f68dc0d1b60 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:39.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.234+0000 7f68e11fe640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f68dc0d1f40 0x7f68dc15c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:39.237 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.234+0000 7f68e11fe640 10 monclient(hunting): picked mon.noname-c con 0x7f68dc0d1f40 addr v2:10.20.193.135:3300/0 2026-02-17T21:30:39.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.234+0000 7f68e11fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f68dc15d950 addr v1:10.20.193.5:6789/0 2026-02-17T21:30:39.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.234+0000 7f68e11fe640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68dc0c98e0 con 0x7f68dc15d950 2026-02-17T21:30:39.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.234+0000 7f68e11fe640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68dc0c9bc0 con 0x7f68dc0d1b60 2026-02-17T21:30:39.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.234+0000 7f68e11fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:39.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.234+0000 7f68e11fe640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f68dc15cd80 con 0x7f68dc0d1f40 2026-02-17T21:30:39.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.234+0000 7f68e11fe640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:39.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.234+0000 7f68e11fe640 10 monclient(hunting): authenticate will time out at 1344.800995s 2026-02-17T21:30:39.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.235+0000 7f68db577640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f68dc15d950 0x7f68dc15dd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:34504/0 (socket says 10.20.193.5:34504) 2026-02-17T21:30:39.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.235+0000 7f68db577640 1 -- 10.20.193.5:0/1384315384 learned_addr learned my addr 10.20.193.5:0/1384315384 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:39.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.235+0000 7f68da575640 1 --2- 10.20.193.5:0/1384315384 >> v2:10.20.193.135:3300/0 conn(0x7f68dc0d1f40 0x7f68dc15c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:39.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.235+0000 7f68da575640 10 monclient(hunting): get_auth_request con 0x7f68dc0d1f40 auth_method 0 2026-02-17T21:30:39.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.235+0000 7f68da575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:39.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.235+0000 7f68da575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:39.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.235+0000 7f68da575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:39.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.236+0000 7f68da575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:39.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.236+0000 7f68da575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:39.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.236+0000 7f68da575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:39.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.236+0000 7f68d9d74640 1 -- 10.20.193.5:0/1384315384 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 895742801 0 0) 0x7f68dc0c98e0 con 0x7f68dc15d950 2026-02-17T21:30:39.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.236+0000 7f68d9d74640 10 monclient(hunting): _negotiate 2026-02-17T21:30:39.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.236+0000 7f68d9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:39.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.236+0000 7f68d9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:39.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.236+0000 7f68d9d74640 10 monclient(hunting): my global_id is 5082 2026-02-17T21:30:39.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.236+0000 7f68d9d74640 1 -- 10.20.193.5:0/1384315384 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68c8003620 con 0x7f68dc15d950 2026-02-17T21:30:39.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.237+0000 7f68da575640 10 monclient(hunting): handle_auth_done global_id 5150 payload 274 2026-02-17T21:30:39.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.237+0000 7f68da575640 1 -- 10.20.193.5:0/1384315384 >> v1:10.20.193.119:6789/0 conn(0x7f68dc0d1b60 legacy=0x7f68dc0c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:39.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.237+0000 7f68da575640 1 -- 10.20.193.5:0/1384315384 >> v1:10.20.193.5:6789/0 conn(0x7f68dc15d950 legacy=0x7f68dc15dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:39.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.237+0000 7f68da575640 10 monclient: _finish_hunting 0 2026-02-17T21:30:39.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.237+0000 7f68da575640 1 monclient: found mon.noname-c 2026-02-17T21:30:39.239 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.237+0000 7f68da575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:39.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.237+0000 7f68da575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:39.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.237+0000 7f68da575640 1 -- 10.20.193.5:0/1384315384 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68dc0c9ea0 con 0x7f68dc0d1f40 2026-02-17T21:30:39.240 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.238+0000 7f68da575640 1 --2- 10.20.193.5:0/1384315384 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f68dc0d1f40 0x7f68dc15c840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f68c40098a0 tx=0x7f68c402ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b7b344a3d6103f1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:39.242 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.240+0000 7f68d9d74640 1 -- 10.20.193.5:0/1384315384 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c403c070 con 0x7f68dc0d1f40 2026-02-17T21:30:39.242 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.240+0000 7f68d9d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:39.242 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.240+0000 7f68d9d74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:39.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.240+0000 7f68d9d74640 10 monclient: dump: 2026-02-17T21:30:39.243 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:39.243 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:39.243 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:39.243 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:39.243 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:39.243 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:39.243 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:39.243 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:39.243 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:39.243 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:39.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.240+0000 7f68d9d74640 10 monclient: _finish_auth 0 2026-02-17T21:30:39.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.240+0000 7f68d9d74640 10 monclient: _check_auth_tickets 2026-02-17T21:30:39.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.240+0000 7f68d9d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:39.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.240+0000 7f68d9d74640 1 -- 10.20.193.5:0/1384315384 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c402fb70 con 0x7f68dc0d1f40 2026-02-17T21:30:39.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.240+0000 7f68d9d74640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:39.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.240+0000 7f68d9d74640 1 -- 10.20.193.5:0/1384315384 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c4037440 con 0x7f68dc0d1f40 2026-02-17T21:30:39.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.240+0000 7f68e11fe640 5 monclient: authenticate success, global_id 5150 2026-02-17T21:30:39.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.240+0000 7f68e11fe640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:39.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.240+0000 7f68e11fe640 4 set_mon_vals no callback set 2026-02-17T21:30:39.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.240+0000 7f68d9d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:39.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.240+0000 7f68d9d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:39.243 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.240+0000 7f68d9d74640 10 monclient: dump: 2026-02-17T21:30:39.244 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:39.244 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:39.244 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:39.244 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:39.244 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:39.244 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:39.244 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:39.244 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:39.244 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:39.244 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:39.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.240+0000 7f68e11fe640 10 monclient: shutdown 2026-02-17T21:30:39.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.240+0000 7f68e11fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:39.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.240+0000 7f68e11fe640 1 -- 10.20.193.5:0/1384315384 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f68dc0d1f40 msgr2=0x7f68dc15c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:39.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.240+0000 7f68e11fe640 1 --2- 10.20.193.5:0/1384315384 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f68dc0d1f40 0x7f68dc15c840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f68c40098a0 tx=0x7f68c402ee60 comp rx=0 tx=0).stop 2026-02-17T21:30:39.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.240+0000 7f68e11fe640 1 -- 10.20.193.5:0/1384315384 shutdown_connections 2026-02-17T21:30:39.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.240+0000 7f68e11fe640 1 --2- 10.20.193.5:0/1384315384 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f68dc0d1f40 0x7f68dc15c840 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:39.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.240+0000 7f68e11fe640 1 -- 10.20.193.5:0/1384315384 >> 10.20.193.5:0/1384315384 conn(0x7f68dc06d9b0 msgr2=0x7f68dc06ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:39.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.240+0000 7f68e11fe640 1 -- 10.20.193.5:0/1384315384 shutdown_connections 2026-02-17T21:30:39.244 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.240+0000 7f68e11fe640 1 -- 10.20.193.5:0/1384315384 wait complete. 2026-02-17T21:30:39.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.241+0000 7f68e11fe640 10 monclient: build_initial_monmap 2026-02-17T21:30:39.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.241+0000 7f68e11fe640 10 monclient: monmap: 2026-02-17T21:30:39.247 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:39.247 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:39.247 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:39.247 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:39.247 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:39.247 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:39.247 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:39.247 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:39.247 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:39.247 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:39.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.241+0000 7f68e11fe640 1 librados: starting msgr at 2026-02-17T21:30:39.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.241+0000 7f68e11fe640 1 librados: starting objecter 2026-02-17T21:30:39.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.241+0000 7f68e11fe640 1 Processor -- start 2026-02-17T21:30:39.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.241+0000 7f68e11fe640 1 -- start start 2026-02-17T21:30:39.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.241+0000 7f68e11fe640 1 librados: setting wanted keys 2026-02-17T21:30:39.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.241+0000 7f68e11fe640 1 librados: calling monclient init 2026-02-17T21:30:39.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.241+0000 7f68e11fe640 10 monclient: init 2026-02-17T21:30:39.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.241+0000 7f68e11fe640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:39.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.241+0000 7f68e11fe640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:30:39.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.241+0000 7f68e11fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f68dc0d1b60 0x7f68dc144ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:39.247 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.241+0000 7f68e11fe640 10 monclient(hunting): picked mon.noname-a con 0x7f68dc0d1b60 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:39.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.241+0000 7f68e11fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f68dc0d1f40 0x7f68dc1f5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:39.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.241+0000 7f68e11fe640 10 monclient(hunting): picked mon.noname-c con 0x7f68dc0d1f40 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:39.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.241+0000 7f68e11fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f68dc15d950 0x7f68dc1f55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:39.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.241+0000 7f68e11fe640 10 monclient(hunting): picked mon.noname-b con 0x7f68dc15d950 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:39.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.241+0000 7f68e11fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:39.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.241+0000 7f68e11fe640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f68dc15d4c0 con 0x7f68dc0d1b60 2026-02-17T21:30:39.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.241+0000 7f68e11fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:39.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.241+0000 7f68e11fe640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f68dc0ca460 con 0x7f68dc15d950 2026-02-17T21:30:39.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.241+0000 7f68e11fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:39.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.241+0000 7f68e11fe640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f68dc06e7b0 con 0x7f68dc0d1f40 2026-02-17T21:30:39.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.241+0000 7f68e11fe640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:39.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.241+0000 7f68e11fe640 10 monclient(hunting): authenticate will time out at 1344.807910s 2026-02-17T21:30:39.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68da575640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f68dc0d1f40 0x7f68dc1f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:39.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68dad76640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f68dc0d1b60 0x7f68dc144ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:39.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68da575640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f68dc0d1f40 0x7f68dc1f5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:33818/0 (socket says 10.20.193.5:33818) 2026-02-17T21:30:39.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68da575640 1 -- 10.20.193.5:0/506055610 learned_addr learned my addr 10.20.193.5:0/506055610 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:39.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68da575640 10 monclient(hunting): get_auth_request con 0x7f68dc0d1f40 auth_method 0 2026-02-17T21:30:39.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68da575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:39.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68da575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:39.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68da575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:39.248 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68db577640 1 --2- 10.20.193.5:0/506055610 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f68dc15d950 0x7f68dc1f55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:39.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68dad76640 10 monclient(hunting): get_auth_request con 0x7f68dc0d1b60 auth_method 0 2026-02-17T21:30:39.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68dad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:39.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68dad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:39.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68dad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:39.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68da575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:39.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68da575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:39.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68da575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:39.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68db577640 10 monclient(hunting): get_auth_request con 0x7f68dc15d950 auth_method 0 2026-02-17T21:30:39.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68db577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:39.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68db577640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:39.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68db577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:39.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68dad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:39.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68dad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:39.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68dad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:39.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68db577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:39.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68db577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:39.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.242+0000 7f68db577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:39.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.244+0000 7f68da575640 10 monclient(hunting): handle_auth_done global_id 5153 payload 824 2026-02-17T21:30:39.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.244+0000 7f68da575640 1 -- 10.20.193.5:0/506055610 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f68dc15d950 msgr2=0x7f68dc1f55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:39.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.244+0000 7f68da575640 1 --2- 10.20.193.5:0/506055610 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f68dc15d950 0x7f68dc1f55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:39.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.244+0000 7f68da575640 1 -- 10.20.193.5:0/506055610 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f68dc0d1b60 msgr2=0x7f68dc144ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:39.249 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.244+0000 7f68da575640 1 --2- 10.20.193.5:0/506055610 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f68dc0d1b60 0x7f68dc144ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:39.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.244+0000 7f68da575640 10 monclient: _finish_hunting 0 2026-02-17T21:30:39.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.244+0000 7f68da575640 1 monclient: found mon.noname-c 2026-02-17T21:30:39.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.244+0000 7f68da575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:39.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.244+0000 7f68da575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:39.250 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.244+0000 7f68da575640 1 -- 10.20.193.5:0/506055610 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68dc1f4a90 con 0x7f68dc0d1f40 2026-02-17T21:30:39.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.245+0000 7f68da575640 1 --2- 10.20.193.5:0/506055610 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f68dc0d1f40 0x7f68dc1f5090 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009130 tx=0x7f68c40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:39.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.245+0000 7f68bb7fe640 10 client.?.objecter ms_handle_connect 0x7f68dc0d1f40 2026-02-17T21:30:39.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.245+0000 7f68bb7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:39.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.246+0000 7f68bb7fe640 1 -- 10.20.193.5:0/506055610 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c403c040 con 0x7f68dc0d1f40 2026-02-17T21:30:39.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.246+0000 7f68bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:39.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.246+0000 7f68bb7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:39.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.246+0000 7f68bb7fe640 10 monclient: dump: 2026-02-17T21:30:39.251 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:39.251 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:39.251 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:39.251 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:39.251 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:39.251 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:39.251 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:39.251 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:39.251 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:39.251 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:39.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.246+0000 7f68bb7fe640 10 monclient: _finish_auth 0 2026-02-17T21:30:39.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.246+0000 7f68bb7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:30:39.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.246+0000 7f68bb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:39.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.246+0000 7f68bb7fe640 1 -- 10.20.193.5:0/506055610 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c4042630 con 0x7f68dc0d1f40 2026-02-17T21:30:39.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.246+0000 7f68bb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:39.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.246+0000 7f68bb7fe640 1 -- 10.20.193.5:0/506055610 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c4042a20 con 0x7f68dc0d1f40 2026-02-17T21:30:39.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.246+0000 7f68e11fe640 5 monclient: authenticate success, global_id 5153 2026-02-17T21:30:39.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.246+0000 7f68d9573640 4 set_mon_vals no callback set 2026-02-17T21:30:39.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.246+0000 7f68e11fe640 10 monclient: _renew_subs 2026-02-17T21:30:39.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.246+0000 7f68e11fe640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:39.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.246+0000 7f68e11fe640 1 -- 10.20.193.5:0/506055610 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68dc15b070 con 0x7f68dc0d1f40 2026-02-17T21:30:39.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.246+0000 7f68bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:39.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.246+0000 7f68bb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:39.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.246+0000 7f68bb7fe640 10 monclient: dump: 2026-02-17T21:30:39.252 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:39.252 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:39.252 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:39.252 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:39.252 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:39.252 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:39.252 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:39.252 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:39.252 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:39.252 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:39.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.247+0000 7f68e11fe640 10 client.5153.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:39.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.247+0000 7f68e11fe640 10 monclient: _renew_subs 2026-02-17T21:30:39.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.247+0000 7f68e11fe640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:39.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.247+0000 7f68e11fe640 1 -- 10.20.193.5:0/506055610 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68dc15b630 con 0x7f68dc0d1f40 2026-02-17T21:30:39.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.247+0000 7f68e11fe640 1 librados: init done 2026-02-17T21:30:39.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.247+0000 7f68e11fe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:39.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.247+0000 7f68e11fe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:39.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.247+0000 7f68e11fe640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:39.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.247+0000 7f68e11fe640 1 -- 10.20.193.5:0/506055610 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68dc15c840 con 0x7f68dc0d1f40 2026-02-17T21:30:39.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.259+0000 7f68bb7fe640 1 -- 10.20.193.5:0/506055610 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f68c404b450 con 0x7f68dc0d1f40 2026-02-17T21:30:39.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.259+0000 7f68bb7fe640 1 --2- 10.20.193.5:0/506055610 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f68a80792d0 0x7f68a807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:39.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.259+0000 7f68dad76640 1 --2- 10.20.193.5:0/506055610 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f68a80792d0 0x7f68a807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:39.261 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.259+0000 7f68dad76640 10 monclient: get_auth_request con 0x7f68a80792d0 auth_method 0 2026-02-17T21:30:39.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.260+0000 7f68dad76640 1 --2- 10.20.193.5:0/506055610 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f68a80792d0 0x7f68a807b790 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f68d0002770 tx=0x7f68d0007ef0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:39.262 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.260+0000 7f68bb7fe640 10 client.5153.objecter ms_handle_connect 0x7f68a80792d0 2026-02-17T21:30:39.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.262+0000 7f68bb7fe640 1 -- 10.20.193.5:0/506055610 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f68c402fab0 con 0x7f68dc0d1f40 2026-02-17T21:30:39.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.262+0000 7f68bb7fe640 10 client.5153.objecter ms_dispatch2 0x7f68dc000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:39.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.262+0000 7f68bb7fe640 3 client.5153.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:39.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.262+0000 7f68bb7fe640 3 client.5153.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:39.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.262+0000 7f68bb7fe640 20 client.5153.objecter dump_active .. 0 homeless 2026-02-17T21:30:39.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.363+0000 7f68bb7fe640 1 -- 10.20.193.5:0/506055610 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f68c4086b80 con 0x7f68dc0d1f40 2026-02-17T21:30:39.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.363+0000 7f68bb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:39.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.363+0000 7f68bb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:39.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.465+0000 7f68e11fe640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:30:39.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.465+0000 7f68e11fe640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:39.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.465+0000 7f68e11fe640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:39.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.465+0000 7f68e11fe640 1 -- 10.20.193.5:0/506055610 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f68dc0cb140 con 0x7f68dc0d1f40 2026-02-17T21:30:39.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.467+0000 7f68bb7fe640 1 -- 10.20.193.5:0/506055610 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f68c408ae80 con 0x7f68dc0d1f40 2026-02-17T21:30:39.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.467+0000 7f68bb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:39.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.467+0000 7f68bb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:30:39.469 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:30:39.469 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:30:39.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.468+0000 7f68e11fe640 10 librados: watch_flush enter 2026-02-17T21:30:39.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.468+0000 7f68e11fe640 10 librados: watch_flush exit 2026-02-17T21:30:39.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.468+0000 7f68e11fe640 20 client.5153.objecter shutdown clearing up homeless session... 2026-02-17T21:30:39.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.468+0000 7f68e11fe640 10 client.5153.objecter successfully canceled tick 2026-02-17T21:30:39.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.468+0000 7f68e11fe640 1 -- 10.20.193.5:0/506055610 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f68a80792d0 msgr2=0x7f68a807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:39.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.468+0000 7f68e11fe640 1 --2- 10.20.193.5:0/506055610 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f68a80792d0 0x7f68a807b790 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f68d0002770 tx=0x7f68d0007ef0 comp rx=0 tx=0).stop 2026-02-17T21:30:39.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.468+0000 7f68e11fe640 10 monclient: shutdown 2026-02-17T21:30:39.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.468+0000 7f68e11fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:39.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.468+0000 7f68e11fe640 1 -- 10.20.193.5:0/506055610 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f68dc0d1f40 msgr2=0x7f68dc1f5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:39.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.468+0000 7f68e11fe640 1 --2- 10.20.193.5:0/506055610 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f68dc0d1f40 0x7f68dc1f5090 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009130 tx=0x7f68c40047c0 comp rx=0 tx=0).stop 2026-02-17T21:30:39.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.468+0000 7f68e11fe640 1 -- 10.20.193.5:0/506055610 shutdown_connections 2026-02-17T21:30:39.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.468+0000 7f68e11fe640 1 --2- 10.20.193.5:0/506055610 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f68a80792d0 0x7f68a807b790 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:39.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.468+0000 7f68e11fe640 1 --2- 10.20.193.5:0/506055610 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f68dc15d950 0x7f68dc1f55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:39.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.468+0000 7f68e11fe640 1 --2- 10.20.193.5:0/506055610 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f68dc0d1f40 0x7f68dc1f5090 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:39.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.468+0000 7f68e11fe640 1 --2- 10.20.193.5:0/506055610 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f68dc0d1b60 0x7f68dc144ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:39.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.468+0000 7f68e11fe640 1 -- 10.20.193.5:0/506055610 >> 10.20.193.5:0/506055610 conn(0x7f68dc06d9b0 msgr2=0x7f68dc0d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:39.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.468+0000 7f68e11fe640 1 -- 10.20.193.5:0/506055610 shutdown_connections 2026-02-17T21:30:39.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.468+0000 7f68e11fe640 1 -- 10.20.193.5:0/506055610 wait complete. 2026-02-17T21:30:39.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:39.468+0000 7f68e11fe640 1 librados: shutdown 2026-02-17T21:30:42.480 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:30:42.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.546+0000 7fe8fe1a9640 10 monclient: get_monmap_and_config 2026-02-17T21:30:42.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.546+0000 7fe8fe1a9640 10 monclient: build_initial_monmap 2026-02-17T21:30:42.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.546+0000 7fe8fe1a9640 10 monclient: monmap: 2026-02-17T21:30:42.549 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:42.549 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:42.549 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:42.548275+0000 2026-02-17T21:30:42.549 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:42.548275+0000 2026-02-17T21:30:42.549 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:42.549 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:42.549 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:42.550 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:42.550 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:42.550 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:42.550 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:42.550 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:42.550 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:42.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.547+0000 7fe8fe1a9640 1 Processor -- start 2026-02-17T21:30:42.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.547+0000 7fe8fe1a9640 1 -- start start 2026-02-17T21:30:42.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.547+0000 7fe8fe1a9640 10 monclient: init 2026-02-17T21:30:42.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.547+0000 7fe8fe1a9640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:42.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.547+0000 7fe8fe1a9640 10 monclient: _add_conns ranks=[3,2,5,1,4,0] 2026-02-17T21:30:42.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.547+0000 7fe8fe1a9640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fe8f80c7170 0x7fe8f80c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:42.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.547+0000 7fe8fe1a9640 10 monclient(hunting): picked mon.noname-a con 0x7fe8f80c7170 addr v2:10.20.193.5:3300/0 2026-02-17T21:30:42.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.547+0000 7fe8fe1a9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe8f80c48c0 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:42.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.547+0000 7fe8fe1a9640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fe8f80c4d10 0x7fe8f80c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:42.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.547+0000 7fe8fe1a9640 10 monclient(hunting): picked mon.noname-c con 0x7fe8f80c4d10 addr v2:10.20.193.135:3300/0 2026-02-17T21:30:42.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.547+0000 7fe8fe1a9640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8f815a9a0 con 0x7fe8f80c48c0 2026-02-17T21:30:42.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.547+0000 7fe8fe1a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:42.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.547+0000 7fe8fe1a9640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe8f80c8530 con 0x7fe8f80c7170 2026-02-17T21:30:42.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.547+0000 7fe8fe1a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:42.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.547+0000 7fe8fe1a9640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe8f80c5270 con 0x7fe8f80c4d10 2026-02-17T21:30:42.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.547+0000 7fe8fe1a9640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:42.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.547+0000 7fe8fe1a9640 10 monclient(hunting): authenticate will time out at 1348.113636s 2026-02-17T21:30:42.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.547+0000 7fe8f77fe640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fe8f80c7170 0x7fe8f80c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:42.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.548+0000 7fe8f7fff640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fe8f80c4d10 0x7fe8f80c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:42.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.548+0000 7fe8f77fe640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fe8f80c7170 0x7fe8f80c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:60872/0 (socket says 10.20.193.5:60872) 2026-02-17T21:30:42.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.548+0000 7fe8f77fe640 1 -- 10.20.193.5:0/1032147084 learned_addr learned my addr 10.20.193.5:0/1032147084 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:42.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.548+0000 7fe8f77fe640 10 monclient(hunting): get_auth_request con 0x7fe8f80c7170 auth_method 0 2026-02-17T21:30:42.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.548+0000 7fe8f77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:42.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.548+0000 7fe8f77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:42.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.548+0000 7fe8f77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:42.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.548+0000 7fe8f77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:42.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.548+0000 7fe8f77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:42.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.548+0000 7fe8f77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:42.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.548+0000 7fe8f7fff640 10 monclient(hunting): get_auth_request con 0x7fe8f80c4d10 auth_method 0 2026-02-17T21:30:42.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.548+0000 7fe8f7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:42.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.548+0000 7fe8f7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:42.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.548+0000 7fe8f7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:42.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.549+0000 7fe8f7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:42.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.549+0000 7fe8f7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:42.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.549+0000 7fe8f7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:42.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.549+0000 7fe8f77fe640 10 monclient(hunting): handle_auth_done global_id 5088 payload 274 2026-02-17T21:30:42.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.549+0000 7fe8f77fe640 1 -- 10.20.193.5:0/1032147084 >> v2:10.20.193.135:3300/0 conn(0x7fe8f80c4d10 msgr2=0x7fe8f80c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:42.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.549+0000 7fe8f77fe640 1 --2- 10.20.193.5:0/1032147084 >> v2:10.20.193.135:3300/0 conn(0x7fe8f80c4d10 0x7fe8f80c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:42.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.549+0000 7fe8f77fe640 1 -- 10.20.193.5:0/1032147084 >> v1:10.20.193.135:6789/0 conn(0x7fe8f80c48c0 legacy=0x7fe8f80749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:42.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.549+0000 7fe8f77fe640 10 monclient: _finish_hunting 0 2026-02-17T21:30:42.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.549+0000 7fe8f77fe640 1 monclient: found mon.noname-a 2026-02-17T21:30:42.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.549+0000 7fe8f77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:42.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.549+0000 7fe8f77fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:42.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.549+0000 7fe8f77fe640 1 -- 10.20.193.5:0/1032147084 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f80c5550 con 0x7fe8f80c7170 2026-02-17T21:30:42.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.550+0000 7fe8f77fe640 1 --2- 10.20.193.5:0/1032147084 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe8f80c7170 0x7fe8f80c7550 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80c6e90 tx=0x7fe8e402eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699eca5fc97712b0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:42.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8f67fc640 1 -- 10.20.193.5:0/1032147084 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e403c070 con 0x7fe8f80c7170 2026-02-17T21:30:42.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:42.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8f67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:42.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8f67fc640 10 monclient: dump: 2026-02-17T21:30:42.564 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:42.564 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:42.564 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:42.564 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:42.564 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:42.564 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:42.564 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:42.564 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:42.564 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:42.565 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:42.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8f67fc640 10 monclient: _finish_auth 0 2026-02-17T21:30:42.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8f67fc640 10 monclient: _check_auth_tickets 2026-02-17T21:30:42.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8f67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:42.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8f67fc640 1 -- 10.20.193.5:0/1032147084 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e402fbe0 con 0x7fe8f80c7170 2026-02-17T21:30:42.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8f67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:42.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8f67fc640 1 -- 10.20.193.5:0/1032147084 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4037440 con 0x7fe8f80c7170 2026-02-17T21:30:42.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:42.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8f67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:42.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8f67fc640 10 monclient: dump: 2026-02-17T21:30:42.566 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:42.566 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:42.566 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:42.566 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:42.566 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:42.566 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:42.566 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:42.566 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:42.566 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:42.566 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:42.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8fe1a9640 5 monclient: authenticate success, global_id 5088 2026-02-17T21:30:42.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8fe1a9640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:42.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8fe1a9640 4 set_mon_vals no callback set 2026-02-17T21:30:42.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8fe1a9640 10 monclient: shutdown 2026-02-17T21:30:42.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8fe1a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:42.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8fe1a9640 1 -- 10.20.193.5:0/1032147084 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe8f80c7170 msgr2=0x7fe8f80c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:42.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8fe1a9640 1 --2- 10.20.193.5:0/1032147084 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe8f80c7170 0x7fe8f80c7550 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80c6e90 tx=0x7fe8e402eed0 comp rx=0 tx=0).stop 2026-02-17T21:30:42.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8fe1a9640 1 -- 10.20.193.5:0/1032147084 shutdown_connections 2026-02-17T21:30:42.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8fe1a9640 1 --2- 10.20.193.5:0/1032147084 >> v2:10.20.193.135:3300/0 conn(0x7fe8f80c4d10 0x7fe8f80c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:42.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8fe1a9640 1 --2- 10.20.193.5:0/1032147084 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe8f80c7170 0x7fe8f80c7550 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:42.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8fe1a9640 1 -- 10.20.193.5:0/1032147084 >> 10.20.193.5:0/1032147084 conn(0x7fe8f80c9f40 msgr2=0x7fe8f80ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:42.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8fe1a9640 1 -- 10.20.193.5:0/1032147084 shutdown_connections 2026-02-17T21:30:42.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8fe1a9640 1 -- 10.20.193.5:0/1032147084 wait complete. 2026-02-17T21:30:42.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8fe1a9640 10 monclient: build_initial_monmap 2026-02-17T21:30:42.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.552+0000 7fe8fe1a9640 10 monclient: monmap: 2026-02-17T21:30:42.568 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:42.568 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:42.568 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:42.568 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:42.568 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:42.568 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:42.568 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:42.568 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:42.568 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:42.568 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:42.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.553+0000 7fe8fe1a9640 1 librados: starting msgr at 2026-02-17T21:30:42.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.553+0000 7fe8fe1a9640 1 librados: starting objecter 2026-02-17T21:30:42.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.553+0000 7fe8fe1a9640 1 Processor -- start 2026-02-17T21:30:42.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.553+0000 7fe8fe1a9640 1 -- start start 2026-02-17T21:30:42.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.553+0000 7fe8fe1a9640 1 librados: setting wanted keys 2026-02-17T21:30:42.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.553+0000 7fe8fe1a9640 1 librados: calling monclient init 2026-02-17T21:30:42.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.553+0000 7fe8fe1a9640 10 monclient: init 2026-02-17T21:30:42.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.553+0000 7fe8fe1a9640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:42.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.553+0000 7fe8fe1a9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:30:42.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.553+0000 7fe8fe1a9640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe8f80c48c0 0x7fe8f81f77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:42.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.553+0000 7fe8fe1a9640 10 monclient(hunting): picked mon.noname-b con 0x7fe8f80c48c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:42.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.553+0000 7fe8fe1a9640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe8f80c4d10 0x7fe8f8159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:42.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.553+0000 7fe8fe1a9640 10 monclient(hunting): picked mon.noname-a con 0x7fe8f80c4d10 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:42.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.553+0000 7fe8fe1a9640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe8f80c7170 0x7fe8f8156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:42.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.553+0000 7fe8fe1a9640 10 monclient(hunting): picked mon.noname-c con 0x7fe8f80c7170 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:42.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.553+0000 7fe8fe1a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:42.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.553+0000 7fe8fe1a9640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f80c81c0 con 0x7fe8f80c4d10 2026-02-17T21:30:42.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.553+0000 7fe8fe1a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:42.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.553+0000 7fe8fe1a9640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f80c7ee0 con 0x7fe8f80c48c0 2026-02-17T21:30:42.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.553+0000 7fe8fe1a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:42.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.553+0000 7fe8fe1a9640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f80750c0 con 0x7fe8f80c7170 2026-02-17T21:30:42.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.553+0000 7fe8fe1a9640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:42.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.553+0000 7fe8fe1a9640 10 monclient(hunting): authenticate will time out at 1348.119574s 2026-02-17T21:30:42.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.553+0000 7fe8f6ffd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe8f80c4d10 0x7fe8f8159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:42.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.553+0000 7fe8f7fff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe8f80c7170 0x7fe8f8156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:42.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.554+0000 7fe8f6ffd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe8f80c4d10 0x7fe8f8159390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:60876/0 (socket says 10.20.193.5:60876) 2026-02-17T21:30:42.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.554+0000 7fe8f6ffd640 1 -- 10.20.193.5:0/1485345854 learned_addr learned my addr 10.20.193.5:0/1485345854 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:42.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.554+0000 7fe8f6ffd640 10 monclient(hunting): get_auth_request con 0x7fe8f80c4d10 auth_method 0 2026-02-17T21:30:42.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.554+0000 7fe8f6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:42.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.554+0000 7fe8f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:42.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.554+0000 7fe8f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:42.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.554+0000 7fe8f77fe640 1 --2- 10.20.193.5:0/1485345854 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe8f80c48c0 0x7fe8f81f77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:42.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.554+0000 7fe8f7fff640 10 monclient(hunting): get_auth_request con 0x7fe8f80c7170 auth_method 0 2026-02-17T21:30:42.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.554+0000 7fe8f7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:42.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.554+0000 7fe8f7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:42.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.554+0000 7fe8f7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:42.571 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.554+0000 7fe8f6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:42.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.554+0000 7fe8f6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:42.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.554+0000 7fe8f6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:42.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.554+0000 7fe8f77fe640 10 monclient(hunting): get_auth_request con 0x7fe8f80c48c0 auth_method 0 2026-02-17T21:30:42.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.554+0000 7fe8f77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:42.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.554+0000 7fe8f77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:42.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.554+0000 7fe8f77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:42.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.554+0000 7fe8f7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:42.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.554+0000 7fe8f7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:42.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.554+0000 7fe8f7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:42.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.554+0000 7fe8f77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:42.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.554+0000 7fe8f77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:42.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.554+0000 7fe8f77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:42.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.555+0000 7fe8f6ffd640 10 monclient(hunting): handle_auth_done global_id 5091 payload 824 2026-02-17T21:30:42.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.555+0000 7fe8f6ffd640 1 -- 10.20.193.5:0/1485345854 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe8f80c7170 msgr2=0x7fe8f8156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:42.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.555+0000 7fe8f6ffd640 1 --2- 10.20.193.5:0/1485345854 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe8f80c7170 0x7fe8f8156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:42.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.555+0000 7fe8f6ffd640 1 -- 10.20.193.5:0/1485345854 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe8f80c48c0 msgr2=0x7fe8f81f77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:42.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.555+0000 7fe8f6ffd640 1 --2- 10.20.193.5:0/1485345854 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe8f80c48c0 0x7fe8f81f77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:42.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.555+0000 7fe8f6ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:30:42.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.555+0000 7fe8f6ffd640 1 monclient: found mon.noname-a 2026-02-17T21:30:42.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.555+0000 7fe8f6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:42.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.555+0000 7fe8f6ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:42.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.555+0000 7fe8f6ffd640 1 -- 10.20.193.5:0/1485345854 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f81f4720 con 0x7fe8f80c4d10 2026-02-17T21:30:42.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.556+0000 7fe8f6ffd640 1 --2- 10.20.193.5:0/1485345854 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe8f80c4d10 0x7fe8f8159390 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800c480 tx=0x7fe8e800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:42.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.556+0000 7fe8d3fff640 10 client.?.objecter ms_handle_connect 0x7fe8f80c4d10 2026-02-17T21:30:42.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.556+0000 7fe8d3fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:42.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.558+0000 7fe8d3fff640 1 -- 10.20.193.5:0/1485345854 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8017070 con 0x7fe8f80c4d10 2026-02-17T21:30:42.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.558+0000 7fe8d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:42.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.558+0000 7fe8d3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:42.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.558+0000 7fe8d3fff640 10 monclient: dump: 2026-02-17T21:30:42.574 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:42.574 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:42.574 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:42.574 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:42.574 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:42.574 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:42.574 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:42.575 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:42.575 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:42.575 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:42.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.558+0000 7fe8d3fff640 10 monclient: _finish_auth 0 2026-02-17T21:30:42.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.558+0000 7fe8d3fff640 10 monclient: _check_auth_tickets 2026-02-17T21:30:42.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.558+0000 7fe8d3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:42.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.558+0000 7fe8d3fff640 1 -- 10.20.193.5:0/1485345854 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e80052f0 con 0x7fe8f80c4d10 2026-02-17T21:30:42.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.558+0000 7fe8d3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:42.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.558+0000 7fe8d3fff640 1 -- 10.20.193.5:0/1485345854 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e80036f0 con 0x7fe8f80c4d10 2026-02-17T21:30:42.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.558+0000 7fe8d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:42.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.558+0000 7fe8d3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:42.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.558+0000 7fe8d3fff640 10 monclient: dump: 2026-02-17T21:30:42.575 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:42.576 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:42.576 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:42.576 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:42.576 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:42.576 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:42.576 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:42.576 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:42.576 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:42.576 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:42.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.558+0000 7fe8f5ffb640 4 set_mon_vals no callback set 2026-02-17T21:30:42.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.558+0000 7fe8fe1a9640 5 monclient: authenticate success, global_id 5091 2026-02-17T21:30:42.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.558+0000 7fe8fe1a9640 10 monclient: _renew_subs 2026-02-17T21:30:42.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.558+0000 7fe8fe1a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:42.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.558+0000 7fe8fe1a9640 1 -- 10.20.193.5:0/1485345854 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8f8155e00 con 0x7fe8f80c4d10 2026-02-17T21:30:42.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.558+0000 7fe8fe1a9640 10 client.5091.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:42.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.558+0000 7fe8fe1a9640 10 monclient: _renew_subs 2026-02-17T21:30:42.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.558+0000 7fe8fe1a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:42.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.558+0000 7fe8fe1a9640 1 -- 10.20.193.5:0/1485345854 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8f81563c0 con 0x7fe8f80c4d10 2026-02-17T21:30:42.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.558+0000 7fe8fe1a9640 1 librados: init done 2026-02-17T21:30:42.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.559+0000 7fe8fe1a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:42.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.559+0000 7fe8fe1a9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:42.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.559+0000 7fe8fe1a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:42.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.559+0000 7fe8fe1a9640 1 -- 10.20.193.5:0/1485345854 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8f80c7550 con 0x7fe8f80c4d10 2026-02-17T21:30:42.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.570+0000 7fe8d3fff640 1 -- 10.20.193.5:0/1485345854 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fe8e8003890 con 0x7fe8f80c4d10 2026-02-17T21:30:42.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.570+0000 7fe8d3fff640 1 --2- 10.20.193.5:0/1485345854 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe8c80792d0 0x7fe8c807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:42.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.571+0000 7fe8f77fe640 1 --2- 10.20.193.5:0/1485345854 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe8c80792d0 0x7fe8c807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:42.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.571+0000 7fe8f77fe640 10 monclient: get_auth_request con 0x7fe8c80792d0 auth_method 0 2026-02-17T21:30:42.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.571+0000 7fe8f77fe640 1 --2- 10.20.193.5:0/1485345854 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe8c80792d0 0x7fe8c807b790 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80c7a90 tx=0x7fe8e4039040 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:42.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.571+0000 7fe8d3fff640 10 client.5091.objecter ms_handle_connect 0x7fe8c80792d0 2026-02-17T21:30:42.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.572+0000 7fe8d3fff640 1 -- 10.20.193.5:0/1485345854 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fe8e805d750 con 0x7fe8f80c4d10 2026-02-17T21:30:42.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.572+0000 7fe8d3fff640 10 client.5091.objecter ms_dispatch2 0x7fe8f8000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:42.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.572+0000 7fe8d3fff640 3 client.5091.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:42.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.572+0000 7fe8d3fff640 3 client.5091.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:42.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.572+0000 7fe8d3fff640 20 client.5091.objecter dump_active .. 0 homeless 2026-02-17T21:30:42.674 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.672+0000 7fe8d3fff640 1 -- 10.20.193.5:0/1485345854 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe8e8021020 con 0x7fe8f80c4d10 2026-02-17T21:30:42.674 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.672+0000 7fe8d3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:42.674 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.672+0000 7fe8d3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:42.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.772+0000 7fe8fe1a9640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:30:42.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.772+0000 7fe8fe1a9640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:42.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.772+0000 7fe8fe1a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:42.775 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.772+0000 7fe8fe1a9640 1 -- 10.20.193.5:0/1485345854 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe8f815ac60 con 0x7fe8f80c4d10 2026-02-17T21:30:42.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.775+0000 7fe8d3fff640 1 -- 10.20.193.5:0/1485345854 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fe8e8061710 con 0x7fe8f80c4d10 2026-02-17T21:30:42.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.775+0000 7fe8d3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:30:42.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.775+0000 7fe8d3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:30:42.777 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:30:42.778 INFO:teuthology.orchestra.run.trial005.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"11 OSD(s) experiencing slow operations in BlueStore","count":11},"muted":false}},"mutes":[]} 2026-02-17T21:30:42.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.776+0000 7fe8fe1a9640 10 librados: watch_flush enter 2026-02-17T21:30:42.779 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.776+0000 7fe8fe1a9640 10 librados: watch_flush exit 2026-02-17T21:30:42.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.776+0000 7fe8fe1a9640 20 client.5091.objecter shutdown clearing up homeless session... 2026-02-17T21:30:42.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.776+0000 7fe8fe1a9640 10 client.5091.objecter successfully canceled tick 2026-02-17T21:30:42.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.776+0000 7fe8fe1a9640 1 -- 10.20.193.5:0/1485345854 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe8c80792d0 msgr2=0x7fe8c807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:42.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.776+0000 7fe8fe1a9640 1 --2- 10.20.193.5:0/1485345854 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe8c80792d0 0x7fe8c807b790 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80c7a90 tx=0x7fe8e4039040 comp rx=0 tx=0).stop 2026-02-17T21:30:42.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.776+0000 7fe8fe1a9640 10 monclient: shutdown 2026-02-17T21:30:42.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.776+0000 7fe8fe1a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:42.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.776+0000 7fe8fe1a9640 1 -- 10.20.193.5:0/1485345854 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe8f80c4d10 msgr2=0x7fe8f8159390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:42.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.776+0000 7fe8fe1a9640 1 --2- 10.20.193.5:0/1485345854 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe8f80c4d10 0x7fe8f8159390 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800c480 tx=0x7fe8e800c950 comp rx=0 tx=0).stop 2026-02-17T21:30:42.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.776+0000 7fe8fe1a9640 1 -- 10.20.193.5:0/1485345854 shutdown_connections 2026-02-17T21:30:42.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.776+0000 7fe8fe1a9640 1 --2- 10.20.193.5:0/1485345854 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe8c80792d0 0x7fe8c807b790 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:42.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.776+0000 7fe8fe1a9640 1 --2- 10.20.193.5:0/1485345854 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe8f80c7170 0x7fe8f8156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:42.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.776+0000 7fe8fe1a9640 1 --2- 10.20.193.5:0/1485345854 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe8f80c4d10 0x7fe8f8159390 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:42.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.776+0000 7fe8fe1a9640 1 --2- 10.20.193.5:0/1485345854 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe8f80c48c0 0x7fe8f81f77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:42.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.776+0000 7fe8fe1a9640 1 -- 10.20.193.5:0/1485345854 >> 10.20.193.5:0/1485345854 conn(0x7fe8f80c9f40 msgr2=0x7fe8f80ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:42.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.776+0000 7fe8fe1a9640 1 -- 10.20.193.5:0/1485345854 shutdown_connections 2026-02-17T21:30:42.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.776+0000 7fe8fe1a9640 1 -- 10.20.193.5:0/1485345854 wait complete. 2026-02-17T21:30:42.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.776+0000 7fe8fe1a9640 1 librados: shutdown 2026-02-17T21:30:42.787 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T21:30:42.787 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T21:30:42.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.854+0000 7faef676a640 10 monclient: get_monmap_and_config 2026-02-17T21:30:42.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.854+0000 7faef676a640 10 monclient: build_initial_monmap 2026-02-17T21:30:42.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.854+0000 7faef676a640 10 monclient: monmap: 2026-02-17T21:30:42.857 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:42.857 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:42.857 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:42.856049+0000 2026-02-17T21:30:42.857 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:42.856049+0000 2026-02-17T21:30:42.857 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:42.857 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:42.857 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:42.857 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:42.857 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:42.857 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:42.857 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:42.857 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:42.858 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:42.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.854+0000 7faef676a640 1 Processor -- start 2026-02-17T21:30:42.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.854+0000 7faef676a640 1 -- start start 2026-02-17T21:30:42.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.854+0000 7faef676a640 10 monclient: init 2026-02-17T21:30:42.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.855+0000 7faef676a640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:42.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.855+0000 7faef676a640 10 monclient: _add_conns ranks=[4,0,1,5,3,2] 2026-02-17T21:30:42.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.855+0000 7faef676a640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7faef015d370 0x7faef015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:42.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.855+0000 7faef676a640 10 monclient(hunting): picked mon.noname-b con 0x7faef015d370 addr v2:10.20.193.119:3300/0 2026-02-17T21:30:42.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.855+0000 7faef676a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7faef00c7e20 addr v1:10.20.193.5:6789/0 2026-02-17T21:30:42.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.855+0000 7faef676a640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7faef00c74c0 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:42.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.855+0000 7faef676a640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faef00c8350 con 0x7faef00c7e20 2026-02-17T21:30:42.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.855+0000 7faef676a640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faef00c8630 con 0x7faef00c74c0 2026-02-17T21:30:42.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.855+0000 7faef676a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:42.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.855+0000 7faef676a640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7faef015b710 con 0x7faef015d370 2026-02-17T21:30:42.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.855+0000 7faef676a640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:42.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.855+0000 7faef676a640 10 monclient(hunting): authenticate will time out at 1348.421339s 2026-02-17T21:30:42.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.855+0000 7faeeffff640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7faef015d370 0x7faef015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:42.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.855+0000 7faeef7fe640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7faef00c7e20 0x7faef015b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:34512/0 (socket says 10.20.193.5:34512) 2026-02-17T21:30:42.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.855+0000 7faeef7fe640 1 -- 10.20.193.5:0/3491017192 learned_addr learned my addr 10.20.193.5:0/3491017192 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:42.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.855+0000 7faeeffff640 10 monclient(hunting): get_auth_request con 0x7faef015d370 auth_method 0 2026-02-17T21:30:42.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.855+0000 7faeeffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:42.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.855+0000 7faeeffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:42.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.855+0000 7faeeffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:42.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.856+0000 7faeeffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:42.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.856+0000 7faeeffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:42.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.856+0000 7faeeffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:42.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.857+0000 7faeeeffd640 1 -- 10.20.193.5:0/3491017192 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3277094281 0 0) 0x7faef00c8350 con 0x7faef00c7e20 2026-02-17T21:30:42.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.857+0000 7faeeeffd640 10 monclient(hunting): _negotiate 2026-02-17T21:30:42.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.857+0000 7faeeeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:42.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.857+0000 7faeeeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:42.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.857+0000 7faeeeffd640 10 monclient(hunting): my global_id is 5094 2026-02-17T21:30:42.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.857+0000 7faeeeffd640 1 -- 10.20.193.5:0/3491017192 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faed4003620 con 0x7faef00c7e20 2026-02-17T21:30:42.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.857+0000 7faeeffff640 10 monclient(hunting): handle_auth_done global_id 5161 payload 274 2026-02-17T21:30:42.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.857+0000 7faeeffff640 1 -- 10.20.193.5:0/3491017192 >> v1:10.20.193.119:6789/0 conn(0x7faef00c74c0 legacy=0x7faef00c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:42.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.857+0000 7faeeffff640 1 -- 10.20.193.5:0/3491017192 >> v1:10.20.193.5:6789/0 conn(0x7faef00c7e20 legacy=0x7faef015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:42.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.857+0000 7faeeffff640 10 monclient: _finish_hunting 0 2026-02-17T21:30:42.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.857+0000 7faeeffff640 1 monclient: found mon.noname-b 2026-02-17T21:30:42.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.857+0000 7faeeffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:42.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.857+0000 7faeeffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:30:42.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.857+0000 7faeeffff640 1 -- 10.20.193.5:0/3491017192 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef00c8910 con 0x7faef015d370 2026-02-17T21:30:42.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.859+0000 7faeeffff640 1 --2- 10.20.193.5:0/3491017192 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faef015d370 0x7faef015d750 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7faedc0098a0 tx=0x7faedc02ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9442afa2fb60b43 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:42.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faeeeffd640 1 -- 10.20.193.5:0/3491017192 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc03c070 con 0x7faef015d370 2026-02-17T21:30:42.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faeeeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:42.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faeeeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:30:42.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faeeeffd640 10 monclient: dump: 2026-02-17T21:30:42.869 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:42.869 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:42.869 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:42.869 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:42.869 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:42.869 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:42.869 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:42.869 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:42.870 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:42.870 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:42.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faeeeffd640 10 monclient: _finish_auth 0 2026-02-17T21:30:42.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faeeeffd640 10 monclient: _check_auth_tickets 2026-02-17T21:30:42.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faeeeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:42.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faeeeffd640 1 -- 10.20.193.5:0/3491017192 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faedc02fb70 con 0x7faef015d370 2026-02-17T21:30:42.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faef676a640 5 monclient: authenticate success, global_id 5161 2026-02-17T21:30:42.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faef676a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:42.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faeeeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:42.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faeeeffd640 1 -- 10.20.193.5:0/3491017192 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc037440 con 0x7faef015d370 2026-02-17T21:30:42.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faef676a640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:42.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faef676a640 4 set_mon_vals no callback set 2026-02-17T21:30:42.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faeeeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:42.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faeeeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:30:42.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faeeeffd640 10 monclient: dump: 2026-02-17T21:30:42.871 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:42.871 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:42.871 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:42.871 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:42.871 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:42.871 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:42.871 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:42.871 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:42.871 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:42.871 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:42.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faef676a640 10 monclient: shutdown 2026-02-17T21:30:42.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faef676a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:42.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faef676a640 1 -- 10.20.193.5:0/3491017192 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faef015d370 msgr2=0x7faef015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:42.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faef676a640 1 --2- 10.20.193.5:0/3491017192 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faef015d370 0x7faef015d750 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7faedc0098a0 tx=0x7faedc02ee60 comp rx=0 tx=0).stop 2026-02-17T21:30:42.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faef676a640 1 -- 10.20.193.5:0/3491017192 shutdown_connections 2026-02-17T21:30:42.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faef676a640 1 --2- 10.20.193.5:0/3491017192 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faef015d370 0x7faef015d750 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:42.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faef676a640 1 -- 10.20.193.5:0/3491017192 >> 10.20.193.5:0/3491017192 conn(0x7faef00c9f20 msgr2=0x7faef00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:42.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faef676a640 1 -- 10.20.193.5:0/3491017192 shutdown_connections 2026-02-17T21:30:42.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.861+0000 7faef676a640 1 -- 10.20.193.5:0/3491017192 wait complete. 2026-02-17T21:30:42.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.862+0000 7faef676a640 10 monclient: build_initial_monmap 2026-02-17T21:30:42.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.862+0000 7faef676a640 10 monclient: monmap: 2026-02-17T21:30:42.873 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:42.873 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:42.873 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:42.873 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:42.873 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:42.873 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:42.873 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:42.873 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:42.873 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:42.873 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:42.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.862+0000 7faef676a640 1 librados: starting msgr at 2026-02-17T21:30:42.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.862+0000 7faef676a640 1 librados: starting objecter 2026-02-17T21:30:42.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.862+0000 7faef676a640 1 Processor -- start 2026-02-17T21:30:42.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.862+0000 7faef676a640 1 -- start start 2026-02-17T21:30:42.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.862+0000 7faef676a640 1 librados: setting wanted keys 2026-02-17T21:30:42.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.862+0000 7faef676a640 1 librados: calling monclient init 2026-02-17T21:30:42.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.862+0000 7faef676a640 10 monclient: init 2026-02-17T21:30:42.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.862+0000 7faef676a640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:42.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.862+0000 7faef676a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:30:42.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.862+0000 7faef676a640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7faef00c74c0 0x7faef01f6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:42.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.862+0000 7faef676a640 10 monclient(hunting): picked mon.noname-c con 0x7faef00c74c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:42.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.862+0000 7faef676a640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faef00c7e20 0x7faef006ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:42.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.862+0000 7faef676a640 10 monclient(hunting): picked mon.noname-b con 0x7faef00c7e20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:42.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.862+0000 7faef676a640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7faef015d370 0x7faef006f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:42.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.862+0000 7faef676a640 10 monclient(hunting): picked mon.noname-a con 0x7faef015d370 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:42.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.862+0000 7faef676a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:42.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.862+0000 7faef676a640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7faef00c8ed0 con 0x7faef015d370 2026-02-17T21:30:42.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.862+0000 7faef676a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:42.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.862+0000 7faef676a640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7faef00c9240 con 0x7faef00c7e20 2026-02-17T21:30:42.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.862+0000 7faef676a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:42.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.862+0000 7faef676a640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7faef00c96d0 con 0x7faef00c74c0 2026-02-17T21:30:42.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.862+0000 7faef676a640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:42.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.862+0000 7faef676a640 10 monclient(hunting): authenticate will time out at 1348.428791s 2026-02-17T21:30:42.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faef4ce0640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7faef015d370 0x7faef006f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:42.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faeef7fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faef00c7e20 0x7faef006ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:42.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faeeffff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7faef00c74c0 0x7faef01f6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:42.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faeef7fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faef00c7e20 0x7faef006ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:34336/0 (socket says 10.20.193.5:34336) 2026-02-17T21:30:42.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faeef7fe640 1 -- 10.20.193.5:0/2276064272 learned_addr learned my addr 10.20.193.5:0/2276064272 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:42.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faeef7fe640 10 monclient(hunting): get_auth_request con 0x7faef00c7e20 auth_method 0 2026-02-17T21:30:42.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faeef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:42.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faeef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:42.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faeef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:42.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faef4ce0640 10 monclient(hunting): get_auth_request con 0x7faef015d370 auth_method 0 2026-02-17T21:30:42.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faef4ce0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:42.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faef4ce0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:42.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faef4ce0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:42.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faeeffff640 10 monclient(hunting): get_auth_request con 0x7faef00c74c0 auth_method 0 2026-02-17T21:30:42.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faeeffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:42.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faeeffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:42.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faeeffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:42.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faeef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:42.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faeef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:42.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faeef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:42.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faef4ce0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:42.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faef4ce0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:42.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faef4ce0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:42.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faeeffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:42.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faeeffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:42.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.863+0000 7faeeffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:42.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.864+0000 7faeef7fe640 10 monclient(hunting): handle_auth_done global_id 5167 payload 824 2026-02-17T21:30:42.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.864+0000 7faeef7fe640 1 -- 10.20.193.5:0/2276064272 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7faef00c74c0 msgr2=0x7faef01f6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:42.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.864+0000 7faeef7fe640 1 --2- 10.20.193.5:0/2276064272 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7faef00c74c0 0x7faef01f6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:42.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.864+0000 7faeef7fe640 1 -- 10.20.193.5:0/2276064272 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7faef015d370 msgr2=0x7faef006f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:42.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.864+0000 7faeef7fe640 1 --2- 10.20.193.5:0/2276064272 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7faef015d370 0x7faef006f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:42.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.864+0000 7faeef7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:30:42.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.864+0000 7faeef7fe640 1 monclient: found mon.noname-b 2026-02-17T21:30:42.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.864+0000 7faeef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:42.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.864+0000 7faeef7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:30:42.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.864+0000 7faeef7fe640 1 -- 10.20.193.5:0/2276064272 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef006d9b0 con 0x7faef00c7e20 2026-02-17T21:30:42.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.865+0000 7faeef7fe640 1 --2- 10.20.193.5:0/2276064272 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faef00c7e20 0x7faef006ed30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7faee000c730 tx=0x7faee000cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:42.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.865+0000 7faeecff9640 10 client.?.objecter ms_handle_connect 0x7faef00c7e20 2026-02-17T21:30:42.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.865+0000 7faeecff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:42.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.867+0000 7faeecff9640 1 -- 10.20.193.5:0/2276064272 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0017070 con 0x7faef00c7e20 2026-02-17T21:30:42.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.867+0000 7faeecff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:42.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.867+0000 7faeecff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:30:42.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.867+0000 7faeecff9640 10 monclient: dump: 2026-02-17T21:30:42.880 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:42.881 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:42.881 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:42.881 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:42.881 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:42.881 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:42.881 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:42.881 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:42.881 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:42.881 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:42.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.867+0000 7faeecff9640 10 monclient: _finish_auth 0 2026-02-17T21:30:42.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.867+0000 7faeecff9640 10 monclient: _check_auth_tickets 2026-02-17T21:30:42.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.867+0000 7faeecff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:42.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.867+0000 7faeecff9640 1 -- 10.20.193.5:0/2276064272 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee0005bf0 con 0x7faef00c7e20 2026-02-17T21:30:42.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.867+0000 7faeecff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:42.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.867+0000 7faeecff9640 1 -- 10.20.193.5:0/2276064272 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0007070 con 0x7faef00c7e20 2026-02-17T21:30:42.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.867+0000 7faef676a640 5 monclient: authenticate success, global_id 5167 2026-02-17T21:30:42.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.867+0000 7faef676a640 10 monclient: _renew_subs 2026-02-17T21:30:42.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.867+0000 7faef676a640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:42.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.867+0000 7faef676a640 1 -- 10.20.193.5:0/2276064272 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faef006dc90 con 0x7faef00c7e20 2026-02-17T21:30:42.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.867+0000 7faeee7fc640 4 set_mon_vals no callback set 2026-02-17T21:30:42.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.867+0000 7faeecff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:42.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.867+0000 7faeecff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:30:42.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.867+0000 7faeecff9640 10 monclient: dump: 2026-02-17T21:30:42.882 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:42.882 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:42.883 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:42.883 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:42.883 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:42.883 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:42.883 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:42.883 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:42.883 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:42.883 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:42.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.867+0000 7faef676a640 10 client.5167.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:42.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.867+0000 7faef676a640 10 monclient: _renew_subs 2026-02-17T21:30:42.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.867+0000 7faef676a640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:42.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.867+0000 7faef676a640 1 -- 10.20.193.5:0/2276064272 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faef006e250 con 0x7faef00c7e20 2026-02-17T21:30:42.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.867+0000 7faef676a640 1 librados: init done 2026-02-17T21:30:42.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.868+0000 7faef676a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:42.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.868+0000 7faef676a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:42.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.868+0000 7faef676a640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:42.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.868+0000 7faef676a640 1 -- 10.20.193.5:0/2276064272 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faef015d750 con 0x7faef00c7e20 2026-02-17T21:30:42.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.879+0000 7faeecff9640 1 -- 10.20.193.5:0/2276064272 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7faee0007210 con 0x7faef00c7e20 2026-02-17T21:30:42.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.880+0000 7faeecff9640 1 --2- 10.20.193.5:0/2276064272 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7faec0079280 0x7faec007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:42.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.880+0000 7faeeffff640 1 --2- 10.20.193.5:0/2276064272 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7faec0079280 0x7faec007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:42.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.880+0000 7faeeffff640 10 monclient: get_auth_request con 0x7faec0079280 auth_method 0 2026-02-17T21:30:42.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.881+0000 7faeecff9640 1 -- 10.20.193.5:0/2276064272 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7faee005d840 con 0x7faef00c7e20 2026-02-17T21:30:42.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.881+0000 7faeecff9640 10 client.5167.objecter ms_dispatch2 0x7faef0000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:42.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.881+0000 7faeecff9640 3 client.5167.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:42.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.881+0000 7faeecff9640 3 client.5167.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:42.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.881+0000 7faeeffff640 1 --2- 10.20.193.5:0/2276064272 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7faec0079280 0x7faec007b740 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faedc039000 tx=0x7faedc033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:42.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.881+0000 7faeecff9640 20 client.5167.objecter dump_active .. 0 homeless 2026-02-17T21:30:42.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.881+0000 7faeecff9640 10 client.5167.objecter ms_handle_connect 0x7faec0079280 2026-02-17T21:30:42.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.979+0000 7faeecff9640 1 -- 10.20.193.5:0/2276064272 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7faee0021020 con 0x7faef00c7e20 2026-02-17T21:30:42.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.979+0000 7faeecff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:42.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:42.979+0000 7faeecff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:43.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.061+0000 7faef676a640 1 -- 10.20.193.5:0/2276064272 --> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faef0152db0 con 0x7faec0079280 2026-02-17T21:30:43.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.063+0000 7faeecff9640 1 -- 10.20.193.5:0/2276064272 <== mgr.4131 v2:10.20.193.176:6800/2898618020 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+43916 (secure 0 0 0) 0x7faef0152db0 con 0x7faec0079280 2026-02-17T21:30:43.065 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:30:43.067 INFO:teuthology.orchestra.run.trial005.stderr:dumped all 2026-02-17T21:30:43.067 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.064+0000 7faef676a640 10 librados: watch_flush enter 2026-02-17T21:30:43.067 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.064+0000 7faef676a640 10 librados: watch_flush exit 2026-02-17T21:30:43.067 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.064+0000 7faef676a640 20 client.5167.objecter shutdown clearing up homeless session... 2026-02-17T21:30:43.067 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.064+0000 7faef676a640 10 client.5167.objecter successfully canceled tick 2026-02-17T21:30:43.067 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.064+0000 7faef676a640 1 -- 10.20.193.5:0/2276064272 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7faec0079280 msgr2=0x7faec007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:43.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.064+0000 7faef676a640 1 --2- 10.20.193.5:0/2276064272 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7faec0079280 0x7faec007b740 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faedc039000 tx=0x7faedc033000 comp rx=0 tx=0).stop 2026-02-17T21:30:43.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.064+0000 7faef676a640 10 monclient: shutdown 2026-02-17T21:30:43.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.064+0000 7faef676a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:43.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.064+0000 7faef676a640 1 -- 10.20.193.5:0/2276064272 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faef00c7e20 msgr2=0x7faef006ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:43.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.064+0000 7faef676a640 1 --2- 10.20.193.5:0/2276064272 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faef00c7e20 0x7faef006ed30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7faee000c730 tx=0x7faee000cc00 comp rx=0 tx=0).stop 2026-02-17T21:30:43.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.064+0000 7faef676a640 1 -- 10.20.193.5:0/2276064272 shutdown_connections 2026-02-17T21:30:43.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.064+0000 7faef676a640 1 --2- 10.20.193.5:0/2276064272 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7faec0079280 0x7faec007b740 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.064+0000 7faef676a640 1 --2- 10.20.193.5:0/2276064272 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7faef015d370 0x7faef006f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.064+0000 7faef676a640 1 --2- 10.20.193.5:0/2276064272 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faef00c7e20 0x7faef006ed30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.064+0000 7faef676a640 1 --2- 10.20.193.5:0/2276064272 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7faef00c74c0 0x7faef01f6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.064+0000 7faef676a640 1 -- 10.20.193.5:0/2276064272 >> 10.20.193.5:0/2276064272 conn(0x7faef00c9f20 msgr2=0x7faef00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:43.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.064+0000 7faef676a640 1 -- 10.20.193.5:0/2276064272 shutdown_connections 2026-02-17T21:30:43.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.064+0000 7faef676a640 1 -- 10.20.193.5:0/2276064272 wait complete. 2026-02-17T21:30:43.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.064+0000 7faef676a640 1 librados: shutdown 2026-02-17T21:30:43.075 INFO:teuthology.orchestra.run.trial005.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2026-02-17T21:30:41.562599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":10,"kb":1509949440,"kb_used":438168,"kb_used_data":6744,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511272,"statfs":{"total":1546188226560,"available":1545739542528,"internally_reserved":0,"allocated":6905856,"data_stored":3428134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25504,"internal_metadata":441424992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001947"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:45.672446+0000","last_change":"2026-02-17T21:25:34.688050+0000","last_active":"2026-02-17T21:27:45.672446+0000","last_peered":"2026-02-17T21:27:45.672446+0000","last_clean":"2026-02-17T21:27:45.672446+0000","last_became_active":"2026-02-17T21:25:32.292871+0000","last_became_peered":"2026-02-17T21:25:32.292871+0000","last_unstale":"2026-02-17T21:27:45.672446+0000","last_undegraded":"2026-02-17T21:27:45.672446+0000","last_fullsized":"2026-02-17T21:27:45.672446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T01:55:40.877834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038010112999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:43.552125+0000","last_change":"2026-02-17T21:25:34.963519+0000","last_active":"2026-02-17T21:27:43.552125+0000","last_peered":"2026-02-17T21:27:43.552125+0000","last_clean":"2026-02-17T21:27:43.552125+0000","last_became_active":"2026-02-17T21:25:31.984749+0000","last_became_peered":"2026-02-17T21:25:31.984749+0000","last_unstale":"2026-02-17T21:27:43.552125+0000","last_undegraded":"2026-02-17T21:27:43.552125+0000","last_fullsized":"2026-02-17T21:27:43.552125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:03:42.411486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037066832000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:40.482034+0000","last_change":"2026-02-17T21:25:35.008224+0000","last_active":"2026-02-17T21:27:40.482034+0000","last_peered":"2026-02-17T21:27:40.482034+0000","last_clean":"2026-02-17T21:27:40.482034+0000","last_became_active":"2026-02-17T21:25:32.229048+0000","last_became_peered":"2026-02-17T21:25:32.229048+0000","last_unstale":"2026-02-17T21:27:40.482034+0000","last_undegraded":"2026-02-17T21:27:40.482034+0000","last_fullsized":"2026-02-17T21:27:40.482034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T09:14:11.573578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.041957774000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:38.952464+0000","last_change":"2026-02-17T21:25:36.620455+0000","last_active":"2026-02-17T21:27:38.952464+0000","last_peered":"2026-02-17T21:27:38.952464+0000","last_clean":"2026-02-17T21:27:38.952464+0000","last_became_active":"2026-02-17T21:25:32.009122+0000","last_became_peered":"2026-02-17T21:25:32.009122+0000","last_unstale":"2026-02-17T21:27:38.952464+0000","last_undegraded":"2026-02-17T21:27:38.952464+0000","last_fullsized":"2026-02-17T21:27:38.952464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:02:56.485559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032898110000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"34'2","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:40.465729+0000","last_change":"2026-02-17T21:25:34.887379+0000","last_active":"2026-02-17T21:27:40.465729+0000","last_peered":"2026-02-17T21:27:40.465729+0000","last_clean":"2026-02-17T21:27:40.465729+0000","last_became_active":"2026-02-17T21:25:32.016451+0000","last_became_peered":"2026-02-17T21:25:32.016451+0000","last_unstale":"2026-02-17T21:27:40.465729+0000","last_undegraded":"2026-02-17T21:27:40.465729+0000","last_fullsized":"2026-02-17T21:27:40.465729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:05:51.937857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046646930000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:40.788190+0000","last_change":"2026-02-17T21:25:34.719483+0000","last_active":"2026-02-17T21:27:40.788190+0000","last_peered":"2026-02-17T21:27:40.788190+0000","last_clean":"2026-02-17T21:27:40.788190+0000","last_became_active":"2026-02-17T21:25:31.944529+0000","last_became_peered":"2026-02-17T21:25:31.944529+0000","last_unstale":"2026-02-17T21:27:40.788190+0000","last_undegraded":"2026-02-17T21:27:40.788190+0000","last_fullsized":"2026-02-17T21:27:40.788190+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T02:38:03.529141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030826864999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:35.463435+0000","last_change":"2026-02-17T21:25:34.893210+0000","last_active":"2026-02-17T21:27:35.463435+0000","last_peered":"2026-02-17T21:27:35.463435+0000","last_clean":"2026-02-17T21:27:35.463435+0000","last_became_active":"2026-02-17T21:25:31.969947+0000","last_became_peered":"2026-02-17T21:25:31.969947+0000","last_unstale":"2026-02-17T21:27:35.463435+0000","last_undegraded":"2026-02-17T21:27:35.463435+0000","last_fullsized":"2026-02-17T21:27:35.463435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:26:53.468392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063724551000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"32'1","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:40.694733+0000","last_change":"2026-02-17T21:25:34.347523+0000","last_active":"2026-02-17T21:27:40.694733+0000","last_peered":"2026-02-17T21:27:40.694733+0000","last_clean":"2026-02-17T21:27:40.694733+0000","last_became_active":"2026-02-17T21:25:31.956011+0000","last_became_peered":"2026-02-17T21:25:31.956011+0000","last_unstale":"2026-02-17T21:27:40.694733+0000","last_undegraded":"2026-02-17T21:27:40.694733+0000","last_fullsized":"2026-02-17T21:27:40.694733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:12:18.319913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036103899000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,15],"acting":[4,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"34'32","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:25.781875+0000","last_change":"2026-02-17T21:25:26.799130+0000","last_active":"2026-02-17T21:27:25.781875+0000","last_peered":"2026-02-17T21:27:25.781875+0000","last_clean":"2026-02-17T21:27:25.781875+0000","last_became_active":"2026-02-17T21:25:26.779982+0000","last_became_peered":"2026-02-17T21:25:26.779982+0000","last_unstale":"2026-02-17T21:27:25.781875+0000","last_undegraded":"2026-02-17T21:27:25.781875+0000","last_fullsized":"2026-02-17T21:27:25.781875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:19.732550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:19.732550+0000","last_clean_scrub_stamp":"2026-02-17T21:25:19.732550+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T02:49:12.060591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":28,"seq":120259084357,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":28,"seq":120259084356,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27589058},"hb_peers":[0,1,3,4,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":28,"seq":120259084356,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":782336,"data_stored":562366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[2,4,5,6,7,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":22,"seq":94489280578,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":24,"seq":103079215170,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,4,5,6,7,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":5,"up_from":22,"seq":94489280579,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,4,6,7,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27589068},"hb_peers":[3,4,5,6,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":23,"seq":98784247875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27589061},"hb_peers":[0,2,5,6,7,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":24,"seq":103079215169,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,5,6,7,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":26,"seq":111669149763,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,4,5,6,7,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":12,"up_from":24,"seq":103079215171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,5,6,7,9,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":26,"seq":111669149766,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":164545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[3,5,6,7,8,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117062,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":164545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[2,4,5,6,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":27,"seq":115964117062,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,4,5,7,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":28,"seq":120259084357,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":782336,"data_stored":562366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,4,5,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084357,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T21:30:43.077 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T21:30:43.144 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.142+0000 7fd072b71640 10 monclient: get_monmap_and_config 2026-02-17T21:30:43.144 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.142+0000 7fd072b71640 10 monclient: build_initial_monmap 2026-02-17T21:30:43.145 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.142+0000 7fd072b71640 10 monclient: monmap: 2026-02-17T21:30:43.145 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:43.145 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:43.145 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:43.144050+0000 2026-02-17T21:30:43.145 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:43.144050+0000 2026-02-17T21:30:43.145 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:43.145 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:43.145 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:43.145 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:43.145 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:43.145 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:43.146 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:43.146 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:43.146 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:43.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.142+0000 7fd072b71640 1 Processor -- start 2026-02-17T21:30:43.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.142+0000 7fd072b71640 1 -- start start 2026-02-17T21:30:43.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.142+0000 7fd072b71640 10 monclient: init 2026-02-17T21:30:43.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.143+0000 7fd072b71640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:43.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.143+0000 7fd072b71640 10 monclient: _add_conns ranks=[4,1,3,5,2,0] 2026-02-17T21:30:43.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.143+0000 7fd072b71640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fd06c0c7170 0x7fd06c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:43.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.143+0000 7fd072b71640 10 monclient(hunting): picked mon.noname-b con 0x7fd06c0c7170 addr v2:10.20.193.119:3300/0 2026-02-17T21:30:43.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.143+0000 7fd072b71640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fd06c0c48c0 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:43.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.143+0000 7fd072b71640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fd06c0c4d10 0x7fd06c0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:43.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.143+0000 7fd072b71640 10 monclient(hunting): picked mon.noname-a con 0x7fd06c0c4d10 addr v2:10.20.193.5:3300/0 2026-02-17T21:30:43.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.143+0000 7fd072b71640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd06c15a9a0 con 0x7fd06c0c48c0 2026-02-17T21:30:43.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.143+0000 7fd072b71640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:43.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.143+0000 7fd072b71640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd06c0c8530 con 0x7fd06c0c4d10 2026-02-17T21:30:43.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.143+0000 7fd072b71640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:43.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.143+0000 7fd072b71640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fd06c0c5270 con 0x7fd06c0c7170 2026-02-17T21:30:43.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.143+0000 7fd072b71640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:43.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.143+0000 7fd072b71640 10 monclient(hunting): authenticate will time out at 1348.709491s 2026-02-17T21:30:43.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.143+0000 7fd0708e6640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fd06c0c7170 0x7fd06c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:43.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.144+0000 7fd0710e7640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fd06c0c4d10 0x7fd06c0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:43.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.144+0000 7fd0708e6640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fd06c0c7170 0x7fd06c0c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:34342/0 (socket says 10.20.193.5:34342) 2026-02-17T21:30:43.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.144+0000 7fd0708e6640 1 -- 10.20.193.5:0/3311944973 learned_addr learned my addr 10.20.193.5:0/3311944973 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:43.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.144+0000 7fd0708e6640 10 monclient(hunting): get_auth_request con 0x7fd06c0c7170 auth_method 0 2026-02-17T21:30:43.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.144+0000 7fd0708e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:43.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.144+0000 7fd0708e6640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:43.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.144+0000 7fd0708e6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:43.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.144+0000 7fd0710e7640 10 monclient(hunting): get_auth_request con 0x7fd06c0c4d10 auth_method 0 2026-02-17T21:30:43.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.144+0000 7fd0710e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:43.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.144+0000 7fd0710e7640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:43.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.144+0000 7fd0710e7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:43.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.144+0000 7fd0710e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:43.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.144+0000 7fd0710e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:43.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.144+0000 7fd0710e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:43.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.144+0000 7fd0708e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:43.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.144+0000 7fd0708e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:43.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.144+0000 7fd0708e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:43.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.145+0000 7fd0710e7640 10 monclient(hunting): handle_auth_done global_id 5100 payload 274 2026-02-17T21:30:43.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.145+0000 7fd0710e7640 1 -- 10.20.193.5:0/3311944973 >> v2:10.20.193.119:3300/0 conn(0x7fd06c0c7170 msgr2=0x7fd06c0c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:43.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.145+0000 7fd0710e7640 1 --2- 10.20.193.5:0/3311944973 >> v2:10.20.193.119:3300/0 conn(0x7fd06c0c7170 0x7fd06c0c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.145+0000 7fd0710e7640 1 -- 10.20.193.5:0/3311944973 >> v1:10.20.193.119:6789/0 conn(0x7fd06c0c48c0 legacy=0x7fd06c0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:43.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.145+0000 7fd0710e7640 10 monclient: _finish_hunting 0 2026-02-17T21:30:43.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.145+0000 7fd0710e7640 1 monclient: found mon.noname-a 2026-02-17T21:30:43.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.145+0000 7fd0710e7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:43.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.145+0000 7fd0710e7640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:43.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.145+0000 7fd0710e7640 1 -- 10.20.193.5:0/3311944973 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06c0c5550 con 0x7fd06c0c4d10 2026-02-17T21:30:43.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.146+0000 7fd0710e7640 1 --2- 10.20.193.5:0/3311944973 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd06c0c4d10 0x7fd06c0c89c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd06c0723c0 tx=0x7fd06802f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe48934aa493e78 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:43.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.148+0000 7fd0637fe640 1 -- 10.20.193.5:0/3311944973 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06803c070 con 0x7fd06c0c4d10 2026-02-17T21:30:43.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.148+0000 7fd0637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:43.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.148+0000 7fd0637fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:43.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.148+0000 7fd0637fe640 10 monclient: dump: 2026-02-17T21:30:43.159 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:43.159 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:43.159 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.159 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.159 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:43.160 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:43.160 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:43.160 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:43.160 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:43.160 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:43.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.148+0000 7fd0637fe640 10 monclient: _finish_auth 0 2026-02-17T21:30:43.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.148+0000 7fd0637fe640 10 monclient: _check_auth_tickets 2026-02-17T21:30:43.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.148+0000 7fd0637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:43.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.148+0000 7fd0637fe640 1 -- 10.20.193.5:0/3311944973 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd068037440 con 0x7fd06c0c4d10 2026-02-17T21:30:43.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.148+0000 7fd072b71640 5 monclient: authenticate success, global_id 5100 2026-02-17T21:30:43.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.148+0000 7fd0637fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:43.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.148+0000 7fd0637fe640 1 -- 10.20.193.5:0/3311944973 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd068037810 con 0x7fd06c0c4d10 2026-02-17T21:30:43.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.148+0000 7fd072b71640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:43.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.148+0000 7fd0637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:43.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.148+0000 7fd072b71640 4 set_mon_vals no callback set 2026-02-17T21:30:43.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.148+0000 7fd0637fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:43.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.148+0000 7fd0637fe640 10 monclient: dump: 2026-02-17T21:30:43.161 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:43.161 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:43.161 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.161 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.161 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:43.161 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:43.161 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:43.161 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:43.162 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:43.162 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:43.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.148+0000 7fd072b71640 10 monclient: shutdown 2026-02-17T21:30:43.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.148+0000 7fd072b71640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:43.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.148+0000 7fd072b71640 1 -- 10.20.193.5:0/3311944973 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd06c0c4d10 msgr2=0x7fd06c0c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:43.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.148+0000 7fd072b71640 1 --2- 10.20.193.5:0/3311944973 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd06c0c4d10 0x7fd06c0c89c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd06c0723c0 tx=0x7fd06802f1c0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.149+0000 7fd072b71640 1 -- 10.20.193.5:0/3311944973 shutdown_connections 2026-02-17T21:30:43.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.149+0000 7fd072b71640 1 --2- 10.20.193.5:0/3311944973 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd06c0c4d10 0x7fd06c0c89c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.149+0000 7fd072b71640 1 --2- 10.20.193.5:0/3311944973 >> v2:10.20.193.119:3300/0 conn(0x7fd06c0c7170 0x7fd06c0c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.149+0000 7fd072b71640 1 -- 10.20.193.5:0/3311944973 >> 10.20.193.5:0/3311944973 conn(0x7fd06c0c9f40 msgr2=0x7fd06c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:43.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.149+0000 7fd072b71640 1 -- 10.20.193.5:0/3311944973 shutdown_connections 2026-02-17T21:30:43.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.149+0000 7fd072b71640 1 -- 10.20.193.5:0/3311944973 wait complete. 2026-02-17T21:30:43.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.149+0000 7fd072b71640 10 monclient: build_initial_monmap 2026-02-17T21:30:43.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.149+0000 7fd072b71640 10 monclient: monmap: 2026-02-17T21:30:43.163 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:43.163 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:43.163 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:43.163 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:43.163 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:43.163 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:43.163 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:43.163 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:43.163 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:43.163 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:43.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.149+0000 7fd072b71640 1 librados: starting msgr at 2026-02-17T21:30:43.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.149+0000 7fd072b71640 1 librados: starting objecter 2026-02-17T21:30:43.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.149+0000 7fd072b71640 1 Processor -- start 2026-02-17T21:30:43.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.149+0000 7fd072b71640 1 -- start start 2026-02-17T21:30:43.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.149+0000 7fd072b71640 1 librados: setting wanted keys 2026-02-17T21:30:43.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.149+0000 7fd072b71640 1 librados: calling monclient init 2026-02-17T21:30:43.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.149+0000 7fd072b71640 10 monclient: init 2026-02-17T21:30:43.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd072b71640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:43.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd072b71640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:30:43.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd072b71640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd06c0c48c0 0x7fd06c1f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:43.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd072b71640 10 monclient(hunting): picked mon.noname-c con 0x7fd06c0c48c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:43.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd072b71640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd06c0c4d10 0x7fd06c15d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:43.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd072b71640 10 monclient(hunting): picked mon.noname-b con 0x7fd06c0c4d10 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:43.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd072b71640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd06c0c7170 0x7fd06c1498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:43.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd072b71640 10 monclient(hunting): picked mon.noname-a con 0x7fd06c0c7170 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:43.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd072b71640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:43.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd072b71640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd06c0c81c0 con 0x7fd06c0c7170 2026-02-17T21:30:43.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd072b71640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:43.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd072b71640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd06c0c7ee0 con 0x7fd06c0c4d10 2026-02-17T21:30:43.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd072b71640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:43.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd072b71640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd06c0750c0 con 0x7fd06c0c48c0 2026-02-17T21:30:43.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd072b71640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:43.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd072b71640 10 monclient(hunting): authenticate will time out at 1348.716293s 2026-02-17T21:30:43.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd0710e7640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd06c0c7170 0x7fd06c1498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:43.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd063fff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd06c0c4d10 0x7fd06c15d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:43.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd0708e6640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd06c0c48c0 0x7fd06c1f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:43.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd0710e7640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd06c0c7170 0x7fd06c1498d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:60904/0 (socket says 10.20.193.5:60904) 2026-02-17T21:30:43.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd0710e7640 1 -- 10.20.193.5:0/175676604 learned_addr learned my addr 10.20.193.5:0/175676604 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:43.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd0710e7640 10 monclient(hunting): get_auth_request con 0x7fd06c0c7170 auth_method 0 2026-02-17T21:30:43.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd0710e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:43.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd0710e7640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:43.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd0710e7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:43.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd063fff640 10 monclient(hunting): get_auth_request con 0x7fd06c0c4d10 auth_method 0 2026-02-17T21:30:43.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd063fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:43.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd063fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:43.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd063fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:43.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd0708e6640 10 monclient(hunting): get_auth_request con 0x7fd06c0c48c0 auth_method 0 2026-02-17T21:30:43.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd0708e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:43.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd0708e6640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:43.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd0708e6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:43.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd0710e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:43.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.150+0000 7fd0710e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:43.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.151+0000 7fd0710e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:43.167 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.151+0000 7fd063fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:43.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.151+0000 7fd063fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:43.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.151+0000 7fd063fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:43.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.151+0000 7fd0708e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:43.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.151+0000 7fd0708e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:43.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.151+0000 7fd0708e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:43.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.152+0000 7fd0710e7640 10 monclient(hunting): handle_auth_done global_id 5103 payload 824 2026-02-17T21:30:43.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.152+0000 7fd0710e7640 1 -- 10.20.193.5:0/175676604 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd06c0c48c0 msgr2=0x7fd06c1f21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:43.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.152+0000 7fd0710e7640 1 --2- 10.20.193.5:0/175676604 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd06c0c48c0 0x7fd06c1f21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.152+0000 7fd0710e7640 1 -- 10.20.193.5:0/175676604 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd06c0c4d10 msgr2=0x7fd06c15d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:43.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.152+0000 7fd0710e7640 1 --2- 10.20.193.5:0/175676604 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd06c0c4d10 0x7fd06c15d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.152+0000 7fd0710e7640 10 monclient: _finish_hunting 0 2026-02-17T21:30:43.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.152+0000 7fd0710e7640 1 monclient: found mon.noname-a 2026-02-17T21:30:43.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.152+0000 7fd0710e7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:43.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.152+0000 7fd0710e7640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:43.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.152+0000 7fd0710e7640 1 -- 10.20.193.5:0/175676604 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06c1f26f0 con 0x7fd06c0c7170 2026-02-17T21:30:43.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.153+0000 7fd0710e7640 1 --2- 10.20.193.5:0/175676604 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd06c0c7170 0x7fd06c1498d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd06802f6f0 tx=0x7fd068004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:43.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.153+0000 7fd0617fa640 10 client.?.objecter ms_handle_connect 0x7fd06c0c7170 2026-02-17T21:30:43.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.153+0000 7fd0617fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:43.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd0617fa640 1 -- 10.20.193.5:0/175676604 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06803c050 con 0x7fd06c0c7170 2026-02-17T21:30:43.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd0617fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:43.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd0617fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:43.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd0617fa640 10 monclient: dump: 2026-02-17T21:30:43.169 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:43.169 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:43.170 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.170 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.170 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:43.170 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:43.170 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:43.170 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:43.170 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:43.170 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:43.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd0617fa640 10 monclient: _finish_auth 0 2026-02-17T21:30:43.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd0617fa640 10 monclient: _check_auth_tickets 2026-02-17T21:30:43.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd0617fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:43.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd0617fa640 1 -- 10.20.193.5:0/175676604 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd068048070 con 0x7fd06c0c7170 2026-02-17T21:30:43.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd072b71640 5 monclient: authenticate success, global_id 5103 2026-02-17T21:30:43.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd072b71640 10 monclient: _renew_subs 2026-02-17T21:30:43.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd072b71640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:43.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd072b71640 1 -- 10.20.193.5:0/175676604 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd06c154560 con 0x7fd06c0c7170 2026-02-17T21:30:43.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd0617fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:43.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd0617fa640 1 -- 10.20.193.5:0/175676604 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd068035a90 con 0x7fd06c0c7170 2026-02-17T21:30:43.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd0617fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:43.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd0617fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:43.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd062ffd640 4 set_mon_vals no callback set 2026-02-17T21:30:43.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd0617fa640 10 monclient: dump: 2026-02-17T21:30:43.171 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:43.171 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:43.171 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.172 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.172 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:43.172 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:43.172 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:43.172 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:43.172 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:43.172 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:43.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd072b71640 10 client.5103.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:43.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd072b71640 10 monclient: _renew_subs 2026-02-17T21:30:43.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd072b71640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:43.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd072b71640 1 -- 10.20.193.5:0/175676604 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd06c154b20 con 0x7fd06c0c7170 2026-02-17T21:30:43.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd072b71640 1 librados: init done 2026-02-17T21:30:43.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd072b71640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:43.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd072b71640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:43.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd072b71640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:43.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.155+0000 7fd072b71640 1 -- 10.20.193.5:0/175676604 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd06c0c7550 con 0x7fd06c0c7170 2026-02-17T21:30:43.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.166+0000 7fd0617fa640 1 -- 10.20.193.5:0/175676604 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fd068035c30 con 0x7fd06c0c7170 2026-02-17T21:30:43.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.166+0000 7fd0617fa640 1 --2- 10.20.193.5:0/175676604 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd03c079300 0x7fd03c07b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:43.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.167+0000 7fd0708e6640 1 --2- 10.20.193.5:0/175676604 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd03c079300 0x7fd03c07b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:43.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.167+0000 7fd0708e6640 10 monclient: get_auth_request con 0x7fd03c079300 auth_method 0 2026-02-17T21:30:43.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.167+0000 7fd0617fa640 1 -- 10.20.193.5:0/175676604 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fd068084800 con 0x7fd06c0c7170 2026-02-17T21:30:43.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.167+0000 7fd0617fa640 10 client.5103.objecter ms_dispatch2 0x7fd06c000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:43.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.167+0000 7fd0617fa640 3 client.5103.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:43.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.167+0000 7fd0617fa640 3 client.5103.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:43.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.167+0000 7fd0617fa640 20 client.5103.objecter dump_active .. 0 homeless 2026-02-17T21:30:43.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.167+0000 7fd0708e6640 1 --2- 10.20.193.5:0/175676604 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd03c079300 0x7fd03c07b7c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd05c006dc0 tx=0x7fd05c009340 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:43.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.167+0000 7fd0617fa640 10 client.5103.objecter ms_handle_connect 0x7fd03c079300 2026-02-17T21:30:43.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.266+0000 7fd0617fa640 1 -- 10.20.193.5:0/175676604 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd0680887c0 con 0x7fd06c0c7170 2026-02-17T21:30:43.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.266+0000 7fd0617fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:43.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.266+0000 7fd0617fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:43.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.346+0000 7fd072b71640 1 -- 10.20.193.5:0/175676604 --> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd06c0ccf30 con 0x7fd03c079300 2026-02-17T21:30:43.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.348+0000 7fd0617fa640 1 -- 10.20.193.5:0/175676604 <== mgr.4131 v2:10.20.193.176:6800/2898618020 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+43916 (secure 0 0 0) 0x7fd06c0ccf30 con 0x7fd03c079300 2026-02-17T21:30:43.351 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:30:43.352 INFO:teuthology.orchestra.run.trial005.stderr:dumped all 2026-02-17T21:30:43.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.348+0000 7fd072b71640 10 librados: watch_flush enter 2026-02-17T21:30:43.352 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.348+0000 7fd072b71640 10 librados: watch_flush exit 2026-02-17T21:30:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.348+0000 7fd072b71640 20 client.5103.objecter shutdown clearing up homeless session... 2026-02-17T21:30:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.348+0000 7fd072b71640 10 client.5103.objecter successfully canceled tick 2026-02-17T21:30:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.348+0000 7fd072b71640 1 -- 10.20.193.5:0/175676604 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd03c079300 msgr2=0x7fd03c07b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.348+0000 7fd072b71640 1 --2- 10.20.193.5:0/175676604 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd03c079300 0x7fd03c07b7c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd05c006dc0 tx=0x7fd05c009340 comp rx=0 tx=0).stop 2026-02-17T21:30:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.348+0000 7fd072b71640 10 monclient: shutdown 2026-02-17T21:30:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.348+0000 7fd072b71640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.348+0000 7fd072b71640 1 -- 10.20.193.5:0/175676604 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd06c0c7170 msgr2=0x7fd06c1498d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.348+0000 7fd072b71640 1 --2- 10.20.193.5:0/175676604 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd06c0c7170 0x7fd06c1498d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd06802f6f0 tx=0x7fd068004b40 comp rx=0 tx=0).stop 2026-02-17T21:30:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.348+0000 7fd072b71640 1 -- 10.20.193.5:0/175676604 shutdown_connections 2026-02-17T21:30:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.348+0000 7fd072b71640 1 --2- 10.20.193.5:0/175676604 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd03c079300 0x7fd03c07b7c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.348+0000 7fd072b71640 1 --2- 10.20.193.5:0/175676604 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd06c0c7170 0x7fd06c1498d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.348+0000 7fd072b71640 1 --2- 10.20.193.5:0/175676604 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd06c0c4d10 0x7fd06c15d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.348+0000 7fd072b71640 1 --2- 10.20.193.5:0/175676604 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd06c0c48c0 0x7fd06c1f21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.348+0000 7fd072b71640 1 -- 10.20.193.5:0/175676604 >> 10.20.193.5:0/175676604 conn(0x7fd06c0c9f40 msgr2=0x7fd06c0cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.348+0000 7fd072b71640 1 -- 10.20.193.5:0/175676604 shutdown_connections 2026-02-17T21:30:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.349+0000 7fd072b71640 1 -- 10.20.193.5:0/175676604 wait complete. 2026-02-17T21:30:43.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.349+0000 7fd072b71640 1 librados: shutdown 2026-02-17T21:30:43.359 INFO:teuthology.orchestra.run.trial005.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2026-02-17T21:30:41.562599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":10,"kb":1509949440,"kb_used":438168,"kb_used_data":6744,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511272,"statfs":{"total":1546188226560,"available":1545739542528,"internally_reserved":0,"allocated":6905856,"data_stored":3428134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25504,"internal_metadata":441424992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001947"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:45.672446+0000","last_change":"2026-02-17T21:25:34.688050+0000","last_active":"2026-02-17T21:27:45.672446+0000","last_peered":"2026-02-17T21:27:45.672446+0000","last_clean":"2026-02-17T21:27:45.672446+0000","last_became_active":"2026-02-17T21:25:32.292871+0000","last_became_peered":"2026-02-17T21:25:32.292871+0000","last_unstale":"2026-02-17T21:27:45.672446+0000","last_undegraded":"2026-02-17T21:27:45.672446+0000","last_fullsized":"2026-02-17T21:27:45.672446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T01:55:40.877834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038010112999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:43.552125+0000","last_change":"2026-02-17T21:25:34.963519+0000","last_active":"2026-02-17T21:27:43.552125+0000","last_peered":"2026-02-17T21:27:43.552125+0000","last_clean":"2026-02-17T21:27:43.552125+0000","last_became_active":"2026-02-17T21:25:31.984749+0000","last_became_peered":"2026-02-17T21:25:31.984749+0000","last_unstale":"2026-02-17T21:27:43.552125+0000","last_undegraded":"2026-02-17T21:27:43.552125+0000","last_fullsized":"2026-02-17T21:27:43.552125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:03:42.411486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037066832000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:40.482034+0000","last_change":"2026-02-17T21:25:35.008224+0000","last_active":"2026-02-17T21:27:40.482034+0000","last_peered":"2026-02-17T21:27:40.482034+0000","last_clean":"2026-02-17T21:27:40.482034+0000","last_became_active":"2026-02-17T21:25:32.229048+0000","last_became_peered":"2026-02-17T21:25:32.229048+0000","last_unstale":"2026-02-17T21:27:40.482034+0000","last_undegraded":"2026-02-17T21:27:40.482034+0000","last_fullsized":"2026-02-17T21:27:40.482034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T09:14:11.573578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.041957774000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:38.952464+0000","last_change":"2026-02-17T21:25:36.620455+0000","last_active":"2026-02-17T21:27:38.952464+0000","last_peered":"2026-02-17T21:27:38.952464+0000","last_clean":"2026-02-17T21:27:38.952464+0000","last_became_active":"2026-02-17T21:25:32.009122+0000","last_became_peered":"2026-02-17T21:25:32.009122+0000","last_unstale":"2026-02-17T21:27:38.952464+0000","last_undegraded":"2026-02-17T21:27:38.952464+0000","last_fullsized":"2026-02-17T21:27:38.952464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:02:56.485559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032898110000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"34'2","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:40.465729+0000","last_change":"2026-02-17T21:25:34.887379+0000","last_active":"2026-02-17T21:27:40.465729+0000","last_peered":"2026-02-17T21:27:40.465729+0000","last_clean":"2026-02-17T21:27:40.465729+0000","last_became_active":"2026-02-17T21:25:32.016451+0000","last_became_peered":"2026-02-17T21:25:32.016451+0000","last_unstale":"2026-02-17T21:27:40.465729+0000","last_undegraded":"2026-02-17T21:27:40.465729+0000","last_fullsized":"2026-02-17T21:27:40.465729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:05:51.937857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046646930000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:40.788190+0000","last_change":"2026-02-17T21:25:34.719483+0000","last_active":"2026-02-17T21:27:40.788190+0000","last_peered":"2026-02-17T21:27:40.788190+0000","last_clean":"2026-02-17T21:27:40.788190+0000","last_became_active":"2026-02-17T21:25:31.944529+0000","last_became_peered":"2026-02-17T21:25:31.944529+0000","last_unstale":"2026-02-17T21:27:40.788190+0000","last_undegraded":"2026-02-17T21:27:40.788190+0000","last_fullsized":"2026-02-17T21:27:40.788190+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T02:38:03.529141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030826864999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:35.463435+0000","last_change":"2026-02-17T21:25:34.893210+0000","last_active":"2026-02-17T21:27:35.463435+0000","last_peered":"2026-02-17T21:27:35.463435+0000","last_clean":"2026-02-17T21:27:35.463435+0000","last_became_active":"2026-02-17T21:25:31.969947+0000","last_became_peered":"2026-02-17T21:25:31.969947+0000","last_unstale":"2026-02-17T21:27:35.463435+0000","last_undegraded":"2026-02-17T21:27:35.463435+0000","last_fullsized":"2026-02-17T21:27:35.463435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:26:53.468392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063724551000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"32'1","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:40.694733+0000","last_change":"2026-02-17T21:25:34.347523+0000","last_active":"2026-02-17T21:27:40.694733+0000","last_peered":"2026-02-17T21:27:40.694733+0000","last_clean":"2026-02-17T21:27:40.694733+0000","last_became_active":"2026-02-17T21:25:31.956011+0000","last_became_peered":"2026-02-17T21:25:31.956011+0000","last_unstale":"2026-02-17T21:27:40.694733+0000","last_undegraded":"2026-02-17T21:27:40.694733+0000","last_fullsized":"2026-02-17T21:27:40.694733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:12:18.319913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036103899000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,15],"acting":[4,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"34'32","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:25.781875+0000","last_change":"2026-02-17T21:25:26.799130+0000","last_active":"2026-02-17T21:27:25.781875+0000","last_peered":"2026-02-17T21:27:25.781875+0000","last_clean":"2026-02-17T21:27:25.781875+0000","last_became_active":"2026-02-17T21:25:26.779982+0000","last_became_peered":"2026-02-17T21:25:26.779982+0000","last_unstale":"2026-02-17T21:27:25.781875+0000","last_undegraded":"2026-02-17T21:27:25.781875+0000","last_fullsized":"2026-02-17T21:27:25.781875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:19.732550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:19.732550+0000","last_clean_scrub_stamp":"2026-02-17T21:25:19.732550+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T02:49:12.060591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":28,"seq":120259084357,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":28,"seq":120259084356,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27589058},"hb_peers":[0,1,3,4,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":28,"seq":120259084356,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":782336,"data_stored":562366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[2,4,5,6,7,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":22,"seq":94489280578,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":24,"seq":103079215170,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,4,5,6,7,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":5,"up_from":22,"seq":94489280579,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,4,6,7,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27589068},"hb_peers":[3,4,5,6,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":23,"seq":98784247875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27589061},"hb_peers":[0,2,5,6,7,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":24,"seq":103079215169,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,5,6,7,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":26,"seq":111669149763,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,4,5,6,7,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":12,"up_from":24,"seq":103079215171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,5,6,7,9,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":26,"seq":111669149766,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":164545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[3,5,6,7,8,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117062,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":164545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[2,4,5,6,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":27,"seq":115964117062,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,4,5,7,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":28,"seq":120259084357,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":782336,"data_stored":562366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,4,5,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084357,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T21:30:43.361 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T21:30:43.361 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T21:30:43.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.427+0000 7f5c51f7f640 10 monclient: get_monmap_and_config 2026-02-17T21:30:43.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.427+0000 7f5c51f7f640 10 monclient: build_initial_monmap 2026-02-17T21:30:43.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.427+0000 7f5c51f7f640 10 monclient: monmap: 2026-02-17T21:30:43.430 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:43.430 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:43.430 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:43.429114+0000 2026-02-17T21:30:43.430 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:43.429114+0000 2026-02-17T21:30:43.430 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:43.430 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:43.430 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:43.430 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:43.430 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:43.431 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:43.431 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:43.431 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:43.431 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:43.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.427+0000 7f5c51f7f640 1 Processor -- start 2026-02-17T21:30:43.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.427+0000 7f5c51f7f640 1 -- start start 2026-02-17T21:30:43.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.427+0000 7f5c51f7f640 10 monclient: init 2026-02-17T21:30:43.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.428+0000 7f5c51f7f640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:43.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.428+0000 7f5c51f7f640 10 monclient: _add_conns ranks=[3,4,5,2,1,0] 2026-02-17T21:30:43.434 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.428+0000 7f5c51f7f640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f5c4c0c7170 0x7f5c4c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:43.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.428+0000 7f5c51f7f640 10 monclient(hunting): picked mon.noname-a con 0x7f5c4c0c7170 addr v2:10.20.193.5:3300/0 2026-02-17T21:30:43.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.428+0000 7f5c51f7f640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f5c4c0c48c0 0x7f5c4c0749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:43.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.428+0000 7f5c51f7f640 10 monclient(hunting): picked mon.noname-b con 0x7f5c4c0c48c0 addr v2:10.20.193.119:3300/0 2026-02-17T21:30:43.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.428+0000 7f5c51f7f640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f5c4c074ef0 0x7f5c4c0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:43.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.428+0000 7f5c51f7f640 10 monclient(hunting): picked mon.noname-c con 0x7f5c4c074ef0 addr v2:10.20.193.135:3300/0 2026-02-17T21:30:43.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.428+0000 7f5c51f7f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:43.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.428+0000 7f5c51f7f640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5c4c0c8530 con 0x7f5c4c0c7170 2026-02-17T21:30:43.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.428+0000 7f5c51f7f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:43.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.428+0000 7f5c51f7f640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f5c4c15a9a0 con 0x7f5c4c0c48c0 2026-02-17T21:30:43.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.428+0000 7f5c51f7f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:43.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.428+0000 7f5c51f7f640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f5c4c0c5270 con 0x7f5c4c074ef0 2026-02-17T21:30:43.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.428+0000 7f5c51f7f640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:43.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.428+0000 7f5c51f7f640 10 monclient(hunting): authenticate will time out at 1348.994505s 2026-02-17T21:30:43.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.428+0000 7f5c4b7fe640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f5c4c0c7170 0x7f5c4c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:43.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.428+0000 7f5c4affd640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f5c4c0c48c0 0x7f5c4c0749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:43.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.428+0000 7f5c4bfff640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f5c4c074ef0 0x7f5c4c0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:43.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.429+0000 7f5c4affd640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f5c4c0c48c0 0x7f5c4c0749b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:34360/0 (socket says 10.20.193.5:34360) 2026-02-17T21:30:43.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.429+0000 7f5c4affd640 1 -- 10.20.193.5:0/2262428464 learned_addr learned my addr 10.20.193.5:0/2262428464 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:43.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.429+0000 7f5c4affd640 10 monclient(hunting): get_auth_request con 0x7f5c4c0c48c0 auth_method 0 2026-02-17T21:30:43.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.429+0000 7f5c4affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:43.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.429+0000 7f5c4affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:43.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.429+0000 7f5c4affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:43.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.429+0000 7f5c4b7fe640 10 monclient(hunting): get_auth_request con 0x7f5c4c0c7170 auth_method 0 2026-02-17T21:30:43.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.429+0000 7f5c4b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:43.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.429+0000 7f5c4b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:43.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.429+0000 7f5c4b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:43.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.429+0000 7f5c4bfff640 10 monclient(hunting): get_auth_request con 0x7f5c4c074ef0 auth_method 0 2026-02-17T21:30:43.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.429+0000 7f5c4bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:43.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.429+0000 7f5c4bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:43.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.429+0000 7f5c4bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:43.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.429+0000 7f5c4affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:43.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.429+0000 7f5c4affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:43.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.429+0000 7f5c4affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:43.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.429+0000 7f5c4b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:43.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.429+0000 7f5c4b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:43.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.429+0000 7f5c4b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:43.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.429+0000 7f5c4bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:43.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.429+0000 7f5c4bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:43.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.429+0000 7f5c4bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:43.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.430+0000 7f5c4affd640 10 monclient(hunting): handle_auth_done global_id 5179 payload 274 2026-02-17T21:30:43.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.430+0000 7f5c4affd640 1 -- 10.20.193.5:0/2262428464 >> v2:10.20.193.135:3300/0 conn(0x7f5c4c074ef0 msgr2=0x7f5c4c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:43.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.430+0000 7f5c4affd640 1 --2- 10.20.193.5:0/2262428464 >> v2:10.20.193.135:3300/0 conn(0x7f5c4c074ef0 0x7f5c4c0c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.430+0000 7f5c4affd640 1 -- 10.20.193.5:0/2262428464 >> v2:10.20.193.5:3300/0 conn(0x7f5c4c0c7170 msgr2=0x7f5c4c0c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:43.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.430+0000 7f5c4affd640 1 --2- 10.20.193.5:0/2262428464 >> v2:10.20.193.5:3300/0 conn(0x7f5c4c0c7170 0x7f5c4c0c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.430+0000 7f5c4affd640 10 monclient: _finish_hunting 0 2026-02-17T21:30:43.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.430+0000 7f5c4affd640 1 monclient: found mon.noname-b 2026-02-17T21:30:43.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.430+0000 7f5c4affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:43.438 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.430+0000 7f5c4affd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:30:43.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.430+0000 7f5c4affd640 1 -- 10.20.193.5:0/2262428464 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4c0c5550 con 0x7f5c4c0c48c0 2026-02-17T21:30:43.439 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.430+0000 7f5c4affd640 1 --2- 10.20.193.5:0/2262428464 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5c4c0c48c0 0x7f5c4c0749b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c0c7a90 tx=0x7f5c3c02ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef22fec8888206e3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:43.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.432+0000 7f5c4a7fc640 1 -- 10.20.193.5:0/2262428464 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c03c070 con 0x7f5c4c0c48c0 2026-02-17T21:30:43.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.432+0000 7f5c4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:43.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.432+0000 7f5c4a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:30:43.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.432+0000 7f5c4a7fc640 10 monclient: dump: 2026-02-17T21:30:43.445 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:43.445 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:43.446 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.446 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.446 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:43.446 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:43.446 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:43.446 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:43.446 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:43.446 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:43.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.432+0000 7f5c4a7fc640 10 monclient: _finish_auth 0 2026-02-17T21:30:43.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.432+0000 7f5c4a7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:30:43.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.432+0000 7f5c4a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:43.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.432+0000 7f5c4a7fc640 1 -- 10.20.193.5:0/2262428464 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c3c02fb50 con 0x7f5c4c0c48c0 2026-02-17T21:30:43.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.432+0000 7f5c4a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:43.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.432+0000 7f5c51f7f640 5 monclient: authenticate success, global_id 5179 2026-02-17T21:30:43.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.432+0000 7f5c4a7fc640 1 -- 10.20.193.5:0/2262428464 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c037440 con 0x7f5c4c0c48c0 2026-02-17T21:30:43.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.432+0000 7f5c4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:43.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.432+0000 7f5c4a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:30:43.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.432+0000 7f5c4a7fc640 10 monclient: dump: 2026-02-17T21:30:43.447 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:43.447 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:43.447 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.447 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.447 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:43.447 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:43.447 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:43.448 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:43.448 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:43.448 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:43.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.432+0000 7f5c51f7f640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:43.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.432+0000 7f5c51f7f640 4 set_mon_vals no callback set 2026-02-17T21:30:43.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.433+0000 7f5c51f7f640 10 monclient: shutdown 2026-02-17T21:30:43.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.433+0000 7f5c51f7f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:43.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.433+0000 7f5c51f7f640 1 -- 10.20.193.5:0/2262428464 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5c4c0c48c0 msgr2=0x7f5c4c0749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:43.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.433+0000 7f5c51f7f640 1 --2- 10.20.193.5:0/2262428464 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5c4c0c48c0 0x7f5c4c0749b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c0c7a90 tx=0x7f5c3c02ee90 comp rx=0 tx=0).stop 2026-02-17T21:30:43.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.433+0000 7f5c51f7f640 1 -- 10.20.193.5:0/2262428464 shutdown_connections 2026-02-17T21:30:43.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.433+0000 7f5c51f7f640 1 --2- 10.20.193.5:0/2262428464 >> v2:10.20.193.135:3300/0 conn(0x7f5c4c074ef0 0x7f5c4c0c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.433+0000 7f5c51f7f640 1 --2- 10.20.193.5:0/2262428464 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5c4c0c48c0 0x7f5c4c0749b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.433+0000 7f5c51f7f640 1 --2- 10.20.193.5:0/2262428464 >> v2:10.20.193.5:3300/0 conn(0x7f5c4c0c7170 0x7f5c4c0c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.433+0000 7f5c51f7f640 1 -- 10.20.193.5:0/2262428464 >> 10.20.193.5:0/2262428464 conn(0x7f5c4c0c9f40 msgr2=0x7f5c4c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:43.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.433+0000 7f5c51f7f640 1 -- 10.20.193.5:0/2262428464 shutdown_connections 2026-02-17T21:30:43.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.433+0000 7f5c51f7f640 1 -- 10.20.193.5:0/2262428464 wait complete. 2026-02-17T21:30:43.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.433+0000 7f5c51f7f640 10 monclient: build_initial_monmap 2026-02-17T21:30:43.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.433+0000 7f5c51f7f640 10 monclient: monmap: 2026-02-17T21:30:43.449 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:43.449 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:43.449 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:43.449 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:43.449 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:43.450 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:43.450 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:43.450 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:43.450 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:43.450 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:43.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.433+0000 7f5c51f7f640 1 librados: starting msgr at 2026-02-17T21:30:43.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.433+0000 7f5c51f7f640 1 librados: starting objecter 2026-02-17T21:30:43.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.433+0000 7f5c51f7f640 1 Processor -- start 2026-02-17T21:30:43.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.433+0000 7f5c51f7f640 1 -- start start 2026-02-17T21:30:43.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.433+0000 7f5c51f7f640 1 librados: setting wanted keys 2026-02-17T21:30:43.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.433+0000 7f5c51f7f640 1 librados: calling monclient init 2026-02-17T21:30:43.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.433+0000 7f5c51f7f640 10 monclient: init 2026-02-17T21:30:43.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c51f7f640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:43.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c51f7f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:30:43.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c51f7f640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5c4c074ef0 0x7f5c4c15c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:43.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c51f7f640 10 monclient(hunting): picked mon.noname-c con 0x7f5c4c074ef0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:43.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c51f7f640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5c4c0c48c0 0x7f5c4c152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:43.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c51f7f640 10 monclient(hunting): picked mon.noname-b con 0x7f5c4c0c48c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:43.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c51f7f640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5c4c0c7170 0x7f5c4c153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:43.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c51f7f640 10 monclient(hunting): picked mon.noname-a con 0x7f5c4c0c7170 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:43.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c51f7f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:43.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c51f7f640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c0c81c0 con 0x7f5c4c0c7170 2026-02-17T21:30:43.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c51f7f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:43.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c51f7f640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c0c7ee0 con 0x7f5c4c0c48c0 2026-02-17T21:30:43.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c51f7f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:43.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c51f7f640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c0c4d10 con 0x7f5c4c074ef0 2026-02-17T21:30:43.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c51f7f640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:43.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c51f7f640 10 monclient(hunting): authenticate will time out at 1349.000273s 2026-02-17T21:30:43.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c4bfff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5c4c0c7170 0x7f5c4c153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:43.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c4affd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5c4c0c48c0 0x7f5c4c152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:43.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c4b7fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5c4c074ef0 0x7f5c4c15c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:43.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c4affd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5c4c0c48c0 0x7f5c4c152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:34362/0 (socket says 10.20.193.5:34362) 2026-02-17T21:30:43.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c4affd640 1 -- 10.20.193.5:0/321809672 learned_addr learned my addr 10.20.193.5:0/321809672 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:43.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c4bfff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5c4c0c7170 0x7f5c4c153440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:60914/0 (socket says 10.20.193.5:60914) 2026-02-17T21:30:43.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c4affd640 10 monclient(hunting): get_auth_request con 0x7f5c4c0c48c0 auth_method 0 2026-02-17T21:30:43.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c4affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:43.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c4affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:43.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c4affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:43.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c4bfff640 10 monclient(hunting): get_auth_request con 0x7f5c4c0c7170 auth_method 0 2026-02-17T21:30:43.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c4bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:43.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c4bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:43.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c4bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:43.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c4b7fe640 10 monclient(hunting): get_auth_request con 0x7f5c4c074ef0 auth_method 0 2026-02-17T21:30:43.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c4b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:43.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c4b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:43.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c4b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:43.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c4affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:43.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c4affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:43.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c4affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:43.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c4b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:43.454 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.434+0000 7f5c4b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:43.454 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.435+0000 7f5c4b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:43.454 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.435+0000 7f5c4bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:43.454 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.435+0000 7f5c4bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:43.454 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.435+0000 7f5c4bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:43.454 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.436+0000 7f5c4affd640 10 monclient(hunting): handle_auth_done global_id 5182 payload 824 2026-02-17T21:30:43.454 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.436+0000 7f5c4affd640 1 -- 10.20.193.5:0/321809672 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5c4c074ef0 msgr2=0x7f5c4c15c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:43.454 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.436+0000 7f5c4affd640 1 --2- 10.20.193.5:0/321809672 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5c4c074ef0 0x7f5c4c15c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.454 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.436+0000 7f5c4affd640 1 -- 10.20.193.5:0/321809672 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5c4c0c7170 msgr2=0x7f5c4c153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:43.454 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.436+0000 7f5c4affd640 1 --2- 10.20.193.5:0/321809672 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5c4c0c7170 0x7f5c4c153440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.454 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.436+0000 7f5c4affd640 10 monclient: _finish_hunting 0 2026-02-17T21:30:43.454 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.436+0000 7f5c4affd640 1 monclient: found mon.noname-b 2026-02-17T21:30:43.455 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.436+0000 7f5c4affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:43.455 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.436+0000 7f5c4affd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:30:43.455 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.436+0000 7f5c4affd640 1 -- 10.20.193.5:0/321809672 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4c1f26c0 con 0x7f5c4c0c48c0 2026-02-17T21:30:43.455 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.437+0000 7f5c4affd640 1 --2- 10.20.193.5:0/321809672 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5c4c0c48c0 0x7f5c4c152f00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c009a40 tx=0x7f5c3c0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:43.455 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.437+0000 7f5c27fff640 10 client.?.objecter ms_handle_connect 0x7f5c4c0c48c0 2026-02-17T21:30:43.455 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.437+0000 7f5c27fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:43.455 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.438+0000 7f5c27fff640 1 -- 10.20.193.5:0/321809672 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c03c040 con 0x7f5c4c0c48c0 2026-02-17T21:30:43.455 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.438+0000 7f5c27fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:43.455 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.438+0000 7f5c27fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:30:43.455 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.438+0000 7f5c27fff640 10 monclient: dump: 2026-02-17T21:30:43.455 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:43.455 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:43.455 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.456 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.456 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:43.456 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:43.456 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:43.456 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:43.456 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:43.456 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:43.456 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.438+0000 7f5c27fff640 10 monclient: _finish_auth 0 2026-02-17T21:30:43.456 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.438+0000 7f5c27fff640 10 monclient: _check_auth_tickets 2026-02-17T21:30:43.456 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.438+0000 7f5c27fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:43.456 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.438+0000 7f5c27fff640 1 -- 10.20.193.5:0/321809672 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c3c042430 con 0x7f5c4c0c48c0 2026-02-17T21:30:43.456 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.438+0000 7f5c27fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:43.456 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.438+0000 7f5c27fff640 1 -- 10.20.193.5:0/321809672 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c042800 con 0x7f5c4c0c48c0 2026-02-17T21:30:43.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.438+0000 7f5c27fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:43.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.438+0000 7f5c27fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:30:43.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.438+0000 7f5c49ffb640 4 set_mon_vals no callback set 2026-02-17T21:30:43.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.438+0000 7f5c27fff640 10 monclient: dump: 2026-02-17T21:30:43.457 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:43.457 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:43.457 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.457 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.457 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:43.457 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:43.457 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:43.457 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:43.458 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:43.458 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:43.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.438+0000 7f5c51f7f640 5 monclient: authenticate success, global_id 5182 2026-02-17T21:30:43.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.438+0000 7f5c51f7f640 10 monclient: _renew_subs 2026-02-17T21:30:43.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.438+0000 7f5c51f7f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:43.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.438+0000 7f5c51f7f640 1 -- 10.20.193.5:0/321809672 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c4c15d2f0 con 0x7f5c4c0c48c0 2026-02-17T21:30:43.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.439+0000 7f5c51f7f640 10 client.5182.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:43.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.439+0000 7f5c51f7f640 10 monclient: _renew_subs 2026-02-17T21:30:43.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.439+0000 7f5c51f7f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:43.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.439+0000 7f5c51f7f640 1 -- 10.20.193.5:0/321809672 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c4c15d8b0 con 0x7f5c4c0c48c0 2026-02-17T21:30:43.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.439+0000 7f5c51f7f640 1 librados: init done 2026-02-17T21:30:43.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.439+0000 7f5c51f7f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:43.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.439+0000 7f5c51f7f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:43.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.439+0000 7f5c51f7f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:43.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.439+0000 7f5c51f7f640 1 -- 10.20.193.5:0/321809672 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c4c0c7b10 con 0x7f5c4c0c48c0 2026-02-17T21:30:43.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.545+0000 7f5c27fff640 1 -- 10.20.193.5:0/321809672 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f5c3c0429a0 con 0x7f5c4c0c48c0 2026-02-17T21:30:43.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.546+0000 7f5c27fff640 1 --2- 10.20.193.5:0/321809672 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f5c1c079280 0x7f5c1c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:43.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.546+0000 7f5c4b7fe640 1 --2- 10.20.193.5:0/321809672 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f5c1c079280 0x7f5c1c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:43.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.546+0000 7f5c4b7fe640 10 monclient: get_auth_request con 0x7f5c1c079280 auth_method 0 2026-02-17T21:30:43.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.547+0000 7f5c4b7fe640 1 --2- 10.20.193.5:0/321809672 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f5c1c079280 0x7f5c1c07b740 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009ba0 tx=0x7f5c38009290 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:43.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.547+0000 7f5c27fff640 10 client.5182.objecter ms_handle_connect 0x7f5c1c079280 2026-02-17T21:30:43.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.549+0000 7f5c27fff640 1 -- 10.20.193.5:0/321809672 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f5c3c083a90 con 0x7f5c4c0c48c0 2026-02-17T21:30:43.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.549+0000 7f5c27fff640 10 client.5182.objecter ms_dispatch2 0x7f5c4c000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:43.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.549+0000 7f5c27fff640 3 client.5182.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:43.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.549+0000 7f5c27fff640 3 client.5182.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:43.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.549+0000 7f5c27fff640 20 client.5182.objecter dump_active .. 0 homeless 2026-02-17T21:30:43.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.555+0000 7f5c27fff640 1 -- 10.20.193.5:0/321809672 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5c4c0c7b10 con 0x7f5c4c0c48c0 2026-02-17T21:30:43.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.555+0000 7f5c27fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:43.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.555+0000 7f5c27fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:43.644 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.642+0000 7f5c51f7f640 1 -- 10.20.193.5:0/321809672 --> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5c4c0749b0 con 0x7f5c1c079280 2026-02-17T21:30:43.645 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.643+0000 7f5c27fff640 1 -- 10.20.193.5:0/321809672 <== mgr.4131 v2:10.20.193.176:6800/2898618020 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+43916 (secure 0 0 0) 0x7f5c4c0749b0 con 0x7f5c1c079280 2026-02-17T21:30:43.646 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:30:43.648 INFO:teuthology.orchestra.run.trial005.stderr:dumped all 2026-02-17T21:30:43.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.644+0000 7f5c51f7f640 10 librados: watch_flush enter 2026-02-17T21:30:43.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.644+0000 7f5c51f7f640 10 librados: watch_flush exit 2026-02-17T21:30:43.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.644+0000 7f5c51f7f640 20 client.5182.objecter shutdown clearing up homeless session... 2026-02-17T21:30:43.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.644+0000 7f5c51f7f640 10 client.5182.objecter successfully canceled tick 2026-02-17T21:30:43.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.644+0000 7f5c51f7f640 1 -- 10.20.193.5:0/321809672 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f5c1c079280 msgr2=0x7f5c1c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:43.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.644+0000 7f5c51f7f640 1 --2- 10.20.193.5:0/321809672 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f5c1c079280 0x7f5c1c07b740 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009ba0 tx=0x7f5c38009290 comp rx=0 tx=0).stop 2026-02-17T21:30:43.648 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.644+0000 7f5c51f7f640 10 monclient: shutdown 2026-02-17T21:30:43.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.644+0000 7f5c51f7f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:43.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.644+0000 7f5c51f7f640 1 -- 10.20.193.5:0/321809672 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5c4c0c48c0 msgr2=0x7f5c4c152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:43.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.644+0000 7f5c51f7f640 1 --2- 10.20.193.5:0/321809672 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5c4c0c48c0 0x7f5c4c152f00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c009a40 tx=0x7f5c3c0047c0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.644+0000 7f5c51f7f640 1 -- 10.20.193.5:0/321809672 shutdown_connections 2026-02-17T21:30:43.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.644+0000 7f5c51f7f640 1 --2- 10.20.193.5:0/321809672 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f5c1c079280 0x7f5c1c07b740 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.644+0000 7f5c51f7f640 1 --2- 10.20.193.5:0/321809672 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f5c4c0c7170 0x7f5c4c153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.644+0000 7f5c51f7f640 1 --2- 10.20.193.5:0/321809672 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5c4c0c48c0 0x7f5c4c152f00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.644+0000 7f5c51f7f640 1 --2- 10.20.193.5:0/321809672 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f5c4c074ef0 0x7f5c4c15c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.644+0000 7f5c51f7f640 1 -- 10.20.193.5:0/321809672 >> 10.20.193.5:0/321809672 conn(0x7f5c4c0c9f40 msgr2=0x7f5c4c159140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:43.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.644+0000 7f5c51f7f640 1 -- 10.20.193.5:0/321809672 shutdown_connections 2026-02-17T21:30:43.649 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.644+0000 7f5c51f7f640 1 -- 10.20.193.5:0/321809672 wait complete. 2026-02-17T21:30:43.650 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.644+0000 7f5c51f7f640 1 librados: shutdown 2026-02-17T21:30:43.656 INFO:teuthology.orchestra.run.trial005.stdout:{"pg_ready":true,"pg_map":{"version":223,"stamp":"2026-02-17T21:30:43.562872+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":10,"kb":1509949440,"kb_used":438168,"kb_used_data":6744,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511272,"statfs":{"total":1546188226560,"available":1545739542528,"internally_reserved":0,"allocated":6905856,"data_stored":3428134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25504,"internal_metadata":441424992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001867"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:45.672446+0000","last_change":"2026-02-17T21:25:34.688050+0000","last_active":"2026-02-17T21:27:45.672446+0000","last_peered":"2026-02-17T21:27:45.672446+0000","last_clean":"2026-02-17T21:27:45.672446+0000","last_became_active":"2026-02-17T21:25:32.292871+0000","last_became_peered":"2026-02-17T21:25:32.292871+0000","last_unstale":"2026-02-17T21:27:45.672446+0000","last_undegraded":"2026-02-17T21:27:45.672446+0000","last_fullsized":"2026-02-17T21:27:45.672446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T01:55:40.877834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038010112999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:43.552125+0000","last_change":"2026-02-17T21:25:34.963519+0000","last_active":"2026-02-17T21:27:43.552125+0000","last_peered":"2026-02-17T21:27:43.552125+0000","last_clean":"2026-02-17T21:27:43.552125+0000","last_became_active":"2026-02-17T21:25:31.984749+0000","last_became_peered":"2026-02-17T21:25:31.984749+0000","last_unstale":"2026-02-17T21:27:43.552125+0000","last_undegraded":"2026-02-17T21:27:43.552125+0000","last_fullsized":"2026-02-17T21:27:43.552125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:03:42.411486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037066832000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:40.482034+0000","last_change":"2026-02-17T21:25:35.008224+0000","last_active":"2026-02-17T21:27:40.482034+0000","last_peered":"2026-02-17T21:27:40.482034+0000","last_clean":"2026-02-17T21:27:40.482034+0000","last_became_active":"2026-02-17T21:25:32.229048+0000","last_became_peered":"2026-02-17T21:25:32.229048+0000","last_unstale":"2026-02-17T21:27:40.482034+0000","last_undegraded":"2026-02-17T21:27:40.482034+0000","last_fullsized":"2026-02-17T21:27:40.482034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T09:14:11.573578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.041957774000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:38.952464+0000","last_change":"2026-02-17T21:25:36.620455+0000","last_active":"2026-02-17T21:27:38.952464+0000","last_peered":"2026-02-17T21:27:38.952464+0000","last_clean":"2026-02-17T21:27:38.952464+0000","last_became_active":"2026-02-17T21:25:32.009122+0000","last_became_peered":"2026-02-17T21:25:32.009122+0000","last_unstale":"2026-02-17T21:27:38.952464+0000","last_undegraded":"2026-02-17T21:27:38.952464+0000","last_fullsized":"2026-02-17T21:27:38.952464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:02:56.485559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032898110000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"34'2","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:40.465729+0000","last_change":"2026-02-17T21:25:34.887379+0000","last_active":"2026-02-17T21:27:40.465729+0000","last_peered":"2026-02-17T21:27:40.465729+0000","last_clean":"2026-02-17T21:27:40.465729+0000","last_became_active":"2026-02-17T21:25:32.016451+0000","last_became_peered":"2026-02-17T21:25:32.016451+0000","last_unstale":"2026-02-17T21:27:40.465729+0000","last_undegraded":"2026-02-17T21:27:40.465729+0000","last_fullsized":"2026-02-17T21:27:40.465729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:05:51.937857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046646930000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:40.788190+0000","last_change":"2026-02-17T21:25:34.719483+0000","last_active":"2026-02-17T21:27:40.788190+0000","last_peered":"2026-02-17T21:27:40.788190+0000","last_clean":"2026-02-17T21:27:40.788190+0000","last_became_active":"2026-02-17T21:25:31.944529+0000","last_became_peered":"2026-02-17T21:25:31.944529+0000","last_unstale":"2026-02-17T21:27:40.788190+0000","last_undegraded":"2026-02-17T21:27:40.788190+0000","last_fullsized":"2026-02-17T21:27:40.788190+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T02:38:03.529141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030826864999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:35.463435+0000","last_change":"2026-02-17T21:25:34.893210+0000","last_active":"2026-02-17T21:27:35.463435+0000","last_peered":"2026-02-17T21:27:35.463435+0000","last_clean":"2026-02-17T21:27:35.463435+0000","last_became_active":"2026-02-17T21:25:31.969947+0000","last_became_peered":"2026-02-17T21:25:31.969947+0000","last_unstale":"2026-02-17T21:27:35.463435+0000","last_undegraded":"2026-02-17T21:27:35.463435+0000","last_fullsized":"2026-02-17T21:27:35.463435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:26:53.468392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063724551000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"32'1","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:40.694733+0000","last_change":"2026-02-17T21:25:34.347523+0000","last_active":"2026-02-17T21:27:40.694733+0000","last_peered":"2026-02-17T21:27:40.694733+0000","last_clean":"2026-02-17T21:27:40.694733+0000","last_became_active":"2026-02-17T21:25:31.956011+0000","last_became_peered":"2026-02-17T21:25:31.956011+0000","last_unstale":"2026-02-17T21:27:40.694733+0000","last_undegraded":"2026-02-17T21:27:40.694733+0000","last_fullsized":"2026-02-17T21:27:40.694733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:12:18.319913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036103899000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,15],"acting":[4,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"34'32","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:25.781875+0000","last_change":"2026-02-17T21:25:26.799130+0000","last_active":"2026-02-17T21:27:25.781875+0000","last_peered":"2026-02-17T21:27:25.781875+0000","last_clean":"2026-02-17T21:27:25.781875+0000","last_became_active":"2026-02-17T21:25:26.779982+0000","last_became_peered":"2026-02-17T21:25:26.779982+0000","last_unstale":"2026-02-17T21:27:25.781875+0000","last_undegraded":"2026-02-17T21:27:25.781875+0000","last_fullsized":"2026-02-17T21:27:25.781875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:19.732550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:19.732550+0000","last_clean_scrub_stamp":"2026-02-17T21:25:19.732550+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T02:49:12.060591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":28,"seq":120259084357,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":28,"seq":120259084357,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27589058},"hb_peers":[0,1,3,4,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":28,"seq":120259084356,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":782336,"data_stored":562366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[2,4,5,6,7,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":22,"seq":94489280578,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":24,"seq":103079215171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,4,5,6,7,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":5,"up_from":22,"seq":94489280579,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,4,6,7,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27589068},"hb_peers":[3,4,5,6,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":23,"seq":98784247875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27589061},"hb_peers":[0,2,5,6,7,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":24,"seq":103079215170,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,5,6,7,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":26,"seq":111669149763,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,4,5,6,7,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":12,"up_from":24,"seq":103079215172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,5,6,7,9,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":26,"seq":111669149766,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":164545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[3,5,6,7,8,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117062,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":164545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[2,4,5,6,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":27,"seq":115964117062,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,4,5,7,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":28,"seq":120259084357,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":782336,"data_stored":562366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,4,5,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084357,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T21:30:43.658 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T21:30:43.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.723+0000 7f6ee172c640 10 monclient: get_monmap_and_config 2026-02-17T21:30:43.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.723+0000 7f6ee172c640 10 monclient: build_initial_monmap 2026-02-17T21:30:43.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.723+0000 7f6ee172c640 10 monclient: monmap: 2026-02-17T21:30:43.726 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:43.726 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:43.726 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:43.724948+0000 2026-02-17T21:30:43.726 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:43.724948+0000 2026-02-17T21:30:43.726 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:43.726 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:43.726 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:43.726 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:43.726 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:43.726 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:43.727 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:43.727 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:43.727 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:43.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.723+0000 7f6ee172c640 1 Processor -- start 2026-02-17T21:30:43.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.723+0000 7f6ee172c640 1 -- start start 2026-02-17T21:30:43.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.723+0000 7f6ee172c640 10 monclient: init 2026-02-17T21:30:43.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.724+0000 7f6ee172c640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:43.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.724+0000 7f6ee172c640 10 monclient: _add_conns ranks=[0,2,1,3,5,4] 2026-02-17T21:30:43.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.724+0000 7f6ee172c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6edc152820 addr v1:10.20.193.5:6789/0 2026-02-17T21:30:43.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.724+0000 7f6ee172c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6edc152c00 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:43.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.724+0000 7f6ee172c640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f6edc0c63f0 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:43.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.724+0000 7f6ee172c640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6edc073e90 con 0x7f6edc152820 2026-02-17T21:30:43.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.724+0000 7f6ee172c640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6edc074170 con 0x7f6edc0c63f0 2026-02-17T21:30:43.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.724+0000 7f6ee172c640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6edc074450 con 0x7f6edc152c00 2026-02-17T21:30:43.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.724+0000 7f6ee172c640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:43.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.724+0000 7f6ee172c640 10 monclient(hunting): authenticate will time out at 1349.290351s 2026-02-17T21:30:43.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.724+0000 7f6edaffd640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f6edc152820 0x7f6edc0c7e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:34518/0 (socket says 10.20.193.5:34518) 2026-02-17T21:30:43.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.724+0000 7f6edaffd640 1 -- 10.20.193.5:0/1379127323 learned_addr learned my addr 10.20.193.5:0/1379127323 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:43.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.726+0000 7f6ed9ffb640 1 -- 10.20.193.5:0/1379127323 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1649138813 0 0) 0x7f6edc074450 con 0x7f6edc152c00 2026-02-17T21:30:43.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.726+0000 7f6ed9ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:30:43.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.726+0000 7f6ed9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:43.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.726+0000 7f6ed9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:43.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.726+0000 7f6ed9ffb640 10 monclient(hunting): my global_id is 5177 2026-02-17T21:30:43.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.726+0000 7f6ed9ffb640 1 -- 10.20.193.5:0/1379127323 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ec8003620 con 0x7f6edc152c00 2026-02-17T21:30:43.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.726+0000 7f6ed9ffb640 1 -- 10.20.193.5:0/1379127323 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3296296601 0 0) 0x7f6edc073e90 con 0x7f6edc152820 2026-02-17T21:30:43.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.726+0000 7f6ed9ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:30:43.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.726+0000 7f6ed9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:43.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.726+0000 7f6ed9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:43.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.726+0000 7f6ed9ffb640 10 monclient(hunting): my global_id is 5112 2026-02-17T21:30:43.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.726+0000 7f6ed9ffb640 1 -- 10.20.193.5:0/1379127323 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6edc074450 con 0x7f6edc152820 2026-02-17T21:30:43.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.726+0000 7f6ed9ffb640 1 -- 10.20.193.5:0/1379127323 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4116622365 0 0) 0x7f6edc074170 con 0x7f6edc0c63f0 2026-02-17T21:30:43.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.726+0000 7f6ed9ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:30:43.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.726+0000 7f6ed9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:43.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.726+0000 7f6ed9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:43.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.726+0000 7f6ed9ffb640 10 monclient(hunting): my global_id is 5185 2026-02-17T21:30:43.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.726+0000 7f6ed9ffb640 1 -- 10.20.193.5:0/1379127323 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6edc073e90 con 0x7f6edc0c63f0 2026-02-17T21:30:43.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 1 -- 10.20.193.5:0/1379127323 <== mon.2 v1:10.20.193.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3754156207 0 0) 0x7f6ec8003620 con 0x7f6edc152c00 2026-02-17T21:30:43.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 1 -- 10.20.193.5:0/1379127323 >> v1:10.20.193.119:6789/0 conn(0x7f6edc0c63f0 legacy=0x7f6edc0726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:43.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 1 -- 10.20.193.5:0/1379127323 >> v1:10.20.193.5:6789/0 conn(0x7f6edc152820 legacy=0x7f6edc0c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:43.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 10 monclient: _finish_hunting 0 2026-02-17T21:30:43.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 1 monclient: found mon.noname-c-legacy 2026-02-17T21:30:43.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:43.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.135:6789/0 2026-02-17T21:30:43.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 1 -- 10.20.193.5:0/1379127323 --> v1:10.20.193.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6edc074730 con 0x7f6edc152c00 2026-02-17T21:30:43.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 10 monclient: _finish_auth 0 2026-02-17T21:30:43.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:30:43.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:43.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 1 -- 10.20.193.5:0/1379127323 <== mon.2 v1:10.20.193.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3880376286 0 0) 0x7f6ec4002f00 con 0x7f6edc152c00 2026-02-17T21:30:43.742 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:43.742 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T21:30:43.742 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 10 monclient: dump: 2026-02-17T21:30:43.742 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:43.742 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:43.742 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.742 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.742 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:43.742 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:43.742 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:43.742 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:43.742 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:43.743 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:43.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 1 monclient: mon.c has (v2) addrs [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] but i'm connected to v1:10.20.193.135:6789/0, reconnecting 2026-02-17T21:30:43.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:43.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 1 -- 10.20.193.5:0/1379127323 >> v1:10.20.193.135:6789/0 conn(0x7f6edc152c00 legacy=0x7f6edc0c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:43.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:30:43.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 1 --2- 10.20.193.5:0/1379127323 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6ec8005010 0x7f6ec80038a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:43.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 10 monclient(hunting): picked mon.c con 0x7f6ec8005010 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:43.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 1 --2- 10.20.193.5:0/1379127323 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6ec8005520 0x7f6ec8003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:43.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 10 monclient(hunting): picked mon.a con 0x7f6ec8005520 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:43.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 1 --2- 10.20.193.5:0/1379127323 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6ec800bd40 0x7f6ec800e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:43.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 10 monclient(hunting): picked mon.b con 0x7f6ec800bd40 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:43.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:43.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 1 -- 10.20.193.5:0/1379127323 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec800e720 con 0x7f6ec8005520 2026-02-17T21:30:43.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:43.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 1 -- 10.20.193.5:0/1379127323 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec800e8a0 con 0x7f6ec800bd40 2026-02-17T21:30:43.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:43.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 1 -- 10.20.193.5:0/1379127323 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec800eaa0 con 0x7f6ec8005010 2026-02-17T21:30:43.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:43.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.727+0000 7f6ed9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:30:43.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.728+0000 7f6eda7fc640 1 --2- 10.20.193.5:0/1379127323 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6ec8005520 0x7f6ec8003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:43.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.728+0000 7f6edb7fe640 1 --2- 10.20.193.5:0/1379127323 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6ec800bd40 0x7f6ec800e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:43.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.729+0000 7f6eda7fc640 10 monclient(hunting): get_auth_request con 0x7f6ec8005520 auth_method 0 2026-02-17T21:30:43.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.729+0000 7f6eda7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:43.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.729+0000 7f6eda7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:43.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.729+0000 7f6eda7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:30:43.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.729+0000 7f6edb7fe640 10 monclient(hunting): get_auth_request con 0x7f6ec800bd40 auth_method 0 2026-02-17T21:30:43.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.729+0000 7f6edb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:43.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.729+0000 7f6edb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:43.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.729+0000 7f6edb7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:30:43.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.729+0000 7f6eda7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:43.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.729+0000 7f6eda7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:43.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.729+0000 7f6edaffd640 1 --2- 10.20.193.5:0/1379127323 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6ec8005010 0x7f6ec80038a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:43.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.729+0000 7f6eda7fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:30:43.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.729+0000 7f6edaffd640 10 monclient(hunting): get_auth_request con 0x7f6ec8005010 auth_method 0 2026-02-17T21:30:43.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.729+0000 7f6edaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:43.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.729+0000 7f6edaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:43.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.729+0000 7f6edaffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:30:43.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.729+0000 7f6edb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:43.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.729+0000 7f6edb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:43.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.729+0000 7f6edb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:30:43.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.729+0000 7f6edaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:43.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.729+0000 7f6edaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:43.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.730+0000 7f6edaffd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:30:43.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.730+0000 7f6eda7fc640 10 monclient(hunting): handle_auth_done global_id 5177 payload 293 2026-02-17T21:30:43.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.730+0000 7f6eda7fc640 1 -- 10.20.193.5:0/1379127323 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6ec8005010 msgr2=0x7f6ec80038a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:43.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.730+0000 7f6eda7fc640 1 --2- 10.20.193.5:0/1379127323 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6ec8005010 0x7f6ec80038a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.730+0000 7f6eda7fc640 1 -- 10.20.193.5:0/1379127323 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6ec800bd40 msgr2=0x7f6ec800e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:43.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.730+0000 7f6eda7fc640 1 --2- 10.20.193.5:0/1379127323 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6ec800bd40 0x7f6ec800e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.730+0000 7f6eda7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:30:43.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.730+0000 7f6eda7fc640 1 monclient: found mon.a 2026-02-17T21:30:43.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.730+0000 7f6eda7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:43.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.730+0000 7f6eda7fc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:43.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.730+0000 7f6edb7fe640 1 -- 10.20.193.5:0/1379127323 reap_dead start 2026-02-17T21:30:43.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.730+0000 7f6eda7fc640 1 -- 10.20.193.5:0/1379127323 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec8003620 con 0x7f6ec8005520 2026-02-17T21:30:43.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.730+0000 7f6eda7fc640 10 monclient: _finish_auth 0 2026-02-17T21:30:43.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.730+0000 7f6eda7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:30:43.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.730+0000 7f6eda7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:43.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.730+0000 7f6ee172c640 5 monclient: authenticate success, global_id 5177 2026-02-17T21:30:43.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.730+0000 7f6ee172c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:43.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.731+0000 7f6eda7fc640 1 --2- 10.20.193.5:0/1379127323 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6ec8005520 0x7f6ec8003e80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6ec400c0e0 tx=0x7f6ec402f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5552b559fe2e46 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:43.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.733+0000 7f6ed9ffb640 1 -- 10.20.193.5:0/1379127323 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec403c070 con 0x7f6ec8005520 2026-02-17T21:30:43.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.733+0000 7f6ed9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:43.748 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.733+0000 7f6ed9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:43.748 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.733+0000 7f6ed9ffb640 10 monclient: dump: 2026-02-17T21:30:43.748 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:43.748 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:43.748 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.748 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.748 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:43.748 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:43.748 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:43.748 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:43.748 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:43.748 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:43.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.733+0000 7f6ed9ffb640 1 -- 10.20.193.5:0/1379127323 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec4037440 con 0x7f6ec8005520 2026-02-17T21:30:43.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.733+0000 7f6ee172c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:43.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.733+0000 7f6ed9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:43.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.733+0000 7f6ed9ffb640 1 -- 10.20.193.5:0/1379127323 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4007c50 con 0x7f6ec8005520 2026-02-17T21:30:43.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.733+0000 7f6ed9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:43.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.733+0000 7f6ed9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:43.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.733+0000 7f6ed9ffb640 10 monclient: dump: 2026-02-17T21:30:43.749 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:43.749 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:43.749 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.749 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.749 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:43.750 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:43.750 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:43.750 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:43.750 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:43.750 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:43.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.733+0000 7f6ee172c640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:43.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.733+0000 7f6ee172c640 4 set_mon_vals no callback set 2026-02-17T21:30:43.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.733+0000 7f6ee172c640 10 monclient: shutdown 2026-02-17T21:30:43.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.733+0000 7f6ee172c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:43.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.733+0000 7f6ee172c640 1 -- 10.20.193.5:0/1379127323 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6ec8005520 msgr2=0x7f6ec8003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:43.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.733+0000 7f6ee172c640 1 --2- 10.20.193.5:0/1379127323 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6ec8005520 0x7f6ec8003e80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6ec400c0e0 tx=0x7f6ec402f3f0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.733+0000 7f6ee172c640 1 -- 10.20.193.5:0/1379127323 shutdown_connections 2026-02-17T21:30:43.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.733+0000 7f6ee172c640 1 --2- 10.20.193.5:0/1379127323 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6ec8005520 0x7f6ec8003e80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.733+0000 7f6ee172c640 1 -- 10.20.193.5:0/1379127323 >> 10.20.193.5:0/1379127323 conn(0x7f6edc0c9f40 msgr2=0x7f6edc0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:43.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.733+0000 7f6ee172c640 1 -- 10.20.193.5:0/1379127323 shutdown_connections 2026-02-17T21:30:43.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.733+0000 7f6ee172c640 1 -- 10.20.193.5:0/1379127323 wait complete. 2026-02-17T21:30:43.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6ee172c640 10 monclient: build_initial_monmap 2026-02-17T21:30:43.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6ee172c640 10 monclient: monmap: 2026-02-17T21:30:43.751 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:43.751 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:43.751 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:43.751 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:43.751 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:43.751 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:43.751 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:43.751 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:43.752 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:43.752 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:43.752 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6ee172c640 1 librados: starting msgr at 2026-02-17T21:30:43.752 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6ee172c640 1 librados: starting objecter 2026-02-17T21:30:43.752 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6ee172c640 1 Processor -- start 2026-02-17T21:30:43.752 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6ee172c640 1 -- start start 2026-02-17T21:30:43.752 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6ee172c640 1 librados: setting wanted keys 2026-02-17T21:30:43.752 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6ee172c640 1 librados: calling monclient init 2026-02-17T21:30:43.752 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6ee172c640 10 monclient: init 2026-02-17T21:30:43.752 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6ee172c640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:43.752 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6ee172c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:30:43.752 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6ee172c640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6edc1471e0 0x7f6edc158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:43.752 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6ee172c640 10 monclient(hunting): picked mon.noname-c con 0x7f6edc1471e0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:43.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6ee172c640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6edc1475c0 0x7f6edc149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:43.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6ee172c640 10 monclient(hunting): picked mon.noname-b con 0x7f6edc1475c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:43.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6ee172c640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6edc0be9d0 0x7f6edc0c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:43.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6ee172c640 10 monclient(hunting): picked mon.noname-a con 0x7f6edc0be9d0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:43.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6ee172c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:43.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6ee172c640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6edc0738f0 con 0x7f6edc0be9d0 2026-02-17T21:30:43.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6ee172c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:43.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6ee172c640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6edc074cf0 con 0x7f6edc1475c0 2026-02-17T21:30:43.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6ee172c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:43.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6ee172c640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6edc073a70 con 0x7f6edc1471e0 2026-02-17T21:30:43.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6ee172c640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:43.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6ee172c640 10 monclient(hunting): authenticate will time out at 1349.300703s 2026-02-17T21:30:43.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.734+0000 7f6edb7fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6edc0be9d0 0x7f6edc0c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:43.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.735+0000 7f6edaffd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6edc1471e0 0x7f6edc158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:43.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.735+0000 7f6edb7fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6edc0be9d0 0x7f6edc0c6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:60930/0 (socket says 10.20.193.5:60930) 2026-02-17T21:30:43.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.735+0000 7f6edb7fe640 1 -- 10.20.193.5:0/1476041617 learned_addr learned my addr 10.20.193.5:0/1476041617 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:43.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.735+0000 7f6edb7fe640 10 monclient(hunting): get_auth_request con 0x7f6edc0be9d0 auth_method 0 2026-02-17T21:30:43.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.735+0000 7f6edb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:43.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.735+0000 7f6edb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:43.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.735+0000 7f6edb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:43.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.735+0000 7f6edaffd640 10 monclient(hunting): get_auth_request con 0x7f6edc1471e0 auth_method 0 2026-02-17T21:30:43.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.735+0000 7f6edaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:43.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.735+0000 7f6edaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:43.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.735+0000 7f6edaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:43.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.735+0000 7f6eda7fc640 1 --2- 10.20.193.5:0/1476041617 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6edc1475c0 0x7f6edc149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:43.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.735+0000 7f6edb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:43.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.735+0000 7f6edb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:43.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.735+0000 7f6edb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:43.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.735+0000 7f6edaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:43.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.735+0000 7f6edaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:43.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.735+0000 7f6edaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:43.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.735+0000 7f6eda7fc640 10 monclient(hunting): get_auth_request con 0x7f6edc1475c0 auth_method 0 2026-02-17T21:30:43.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.735+0000 7f6eda7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:43.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.735+0000 7f6eda7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:43.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.735+0000 7f6eda7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:43.755 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.735+0000 7f6eda7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:43.756 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.735+0000 7f6eda7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:43.756 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.735+0000 7f6eda7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:43.756 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.736+0000 7f6edaffd640 10 monclient(hunting): handle_auth_done global_id 5180 payload 824 2026-02-17T21:30:43.756 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.736+0000 7f6edaffd640 1 -- 10.20.193.5:0/1476041617 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6edc1475c0 msgr2=0x7f6edc149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:43.756 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.736+0000 7f6edaffd640 1 --2- 10.20.193.5:0/1476041617 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6edc1475c0 0x7f6edc149640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.756 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.736+0000 7f6edaffd640 1 -- 10.20.193.5:0/1476041617 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6edc0be9d0 msgr2=0x7f6edc0c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:43.756 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.736+0000 7f6edaffd640 1 --2- 10.20.193.5:0/1476041617 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6edc0be9d0 0x7f6edc0c6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.756 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.736+0000 7f6edaffd640 10 monclient: _finish_hunting 0 2026-02-17T21:30:43.756 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.736+0000 7f6edaffd640 1 monclient: found mon.noname-c 2026-02-17T21:30:43.756 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.736+0000 7f6edaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:43.756 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.736+0000 7f6edaffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:43.756 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.736+0000 7f6edaffd640 1 -- 10.20.193.5:0/1476041617 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6edc1587d0 con 0x7f6edc1471e0 2026-02-17T21:30:43.756 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.737+0000 7f6edaffd640 1 --2- 10.20.193.5:0/1476041617 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6edc1471e0 0x7f6edc158290 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0007140 tx=0x7f6ed0007610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:43.757 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.737+0000 7f6ebb7fe640 10 client.?.objecter ms_handle_connect 0x7f6edc1471e0 2026-02-17T21:30:43.757 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.737+0000 7f6ebb7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:43.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ebb7fe640 1 -- 10.20.193.5:0/1476041617 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed000f7b0 con 0x7f6edc1471e0 2026-02-17T21:30:43.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ebb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:43.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ebb7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:43.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ebb7fe640 10 monclient: dump: 2026-02-17T21:30:43.759 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:43.759 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:43.760 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.760 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.760 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:43.760 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:43.760 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:43.760 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:43.760 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:43.760 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:43.760 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ebb7fe640 10 monclient: _finish_auth 0 2026-02-17T21:30:43.760 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ebb7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:30:43.760 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ebb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:43.760 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ebb7fe640 1 -- 10.20.193.5:0/1476041617 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ed0018070 con 0x7f6edc1471e0 2026-02-17T21:30:43.760 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ee172c640 5 monclient: authenticate success, global_id 5180 2026-02-17T21:30:43.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ee172c640 10 monclient: _renew_subs 2026-02-17T21:30:43.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ee172c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:43.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ee172c640 1 -- 10.20.193.5:0/1476041617 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6edc148980 con 0x7f6edc1471e0 2026-02-17T21:30:43.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ebb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:43.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ebb7fe640 1 -- 10.20.193.5:0/1476041617 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed000fb50 con 0x7f6edc1471e0 2026-02-17T21:30:43.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ebb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:43.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ebb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:43.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ebb7fe640 10 monclient: dump: 2026-02-17T21:30:43.761 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:43.761 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:43.761 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.761 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:43.761 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:43.761 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:43.762 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:43.762 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:43.762 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:43.762 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:43.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ed97fa640 4 set_mon_vals no callback set 2026-02-17T21:30:43.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ee172c640 10 client.5180.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:43.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ee172c640 10 monclient: _renew_subs 2026-02-17T21:30:43.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ee172c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:43.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ee172c640 1 -- 10.20.193.5:0/1476041617 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6edc1577b0 con 0x7f6edc1471e0 2026-02-17T21:30:43.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ee172c640 1 librados: init done 2026-02-17T21:30:43.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ee172c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:43.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ee172c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:43.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ee172c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:43.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.739+0000 7f6ee172c640 1 -- 10.20.193.5:0/1476041617 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6edc1593f0 con 0x7f6edc1471e0 2026-02-17T21:30:43.762 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.751+0000 7f6ebb7fe640 1 -- 10.20.193.5:0/1476041617 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f6ed000fcf0 con 0x7f6edc1471e0 2026-02-17T21:30:43.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.751+0000 7f6ebb7fe640 1 --2- 10.20.193.5:0/1476041617 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6ea80792b0 0x7f6ea807b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:43.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.751+0000 7f6eda7fc640 1 --2- 10.20.193.5:0/1476041617 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6ea80792b0 0x7f6ea807b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:43.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.751+0000 7f6eda7fc640 10 monclient: get_auth_request con 0x7f6ea80792b0 auth_method 0 2026-02-17T21:30:43.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.752+0000 7f6ebb7fe640 10 client.5180.objecter ms_handle_connect 0x7f6ea80792b0 2026-02-17T21:30:43.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.752+0000 7f6ebb7fe640 1 -- 10.20.193.5:0/1476041617 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f6ed005e600 con 0x7f6edc1471e0 2026-02-17T21:30:43.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.752+0000 7f6eda7fc640 1 --2- 10.20.193.5:0/1476041617 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6ea80792b0 0x7f6ea807b770 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6edc156560 tx=0x7f6ec4005040 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:43.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.752+0000 7f6ebb7fe640 10 client.5180.objecter ms_dispatch2 0x7f6edc000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:43.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.752+0000 7f6ebb7fe640 3 client.5180.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:43.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.752+0000 7f6ebb7fe640 3 client.5180.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:43.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.752+0000 7f6ebb7fe640 20 client.5180.objecter dump_active .. 0 homeless 2026-02-17T21:30:43.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.853+0000 7f6ebb7fe640 1 -- 10.20.193.5:0/1476041617 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6ed0062cc0 con 0x7f6edc1471e0 2026-02-17T21:30:43.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.853+0000 7f6ebb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:43.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.853+0000 7f6ebb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:43.937 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.935+0000 7f6ee172c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:30:43.937 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.935+0000 7f6ee172c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:30:43.937 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.935+0000 7f6ee172c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:43.937 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.935+0000 7f6ee172c640 1 -- 10.20.193.5:0/1476041617 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6edc14a9a0 con 0x7f6edc1471e0 2026-02-17T21:30:43.955 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.954+0000 7f6ebb7fe640 1 -- 10.20.193.5:0/1476041617 <== mon.2 v2:10.20.193.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+24676 (secure 0 0 0) 0x7f6ed00625c0 con 0x7f6edc1471e0 2026-02-17T21:30:43.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.954+0000 7f6ebb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:30:43.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.954+0000 7f6ebb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:30:43.956 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:30:43.956 INFO:teuthology.orchestra.run.trial005.stdout:{"epoch":35,"fsid":"b1be373b-56c5-4b5b-a965-9bcc20042691","created":"2026-02-17T21:23:38.622021+0000","modified":"2026-02-17T21:25:42.279045+0000","last_up_change":"2026-02-17T21:25:25.434771+0000","last_in_change":"2026-02-17T21:23:44.366223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T21:25:19.677742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T21:25:30.292349+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":34,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.0199999809265137,"score_stable":4.0199999809265137,"optimal_score":0.56000000238418579,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8bffc5e9-1f92-4603-bf29-ce19225edc1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6808","nonce":3662168592},{"type":"v1","addr":"10.20.193.5:6809","nonce":3662168592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6810","nonce":3662168592},{"type":"v1","addr":"10.20.193.5:6811","nonce":3662168592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6814","nonce":3662168592},{"type":"v1","addr":"10.20.193.5:6815","nonce":3662168592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6812","nonce":3662168592},{"type":"v1","addr":"10.20.193.5:6813","nonce":3662168592}]},"public_addr":"10.20.193.5:6809/3662168592","cluster_addr":"10.20.193.5:6811/3662168592","heartbeat_back_addr":"10.20.193.5:6815/3662168592","heartbeat_front_addr":"10.20.193.5:6813/3662168592","state":["exists","up"]},{"osd":1,"uuid":"8ffdf919-2ec4-4c1f-a69f-aee5cea211e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6800","nonce":267553149},{"type":"v1","addr":"10.20.193.119:6801","nonce":267553149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6802","nonce":267553149},{"type":"v1","addr":"10.20.193.119:6803","nonce":267553149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6806","nonce":267553149},{"type":"v1","addr":"10.20.193.119:6807","nonce":267553149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6804","nonce":267553149},{"type":"v1","addr":"10.20.193.119:6805","nonce":267553149}]},"public_addr":"10.20.193.119:6801/267553149","cluster_addr":"10.20.193.119:6803/267553149","heartbeat_back_addr":"10.20.193.119:6807/267553149","heartbeat_front_addr":"10.20.193.119:6805/267553149","state":["exists","up"]},{"osd":2,"uuid":"d186244a-4bf7-416d-b6a0-0e0f5af50eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6824","nonce":692096764},{"type":"v1","addr":"10.20.193.135:6825","nonce":692096764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6826","nonce":692096764},{"type":"v1","addr":"10.20.193.135:6827","nonce":692096764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6830","nonce":692096764},{"type":"v1","addr":"10.20.193.135:6831","nonce":692096764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6828","nonce":692096764},{"type":"v1","addr":"10.20.193.135:6829","nonce":692096764}]},"public_addr":"10.20.193.135:6825/692096764","cluster_addr":"10.20.193.135:6827/692096764","heartbeat_back_addr":"10.20.193.135:6831/692096764","heartbeat_front_addr":"10.20.193.135:6829/692096764","state":["exists","up"]},{"osd":3,"uuid":"093b417e-53bf-4b60-a937-7c5ffee43e1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6818","nonce":1862950168},{"type":"v1","addr":"10.20.193.176:6819","nonce":1862950168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6820","nonce":1862950168},{"type":"v1","addr":"10.20.193.176:6821","nonce":1862950168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6824","nonce":1862950168},{"type":"v1","addr":"10.20.193.176:6825","nonce":1862950168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6822","nonce":1862950168},{"type":"v1","addr":"10.20.193.176:6823","nonce":1862950168}]},"public_addr":"10.20.193.176:6819/1862950168","cluster_addr":"10.20.193.176:6821/1862950168","heartbeat_back_addr":"10.20.193.176:6825/1862950168","heartbeat_front_addr":"10.20.193.176:6823/1862950168","state":["exists","up"]},{"osd":4,"uuid":"0a48e684-05b0-41b1-a553-022424011225","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6800","nonce":234574736},{"type":"v1","addr":"10.20.193.5:6801","nonce":234574736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6802","nonce":234574736},{"type":"v1","addr":"10.20.193.5:6803","nonce":234574736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6806","nonce":234574736},{"type":"v1","addr":"10.20.193.5:6807","nonce":234574736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6804","nonce":234574736},{"type":"v1","addr":"10.20.193.5:6805","nonce":234574736}]},"public_addr":"10.20.193.5:6801/234574736","cluster_addr":"10.20.193.5:6803/234574736","heartbeat_back_addr":"10.20.193.5:6807/234574736","heartbeat_front_addr":"10.20.193.5:6805/234574736","state":["exists","up"]},{"osd":5,"uuid":"d73b7c38-cef9-4993-b353-908c1d87603c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6818","nonce":4010664603},{"type":"v1","addr":"10.20.193.119:6820","nonce":4010664603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6824","nonce":4010664603},{"type":"v1","addr":"10.20.193.119:6825","nonce":4010664603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6830","nonce":4010664603},{"type":"v1","addr":"10.20.193.119:6831","nonce":4010664603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6828","nonce":4010664603},{"type":"v1","addr":"10.20.193.119:6829","nonce":4010664603}]},"public_addr":"10.20.193.119:6820/4010664603","cluster_addr":"10.20.193.119:6825/4010664603","heartbeat_back_addr":"10.20.193.119:6831/4010664603","heartbeat_front_addr":"10.20.193.119:6829/4010664603","state":["exists","up"]},{"osd":6,"uuid":"f7774c25-72e8-41b2-8634-517af7a213b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6808","nonce":1853988335},{"type":"v1","addr":"10.20.193.135:6809","nonce":1853988335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6810","nonce":1853988335},{"type":"v1","addr":"10.20.193.135:6811","nonce":1853988335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6814","nonce":1853988335},{"type":"v1","addr":"10.20.193.135:6815","nonce":1853988335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6812","nonce":1853988335},{"type":"v1","addr":"10.20.193.135:6813","nonce":1853988335}]},"public_addr":"10.20.193.135:6809/1853988335","cluster_addr":"10.20.193.135:6811/1853988335","heartbeat_back_addr":"10.20.193.135:6815/1853988335","heartbeat_front_addr":"10.20.193.135:6813/1853988335","state":["exists","up"]},{"osd":7,"uuid":"30a68802-afce-499b-90ce-bd568bc69406","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6826","nonce":1604873931},{"type":"v1","addr":"10.20.193.176:6827","nonce":1604873931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6828","nonce":1604873931},{"type":"v1","addr":"10.20.193.176:6829","nonce":1604873931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6832","nonce":1604873931},{"type":"v1","addr":"10.20.193.176:6833","nonce":1604873931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6830","nonce":1604873931},{"type":"v1","addr":"10.20.193.176:6831","nonce":1604873931}]},"public_addr":"10.20.193.176:6827/1604873931","cluster_addr":"10.20.193.176:6829/1604873931","heartbeat_back_addr":"10.20.193.176:6833/1604873931","heartbeat_front_addr":"10.20.193.176:6831/1604873931","state":["exists","up"]},{"osd":8,"uuid":"8b4a2001-3ac8-4756-9dcf-af38c6d12d44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6816","nonce":1609723815},{"type":"v1","addr":"10.20.193.5:6817","nonce":1609723815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6820","nonce":1609723815},{"type":"v1","addr":"10.20.193.5:6821","nonce":1609723815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6826","nonce":1609723815},{"type":"v1","addr":"10.20.193.5:6828","nonce":1609723815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6822","nonce":1609723815},{"type":"v1","addr":"10.20.193.5:6824","nonce":1609723815}]},"public_addr":"10.20.193.5:6817/1609723815","cluster_addr":"10.20.193.5:6821/1609723815","heartbeat_back_addr":"10.20.193.5:6828/1609723815","heartbeat_front_addr":"10.20.193.5:6824/1609723815","state":["exists","up"]},{"osd":9,"uuid":"dfdfee67-eff6-4413-bd7a-adc0a019bfbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6816","nonce":576833933},{"type":"v1","addr":"10.20.193.119:6817","nonce":576833933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6819","nonce":576833933},{"type":"v1","addr":"10.20.193.119:6821","nonce":576833933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6826","nonce":576833933},{"type":"v1","addr":"10.20.193.119:6827","nonce":576833933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6822","nonce":576833933},{"type":"v1","addr":"10.20.193.119:6823","nonce":576833933}]},"public_addr":"10.20.193.119:6817/576833933","cluster_addr":"10.20.193.119:6821/576833933","heartbeat_back_addr":"10.20.193.119:6827/576833933","heartbeat_front_addr":"10.20.193.119:6823/576833933","state":["exists","up"]},{"osd":10,"uuid":"fc24ee77-5a0d-41d4-88f5-8d03a77c7608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6800","nonce":3469915965},{"type":"v1","addr":"10.20.193.135:6801","nonce":3469915965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6802","nonce":3469915965},{"type":"v1","addr":"10.20.193.135:6803","nonce":3469915965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6806","nonce":3469915965},{"type":"v1","addr":"10.20.193.135:6807","nonce":3469915965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6804","nonce":3469915965},{"type":"v1","addr":"10.20.193.135:6805","nonce":3469915965}]},"public_addr":"10.20.193.135:6801/3469915965","cluster_addr":"10.20.193.135:6803/3469915965","heartbeat_back_addr":"10.20.193.135:6807/3469915965","heartbeat_front_addr":"10.20.193.135:6805/3469915965","state":["exists","up"]},{"osd":11,"uuid":"1d737681-1923-453a-82f8-516eeb875559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6802","nonce":3067818664},{"type":"v1","addr":"10.20.193.176:6803","nonce":3067818664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6804","nonce":3067818664},{"type":"v1","addr":"10.20.193.176:6805","nonce":3067818664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6808","nonce":3067818664},{"type":"v1","addr":"10.20.193.176:6809","nonce":3067818664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6806","nonce":3067818664},{"type":"v1","addr":"10.20.193.176:6807","nonce":3067818664}]},"public_addr":"10.20.193.176:6803/3067818664","cluster_addr":"10.20.193.176:6805/3067818664","heartbeat_back_addr":"10.20.193.176:6809/3067818664","heartbeat_front_addr":"10.20.193.176:6807/3067818664","state":["exists","up"]},{"osd":12,"uuid":"c4f0322e-a862-4c5e-967e-4551087ede8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6818","nonce":2028057944},{"type":"v1","addr":"10.20.193.5:6819","nonce":2028057944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6823","nonce":2028057944},{"type":"v1","addr":"10.20.193.5:6825","nonce":2028057944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6830","nonce":2028057944},{"type":"v1","addr":"10.20.193.5:6831","nonce":2028057944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.5:6827","nonce":2028057944},{"type":"v1","addr":"10.20.193.5:6829","nonce":2028057944}]},"public_addr":"10.20.193.5:6819/2028057944","cluster_addr":"10.20.193.5:6825/2028057944","heartbeat_back_addr":"10.20.193.5:6831/2028057944","heartbeat_front_addr":"10.20.193.5:6829/2028057944","state":["exists","up"]},{"osd":13,"uuid":"0b5e9861-a194-4f11-a849-d8bb94ce95a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6808","nonce":1303925174},{"type":"v1","addr":"10.20.193.119:6809","nonce":1303925174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6810","nonce":1303925174},{"type":"v1","addr":"10.20.193.119:6811","nonce":1303925174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6814","nonce":1303925174},{"type":"v1","addr":"10.20.193.119:6815","nonce":1303925174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6812","nonce":1303925174},{"type":"v1","addr":"10.20.193.119:6813","nonce":1303925174}]},"public_addr":"10.20.193.119:6809/1303925174","cluster_addr":"10.20.193.119:6811/1303925174","heartbeat_back_addr":"10.20.193.119:6815/1303925174","heartbeat_front_addr":"10.20.193.119:6813/1303925174","state":["exists","up"]},{"osd":14,"uuid":"6f182077-0c0d-481c-97b4-43ef48aa5aea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6816","nonce":1552304264},{"type":"v1","addr":"10.20.193.135:6817","nonce":1552304264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6818","nonce":1552304264},{"type":"v1","addr":"10.20.193.135:6819","nonce":1552304264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6822","nonce":1552304264},{"type":"v1","addr":"10.20.193.135:6823","nonce":1552304264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.135:6820","nonce":1552304264},{"type":"v1","addr":"10.20.193.135:6821","nonce":1552304264}]},"public_addr":"10.20.193.135:6817/1552304264","cluster_addr":"10.20.193.135:6819/1552304264","heartbeat_back_addr":"10.20.193.135:6823/1552304264","heartbeat_front_addr":"10.20.193.135:6821/1552304264","state":["exists","up"]},{"osd":15,"uuid":"537605ff-bedd-4f2b-922f-e2eaa8c17f48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6810","nonce":1976318959},{"type":"v1","addr":"10.20.193.176:6811","nonce":1976318959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6812","nonce":1976318959},{"type":"v1","addr":"10.20.193.176:6813","nonce":1976318959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6816","nonce":1976318959},{"type":"v1","addr":"10.20.193.176:6817","nonce":1976318959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6814","nonce":1976318959},{"type":"v1","addr":"10.20.193.176:6815","nonce":1976318959}]},"public_addr":"10.20.193.176:6811/1976318959","cluster_addr":"10.20.193.176:6813/1976318959","heartbeat_back_addr":"10.20.193.176:6817/1976318959","heartbeat_front_addr":"10.20.193.176:6815/1976318959","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.964722+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:16.831330+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:19.360415+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.257999+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:19.239391+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:16.741791+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.466814+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.473911+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:19.537915+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:17.261755+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:19.188280+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.075749+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:19.610371+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:16.923597+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:19.117422+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:25:18.626513+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:30:43.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.954+0000 7f6ee172c640 10 librados: watch_flush enter 2026-02-17T21:30:43.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.954+0000 7f6ee172c640 10 librados: watch_flush exit 2026-02-17T21:30:43.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.954+0000 7f6ee172c640 20 client.5180.objecter shutdown clearing up homeless session... 2026-02-17T21:30:43.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.954+0000 7f6ee172c640 10 client.5180.objecter successfully canceled tick 2026-02-17T21:30:43.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.954+0000 7f6ee172c640 1 -- 10.20.193.5:0/1476041617 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6ea80792b0 msgr2=0x7f6ea807b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:43.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.954+0000 7f6ee172c640 1 --2- 10.20.193.5:0/1476041617 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6ea80792b0 0x7f6ea807b770 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6edc156560 tx=0x7f6ec4005040 comp rx=0 tx=0).stop 2026-02-17T21:30:43.958 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.954+0000 7f6ee172c640 10 monclient: shutdown 2026-02-17T21:30:43.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.954+0000 7f6ee172c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:43.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.954+0000 7f6ee172c640 1 -- 10.20.193.5:0/1476041617 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6edc1471e0 msgr2=0x7f6edc158290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:43.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.954+0000 7f6ee172c640 1 --2- 10.20.193.5:0/1476041617 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6edc1471e0 0x7f6edc158290 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0007140 tx=0x7f6ed0007610 comp rx=0 tx=0).stop 2026-02-17T21:30:43.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.954+0000 7f6ee172c640 1 -- 10.20.193.5:0/1476041617 shutdown_connections 2026-02-17T21:30:43.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.954+0000 7f6ee172c640 1 --2- 10.20.193.5:0/1476041617 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6ea80792b0 0x7f6ea807b770 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.954+0000 7f6ee172c640 1 --2- 10.20.193.5:0/1476041617 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6edc0be9d0 0x7f6edc0c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.954+0000 7f6ee172c640 1 --2- 10.20.193.5:0/1476041617 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6edc1475c0 0x7f6edc149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.954+0000 7f6ee172c640 1 --2- 10.20.193.5:0/1476041617 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6edc1471e0 0x7f6edc158290 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:43.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.954+0000 7f6ee172c640 1 -- 10.20.193.5:0/1476041617 >> 10.20.193.5:0/1476041617 conn(0x7f6edc0c9f40 msgr2=0x7f6edc14bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:43.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.954+0000 7f6ee172c640 1 -- 10.20.193.5:0/1476041617 shutdown_connections 2026-02-17T21:30:43.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.954+0000 7f6ee172c640 1 -- 10.20.193.5:0/1476041617 wait complete. 2026-02-17T21:30:43.959 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:43.954+0000 7f6ee172c640 1 librados: shutdown 2026-02-17T21:30:44.967 INFO:tasks.ceph:Scrubbing osd.0 2026-02-17T21:30:44.967 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:30:45.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.034+0000 7fdfdbe15640 10 monclient: get_monmap_and_config 2026-02-17T21:30:45.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.034+0000 7fdfdbe15640 10 monclient: build_initial_monmap 2026-02-17T21:30:45.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.034+0000 7fdfdbe15640 10 monclient: monmap: 2026-02-17T21:30:45.037 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:45.037 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.037 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:45.036109+0000 2026-02-17T21:30:45.037 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:45.036109+0000 2026-02-17T21:30:45.037 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:45.037 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.037 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:45.038 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:45.038 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:45.038 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:45.038 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:45.038 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:45.038 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.034+0000 7fdfdbe15640 1 Processor -- start 2026-02-17T21:30:45.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.034+0000 7fdfdbe15640 1 -- start start 2026-02-17T21:30:45.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.034+0000 7fdfdbe15640 10 monclient: init 2026-02-17T21:30:45.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.035+0000 7fdfdbe15640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:45.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.035+0000 7fdfdbe15640 10 monclient: _add_conns ranks=[5,0,2,3,1,4] 2026-02-17T21:30:45.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.035+0000 7fdfdbe15640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fdfd415d3c0 0x7fdfd415d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.035+0000 7fdfdbe15640 10 monclient(hunting): picked mon.noname-c con 0x7fdfd415d3c0 addr v2:10.20.193.135:3300/0 2026-02-17T21:30:45.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.035+0000 7fdfdbe15640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdfd40c94c0 addr v1:10.20.193.5:6789/0 2026-02-17T21:30:45.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.035+0000 7fdfdbe15640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fdfd415b050 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:45.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.035+0000 7fdfdbe15640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfd415b4a0 con 0x7fdfd40c94c0 2026-02-17T21:30:45.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.035+0000 7fdfdbe15640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfd40c7e60 con 0x7fdfd415b050 2026-02-17T21:30:45.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.035+0000 7fdfdbe15640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.035+0000 7fdfdbe15640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fdfd40c8140 con 0x7fdfd415d3c0 2026-02-17T21:30:45.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.035+0000 7fdfdbe15640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:45.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.035+0000 7fdfdbe15640 10 monclient(hunting): authenticate will time out at 1350.601500s 2026-02-17T21:30:45.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.035+0000 7fdfd9b8a640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fdfd415d3c0 0x7fdfd415d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.035+0000 7fdfd9389640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7fdfd40c94c0 0x7fdfd40c7300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:34528/0 (socket says 10.20.193.5:34528) 2026-02-17T21:30:45.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.035+0000 7fdfd9389640 1 -- 10.20.193.5:0/2893094325 learned_addr learned my addr 10.20.193.5:0/2893094325 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:45.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.036+0000 7fdfd9b8a640 10 monclient(hunting): get_auth_request con 0x7fdfd415d3c0 auth_method 0 2026-02-17T21:30:45.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.036+0000 7fdfd9b8a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:45.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.036+0000 7fdfd9b8a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.036+0000 7fdfd9b8a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.036+0000 7fdfd9b8a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:45.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.036+0000 7fdfd9b8a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:45.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.036+0000 7fdfd9b8a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:45.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.037+0000 7fdfd8b88640 1 -- 10.20.193.5:0/2893094325 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4184559471 0 0) 0x7fdfd415b4a0 con 0x7fdfd40c94c0 2026-02-17T21:30:45.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.037+0000 7fdfd8b88640 10 monclient(hunting): _negotiate 2026-02-17T21:30:45.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.037+0000 7fdfd8b88640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.037+0000 7fdfd8b88640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.037+0000 7fdfd8b88640 10 monclient(hunting): my global_id is 5118 2026-02-17T21:30:45.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.037+0000 7fdfd8b88640 1 -- 10.20.193.5:0/2893094325 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfbc003620 con 0x7fdfd40c94c0 2026-02-17T21:30:45.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.037+0000 7fdfd9b8a640 10 monclient(hunting): handle_auth_done global_id 5183 payload 274 2026-02-17T21:30:45.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.037+0000 7fdfd9b8a640 1 -- 10.20.193.5:0/2893094325 >> v1:10.20.193.135:6789/0 conn(0x7fdfd415b050 legacy=0x7fdfd40c52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.037+0000 7fdfd9b8a640 1 -- 10.20.193.5:0/2893094325 >> v1:10.20.193.5:6789/0 conn(0x7fdfd40c94c0 legacy=0x7fdfd40c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.037+0000 7fdfd9b8a640 10 monclient: _finish_hunting 0 2026-02-17T21:30:45.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.037+0000 7fdfd9b8a640 1 monclient: found mon.noname-c 2026-02-17T21:30:45.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.037+0000 7fdfd9b8a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:45.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.037+0000 7fdfd9b8a640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:45.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.037+0000 7fdfd9b8a640 1 -- 10.20.193.5:0/2893094325 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfd40c8420 con 0x7fdfd415d3c0 2026-02-17T21:30:45.049 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.040+0000 7fdfd9b8a640 1 --2- 10.20.193.5:0/2893094325 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fdfd415d3c0 0x7fdfd415d7a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40098a0 tx=0x7fdfc402ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93179ace190c8bf8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:45.050 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.041+0000 7fdfd8b88640 1 -- 10.20.193.5:0/2893094325 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc403c070 con 0x7fdfd415d3c0 2026-02-17T21:30:45.050 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.041+0000 7fdfd8b88640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:45.050 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.041+0000 7fdfd8b88640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:45.050 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.041+0000 7fdfd8b88640 10 monclient: dump: 2026-02-17T21:30:45.050 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:45.050 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.050 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.050 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.050 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:45.050 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.051 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:45.051 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:45.051 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:45.051 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.051 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.041+0000 7fdfd8b88640 10 monclient: _finish_auth 0 2026-02-17T21:30:45.051 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.041+0000 7fdfd8b88640 10 monclient: _check_auth_tickets 2026-02-17T21:30:45.051 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.041+0000 7fdfd8b88640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:45.051 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.041+0000 7fdfdbe15640 5 monclient: authenticate success, global_id 5183 2026-02-17T21:30:45.051 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.041+0000 7fdfdbe15640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:45.051 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.042+0000 7fdfd8b88640 1 -- 10.20.193.5:0/2893094325 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfc402fca0 con 0x7fdfd415d3c0 2026-02-17T21:30:45.051 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.042+0000 7fdfd8b88640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:45.052 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.042+0000 7fdfd8b88640 1 -- 10.20.193.5:0/2893094325 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4037640 con 0x7fdfd415d3c0 2026-02-17T21:30:45.052 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.042+0000 7fdfd8b88640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:45.052 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.042+0000 7fdfd8b88640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:45.052 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.042+0000 7fdfd8b88640 10 monclient: dump: 2026-02-17T21:30:45.052 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:45.052 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.052 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.052 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.052 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:45.052 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.052 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:45.052 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:45.053 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:45.053 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.042+0000 7fdfdbe15640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:45.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.042+0000 7fdfdbe15640 4 set_mon_vals no callback set 2026-02-17T21:30:45.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.042+0000 7fdfdbe15640 10 monclient: shutdown 2026-02-17T21:30:45.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.042+0000 7fdfdbe15640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:45.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.042+0000 7fdfdbe15640 1 -- 10.20.193.5:0/2893094325 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fdfd415d3c0 msgr2=0x7fdfd415d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.042+0000 7fdfdbe15640 1 --2- 10.20.193.5:0/2893094325 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fdfd415d3c0 0x7fdfd415d7a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40098a0 tx=0x7fdfc402ef90 comp rx=0 tx=0).stop 2026-02-17T21:30:45.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.042+0000 7fdfdbe15640 1 -- 10.20.193.5:0/2893094325 shutdown_connections 2026-02-17T21:30:45.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.042+0000 7fdfdbe15640 1 --2- 10.20.193.5:0/2893094325 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fdfd415d3c0 0x7fdfd415d7a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.042+0000 7fdfdbe15640 1 -- 10.20.193.5:0/2893094325 >> 10.20.193.5:0/2893094325 conn(0x7fdfd40c9f60 msgr2=0x7fdfd40ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:45.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.042+0000 7fdfdbe15640 1 -- 10.20.193.5:0/2893094325 shutdown_connections 2026-02-17T21:30:45.054 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.042+0000 7fdfdbe15640 1 -- 10.20.193.5:0/2893094325 wait complete. 2026-02-17T21:30:45.054 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.042+0000 7fdfdbe15640 10 monclient: build_initial_monmap 2026-02-17T21:30:45.054 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.042+0000 7fdfdbe15640 10 monclient: monmap: 2026-02-17T21:30:45.054 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:45.054 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:45.054 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:45.054 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:45.054 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:45.054 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.054 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:45.054 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:45.054 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:45.055 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.055 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.043+0000 7fdfdbe15640 1 librados: starting msgr at 2026-02-17T21:30:45.055 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.043+0000 7fdfdbe15640 1 librados: starting objecter 2026-02-17T21:30:45.055 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.043+0000 7fdfdbe15640 1 Processor -- start 2026-02-17T21:30:45.055 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.043+0000 7fdfdbe15640 1 -- start start 2026-02-17T21:30:45.055 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.043+0000 7fdfdbe15640 1 librados: setting wanted keys 2026-02-17T21:30:45.055 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.043+0000 7fdfdbe15640 1 librados: calling monclient init 2026-02-17T21:30:45.055 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.043+0000 7fdfdbe15640 10 monclient: init 2026-02-17T21:30:45.055 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.043+0000 7fdfdbe15640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:45.055 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.043+0000 7fdfdbe15640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:30:45.055 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.043+0000 7fdfdbe15640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fdfd40c94c0 0x7fdfd41f7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.055 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.043+0000 7fdfdbe15640 10 monclient(hunting): picked mon.noname-a con 0x7fdfd40c94c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:45.055 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.043+0000 7fdfdbe15640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdfd415b050 0x7fdfd4155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.056 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.043+0000 7fdfdbe15640 10 monclient(hunting): picked mon.noname-b con 0x7fdfd415b050 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:45.056 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.043+0000 7fdfdbe15640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fdfd415d3c0 0x7fdfd4147b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.056 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.043+0000 7fdfdbe15640 10 monclient(hunting): picked mon.noname-c con 0x7fdfd415d3c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:45.056 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.043+0000 7fdfdbe15640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.056 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.043+0000 7fdfdbe15640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd40c8cc0 con 0x7fdfd40c94c0 2026-02-17T21:30:45.056 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.043+0000 7fdfdbe15640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.056 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.043+0000 7fdfdbe15640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd40c89e0 con 0x7fdfd415b050 2026-02-17T21:30:45.056 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.043+0000 7fdfdbe15640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.056 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.043+0000 7fdfdbe15640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd40c8fa0 con 0x7fdfd415d3c0 2026-02-17T21:30:45.056 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.043+0000 7fdfdbe15640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:45.056 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.043+0000 7fdfdbe15640 10 monclient(hunting): authenticate will time out at 1350.609620s 2026-02-17T21:30:45.056 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.043+0000 7fdfd9b8a640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fdfd40c94c0 0x7fdfd41f7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.043+0000 7fdfda38b640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fdfd415d3c0 0x7fdfd4147b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.044+0000 7fdfd9389640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdfd415b050 0x7fdfd4155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.044+0000 7fdfda38b640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fdfd415d3c0 0x7fdfd4147b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:33902/0 (socket says 10.20.193.5:33902) 2026-02-17T21:30:45.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.044+0000 7fdfda38b640 1 -- 10.20.193.5:0/2251884094 learned_addr learned my addr 10.20.193.5:0/2251884094 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:45.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.044+0000 7fdfda38b640 10 monclient(hunting): get_auth_request con 0x7fdfd415d3c0 auth_method 0 2026-02-17T21:30:45.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.044+0000 7fdfda38b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:45.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.044+0000 7fdfda38b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.044+0000 7fdfda38b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.044+0000 7fdfd9b8a640 10 monclient(hunting): get_auth_request con 0x7fdfd40c94c0 auth_method 0 2026-02-17T21:30:45.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.044+0000 7fdfd9b8a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:45.057 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.044+0000 7fdfd9b8a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.044+0000 7fdfd9b8a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.044+0000 7fdfd9389640 10 monclient(hunting): get_auth_request con 0x7fdfd415b050 auth_method 0 2026-02-17T21:30:45.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.044+0000 7fdfd9389640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:45.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.044+0000 7fdfd9389640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.044+0000 7fdfd9389640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.044+0000 7fdfda38b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:45.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.044+0000 7fdfda38b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:45.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.044+0000 7fdfda38b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:45.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.044+0000 7fdfd9b8a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:45.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.044+0000 7fdfd9b8a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:45.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.044+0000 7fdfd9b8a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:45.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.044+0000 7fdfd9389640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:45.058 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.044+0000 7fdfd9389640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:45.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.044+0000 7fdfd9389640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:45.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.045+0000 7fdfda38b640 10 monclient(hunting): handle_auth_done global_id 5189 payload 824 2026-02-17T21:30:45.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.045+0000 7fdfda38b640 1 -- 10.20.193.5:0/2251884094 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdfd415b050 msgr2=0x7fdfd4155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.045+0000 7fdfda38b640 1 --2- 10.20.193.5:0/2251884094 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdfd415b050 0x7fdfd4155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.045+0000 7fdfda38b640 1 -- 10.20.193.5:0/2251884094 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fdfd40c94c0 msgr2=0x7fdfd41f7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.045+0000 7fdfda38b640 1 --2- 10.20.193.5:0/2251884094 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fdfd40c94c0 0x7fdfd41f7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.045+0000 7fdfda38b640 10 monclient: _finish_hunting 0 2026-02-17T21:30:45.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.045+0000 7fdfda38b640 1 monclient: found mon.noname-c 2026-02-17T21:30:45.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.045+0000 7fdfda38b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:45.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.045+0000 7fdfda38b640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:45.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.045+0000 7fdfda38b640 1 -- 10.20.193.5:0/2251884094 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfd41559a0 con 0x7fdfd415d3c0 2026-02-17T21:30:45.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.046+0000 7fdfda38b640 1 --2- 10.20.193.5:0/2251884094 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fdfd415d3c0 0x7fdfd4147b40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdfd000cc80 tx=0x7fdfd000a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:45.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.046+0000 7fdfc27fc640 10 client.?.objecter ms_handle_connect 0x7fdfd415d3c0 2026-02-17T21:30:45.060 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.046+0000 7fdfc27fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:45.061 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.048+0000 7fdfc27fc640 1 -- 10.20.193.5:0/2251884094 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0003a70 con 0x7fdfd415d3c0 2026-02-17T21:30:45.061 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.048+0000 7fdfc27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:45.062 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.048+0000 7fdfc27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:45.062 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.048+0000 7fdfc27fc640 10 monclient: dump: 2026-02-17T21:30:45.062 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:45.062 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.062 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.062 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.062 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:45.062 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.062 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:45.062 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:45.062 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:45.062 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.048+0000 7fdfc27fc640 10 monclient: _finish_auth 0 2026-02-17T21:30:45.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.048+0000 7fdfc27fc640 10 monclient: _check_auth_tickets 2026-02-17T21:30:45.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.048+0000 7fdfc27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:45.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.048+0000 7fdfc27fc640 1 -- 10.20.193.5:0/2251884094 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfd0003c10 con 0x7fdfd415d3c0 2026-02-17T21:30:45.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.048+0000 7fdfdbe15640 5 monclient: authenticate success, global_id 5189 2026-02-17T21:30:45.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.048+0000 7fdfdbe15640 10 monclient: _renew_subs 2026-02-17T21:30:45.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.048+0000 7fdfdbe15640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:45.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.048+0000 7fdfdbe15640 1 -- 10.20.193.5:0/2251884094 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfd4148080 con 0x7fdfd415d3c0 2026-02-17T21:30:45.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.048+0000 7fdfc27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:45.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.048+0000 7fdfc27fc640 1 -- 10.20.193.5:0/2251884094 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd00050d0 con 0x7fdfd415d3c0 2026-02-17T21:30:45.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.048+0000 7fdfc27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:45.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.048+0000 7fdfc27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:45.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.048+0000 7fdfc3fff640 4 set_mon_vals no callback set 2026-02-17T21:30:45.064 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.048+0000 7fdfc27fc640 10 monclient: dump: 2026-02-17T21:30:45.064 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:45.064 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.064 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.064 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.064 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:45.064 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.064 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:45.064 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:45.065 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:45.065 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.048+0000 7fdfdbe15640 10 client.5189.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:45.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.048+0000 7fdfdbe15640 10 monclient: _renew_subs 2026-02-17T21:30:45.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.048+0000 7fdfdbe15640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:45.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.048+0000 7fdfdbe15640 1 -- 10.20.193.5:0/2251884094 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfd41546a0 con 0x7fdfd415d3c0 2026-02-17T21:30:45.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.048+0000 7fdfdbe15640 1 librados: init done 2026-02-17T21:30:45.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.049+0000 7fdfdbe15640 10 client.5189.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:45.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.049+0000 7fdfdbe15640 15 client.5189.objecter _session_command_op_assign -1 1 2026-02-17T21:30:45.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.049+0000 7fdfdbe15640 20 client.5189.objecter _get_session osd=-1 returning homeless 2026-02-17T21:30:45.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.049+0000 7fdfdbe15640 10 client.5189.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:45.065 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.049+0000 7fdfdbe15640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:45.066 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.049+0000 7fdfdbe15640 1 -- 10.20.193.5:0/2251884094 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdfd4154450 con 0x7fdfd415d3c0 2026-02-17T21:30:45.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.060+0000 7fdfc27fc640 1 -- 10.20.193.5:0/2251884094 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fdfd0005270 con 0x7fdfd415d3c0 2026-02-17T21:30:45.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.061+0000 7fdfc27fc640 1 --2- 10.20.193.5:0/2251884094 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fdfa40792d0 0x7fdfa407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.061+0000 7fdfd9b8a640 1 --2- 10.20.193.5:0/2251884094 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fdfa40792d0 0x7fdfa407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.061+0000 7fdfd9b8a640 10 monclient: get_auth_request con 0x7fdfa40792d0 auth_method 0 2026-02-17T21:30:45.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.062+0000 7fdfd9b8a640 1 --2- 10.20.193.5:0/2251884094 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fdfa40792d0 0x7fdfa407b790 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4039000 tx=0x7fdfc4033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:45.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.062+0000 7fdfc27fc640 10 client.5189.objecter ms_handle_connect 0x7fdfa40792d0 2026-02-17T21:30:45.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.062+0000 7fdfc27fc640 1 -- 10.20.193.5:0/2251884094 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fdfd005e9f0 con 0x7fdfd415d3c0 2026-02-17T21:30:45.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.062+0000 7fdfc27fc640 10 client.5189.objecter ms_dispatch2 0x7fdfd4000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:45.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.062+0000 7fdfc27fc640 3 client.5189.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:45.068 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.062+0000 7fdfc27fc640 3 client.5189.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:45.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.062+0000 7fdfc27fc640 10 client.5189.objecter checking command 1 2026-02-17T21:30:45.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.062+0000 7fdfc27fc640 1 --2- 10.20.193.5:0/2251884094 >> [v2:10.20.193.5:6808/3662168592,v1:10.20.193.5:6809/3662168592] conn(0x7fdfa40817b0 0x7fdfa4083bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.062+0000 7fdfc27fc640 20 client.5189.objecter _get_session s=0x7fdfa40810e0 osd=0 3 2026-02-17T21:30:45.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.062+0000 7fdfc27fc640 20 client.5189.objecter put_session s=0x7fdfa40810e0 osd=0 3 2026-02-17T21:30:45.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.062+0000 7fdfc27fc640 15 client.5189.objecter _session_command_op_remove -1 1 2026-02-17T21:30:45.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.062+0000 7fdfc27fc640 20 client.5189.objecter _get_session s=0x7fdfa40810e0 osd=0 3 2026-02-17T21:30:45.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.062+0000 7fdfc27fc640 20 client.5189.objecter get_session s=0x7fdfa40810e0 osd=0 3 2026-02-17T21:30:45.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.062+0000 7fdfc27fc640 15 client.5189.objecter _session_command_op_assign 0 1 2026-02-17T21:30:45.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.062+0000 7fdfc27fc640 20 client.5189.objecter put_session s=0x7fdfa40810e0 osd=0 4 2026-02-17T21:30:45.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.062+0000 7fdfc27fc640 10 client.5189.objecter _send_command 1 2026-02-17T21:30:45.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.062+0000 7fdfc27fc640 1 -- 10.20.193.5:0/2251884094 --> [v2:10.20.193.5:6808/3662168592,v1:10.20.193.5:6809/3662168592] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdfd0013e70 con 0x7fdfa40817b0 2026-02-17T21:30:45.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.062+0000 7fdfc27fc640 20 client.5189.objecter dump_active .. 0 homeless 2026-02-17T21:30:45.069 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.063+0000 7fdfd9389640 1 --2- 10.20.193.5:0/2251884094 >> [v2:10.20.193.5:6808/3662168592,v1:10.20.193.5:6809/3662168592] conn(0x7fdfa40817b0 0x7fdfa4083bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.070 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.063+0000 7fdfd9389640 10 monclient: get_auth_request con 0x7fdfa40817b0 auth_method 0 2026-02-17T21:30:45.070 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.063+0000 7fdfc27fc640 1 -- 10.20.193.5:0/2251884094 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fdfd005edb0 con 0x7fdfd415d3c0 2026-02-17T21:30:45.070 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.063+0000 7fdfc27fc640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T21:30:45.070 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.064+0000 7fdfd9389640 1 --2- 10.20.193.5:0/2251884094 >> [v2:10.20.193.5:6808/3662168592,v1:10.20.193.5:6809/3662168592] conn(0x7fdfa40817b0 0x7fdfa4083bd0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:45.070 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.064+0000 7fdfc27fc640 10 client.5189.objecter ms_handle_connect 0x7fdfa40817b0 2026-02-17T21:30:45.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.074+0000 7fdfc27fc640 1 -- 10.20.193.5:0/2251884094 <== osd.0 v2:10.20.193.5:6808/3662168592 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fdfd0013e70 con 0x7fdfa40817b0 2026-02-17T21:30:45.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.074+0000 7fdfc27fc640 10 client.5189.objecter ms_dispatch2 0x7fdfd4000b90 command_reply(tid 1: 0 ) 2026-02-17T21:30:45.076 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.074+0000 7fdfc27fc640 10 client.5189.objecter _finish_command 1 = system:0 2026-02-17T21:30:45.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.074+0000 7fdfc27fc640 20 client.5189.objecter put_session s=0x7fdfa40810e0 osd=0 4 2026-02-17T21:30:45.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.074+0000 7fdfc27fc640 15 client.5189.objecter _session_command_op_remove 0 1 2026-02-17T21:30:45.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.080+0000 7fdfdbe15640 10 client.5189.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:30:45.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.080+0000 7fdfdbe15640 15 client.5189.objecter _session_command_op_assign -1 2 2026-02-17T21:30:45.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.080+0000 7fdfdbe15640 20 client.5189.objecter _get_session s=0x7fdfa40810e0 osd=0 3 2026-02-17T21:30:45.083 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.080+0000 7fdfdbe15640 20 client.5189.objecter put_session s=0x7fdfa40810e0 osd=0 3 2026-02-17T21:30:45.084 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.080+0000 7fdfdbe15640 20 client.5189.objecter _get_session s=0x7fdfa40810e0 osd=0 3 2026-02-17T21:30:45.084 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.081+0000 7fdfdbe15640 15 client.5189.objecter _session_command_op_remove -1 2 2026-02-17T21:30:45.084 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.081+0000 7fdfdbe15640 20 client.5189.objecter get_session s=0x7fdfa40810e0 osd=0 3 2026-02-17T21:30:45.084 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.081+0000 7fdfdbe15640 15 client.5189.objecter _session_command_op_assign 0 2 2026-02-17T21:30:45.084 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.081+0000 7fdfdbe15640 20 client.5189.objecter put_session s=0x7fdfa40810e0 osd=0 4 2026-02-17T21:30:45.084 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.081+0000 7fdfdbe15640 10 client.5189.objecter _send_command 2 2026-02-17T21:30:45.084 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.081+0000 7fdfdbe15640 1 -- 10.20.193.5:0/2251884094 --> [v2:10.20.193.5:6808/3662168592,v1:10.20.193.5:6809/3662168592] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdfd40c7b30 con 0x7fdfa40817b0 2026-02-17T21:30:45.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.087+0000 7fdfc27fc640 1 -- 10.20.193.5:0/2251884094 <== osd.0 v2:10.20.193.5:6808/3662168592 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdfd40c7b30 con 0x7fdfa40817b0 2026-02-17T21:30:45.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.087+0000 7fdfc27fc640 10 client.5189.objecter ms_dispatch2 0x7fdfd4000b90 command_reply(tid 2: 0 ) 2026-02-17T21:30:45.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.087+0000 7fdfc27fc640 10 client.5189.objecter _finish_command 2 = system:0 2026-02-17T21:30:45.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.087+0000 7fdfc27fc640 20 client.5189.objecter put_session s=0x7fdfa40810e0 osd=0 4 2026-02-17T21:30:45.090 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.087+0000 7fdfc27fc640 15 client.5189.objecter _session_command_op_remove 0 2 2026-02-17T21:30:45.090 INFO:teuthology.orchestra.run.trial005.stdout:{ 2026-02-17T21:30:45.091 INFO:teuthology.orchestra.run.trial005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:30:45.091 INFO:teuthology.orchestra.run.trial005.stdout:} 2026-02-17T21:30:45.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.087+0000 7fdfdbe15640 10 librados: watch_flush enter 2026-02-17T21:30:45.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.087+0000 7fdfdbe15640 10 librados: watch_flush exit 2026-02-17T21:30:45.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.087+0000 7fdfdbe15640 10 client.5189.objecter close_session for osd.0 2026-02-17T21:30:45.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.087+0000 7fdfdbe15640 1 -- 10.20.193.5:0/2251884094 >> [v2:10.20.193.5:6808/3662168592,v1:10.20.193.5:6809/3662168592] conn(0x7fdfa40817b0 msgr2=0x7fdfa4083bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.087+0000 7fdfdbe15640 1 --2- 10.20.193.5:0/2251884094 >> [v2:10.20.193.5:6808/3662168592,v1:10.20.193.5:6809/3662168592] conn(0x7fdfa40817b0 0x7fdfa4083bd0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.087+0000 7fdfdbe15640 20 client.5189.objecter put_session s=0x7fdfa40810e0 osd=0 1 2026-02-17T21:30:45.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.087+0000 7fdfdbe15640 20 client.5189.objecter shutdown clearing up homeless session... 2026-02-17T21:30:45.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.087+0000 7fdfdbe15640 10 client.5189.objecter successfully canceled tick 2026-02-17T21:30:45.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.087+0000 7fdfdbe15640 1 -- 10.20.193.5:0/2251884094 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fdfa40792d0 msgr2=0x7fdfa407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.087+0000 7fdfdbe15640 1 --2- 10.20.193.5:0/2251884094 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fdfa40792d0 0x7fdfa407b790 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4039000 tx=0x7fdfc4033000 comp rx=0 tx=0).stop 2026-02-17T21:30:45.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.087+0000 7fdfdbe15640 10 monclient: shutdown 2026-02-17T21:30:45.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.087+0000 7fdfdbe15640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:45.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.087+0000 7fdfdbe15640 1 -- 10.20.193.5:0/2251884094 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fdfd415d3c0 msgr2=0x7fdfd4147b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.087+0000 7fdfdbe15640 1 --2- 10.20.193.5:0/2251884094 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fdfd415d3c0 0x7fdfd4147b40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdfd000cc80 tx=0x7fdfd000a430 comp rx=0 tx=0).stop 2026-02-17T21:30:45.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.087+0000 7fdfda38b640 1 -- 10.20.193.5:0/2251884094 reap_dead start 2026-02-17T21:30:45.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.087+0000 7fdfdbe15640 1 -- 10.20.193.5:0/2251884094 shutdown_connections 2026-02-17T21:30:45.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.087+0000 7fdfdbe15640 1 -- 10.20.193.5:0/2251884094 >> 10.20.193.5:0/2251884094 conn(0x7fdfd40c9f60 msgr2=0x7fdfd40c47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:45.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.087+0000 7fdfdbe15640 1 -- 10.20.193.5:0/2251884094 shutdown_connections 2026-02-17T21:30:45.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.087+0000 7fdfdbe15640 1 -- 10.20.193.5:0/2251884094 wait complete. 2026-02-17T21:30:45.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.087+0000 7fdfdbe15640 1 librados: shutdown 2026-02-17T21:30:45.098 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-17T21:30:45.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.163+0000 7f58349bc640 10 monclient: get_monmap_and_config 2026-02-17T21:30:45.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.163+0000 7f58349bc640 10 monclient: build_initial_monmap 2026-02-17T21:30:45.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.163+0000 7f58349bc640 10 monclient: monmap: 2026-02-17T21:30:45.166 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:45.167 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.167 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:45.165307+0000 2026-02-17T21:30:45.167 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:45.165307+0000 2026-02-17T21:30:45.167 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:45.167 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.167 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:45.167 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:45.167 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:45.167 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:45.167 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:45.168 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:45.168 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.164+0000 7f58349bc640 1 Processor -- start 2026-02-17T21:30:45.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.164+0000 7f58349bc640 1 -- start start 2026-02-17T21:30:45.168 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.164+0000 7f58349bc640 10 monclient: init 2026-02-17T21:30:45.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.164+0000 7f58349bc640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:45.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.164+0000 7f58349bc640 10 monclient: _add_conns ranks=[5,1,4,2,3,0] 2026-02-17T21:30:45.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.164+0000 7f58349bc640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f582c0c7170 0x7f582c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.164+0000 7f58349bc640 10 monclient(hunting): picked mon.noname-c con 0x7f582c0c7170 addr v2:10.20.193.135:3300/0 2026-02-17T21:30:45.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.164+0000 7f58349bc640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f582c0c48c0 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:45.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.164+0000 7f58349bc640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f582c0c4d10 0x7f582c0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.164+0000 7f58349bc640 10 monclient(hunting): picked mon.noname-b con 0x7f582c0c4d10 addr v2:10.20.193.119:3300/0 2026-02-17T21:30:45.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.164+0000 7f58349bc640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f582c15a9a0 con 0x7f582c0c48c0 2026-02-17T21:30:45.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.164+0000 7f58349bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.164+0000 7f58349bc640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f582c0c8530 con 0x7f582c0c4d10 2026-02-17T21:30:45.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.164+0000 7f58349bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.164+0000 7f58349bc640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f582c0c5270 con 0x7f582c0c7170 2026-02-17T21:30:45.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.164+0000 7f58349bc640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:45.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.164+0000 7f58349bc640 10 monclient(hunting): authenticate will time out at 1350.730614s 2026-02-17T21:30:45.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.165+0000 7f5832f32640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f582c0c4d10 0x7f582c0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.165+0000 7f5832731640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f582c0c7170 0x7f582c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.165+0000 7f5832731640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f582c0c7170 0x7f582c0c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:33914/0 (socket says 10.20.193.5:33914) 2026-02-17T21:30:45.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.165+0000 7f5832731640 1 -- 10.20.193.5:0/2860868910 learned_addr learned my addr 10.20.193.5:0/2860868910 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:45.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.165+0000 7f5832731640 10 monclient(hunting): get_auth_request con 0x7f582c0c7170 auth_method 0 2026-02-17T21:30:45.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.165+0000 7f5832731640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:45.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.165+0000 7f5832731640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.165+0000 7f5832731640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.165+0000 7f5832f32640 10 monclient(hunting): get_auth_request con 0x7f582c0c4d10 auth_method 0 2026-02-17T21:30:45.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.165+0000 7f5832f32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:45.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.165+0000 7f5832f32640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.165+0000 7f5832f32640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.165+0000 7f5832731640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:45.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.165+0000 7f5832731640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:45.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.165+0000 7f5832731640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:45.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.165+0000 7f5832f32640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:45.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.165+0000 7f5832f32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:45.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.165+0000 7f5832f32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:45.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.166+0000 7f5832731640 10 monclient(hunting): handle_auth_done global_id 5192 payload 274 2026-02-17T21:30:45.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.166+0000 7f5832731640 1 -- 10.20.193.5:0/2860868910 >> v2:10.20.193.119:3300/0 conn(0x7f582c0c4d10 msgr2=0x7f582c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:45.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.166+0000 7f5832731640 1 --2- 10.20.193.5:0/2860868910 >> v2:10.20.193.119:3300/0 conn(0x7f582c0c4d10 0x7f582c0c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.166+0000 7f5832731640 1 -- 10.20.193.5:0/2860868910 >> v1:10.20.193.119:6789/0 conn(0x7f582c0c48c0 legacy=0x7f582c0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.166+0000 7f5832731640 10 monclient: _finish_hunting 0 2026-02-17T21:30:45.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.166+0000 7f5832731640 1 monclient: found mon.noname-c 2026-02-17T21:30:45.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.166+0000 7f5832731640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:45.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.166+0000 7f5832731640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:45.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.166+0000 7f5832731640 1 -- 10.20.193.5:0/2860868910 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f582c0c5550 con 0x7f582c0c7170 2026-02-17T21:30:45.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.167+0000 7f5832731640 1 --2- 10.20.193.5:0/2860868910 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f582c0c7170 0x7f582c0c7550 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f582c0723c0 tx=0x7f582402eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87c29ab0d36b5f51 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:45.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.169+0000 7f583172f640 1 -- 10.20.193.5:0/2860868910 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582403c070 con 0x7f582c0c7170 2026-02-17T21:30:45.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.169+0000 7f583172f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:45.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.169+0000 7f583172f640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:45.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.169+0000 7f583172f640 10 monclient: dump: 2026-02-17T21:30:45.181 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:45.182 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.182 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.182 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.182 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:45.182 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.182 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:45.182 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:45.182 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:45.182 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.169+0000 7f583172f640 10 monclient: _finish_auth 0 2026-02-17T21:30:45.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.169+0000 7f583172f640 10 monclient: _check_auth_tickets 2026-02-17T21:30:45.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.169+0000 7f583172f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:45.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.169+0000 7f58349bc640 5 monclient: authenticate success, global_id 5192 2026-02-17T21:30:45.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.169+0000 7f583172f640 1 -- 10.20.193.5:0/2860868910 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f582402fbe0 con 0x7f582c0c7170 2026-02-17T21:30:45.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.169+0000 7f58349bc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:45.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.169+0000 7f583172f640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:45.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.169+0000 7f583172f640 1 -- 10.20.193.5:0/2860868910 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5824037440 con 0x7f582c0c7170 2026-02-17T21:30:45.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.169+0000 7f583172f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:45.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.169+0000 7f583172f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:45.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.169+0000 7f583172f640 10 monclient: dump: 2026-02-17T21:30:45.183 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:45.183 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.183 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.183 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.184 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:45.184 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.184 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:45.184 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:45.184 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:45.184 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.169+0000 7f58349bc640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:45.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.169+0000 7f58349bc640 4 set_mon_vals no callback set 2026-02-17T21:30:45.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.170+0000 7f58349bc640 10 monclient: shutdown 2026-02-17T21:30:45.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.170+0000 7f58349bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:45.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.170+0000 7f58349bc640 1 -- 10.20.193.5:0/2860868910 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f582c0c7170 msgr2=0x7f582c0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.184 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.170+0000 7f58349bc640 1 --2- 10.20.193.5:0/2860868910 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f582c0c7170 0x7f582c0c7550 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f582c0723c0 tx=0x7f582402eed0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.170+0000 7f58349bc640 1 -- 10.20.193.5:0/2860868910 shutdown_connections 2026-02-17T21:30:45.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.170+0000 7f58349bc640 1 --2- 10.20.193.5:0/2860868910 >> v2:10.20.193.119:3300/0 conn(0x7f582c0c4d10 0x7f582c0c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.170+0000 7f58349bc640 1 --2- 10.20.193.5:0/2860868910 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f582c0c7170 0x7f582c0c7550 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.170+0000 7f58349bc640 1 -- 10.20.193.5:0/2860868910 >> 10.20.193.5:0/2860868910 conn(0x7f582c0c9f40 msgr2=0x7f582c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:45.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.170+0000 7f58349bc640 1 -- 10.20.193.5:0/2860868910 shutdown_connections 2026-02-17T21:30:45.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.170+0000 7f58349bc640 1 -- 10.20.193.5:0/2860868910 wait complete. 2026-02-17T21:30:45.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.170+0000 7f58349bc640 10 monclient: build_initial_monmap 2026-02-17T21:30:45.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.170+0000 7f58349bc640 10 monclient: monmap: 2026-02-17T21:30:45.185 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:45.185 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:45.185 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:45.185 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:45.186 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:45.186 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.186 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:45.186 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:45.186 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:45.186 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.170+0000 7f58349bc640 1 librados: starting msgr at 2026-02-17T21:30:45.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.170+0000 7f58349bc640 1 librados: starting objecter 2026-02-17T21:30:45.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.170+0000 7f58349bc640 1 Processor -- start 2026-02-17T21:30:45.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.170+0000 7f58349bc640 1 -- start start 2026-02-17T21:30:45.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.170+0000 7f58349bc640 1 librados: setting wanted keys 2026-02-17T21:30:45.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.170+0000 7f58349bc640 1 librados: calling monclient init 2026-02-17T21:30:45.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.170+0000 7f58349bc640 10 monclient: init 2026-02-17T21:30:45.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.171+0000 7f58349bc640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:45.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.171+0000 7f58349bc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:30:45.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.171+0000 7f58349bc640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f582c0c48c0 0x7f582c1f2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.171+0000 7f58349bc640 10 monclient(hunting): picked mon.noname-b con 0x7f582c0c48c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:45.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.171+0000 7f58349bc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f582c0c4d10 0x7f582c0c2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.171+0000 7f58349bc640 10 monclient(hunting): picked mon.noname-c con 0x7f582c0c4d10 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:45.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.171+0000 7f58349bc640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f582c0c7170 0x7f582c0ba300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.171+0000 7f58349bc640 10 monclient(hunting): picked mon.noname-a con 0x7f582c0c7170 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:45.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.171+0000 7f58349bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.171+0000 7f58349bc640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f582c0c81c0 con 0x7f582c0c7170 2026-02-17T21:30:45.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.171+0000 7f58349bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.171+0000 7f58349bc640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f582c0c7ee0 con 0x7f582c0c48c0 2026-02-17T21:30:45.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.171+0000 7f58349bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.171+0000 7f58349bc640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f582c0750c0 con 0x7f582c0c4d10 2026-02-17T21:30:45.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.171+0000 7f58349bc640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:45.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.171+0000 7f58349bc640 10 monclient(hunting): authenticate will time out at 1350.737413s 2026-02-17T21:30:45.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.171+0000 7f5831f30640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f582c0c4d10 0x7f582c0c2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.171+0000 7f5832731640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f582c0c48c0 0x7f582c1f2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.171+0000 7f5831f30640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f582c0c4d10 0x7f582c0c2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:33916/0 (socket says 10.20.193.5:33916) 2026-02-17T21:30:45.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.171+0000 7f5831f30640 1 -- 10.20.193.5:0/877501253 learned_addr learned my addr 10.20.193.5:0/877501253 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:45.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.171+0000 7f5831f30640 10 monclient(hunting): get_auth_request con 0x7f582c0c4d10 auth_method 0 2026-02-17T21:30:45.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.171+0000 7f5831f30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:45.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.171+0000 7f5831f30640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.188 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.171+0000 7f5831f30640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.171+0000 7f5832f32640 1 --2- 10.20.193.5:0/877501253 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f582c0c7170 0x7f582c0ba300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.172+0000 7f5832731640 10 monclient(hunting): get_auth_request con 0x7f582c0c48c0 auth_method 0 2026-02-17T21:30:45.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.172+0000 7f5832731640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:45.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.172+0000 7f5832731640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.172+0000 7f5832731640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.172+0000 7f5831f30640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:45.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.172+0000 7f5831f30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:45.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.172+0000 7f5831f30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:45.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.172+0000 7f5832f32640 10 monclient(hunting): get_auth_request con 0x7f582c0c7170 auth_method 0 2026-02-17T21:30:45.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.172+0000 7f5832f32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:45.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.172+0000 7f5832f32640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.172+0000 7f5832f32640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.172+0000 7f5832731640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:45.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.172+0000 7f5832731640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:45.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.172+0000 7f5832731640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:45.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.172+0000 7f5832f32640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:45.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.172+0000 7f5832f32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:45.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.172+0000 7f5832f32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:45.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.173+0000 7f5831f30640 10 monclient(hunting): handle_auth_done global_id 5195 payload 824 2026-02-17T21:30:45.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.173+0000 7f5831f30640 1 -- 10.20.193.5:0/877501253 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f582c0c48c0 msgr2=0x7f582c1f2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.173+0000 7f5831f30640 1 --2- 10.20.193.5:0/877501253 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f582c0c48c0 0x7f582c1f2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.173+0000 7f5831f30640 1 -- 10.20.193.5:0/877501253 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f582c0c7170 msgr2=0x7f582c0ba300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.173+0000 7f5831f30640 1 --2- 10.20.193.5:0/877501253 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f582c0c7170 0x7f582c0ba300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.173+0000 7f5831f30640 10 monclient: _finish_hunting 0 2026-02-17T21:30:45.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.173+0000 7f5831f30640 1 monclient: found mon.noname-c 2026-02-17T21:30:45.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.173+0000 7f5831f30640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:45.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.173+0000 7f5831f30640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:45.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.173+0000 7f5831f30640 1 -- 10.20.193.5:0/877501253 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f582c0badf0 con 0x7f582c0c4d10 2026-02-17T21:30:45.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.174+0000 7f5831f30640 1 --2- 10.20.193.5:0/877501253 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f582c0c4d10 0x7f582c0c2fa0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f581800c4b0 tx=0x7f581800c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:45.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.174+0000 7f5816ffd640 10 client.?.objecter ms_handle_connect 0x7f582c0c4d10 2026-02-17T21:30:45.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.174+0000 7f5816ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:45.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.175+0000 7f5816ffd640 1 -- 10.20.193.5:0/877501253 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58180052d0 con 0x7f582c0c4d10 2026-02-17T21:30:45.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.175+0000 7f5816ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:45.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.175+0000 7f5816ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:45.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.175+0000 7f5816ffd640 10 monclient: dump: 2026-02-17T21:30:45.191 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:45.191 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.192 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.192 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.192 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:45.192 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.192 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:45.192 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:45.192 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:45.192 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.175+0000 7f5816ffd640 10 monclient: _finish_auth 0 2026-02-17T21:30:45.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.175+0000 7f5816ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:30:45.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.175+0000 7f5816ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:45.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.175+0000 7f58349bc640 5 monclient: authenticate success, global_id 5195 2026-02-17T21:30:45.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.175+0000 7f58349bc640 10 monclient: _renew_subs 2026-02-17T21:30:45.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.175+0000 7f58349bc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:45.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.175+0000 7f58349bc640 1 -- 10.20.193.5:0/877501253 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f582c0bb0d0 con 0x7f582c0c4d10 2026-02-17T21:30:45.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.175+0000 7f58349bc640 10 client.5195.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:45.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.175+0000 7f58349bc640 10 monclient: _renew_subs 2026-02-17T21:30:45.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.175+0000 7f58349bc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:45.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.175+0000 7f58349bc640 1 -- 10.20.193.5:0/877501253 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f582c0bb690 con 0x7f582c0c4d10 2026-02-17T21:30:45.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.175+0000 7f58349bc640 1 librados: init done 2026-02-17T21:30:45.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.175+0000 7f58349bc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:45.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.175+0000 7f58349bc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:45.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.175+0000 7f58349bc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:45.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.175+0000 7f58349bc640 1 -- 10.20.193.5:0/877501253 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f582c0c7550 con 0x7f582c0c4d10 2026-02-17T21:30:45.283 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.282+0000 7f5816ffd640 1 -- 10.20.193.5:0/877501253 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5818005470 con 0x7f582c0c4d10 2026-02-17T21:30:45.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.282+0000 7f5816ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:45.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.282+0000 7f5816ffd640 1 -- 10.20.193.5:0/877501253 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58180038f0 con 0x7f582c0c4d10 2026-02-17T21:30:45.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.282+0000 7f5816ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:45.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.282+0000 7f5816ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:45.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.282+0000 7f5830f2e640 4 set_mon_vals no callback set 2026-02-17T21:30:45.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.282+0000 7f5816ffd640 10 monclient: dump: 2026-02-17T21:30:45.284 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:45.284 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.284 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.284 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.285 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:45.285 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.285 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:45.285 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:45.285 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:45.285 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.282+0000 7f5816ffd640 1 -- 10.20.193.5:0/877501253 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f5818003ad0 con 0x7f582c0c4d10 2026-02-17T21:30:45.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.282+0000 7f5816ffd640 1 --2- 10.20.193.5:0/877501253 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f57fc079280 0x7f57fc07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.282+0000 7f5832731640 1 --2- 10.20.193.5:0/877501253 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f57fc079280 0x7f57fc07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.283+0000 7f5832731640 10 monclient: get_auth_request con 0x7f57fc079280 auth_method 0 2026-02-17T21:30:45.286 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.283+0000 7f5816ffd640 10 client.5195.objecter ms_handle_connect 0x7f57fc079280 2026-02-17T21:30:45.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.283+0000 7f5832731640 1 --2- 10.20.193.5:0/877501253 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f57fc079280 0x7f57fc07b740 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f582c0c7a90 tx=0x7f5824039040 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:45.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.285+0000 7f5816ffd640 1 -- 10.20.193.5:0/877501253 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f581805e3a0 con 0x7f582c0c4d10 2026-02-17T21:30:45.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.285+0000 7f5816ffd640 10 client.5195.objecter ms_dispatch2 0x7f582c000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:45.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.285+0000 7f5816ffd640 3 client.5195.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:45.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.285+0000 7f5816ffd640 3 client.5195.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:45.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.285+0000 7f5816ffd640 20 client.5195.objecter dump_active .. 0 homeless 2026-02-17T21:30:45.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.290+0000 7f5816ffd640 1 -- 10.20.193.5:0/877501253 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5818062360 con 0x7f582c0c4d10 2026-02-17T21:30:45.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.290+0000 7f5816ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:45.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.290+0000 7f5816ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:45.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.372+0000 7f58349bc640 1 -- 10.20.193.5:0/877501253 --> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f582c0cae20 con 0x7f57fc079280 2026-02-17T21:30:45.375 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.373+0000 7f5816ffd640 1 -- 10.20.193.5:0/877501253 <== mgr.4131 v2:10.20.193.176:6800/2898618020 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f582c0cae20 con 0x7f57fc079280 2026-02-17T21:30:45.375 INFO:teuthology.orchestra.run.trial005.stderr:instructed osd(s) 0 to deep-scrub 2026-02-17T21:30:45.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.373+0000 7f58349bc640 10 librados: watch_flush enter 2026-02-17T21:30:45.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.373+0000 7f58349bc640 10 librados: watch_flush exit 2026-02-17T21:30:45.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.373+0000 7f58349bc640 20 client.5195.objecter shutdown clearing up homeless session... 2026-02-17T21:30:45.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.373+0000 7f58349bc640 10 client.5195.objecter successfully canceled tick 2026-02-17T21:30:45.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.373+0000 7f58349bc640 1 -- 10.20.193.5:0/877501253 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f57fc079280 msgr2=0x7f57fc07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.377 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.373+0000 7f58349bc640 1 --2- 10.20.193.5:0/877501253 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f57fc079280 0x7f57fc07b740 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f582c0c7a90 tx=0x7f5824039040 comp rx=0 tx=0).stop 2026-02-17T21:30:45.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.374+0000 7f58349bc640 10 monclient: shutdown 2026-02-17T21:30:45.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.374+0000 7f58349bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:45.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.374+0000 7f58349bc640 1 -- 10.20.193.5:0/877501253 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f582c0c4d10 msgr2=0x7f582c0c2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.374+0000 7f58349bc640 1 --2- 10.20.193.5:0/877501253 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f582c0c4d10 0x7f582c0c2fa0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f581800c4b0 tx=0x7f581800c980 comp rx=0 tx=0).stop 2026-02-17T21:30:45.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.374+0000 7f58349bc640 1 -- 10.20.193.5:0/877501253 shutdown_connections 2026-02-17T21:30:45.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.374+0000 7f58349bc640 1 --2- 10.20.193.5:0/877501253 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f57fc079280 0x7f57fc07b740 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.374+0000 7f58349bc640 1 --2- 10.20.193.5:0/877501253 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f582c0c7170 0x7f582c0ba300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.374+0000 7f58349bc640 1 --2- 10.20.193.5:0/877501253 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f582c0c4d10 0x7f582c0c2fa0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.374+0000 7f58349bc640 1 --2- 10.20.193.5:0/877501253 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f582c0c48c0 0x7f582c1f2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.374+0000 7f58349bc640 1 -- 10.20.193.5:0/877501253 >> 10.20.193.5:0/877501253 conn(0x7f582c0c9f40 msgr2=0x7f582c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:45.378 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.374+0000 7f58349bc640 1 -- 10.20.193.5:0/877501253 shutdown_connections 2026-02-17T21:30:45.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.374+0000 7f58349bc640 1 -- 10.20.193.5:0/877501253 wait complete. 2026-02-17T21:30:45.379 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.374+0000 7f58349bc640 1 librados: shutdown 2026-02-17T21:30:45.385 INFO:tasks.ceph:Scrubbing osd.4 2026-02-17T21:30:45.385 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:30:45.455 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.453+0000 7f0849d8f640 10 monclient: get_monmap_and_config 2026-02-17T21:30:45.456 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.453+0000 7f0849d8f640 10 monclient: build_initial_monmap 2026-02-17T21:30:45.456 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.453+0000 7f0849d8f640 10 monclient: monmap: 2026-02-17T21:30:45.456 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:45.456 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.456 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:45.454916+0000 2026-02-17T21:30:45.456 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:45.454916+0000 2026-02-17T21:30:45.456 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:45.456 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.457 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:45.457 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:45.457 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:45.457 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:45.457 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:45.457 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:45.457 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.453+0000 7f0849d8f640 1 Processor -- start 2026-02-17T21:30:45.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.453+0000 7f0849d8f640 1 -- start start 2026-02-17T21:30:45.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.453+0000 7f0849d8f640 10 monclient: init 2026-02-17T21:30:45.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.454+0000 7f0849d8f640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:45.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.454+0000 7f0849d8f640 10 monclient: _add_conns ranks=[2,0,4,3,1,5] 2026-02-17T21:30:45.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.454+0000 7f0849d8f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f084415d3c0 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:45.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.454+0000 7f0849d8f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f08440c94c0 addr v1:10.20.193.5:6789/0 2026-02-17T21:30:45.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.454+0000 7f0849d8f640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f084415d7a0 0x7f084415b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.454+0000 7f0849d8f640 10 monclient(hunting): picked mon.noname-b con 0x7f084415d7a0 addr v2:10.20.193.119:3300/0 2026-02-17T21:30:45.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.454+0000 7f0849d8f640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08440c7e60 con 0x7f08440c94c0 2026-02-17T21:30:45.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.454+0000 7f0849d8f640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08440c8140 con 0x7f084415d3c0 2026-02-17T21:30:45.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.454+0000 7f0849d8f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.454+0000 7f0849d8f640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f08440c8420 con 0x7f084415d7a0 2026-02-17T21:30:45.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.454+0000 7f0849d8f640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:45.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.454+0000 7f0849d8f640 10 monclient(hunting): authenticate will time out at 1351.020222s 2026-02-17T21:30:45.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.454+0000 7f08437fe640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f084415d3c0 0x7f08440c7300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:33588/0 (socket says 10.20.193.5:33588) 2026-02-17T21:30:45.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.454+0000 7f08437fe640 1 -- 10.20.193.5:0/2748747226 learned_addr learned my addr 10.20.193.5:0/2748747226 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:45.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.455+0000 7f08427fc640 1 -- 10.20.193.5:0/2748747226 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 826365062 0 0) 0x7f08440c8140 con 0x7f084415d3c0 2026-02-17T21:30:45.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.455+0000 7f08427fc640 10 monclient(hunting): _negotiate 2026-02-17T21:30:45.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.455+0000 7f08427fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.455+0000 7f08427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.455+0000 7f08427fc640 10 monclient(hunting): my global_id is 5198 2026-02-17T21:30:45.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.456+0000 7f08427fc640 1 -- 10.20.193.5:0/2748747226 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0828003620 con 0x7f084415d3c0 2026-02-17T21:30:45.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.456+0000 7f08427fc640 1 -- 10.20.193.5:0/2748747226 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3981578978 0 0) 0x7f08440c7e60 con 0x7f08440c94c0 2026-02-17T21:30:45.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.456+0000 7f08427fc640 10 monclient(hunting): _negotiate 2026-02-17T21:30:45.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.456+0000 7f08427fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.456+0000 7f08427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.456+0000 7f08427fc640 10 monclient(hunting): my global_id is 5127 2026-02-17T21:30:45.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.456+0000 7f08427fc640 1 -- 10.20.193.5:0/2748747226 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08440c8140 con 0x7f08440c94c0 2026-02-17T21:30:45.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.456+0000 7f0843fff640 1 --2- 10.20.193.5:0/2748747226 >> v2:10.20.193.119:3300/0 conn(0x7f084415d7a0 0x7f084415b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f0843fff640 10 monclient(hunting): get_auth_request con 0x7f084415d7a0 auth_method 0 2026-02-17T21:30:45.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f0843fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:45.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f0843fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f0843fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f0843fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:45.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f0843fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:45.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f0843fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:45.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f08427fc640 1 -- 10.20.193.5:0/2748747226 <== mon.0 v1:10.20.193.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3719800675 0 0) 0x7f08440c8140 con 0x7f08440c94c0 2026-02-17T21:30:45.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f08427fc640 1 -- 10.20.193.5:0/2748747226 >> v2:10.20.193.119:3300/0 conn(0x7f084415d7a0 msgr2=0x7f084415b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:45.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f08427fc640 1 --2- 10.20.193.5:0/2748747226 >> v2:10.20.193.119:3300/0 conn(0x7f084415d7a0 0x7f084415b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f08427fc640 1 -- 10.20.193.5:0/2748747226 >> v1:10.20.193.135:6789/0 conn(0x7f084415d3c0 legacy=0x7f08440c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f08427fc640 10 monclient: _finish_hunting 0 2026-02-17T21:30:45.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f08427fc640 1 monclient: found mon.noname-a-legacy 2026-02-17T21:30:45.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f08427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:45.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f08427fc640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.5:6789/0 2026-02-17T21:30:45.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f08427fc640 1 -- 10.20.193.5:0/2748747226 --> v1:10.20.193.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08440c8700 con 0x7f08440c94c0 2026-02-17T21:30:45.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f08427fc640 10 monclient: _finish_auth 0 2026-02-17T21:30:45.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f08427fc640 10 monclient: _check_auth_tickets 2026-02-17T21:30:45.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f08427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:45.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f08427fc640 1 -- 10.20.193.5:0/2748747226 <== mon.0 v1:10.20.193.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3880376286 0 0) 0x7f0834002ee0 con 0x7f08440c94c0 2026-02-17T21:30:45.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f08427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:45.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f08427fc640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T21:30:45.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f08427fc640 10 monclient: dump: 2026-02-17T21:30:45.468 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:45.468 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.468 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.468 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.468 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:45.468 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.468 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:45.468 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:45.468 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:45.468 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f08427fc640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] but i'm connected to v1:10.20.193.5:6789/0, reconnecting 2026-02-17T21:30:45.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f08427fc640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:45.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.457+0000 7f08427fc640 1 -- 10.20.193.5:0/2748747226 >> v1:10.20.193.5:6789/0 conn(0x7f08440c94c0 legacy=0x7f08440c52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.458+0000 7f08427fc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:30:45.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.458+0000 7f08427fc640 1 --2- 10.20.193.5:0/2748747226 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0828003dd0 0x7f08280041d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.458+0000 7f08427fc640 10 monclient(hunting): picked mon.b con 0x7f0828003dd0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:45.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.458+0000 7f08427fc640 1 --2- 10.20.193.5:0/2748747226 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0828004900 0x7f0828004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.458+0000 7f08427fc640 10 monclient(hunting): picked mon.a con 0x7f0828004900 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:45.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.458+0000 7f08427fc640 1 --2- 10.20.193.5:0/2748747226 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0828005380 0x7f082800bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.458+0000 7f08427fc640 10 monclient(hunting): picked mon.c con 0x7f0828005380 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:45.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.458+0000 7f08427fc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.458+0000 7f08427fc640 1 -- 10.20.193.5:0/2748747226 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f08440c8420 con 0x7f0828004900 2026-02-17T21:30:45.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.458+0000 7f08427fc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.458+0000 7f08427fc640 1 -- 10.20.193.5:0/2748747226 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f082800c240 con 0x7f0828003dd0 2026-02-17T21:30:45.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.458+0000 7f08427fc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.458+0000 7f08427fc640 1 -- 10.20.193.5:0/2748747226 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f082800c440 con 0x7f0828005380 2026-02-17T21:30:45.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.458+0000 7f08427fc640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:45.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.458+0000 7f08427fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:30:45.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.458+0000 7f0843fff640 1 --2- 10.20.193.5:0/2748747226 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0828005380 0x7f082800bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.459+0000 7f0843fff640 10 monclient(hunting): get_auth_request con 0x7f0828005380 auth_method 0 2026-02-17T21:30:45.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.459+0000 7f0843fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:45.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.459+0000 7f0843fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.459+0000 7f0843fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:30:45.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.459+0000 7f0843fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:45.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.459+0000 7f0843fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:45.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.459+0000 7f0843fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:30:45.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.459+0000 7f08437fe640 1 --2- 10.20.193.5:0/2748747226 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0828003dd0 0x7f08280041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.459+0000 7f08437fe640 10 monclient(hunting): get_auth_request con 0x7f0828003dd0 auth_method 0 2026-02-17T21:30:45.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.459+0000 7f08437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:45.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.459+0000 7f08437fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.459+0000 7f08437fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:30:45.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.460+0000 7f08437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:45.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.460+0000 7f08437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:45.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.460+0000 7f08437fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:30:45.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.460+0000 7f0843fff640 10 monclient(hunting): handle_auth_done global_id 5127 payload 293 2026-02-17T21:30:45.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.460+0000 7f0843fff640 1 -- 10.20.193.5:0/2748747226 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0828003dd0 msgr2=0x7f08280041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:45.472 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.460+0000 7f0843fff640 1 --2- 10.20.193.5:0/2748747226 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0828003dd0 0x7f08280041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.460+0000 7f0843fff640 1 -- 10.20.193.5:0/2748747226 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0828004900 msgr2=0x7f0828004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:45.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.460+0000 7f0843fff640 1 --2- 10.20.193.5:0/2748747226 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0828004900 0x7f0828004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.460+0000 7f0843fff640 10 monclient: _finish_hunting 0 2026-02-17T21:30:45.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.460+0000 7f0843fff640 1 monclient: found mon.c 2026-02-17T21:30:45.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.460+0000 7f0843fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:45.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.460+0000 7f0843fff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:45.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.460+0000 7f0843fff640 1 -- 10.20.193.5:0/2748747226 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08440c8140 con 0x7f0828005380 2026-02-17T21:30:45.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.460+0000 7f0843fff640 10 monclient: _finish_auth 0 2026-02-17T21:30:45.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.460+0000 7f0843fff640 10 monclient: _check_auth_tickets 2026-02-17T21:30:45.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.460+0000 7f0843fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:45.473 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.460+0000 7f0849d8f640 5 monclient: authenticate success, global_id 5127 2026-02-17T21:30:45.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.460+0000 7f0849d8f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:45.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.460+0000 7f0843fff640 1 -- 10.20.193.5:0/2748747226 reap_dead start 2026-02-17T21:30:45.474 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.461+0000 7f0843fff640 1 --2- 10.20.193.5:0/2748747226 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0828005380 0x7f082800bac0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0838009fc0 tx=0x7f083802f5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc1d6942ad6128a4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:45.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.462+0000 7f08427fc640 1 -- 10.20.193.5:0/2748747226 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0838009c10 con 0x7f0828005380 2026-02-17T21:30:45.480 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.462+0000 7f08427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:45.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.462+0000 7f08427fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:45.481 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.462+0000 7f08427fc640 10 monclient: dump: 2026-02-17T21:30:45.481 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:45.481 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.481 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.481 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.481 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:45.481 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.481 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:45.481 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:45.481 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:45.482 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.462+0000 7f0849d8f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:45.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.462+0000 7f08427fc640 1 -- 10.20.193.5:0/2748747226 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0838003c90 con 0x7f0828005380 2026-02-17T21:30:45.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.462+0000 7f08427fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:45.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.462+0000 7f08427fc640 1 -- 10.20.193.5:0/2748747226 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0838004260 con 0x7f0828005380 2026-02-17T21:30:45.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.462+0000 7f0849d8f640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:45.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.462+0000 7f0849d8f640 4 set_mon_vals no callback set 2026-02-17T21:30:45.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.462+0000 7f08427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:45.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.462+0000 7f08427fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:45.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.462+0000 7f08427fc640 10 monclient: dump: 2026-02-17T21:30:45.482 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:45.482 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.483 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.483 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.483 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:45.483 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.483 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:45.483 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:45.483 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:45.483 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.463+0000 7f0849d8f640 10 monclient: shutdown 2026-02-17T21:30:45.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.463+0000 7f0849d8f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:45.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.463+0000 7f0849d8f640 1 -- 10.20.193.5:0/2748747226 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0828005380 msgr2=0x7f082800bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.483 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.463+0000 7f0849d8f640 1 --2- 10.20.193.5:0/2748747226 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0828005380 0x7f082800bac0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0838009fc0 tx=0x7f083802f5b0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.463+0000 7f0849d8f640 1 -- 10.20.193.5:0/2748747226 shutdown_connections 2026-02-17T21:30:45.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.463+0000 7f0849d8f640 1 --2- 10.20.193.5:0/2748747226 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0828005380 0x7f082800bac0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.463+0000 7f0849d8f640 1 -- 10.20.193.5:0/2748747226 >> 10.20.193.5:0/2748747226 conn(0x7f08440c9f60 msgr2=0x7f08440ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:45.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.463+0000 7f0849d8f640 1 -- 10.20.193.5:0/2748747226 shutdown_connections 2026-02-17T21:30:45.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.463+0000 7f0849d8f640 1 -- 10.20.193.5:0/2748747226 wait complete. 2026-02-17T21:30:45.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.463+0000 7f0849d8f640 10 monclient: build_initial_monmap 2026-02-17T21:30:45.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.463+0000 7f0849d8f640 10 monclient: monmap: 2026-02-17T21:30:45.484 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:45.484 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:45.484 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:45.484 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:45.485 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:45.485 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.485 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:45.485 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:45.485 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:45.485 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.464+0000 7f0849d8f640 1 librados: starting msgr at 2026-02-17T21:30:45.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.464+0000 7f0849d8f640 1 librados: starting objecter 2026-02-17T21:30:45.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.464+0000 7f0849d8f640 1 Processor -- start 2026-02-17T21:30:45.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.464+0000 7f0849d8f640 1 -- start start 2026-02-17T21:30:45.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.464+0000 7f0849d8f640 1 librados: setting wanted keys 2026-02-17T21:30:45.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.464+0000 7f0849d8f640 1 librados: calling monclient init 2026-02-17T21:30:45.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.464+0000 7f0849d8f640 10 monclient: init 2026-02-17T21:30:45.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.464+0000 7f0849d8f640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:45.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.464+0000 7f0849d8f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:30:45.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.464+0000 7f0849d8f640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0828005380 0x7f0844147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.464+0000 7f0849d8f640 10 monclient(hunting): picked mon.noname-b con 0x7f0828005380 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:45.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.464+0000 7f0849d8f640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0844148f50 0x7f0844073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.464+0000 7f0849d8f640 10 monclient(hunting): picked mon.noname-a con 0x7f0844148f50 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:45.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.464+0000 7f0849d8f640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f08441493d0 0x7f0844073c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.464+0000 7f0849d8f640 10 monclient(hunting): picked mon.noname-c con 0x7f08441493d0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:45.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.464+0000 7f0849d8f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.464+0000 7f0849d8f640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f08440c8fa0 con 0x7f0844148f50 2026-02-17T21:30:45.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.464+0000 7f0849d8f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.464+0000 7f0849d8f640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f08440c8cc0 con 0x7f0828005380 2026-02-17T21:30:45.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.464+0000 7f0849d8f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.464+0000 7f0849d8f640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f084415b050 con 0x7f08441493d0 2026-02-17T21:30:45.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.464+0000 7f0849d8f640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:45.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.464+0000 7f0849d8f640 10 monclient(hunting): authenticate will time out at 1351.030598s 2026-02-17T21:30:45.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.464+0000 7f0843fff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f08441493d0 0x7f0844073c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.465+0000 7f08437fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0828005380 0x7f0844147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.465+0000 7f0843fff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f08441493d0 0x7f0844073c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:33934/0 (socket says 10.20.193.5:33934) 2026-02-17T21:30:45.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.465+0000 7f0843fff640 1 -- 10.20.193.5:0/3819043247 learned_addr learned my addr 10.20.193.5:0/3819043247 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:45.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.465+0000 7f0843fff640 10 monclient(hunting): get_auth_request con 0x7f08441493d0 auth_method 0 2026-02-17T21:30:45.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.465+0000 7f0843fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:45.487 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.465+0000 7f0843fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.465+0000 7f0843fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.465+0000 7f08437fe640 10 monclient(hunting): get_auth_request con 0x7f0828005380 auth_method 0 2026-02-17T21:30:45.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.465+0000 7f08437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:45.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.465+0000 7f08437fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.465+0000 7f08437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.465+0000 7f0843fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:45.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.465+0000 7f0843fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:45.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.465+0000 7f0843fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:45.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.465+0000 7f08437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:45.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.465+0000 7f08437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:45.488 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.465+0000 7f08437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:45.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.466+0000 7f0842ffd640 1 --2- 10.20.193.5:0/3819043247 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0844148f50 0x7f0844073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.466+0000 7f0843fff640 10 monclient(hunting): handle_auth_done global_id 5201 payload 824 2026-02-17T21:30:45.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.466+0000 7f0843fff640 1 -- 10.20.193.5:0/3819043247 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0828005380 msgr2=0x7f0844147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.466+0000 7f0843fff640 1 --2- 10.20.193.5:0/3819043247 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0828005380 0x7f0844147120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.466+0000 7f0843fff640 1 -- 10.20.193.5:0/3819043247 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0844148f50 msgr2=0x7f0844073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.466+0000 7f0843fff640 1 --2- 10.20.193.5:0/3819043247 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0844148f50 0x7f0844073710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.466+0000 7f0843fff640 10 monclient: _finish_hunting 0 2026-02-17T21:30:45.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.466+0000 7f0843fff640 1 monclient: found mon.noname-c 2026-02-17T21:30:45.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.466+0000 7f0843fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:45.489 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.466+0000 7f0843fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:45.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.466+0000 7f0843fff640 1 -- 10.20.193.5:0/3819043247 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0844147780 con 0x7f08441493d0 2026-02-17T21:30:45.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.467+0000 7f0843fff640 1 --2- 10.20.193.5:0/3819043247 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f08441493d0 0x7f0844073c50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f083800e240 tx=0x7f0838004bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:45.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.467+0000 7f081ffff640 10 client.?.objecter ms_handle_connect 0x7f08441493d0 2026-02-17T21:30:45.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.467+0000 7f081ffff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:45.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.469+0000 7f081ffff640 1 -- 10.20.193.5:0/3819043247 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0838009c10 con 0x7f08441493d0 2026-02-17T21:30:45.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.469+0000 7f081ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:45.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.469+0000 7f081ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:45.490 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.469+0000 7f081ffff640 10 monclient: dump: 2026-02-17T21:30:45.490 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:45.491 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.491 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.491 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.491 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:45.491 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.491 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:45.491 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:45.491 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:45.491 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.491 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.469+0000 7f081ffff640 10 monclient: _finish_auth 0 2026-02-17T21:30:45.491 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.469+0000 7f081ffff640 10 monclient: _check_auth_tickets 2026-02-17T21:30:45.492 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.469+0000 7f081ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:45.492 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.469+0000 7f081ffff640 1 -- 10.20.193.5:0/3819043247 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0838048070 con 0x7f08441493d0 2026-02-17T21:30:45.492 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.469+0000 7f081ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:45.492 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.469+0000 7f081ffff640 1 -- 10.20.193.5:0/3819043247 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0838041430 con 0x7f08441493d0 2026-02-17T21:30:45.492 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.469+0000 7f081ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:45.492 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.469+0000 7f081ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:45.492 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.469+0000 7f081ffff640 10 monclient: dump: 2026-02-17T21:30:45.492 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:45.492 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.492 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.492 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.492 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:45.493 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.493 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:45.493 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:45.493 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:45.493 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.493 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.469+0000 7f0849d8f640 5 monclient: authenticate success, global_id 5201 2026-02-17T21:30:45.493 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.469+0000 7f0841ffb640 4 set_mon_vals no callback set 2026-02-17T21:30:45.493 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.469+0000 7f0849d8f640 10 monclient: _renew_subs 2026-02-17T21:30:45.493 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.469+0000 7f0849d8f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:45.493 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.469+0000 7f0849d8f640 1 -- 10.20.193.5:0/3819043247 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0844072950 con 0x7f08441493d0 2026-02-17T21:30:45.493 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.469+0000 7f0849d8f640 10 client.5201.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:45.493 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.469+0000 7f0849d8f640 10 monclient: _renew_subs 2026-02-17T21:30:45.494 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.469+0000 7f0849d8f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:45.494 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.469+0000 7f0849d8f640 1 -- 10.20.193.5:0/3819043247 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0844072f10 con 0x7f08441493d0 2026-02-17T21:30:45.494 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.469+0000 7f0849d8f640 1 librados: init done 2026-02-17T21:30:45.494 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.470+0000 7f0849d8f640 10 client.5201.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:45.494 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.470+0000 7f0849d8f640 15 client.5201.objecter _session_command_op_assign -1 1 2026-02-17T21:30:45.494 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.470+0000 7f0849d8f640 20 client.5201.objecter _get_session osd=-1 returning homeless 2026-02-17T21:30:45.494 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.470+0000 7f0849d8f640 10 client.5201.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:45.494 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.470+0000 7f0849d8f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:45.494 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.470+0000 7f0849d8f640 1 -- 10.20.193.5:0/3819043247 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0844157580 con 0x7f08441493d0 2026-02-17T21:30:45.496 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.481+0000 7f081ffff640 1 -- 10.20.193.5:0/3819043247 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f08380415d0 con 0x7f08441493d0 2026-02-17T21:30:45.496 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.482+0000 7f081ffff640 1 --2- 10.20.193.5:0/3819043247 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f08140792b0 0x7f081407b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.496 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.482+0000 7f08437fe640 1 --2- 10.20.193.5:0/3819043247 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f08140792b0 0x7f081407b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.496 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.482+0000 7f08437fe640 10 monclient: get_auth_request con 0x7f08140792b0 auth_method 0 2026-02-17T21:30:45.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.482+0000 7f08437fe640 1 --2- 10.20.193.5:0/3819043247 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f08140792b0 0x7f081407b770 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0830004e80 tx=0x7f0830007eb0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:45.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.482+0000 7f081ffff640 10 client.5201.objecter ms_handle_connect 0x7f08140792b0 2026-02-17T21:30:45.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.483+0000 7f081ffff640 1 -- 10.20.193.5:0/3819043247 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f08380bde60 con 0x7f08441493d0 2026-02-17T21:30:45.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.483+0000 7f081ffff640 10 client.5201.objecter ms_dispatch2 0x7f0844000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:45.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.483+0000 7f081ffff640 3 client.5201.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:45.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.483+0000 7f081ffff640 3 client.5201.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:45.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.483+0000 7f081ffff640 10 client.5201.objecter checking command 1 2026-02-17T21:30:45.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.483+0000 7f081ffff640 1 --2- 10.20.193.5:0/3819043247 >> [v2:10.20.193.5:6800/234574736,v1:10.20.193.5:6801/234574736] conn(0x7f0814081790 0x7f0814083bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.483+0000 7f081ffff640 20 client.5201.objecter _get_session s=0x7f08140810c0 osd=4 3 2026-02-17T21:30:45.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.483+0000 7f081ffff640 20 client.5201.objecter put_session s=0x7f08140810c0 osd=4 3 2026-02-17T21:30:45.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.483+0000 7f081ffff640 15 client.5201.objecter _session_command_op_remove -1 1 2026-02-17T21:30:45.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.483+0000 7f081ffff640 20 client.5201.objecter _get_session s=0x7f08140810c0 osd=4 3 2026-02-17T21:30:45.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.483+0000 7f081ffff640 20 client.5201.objecter get_session s=0x7f08140810c0 osd=4 3 2026-02-17T21:30:45.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.483+0000 7f081ffff640 15 client.5201.objecter _session_command_op_assign 4 1 2026-02-17T21:30:45.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.483+0000 7f081ffff640 20 client.5201.objecter put_session s=0x7f08140810c0 osd=4 4 2026-02-17T21:30:45.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.483+0000 7f081ffff640 10 client.5201.objecter _send_command 1 2026-02-17T21:30:45.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.483+0000 7f081ffff640 1 -- 10.20.193.5:0/3819043247 --> [v2:10.20.193.5:6800/234574736,v1:10.20.193.5:6801/234574736] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0838057e50 con 0x7f0814081790 2026-02-17T21:30:45.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.483+0000 7f081ffff640 20 client.5201.objecter dump_active .. 0 homeless 2026-02-17T21:30:45.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.484+0000 7f0842ffd640 1 --2- 10.20.193.5:0/3819043247 >> [v2:10.20.193.5:6800/234574736,v1:10.20.193.5:6801/234574736] conn(0x7f0814081790 0x7f0814083bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.484+0000 7f0842ffd640 10 monclient: get_auth_request con 0x7f0814081790 auth_method 0 2026-02-17T21:30:45.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.484+0000 7f081ffff640 1 -- 10.20.193.5:0/3819043247 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f0838084630 con 0x7f08441493d0 2026-02-17T21:30:45.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.484+0000 7f081ffff640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T21:30:45.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.486+0000 7f081ffff640 10 client.5201.objecter ms_handle_connect 0x7f0814081790 2026-02-17T21:30:45.498 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.486+0000 7f0842ffd640 1 --2- 10.20.193.5:0/3819043247 >> [v2:10.20.193.5:6800/234574736,v1:10.20.193.5:6801/234574736] conn(0x7f0814081790 0x7f0814083bb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:45.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.497+0000 7f081ffff640 1 -- 10.20.193.5:0/3819043247 <== osd.4 v2:10.20.193.5:6800/234574736 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f0838057e50 con 0x7f0814081790 2026-02-17T21:30:45.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.497+0000 7f081ffff640 10 client.5201.objecter ms_dispatch2 0x7f0844000b90 command_reply(tid 1: 0 ) 2026-02-17T21:30:45.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.497+0000 7f081ffff640 10 client.5201.objecter _finish_command 1 = system:0 2026-02-17T21:30:45.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.497+0000 7f081ffff640 20 client.5201.objecter put_session s=0x7f08140810c0 osd=4 4 2026-02-17T21:30:45.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.497+0000 7f081ffff640 15 client.5201.objecter _session_command_op_remove 4 1 2026-02-17T21:30:45.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.503+0000 7f0849d8f640 10 client.5201.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:30:45.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.503+0000 7f0849d8f640 15 client.5201.objecter _session_command_op_assign -1 2 2026-02-17T21:30:45.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.503+0000 7f0849d8f640 20 client.5201.objecter _get_session s=0x7f08140810c0 osd=4 3 2026-02-17T21:30:45.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.503+0000 7f0849d8f640 20 client.5201.objecter put_session s=0x7f08140810c0 osd=4 3 2026-02-17T21:30:45.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.503+0000 7f0849d8f640 20 client.5201.objecter _get_session s=0x7f08140810c0 osd=4 3 2026-02-17T21:30:45.505 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.503+0000 7f0849d8f640 15 client.5201.objecter _session_command_op_remove -1 2 2026-02-17T21:30:45.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.503+0000 7f0849d8f640 20 client.5201.objecter get_session s=0x7f08140810c0 osd=4 3 2026-02-17T21:30:45.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.503+0000 7f0849d8f640 15 client.5201.objecter _session_command_op_assign 4 2 2026-02-17T21:30:45.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.503+0000 7f0849d8f640 20 client.5201.objecter put_session s=0x7f08140810c0 osd=4 4 2026-02-17T21:30:45.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.503+0000 7f0849d8f640 10 client.5201.objecter _send_command 2 2026-02-17T21:30:45.506 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.503+0000 7f0849d8f640 1 -- 10.20.193.5:0/3819043247 --> [v2:10.20.193.5:6800/234574736,v1:10.20.193.5:6801/234574736] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f08440cbde0 con 0x7f0814081790 2026-02-17T21:30:45.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.510+0000 7f081ffff640 1 -- 10.20.193.5:0/3819043247 <== osd.4 v2:10.20.193.5:6800/234574736 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f08440cbde0 con 0x7f0814081790 2026-02-17T21:30:45.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.510+0000 7f081ffff640 10 client.5201.objecter ms_dispatch2 0x7f0844000b90 command_reply(tid 2: 0 ) 2026-02-17T21:30:45.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.510+0000 7f081ffff640 10 client.5201.objecter _finish_command 2 = system:0 2026-02-17T21:30:45.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.510+0000 7f081ffff640 20 client.5201.objecter put_session s=0x7f08140810c0 osd=4 4 2026-02-17T21:30:45.513 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.510+0000 7f081ffff640 15 client.5201.objecter _session_command_op_remove 4 2 2026-02-17T21:30:45.513 INFO:teuthology.orchestra.run.trial005.stdout:{ 2026-02-17T21:30:45.514 INFO:teuthology.orchestra.run.trial005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:30:45.514 INFO:teuthology.orchestra.run.trial005.stdout:} 2026-02-17T21:30:45.515 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.510+0000 7f0849d8f640 10 librados: watch_flush enter 2026-02-17T21:30:45.515 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.510+0000 7f0849d8f640 10 librados: watch_flush exit 2026-02-17T21:30:45.515 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.510+0000 7f0849d8f640 10 client.5201.objecter close_session for osd.4 2026-02-17T21:30:45.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.510+0000 7f0849d8f640 1 -- 10.20.193.5:0/3819043247 >> [v2:10.20.193.5:6800/234574736,v1:10.20.193.5:6801/234574736] conn(0x7f0814081790 msgr2=0x7f0814083bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.510+0000 7f0849d8f640 1 --2- 10.20.193.5:0/3819043247 >> [v2:10.20.193.5:6800/234574736,v1:10.20.193.5:6801/234574736] conn(0x7f0814081790 0x7f0814083bb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.510+0000 7f0849d8f640 20 client.5201.objecter put_session s=0x7f08140810c0 osd=4 1 2026-02-17T21:30:45.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.510+0000 7f0849d8f640 20 client.5201.objecter shutdown clearing up homeless session... 2026-02-17T21:30:45.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.510+0000 7f0849d8f640 10 client.5201.objecter successfully canceled tick 2026-02-17T21:30:45.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.510+0000 7f0849d8f640 1 -- 10.20.193.5:0/3819043247 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f08140792b0 msgr2=0x7f081407b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.510+0000 7f0849d8f640 1 --2- 10.20.193.5:0/3819043247 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f08140792b0 0x7f081407b770 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0830004e80 tx=0x7f0830007eb0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.510+0000 7f0849d8f640 10 monclient: shutdown 2026-02-17T21:30:45.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.510+0000 7f0849d8f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:45.516 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.510+0000 7f0849d8f640 1 -- 10.20.193.5:0/3819043247 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f08441493d0 msgr2=0x7f0844073c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.510+0000 7f0849d8f640 1 --2- 10.20.193.5:0/3819043247 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f08441493d0 0x7f0844073c50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f083800e240 tx=0x7f0838004bb0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.510+0000 7f0843fff640 1 -- 10.20.193.5:0/3819043247 reap_dead start 2026-02-17T21:30:45.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.510+0000 7f0849d8f640 1 -- 10.20.193.5:0/3819043247 shutdown_connections 2026-02-17T21:30:45.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.510+0000 7f0849d8f640 1 -- 10.20.193.5:0/3819043247 >> 10.20.193.5:0/3819043247 conn(0x7f08440c9f60 msgr2=0x7f084406fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:45.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.510+0000 7f0849d8f640 1 -- 10.20.193.5:0/3819043247 shutdown_connections 2026-02-17T21:30:45.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.510+0000 7f0849d8f640 1 -- 10.20.193.5:0/3819043247 wait complete. 2026-02-17T21:30:45.517 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.511+0000 7f0849d8f640 1 librados: shutdown 2026-02-17T21:30:45.521 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-17T21:30:45.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.587+0000 7f35c9311640 10 monclient: get_monmap_and_config 2026-02-17T21:30:45.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.587+0000 7f35c9311640 10 monclient: build_initial_monmap 2026-02-17T21:30:45.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.587+0000 7f35c9311640 10 monclient: monmap: 2026-02-17T21:30:45.590 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:45.590 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.590 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:45.589348+0000 2026-02-17T21:30:45.590 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:45.589348+0000 2026-02-17T21:30:45.590 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:45.591 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.591 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:45.591 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:45.591 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:45.591 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:45.591 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:45.591 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:45.591 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.588+0000 7f35c9311640 1 Processor -- start 2026-02-17T21:30:45.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.588+0000 7f35c9311640 1 -- start start 2026-02-17T21:30:45.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.588+0000 7f35c9311640 10 monclient: init 2026-02-17T21:30:45.599 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.588+0000 7f35c9311640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:45.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.588+0000 7f35c9311640 10 monclient: _add_conns ranks=[4,5,0,2,1,3] 2026-02-17T21:30:45.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.588+0000 7f35c9311640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f35c40c7170 0x7f35c40c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.588+0000 7f35c9311640 10 monclient(hunting): picked mon.noname-b con 0x7f35c40c7170 addr v2:10.20.193.119:3300/0 2026-02-17T21:30:45.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.588+0000 7f35c9311640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f35c40c48c0 0x7f35c40749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.588+0000 7f35c9311640 10 monclient(hunting): picked mon.noname-c con 0x7f35c40c48c0 addr v2:10.20.193.135:3300/0 2026-02-17T21:30:45.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.588+0000 7f35c9311640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f35c4074ef0 addr v1:10.20.193.5:6789/0 2026-02-17T21:30:45.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.588+0000 7f35c9311640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35c415a9a0 con 0x7f35c4074ef0 2026-02-17T21:30:45.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.588+0000 7f35c9311640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.588+0000 7f35c9311640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f35c40c8530 con 0x7f35c40c7170 2026-02-17T21:30:45.600 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.588+0000 7f35c9311640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.588+0000 7f35c9311640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f35c40c5270 con 0x7f35c40c48c0 2026-02-17T21:30:45.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.588+0000 7f35c9311640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:45.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.588+0000 7f35c9311640 10 monclient(hunting): authenticate will time out at 1351.154633s 2026-02-17T21:30:45.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.588+0000 7f35c37fe640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f35c4074ef0 0x7f35c40c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:34538/0 (socket says 10.20.193.5:34538) 2026-02-17T21:30:45.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.588+0000 7f35c37fe640 1 -- 10.20.193.5:0/1397221699 learned_addr learned my addr 10.20.193.5:0/1397221699 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:45.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.589+0000 7f35c2ffd640 1 --2- 10.20.193.5:0/1397221699 >> v2:10.20.193.119:3300/0 conn(0x7f35c40c7170 0x7f35c40c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.589+0000 7f35c27fc640 1 --2- 10.20.193.5:0/1397221699 >> v2:10.20.193.135:3300/0 conn(0x7f35c40c48c0 0x7f35c40749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.589+0000 7f35c27fc640 10 monclient(hunting): get_auth_request con 0x7f35c40c48c0 auth_method 0 2026-02-17T21:30:45.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.589+0000 7f35c27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:45.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.589+0000 7f35c27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.601 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.589+0000 7f35c27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.589+0000 7f35c2ffd640 10 monclient(hunting): get_auth_request con 0x7f35c40c7170 auth_method 0 2026-02-17T21:30:45.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.589+0000 7f35c2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:45.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.589+0000 7f35c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.589+0000 7f35c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.589+0000 7f35c27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:45.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.589+0000 7f35c27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:45.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.589+0000 7f35c27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:45.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.589+0000 7f35c2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:45.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.589+0000 7f35c2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:45.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.589+0000 7f35c2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:45.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.590+0000 7f35c1ffb640 1 -- 10.20.193.5:0/1397221699 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1680501209 0 0) 0x7f35c415a9a0 con 0x7f35c4074ef0 2026-02-17T21:30:45.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.590+0000 7f35c1ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:30:45.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.590+0000 7f35c1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.590+0000 7f35c1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.590+0000 7f35c1ffb640 10 monclient(hunting): my global_id is 5130 2026-02-17T21:30:45.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.590+0000 7f35c1ffb640 1 -- 10.20.193.5:0/1397221699 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35b0003620 con 0x7f35c4074ef0 2026-02-17T21:30:45.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.590+0000 7f35c27fc640 10 monclient(hunting): handle_auth_done global_id 5204 payload 274 2026-02-17T21:30:45.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.590+0000 7f35c27fc640 1 -- 10.20.193.5:0/1397221699 >> v2:10.20.193.119:3300/0 conn(0x7f35c40c7170 msgr2=0x7f35c40c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:45.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.590+0000 7f35c27fc640 1 --2- 10.20.193.5:0/1397221699 >> v2:10.20.193.119:3300/0 conn(0x7f35c40c7170 0x7f35c40c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.590+0000 7f35c27fc640 1 -- 10.20.193.5:0/1397221699 >> v1:10.20.193.5:6789/0 conn(0x7f35c4074ef0 legacy=0x7f35c40c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.590+0000 7f35c27fc640 10 monclient: _finish_hunting 0 2026-02-17T21:30:45.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.590+0000 7f35c27fc640 1 monclient: found mon.noname-c 2026-02-17T21:30:45.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.590+0000 7f35c27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:45.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.590+0000 7f35c27fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:45.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.590+0000 7f35c27fc640 1 -- 10.20.193.5:0/1397221699 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c40c5550 con 0x7f35c40c48c0 2026-02-17T21:30:45.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.591+0000 7f35c27fc640 1 --2- 10.20.193.5:0/1397221699 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f35c40c48c0 0x7f35c40749b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f35c40c7a90 tx=0x7f35ac02ede0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21048dc0dfdb204f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:45.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.592+0000 7f35c1ffb640 1 -- 10.20.193.5:0/1397221699 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ac03c070 con 0x7f35c40c48c0 2026-02-17T21:30:45.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.592+0000 7f35c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:45.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.592+0000 7f35c1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:45.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.592+0000 7f35c1ffb640 10 monclient: dump: 2026-02-17T21:30:45.604 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:45.604 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.604 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.604 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.604 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:45.604 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.604 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:45.605 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:45.605 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:45.605 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.592+0000 7f35c1ffb640 10 monclient: _finish_auth 0 2026-02-17T21:30:45.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.592+0000 7f35c1ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:30:45.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.592+0000 7f35c1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:45.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.592+0000 7f35c9311640 5 monclient: authenticate success, global_id 5204 2026-02-17T21:30:45.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.592+0000 7f35c9311640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:45.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.593+0000 7f35c1ffb640 1 -- 10.20.193.5:0/1397221699 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35ac02faf0 con 0x7f35c40c48c0 2026-02-17T21:30:45.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.593+0000 7f35c1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:45.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.593+0000 7f35c1ffb640 1 -- 10.20.193.5:0/1397221699 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ac037440 con 0x7f35c40c48c0 2026-02-17T21:30:45.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.593+0000 7f35c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:45.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.593+0000 7f35c1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:45.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.593+0000 7f35c1ffb640 10 monclient: dump: 2026-02-17T21:30:45.606 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:45.606 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.606 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.606 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.606 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:45.606 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.606 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:45.606 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:45.606 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:45.606 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.593+0000 7f35c9311640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:45.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.593+0000 7f35c9311640 4 set_mon_vals no callback set 2026-02-17T21:30:45.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.593+0000 7f35c9311640 10 monclient: shutdown 2026-02-17T21:30:45.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.593+0000 7f35c9311640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:45.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.593+0000 7f35c9311640 1 -- 10.20.193.5:0/1397221699 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f35c40c48c0 msgr2=0x7f35c40749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.593+0000 7f35c9311640 1 --2- 10.20.193.5:0/1397221699 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f35c40c48c0 0x7f35c40749b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f35c40c7a90 tx=0x7f35ac02ede0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.593+0000 7f35c9311640 1 -- 10.20.193.5:0/1397221699 shutdown_connections 2026-02-17T21:30:45.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.593+0000 7f35c9311640 1 --2- 10.20.193.5:0/1397221699 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f35c40c48c0 0x7f35c40749b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.593+0000 7f35c9311640 1 --2- 10.20.193.5:0/1397221699 >> v2:10.20.193.119:3300/0 conn(0x7f35c40c7170 0x7f35c40c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.593+0000 7f35c9311640 1 -- 10.20.193.5:0/1397221699 >> 10.20.193.5:0/1397221699 conn(0x7f35c40c9f40 msgr2=0x7f35c40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:45.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.593+0000 7f35c9311640 1 -- 10.20.193.5:0/1397221699 shutdown_connections 2026-02-17T21:30:45.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.593+0000 7f35c9311640 1 -- 10.20.193.5:0/1397221699 wait complete. 2026-02-17T21:30:45.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.593+0000 7f35c9311640 10 monclient: build_initial_monmap 2026-02-17T21:30:45.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.593+0000 7f35c9311640 10 monclient: monmap: 2026-02-17T21:30:45.608 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:45.608 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:45.608 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:45.608 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:45.608 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:45.608 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.608 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:45.608 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:45.608 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:45.608 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.594+0000 7f35c9311640 1 librados: starting msgr at 2026-02-17T21:30:45.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.594+0000 7f35c9311640 1 librados: starting objecter 2026-02-17T21:30:45.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.594+0000 7f35c9311640 1 Processor -- start 2026-02-17T21:30:45.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.594+0000 7f35c9311640 1 -- start start 2026-02-17T21:30:45.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.594+0000 7f35c9311640 1 librados: setting wanted keys 2026-02-17T21:30:45.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.594+0000 7f35c9311640 1 librados: calling monclient init 2026-02-17T21:30:45.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.594+0000 7f35c9311640 10 monclient: init 2026-02-17T21:30:45.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.594+0000 7f35c9311640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:45.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.594+0000 7f35c9311640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:30:45.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.594+0000 7f35c9311640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f35c4074ef0 0x7f35c4158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.594+0000 7f35c9311640 10 monclient(hunting): picked mon.noname-b con 0x7f35c4074ef0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:45.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.594+0000 7f35c9311640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f35c40c48c0 0x7f35c415b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.594+0000 7f35c9311640 10 monclient(hunting): picked mon.noname-a con 0x7f35c40c48c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:45.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.594+0000 7f35c9311640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f35c40c7170 0x7f35c415bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.594+0000 7f35c9311640 10 monclient(hunting): picked mon.noname-c con 0x7f35c40c7170 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:45.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.594+0000 7f35c9311640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.594+0000 7f35c9311640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f35c40c81c0 con 0x7f35c40c48c0 2026-02-17T21:30:45.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.594+0000 7f35c9311640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.594+0000 7f35c9311640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f35c40c7ee0 con 0x7f35c4074ef0 2026-02-17T21:30:45.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.594+0000 7f35c9311640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.594+0000 7f35c9311640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f35c40c90d0 con 0x7f35c40c7170 2026-02-17T21:30:45.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.594+0000 7f35c9311640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:45.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.594+0000 7f35c9311640 10 monclient(hunting): authenticate will time out at 1351.160542s 2026-02-17T21:30:45.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.594+0000 7f35c37fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f35c40c7170 0x7f35c415bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.594+0000 7f35c2ffd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f35c4074ef0 0x7f35c4158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.595+0000 7f35c37fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f35c40c7170 0x7f35c415bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:33948/0 (socket says 10.20.193.5:33948) 2026-02-17T21:30:45.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.595+0000 7f35c37fe640 1 -- 10.20.193.5:0/3831048068 learned_addr learned my addr 10.20.193.5:0/3831048068 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:45.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.595+0000 7f35c37fe640 10 monclient(hunting): get_auth_request con 0x7f35c40c7170 auth_method 0 2026-02-17T21:30:45.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.595+0000 7f35c37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:45.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.595+0000 7f35c37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.595+0000 7f35c37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.595+0000 7f35c27fc640 1 --2- 10.20.193.5:0/3831048068 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f35c40c48c0 0x7f35c415b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.595+0000 7f35c2ffd640 10 monclient(hunting): get_auth_request con 0x7f35c4074ef0 auth_method 0 2026-02-17T21:30:45.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.595+0000 7f35c2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:45.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.595+0000 7f35c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.595+0000 7f35c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.595+0000 7f35c37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:45.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.595+0000 7f35c37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:45.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.595+0000 7f35c37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:45.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.595+0000 7f35c27fc640 10 monclient(hunting): get_auth_request con 0x7f35c40c48c0 auth_method 0 2026-02-17T21:30:45.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.595+0000 7f35c27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:45.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.595+0000 7f35c27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.595+0000 7f35c27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.595+0000 7f35c2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:45.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.595+0000 7f35c2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:45.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.595+0000 7f35c2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:45.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.595+0000 7f35c27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:45.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.595+0000 7f35c27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:45.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.595+0000 7f35c27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:45.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.596+0000 7f35c37fe640 10 monclient(hunting): handle_auth_done global_id 5207 payload 824 2026-02-17T21:30:45.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.596+0000 7f35c37fe640 1 -- 10.20.193.5:0/3831048068 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f35c4074ef0 msgr2=0x7f35c4158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.596+0000 7f35c37fe640 1 --2- 10.20.193.5:0/3831048068 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f35c4074ef0 0x7f35c4158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.596+0000 7f35c37fe640 1 -- 10.20.193.5:0/3831048068 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f35c40c48c0 msgr2=0x7f35c415b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.596+0000 7f35c37fe640 1 --2- 10.20.193.5:0/3831048068 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f35c40c48c0 0x7f35c415b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.596+0000 7f35c37fe640 10 monclient: _finish_hunting 0 2026-02-17T21:30:45.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.596+0000 7f35c37fe640 1 monclient: found mon.noname-c 2026-02-17T21:30:45.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.596+0000 7f35c37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:45.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.596+0000 7f35c37fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:45.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.596+0000 7f35c37fe640 1 -- 10.20.193.5:0/3831048068 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c41f32e0 con 0x7f35c40c7170 2026-02-17T21:30:45.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.597+0000 7f35c37fe640 1 --2- 10.20.193.5:0/3831048068 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f35c40c7170 0x7f35c415bac0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f35b400cb40 tx=0x7f35b400a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:45.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.597+0000 7f35a37fe640 10 client.?.objecter ms_handle_connect 0x7f35c40c7170 2026-02-17T21:30:45.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.597+0000 7f35a37fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:45.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.598+0000 7f35a37fe640 1 -- 10.20.193.5:0/3831048068 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b400ad50 con 0x7f35c40c7170 2026-02-17T21:30:45.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.598+0000 7f35a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:45.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.598+0000 7f35a37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:45.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.598+0000 7f35a37fe640 10 monclient: dump: 2026-02-17T21:30:45.616 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:45.617 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.617 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.617 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.617 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:45.617 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.617 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:45.617 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:45.617 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:45.617 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.598+0000 7f35a37fe640 10 monclient: _finish_auth 0 2026-02-17T21:30:45.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.598+0000 7f35a37fe640 10 monclient: _check_auth_tickets 2026-02-17T21:30:45.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.598+0000 7f35a37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:45.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.598+0000 7f35c9311640 5 monclient: authenticate success, global_id 5207 2026-02-17T21:30:45.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.598+0000 7f35c9311640 10 monclient: _renew_subs 2026-02-17T21:30:45.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.598+0000 7f35c9311640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:45.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.598+0000 7f35c9311640 1 -- 10.20.193.5:0/3831048068 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35c41f35c0 con 0x7f35c40c7170 2026-02-17T21:30:45.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.598+0000 7f35c9311640 10 client.5207.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:45.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.598+0000 7f35c9311640 10 monclient: _renew_subs 2026-02-17T21:30:45.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.598+0000 7f35c9311640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:45.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.598+0000 7f35c9311640 1 -- 10.20.193.5:0/3831048068 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35c41f3b80 con 0x7f35c40c7170 2026-02-17T21:30:45.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.598+0000 7f35c9311640 1 librados: init done 2026-02-17T21:30:45.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.599+0000 7f35c9311640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:45.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.599+0000 7f35c9311640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:45.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.599+0000 7f35c9311640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:45.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.599+0000 7f35c9311640 1 -- 10.20.193.5:0/3831048068 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35c41f3d80 con 0x7f35c40c7170 2026-02-17T21:30:45.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.599+0000 7f35a37fe640 1 -- 10.20.193.5:0/3831048068 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b4025430 con 0x7f35c40c7170 2026-02-17T21:30:45.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.599+0000 7f35a37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:45.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.599+0000 7f35a37fe640 1 -- 10.20.193.5:0/3831048068 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b4025860 con 0x7f35c40c7170 2026-02-17T21:30:45.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.599+0000 7f35a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:45.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.599+0000 7f35a37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:45.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.599+0000 7f35a37fe640 10 monclient: dump: 2026-02-17T21:30:45.619 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:45.619 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.619 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.619 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.619 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:45.619 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.620 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:45.620 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:45.620 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:45.620 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.599+0000 7f35c17fa640 4 set_mon_vals no callback set 2026-02-17T21:30:45.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.708+0000 7f35a37fe640 1 -- 10.20.193.5:0/3831048068 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f35b4025a00 con 0x7f35c40c7170 2026-02-17T21:30:45.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.708+0000 7f35a37fe640 1 --2- 10.20.193.5:0/3831048068 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3590079280 0x7f359007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.708+0000 7f35c2ffd640 1 --2- 10.20.193.5:0/3831048068 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3590079280 0x7f359007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.708+0000 7f35c2ffd640 10 monclient: get_auth_request con 0x7f3590079280 auth_method 0 2026-02-17T21:30:45.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.709+0000 7f35a37fe640 10 client.5207.objecter ms_handle_connect 0x7f3590079280 2026-02-17T21:30:45.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.709+0000 7f35c2ffd640 1 --2- 10.20.193.5:0/3831048068 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3590079280 0x7f359007b740 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f35c41ed7a0 tx=0x7f35b8009290 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:45.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.710+0000 7f35a37fe640 1 -- 10.20.193.5:0/3831048068 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f35b4025d20 con 0x7f35c40c7170 2026-02-17T21:30:45.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.710+0000 7f35a37fe640 10 client.5207.objecter ms_dispatch2 0x7f35c4000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:45.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.710+0000 7f35a37fe640 3 client.5207.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:45.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.710+0000 7f35a37fe640 3 client.5207.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:45.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.710+0000 7f35a37fe640 20 client.5207.objecter dump_active .. 0 homeless 2026-02-17T21:30:45.719 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.717+0000 7f35a37fe640 1 -- 10.20.193.5:0/3831048068 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f35b4062d20 con 0x7f35c40c7170 2026-02-17T21:30:45.719 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.717+0000 7f35a37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:45.719 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.717+0000 7f35a37fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:45.803 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.801+0000 7f35c9311640 1 -- 10.20.193.5:0/3831048068 --> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f35c40c4d10 con 0x7f3590079280 2026-02-17T21:30:45.804 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.801+0000 7f35a37fe640 1 -- 10.20.193.5:0/3831048068 <== mgr.4131 v2:10.20.193.176:6800/2898618020 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f35c40c4d10 con 0x7f3590079280 2026-02-17T21:30:45.804 INFO:teuthology.orchestra.run.trial005.stderr:instructed osd(s) 4 to deep-scrub 2026-02-17T21:30:45.805 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.802+0000 7f35c9311640 10 librados: watch_flush enter 2026-02-17T21:30:45.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.802+0000 7f35c9311640 10 librados: watch_flush exit 2026-02-17T21:30:45.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.802+0000 7f35c9311640 20 client.5207.objecter shutdown clearing up homeless session... 2026-02-17T21:30:45.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.802+0000 7f35c9311640 10 client.5207.objecter successfully canceled tick 2026-02-17T21:30:45.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.802+0000 7f35c9311640 1 -- 10.20.193.5:0/3831048068 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3590079280 msgr2=0x7f359007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.802+0000 7f35c9311640 1 --2- 10.20.193.5:0/3831048068 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3590079280 0x7f359007b740 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f35c41ed7a0 tx=0x7f35b8009290 comp rx=0 tx=0).stop 2026-02-17T21:30:45.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.802+0000 7f35c9311640 10 monclient: shutdown 2026-02-17T21:30:45.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.802+0000 7f35c9311640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:45.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.802+0000 7f35c9311640 1 -- 10.20.193.5:0/3831048068 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f35c40c7170 msgr2=0x7f35c415bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.802+0000 7f35c9311640 1 --2- 10.20.193.5:0/3831048068 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f35c40c7170 0x7f35c415bac0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f35b400cb40 tx=0x7f35b400a430 comp rx=0 tx=0).stop 2026-02-17T21:30:45.806 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.802+0000 7f35c9311640 1 -- 10.20.193.5:0/3831048068 shutdown_connections 2026-02-17T21:30:45.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.802+0000 7f35c9311640 1 --2- 10.20.193.5:0/3831048068 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f3590079280 0x7f359007b740 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.802+0000 7f35c9311640 1 --2- 10.20.193.5:0/3831048068 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f35c40c7170 0x7f35c415bac0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.802+0000 7f35c9311640 1 --2- 10.20.193.5:0/3831048068 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f35c40c48c0 0x7f35c415b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.802+0000 7f35c9311640 1 --2- 10.20.193.5:0/3831048068 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f35c4074ef0 0x7f35c4158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.802+0000 7f35c9311640 1 -- 10.20.193.5:0/3831048068 >> 10.20.193.5:0/3831048068 conn(0x7f35c40c9f40 msgr2=0x7f35c4158f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:45.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.802+0000 7f35c9311640 1 -- 10.20.193.5:0/3831048068 shutdown_connections 2026-02-17T21:30:45.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.802+0000 7f35c9311640 1 -- 10.20.193.5:0/3831048068 wait complete. 2026-02-17T21:30:45.807 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.803+0000 7f35c9311640 1 librados: shutdown 2026-02-17T21:30:45.814 INFO:tasks.ceph:Scrubbing osd.8 2026-02-17T21:30:45.814 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:30:45.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.881+0000 7f67480cd640 10 monclient: get_monmap_and_config 2026-02-17T21:30:45.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.881+0000 7f67480cd640 10 monclient: build_initial_monmap 2026-02-17T21:30:45.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.881+0000 7f67480cd640 10 monclient: monmap: 2026-02-17T21:30:45.883 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:45.883 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.884 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:45.882713+0000 2026-02-17T21:30:45.884 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:45.882713+0000 2026-02-17T21:30:45.884 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:45.884 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.884 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:45.884 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:45.884 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:45.884 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:45.884 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:45.884 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:45.885 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.888 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.881+0000 7f67480cd640 1 Processor -- start 2026-02-17T21:30:45.888 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.881+0000 7f67480cd640 1 -- start start 2026-02-17T21:30:45.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.881+0000 7f67480cd640 10 monclient: init 2026-02-17T21:30:45.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f67480cd640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:45.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f67480cd640 10 monclient: _add_conns ranks=[1,4,3,5,0,2] 2026-02-17T21:30:45.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f67480cd640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f6740155e20 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:45.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f67480cd640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f6740156200 0x7f67400c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f67480cd640 10 monclient(hunting): picked mon.noname-b con 0x7f6740156200 addr v2:10.20.193.119:3300/0 2026-02-17T21:30:45.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f67480cd640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f67400c9230 0x7f674015daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f67480cd640 10 monclient(hunting): picked mon.noname-a con 0x7f67400c9230 addr v2:10.20.193.5:3300/0 2026-02-17T21:30:45.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f67480cd640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67400c97e0 con 0x7f6740155e20 2026-02-17T21:30:45.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f67480cd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f67480cd640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f67400cbd60 con 0x7f67400c9230 2026-02-17T21:30:45.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f67480cd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f67480cd640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f67400c9ac0 con 0x7f6740156200 2026-02-17T21:30:45.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f67480cd640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:45.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f67480cd640 10 monclient(hunting): authenticate will time out at 1351.448205s 2026-02-17T21:30:45.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f6745641640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f6740156200 0x7f67400c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f6746643640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f67400c9230 0x7f674015daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f6745641640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f6740156200 0x7f67400c8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:34438/0 (socket says 10.20.193.5:34438) 2026-02-17T21:30:45.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f6745641640 1 -- 10.20.193.5:0/658564636 learned_addr learned my addr 10.20.193.5:0/658564636 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:45.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f6745641640 10 monclient(hunting): get_auth_request con 0x7f6740156200 auth_method 0 2026-02-17T21:30:45.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f6745641640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:45.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f6745641640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f6745641640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f6746643640 10 monclient(hunting): get_auth_request con 0x7f67400c9230 auth_method 0 2026-02-17T21:30:45.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f6746643640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:45.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f6746643640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.891 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.882+0000 7f6746643640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.883+0000 7f6746643640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:45.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.883+0000 7f6746643640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:45.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.883+0000 7f6746643640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:45.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.883+0000 7f6745641640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:45.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.883+0000 7f6745641640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:45.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.883+0000 7f6745641640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:45.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.884+0000 7f6746643640 10 monclient(hunting): handle_auth_done global_id 5136 payload 274 2026-02-17T21:30:45.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.884+0000 7f6746643640 1 -- 10.20.193.5:0/658564636 >> v2:10.20.193.119:3300/0 conn(0x7f6740156200 msgr2=0x7f67400c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:45.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.884+0000 7f6746643640 1 --2- 10.20.193.5:0/658564636 >> v2:10.20.193.119:3300/0 conn(0x7f6740156200 0x7f67400c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.884+0000 7f6746643640 1 -- 10.20.193.5:0/658564636 >> v1:10.20.193.119:6789/0 conn(0x7f6740155e20 legacy=0x7f67400cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.892 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.884+0000 7f6746643640 10 monclient: _finish_hunting 0 2026-02-17T21:30:45.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.884+0000 7f6746643640 1 monclient: found mon.noname-a 2026-02-17T21:30:45.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.884+0000 7f6746643640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:45.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.884+0000 7f6746643640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:45.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.884+0000 7f6746643640 1 -- 10.20.193.5:0/658564636 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67400c9da0 con 0x7f67400c9230 2026-02-17T21:30:45.893 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.886+0000 7f6746643640 1 --2- 10.20.193.5:0/658564636 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f67400c9230 0x7f674015daf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f674006cf30 tx=0x7f673c02f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2981acf25afcc379 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:45.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f6744e40640 1 -- 10.20.193.5:0/658564636 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c03c070 con 0x7f67400c9230 2026-02-17T21:30:45.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f6744e40640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:45.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f6744e40640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:45.898 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f6744e40640 10 monclient: dump: 2026-02-17T21:30:45.898 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:45.898 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.899 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.899 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.899 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:45.899 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.899 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:45.899 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:45.899 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:45.899 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f6744e40640 10 monclient: _finish_auth 0 2026-02-17T21:30:45.899 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f6744e40640 10 monclient: _check_auth_tickets 2026-02-17T21:30:45.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f6744e40640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:45.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f6744e40640 1 -- 10.20.193.5:0/658564636 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f673c037440 con 0x7f67400c9230 2026-02-17T21:30:45.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f6744e40640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:45.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f6744e40640 1 -- 10.20.193.5:0/658564636 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c037810 con 0x7f67400c9230 2026-02-17T21:30:45.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f67480cd640 5 monclient: authenticate success, global_id 5136 2026-02-17T21:30:45.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f67480cd640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:45.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f67480cd640 4 set_mon_vals no callback set 2026-02-17T21:30:45.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f6744e40640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:45.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f6744e40640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:45.900 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f6744e40640 10 monclient: dump: 2026-02-17T21:30:45.900 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:45.900 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.901 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.901 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.901 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:45.901 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.901 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:45.901 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:45.901 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:45.901 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f67480cd640 10 monclient: shutdown 2026-02-17T21:30:45.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f67480cd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:45.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f67480cd640 1 -- 10.20.193.5:0/658564636 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f67400c9230 msgr2=0x7f674015daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f67480cd640 1 --2- 10.20.193.5:0/658564636 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f67400c9230 0x7f674015daf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f674006cf30 tx=0x7f673c02f1c0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f67480cd640 1 -- 10.20.193.5:0/658564636 shutdown_connections 2026-02-17T21:30:45.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f67480cd640 1 --2- 10.20.193.5:0/658564636 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f67400c9230 0x7f674015daf0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f67480cd640 1 --2- 10.20.193.5:0/658564636 >> v2:10.20.193.119:3300/0 conn(0x7f6740156200 0x7f67400c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f67480cd640 1 -- 10.20.193.5:0/658564636 >> 10.20.193.5:0/658564636 conn(0x7f6740073030 msgr2=0x7f6740073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:45.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f67480cd640 1 -- 10.20.193.5:0/658564636 shutdown_connections 2026-02-17T21:30:45.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.888+0000 7f67480cd640 1 -- 10.20.193.5:0/658564636 wait complete. 2026-02-17T21:30:45.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.889+0000 7f67480cd640 10 monclient: build_initial_monmap 2026-02-17T21:30:45.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.889+0000 7f67480cd640 10 monclient: monmap: 2026-02-17T21:30:45.902 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:45.902 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:45.902 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:45.902 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:45.903 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:45.903 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.903 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:45.903 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:45.903 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:45.903 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.889+0000 7f67480cd640 1 librados: starting msgr at 2026-02-17T21:30:45.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.889+0000 7f67480cd640 1 librados: starting objecter 2026-02-17T21:30:45.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.889+0000 7f67480cd640 1 Processor -- start 2026-02-17T21:30:45.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.889+0000 7f67480cd640 1 -- start start 2026-02-17T21:30:45.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.889+0000 7f67480cd640 1 librados: setting wanted keys 2026-02-17T21:30:45.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.889+0000 7f67480cd640 1 librados: calling monclient init 2026-02-17T21:30:45.903 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.889+0000 7f67480cd640 10 monclient: init 2026-02-17T21:30:45.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.890+0000 7f67480cd640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:45.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.890+0000 7f67480cd640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:30:45.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.890+0000 7f67480cd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f67400c9230 0x7f67400c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.890+0000 7f67480cd640 10 monclient(hunting): picked mon.noname-a con 0x7f67400c9230 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:45.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.890+0000 7f67480cd640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6740155e20 0x7f67401f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.890+0000 7f67480cd640 10 monclient(hunting): picked mon.noname-c con 0x7f6740155e20 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:45.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.890+0000 7f67480cd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6740156200 0x7f67401f3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.890+0000 7f67480cd640 10 monclient(hunting): picked mon.noname-b con 0x7f6740156200 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:45.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.890+0000 7f67480cd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.890+0000 7f67480cd640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f67400d2750 con 0x7f67400c9230 2026-02-17T21:30:45.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.890+0000 7f67480cd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.890+0000 7f67480cd640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f674015d5d0 con 0x7f6740156200 2026-02-17T21:30:45.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.890+0000 7f67480cd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:45.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.890+0000 7f67480cd640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f67400ca080 con 0x7f6740155e20 2026-02-17T21:30:45.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.890+0000 7f67480cd640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:45.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.890+0000 7f67480cd640 10 monclient(hunting): authenticate will time out at 1351.456410s 2026-02-17T21:30:45.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.890+0000 7f6745e42640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f67400c9230 0x7f67400c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.890+0000 7f6745641640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6740155e20 0x7f67401f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.890+0000 7f6745e42640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f67400c9230 0x7f67400c7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:60992/0 (socket says 10.20.193.5:60992) 2026-02-17T21:30:45.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.890+0000 7f6745e42640 1 -- 10.20.193.5:0/2610114889 learned_addr learned my addr 10.20.193.5:0/2610114889 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:45.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.890+0000 7f6745e42640 10 monclient(hunting): get_auth_request con 0x7f67400c9230 auth_method 0 2026-02-17T21:30:45.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.890+0000 7f6745e42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:45.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.890+0000 7f6745e42640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.890+0000 7f6745e42640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.890+0000 7f6746643640 1 --2- 10.20.193.5:0/2610114889 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6740156200 0x7f67401f3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.891+0000 7f6745641640 10 monclient(hunting): get_auth_request con 0x7f6740155e20 auth_method 0 2026-02-17T21:30:45.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.891+0000 7f6745641640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:45.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.891+0000 7f6745641640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.891+0000 7f6745641640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.891+0000 7f6745e42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:45.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.891+0000 7f6745e42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:45.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.891+0000 7f6745e42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:45.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.891+0000 7f6746643640 10 monclient(hunting): get_auth_request con 0x7f6740156200 auth_method 0 2026-02-17T21:30:45.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.891+0000 7f6746643640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:45.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.891+0000 7f6746643640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:45.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.891+0000 7f6746643640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:45.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.891+0000 7f6745641640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:45.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.891+0000 7f6745641640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:45.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.891+0000 7f6745641640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:45.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.891+0000 7f6746643640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:45.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.891+0000 7f6746643640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:45.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.891+0000 7f6746643640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:45.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.892+0000 7f6745e42640 10 monclient(hunting): handle_auth_done global_id 5139 payload 824 2026-02-17T21:30:45.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.892+0000 7f6745e42640 1 -- 10.20.193.5:0/2610114889 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6740155e20 msgr2=0x7f67401f2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.892+0000 7f6745e42640 1 --2- 10.20.193.5:0/2610114889 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6740155e20 0x7f67401f2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.892+0000 7f6745e42640 1 -- 10.20.193.5:0/2610114889 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6740156200 msgr2=0x7f67401f3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.892+0000 7f6745e42640 1 --2- 10.20.193.5:0/2610114889 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6740156200 0x7f67401f3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.907 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.892+0000 7f6745e42640 10 monclient: _finish_hunting 0 2026-02-17T21:30:45.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.892+0000 7f6745e42640 1 monclient: found mon.noname-a 2026-02-17T21:30:45.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.892+0000 7f6745e42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:45.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.892+0000 7f6745e42640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:45.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.892+0000 7f6745e42640 1 -- 10.20.193.5:0/2610114889 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67401f7110 con 0x7f67400c9230 2026-02-17T21:30:45.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.894+0000 7f6745e42640 1 --2- 10.20.193.5:0/2610114889 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f67400c9230 0x7f67400c7920 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f673000c5b0 tx=0x7f673000ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:45.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.894+0000 7f672e7fc640 10 client.?.objecter ms_handle_connect 0x7f67400c9230 2026-02-17T21:30:45.908 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.894+0000 7f672e7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:45.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f672e7fc640 1 -- 10.20.193.5:0/2610114889 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67300052d0 con 0x7f67400c9230 2026-02-17T21:30:45.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f672e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:45.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f672e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:45.910 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f672e7fc640 10 monclient: dump: 2026-02-17T21:30:45.910 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:45.910 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.910 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.910 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.910 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:45.910 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.911 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:45.911 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:45.911 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:45.911 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f672e7fc640 10 monclient: _finish_auth 0 2026-02-17T21:30:45.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f672e7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:30:45.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f672e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:45.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f672e7fc640 1 -- 10.20.193.5:0/2610114889 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6730005470 con 0x7f67400c9230 2026-02-17T21:30:45.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f672e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:45.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f672e7fc640 1 -- 10.20.193.5:0/2610114889 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67300038f0 con 0x7f67400c9230 2026-02-17T21:30:45.911 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f672e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:45.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f672e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:45.912 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f672e7fc640 10 monclient: dump: 2026-02-17T21:30:45.912 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:45.912 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:45.912 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.912 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:45.912 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:45.912 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:45.912 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:45.912 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:45.912 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:45.912 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:45.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f67480cd640 5 monclient: authenticate success, global_id 5139 2026-02-17T21:30:45.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f672ffff640 4 set_mon_vals no callback set 2026-02-17T21:30:45.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f67480cd640 10 monclient: _renew_subs 2026-02-17T21:30:45.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f67480cd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:45.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f67480cd640 1 -- 10.20.193.5:0/2610114889 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67401f1ea0 con 0x7f67400c9230 2026-02-17T21:30:45.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f67480cd640 10 client.5139.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:45.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f67480cd640 10 monclient: _renew_subs 2026-02-17T21:30:45.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f67480cd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:45.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f67480cd640 1 -- 10.20.193.5:0/2610114889 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67401f2140 con 0x7f67400c9230 2026-02-17T21:30:45.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f67480cd640 1 librados: init done 2026-02-17T21:30:45.913 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f67480cd640 10 client.5139.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:45.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f67480cd640 15 client.5139.objecter _session_command_op_assign -1 1 2026-02-17T21:30:45.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f67480cd640 20 client.5139.objecter _get_session osd=-1 returning homeless 2026-02-17T21:30:45.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f67480cd640 10 client.5139.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:45.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f67480cd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:45.914 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.897+0000 7f67480cd640 1 -- 10.20.193.5:0/2610114889 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f67400d08d0 con 0x7f67400c9230 2026-02-17T21:30:45.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.909+0000 7f672e7fc640 1 -- 10.20.193.5:0/2610114889 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f6730003a90 con 0x7f67400c9230 2026-02-17T21:30:45.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.910+0000 7f672e7fc640 1 --2- 10.20.193.5:0/2610114889 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f67100792d0 0x7f671007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.910+0000 7f6745641640 1 --2- 10.20.193.5:0/2610114889 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f67100792d0 0x7f671007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.910+0000 7f6745641640 10 monclient: get_auth_request con 0x7f67100792d0 auth_method 0 2026-02-17T21:30:45.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.911+0000 7f672e7fc640 10 client.5139.objecter ms_handle_connect 0x7f67100792d0 2026-02-17T21:30:45.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.911+0000 7f6745641640 1 --2- 10.20.193.5:0/2610114889 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f67100792d0 0x7f671007b790 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f674006d750 tx=0x7f6734009340 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:45.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.912+0000 7f672e7fc640 1 -- 10.20.193.5:0/2610114889 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f673005e2e0 con 0x7f67400c9230 2026-02-17T21:30:45.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.912+0000 7f672e7fc640 10 client.5139.objecter ms_dispatch2 0x7f6740000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:45.916 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.912+0000 7f672e7fc640 3 client.5139.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:45.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.912+0000 7f672e7fc640 3 client.5139.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:45.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.912+0000 7f672e7fc640 10 client.5139.objecter checking command 1 2026-02-17T21:30:45.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.912+0000 7f672e7fc640 1 --2- 10.20.193.5:0/2610114889 >> [v2:10.20.193.5:6816/1609723815,v1:10.20.193.5:6817/1609723815] conn(0x7f6710081810 0x7f6710083c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:45.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.912+0000 7f672e7fc640 20 client.5139.objecter _get_session s=0x7f6710081140 osd=8 3 2026-02-17T21:30:45.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.912+0000 7f672e7fc640 20 client.5139.objecter put_session s=0x7f6710081140 osd=8 3 2026-02-17T21:30:45.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.912+0000 7f672e7fc640 15 client.5139.objecter _session_command_op_remove -1 1 2026-02-17T21:30:45.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.912+0000 7f672e7fc640 20 client.5139.objecter _get_session s=0x7f6710081140 osd=8 3 2026-02-17T21:30:45.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.912+0000 7f672e7fc640 20 client.5139.objecter get_session s=0x7f6710081140 osd=8 3 2026-02-17T21:30:45.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.912+0000 7f672e7fc640 15 client.5139.objecter _session_command_op_assign 8 1 2026-02-17T21:30:45.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.912+0000 7f672e7fc640 20 client.5139.objecter put_session s=0x7f6710081140 osd=8 4 2026-02-17T21:30:45.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.912+0000 7f672e7fc640 10 client.5139.objecter _send_command 1 2026-02-17T21:30:45.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.912+0000 7f672e7fc640 1 -- 10.20.193.5:0/2610114889 --> [v2:10.20.193.5:6816/1609723815,v1:10.20.193.5:6817/1609723815] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6710084300 con 0x7f6710081810 2026-02-17T21:30:45.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.912+0000 7f672e7fc640 20 client.5139.objecter dump_active .. 0 homeless 2026-02-17T21:30:45.917 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.912+0000 7f672e7fc640 1 -- 10.20.193.5:0/2610114889 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f673005e6a0 con 0x7f67400c9230 2026-02-17T21:30:45.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.912+0000 7f672e7fc640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T21:30:45.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.912+0000 7f6746643640 1 --2- 10.20.193.5:0/2610114889 >> [v2:10.20.193.5:6816/1609723815,v1:10.20.193.5:6817/1609723815] conn(0x7f6710081810 0x7f6710083c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:45.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.913+0000 7f6746643640 10 monclient: get_auth_request con 0x7f6710081810 auth_method 0 2026-02-17T21:30:45.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.914+0000 7f6746643640 1 --2- 10.20.193.5:0/2610114889 >> [v2:10.20.193.5:6816/1609723815,v1:10.20.193.5:6817/1609723815] conn(0x7f6710081810 0x7f6710083c30 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:45.918 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.914+0000 7f672e7fc640 10 client.5139.objecter ms_handle_connect 0x7f6710081810 2026-02-17T21:30:45.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.924+0000 7f672e7fc640 1 -- 10.20.193.5:0/2610114889 <== osd.8 v2:10.20.193.5:6816/1609723815 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f6710084300 con 0x7f6710081810 2026-02-17T21:30:45.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.924+0000 7f672e7fc640 10 client.5139.objecter ms_dispatch2 0x7f6740000b90 command_reply(tid 1: 0 ) 2026-02-17T21:30:45.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.924+0000 7f672e7fc640 10 client.5139.objecter _finish_command 1 = system:0 2026-02-17T21:30:45.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.924+0000 7f672e7fc640 20 client.5139.objecter put_session s=0x7f6710081140 osd=8 4 2026-02-17T21:30:45.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.924+0000 7f672e7fc640 15 client.5139.objecter _session_command_op_remove 8 1 2026-02-17T21:30:45.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.931+0000 7f67480cd640 10 client.5139.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:30:45.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.931+0000 7f67480cd640 15 client.5139.objecter _session_command_op_assign -1 2 2026-02-17T21:30:45.933 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.931+0000 7f67480cd640 20 client.5139.objecter _get_session s=0x7f6710081140 osd=8 3 2026-02-17T21:30:45.934 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.931+0000 7f67480cd640 20 client.5139.objecter put_session s=0x7f6710081140 osd=8 3 2026-02-17T21:30:45.934 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.931+0000 7f67480cd640 20 client.5139.objecter _get_session s=0x7f6710081140 osd=8 3 2026-02-17T21:30:45.934 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.931+0000 7f67480cd640 15 client.5139.objecter _session_command_op_remove -1 2 2026-02-17T21:30:45.934 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.931+0000 7f67480cd640 20 client.5139.objecter get_session s=0x7f6710081140 osd=8 3 2026-02-17T21:30:45.934 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.931+0000 7f67480cd640 15 client.5139.objecter _session_command_op_assign 8 2 2026-02-17T21:30:45.934 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.931+0000 7f67480cd640 20 client.5139.objecter put_session s=0x7f6710081140 osd=8 4 2026-02-17T21:30:45.934 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.931+0000 7f67480cd640 10 client.5139.objecter _send_command 2 2026-02-17T21:30:45.934 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.931+0000 7f67480cd640 1 -- 10.20.193.5:0/2610114889 --> [v2:10.20.193.5:6816/1609723815,v1:10.20.193.5:6817/1609723815] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f674006a0a0 con 0x7f6710081810 2026-02-17T21:30:45.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.938+0000 7f672e7fc640 1 -- 10.20.193.5:0/2610114889 <== osd.8 v2:10.20.193.5:6816/1609723815 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f674006a0a0 con 0x7f6710081810 2026-02-17T21:30:45.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.938+0000 7f672e7fc640 10 client.5139.objecter ms_dispatch2 0x7f6740000b90 command_reply(tid 2: 0 ) 2026-02-17T21:30:45.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.938+0000 7f672e7fc640 10 client.5139.objecter _finish_command 2 = system:0 2026-02-17T21:30:45.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.938+0000 7f672e7fc640 20 client.5139.objecter put_session s=0x7f6710081140 osd=8 4 2026-02-17T21:30:45.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.938+0000 7f672e7fc640 15 client.5139.objecter _session_command_op_remove 8 2 2026-02-17T21:30:45.941 INFO:teuthology.orchestra.run.trial005.stdout:{ 2026-02-17T21:30:45.941 INFO:teuthology.orchestra.run.trial005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:30:45.942 INFO:teuthology.orchestra.run.trial005.stdout:} 2026-02-17T21:30:45.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.938+0000 7f67480cd640 10 librados: watch_flush enter 2026-02-17T21:30:45.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.938+0000 7f67480cd640 10 librados: watch_flush exit 2026-02-17T21:30:45.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.938+0000 7f67480cd640 10 client.5139.objecter close_session for osd.8 2026-02-17T21:30:45.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.938+0000 7f67480cd640 1 -- 10.20.193.5:0/2610114889 >> [v2:10.20.193.5:6816/1609723815,v1:10.20.193.5:6817/1609723815] conn(0x7f6710081810 msgr2=0x7f6710083c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.943 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.938+0000 7f67480cd640 1 --2- 10.20.193.5:0/2610114889 >> [v2:10.20.193.5:6816/1609723815,v1:10.20.193.5:6817/1609723815] conn(0x7f6710081810 0x7f6710083c30 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:45.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.938+0000 7f67480cd640 20 client.5139.objecter put_session s=0x7f6710081140 osd=8 1 2026-02-17T21:30:45.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.938+0000 7f67480cd640 20 client.5139.objecter shutdown clearing up homeless session... 2026-02-17T21:30:45.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.938+0000 7f67480cd640 10 client.5139.objecter successfully canceled tick 2026-02-17T21:30:45.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.938+0000 7f67480cd640 1 -- 10.20.193.5:0/2610114889 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f67100792d0 msgr2=0x7f671007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.938+0000 7f67480cd640 1 --2- 10.20.193.5:0/2610114889 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f67100792d0 0x7f671007b790 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f674006d750 tx=0x7f6734009340 comp rx=0 tx=0).stop 2026-02-17T21:30:45.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.938+0000 7f67480cd640 10 monclient: shutdown 2026-02-17T21:30:45.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.938+0000 7f67480cd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:45.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.938+0000 7f67480cd640 1 -- 10.20.193.5:0/2610114889 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f67400c9230 msgr2=0x7f67400c7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:45.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.938+0000 7f67480cd640 1 --2- 10.20.193.5:0/2610114889 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f67400c9230 0x7f67400c7920 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f673000c5b0 tx=0x7f673000ca80 comp rx=0 tx=0).stop 2026-02-17T21:30:45.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.938+0000 7f6746643640 1 -- 10.20.193.5:0/2610114889 reap_dead start 2026-02-17T21:30:45.944 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.939+0000 7f67480cd640 1 -- 10.20.193.5:0/2610114889 shutdown_connections 2026-02-17T21:30:45.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.939+0000 7f67480cd640 1 -- 10.20.193.5:0/2610114889 >> 10.20.193.5:0/2610114889 conn(0x7f6740073030 msgr2=0x7f67400cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:45.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.939+0000 7f67480cd640 1 -- 10.20.193.5:0/2610114889 shutdown_connections 2026-02-17T21:30:45.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.939+0000 7f67480cd640 1 -- 10.20.193.5:0/2610114889 wait complete. 2026-02-17T21:30:45.945 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:45.939+0000 7f67480cd640 1 librados: shutdown 2026-02-17T21:30:45.949 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2026-02-17T21:30:46.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.015+0000 7f03f4815640 10 monclient: get_monmap_and_config 2026-02-17T21:30:46.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.015+0000 7f03f4815640 10 monclient: build_initial_monmap 2026-02-17T21:30:46.017 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.015+0000 7f03f4815640 10 monclient: monmap: 2026-02-17T21:30:46.017 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:46.018 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:46.018 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:46.016908+0000 2026-02-17T21:30:46.018 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:46.016908+0000 2026-02-17T21:30:46.018 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:46.018 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.018 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:46.018 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:46.018 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:46.018 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:46.018 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:46.019 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:46.019 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.015+0000 7f03f4815640 1 Processor -- start 2026-02-17T21:30:46.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.015+0000 7f03f4815640 1 -- start start 2026-02-17T21:30:46.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.015+0000 7f03f4815640 10 monclient: init 2026-02-17T21:30:46.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.016+0000 7f03f4815640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:46.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.016+0000 7f03f4815640 10 monclient: _add_conns ranks=[3,0,1,5,4,2] 2026-02-17T21:30:46.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.016+0000 7f03f4815640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f03ec0c7170 0x7f03ec0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.016+0000 7f03f4815640 10 monclient(hunting): picked mon.noname-a con 0x7f03ec0c7170 addr v2:10.20.193.5:3300/0 2026-02-17T21:30:46.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.016+0000 7f03f4815640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f03ec0c48c0 addr v1:10.20.193.5:6789/0 2026-02-17T21:30:46.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.016+0000 7f03f4815640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f03ec0c4d10 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:46.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.016+0000 7f03f4815640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03ec15a9a0 con 0x7f03ec0c48c0 2026-02-17T21:30:46.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.016+0000 7f03f4815640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03ec0c5270 con 0x7f03ec0c4d10 2026-02-17T21:30:46.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.016+0000 7f03f4815640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:46.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.016+0000 7f03f4815640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f03ec0c8530 con 0x7f03ec0c7170 2026-02-17T21:30:46.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.016+0000 7f03f4815640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:46.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.016+0000 7f03f4815640 10 monclient(hunting): authenticate will time out at 1351.582211s 2026-02-17T21:30:46.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.016+0000 7f03f258a640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f03ec0c7170 0x7f03ec0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.016+0000 7f03f2d8b640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f03ec0c4d10 0x7f03ec0c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:43552/0 (socket says 10.20.193.5:43552) 2026-02-17T21:30:46.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.016+0000 7f03f2d8b640 1 -- 10.20.193.5:0/3957174977 learned_addr learned my addr 10.20.193.5:0/3957174977 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:46.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.017+0000 7f03f258a640 10 monclient(hunting): get_auth_request con 0x7f03ec0c7170 auth_method 0 2026-02-17T21:30:46.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.017+0000 7f03f258a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:46.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.017+0000 7f03f258a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.017+0000 7f03f258a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.017+0000 7f03f258a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:46.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.017+0000 7f03f258a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:46.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.017+0000 7f03f258a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:46.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.018+0000 7f03f1588640 1 -- 10.20.193.5:0/3957174977 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 674851783 0 0) 0x7f03ec0c5270 con 0x7f03ec0c4d10 2026-02-17T21:30:46.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.018+0000 7f03f1588640 10 monclient(hunting): _negotiate 2026-02-17T21:30:46.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.018+0000 7f03f1588640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.018+0000 7f03f1588640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.018+0000 7f03f1588640 10 monclient(hunting): my global_id is 5221 2026-02-17T21:30:46.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.018+0000 7f03f1588640 1 -- 10.20.193.5:0/3957174977 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03dc003620 con 0x7f03ec0c4d10 2026-02-17T21:30:46.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.019+0000 7f03f258a640 10 monclient(hunting): handle_auth_done global_id 5142 payload 274 2026-02-17T21:30:46.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.019+0000 7f03f258a640 1 -- 10.20.193.5:0/3957174977 >> v1:10.20.193.119:6789/0 conn(0x7f03ec0c4d10 legacy=0x7f03ec0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.019+0000 7f03f258a640 1 -- 10.20.193.5:0/3957174977 >> v1:10.20.193.5:6789/0 conn(0x7f03ec0c48c0 legacy=0x7f03ec0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.019+0000 7f03f258a640 10 monclient: _finish_hunting 0 2026-02-17T21:30:46.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.019+0000 7f03f258a640 1 monclient: found mon.noname-a 2026-02-17T21:30:46.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.019+0000 7f03f258a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:46.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.019+0000 7f03f258a640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:46.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.019+0000 7f03f258a640 1 -- 10.20.193.5:0/3957174977 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03ec0c5550 con 0x7f03ec0c7170 2026-02-17T21:30:46.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.020+0000 7f03f258a640 1 --2- 10.20.193.5:0/3957174977 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f03ec0c7170 0x7f03ec0c7550 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f03e40098a0 tx=0x7f03e402ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf92d958c5e117b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:46.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.022+0000 7f03f1588640 1 -- 10.20.193.5:0/3957174977 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e403c070 con 0x7f03ec0c7170 2026-02-17T21:30:46.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.022+0000 7f03f1588640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:46.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.022+0000 7f03f1588640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:46.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.022+0000 7f03f1588640 10 monclient: dump: 2026-02-17T21:30:46.031 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:46.031 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:46.031 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.032 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.032 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:46.032 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.032 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:46.032 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:46.032 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:46.032 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.022+0000 7f03f1588640 10 monclient: _finish_auth 0 2026-02-17T21:30:46.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.022+0000 7f03f1588640 10 monclient: _check_auth_tickets 2026-02-17T21:30:46.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.022+0000 7f03f1588640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:46.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.022+0000 7f03f1588640 1 -- 10.20.193.5:0/3957174977 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03e402fb70 con 0x7f03ec0c7170 2026-02-17T21:30:46.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.022+0000 7f03f1588640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:46.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.022+0000 7f03f1588640 1 -- 10.20.193.5:0/3957174977 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e4037440 con 0x7f03ec0c7170 2026-02-17T21:30:46.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.022+0000 7f03f1588640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:46.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.022+0000 7f03f1588640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:46.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.022+0000 7f03f1588640 10 monclient: dump: 2026-02-17T21:30:46.033 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:46.033 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:46.033 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.033 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.033 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:46.033 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.033 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:46.033 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:46.034 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:46.034 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.022+0000 7f03f4815640 5 monclient: authenticate success, global_id 5142 2026-02-17T21:30:46.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.022+0000 7f03f4815640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:46.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.022+0000 7f03f4815640 4 set_mon_vals no callback set 2026-02-17T21:30:46.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.023+0000 7f03f4815640 10 monclient: shutdown 2026-02-17T21:30:46.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.023+0000 7f03f4815640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:46.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.023+0000 7f03f4815640 1 -- 10.20.193.5:0/3957174977 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f03ec0c7170 msgr2=0x7f03ec0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.023+0000 7f03f4815640 1 --2- 10.20.193.5:0/3957174977 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f03ec0c7170 0x7f03ec0c7550 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f03e40098a0 tx=0x7f03e402ee60 comp rx=0 tx=0).stop 2026-02-17T21:30:46.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.023+0000 7f03f4815640 1 -- 10.20.193.5:0/3957174977 shutdown_connections 2026-02-17T21:30:46.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.023+0000 7f03f4815640 1 --2- 10.20.193.5:0/3957174977 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f03ec0c7170 0x7f03ec0c7550 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.023+0000 7f03f4815640 1 -- 10.20.193.5:0/3957174977 >> 10.20.193.5:0/3957174977 conn(0x7f03ec0c9f40 msgr2=0x7f03ec0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:46.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.023+0000 7f03f4815640 1 -- 10.20.193.5:0/3957174977 shutdown_connections 2026-02-17T21:30:46.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.023+0000 7f03f4815640 1 -- 10.20.193.5:0/3957174977 wait complete. 2026-02-17T21:30:46.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.023+0000 7f03f4815640 10 monclient: build_initial_monmap 2026-02-17T21:30:46.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.023+0000 7f03f4815640 10 monclient: monmap: 2026-02-17T21:30:46.035 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:46.035 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:46.035 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:46.035 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:46.035 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:46.035 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.035 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:46.035 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:46.036 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:46.036 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.024+0000 7f03f4815640 1 librados: starting msgr at 2026-02-17T21:30:46.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.024+0000 7f03f4815640 1 librados: starting objecter 2026-02-17T21:30:46.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.024+0000 7f03f4815640 1 Processor -- start 2026-02-17T21:30:46.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.024+0000 7f03f4815640 1 -- start start 2026-02-17T21:30:46.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.024+0000 7f03f4815640 1 librados: setting wanted keys 2026-02-17T21:30:46.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.024+0000 7f03f4815640 1 librados: calling monclient init 2026-02-17T21:30:46.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.024+0000 7f03f4815640 10 monclient: init 2026-02-17T21:30:46.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.024+0000 7f03f4815640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:46.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.024+0000 7f03f4815640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:30:46.036 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.024+0000 7f03f4815640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f03ec0c48c0 0x7f03ec0c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.024+0000 7f03f4815640 10 monclient(hunting): picked mon.noname-c con 0x7f03ec0c48c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:46.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.024+0000 7f03f4815640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f03ec0c4d10 0x7f03ec0be930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.024+0000 7f03f4815640 10 monclient(hunting): picked mon.noname-a con 0x7f03ec0c4d10 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:46.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.024+0000 7f03f4815640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f03ec0c7170 0x7f03ec14a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.024+0000 7f03f4815640 10 monclient(hunting): picked mon.noname-b con 0x7f03ec0c7170 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:46.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.024+0000 7f03f4815640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:46.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.024+0000 7f03f4815640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec0c81c0 con 0x7f03ec0c4d10 2026-02-17T21:30:46.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.024+0000 7f03f4815640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:46.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.024+0000 7f03f4815640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec0c7ee0 con 0x7f03ec0c7170 2026-02-17T21:30:46.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.024+0000 7f03f4815640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:46.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.024+0000 7f03f4815640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec0750c0 con 0x7f03ec0c48c0 2026-02-17T21:30:46.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.024+0000 7f03f4815640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:46.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.024+0000 7f03f4815640 10 monclient(hunting): authenticate will time out at 1351.590587s 2026-02-17T21:30:46.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.024+0000 7f03f1d89640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f03ec0c4d10 0x7f03ec0be930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.024+0000 7f03f2d8b640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f03ec0c7170 0x7f03ec14a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.025+0000 7f03f1d89640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f03ec0c4d10 0x7f03ec0be930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:32772/0 (socket says 10.20.193.5:32772) 2026-02-17T21:30:46.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.025+0000 7f03f1d89640 1 -- 10.20.193.5:0/2553295675 learned_addr learned my addr 10.20.193.5:0/2553295675 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:46.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.025+0000 7f03f1d89640 10 monclient(hunting): get_auth_request con 0x7f03ec0c4d10 auth_method 0 2026-02-17T21:30:46.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.025+0000 7f03f1d89640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:46.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.025+0000 7f03f1d89640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.025+0000 7f03f1d89640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.025+0000 7f03f258a640 1 --2- 10.20.193.5:0/2553295675 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f03ec0c48c0 0x7f03ec0c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.025+0000 7f03f2d8b640 10 monclient(hunting): get_auth_request con 0x7f03ec0c7170 auth_method 0 2026-02-17T21:30:46.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.025+0000 7f03f2d8b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:46.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.025+0000 7f03f2d8b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.025+0000 7f03f2d8b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.025+0000 7f03f1d89640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:46.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.025+0000 7f03f1d89640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:46.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.025+0000 7f03f1d89640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:46.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.025+0000 7f03f258a640 10 monclient(hunting): get_auth_request con 0x7f03ec0c48c0 auth_method 0 2026-02-17T21:30:46.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.025+0000 7f03f258a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:46.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.025+0000 7f03f258a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.025+0000 7f03f258a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.025+0000 7f03f2d8b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:46.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.025+0000 7f03f2d8b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:46.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.025+0000 7f03f2d8b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:46.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.025+0000 7f03f258a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:46.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.025+0000 7f03f258a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:46.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.025+0000 7f03f258a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:46.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.026+0000 7f03f1d89640 10 monclient(hunting): handle_auth_done global_id 5148 payload 824 2026-02-17T21:30:46.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.026+0000 7f03f1d89640 1 -- 10.20.193.5:0/2553295675 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f03ec0c48c0 msgr2=0x7f03ec0c37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.026+0000 7f03f1d89640 1 --2- 10.20.193.5:0/2553295675 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f03ec0c48c0 0x7f03ec0c37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.026+0000 7f03f1d89640 1 -- 10.20.193.5:0/2553295675 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f03ec0c7170 msgr2=0x7f03ec14a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.026+0000 7f03f1d89640 1 --2- 10.20.193.5:0/2553295675 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f03ec0c7170 0x7f03ec14a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.026+0000 7f03f1d89640 10 monclient: _finish_hunting 0 2026-02-17T21:30:46.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.026+0000 7f03f1d89640 1 monclient: found mon.noname-a 2026-02-17T21:30:46.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.026+0000 7f03f1d89640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:46.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.026+0000 7f03f1d89640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:46.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.026+0000 7f03f1d89640 1 -- 10.20.193.5:0/2553295675 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03ec0c2470 con 0x7f03ec0c4d10 2026-02-17T21:30:46.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.027+0000 7f03f1d89640 1 --2- 10.20.193.5:0/2553295675 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f03ec0c4d10 0x7f03ec0be930 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f03d800c700 tx=0x7f03d800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:46.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.027+0000 7f03d6ffd640 10 client.?.objecter ms_handle_connect 0x7f03ec0c4d10 2026-02-17T21:30:46.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.027+0000 7f03d6ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:46.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03d6ffd640 1 -- 10.20.193.5:0/2553295675 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d80052d0 con 0x7f03ec0c4d10 2026-02-17T21:30:46.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:46.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03d6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:46.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03d6ffd640 10 monclient: dump: 2026-02-17T21:30:46.043 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:46.043 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:46.043 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.043 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.043 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:46.043 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.044 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:46.044 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:46.044 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:46.044 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03d6ffd640 10 monclient: _finish_auth 0 2026-02-17T21:30:46.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03d6ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:30:46.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:46.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03d6ffd640 1 -- 10.20.193.5:0/2553295675 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03d8005470 con 0x7f03ec0c4d10 2026-02-17T21:30:46.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03d6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:46.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03d6ffd640 1 -- 10.20.193.5:0/2553295675 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d800a860 con 0x7f03ec0c4d10 2026-02-17T21:30:46.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:46.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03d6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:46.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03f0d87640 4 set_mon_vals no callback set 2026-02-17T21:30:46.045 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03d6ffd640 10 monclient: dump: 2026-02-17T21:30:46.045 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:46.045 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:46.045 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.045 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.045 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:46.045 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.045 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:46.045 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:46.045 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:46.045 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.045 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03f4815640 5 monclient: authenticate success, global_id 5148 2026-02-17T21:30:46.045 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03f4815640 10 monclient: _renew_subs 2026-02-17T21:30:46.045 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03f4815640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:46.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03f4815640 1 -- 10.20.193.5:0/2553295675 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03ec0c2750 con 0x7f03ec0c4d10 2026-02-17T21:30:46.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03f4815640 10 client.5148.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:46.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03f4815640 10 monclient: _renew_subs 2026-02-17T21:30:46.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03f4815640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:46.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03f4815640 1 -- 10.20.193.5:0/2553295675 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03ec0c2d10 con 0x7f03ec0c4d10 2026-02-17T21:30:46.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03f4815640 1 librados: init done 2026-02-17T21:30:46.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03f4815640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:46.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03f4815640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:46.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03f4815640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:46.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.029+0000 7f03f4815640 1 -- 10.20.193.5:0/2553295675 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03ec0c7550 con 0x7f03ec0c4d10 2026-02-17T21:30:46.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.135+0000 7f03d6ffd640 1 -- 10.20.193.5:0/2553295675 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f03d800aa00 con 0x7f03ec0c4d10 2026-02-17T21:30:46.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.136+0000 7f03d6ffd640 1 --2- 10.20.193.5:0/2553295675 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f03bc0792d0 0x7f03bc07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.136+0000 7f03f258a640 1 --2- 10.20.193.5:0/2553295675 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f03bc0792d0 0x7f03bc07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.136+0000 7f03f258a640 10 monclient: get_auth_request con 0x7f03bc0792d0 auth_method 0 2026-02-17T21:30:46.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.137+0000 7f03f258a640 1 --2- 10.20.193.5:0/2553295675 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f03bc0792d0 0x7f03bc07b790 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f03e4039000 tx=0x7f03e4033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:46.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.137+0000 7f03d6ffd640 10 client.5148.objecter ms_handle_connect 0x7f03bc0792d0 2026-02-17T21:30:46.145 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.143+0000 7f03d6ffd640 1 -- 10.20.193.5:0/2553295675 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f03d800ad20 con 0x7f03ec0c4d10 2026-02-17T21:30:46.145 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.143+0000 7f03d6ffd640 10 client.5148.objecter ms_dispatch2 0x7f03ec000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:46.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.143+0000 7f03d6ffd640 3 client.5148.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:46.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.143+0000 7f03d6ffd640 3 client.5148.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:46.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.143+0000 7f03d6ffd640 20 client.5148.objecter dump_active .. 0 homeless 2026-02-17T21:30:46.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.143+0000 7f03d6ffd640 1 -- 10.20.193.5:0/2553295675 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f03d8097e20 con 0x7f03ec0c4d10 2026-02-17T21:30:46.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.143+0000 7f03d6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:46.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.143+0000 7f03d6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:46.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.225+0000 7f03f4815640 1 -- 10.20.193.5:0/2553295675 --> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "8", "target": ["mon-mgr", ""]}) -- 0x7f03ec0731f0 con 0x7f03bc0792d0 2026-02-17T21:30:46.228 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.226+0000 7f03d6ffd640 1 -- 10.20.193.5:0/2553295675 <== mgr.4131 v2:10.20.193.176:6800/2898618020 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 8 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f03ec0731f0 con 0x7f03bc0792d0 2026-02-17T21:30:46.228 INFO:teuthology.orchestra.run.trial005.stderr:instructed osd(s) 8 to deep-scrub 2026-02-17T21:30:46.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.226+0000 7f03f4815640 10 librados: watch_flush enter 2026-02-17T21:30:46.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.226+0000 7f03f4815640 10 librados: watch_flush exit 2026-02-17T21:30:46.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.226+0000 7f03f4815640 20 client.5148.objecter shutdown clearing up homeless session... 2026-02-17T21:30:46.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.226+0000 7f03f4815640 10 client.5148.objecter successfully canceled tick 2026-02-17T21:30:46.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.226+0000 7f03f4815640 1 -- 10.20.193.5:0/2553295675 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f03bc0792d0 msgr2=0x7f03bc07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.226+0000 7f03f4815640 1 --2- 10.20.193.5:0/2553295675 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f03bc0792d0 0x7f03bc07b790 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f03e4039000 tx=0x7f03e4033000 comp rx=0 tx=0).stop 2026-02-17T21:30:46.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.226+0000 7f03f4815640 10 monclient: shutdown 2026-02-17T21:30:46.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.226+0000 7f03f4815640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:46.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.226+0000 7f03f4815640 1 -- 10.20.193.5:0/2553295675 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f03ec0c4d10 msgr2=0x7f03ec0be930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.226+0000 7f03f4815640 1 --2- 10.20.193.5:0/2553295675 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f03ec0c4d10 0x7f03ec0be930 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f03d800c700 tx=0x7f03d800cbd0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.231 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.226+0000 7f03f4815640 1 -- 10.20.193.5:0/2553295675 shutdown_connections 2026-02-17T21:30:46.231 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.226+0000 7f03f4815640 1 --2- 10.20.193.5:0/2553295675 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f03bc0792d0 0x7f03bc07b790 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.231 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.226+0000 7f03f4815640 1 --2- 10.20.193.5:0/2553295675 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f03ec0c7170 0x7f03ec14a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.231 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.226+0000 7f03f4815640 1 --2- 10.20.193.5:0/2553295675 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f03ec0c4d10 0x7f03ec0be930 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.231 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.226+0000 7f03f4815640 1 --2- 10.20.193.5:0/2553295675 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f03ec0c48c0 0x7f03ec0c37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.231 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.226+0000 7f03f4815640 1 -- 10.20.193.5:0/2553295675 >> 10.20.193.5:0/2553295675 conn(0x7f03ec0c9f40 msgr2=0x7f03ec0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:46.231 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.226+0000 7f03f4815640 1 -- 10.20.193.5:0/2553295675 shutdown_connections 2026-02-17T21:30:46.231 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.226+0000 7f03f4815640 1 -- 10.20.193.5:0/2553295675 wait complete. 2026-02-17T21:30:46.231 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.227+0000 7f03f4815640 1 librados: shutdown 2026-02-17T21:30:46.238 INFO:tasks.ceph:Scrubbing osd.12 2026-02-17T21:30:46.238 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:30:46.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.307+0000 7f83d2aa3640 10 monclient: get_monmap_and_config 2026-02-17T21:30:46.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.307+0000 7f83d2aa3640 10 monclient: build_initial_monmap 2026-02-17T21:30:46.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.307+0000 7f83d2aa3640 10 monclient: monmap: 2026-02-17T21:30:46.310 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:46.310 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:46.310 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:46.309389+0000 2026-02-17T21:30:46.310 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:46.309389+0000 2026-02-17T21:30:46.310 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:46.310 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.310 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:46.311 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:46.311 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:46.311 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:46.311 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:46.311 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:46.311 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.308+0000 7f83d2aa3640 1 Processor -- start 2026-02-17T21:30:46.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.308+0000 7f83d2aa3640 1 -- start start 2026-02-17T21:30:46.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.308+0000 7f83d2aa3640 10 monclient: init 2026-02-17T21:30:46.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.308+0000 7f83d2aa3640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:46.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.308+0000 7f83d2aa3640 10 monclient: _add_conns ranks=[4,5,3,0,2,1] 2026-02-17T21:30:46.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.308+0000 7f83d2aa3640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f83cc0c6db0 0x7f83cc0c7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.308+0000 7f83d2aa3640 10 monclient(hunting): picked mon.noname-b con 0x7f83cc0c6db0 addr v2:10.20.193.119:3300/0 2026-02-17T21:30:46.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.308+0000 7f83d2aa3640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f83cc0c4550 0x7f83cc0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.315 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.308+0000 7f83d2aa3640 10 monclient(hunting): picked mon.noname-c con 0x7f83cc0c4550 addr v2:10.20.193.135:3300/0 2026-02-17T21:30:46.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.308+0000 7f83d2aa3640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f83cc074b20 0x7f83cc0c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.308+0000 7f83d2aa3640 10 monclient(hunting): picked mon.noname-a con 0x7f83cc074b20 addr v2:10.20.193.5:3300/0 2026-02-17T21:30:46.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.308+0000 7f83d2aa3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:46.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.308+0000 7f83d2aa3640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f83cc0c4b90 con 0x7f83cc074b20 2026-02-17T21:30:46.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.308+0000 7f83d2aa3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:46.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.308+0000 7f83d2aa3640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f83cc0c4e70 con 0x7f83cc0c6db0 2026-02-17T21:30:46.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.308+0000 7f83d2aa3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:46.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.308+0000 7f83d2aa3640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f83cc0c5150 con 0x7f83cc0c4550 2026-02-17T21:30:46.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.308+0000 7f83d2aa3640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:46.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.308+0000 7f83d2aa3640 10 monclient(hunting): authenticate will time out at 1351.874742s 2026-02-17T21:30:46.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d22a2640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f83cc074b20 0x7f83cc0c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d12a0640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f83cc0c4550 0x7f83cc0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d1aa1640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f83cc0c6db0 0x7f83cc0c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d12a0640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f83cc0c4550 0x7f83cc0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:33972/0 (socket says 10.20.193.5:33972) 2026-02-17T21:30:46.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d12a0640 1 -- 10.20.193.5:0/2818527380 learned_addr learned my addr 10.20.193.5:0/2818527380 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:46.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d12a0640 10 monclient(hunting): get_auth_request con 0x7f83cc0c4550 auth_method 0 2026-02-17T21:30:46.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d12a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:46.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d12a0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d12a0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d22a2640 10 monclient(hunting): get_auth_request con 0x7f83cc074b20 auth_method 0 2026-02-17T21:30:46.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d22a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:46.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d22a2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d22a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d1aa1640 10 monclient(hunting): get_auth_request con 0x7f83cc0c6db0 auth_method 0 2026-02-17T21:30:46.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d1aa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:46.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d1aa1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d1aa1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d12a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:46.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d12a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:46.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d12a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:46.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d22a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:46.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d22a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:46.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d22a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:46.318 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d1aa1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:46.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d1aa1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:46.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.309+0000 7f83d1aa1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:46.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.310+0000 7f83d12a0640 10 monclient(hunting): handle_auth_done global_id 5216 payload 274 2026-02-17T21:30:46.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.310+0000 7f83d12a0640 1 -- 10.20.193.5:0/2818527380 >> v2:10.20.193.119:3300/0 conn(0x7f83cc0c6db0 msgr2=0x7f83cc0c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:46.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.310+0000 7f83d12a0640 1 --2- 10.20.193.5:0/2818527380 >> v2:10.20.193.119:3300/0 conn(0x7f83cc0c6db0 0x7f83cc0c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.310+0000 7f83d12a0640 1 -- 10.20.193.5:0/2818527380 >> v2:10.20.193.5:3300/0 conn(0x7f83cc074b20 msgr2=0x7f83cc0c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:46.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.310+0000 7f83d12a0640 1 --2- 10.20.193.5:0/2818527380 >> v2:10.20.193.5:3300/0 conn(0x7f83cc074b20 0x7f83cc0c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.310+0000 7f83d12a0640 10 monclient: _finish_hunting 0 2026-02-17T21:30:46.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.310+0000 7f83d12a0640 1 monclient: found mon.noname-c 2026-02-17T21:30:46.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.310+0000 7f83d12a0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:46.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.310+0000 7f83d12a0640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:46.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.310+0000 7f83d12a0640 1 -- 10.20.193.5:0/2818527380 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83cc0c5430 con 0x7f83cc0c4550 2026-02-17T21:30:46.320 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.311+0000 7f83d12a0640 1 --2- 10.20.193.5:0/2818527380 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f83cc0c4550 0x7f83cc0745e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0caa20 tx=0x7f83c002edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f95a31983b77317e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:46.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d0a9f640 1 -- 10.20.193.5:0/2818527380 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c003c070 con 0x7f83cc0c4550 2026-02-17T21:30:46.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d0a9f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:46.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d0a9f640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:46.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d0a9f640 10 monclient: dump: 2026-02-17T21:30:46.326 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:46.326 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:46.326 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.326 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.327 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:46.327 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.327 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:46.327 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:46.327 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:46.327 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d0a9f640 10 monclient: _finish_auth 0 2026-02-17T21:30:46.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d0a9f640 10 monclient: _check_auth_tickets 2026-02-17T21:30:46.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d0a9f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:46.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d0a9f640 1 -- 10.20.193.5:0/2818527380 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c002fab0 con 0x7f83cc0c4550 2026-02-17T21:30:46.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d0a9f640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:46.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d0a9f640 1 -- 10.20.193.5:0/2818527380 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c0037440 con 0x7f83cc0c4550 2026-02-17T21:30:46.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d2aa3640 5 monclient: authenticate success, global_id 5216 2026-02-17T21:30:46.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d2aa3640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:46.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d2aa3640 4 set_mon_vals no callback set 2026-02-17T21:30:46.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d0a9f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:46.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d0a9f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:46.328 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d0a9f640 10 monclient: dump: 2026-02-17T21:30:46.328 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:46.328 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:46.328 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.328 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.328 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:46.328 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.329 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:46.329 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:46.329 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:46.329 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d2aa3640 10 monclient: shutdown 2026-02-17T21:30:46.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d2aa3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:46.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d2aa3640 1 -- 10.20.193.5:0/2818527380 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f83cc0c4550 msgr2=0x7f83cc0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d2aa3640 1 --2- 10.20.193.5:0/2818527380 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f83cc0c4550 0x7f83cc0745e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0caa20 tx=0x7f83c002edf0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d2aa3640 1 -- 10.20.193.5:0/2818527380 shutdown_connections 2026-02-17T21:30:46.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d2aa3640 1 --2- 10.20.193.5:0/2818527380 >> v2:10.20.193.5:3300/0 conn(0x7f83cc074b20 0x7f83cc0c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d2aa3640 1 --2- 10.20.193.5:0/2818527380 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f83cc0c4550 0x7f83cc0745e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.329 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d2aa3640 1 --2- 10.20.193.5:0/2818527380 >> v2:10.20.193.119:3300/0 conn(0x7f83cc0c6db0 0x7f83cc0c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d2aa3640 1 -- 10.20.193.5:0/2818527380 >> 10.20.193.5:0/2818527380 conn(0x7f83cc0c9bd0 msgr2=0x7f83cc0c9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:46.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d2aa3640 1 -- 10.20.193.5:0/2818527380 shutdown_connections 2026-02-17T21:30:46.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.313+0000 7f83d2aa3640 1 -- 10.20.193.5:0/2818527380 wait complete. 2026-02-17T21:30:46.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.314+0000 7f83d2aa3640 10 monclient: build_initial_monmap 2026-02-17T21:30:46.330 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.314+0000 7f83d2aa3640 10 monclient: monmap: 2026-02-17T21:30:46.330 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:46.330 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:46.330 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:46.330 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:46.330 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:46.330 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.330 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:46.330 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:46.331 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:46.331 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.314+0000 7f83d2aa3640 1 librados: starting msgr at 2026-02-17T21:30:46.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.314+0000 7f83d2aa3640 1 librados: starting objecter 2026-02-17T21:30:46.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.314+0000 7f83d2aa3640 1 Processor -- start 2026-02-17T21:30:46.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.314+0000 7f83d2aa3640 1 -- start start 2026-02-17T21:30:46.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.314+0000 7f83d2aa3640 1 librados: setting wanted keys 2026-02-17T21:30:46.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.314+0000 7f83d2aa3640 1 librados: calling monclient init 2026-02-17T21:30:46.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.314+0000 7f83d2aa3640 10 monclient: init 2026-02-17T21:30:46.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d2aa3640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:46.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d2aa3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:30:46.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d2aa3640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f83cc074b20 0x7f83cc1f76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.331 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d2aa3640 10 monclient(hunting): picked mon.noname-a con 0x7f83cc074b20 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:46.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d2aa3640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f83cc0c4550 0x7f83cc13e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d2aa3640 10 monclient(hunting): picked mon.noname-b con 0x7f83cc0c4550 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:46.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d2aa3640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f83cc0c6db0 0x7f83cc073d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d2aa3640 10 monclient(hunting): picked mon.noname-c con 0x7f83cc0c6db0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:46.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d2aa3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:46.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d2aa3640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc0c8090 con 0x7f83cc074b20 2026-02-17T21:30:46.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d2aa3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:46.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d2aa3640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc0c7db0 con 0x7f83cc0c4550 2026-02-17T21:30:46.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d2aa3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:46.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d2aa3640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc15a690 con 0x7f83cc0c6db0 2026-02-17T21:30:46.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d2aa3640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:46.332 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d2aa3640 10 monclient(hunting): authenticate will time out at 1351.881386s 2026-02-17T21:30:46.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d12a0640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f83cc0c4550 0x7f83cc13e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d22a2640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f83cc0c6db0 0x7f83cc073d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d1aa1640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f83cc074b20 0x7f83cc1f76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d12a0640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f83cc0c4550 0x7f83cc13e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:34460/0 (socket says 10.20.193.5:34460) 2026-02-17T21:30:46.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d12a0640 1 -- 10.20.193.5:0/2767856235 learned_addr learned my addr 10.20.193.5:0/2767856235 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:46.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d12a0640 10 monclient(hunting): get_auth_request con 0x7f83cc0c4550 auth_method 0 2026-02-17T21:30:46.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d12a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:46.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d12a0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d12a0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d1aa1640 10 monclient(hunting): get_auth_request con 0x7f83cc074b20 auth_method 0 2026-02-17T21:30:46.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d1aa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:46.333 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d1aa1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d1aa1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d22a2640 10 monclient(hunting): get_auth_request con 0x7f83cc0c6db0 auth_method 0 2026-02-17T21:30:46.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d22a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:46.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d22a2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.315+0000 7f83d22a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.316+0000 7f83d12a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:46.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.316+0000 7f83d12a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:46.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.316+0000 7f83d12a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:46.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.316+0000 7f83d22a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:46.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.316+0000 7f83d22a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:46.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.316+0000 7f83d22a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:46.334 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.316+0000 7f83d1aa1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:46.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.316+0000 7f83d1aa1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:46.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.316+0000 7f83d1aa1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:46.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.317+0000 7f83d1aa1640 10 monclient(hunting): handle_auth_done global_id 5154 payload 824 2026-02-17T21:30:46.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.317+0000 7f83d1aa1640 1 -- 10.20.193.5:0/2767856235 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f83cc0c6db0 msgr2=0x7f83cc073d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.317+0000 7f83d1aa1640 1 --2- 10.20.193.5:0/2767856235 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f83cc0c6db0 0x7f83cc073d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.317+0000 7f83d1aa1640 1 -- 10.20.193.5:0/2767856235 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f83cc0c4550 msgr2=0x7f83cc13e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.317+0000 7f83d1aa1640 1 --2- 10.20.193.5:0/2767856235 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f83cc0c4550 0x7f83cc13e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.317+0000 7f83d1aa1640 10 monclient: _finish_hunting 0 2026-02-17T21:30:46.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.317+0000 7f83d1aa1640 1 monclient: found mon.noname-a 2026-02-17T21:30:46.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.317+0000 7f83d1aa1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:46.335 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.317+0000 7f83d1aa1640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:46.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.317+0000 7f83d1aa1640 1 -- 10.20.193.5:0/2767856235 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83cc1f3bd0 con 0x7f83cc074b20 2026-02-17T21:30:46.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.317+0000 7f83d22a2640 1 --2- 10.20.193.5:0/2767856235 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f83cc0c6db0 0x7f83cc073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T21:30:46.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.318+0000 7f83d1aa1640 1 --2- 10.20.193.5:0/2767856235 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f83cc074b20 0x7f83cc1f76e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00e9e0 tx=0x7f83bc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:46.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.318+0000 7f83ba7fc640 10 client.?.objecter ms_handle_connect 0x7f83cc074b20 2026-02-17T21:30:46.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.318+0000 7f83ba7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:46.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83ba7fc640 1 -- 10.20.193.5:0/2767856235 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc017070 con 0x7f83cc074b20 2026-02-17T21:30:46.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:46.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83ba7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:46.336 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83ba7fc640 10 monclient: dump: 2026-02-17T21:30:46.336 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:46.336 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:46.336 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.336 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.337 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:46.337 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.337 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:46.337 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:46.337 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:46.337 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83ba7fc640 10 monclient: _finish_auth 0 2026-02-17T21:30:46.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83ba7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:30:46.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83ba7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:46.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83ba7fc640 1 -- 10.20.193.5:0/2767856235 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83bc00ca00 con 0x7f83cc074b20 2026-02-17T21:30:46.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83ba7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:46.337 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83ba7fc640 1 -- 10.20.193.5:0/2767856235 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc00cdf0 con 0x7f83cc074b20 2026-02-17T21:30:46.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:46.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83ba7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:46.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83bbfff640 4 set_mon_vals no callback set 2026-02-17T21:30:46.338 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83ba7fc640 10 monclient: dump: 2026-02-17T21:30:46.338 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:46.338 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:46.338 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.338 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.338 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:46.338 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.338 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:46.338 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:46.338 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:46.339 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83d2aa3640 5 monclient: authenticate success, global_id 5154 2026-02-17T21:30:46.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83d2aa3640 10 monclient: _renew_subs 2026-02-17T21:30:46.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83d2aa3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:46.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83d2aa3640 1 -- 10.20.193.5:0/2767856235 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83cc1f3eb0 con 0x7f83cc074b20 2026-02-17T21:30:46.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83d2aa3640 10 client.5154.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:46.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83d2aa3640 10 monclient: _renew_subs 2026-02-17T21:30:46.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83d2aa3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:46.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83d2aa3640 1 -- 10.20.193.5:0/2767856235 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83cc1f4470 con 0x7f83cc074b20 2026-02-17T21:30:46.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83d2aa3640 1 librados: init done 2026-02-17T21:30:46.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83d2aa3640 10 client.5154.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:46.339 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83d2aa3640 15 client.5154.objecter _session_command_op_assign -1 1 2026-02-17T21:30:46.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83d2aa3640 20 client.5154.objecter _get_session osd=-1 returning homeless 2026-02-17T21:30:46.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83d2aa3640 10 client.5154.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:46.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83d2aa3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:46.340 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.320+0000 7f83d2aa3640 1 -- 10.20.193.5:0/2767856235 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f83cc0745e0 con 0x7f83cc074b20 2026-02-17T21:30:46.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.331+0000 7f83ba7fc640 1 -- 10.20.193.5:0/2767856235 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f83bc024060 con 0x7f83cc074b20 2026-02-17T21:30:46.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.332+0000 7f83ba7fc640 1 --2- 10.20.193.5:0/2767856235 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f839c079280 0x7f839c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.332+0000 7f83d12a0640 1 --2- 10.20.193.5:0/2767856235 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f839c079280 0x7f839c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.332+0000 7f83d12a0640 10 monclient: get_auth_request con 0x7f839c079280 auth_method 0 2026-02-17T21:30:46.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.332+0000 7f83d12a0640 1 --2- 10.20.193.5:0/2767856235 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f839c079280 0x7f839c07b740 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f83cc145e40 tx=0x7f83c0039040 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:46.342 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.332+0000 7f83ba7fc640 10 client.5154.objecter ms_handle_connect 0x7f839c079280 2026-02-17T21:30:46.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.333+0000 7f83ba7fc640 1 -- 10.20.193.5:0/2767856235 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f83bc097be0 con 0x7f83cc074b20 2026-02-17T21:30:46.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.333+0000 7f83ba7fc640 10 client.5154.objecter ms_dispatch2 0x7f83cc000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:46.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.333+0000 7f83ba7fc640 3 client.5154.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:46.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.333+0000 7f83ba7fc640 3 client.5154.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:46.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.333+0000 7f83ba7fc640 10 client.5154.objecter checking command 1 2026-02-17T21:30:46.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.333+0000 7f83ba7fc640 1 --2- 10.20.193.5:0/2767856235 >> [v2:10.20.193.5:6818/2028057944,v1:10.20.193.5:6819/2028057944] conn(0x7f839c081760 0x7f839c083b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.333+0000 7f83ba7fc640 20 client.5154.objecter _get_session s=0x7f839c081090 osd=12 3 2026-02-17T21:30:46.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.333+0000 7f83ba7fc640 20 client.5154.objecter put_session s=0x7f839c081090 osd=12 3 2026-02-17T21:30:46.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.333+0000 7f83ba7fc640 15 client.5154.objecter _session_command_op_remove -1 1 2026-02-17T21:30:46.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.333+0000 7f83ba7fc640 20 client.5154.objecter _get_session s=0x7f839c081090 osd=12 3 2026-02-17T21:30:46.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.333+0000 7f83ba7fc640 20 client.5154.objecter get_session s=0x7f839c081090 osd=12 3 2026-02-17T21:30:46.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.333+0000 7f83ba7fc640 15 client.5154.objecter _session_command_op_assign 12 1 2026-02-17T21:30:46.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.333+0000 7f83ba7fc640 20 client.5154.objecter put_session s=0x7f839c081090 osd=12 4 2026-02-17T21:30:46.343 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.333+0000 7f83ba7fc640 10 client.5154.objecter _send_command 1 2026-02-17T21:30:46.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.333+0000 7f83ba7fc640 1 -- 10.20.193.5:0/2767856235 --> [v2:10.20.193.5:6818/2028057944,v1:10.20.193.5:6819/2028057944] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83bc016ec0 con 0x7f839c081760 2026-02-17T21:30:46.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.333+0000 7f83ba7fc640 20 client.5154.objecter dump_active .. 0 homeless 2026-02-17T21:30:46.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.333+0000 7f83ba7fc640 1 -- 10.20.193.5:0/2767856235 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f83bc05e460 con 0x7f83cc074b20 2026-02-17T21:30:46.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.333+0000 7f83ba7fc640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T21:30:46.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.333+0000 7f83d22a2640 1 --2- 10.20.193.5:0/2767856235 >> [v2:10.20.193.5:6818/2028057944,v1:10.20.193.5:6819/2028057944] conn(0x7f839c081760 0x7f839c083b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.334+0000 7f83d22a2640 10 monclient: get_auth_request con 0x7f839c081760 auth_method 0 2026-02-17T21:30:46.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.335+0000 7f83ba7fc640 10 client.5154.objecter ms_handle_connect 0x7f839c081760 2026-02-17T21:30:46.344 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.335+0000 7f83d22a2640 1 --2- 10.20.193.5:0/2767856235 >> [v2:10.20.193.5:6818/2028057944,v1:10.20.193.5:6819/2028057944] conn(0x7f839c081760 0x7f839c083b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.12 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:46.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.345+0000 7f83ba7fc640 1 -- 10.20.193.5:0/2767856235 <== osd.12 v2:10.20.193.5:6818/2028057944 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f83bc016ec0 con 0x7f839c081760 2026-02-17T21:30:46.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.345+0000 7f83ba7fc640 10 client.5154.objecter ms_dispatch2 0x7f83cc000b90 command_reply(tid 1: 0 ) 2026-02-17T21:30:46.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.345+0000 7f83ba7fc640 10 client.5154.objecter _finish_command 1 = system:0 2026-02-17T21:30:46.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.345+0000 7f83ba7fc640 20 client.5154.objecter put_session s=0x7f839c081090 osd=12 4 2026-02-17T21:30:46.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.345+0000 7f83ba7fc640 15 client.5154.objecter _session_command_op_remove 12 1 2026-02-17T21:30:46.353 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.351+0000 7f83d2aa3640 10 client.5154.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:30:46.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.351+0000 7f83d2aa3640 15 client.5154.objecter _session_command_op_assign -1 2 2026-02-17T21:30:46.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.351+0000 7f83d2aa3640 20 client.5154.objecter _get_session s=0x7f839c081090 osd=12 3 2026-02-17T21:30:46.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.351+0000 7f83d2aa3640 20 client.5154.objecter put_session s=0x7f839c081090 osd=12 3 2026-02-17T21:30:46.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.351+0000 7f83d2aa3640 20 client.5154.objecter _get_session s=0x7f839c081090 osd=12 3 2026-02-17T21:30:46.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.351+0000 7f83d2aa3640 15 client.5154.objecter _session_command_op_remove -1 2 2026-02-17T21:30:46.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.351+0000 7f83d2aa3640 20 client.5154.objecter get_session s=0x7f839c081090 osd=12 3 2026-02-17T21:30:46.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.351+0000 7f83d2aa3640 15 client.5154.objecter _session_command_op_assign 12 2 2026-02-17T21:30:46.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.351+0000 7f83d2aa3640 20 client.5154.objecter put_session s=0x7f839c081090 osd=12 4 2026-02-17T21:30:46.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.351+0000 7f83d2aa3640 10 client.5154.objecter _send_command 2 2026-02-17T21:30:46.354 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.351+0000 7f83d2aa3640 1 -- 10.20.193.5:0/2767856235 --> [v2:10.20.193.5:6818/2028057944,v1:10.20.193.5:6819/2028057944] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f83cc157210 con 0x7f839c081760 2026-02-17T21:30:46.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.359+0000 7f83ba7fc640 1 -- 10.20.193.5:0/2767856235 <== osd.12 v2:10.20.193.5:6818/2028057944 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f83cc157210 con 0x7f839c081760 2026-02-17T21:30:46.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.359+0000 7f83ba7fc640 10 client.5154.objecter ms_dispatch2 0x7f83cc000b90 command_reply(tid 2: 0 ) 2026-02-17T21:30:46.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.359+0000 7f83ba7fc640 10 client.5154.objecter _finish_command 2 = system:0 2026-02-17T21:30:46.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.359+0000 7f83ba7fc640 20 client.5154.objecter put_session s=0x7f839c081090 osd=12 4 2026-02-17T21:30:46.362 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.359+0000 7f83ba7fc640 15 client.5154.objecter _session_command_op_remove 12 2 2026-02-17T21:30:46.362 INFO:teuthology.orchestra.run.trial005.stdout:{ 2026-02-17T21:30:46.363 INFO:teuthology.orchestra.run.trial005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:30:46.363 INFO:teuthology.orchestra.run.trial005.stdout:} 2026-02-17T21:30:46.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.359+0000 7f83d2aa3640 10 librados: watch_flush enter 2026-02-17T21:30:46.364 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.360+0000 7f83d2aa3640 10 librados: watch_flush exit 2026-02-17T21:30:46.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.360+0000 7f83d2aa3640 10 client.5154.objecter close_session for osd.12 2026-02-17T21:30:46.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.360+0000 7f83d2aa3640 1 -- 10.20.193.5:0/2767856235 >> [v2:10.20.193.5:6818/2028057944,v1:10.20.193.5:6819/2028057944] conn(0x7f839c081760 msgr2=0x7f839c083b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.360+0000 7f83d2aa3640 1 --2- 10.20.193.5:0/2767856235 >> [v2:10.20.193.5:6818/2028057944,v1:10.20.193.5:6819/2028057944] conn(0x7f839c081760 0x7f839c083b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.360+0000 7f83d2aa3640 20 client.5154.objecter put_session s=0x7f839c081090 osd=12 1 2026-02-17T21:30:46.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.360+0000 7f83d2aa3640 20 client.5154.objecter shutdown clearing up homeless session... 2026-02-17T21:30:46.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.360+0000 7f83d2aa3640 10 client.5154.objecter successfully canceled tick 2026-02-17T21:30:46.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.360+0000 7f83d2aa3640 1 -- 10.20.193.5:0/2767856235 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f839c079280 msgr2=0x7f839c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.360+0000 7f83d2aa3640 1 --2- 10.20.193.5:0/2767856235 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f839c079280 0x7f839c07b740 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f83cc145e40 tx=0x7f83c0039040 comp rx=0 tx=0).stop 2026-02-17T21:30:46.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.360+0000 7f83d2aa3640 10 monclient: shutdown 2026-02-17T21:30:46.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.360+0000 7f83d2aa3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:46.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.360+0000 7f83d2aa3640 1 -- 10.20.193.5:0/2767856235 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f83cc074b20 msgr2=0x7f83cc1f76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.360+0000 7f83d2aa3640 1 --2- 10.20.193.5:0/2767856235 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f83cc074b20 0x7f83cc1f76e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00e9e0 tx=0x7f83bc00eeb0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.360+0000 7f83d22a2640 1 -- 10.20.193.5:0/2767856235 reap_dead start 2026-02-17T21:30:46.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.360+0000 7f83d2aa3640 1 -- 10.20.193.5:0/2767856235 shutdown_connections 2026-02-17T21:30:46.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.360+0000 7f83d2aa3640 1 -- 10.20.193.5:0/2767856235 >> 10.20.193.5:0/2767856235 conn(0x7f83cc0c9bd0 msgr2=0x7f83cc0c9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:46.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.360+0000 7f83d2aa3640 1 -- 10.20.193.5:0/2767856235 shutdown_connections 2026-02-17T21:30:46.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.360+0000 7f83d2aa3640 1 -- 10.20.193.5:0/2767856235 wait complete. 2026-02-17T21:30:46.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.360+0000 7f83d2aa3640 1 librados: shutdown 2026-02-17T21:30:46.371 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 12 2026-02-17T21:30:46.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.438+0000 7fb182b85640 10 monclient: get_monmap_and_config 2026-02-17T21:30:46.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.438+0000 7fb182b85640 10 monclient: build_initial_monmap 2026-02-17T21:30:46.440 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.438+0000 7fb182b85640 10 monclient: monmap: 2026-02-17T21:30:46.441 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:46.441 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:46.441 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:46.439881+0000 2026-02-17T21:30:46.441 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:46.439881+0000 2026-02-17T21:30:46.441 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:46.441 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.441 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:46.441 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:46.441 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:46.441 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:46.441 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:46.442 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:46.442 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.438+0000 7fb182b85640 1 Processor -- start 2026-02-17T21:30:46.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.438+0000 7fb182b85640 1 -- start start 2026-02-17T21:30:46.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.438+0000 7fb182b85640 10 monclient: init 2026-02-17T21:30:46.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.439+0000 7fb182b85640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:46.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.439+0000 7fb182b85640 10 monclient: _add_conns ranks=[5,4,2,0,1,3] 2026-02-17T21:30:46.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.439+0000 7fb182b85640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fb17c0686b0 0x7fb17c068a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.439+0000 7fb182b85640 10 monclient(hunting): picked mon.noname-c con 0x7fb17c0686b0 addr v2:10.20.193.135:3300/0 2026-02-17T21:30:46.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.439+0000 7fb182b85640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fb17c15be30 0x7fb17c06eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.439+0000 7fb182b85640 10 monclient(hunting): picked mon.noname-b con 0x7fb17c15be30 addr v2:10.20.193.119:3300/0 2026-02-17T21:30:46.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.439+0000 7fb182b85640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb17c06f530 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:46.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.439+0000 7fb182b85640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb17c06f9a0 con 0x7fb17c06f530 2026-02-17T21:30:46.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.439+0000 7fb182b85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:46.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.439+0000 7fb182b85640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fb17c15cd30 con 0x7fb17c15be30 2026-02-17T21:30:46.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.439+0000 7fb182b85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:46.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.439+0000 7fb182b85640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb17c15c490 con 0x7fb17c0686b0 2026-02-17T21:30:46.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.439+0000 7fb182b85640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:46.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.439+0000 7fb182b85640 10 monclient(hunting): authenticate will time out at 1352.005380s 2026-02-17T21:30:46.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.439+0000 7fb173fff640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fb17c15be30 0x7fb17c06eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.439+0000 7fb1808fa640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fb17c0686b0 0x7fb17c068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.440+0000 7fb173fff640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fb17c15be30 0x7fb17c06eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:34476/0 (socket says 10.20.193.5:34476) 2026-02-17T21:30:46.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.440+0000 7fb173fff640 1 -- 10.20.193.5:0/1560177697 learned_addr learned my addr 10.20.193.5:0/1560177697 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:46.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.440+0000 7fb173fff640 10 monclient(hunting): get_auth_request con 0x7fb17c15be30 auth_method 0 2026-02-17T21:30:46.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.440+0000 7fb173fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:46.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.440+0000 7fb173fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.440+0000 7fb173fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.440+0000 7fb1808fa640 10 monclient(hunting): get_auth_request con 0x7fb17c0686b0 auth_method 0 2026-02-17T21:30:46.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.440+0000 7fb1808fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:46.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.440+0000 7fb1808fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.440+0000 7fb1808fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.440+0000 7fb173fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:46.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.440+0000 7fb173fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:46.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.440+0000 7fb173fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:46.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.440+0000 7fb1808fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:46.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.440+0000 7fb1808fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:46.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.440+0000 7fb1808fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:46.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.441+0000 7fb173fff640 10 monclient(hunting): handle_auth_done global_id 5233 payload 274 2026-02-17T21:30:46.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.441+0000 7fb173fff640 1 -- 10.20.193.5:0/1560177697 >> v2:10.20.193.135:3300/0 conn(0x7fb17c0686b0 msgr2=0x7fb17c068a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:46.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.441+0000 7fb173fff640 1 --2- 10.20.193.5:0/1560177697 >> v2:10.20.193.135:3300/0 conn(0x7fb17c0686b0 0x7fb17c068a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.441+0000 7fb173fff640 1 -- 10.20.193.5:0/1560177697 >> v1:10.20.193.135:6789/0 conn(0x7fb17c06f530 legacy=0x7fb17c155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.441+0000 7fb173fff640 10 monclient: _finish_hunting 0 2026-02-17T21:30:46.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.441+0000 7fb173fff640 1 monclient: found mon.noname-b 2026-02-17T21:30:46.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.441+0000 7fb173fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:46.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.441+0000 7fb173fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:30:46.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.441+0000 7fb173fff640 1 -- 10.20.193.5:0/1560177697 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17c15c770 con 0x7fb17c15be30 2026-02-17T21:30:46.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.442+0000 7fb173fff640 1 --2- 10.20.193.5:0/1560177697 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb17c15be30 0x7fb17c06eff0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb17c06d9c0 tx=0x7fb16402eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4fe234efd8afc64 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:46.455 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb1737fe640 1 -- 10.20.193.5:0/1560177697 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16403c070 con 0x7fb17c15be30 2026-02-17T21:30:46.455 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb1737fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:46.455 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb1737fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:30:46.455 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb1737fe640 10 monclient: dump: 2026-02-17T21:30:46.455 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:46.456 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:46.456 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.456 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.456 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:46.456 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.456 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:46.456 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:46.456 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:46.456 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.456 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb1737fe640 10 monclient: _finish_auth 0 2026-02-17T21:30:46.456 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb1737fe640 10 monclient: _check_auth_tickets 2026-02-17T21:30:46.456 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb1737fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:46.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb182b85640 5 monclient: authenticate success, global_id 5233 2026-02-17T21:30:46.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb182b85640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:46.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb1737fe640 1 -- 10.20.193.5:0/1560177697 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb16402fbe0 con 0x7fb17c15be30 2026-02-17T21:30:46.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb1737fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:46.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb1737fe640 1 -- 10.20.193.5:0/1560177697 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164037440 con 0x7fb17c15be30 2026-02-17T21:30:46.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb182b85640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:46.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb182b85640 4 set_mon_vals no callback set 2026-02-17T21:30:46.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb1737fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:46.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb1737fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:30:46.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb1737fe640 10 monclient: dump: 2026-02-17T21:30:46.457 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:46.457 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:46.458 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.458 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.458 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:46.458 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.458 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:46.458 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:46.458 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:46.458 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb182b85640 10 monclient: shutdown 2026-02-17T21:30:46.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb182b85640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:46.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb182b85640 1 -- 10.20.193.5:0/1560177697 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb17c15be30 msgr2=0x7fb17c06eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb182b85640 1 --2- 10.20.193.5:0/1560177697 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb17c15be30 0x7fb17c06eff0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb17c06d9c0 tx=0x7fb16402eed0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb182b85640 1 -- 10.20.193.5:0/1560177697 shutdown_connections 2026-02-17T21:30:46.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb182b85640 1 --2- 10.20.193.5:0/1560177697 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb17c15be30 0x7fb17c06eff0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb182b85640 1 --2- 10.20.193.5:0/1560177697 >> v2:10.20.193.135:3300/0 conn(0x7fb17c0686b0 0x7fb17c068a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb182b85640 1 -- 10.20.193.5:0/1560177697 >> 10.20.193.5:0/1560177697 conn(0x7fb17c0cb3a0 msgr2=0x7fb17c0cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:46.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb182b85640 1 -- 10.20.193.5:0/1560177697 shutdown_connections 2026-02-17T21:30:46.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.444+0000 7fb182b85640 1 -- 10.20.193.5:0/1560177697 wait complete. 2026-02-17T21:30:46.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.445+0000 7fb182b85640 10 monclient: build_initial_monmap 2026-02-17T21:30:46.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.445+0000 7fb182b85640 10 monclient: monmap: 2026-02-17T21:30:46.459 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:46.459 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:46.459 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:46.459 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:46.459 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:46.460 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.460 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:46.460 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:46.460 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:46.460 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.445+0000 7fb182b85640 1 librados: starting msgr at 2026-02-17T21:30:46.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.445+0000 7fb182b85640 1 librados: starting objecter 2026-02-17T21:30:46.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.445+0000 7fb182b85640 1 Processor -- start 2026-02-17T21:30:46.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.445+0000 7fb182b85640 1 -- start start 2026-02-17T21:30:46.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.445+0000 7fb182b85640 1 librados: setting wanted keys 2026-02-17T21:30:46.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.445+0000 7fb182b85640 1 librados: calling monclient init 2026-02-17T21:30:46.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.445+0000 7fb182b85640 10 monclient: init 2026-02-17T21:30:46.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.445+0000 7fb182b85640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:46.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.445+0000 7fb182b85640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:30:46.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.445+0000 7fb182b85640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb17c0686b0 0x7fb17c147d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.445+0000 7fb182b85640 10 monclient(hunting): picked mon.noname-c con 0x7fb17c0686b0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:46.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.445+0000 7fb182b85640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb17c06f530 0x7fb17c159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.445+0000 7fb182b85640 10 monclient(hunting): picked mon.noname-b con 0x7fb17c06f530 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:46.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.445+0000 7fb182b85640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb17c15be30 0x7fb17c13ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.445+0000 7fb182b85640 10 monclient(hunting): picked mon.noname-a con 0x7fb17c15be30 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:46.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.445+0000 7fb182b85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:46.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.445+0000 7fb182b85640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb17c06ead0 con 0x7fb17c15be30 2026-02-17T21:30:46.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.445+0000 7fb182b85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:46.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.445+0000 7fb182b85640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb17c06e7f0 con 0x7fb17c06f530 2026-02-17T21:30:46.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.445+0000 7fb182b85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:46.461 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.445+0000 7fb182b85640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb17c1561f0 con 0x7fb17c0686b0 2026-02-17T21:30:46.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.445+0000 7fb182b85640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:46.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.445+0000 7fb182b85640 10 monclient(hunting): authenticate will time out at 1352.011955s 2026-02-17T21:30:46.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.446+0000 7fb173fff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb17c06f530 0x7fb17c159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.446+0000 7fb173fff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb17c06f530 0x7fb17c159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:34488/0 (socket says 10.20.193.5:34488) 2026-02-17T21:30:46.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.446+0000 7fb173fff640 1 -- 10.20.193.5:0/287661173 learned_addr learned my addr 10.20.193.5:0/287661173 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:46.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.446+0000 7fb173fff640 10 monclient(hunting): get_auth_request con 0x7fb17c06f530 auth_method 0 2026-02-17T21:30:46.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.446+0000 7fb173fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:46.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.446+0000 7fb173fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.446+0000 7fb173fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.446+0000 7fb1810fb640 1 --2- 10.20.193.5:0/287661173 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb17c15be30 0x7fb17c13ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.462 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.446+0000 7fb1808fa640 1 --2- 10.20.193.5:0/287661173 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb17c0686b0 0x7fb17c147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.446+0000 7fb1808fa640 10 monclient(hunting): get_auth_request con 0x7fb17c0686b0 auth_method 0 2026-02-17T21:30:46.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.446+0000 7fb1808fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:46.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.446+0000 7fb1808fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.446+0000 7fb1808fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.446+0000 7fb1810fb640 10 monclient(hunting): get_auth_request con 0x7fb17c15be30 auth_method 0 2026-02-17T21:30:46.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.446+0000 7fb1810fb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:46.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.446+0000 7fb1810fb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.446+0000 7fb1810fb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.446+0000 7fb173fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:46.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.446+0000 7fb173fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:46.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.446+0000 7fb173fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:46.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.446+0000 7fb1810fb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:46.463 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.446+0000 7fb1810fb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:46.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.447+0000 7fb1810fb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:46.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.447+0000 7fb1808fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:46.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.447+0000 7fb1808fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:46.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.447+0000 7fb1808fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:46.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.448+0000 7fb173fff640 10 monclient(hunting): handle_auth_done global_id 5236 payload 824 2026-02-17T21:30:46.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.448+0000 7fb173fff640 1 -- 10.20.193.5:0/287661173 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb17c0686b0 msgr2=0x7fb17c147d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.448+0000 7fb173fff640 1 --2- 10.20.193.5:0/287661173 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb17c0686b0 0x7fb17c147d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.448+0000 7fb173fff640 1 -- 10.20.193.5:0/287661173 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb17c15be30 msgr2=0x7fb17c13ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.448+0000 7fb173fff640 1 --2- 10.20.193.5:0/287661173 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb17c15be30 0x7fb17c13ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.448+0000 7fb173fff640 10 monclient: _finish_hunting 0 2026-02-17T21:30:46.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.448+0000 7fb173fff640 1 monclient: found mon.noname-b 2026-02-17T21:30:46.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.448+0000 7fb173fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:46.464 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.448+0000 7fb173fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:30:46.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.448+0000 7fb173fff640 1 -- 10.20.193.5:0/287661173 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17c1482d0 con 0x7fb17c06f530 2026-02-17T21:30:46.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.449+0000 7fb173fff640 1 --2- 10.20.193.5:0/287661173 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb17c06f530 0x7fb17c159ea0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb164009a70 tx=0x7fb1640047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:46.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.449+0000 7fb1717fa640 10 client.?.objecter ms_handle_connect 0x7fb17c06f530 2026-02-17T21:30:46.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.449+0000 7fb1717fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:46.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.450+0000 7fb1717fa640 1 -- 10.20.193.5:0/287661173 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16403c040 con 0x7fb17c06f530 2026-02-17T21:30:46.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.450+0000 7fb1717fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:46.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.450+0000 7fb1717fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:30:46.465 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.450+0000 7fb1717fa640 10 monclient: dump: 2026-02-17T21:30:46.465 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:46.465 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:46.465 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.465 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.466 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:46.466 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.466 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:46.466 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:46.466 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:46.466 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.450+0000 7fb1717fa640 10 monclient: _finish_auth 0 2026-02-17T21:30:46.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.450+0000 7fb1717fa640 10 monclient: _check_auth_tickets 2026-02-17T21:30:46.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.450+0000 7fb1717fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:46.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.450+0000 7fb1717fa640 1 -- 10.20.193.5:0/287661173 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb164045070 con 0x7fb17c06f530 2026-02-17T21:30:46.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.450+0000 7fb182b85640 5 monclient: authenticate success, global_id 5236 2026-02-17T21:30:46.466 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.450+0000 7fb182b85640 10 monclient: _renew_subs 2026-02-17T21:30:46.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.450+0000 7fb182b85640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:46.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.450+0000 7fb182b85640 1 -- 10.20.193.5:0/287661173 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb17c146a10 con 0x7fb17c06f530 2026-02-17T21:30:46.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.450+0000 7fb1717fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:46.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.450+0000 7fb1717fa640 1 -- 10.20.193.5:0/287661173 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164040670 con 0x7fb17c06f530 2026-02-17T21:30:46.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.450+0000 7fb1717fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:46.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.450+0000 7fb1717fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:30:46.467 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.450+0000 7fb1717fa640 10 monclient: dump: 2026-02-17T21:30:46.467 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:46.467 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:46.467 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.467 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.467 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:46.468 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.468 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:46.468 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:46.468 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:46.468 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.450+0000 7fb172ffd640 4 set_mon_vals no callback set 2026-02-17T21:30:46.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.450+0000 7fb182b85640 10 client.5236.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:46.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.450+0000 7fb182b85640 10 monclient: _renew_subs 2026-02-17T21:30:46.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.450+0000 7fb182b85640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:46.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.450+0000 7fb182b85640 1 -- 10.20.193.5:0/287661173 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb17c146fd0 con 0x7fb17c06f530 2026-02-17T21:30:46.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.450+0000 7fb182b85640 1 librados: init done 2026-02-17T21:30:46.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.451+0000 7fb182b85640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:46.468 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.451+0000 7fb182b85640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:46.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.451+0000 7fb182b85640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:46.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.451+0000 7fb182b85640 1 -- 10.20.193.5:0/287661173 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb17c068a90 con 0x7fb17c06f530 2026-02-17T21:30:46.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.462+0000 7fb1717fa640 1 -- 10.20.193.5:0/287661173 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fb16403f070 con 0x7fb17c06f530 2026-02-17T21:30:46.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.463+0000 7fb1717fa640 1 --2- 10.20.193.5:0/287661173 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb14c079280 0x7fb14c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.463+0000 7fb1808fa640 1 --2- 10.20.193.5:0/287661173 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb14c079280 0x7fb14c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.463+0000 7fb1808fa640 10 monclient: get_auth_request con 0x7fb14c079280 auth_method 0 2026-02-17T21:30:46.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.464+0000 7fb1808fa640 1 --2- 10.20.193.5:0/287661173 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb14c079280 0x7fb14c07b740 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb16c009c40 tx=0x7fb16c009290 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:46.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.464+0000 7fb1717fa640 10 client.5236.objecter ms_handle_connect 0x7fb14c079280 2026-02-17T21:30:46.470 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.465+0000 7fb1717fa640 1 -- 10.20.193.5:0/287661173 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fb1640bcb70 con 0x7fb17c06f530 2026-02-17T21:30:46.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.465+0000 7fb1717fa640 10 client.5236.objecter ms_dispatch2 0x7fb17c000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:46.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.465+0000 7fb1717fa640 3 client.5236.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:46.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.465+0000 7fb1717fa640 3 client.5236.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:46.471 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.465+0000 7fb1717fa640 20 client.5236.objecter dump_active .. 0 homeless 2026-02-17T21:30:46.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.566+0000 7fb1717fa640 1 -- 10.20.193.5:0/287661173 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb164087210 con 0x7fb17c06f530 2026-02-17T21:30:46.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.566+0000 7fb1717fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:46.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.566+0000 7fb1717fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:46.651 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.648+0000 7fb182b85640 1 -- 10.20.193.5:0/287661173 --> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "12", "target": ["mon-mgr", ""]}) -- 0x7fb17c06fda0 con 0x7fb14c079280 2026-02-17T21:30:46.651 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.648+0000 7fb1717fa640 1 -- 10.20.193.5:0/287661173 <== mgr.4131 v2:10.20.193.176:6800/2898618020 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 12 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7fb17c06fda0 con 0x7fb14c079280 2026-02-17T21:30:46.651 INFO:teuthology.orchestra.run.trial005.stderr:instructed osd(s) 12 to deep-scrub 2026-02-17T21:30:46.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.649+0000 7fb182b85640 10 librados: watch_flush enter 2026-02-17T21:30:46.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.649+0000 7fb182b85640 10 librados: watch_flush exit 2026-02-17T21:30:46.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.649+0000 7fb182b85640 20 client.5236.objecter shutdown clearing up homeless session... 2026-02-17T21:30:46.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.649+0000 7fb182b85640 10 client.5236.objecter successfully canceled tick 2026-02-17T21:30:46.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.649+0000 7fb182b85640 1 -- 10.20.193.5:0/287661173 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb14c079280 msgr2=0x7fb14c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.649+0000 7fb182b85640 1 --2- 10.20.193.5:0/287661173 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb14c079280 0x7fb14c07b740 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb16c009c40 tx=0x7fb16c009290 comp rx=0 tx=0).stop 2026-02-17T21:30:46.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.649+0000 7fb182b85640 10 monclient: shutdown 2026-02-17T21:30:46.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.649+0000 7fb182b85640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:46.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.649+0000 7fb182b85640 1 -- 10.20.193.5:0/287661173 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb17c06f530 msgr2=0x7fb17c159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.653 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.649+0000 7fb182b85640 1 --2- 10.20.193.5:0/287661173 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb17c06f530 0x7fb17c159ea0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb164009a70 tx=0x7fb1640047c0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.649+0000 7fb182b85640 1 -- 10.20.193.5:0/287661173 shutdown_connections 2026-02-17T21:30:46.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.649+0000 7fb182b85640 1 --2- 10.20.193.5:0/287661173 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb14c079280 0x7fb14c07b740 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.649+0000 7fb182b85640 1 --2- 10.20.193.5:0/287661173 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb17c15be30 0x7fb17c13ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.649+0000 7fb182b85640 1 --2- 10.20.193.5:0/287661173 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb17c06f530 0x7fb17c159ea0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.649+0000 7fb182b85640 1 --2- 10.20.193.5:0/287661173 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb17c0686b0 0x7fb17c147d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.649+0000 7fb182b85640 1 -- 10.20.193.5:0/287661173 >> 10.20.193.5:0/287661173 conn(0x7fb17c0cb3a0 msgr2=0x7fb17c1558b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:46.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.649+0000 7fb182b85640 1 -- 10.20.193.5:0/287661173 shutdown_connections 2026-02-17T21:30:46.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.649+0000 7fb182b85640 1 -- 10.20.193.5:0/287661173 wait complete. 2026-02-17T21:30:46.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.649+0000 7fb182b85640 1 librados: shutdown 2026-02-17T21:30:46.660 INFO:tasks.ceph:Scrubbing osd.1 2026-02-17T21:30:46.660 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:30:46.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.728+0000 7f0f97cfc640 10 monclient: get_monmap_and_config 2026-02-17T21:30:46.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.728+0000 7f0f97cfc640 10 monclient: build_initial_monmap 2026-02-17T21:30:46.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.728+0000 7f0f97cfc640 10 monclient: monmap: 2026-02-17T21:30:46.731 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:46.731 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:46.731 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:46.730086+0000 2026-02-17T21:30:46.731 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:46.730086+0000 2026-02-17T21:30:46.731 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:46.731 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.731 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:46.731 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:46.732 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:46.732 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:46.732 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:46.732 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:46.732 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.728+0000 7f0f97cfc640 1 Processor -- start 2026-02-17T21:30:46.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.728+0000 7f0f97cfc640 1 -- start start 2026-02-17T21:30:46.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.728+0000 7f0f97cfc640 10 monclient: init 2026-02-17T21:30:46.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.729+0000 7f0f97cfc640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:46.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.729+0000 7f0f97cfc640 10 monclient: _add_conns ranks=[1,2,5,0,4,3] 2026-02-17T21:30:46.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.729+0000 7f0f97cfc640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f0f90153930 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:46.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.729+0000 7f0f97cfc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0f90153d10 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:46.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.729+0000 7f0f97cfc640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f0f900c7e40 0x7f0f9015d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.729+0000 7f0f97cfc640 10 monclient(hunting): picked mon.noname-c con 0x7f0f900c7e40 addr v2:10.20.193.135:3300/0 2026-02-17T21:30:46.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.729+0000 7f0f97cfc640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f900c85a0 con 0x7f0f90153930 2026-02-17T21:30:46.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.729+0000 7f0f97cfc640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f900c8880 con 0x7f0f90153d10 2026-02-17T21:30:46.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.729+0000 7f0f97cfc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:46.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.729+0000 7f0f97cfc640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0f900c9490 con 0x7f0f900c7e40 2026-02-17T21:30:46.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.729+0000 7f0f97cfc640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:46.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.729+0000 7f0f97cfc640 10 monclient(hunting): authenticate will time out at 1352.295474s 2026-02-17T21:30:46.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.729+0000 7f0f95a71640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f0f90153930 0x7f0f9015b070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:43562/0 (socket says 10.20.193.5:43562) 2026-02-17T21:30:46.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.729+0000 7f0f95a71640 1 -- 10.20.193.5:0/2914119432 learned_addr learned my addr 10.20.193.5:0/2914119432 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:46.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.730+0000 7f0f96272640 1 --2- 10.20.193.5:0/2914119432 >> v2:10.20.193.135:3300/0 conn(0x7f0f900c7e40 0x7f0f9015d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.730+0000 7f0f96272640 10 monclient(hunting): get_auth_request con 0x7f0f900c7e40 auth_method 0 2026-02-17T21:30:46.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.730+0000 7f0f96272640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:46.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.730+0000 7f0f96272640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.730+0000 7f0f96272640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.731+0000 7f0f96272640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:46.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.731+0000 7f0f96272640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:46.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.731+0000 7f0f96272640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:46.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.731+0000 7f0f94a6f640 1 -- 10.20.193.5:0/2914119432 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2246365308 0 0) 0x7f0f900c85a0 con 0x7f0f90153930 2026-02-17T21:30:46.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.731+0000 7f0f94a6f640 10 monclient(hunting): _negotiate 2026-02-17T21:30:46.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.731+0000 7f0f94a6f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.731+0000 7f0f94a6f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.731+0000 7f0f94a6f640 10 monclient(hunting): my global_id is 5239 2026-02-17T21:30:46.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.731+0000 7f0f94a6f640 1 -- 10.20.193.5:0/2914119432 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f78003620 con 0x7f0f90153930 2026-02-17T21:30:46.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.732+0000 7f0f96272640 10 monclient(hunting): handle_auth_done global_id 5231 payload 274 2026-02-17T21:30:46.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.732+0000 7f0f96272640 1 -- 10.20.193.5:0/2914119432 >> v1:10.20.193.135:6789/0 conn(0x7f0f90153d10 legacy=0x7f0f900c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.732+0000 7f0f96272640 1 -- 10.20.193.5:0/2914119432 >> v1:10.20.193.119:6789/0 conn(0x7f0f90153930 legacy=0x7f0f9015b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.732+0000 7f0f96272640 10 monclient: _finish_hunting 0 2026-02-17T21:30:46.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.732+0000 7f0f96272640 1 monclient: found mon.noname-c 2026-02-17T21:30:46.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.732+0000 7f0f96272640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:46.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.732+0000 7f0f96272640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:46.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.732+0000 7f0f96272640 1 -- 10.20.193.5:0/2914119432 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f900c8b60 con 0x7f0f900c7e40 2026-02-17T21:30:46.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.733+0000 7f0f96272640 1 --2- 10.20.193.5:0/2914119432 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0f900c7e40 0x7f0f9015d170 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c009d90 tx=0x7f0f8c02f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8665e857ff5c86d7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:46.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.735+0000 7f0f94a6f640 1 -- 10.20.193.5:0/2914119432 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c03c070 con 0x7f0f900c7e40 2026-02-17T21:30:46.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.735+0000 7f0f94a6f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:46.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.735+0000 7f0f94a6f640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:46.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.735+0000 7f0f94a6f640 10 monclient: dump: 2026-02-17T21:30:46.744 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:46.744 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:46.744 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.744 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.744 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:46.744 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.744 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:46.744 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:46.744 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:46.744 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.735+0000 7f0f94a6f640 10 monclient: _finish_auth 0 2026-02-17T21:30:46.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.735+0000 7f0f94a6f640 10 monclient: _check_auth_tickets 2026-02-17T21:30:46.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.735+0000 7f0f94a6f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:46.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.735+0000 7f0f94a6f640 1 -- 10.20.193.5:0/2914119432 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f8c037440 con 0x7f0f900c7e40 2026-02-17T21:30:46.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.735+0000 7f0f97cfc640 5 monclient: authenticate success, global_id 5231 2026-02-17T21:30:46.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.735+0000 7f0f94a6f640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:46.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.735+0000 7f0f94a6f640 1 -- 10.20.193.5:0/2914119432 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c037810 con 0x7f0f900c7e40 2026-02-17T21:30:46.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.735+0000 7f0f94a6f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:46.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.735+0000 7f0f94a6f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:46.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.735+0000 7f0f94a6f640 10 monclient: dump: 2026-02-17T21:30:46.745 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:46.745 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:46.746 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.746 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.746 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:46.746 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.746 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:46.746 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:46.746 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:46.746 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.735+0000 7f0f97cfc640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:46.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.735+0000 7f0f97cfc640 4 set_mon_vals no callback set 2026-02-17T21:30:46.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.736+0000 7f0f97cfc640 10 monclient: shutdown 2026-02-17T21:30:46.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.736+0000 7f0f97cfc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:46.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.736+0000 7f0f97cfc640 1 -- 10.20.193.5:0/2914119432 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0f900c7e40 msgr2=0x7f0f9015d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.736+0000 7f0f97cfc640 1 --2- 10.20.193.5:0/2914119432 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0f900c7e40 0x7f0f9015d170 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c009d90 tx=0x7f0f8c02f230 comp rx=0 tx=0).stop 2026-02-17T21:30:46.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.736+0000 7f0f97cfc640 1 -- 10.20.193.5:0/2914119432 shutdown_connections 2026-02-17T21:30:46.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.736+0000 7f0f97cfc640 1 --2- 10.20.193.5:0/2914119432 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0f900c7e40 0x7f0f9015d170 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.736+0000 7f0f97cfc640 1 -- 10.20.193.5:0/2914119432 >> 10.20.193.5:0/2914119432 conn(0x7f0f900c9f40 msgr2=0x7f0f900ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:46.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.736+0000 7f0f97cfc640 1 -- 10.20.193.5:0/2914119432 shutdown_connections 2026-02-17T21:30:46.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.736+0000 7f0f97cfc640 1 -- 10.20.193.5:0/2914119432 wait complete. 2026-02-17T21:30:46.748 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.736+0000 7f0f97cfc640 10 monclient: build_initial_monmap 2026-02-17T21:30:46.748 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.736+0000 7f0f97cfc640 10 monclient: monmap: 2026-02-17T21:30:46.748 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:46.748 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:46.748 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:46.748 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:46.748 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:46.748 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.748 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:46.748 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:46.749 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:46.749 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.736+0000 7f0f97cfc640 1 librados: starting msgr at 2026-02-17T21:30:46.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.736+0000 7f0f97cfc640 1 librados: starting objecter 2026-02-17T21:30:46.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.736+0000 7f0f97cfc640 1 Processor -- start 2026-02-17T21:30:46.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.736+0000 7f0f97cfc640 1 -- start start 2026-02-17T21:30:46.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.736+0000 7f0f97cfc640 1 librados: setting wanted keys 2026-02-17T21:30:46.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.736+0000 7f0f97cfc640 1 librados: calling monclient init 2026-02-17T21:30:46.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.736+0000 7f0f97cfc640 10 monclient: init 2026-02-17T21:30:46.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f97cfc640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:46.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f97cfc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:30:46.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f97cfc640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0f900c7e40 0x7f0f90074a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f97cfc640 10 monclient(hunting): picked mon.noname-b con 0x7f0f900c7e40 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:46.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f97cfc640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0f90153930 0x7f0f901490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f97cfc640 10 monclient(hunting): picked mon.noname-a con 0x7f0f90153930 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:46.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f97cfc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0f90153d10 0x7f0f900cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f97cfc640 10 monclient(hunting): picked mon.noname-c con 0x7f0f90153d10 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:46.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f97cfc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:46.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f97cfc640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0f900c8250 con 0x7f0f90153930 2026-02-17T21:30:46.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f97cfc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:46.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f97cfc640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0f900c9120 con 0x7f0f900c7e40 2026-02-17T21:30:46.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f97cfc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:46.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f97cfc640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0f900c7730 con 0x7f0f90153d10 2026-02-17T21:30:46.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f97cfc640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:46.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f97cfc640 10 monclient(hunting): authenticate will time out at 1352.303331s 2026-02-17T21:30:46.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f95270640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0f90153930 0x7f0f901490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f96272640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0f90153d10 0x7f0f900cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f95a71640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0f900c7e40 0x7f0f90074a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f96272640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0f90153d10 0x7f0f900cbb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:34014/0 (socket says 10.20.193.5:34014) 2026-02-17T21:30:46.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f96272640 1 -- 10.20.193.5:0/3860177648 learned_addr learned my addr 10.20.193.5:0/3860177648 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:46.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f96272640 10 monclient(hunting): get_auth_request con 0x7f0f90153d10 auth_method 0 2026-02-17T21:30:46.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f96272640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:46.752 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f96272640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.752 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f96272640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.752 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f95a71640 10 monclient(hunting): get_auth_request con 0x7f0f900c7e40 auth_method 0 2026-02-17T21:30:46.752 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f95a71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:46.752 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f95a71640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.752 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f95a71640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.752 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f95270640 10 monclient(hunting): get_auth_request con 0x7f0f90153930 auth_method 0 2026-02-17T21:30:46.752 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f95270640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:46.752 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f95270640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.737+0000 7f0f95270640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.738+0000 7f0f96272640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:46.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.738+0000 7f0f96272640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:46.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.738+0000 7f0f96272640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:46.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.738+0000 7f0f95a71640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:46.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.738+0000 7f0f95a71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:46.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.738+0000 7f0f95a71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:46.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.738+0000 7f0f95270640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:46.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.738+0000 7f0f95270640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:46.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.738+0000 7f0f95270640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:46.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.739+0000 7f0f96272640 10 monclient(hunting): handle_auth_done global_id 5237 payload 824 2026-02-17T21:30:46.753 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.739+0000 7f0f96272640 1 -- 10.20.193.5:0/3860177648 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0f900c7e40 msgr2=0x7f0f90074a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.739+0000 7f0f96272640 1 --2- 10.20.193.5:0/3860177648 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0f900c7e40 0x7f0f90074a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.739+0000 7f0f96272640 1 -- 10.20.193.5:0/3860177648 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0f90153930 msgr2=0x7f0f901490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.739+0000 7f0f96272640 1 --2- 10.20.193.5:0/3860177648 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f0f90153930 0x7f0f901490b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.739+0000 7f0f96272640 10 monclient: _finish_hunting 0 2026-02-17T21:30:46.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.739+0000 7f0f96272640 1 monclient: found mon.noname-c 2026-02-17T21:30:46.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.739+0000 7f0f96272640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:46.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.739+0000 7f0f96272640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:46.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.739+0000 7f0f96272640 1 -- 10.20.193.5:0/3860177648 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f9006ed50 con 0x7f0f90153d10 2026-02-17T21:30:46.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.740+0000 7f0f96272640 1 --2- 10.20.193.5:0/3860177648 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0f90153d10 0x7f0f900cbb40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c03a040 tx=0x7f0f8c004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:46.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.740+0000 7f0f7e7fc640 10 client.?.objecter ms_handle_connect 0x7f0f90153d10 2026-02-17T21:30:46.754 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.740+0000 7f0f7e7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:46.757 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f7e7fc640 1 -- 10.20.193.5:0/3860177648 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c03c050 con 0x7f0f90153d10 2026-02-17T21:30:46.757 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f7e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:46.757 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f7e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:46.757 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f7e7fc640 10 monclient: dump: 2026-02-17T21:30:46.757 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:46.757 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:46.757 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.757 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.758 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:46.758 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.758 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:46.758 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:46.758 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:46.758 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.758 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f7e7fc640 10 monclient: _finish_auth 0 2026-02-17T21:30:46.758 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f7e7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:30:46.758 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f7e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:46.758 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f7e7fc640 1 -- 10.20.193.5:0/3860177648 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f8c048070 con 0x7f0f90153d10 2026-02-17T21:30:46.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f97cfc640 5 monclient: authenticate success, global_id 5237 2026-02-17T21:30:46.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f7e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:46.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f7e7fc640 1 -- 10.20.193.5:0/3860177648 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c041a30 con 0x7f0f90153d10 2026-02-17T21:30:46.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f7e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:46.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f7e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:46.759 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f7e7fc640 10 monclient: dump: 2026-02-17T21:30:46.759 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:46.759 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:46.759 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.759 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.759 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:46.760 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.760 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:46.760 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:46.760 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:46.760 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.760 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f7ffff640 4 set_mon_vals no callback set 2026-02-17T21:30:46.760 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f97cfc640 10 monclient: _renew_subs 2026-02-17T21:30:46.760 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f97cfc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:46.760 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f97cfc640 1 -- 10.20.193.5:0/3860177648 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f9006f030 con 0x7f0f90153d10 2026-02-17T21:30:46.760 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f97cfc640 10 client.5237.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:46.760 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f97cfc640 10 monclient: _renew_subs 2026-02-17T21:30:46.760 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f97cfc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:46.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f97cfc640 1 -- 10.20.193.5:0/3860177648 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f900cb340 con 0x7f0f90153d10 2026-02-17T21:30:46.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f97cfc640 1 librados: init done 2026-02-17T21:30:46.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f97cfc640 10 client.5237.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:46.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f97cfc640 15 client.5237.objecter _session_command_op_assign -1 1 2026-02-17T21:30:46.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f97cfc640 20 client.5237.objecter _get_session osd=-1 returning homeless 2026-02-17T21:30:46.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f97cfc640 10 client.5237.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:46.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f97cfc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:46.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.742+0000 7f0f97cfc640 1 -- 10.20.193.5:0/3860177648 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0f9015b070 con 0x7f0f90153d10 2026-02-17T21:30:46.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.754+0000 7f0f7e7fc640 1 -- 10.20.193.5:0/3860177648 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f0f8c041bd0 con 0x7f0f90153d10 2026-02-17T21:30:46.761 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.755+0000 7f0f7e7fc640 1 --2- 10.20.193.5:0/3860177648 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0f600792d0 0x7f0f6007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.755+0000 7f0f95a71640 1 --2- 10.20.193.5:0/3860177648 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0f600792d0 0x7f0f6007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.755+0000 7f0f95a71640 10 monclient: get_auth_request con 0x7f0f600792d0 auth_method 0 2026-02-17T21:30:46.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.755+0000 7f0f95a71640 1 --2- 10.20.193.5:0/3860177648 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0f600792d0 0x7f0f6007b790 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0f80005980 tx=0x7f0f80007dd0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:46.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.755+0000 7f0f7e7fc640 10 client.5237.objecter ms_handle_connect 0x7f0f600792d0 2026-02-17T21:30:46.763 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.757+0000 7f0f7e7fc640 1 -- 10.20.193.5:0/3860177648 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f0f8c0846b0 con 0x7f0f90153d10 2026-02-17T21:30:46.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.757+0000 7f0f7e7fc640 10 client.5237.objecter ms_dispatch2 0x7f0f90000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:46.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.757+0000 7f0f7e7fc640 3 client.5237.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:46.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.757+0000 7f0f7e7fc640 3 client.5237.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:46.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.757+0000 7f0f7e7fc640 10 client.5237.objecter checking command 1 2026-02-17T21:30:46.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.757+0000 7f0f7e7fc640 1 --2- 10.20.193.5:0/3860177648 >> [v2:10.20.193.119:6800/267553149,v1:10.20.193.119:6801/267553149] conn(0x7f0f600817b0 0x7f0f60083bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.757+0000 7f0f7e7fc640 20 client.5237.objecter _get_session s=0x7f0f600810e0 osd=1 3 2026-02-17T21:30:46.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.757+0000 7f0f7e7fc640 20 client.5237.objecter put_session s=0x7f0f600810e0 osd=1 3 2026-02-17T21:30:46.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.757+0000 7f0f7e7fc640 15 client.5237.objecter _session_command_op_remove -1 1 2026-02-17T21:30:46.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.757+0000 7f0f7e7fc640 20 client.5237.objecter _get_session s=0x7f0f600810e0 osd=1 3 2026-02-17T21:30:46.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.757+0000 7f0f7e7fc640 20 client.5237.objecter get_session s=0x7f0f600810e0 osd=1 3 2026-02-17T21:30:46.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.757+0000 7f0f7e7fc640 15 client.5237.objecter _session_command_op_assign 1 1 2026-02-17T21:30:46.764 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.757+0000 7f0f7e7fc640 20 client.5237.objecter put_session s=0x7f0f600810e0 osd=1 4 2026-02-17T21:30:46.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.757+0000 7f0f7e7fc640 10 client.5237.objecter _send_command 1 2026-02-17T21:30:46.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.757+0000 7f0f7e7fc640 1 -- 10.20.193.5:0/3860177648 --> [v2:10.20.193.119:6800/267553149,v1:10.20.193.119:6801/267553149] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0f8c0038c0 con 0x7f0f600817b0 2026-02-17T21:30:46.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.757+0000 7f0f7e7fc640 20 client.5237.objecter dump_active .. 0 homeless 2026-02-17T21:30:46.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.757+0000 7f0f7e7fc640 1 -- 10.20.193.5:0/3860177648 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f0f8c084a70 con 0x7f0f90153d10 2026-02-17T21:30:46.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.757+0000 7f0f7e7fc640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T21:30:46.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.757+0000 7f0f95270640 1 --2- 10.20.193.5:0/3860177648 >> [v2:10.20.193.119:6800/267553149,v1:10.20.193.119:6801/267553149] conn(0x7f0f600817b0 0x7f0f60083bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.757+0000 7f0f95270640 10 monclient: get_auth_request con 0x7f0f600817b0 auth_method 0 2026-02-17T21:30:46.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.759+0000 7f0f95270640 1 --2- 10.20.193.5:0/3860177648 >> [v2:10.20.193.119:6800/267553149,v1:10.20.193.119:6801/267553149] conn(0x7f0f600817b0 0x7f0f60083bd0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:46.765 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.759+0000 7f0f7e7fc640 10 client.5237.objecter ms_handle_connect 0x7f0f600817b0 2026-02-17T21:30:46.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.769+0000 7f0f7e7fc640 1 -- 10.20.193.5:0/3860177648 <== osd.1 v2:10.20.193.119:6800/267553149 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f0f8c0038c0 con 0x7f0f600817b0 2026-02-17T21:30:46.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.769+0000 7f0f7e7fc640 10 client.5237.objecter ms_dispatch2 0x7f0f90000b90 command_reply(tid 1: 0 ) 2026-02-17T21:30:46.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.769+0000 7f0f7e7fc640 10 client.5237.objecter _finish_command 1 = system:0 2026-02-17T21:30:46.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.769+0000 7f0f7e7fc640 20 client.5237.objecter put_session s=0x7f0f600810e0 osd=1 4 2026-02-17T21:30:46.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.769+0000 7f0f7e7fc640 15 client.5237.objecter _session_command_op_remove 1 1 2026-02-17T21:30:46.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.774+0000 7f0f97cfc640 10 client.5237.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:30:46.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.774+0000 7f0f97cfc640 15 client.5237.objecter _session_command_op_assign -1 2 2026-02-17T21:30:46.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.774+0000 7f0f97cfc640 20 client.5237.objecter _get_session s=0x7f0f600810e0 osd=1 3 2026-02-17T21:30:46.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.774+0000 7f0f97cfc640 20 client.5237.objecter put_session s=0x7f0f600810e0 osd=1 3 2026-02-17T21:30:46.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.774+0000 7f0f97cfc640 20 client.5237.objecter _get_session s=0x7f0f600810e0 osd=1 3 2026-02-17T21:30:46.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.774+0000 7f0f97cfc640 15 client.5237.objecter _session_command_op_remove -1 2 2026-02-17T21:30:46.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.774+0000 7f0f97cfc640 20 client.5237.objecter get_session s=0x7f0f600810e0 osd=1 3 2026-02-17T21:30:46.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.774+0000 7f0f97cfc640 15 client.5237.objecter _session_command_op_assign 1 2 2026-02-17T21:30:46.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.774+0000 7f0f97cfc640 20 client.5237.objecter put_session s=0x7f0f600810e0 osd=1 4 2026-02-17T21:30:46.777 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.774+0000 7f0f97cfc640 10 client.5237.objecter _send_command 2 2026-02-17T21:30:46.778 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.774+0000 7f0f97cfc640 1 -- 10.20.193.5:0/3860177648 --> [v2:10.20.193.119:6800/267553149,v1:10.20.193.119:6801/267553149] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0f9015bf40 con 0x7f0f600817b0 2026-02-17T21:30:46.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.781+0000 7f0f7e7fc640 1 -- 10.20.193.5:0/3860177648 <== osd.1 v2:10.20.193.119:6800/267553149 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0f9015bf40 con 0x7f0f600817b0 2026-02-17T21:30:46.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.781+0000 7f0f7e7fc640 10 client.5237.objecter ms_dispatch2 0x7f0f90000b90 command_reply(tid 2: 0 ) 2026-02-17T21:30:46.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.781+0000 7f0f7e7fc640 10 client.5237.objecter _finish_command 2 = system:0 2026-02-17T21:30:46.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.781+0000 7f0f7e7fc640 20 client.5237.objecter put_session s=0x7f0f600810e0 osd=1 4 2026-02-17T21:30:46.784 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.781+0000 7f0f7e7fc640 15 client.5237.objecter _session_command_op_remove 1 2 2026-02-17T21:30:46.784 INFO:teuthology.orchestra.run.trial005.stdout:{ 2026-02-17T21:30:46.785 INFO:teuthology.orchestra.run.trial005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:30:46.785 INFO:teuthology.orchestra.run.trial005.stdout:} 2026-02-17T21:30:46.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.782+0000 7f0f97cfc640 10 librados: watch_flush enter 2026-02-17T21:30:46.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.782+0000 7f0f97cfc640 10 librados: watch_flush exit 2026-02-17T21:30:46.786 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.782+0000 7f0f97cfc640 10 client.5237.objecter close_session for osd.1 2026-02-17T21:30:46.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.782+0000 7f0f97cfc640 1 -- 10.20.193.5:0/3860177648 >> [v2:10.20.193.119:6800/267553149,v1:10.20.193.119:6801/267553149] conn(0x7f0f600817b0 msgr2=0x7f0f60083bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.782+0000 7f0f97cfc640 1 --2- 10.20.193.5:0/3860177648 >> [v2:10.20.193.119:6800/267553149,v1:10.20.193.119:6801/267553149] conn(0x7f0f600817b0 0x7f0f60083bd0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.782+0000 7f0f97cfc640 20 client.5237.objecter put_session s=0x7f0f600810e0 osd=1 1 2026-02-17T21:30:46.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.782+0000 7f0f97cfc640 20 client.5237.objecter shutdown clearing up homeless session... 2026-02-17T21:30:46.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.782+0000 7f0f97cfc640 10 client.5237.objecter successfully canceled tick 2026-02-17T21:30:46.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.782+0000 7f0f97cfc640 1 -- 10.20.193.5:0/3860177648 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0f600792d0 msgr2=0x7f0f6007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.782+0000 7f0f97cfc640 1 --2- 10.20.193.5:0/3860177648 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0f600792d0 0x7f0f6007b790 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0f80005980 tx=0x7f0f80007dd0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.782+0000 7f0f97cfc640 10 monclient: shutdown 2026-02-17T21:30:46.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.782+0000 7f0f97cfc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:46.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.782+0000 7f0f97cfc640 1 -- 10.20.193.5:0/3860177648 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0f90153d10 msgr2=0x7f0f900cbb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.782+0000 7f0f97cfc640 1 --2- 10.20.193.5:0/3860177648 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f0f90153d10 0x7f0f900cbb40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c03a040 tx=0x7f0f8c004b40 comp rx=0 tx=0).stop 2026-02-17T21:30:46.787 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.782+0000 7f0f96272640 1 -- 10.20.193.5:0/3860177648 reap_dead start 2026-02-17T21:30:46.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.782+0000 7f0f97cfc640 1 -- 10.20.193.5:0/3860177648 shutdown_connections 2026-02-17T21:30:46.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.782+0000 7f0f97cfc640 1 -- 10.20.193.5:0/3860177648 >> 10.20.193.5:0/3860177648 conn(0x7f0f900c9f40 msgr2=0x7f0f9015c460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:46.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.782+0000 7f0f97cfc640 1 -- 10.20.193.5:0/3860177648 shutdown_connections 2026-02-17T21:30:46.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.782+0000 7f0f97cfc640 1 -- 10.20.193.5:0/3860177648 wait complete. 2026-02-17T21:30:46.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.782+0000 7f0f97cfc640 1 librados: shutdown 2026-02-17T21:30:46.792 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-17T21:30:46.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.857+0000 7ff9f7101640 10 monclient: get_monmap_and_config 2026-02-17T21:30:46.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.857+0000 7ff9f7101640 10 monclient: build_initial_monmap 2026-02-17T21:30:46.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.857+0000 7ff9f7101640 10 monclient: monmap: 2026-02-17T21:30:46.860 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:46.860 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:46.860 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:46.859313+0000 2026-02-17T21:30:46.860 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:46.859313+0000 2026-02-17T21:30:46.860 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:46.861 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.861 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:46.861 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:46.861 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:46.861 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:46.861 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:46.861 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:46.861 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.858+0000 7ff9f7101640 1 Processor -- start 2026-02-17T21:30:46.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.858+0000 7ff9f7101640 1 -- start start 2026-02-17T21:30:46.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.858+0000 7ff9f7101640 10 monclient: init 2026-02-17T21:30:46.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.858+0000 7ff9f7101640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:46.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.858+0000 7ff9f7101640 10 monclient: _add_conns ranks=[1,2,3,5,0,4] 2026-02-17T21:30:46.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.858+0000 7ff9f7101640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7ff9f015d370 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:46.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.858+0000 7ff9f7101640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff9f00c7e20 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:46.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.858+0000 7ff9f7101640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7ff9f00c59c0 0x7ff9f015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.858+0000 7ff9f7101640 10 monclient(hunting): picked mon.noname-a con 0x7ff9f00c59c0 addr v2:10.20.193.5:3300/0 2026-02-17T21:30:46.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.858+0000 7ff9f7101640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f00c8350 con 0x7ff9f015d370 2026-02-17T21:30:46.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.858+0000 7ff9f7101640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f00c8630 con 0x7ff9f00c7e20 2026-02-17T21:30:46.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.858+0000 7ff9f7101640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:46.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.858+0000 7ff9f7101640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff9f015b710 con 0x7ff9f00c59c0 2026-02-17T21:30:46.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.858+0000 7ff9f7101640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:46.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.858+0000 7ff9f7101640 10 monclient(hunting): authenticate will time out at 1352.424589s 2026-02-17T21:30:46.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.858+0000 7ff9e7fff640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7ff9f00c7e20 0x7ff9f00c52b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:33622/0 (socket says 10.20.193.5:33622) 2026-02-17T21:30:46.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.858+0000 7ff9e7fff640 1 -- 10.20.193.5:0/2759549385 learned_addr learned my addr 10.20.193.5:0/2759549385 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:46.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.858+0000 7ff9f5677640 1 --2- 10.20.193.5:0/2759549385 >> v2:10.20.193.5:3300/0 conn(0x7ff9f00c59c0 0x7ff9f015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.859+0000 7ff9f5677640 10 monclient(hunting): get_auth_request con 0x7ff9f00c59c0 auth_method 0 2026-02-17T21:30:46.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.859+0000 7ff9f5677640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:46.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.859+0000 7ff9f5677640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.859+0000 7ff9f5677640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.859+0000 7ff9f5677640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:46.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.859+0000 7ff9f5677640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:46.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.859+0000 7ff9f5677640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:46.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.860+0000 7ff9e77fe640 1 -- 10.20.193.5:0/2759549385 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 218673275 0 0) 0x7ff9f00c8350 con 0x7ff9f015d370 2026-02-17T21:30:46.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.860+0000 7ff9e77fe640 10 monclient(hunting): _negotiate 2026-02-17T21:30:46.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.860+0000 7ff9e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.860+0000 7ff9e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.860+0000 7ff9e77fe640 10 monclient(hunting): my global_id is 5245 2026-02-17T21:30:46.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.860+0000 7ff9e77fe640 1 -- 10.20.193.5:0/2759549385 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9dc003620 con 0x7ff9f015d370 2026-02-17T21:30:46.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.860+0000 7ff9e77fe640 1 -- 10.20.193.5:0/2759549385 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 959719414 0 0) 0x7ff9f00c8630 con 0x7ff9f00c7e20 2026-02-17T21:30:46.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.860+0000 7ff9e77fe640 10 monclient(hunting): _negotiate 2026-02-17T21:30:46.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.860+0000 7ff9e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.860+0000 7ff9e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.860+0000 7ff9e77fe640 10 monclient(hunting): my global_id is 5240 2026-02-17T21:30:46.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.860+0000 7ff9e77fe640 1 -- 10.20.193.5:0/2759549385 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9f00c8350 con 0x7ff9f00c7e20 2026-02-17T21:30:46.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.860+0000 7ff9f5677640 10 monclient(hunting): handle_auth_done global_id 5163 payload 274 2026-02-17T21:30:46.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.860+0000 7ff9f5677640 1 -- 10.20.193.5:0/2759549385 >> v1:10.20.193.135:6789/0 conn(0x7ff9f00c7e20 legacy=0x7ff9f00c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.860+0000 7ff9f5677640 1 -- 10.20.193.5:0/2759549385 >> v1:10.20.193.119:6789/0 conn(0x7ff9f015d370 legacy=0x7ff9f015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.860+0000 7ff9f5677640 10 monclient: _finish_hunting 0 2026-02-17T21:30:46.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.860+0000 7ff9f5677640 1 monclient: found mon.noname-a 2026-02-17T21:30:46.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.860+0000 7ff9f5677640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:46.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.860+0000 7ff9f5677640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:46.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.860+0000 7ff9f5677640 1 -- 10.20.193.5:0/2759549385 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f00c8910 con 0x7ff9f00c59c0 2026-02-17T21:30:46.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.861+0000 7ff9f5677640 1 --2- 10.20.193.5:0/2759549385 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff9f00c59c0 0x7ff9f015d750 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009d90 tx=0x7ff9ec02f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b608dec42891ba37 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:46.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.863+0000 7ff9e77fe640 1 -- 10.20.193.5:0/2759549385 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec03c070 con 0x7ff9f00c59c0 2026-02-17T21:30:46.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.863+0000 7ff9e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:46.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.863+0000 7ff9e77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:46.875 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.863+0000 7ff9e77fe640 10 monclient: dump: 2026-02-17T21:30:46.875 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:46.875 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:46.875 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.875 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.875 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:46.875 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.875 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:46.875 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:46.875 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:46.876 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.863+0000 7ff9e77fe640 10 monclient: _finish_auth 0 2026-02-17T21:30:46.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.863+0000 7ff9e77fe640 10 monclient: _check_auth_tickets 2026-02-17T21:30:46.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.863+0000 7ff9e77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:46.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.863+0000 7ff9e77fe640 1 -- 10.20.193.5:0/2759549385 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9ec037440 con 0x7ff9f00c59c0 2026-02-17T21:30:46.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.863+0000 7ff9e77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:46.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.863+0000 7ff9e77fe640 1 -- 10.20.193.5:0/2759549385 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec037810 con 0x7ff9f00c59c0 2026-02-17T21:30:46.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.863+0000 7ff9f7101640 5 monclient: authenticate success, global_id 5163 2026-02-17T21:30:46.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.863+0000 7ff9f7101640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:46.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.863+0000 7ff9f7101640 4 set_mon_vals no callback set 2026-02-17T21:30:46.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.863+0000 7ff9e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:46.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.863+0000 7ff9e77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:46.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.863+0000 7ff9e77fe640 10 monclient: dump: 2026-02-17T21:30:46.877 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:46.877 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:46.877 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.877 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.877 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:46.877 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.877 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:46.877 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:46.877 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:46.877 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.863+0000 7ff9f7101640 10 monclient: shutdown 2026-02-17T21:30:46.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.863+0000 7ff9f7101640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:46.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.863+0000 7ff9f7101640 1 -- 10.20.193.5:0/2759549385 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff9f00c59c0 msgr2=0x7ff9f015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.863+0000 7ff9f7101640 1 --2- 10.20.193.5:0/2759549385 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff9f00c59c0 0x7ff9f015d750 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009d90 tx=0x7ff9ec02f230 comp rx=0 tx=0).stop 2026-02-17T21:30:46.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.863+0000 7ff9f7101640 1 -- 10.20.193.5:0/2759549385 shutdown_connections 2026-02-17T21:30:46.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.863+0000 7ff9f7101640 1 --2- 10.20.193.5:0/2759549385 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff9f00c59c0 0x7ff9f015d750 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.863+0000 7ff9f7101640 1 -- 10.20.193.5:0/2759549385 >> 10.20.193.5:0/2759549385 conn(0x7ff9f00c9f20 msgr2=0x7ff9f00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:46.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.863+0000 7ff9f7101640 1 -- 10.20.193.5:0/2759549385 shutdown_connections 2026-02-17T21:30:46.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.863+0000 7ff9f7101640 1 -- 10.20.193.5:0/2759549385 wait complete. 2026-02-17T21:30:46.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.864+0000 7ff9f7101640 10 monclient: build_initial_monmap 2026-02-17T21:30:46.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.864+0000 7ff9f7101640 10 monclient: monmap: 2026-02-17T21:30:46.878 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:46.878 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:46.879 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:46.879 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:46.879 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:46.879 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.879 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:46.879 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:46.879 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:46.879 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.864+0000 7ff9f7101640 1 librados: starting msgr at 2026-02-17T21:30:46.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.864+0000 7ff9f7101640 1 librados: starting objecter 2026-02-17T21:30:46.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.864+0000 7ff9f7101640 1 Processor -- start 2026-02-17T21:30:46.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.864+0000 7ff9f7101640 1 -- start start 2026-02-17T21:30:46.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.864+0000 7ff9f7101640 1 librados: setting wanted keys 2026-02-17T21:30:46.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.864+0000 7ff9f7101640 1 librados: calling monclient init 2026-02-17T21:30:46.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.864+0000 7ff9f7101640 10 monclient: init 2026-02-17T21:30:46.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f7101640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:46.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f7101640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:30:46.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f7101640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff9f00c59c0 0x7ff9f00729d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f7101640 10 monclient(hunting): picked mon.noname-c con 0x7ff9f00c59c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:46.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f7101640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff9f00c7e20 0x7ff9f00741f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f7101640 10 monclient(hunting): picked mon.noname-b con 0x7ff9f00c7e20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:46.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f7101640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff9f015d370 0x7ff9f00c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f7101640 10 monclient(hunting): picked mon.noname-a con 0x7ff9f015d370 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:46.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f7101640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:46.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f7101640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f00c8ed0 con 0x7ff9f015d370 2026-02-17T21:30:46.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f7101640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:46.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f7101640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f00c9240 con 0x7ff9f00c7e20 2026-02-17T21:30:46.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f7101640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:46.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f7101640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f00c96d0 con 0x7ff9f00c59c0 2026-02-17T21:30:46.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f7101640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:46.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f7101640 10 monclient(hunting): authenticate will time out at 1352.431117s 2026-02-17T21:30:46.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f5677640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff9f015d370 0x7ff9f00c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f4e76640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff9f00c59c0 0x7ff9f00729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9e7fff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff9f00c7e20 0x7ff9f00741f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f5677640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff9f015d370 0x7ff9f00c4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:32808/0 (socket says 10.20.193.5:32808) 2026-02-17T21:30:46.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f5677640 1 -- 10.20.193.5:0/1309916859 learned_addr learned my addr 10.20.193.5:0/1309916859 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:46.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f5677640 10 monclient(hunting): get_auth_request con 0x7ff9f015d370 auth_method 0 2026-02-17T21:30:46.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f5677640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:46.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f5677640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f5677640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9e7fff640 10 monclient(hunting): get_auth_request con 0x7ff9f00c7e20 auth_method 0 2026-02-17T21:30:46.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9e7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:46.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f4e76640 10 monclient(hunting): get_auth_request con 0x7ff9f00c59c0 auth_method 0 2026-02-17T21:30:46.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f4e76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:46.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f4e76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:46.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f4e76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:46.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f5677640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:46.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f5677640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:46.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f5677640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:46.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f4e76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:46.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f4e76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:46.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9f4e76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:46.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9e7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:46.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9e7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:46.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.865+0000 7ff9e7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:46.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.866+0000 7ff9f5677640 10 monclient(hunting): handle_auth_done global_id 5166 payload 824 2026-02-17T21:30:46.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.866+0000 7ff9f5677640 1 -- 10.20.193.5:0/1309916859 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff9f00c59c0 msgr2=0x7ff9f00729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.866+0000 7ff9f5677640 1 --2- 10.20.193.5:0/1309916859 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff9f00c59c0 0x7ff9f00729d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.866+0000 7ff9f5677640 1 -- 10.20.193.5:0/1309916859 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff9f00c7e20 msgr2=0x7ff9f00741f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:46.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.866+0000 7ff9f5677640 1 --2- 10.20.193.5:0/1309916859 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff9f00c7e20 0x7ff9f00741f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:46.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.866+0000 7ff9f5677640 10 monclient: _finish_hunting 0 2026-02-17T21:30:46.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.866+0000 7ff9f5677640 1 monclient: found mon.noname-a 2026-02-17T21:30:46.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.866+0000 7ff9f5677640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:46.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.866+0000 7ff9f5677640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:46.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.866+0000 7ff9f5677640 1 -- 10.20.193.5:0/1309916859 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f01f2080 con 0x7ff9f015d370 2026-02-17T21:30:46.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.867+0000 7ff9f5677640 1 --2- 10.20.193.5:0/1309916859 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff9f015d370 0x7ff9f00c4a10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009ec0 tx=0x7ff9ec004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:46.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.867+0000 7ff9e57fa640 10 client.?.objecter ms_handle_connect 0x7ff9f015d370 2026-02-17T21:30:46.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.867+0000 7ff9e57fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:46.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.869+0000 7ff9e57fa640 1 -- 10.20.193.5:0/1309916859 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec03c050 con 0x7ff9f015d370 2026-02-17T21:30:46.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.869+0000 7ff9e57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:46.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.869+0000 7ff9e57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:46.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.869+0000 7ff9e57fa640 10 monclient: dump: 2026-02-17T21:30:46.884 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:46.885 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:46.885 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.885 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.885 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:46.885 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.885 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:46.885 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:46.885 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:46.885 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.869+0000 7ff9e57fa640 10 monclient: _finish_auth 0 2026-02-17T21:30:46.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.869+0000 7ff9e57fa640 10 monclient: _check_auth_tickets 2026-02-17T21:30:46.885 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.869+0000 7ff9e57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:46.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.869+0000 7ff9e57fa640 1 -- 10.20.193.5:0/1309916859 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9ec03d040 con 0x7ff9f015d370 2026-02-17T21:30:46.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.869+0000 7ff9f7101640 5 monclient: authenticate success, global_id 5166 2026-02-17T21:30:46.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.869+0000 7ff9f7101640 10 monclient: _renew_subs 2026-02-17T21:30:46.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.869+0000 7ff9f7101640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:46.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.869+0000 7ff9f7101640 1 -- 10.20.193.5:0/1309916859 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f0073150 con 0x7ff9f015d370 2026-02-17T21:30:46.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.869+0000 7ff9e57fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:46.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.869+0000 7ff9e57fa640 1 -- 10.20.193.5:0/1309916859 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec041610 con 0x7ff9f015d370 2026-02-17T21:30:46.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.869+0000 7ff9e57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:46.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.869+0000 7ff9e57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:46.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.869+0000 7ff9e6ffd640 4 set_mon_vals no callback set 2026-02-17T21:30:46.886 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.869+0000 7ff9e57fa640 10 monclient: dump: 2026-02-17T21:30:46.886 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:46.886 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:46.887 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.887 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:46.887 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:46.887 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:46.887 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:46.887 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:46.887 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:46.887 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:46.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.869+0000 7ff9f7101640 10 client.5166.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:46.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.869+0000 7ff9f7101640 10 monclient: _renew_subs 2026-02-17T21:30:46.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.869+0000 7ff9f7101640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:46.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.869+0000 7ff9f7101640 1 -- 10.20.193.5:0/1309916859 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f0073710 con 0x7ff9f015d370 2026-02-17T21:30:46.887 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.869+0000 7ff9f7101640 1 librados: init done 2026-02-17T21:30:46.888 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.870+0000 7ff9f7101640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:46.888 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.870+0000 7ff9f7101640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:46.888 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.870+0000 7ff9f7101640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:46.888 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.870+0000 7ff9f7101640 1 -- 10.20.193.5:0/1309916859 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9f015d750 con 0x7ff9f015d370 2026-02-17T21:30:46.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.881+0000 7ff9e57fa640 1 -- 10.20.193.5:0/1309916859 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7ff9ec0417b0 con 0x7ff9f015d370 2026-02-17T21:30:46.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.882+0000 7ff9e57fa640 1 --2- 10.20.193.5:0/1309916859 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff9c00792d0 0x7ff9c007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:46.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.882+0000 7ff9f4e76640 1 --2- 10.20.193.5:0/1309916859 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff9c00792d0 0x7ff9c007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:46.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.882+0000 7ff9f4e76640 10 monclient: get_auth_request con 0x7ff9c00792d0 auth_method 0 2026-02-17T21:30:46.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.883+0000 7ff9f4e76640 1 --2- 10.20.193.5:0/1309916859 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff9c00792d0 0x7ff9c007b790 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0007fd0 tx=0x7ff9e0003d90 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:46.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.883+0000 7ff9e57fa640 10 client.5166.objecter ms_handle_connect 0x7ff9c00792d0 2026-02-17T21:30:46.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.883+0000 7ff9e57fa640 1 -- 10.20.193.5:0/1309916859 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7ff9ec084390 con 0x7ff9f015d370 2026-02-17T21:30:46.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.883+0000 7ff9e57fa640 10 client.5166.objecter ms_dispatch2 0x7ff9f0000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:46.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.883+0000 7ff9e57fa640 3 client.5166.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:46.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.883+0000 7ff9e57fa640 3 client.5166.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:46.890 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.883+0000 7ff9e57fa640 20 client.5166.objecter dump_active .. 0 homeless 2026-02-17T21:30:46.985 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.982+0000 7ff9e57fa640 1 -- 10.20.193.5:0/1309916859 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff9ec088350 con 0x7ff9f015d370 2026-02-17T21:30:46.985 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.982+0000 7ff9e57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:46.985 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:46.983+0000 7ff9e57fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:47.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.072+0000 7ff9f7101640 1 -- 10.20.193.5:0/1309916859 --> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7ff9f0071130 con 0x7ff9c00792d0 2026-02-17T21:30:47.075 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.073+0000 7ff9e57fa640 1 -- 10.20.193.5:0/1309916859 <== mgr.4131 v2:10.20.193.176:6800/2898618020 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff9f0071130 con 0x7ff9c00792d0 2026-02-17T21:30:47.075 INFO:teuthology.orchestra.run.trial005.stderr:instructed osd(s) 1 to deep-scrub 2026-02-17T21:30:47.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.074+0000 7ff9f7101640 10 librados: watch_flush enter 2026-02-17T21:30:47.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.074+0000 7ff9f7101640 10 librados: watch_flush exit 2026-02-17T21:30:47.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.074+0000 7ff9f7101640 20 client.5166.objecter shutdown clearing up homeless session... 2026-02-17T21:30:47.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.074+0000 7ff9f7101640 10 client.5166.objecter successfully canceled tick 2026-02-17T21:30:47.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.074+0000 7ff9f7101640 1 -- 10.20.193.5:0/1309916859 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff9c00792d0 msgr2=0x7ff9c007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.074+0000 7ff9f7101640 1 --2- 10.20.193.5:0/1309916859 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff9c00792d0 0x7ff9c007b790 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0007fd0 tx=0x7ff9e0003d90 comp rx=0 tx=0).stop 2026-02-17T21:30:47.077 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.074+0000 7ff9f7101640 10 monclient: shutdown 2026-02-17T21:30:47.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.074+0000 7ff9f7101640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:47.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.074+0000 7ff9f7101640 1 -- 10.20.193.5:0/1309916859 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff9f015d370 msgr2=0x7ff9f00c4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.074+0000 7ff9f7101640 1 --2- 10.20.193.5:0/1309916859 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff9f015d370 0x7ff9f00c4a10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009ec0 tx=0x7ff9ec004b40 comp rx=0 tx=0).stop 2026-02-17T21:30:47.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.074+0000 7ff9f7101640 1 -- 10.20.193.5:0/1309916859 shutdown_connections 2026-02-17T21:30:47.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.074+0000 7ff9f7101640 1 --2- 10.20.193.5:0/1309916859 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7ff9c00792d0 0x7ff9c007b790 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.074+0000 7ff9f7101640 1 --2- 10.20.193.5:0/1309916859 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7ff9f015d370 0x7ff9f00c4a10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.074+0000 7ff9f7101640 1 --2- 10.20.193.5:0/1309916859 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff9f00c7e20 0x7ff9f00741f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.074+0000 7ff9f7101640 1 --2- 10.20.193.5:0/1309916859 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7ff9f00c59c0 0x7ff9f00729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.074+0000 7ff9f7101640 1 -- 10.20.193.5:0/1309916859 >> 10.20.193.5:0/1309916859 conn(0x7ff9f00c9f20 msgr2=0x7ff9f015c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:47.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.074+0000 7ff9f7101640 1 -- 10.20.193.5:0/1309916859 shutdown_connections 2026-02-17T21:30:47.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.074+0000 7ff9f7101640 1 -- 10.20.193.5:0/1309916859 wait complete. 2026-02-17T21:30:47.078 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.074+0000 7ff9f7101640 1 librados: shutdown 2026-02-17T21:30:47.084 INFO:tasks.ceph:Scrubbing osd.5 2026-02-17T21:30:47.085 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:30:47.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.151+0000 7fc98dd4f640 10 monclient: get_monmap_and_config 2026-02-17T21:30:47.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.151+0000 7fc98dd4f640 10 monclient: build_initial_monmap 2026-02-17T21:30:47.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.151+0000 7fc98dd4f640 10 monclient: monmap: 2026-02-17T21:30:47.154 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:47.154 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:47.154 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:47.153414+0000 2026-02-17T21:30:47.154 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:47.153414+0000 2026-02-17T21:30:47.154 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:47.155 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.155 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:47.155 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:47.155 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:47.155 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:47.155 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:47.155 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:47.155 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.152+0000 7fc98dd4f640 1 Processor -- start 2026-02-17T21:30:47.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.152+0000 7fc98dd4f640 1 -- start start 2026-02-17T21:30:47.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.152+0000 7fc98dd4f640 10 monclient: init 2026-02-17T21:30:47.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.152+0000 7fc98dd4f640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:47.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.152+0000 7fc98dd4f640 10 monclient: _add_conns ranks=[3,1,5,0,2,4] 2026-02-17T21:30:47.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.152+0000 7fc98dd4f640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fc988153930 0x7fc9880c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.152+0000 7fc98dd4f640 10 monclient(hunting): picked mon.noname-a con 0x7fc988153930 addr v2:10.20.193.5:3300/0 2026-02-17T21:30:47.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.152+0000 7fc98dd4f640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fc988153d10 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:47.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.152+0000 7fc98dd4f640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fc9880c52d0 0x7fc9880c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.152+0000 7fc98dd4f640 10 monclient(hunting): picked mon.noname-c con 0x7fc9880c52d0 addr v2:10.20.193.135:3300/0 2026-02-17T21:30:47.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.152+0000 7fc98dd4f640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9880c85a0 con 0x7fc988153d10 2026-02-17T21:30:47.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.152+0000 7fc98dd4f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:47.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.152+0000 7fc98dd4f640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc9880c8380 con 0x7fc988153930 2026-02-17T21:30:47.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.152+0000 7fc98dd4f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:47.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.152+0000 7fc98dd4f640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fc9880c5c20 con 0x7fc9880c52d0 2026-02-17T21:30:47.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.152+0000 7fc98dd4f640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:47.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.152+0000 7fc98dd4f640 10 monclient(hunting): authenticate will time out at 1352.718691s 2026-02-17T21:30:47.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.153+0000 7fc9877fe640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fc988153930 0x7fc9880c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.153+0000 7fc986ffd640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7fc988153d10 0x7fc98815b070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:43588/0 (socket says 10.20.193.5:43588) 2026-02-17T21:30:47.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.153+0000 7fc986ffd640 1 -- 10.20.193.5:0/1404412975 learned_addr learned my addr 10.20.193.5:0/1404412975 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:47.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.153+0000 7fc987fff640 1 --2- 10.20.193.5:0/1404412975 >> v2:10.20.193.135:3300/0 conn(0x7fc9880c52d0 0x7fc9880c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.153+0000 7fc987fff640 10 monclient(hunting): get_auth_request con 0x7fc9880c52d0 auth_method 0 2026-02-17T21:30:47.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.153+0000 7fc987fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:47.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.153+0000 7fc987fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.153+0000 7fc987fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:47.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.153+0000 7fc9877fe640 10 monclient(hunting): get_auth_request con 0x7fc988153930 auth_method 0 2026-02-17T21:30:47.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.153+0000 7fc9877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:47.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.153+0000 7fc9877fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.153+0000 7fc9877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:47.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.153+0000 7fc987fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:47.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.153+0000 7fc987fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:47.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.153+0000 7fc987fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:47.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.154+0000 7fc9877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:47.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.154+0000 7fc9877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:47.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.154+0000 7fc9877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:47.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.154+0000 7fc9867fc640 1 -- 10.20.193.5:0/1404412975 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2668119478 0 0) 0x7fc9880c85a0 con 0x7fc988153d10 2026-02-17T21:30:47.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.154+0000 7fc9867fc640 10 monclient(hunting): _negotiate 2026-02-17T21:30:47.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.154+0000 7fc9867fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.154+0000 7fc9867fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:47.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.154+0000 7fc9867fc640 10 monclient(hunting): my global_id is 5251 2026-02-17T21:30:47.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.154+0000 7fc9867fc640 1 -- 10.20.193.5:0/1404412975 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc96c003620 con 0x7fc988153d10 2026-02-17T21:30:47.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.154+0000 7fc987fff640 10 monclient(hunting): handle_auth_done global_id 5246 payload 274 2026-02-17T21:30:47.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.154+0000 7fc987fff640 1 -- 10.20.193.5:0/1404412975 >> v2:10.20.193.5:3300/0 conn(0x7fc988153930 msgr2=0x7fc9880c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:47.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.154+0000 7fc987fff640 1 --2- 10.20.193.5:0/1404412975 >> v2:10.20.193.5:3300/0 conn(0x7fc988153930 0x7fc9880c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.154+0000 7fc987fff640 1 -- 10.20.193.5:0/1404412975 >> v1:10.20.193.119:6789/0 conn(0x7fc988153d10 legacy=0x7fc98815b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.154+0000 7fc987fff640 10 monclient: _finish_hunting 0 2026-02-17T21:30:47.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.154+0000 7fc987fff640 1 monclient: found mon.noname-c 2026-02-17T21:30:47.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.154+0000 7fc987fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:47.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.154+0000 7fc987fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:47.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.154+0000 7fc987fff640 1 -- 10.20.193.5:0/1404412975 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9880c8880 con 0x7fc9880c52d0 2026-02-17T21:30:47.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.156+0000 7fc987fff640 1 --2- 10.20.193.5:0/1404412975 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc9880c52d0 0x7fc9880c56e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc988157750 tx=0x7fc97c02f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2fc81e2d3772758 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:47.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc9867fc640 1 -- 10.20.193.5:0/1404412975 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97c03c070 con 0x7fc9880c52d0 2026-02-17T21:30:47.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc9867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:47.169 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc9867fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:47.170 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc9867fc640 10 monclient: dump: 2026-02-17T21:30:47.170 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:47.170 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:47.170 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.170 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.170 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:47.170 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.170 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:47.170 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:47.170 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:47.170 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc9867fc640 10 monclient: _finish_auth 0 2026-02-17T21:30:47.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc9867fc640 10 monclient: _check_auth_tickets 2026-02-17T21:30:47.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc9867fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:47.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc9867fc640 1 -- 10.20.193.5:0/1404412975 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc97c037440 con 0x7fc9880c52d0 2026-02-17T21:30:47.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc9867fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:47.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc9867fc640 1 -- 10.20.193.5:0/1404412975 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97c037810 con 0x7fc9880c52d0 2026-02-17T21:30:47.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc98dd4f640 5 monclient: authenticate success, global_id 5246 2026-02-17T21:30:47.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc98dd4f640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:47.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc98dd4f640 4 set_mon_vals no callback set 2026-02-17T21:30:47.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc9867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:47.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc9867fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:47.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc9867fc640 10 monclient: dump: 2026-02-17T21:30:47.172 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:47.172 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:47.172 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.172 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.172 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:47.172 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.172 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:47.172 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:47.172 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:47.172 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc98dd4f640 10 monclient: shutdown 2026-02-17T21:30:47.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc98dd4f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:47.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc98dd4f640 1 -- 10.20.193.5:0/1404412975 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc9880c52d0 msgr2=0x7fc9880c56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc98dd4f640 1 --2- 10.20.193.5:0/1404412975 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc9880c52d0 0x7fc9880c56e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc988157750 tx=0x7fc97c02f1c0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc98dd4f640 1 -- 10.20.193.5:0/1404412975 shutdown_connections 2026-02-17T21:30:47.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc98dd4f640 1 --2- 10.20.193.5:0/1404412975 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc9880c52d0 0x7fc9880c56e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc98dd4f640 1 --2- 10.20.193.5:0/1404412975 >> v2:10.20.193.5:3300/0 conn(0x7fc988153930 0x7fc9880c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc98dd4f640 1 -- 10.20.193.5:0/1404412975 >> 10.20.193.5:0/1404412975 conn(0x7fc9880c9f40 msgr2=0x7fc9880ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:47.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc98dd4f640 1 -- 10.20.193.5:0/1404412975 shutdown_connections 2026-02-17T21:30:47.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc98dd4f640 1 -- 10.20.193.5:0/1404412975 wait complete. 2026-02-17T21:30:47.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc98dd4f640 10 monclient: build_initial_monmap 2026-02-17T21:30:47.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.158+0000 7fc98dd4f640 10 monclient: monmap: 2026-02-17T21:30:47.173 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:47.173 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:47.173 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:47.174 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:47.174 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:47.174 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.174 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:47.174 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:47.174 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:47.174 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.159+0000 7fc98dd4f640 1 librados: starting msgr at 2026-02-17T21:30:47.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.159+0000 7fc98dd4f640 1 librados: starting objecter 2026-02-17T21:30:47.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.159+0000 7fc98dd4f640 1 Processor -- start 2026-02-17T21:30:47.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.159+0000 7fc98dd4f640 1 -- start start 2026-02-17T21:30:47.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.159+0000 7fc98dd4f640 1 librados: setting wanted keys 2026-02-17T21:30:47.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.159+0000 7fc98dd4f640 1 librados: calling monclient init 2026-02-17T21:30:47.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.159+0000 7fc98dd4f640 10 monclient: init 2026-02-17T21:30:47.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.159+0000 7fc98dd4f640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:47.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.159+0000 7fc98dd4f640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:30:47.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.159+0000 7fc98dd4f640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc9880c52d0 0x7fc988073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.159+0000 7fc98dd4f640 10 monclient(hunting): picked mon.noname-a con 0x7fc9880c52d0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:47.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.159+0000 7fc98dd4f640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc988153930 0x7fc9881f48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.159+0000 7fc98dd4f640 10 monclient(hunting): picked mon.noname-b con 0x7fc988153930 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:47.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.159+0000 7fc98dd4f640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc988153d10 0x7fc98814aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.159+0000 7fc98dd4f640 10 monclient(hunting): picked mon.noname-c con 0x7fc988153d10 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:47.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.159+0000 7fc98dd4f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:47.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.159+0000 7fc98dd4f640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc9880c8e40 con 0x7fc9880c52d0 2026-02-17T21:30:47.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.159+0000 7fc98dd4f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:47.175 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.159+0000 7fc98dd4f640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc9880c9490 con 0x7fc988153930 2026-02-17T21:30:47.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.159+0000 7fc98dd4f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:47.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.159+0000 7fc98dd4f640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc9880c9120 con 0x7fc988153d10 2026-02-17T21:30:47.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.159+0000 7fc98dd4f640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:47.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.159+0000 7fc98dd4f640 10 monclient(hunting): authenticate will time out at 1352.725695s 2026-02-17T21:30:47.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.159+0000 7fc9877fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc9880c52d0 0x7fc988073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.160+0000 7fc986ffd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc988153930 0x7fc9881f48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.160+0000 7fc987fff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc988153d10 0x7fc98814aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.160+0000 7fc9877fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc9880c52d0 0x7fc988073ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:32828/0 (socket says 10.20.193.5:32828) 2026-02-17T21:30:47.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.160+0000 7fc9877fe640 1 -- 10.20.193.5:0/3536671404 learned_addr learned my addr 10.20.193.5:0/3536671404 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:47.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.160+0000 7fc9877fe640 10 monclient(hunting): get_auth_request con 0x7fc9880c52d0 auth_method 0 2026-02-17T21:30:47.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.160+0000 7fc9877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:47.176 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.160+0000 7fc9877fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.177 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.160+0000 7fc9877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:47.177 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.160+0000 7fc986ffd640 10 monclient(hunting): get_auth_request con 0x7fc988153930 auth_method 0 2026-02-17T21:30:47.177 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.160+0000 7fc986ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:47.177 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.160+0000 7fc986ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.177 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.160+0000 7fc986ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:47.177 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.160+0000 7fc987fff640 10 monclient(hunting): get_auth_request con 0x7fc988153d10 auth_method 0 2026-02-17T21:30:47.177 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.160+0000 7fc987fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:47.177 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.160+0000 7fc987fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.177 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.160+0000 7fc987fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:47.177 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.160+0000 7fc9877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:47.177 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.160+0000 7fc9877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:47.177 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.160+0000 7fc9877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:47.177 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.160+0000 7fc986ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:47.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.160+0000 7fc986ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:47.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.160+0000 7fc986ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:47.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.160+0000 7fc987fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:47.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.160+0000 7fc987fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:47.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.160+0000 7fc987fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:47.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.161+0000 7fc986ffd640 10 monclient(hunting): handle_auth_done global_id 5254 payload 824 2026-02-17T21:30:47.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.161+0000 7fc986ffd640 1 -- 10.20.193.5:0/3536671404 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc988153d10 msgr2=0x7fc98814aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.161+0000 7fc986ffd640 1 --2- 10.20.193.5:0/3536671404 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc988153d10 0x7fc98814aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.161+0000 7fc986ffd640 1 -- 10.20.193.5:0/3536671404 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc9880c52d0 msgr2=0x7fc988073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.161+0000 7fc986ffd640 1 --2- 10.20.193.5:0/3536671404 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc9880c52d0 0x7fc988073ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.161+0000 7fc986ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:30:47.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.161+0000 7fc986ffd640 1 monclient: found mon.noname-b 2026-02-17T21:30:47.178 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.161+0000 7fc986ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:47.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.161+0000 7fc986ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:30:47.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.161+0000 7fc986ffd640 1 -- 10.20.193.5:0/3536671404 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc988072870 con 0x7fc988153930 2026-02-17T21:30:47.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.163+0000 7fc986ffd640 1 --2- 10.20.193.5:0/3536671404 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc988153930 0x7fc9881f48e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc97800c500 tx=0x7fc97800c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:47.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.163+0000 7fc963fff640 10 client.?.objecter ms_handle_connect 0x7fc988153930 2026-02-17T21:30:47.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.163+0000 7fc963fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:47.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.164+0000 7fc963fff640 1 -- 10.20.193.5:0/3536671404 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978017070 con 0x7fc988153930 2026-02-17T21:30:47.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.164+0000 7fc963fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:47.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.164+0000 7fc963fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:30:47.179 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.164+0000 7fc963fff640 10 monclient: dump: 2026-02-17T21:30:47.179 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:47.179 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:47.179 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.180 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.180 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:47.180 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.180 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:47.180 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:47.180 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:47.180 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.164+0000 7fc963fff640 10 monclient: _finish_auth 0 2026-02-17T21:30:47.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.164+0000 7fc963fff640 10 monclient: _check_auth_tickets 2026-02-17T21:30:47.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.164+0000 7fc963fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:47.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.164+0000 7fc98dd4f640 5 monclient: authenticate success, global_id 5254 2026-02-17T21:30:47.180 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.164+0000 7fc963fff640 1 -- 10.20.193.5:0/3536671404 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc978005de0 con 0x7fc988153930 2026-02-17T21:30:47.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.164+0000 7fc98dd4f640 10 monclient: _renew_subs 2026-02-17T21:30:47.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.164+0000 7fc98dd4f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:47.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.164+0000 7fc98dd4f640 1 -- 10.20.193.5:0/3536671404 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc988072b50 con 0x7fc988153930 2026-02-17T21:30:47.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.164+0000 7fc963fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:47.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.164+0000 7fc963fff640 1 -- 10.20.193.5:0/3536671404 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978007270 con 0x7fc988153930 2026-02-17T21:30:47.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.164+0000 7fc963fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:47.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.164+0000 7fc963fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:30:47.181 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.164+0000 7fc963fff640 10 monclient: dump: 2026-02-17T21:30:47.181 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:47.181 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:47.181 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.181 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.182 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:47.182 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.182 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:47.182 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:47.182 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:47.182 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.164+0000 7fc985ffb640 4 set_mon_vals no callback set 2026-02-17T21:30:47.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.164+0000 7fc98dd4f640 10 client.5254.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:47.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.164+0000 7fc98dd4f640 10 monclient: _renew_subs 2026-02-17T21:30:47.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.164+0000 7fc98dd4f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:47.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.164+0000 7fc98dd4f640 1 -- 10.20.193.5:0/3536671404 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc988073110 con 0x7fc988153930 2026-02-17T21:30:47.182 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.164+0000 7fc98dd4f640 1 librados: init done 2026-02-17T21:30:47.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.165+0000 7fc98dd4f640 10 client.5254.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:47.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.165+0000 7fc98dd4f640 15 client.5254.objecter _session_command_op_assign -1 1 2026-02-17T21:30:47.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.165+0000 7fc98dd4f640 20 client.5254.objecter _get_session osd=-1 returning homeless 2026-02-17T21:30:47.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.165+0000 7fc98dd4f640 10 client.5254.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:47.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.165+0000 7fc98dd4f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:47.183 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.165+0000 7fc98dd4f640 1 -- 10.20.193.5:0/3536671404 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc988073c90 con 0x7fc988153930 2026-02-17T21:30:47.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.176+0000 7fc963fff640 1 -- 10.20.193.5:0/3536671404 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fc978007410 con 0x7fc988153930 2026-02-17T21:30:47.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.177+0000 7fc963fff640 1 --2- 10.20.193.5:0/3536671404 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc958079300 0x7fc95807b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.177+0000 7fc9877fe640 1 --2- 10.20.193.5:0/3536671404 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc958079300 0x7fc95807b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.177+0000 7fc9877fe640 10 monclient: get_auth_request con 0x7fc958079300 auth_method 0 2026-02-17T21:30:47.185 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.178+0000 7fc9877fe640 1 --2- 10.20.193.5:0/3536671404 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc958079300 0x7fc95807b7c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc974009d00 tx=0x7fc974009290 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:47.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.178+0000 7fc963fff640 10 client.5254.objecter ms_handle_connect 0x7fc958079300 2026-02-17T21:30:47.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.179+0000 7fc963fff640 1 -- 10.20.193.5:0/3536671404 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fc978007730 con 0x7fc988153930 2026-02-17T21:30:47.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.179+0000 7fc963fff640 10 client.5254.objecter ms_dispatch2 0x7fc988000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:47.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.179+0000 7fc963fff640 3 client.5254.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:47.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.179+0000 7fc963fff640 3 client.5254.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:47.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.179+0000 7fc963fff640 10 client.5254.objecter checking command 1 2026-02-17T21:30:47.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.179+0000 7fc963fff640 1 --2- 10.20.193.5:0/3536671404 >> [v2:10.20.193.119:6818/4010664603,v1:10.20.193.119:6820/4010664603] conn(0x7fc9580817e0 0x7fc958083c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.179+0000 7fc963fff640 20 client.5254.objecter _get_session s=0x7fc958081110 osd=5 3 2026-02-17T21:30:47.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.179+0000 7fc963fff640 20 client.5254.objecter put_session s=0x7fc958081110 osd=5 3 2026-02-17T21:30:47.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.179+0000 7fc963fff640 15 client.5254.objecter _session_command_op_remove -1 1 2026-02-17T21:30:47.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.179+0000 7fc963fff640 20 client.5254.objecter _get_session s=0x7fc958081110 osd=5 3 2026-02-17T21:30:47.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.179+0000 7fc963fff640 20 client.5254.objecter get_session s=0x7fc958081110 osd=5 3 2026-02-17T21:30:47.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.179+0000 7fc963fff640 15 client.5254.objecter _session_command_op_assign 5 1 2026-02-17T21:30:47.186 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.179+0000 7fc963fff640 20 client.5254.objecter put_session s=0x7fc958081110 osd=5 4 2026-02-17T21:30:47.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.179+0000 7fc963fff640 10 client.5254.objecter _send_command 1 2026-02-17T21:30:47.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.179+0000 7fc963fff640 1 -- 10.20.193.5:0/3536671404 --> [v2:10.20.193.119:6818/4010664603,v1:10.20.193.119:6820/4010664603] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc978021e50 con 0x7fc9580817e0 2026-02-17T21:30:47.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.179+0000 7fc963fff640 20 client.5254.objecter dump_active .. 0 homeless 2026-02-17T21:30:47.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.179+0000 7fc963fff640 1 -- 10.20.193.5:0/3536671404 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc97805db70 con 0x7fc988153930 2026-02-17T21:30:47.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.179+0000 7fc963fff640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T21:30:47.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.179+0000 7fc987fff640 1 --2- 10.20.193.5:0/3536671404 >> [v2:10.20.193.119:6818/4010664603,v1:10.20.193.119:6820/4010664603] conn(0x7fc9580817e0 0x7fc958083c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.179+0000 7fc987fff640 10 monclient: get_auth_request con 0x7fc9580817e0 auth_method 0 2026-02-17T21:30:47.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.181+0000 7fc987fff640 1 --2- 10.20.193.5:0/3536671404 >> [v2:10.20.193.119:6818/4010664603,v1:10.20.193.119:6820/4010664603] conn(0x7fc9580817e0 0x7fc958083c00 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:47.187 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.181+0000 7fc963fff640 10 client.5254.objecter ms_handle_connect 0x7fc9580817e0 2026-02-17T21:30:47.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.192+0000 7fc963fff640 1 -- 10.20.193.5:0/3536671404 <== osd.5 v2:10.20.193.119:6818/4010664603 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fc978021e50 con 0x7fc9580817e0 2026-02-17T21:30:47.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.192+0000 7fc963fff640 10 client.5254.objecter ms_dispatch2 0x7fc988000b90 command_reply(tid 1: 0 ) 2026-02-17T21:30:47.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.192+0000 7fc963fff640 10 client.5254.objecter _finish_command 1 = system:0 2026-02-17T21:30:47.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.192+0000 7fc963fff640 20 client.5254.objecter put_session s=0x7fc958081110 osd=5 4 2026-02-17T21:30:47.195 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.192+0000 7fc963fff640 15 client.5254.objecter _session_command_op_remove 5 1 2026-02-17T21:30:47.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.198+0000 7fc98dd4f640 10 client.5254.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:30:47.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.198+0000 7fc98dd4f640 15 client.5254.objecter _session_command_op_assign -1 2 2026-02-17T21:30:47.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.198+0000 7fc98dd4f640 20 client.5254.objecter _get_session s=0x7fc958081110 osd=5 3 2026-02-17T21:30:47.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.198+0000 7fc98dd4f640 20 client.5254.objecter put_session s=0x7fc958081110 osd=5 3 2026-02-17T21:30:47.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.198+0000 7fc98dd4f640 20 client.5254.objecter _get_session s=0x7fc958081110 osd=5 3 2026-02-17T21:30:47.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.198+0000 7fc98dd4f640 15 client.5254.objecter _session_command_op_remove -1 2 2026-02-17T21:30:47.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.198+0000 7fc98dd4f640 20 client.5254.objecter get_session s=0x7fc958081110 osd=5 3 2026-02-17T21:30:47.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.198+0000 7fc98dd4f640 15 client.5254.objecter _session_command_op_assign 5 2 2026-02-17T21:30:47.201 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.198+0000 7fc98dd4f640 20 client.5254.objecter put_session s=0x7fc958081110 osd=5 4 2026-02-17T21:30:47.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.198+0000 7fc98dd4f640 10 client.5254.objecter _send_command 2 2026-02-17T21:30:47.202 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.198+0000 7fc98dd4f640 1 -- 10.20.193.5:0/3536671404 --> [v2:10.20.193.119:6818/4010664603,v1:10.20.193.119:6820/4010664603] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc9880c7730 con 0x7fc9580817e0 2026-02-17T21:30:47.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.206+0000 7fc963fff640 1 -- 10.20.193.5:0/3536671404 <== osd.5 v2:10.20.193.119:6818/4010664603 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc9880c7730 con 0x7fc9580817e0 2026-02-17T21:30:47.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.206+0000 7fc963fff640 10 client.5254.objecter ms_dispatch2 0x7fc988000b90 command_reply(tid 2: 0 ) 2026-02-17T21:30:47.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.206+0000 7fc963fff640 10 client.5254.objecter _finish_command 2 = system:0 2026-02-17T21:30:47.208 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.206+0000 7fc963fff640 20 client.5254.objecter put_session s=0x7fc958081110 osd=5 4 2026-02-17T21:30:47.209 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.206+0000 7fc963fff640 15 client.5254.objecter _session_command_op_remove 5 2 2026-02-17T21:30:47.209 INFO:teuthology.orchestra.run.trial005.stdout:{ 2026-02-17T21:30:47.209 INFO:teuthology.orchestra.run.trial005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:30:47.209 INFO:teuthology.orchestra.run.trial005.stdout:} 2026-02-17T21:30:47.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.206+0000 7fc98dd4f640 10 librados: watch_flush enter 2026-02-17T21:30:47.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.206+0000 7fc98dd4f640 10 librados: watch_flush exit 2026-02-17T21:30:47.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.206+0000 7fc98dd4f640 10 client.5254.objecter close_session for osd.5 2026-02-17T21:30:47.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.206+0000 7fc98dd4f640 1 -- 10.20.193.5:0/3536671404 >> [v2:10.20.193.119:6818/4010664603,v1:10.20.193.119:6820/4010664603] conn(0x7fc9580817e0 msgr2=0x7fc958083c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.206+0000 7fc98dd4f640 1 --2- 10.20.193.5:0/3536671404 >> [v2:10.20.193.119:6818/4010664603,v1:10.20.193.119:6820/4010664603] conn(0x7fc9580817e0 0x7fc958083c00 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.206+0000 7fc98dd4f640 20 client.5254.objecter put_session s=0x7fc958081110 osd=5 1 2026-02-17T21:30:47.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.206+0000 7fc98dd4f640 20 client.5254.objecter shutdown clearing up homeless session... 2026-02-17T21:30:47.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.206+0000 7fc98dd4f640 10 client.5254.objecter successfully canceled tick 2026-02-17T21:30:47.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.206+0000 7fc98dd4f640 1 -- 10.20.193.5:0/3536671404 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc958079300 msgr2=0x7fc95807b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.211 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.206+0000 7fc98dd4f640 1 --2- 10.20.193.5:0/3536671404 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc958079300 0x7fc95807b7c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc974009d00 tx=0x7fc974009290 comp rx=0 tx=0).stop 2026-02-17T21:30:47.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.206+0000 7fc98dd4f640 10 monclient: shutdown 2026-02-17T21:30:47.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.206+0000 7fc98dd4f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:47.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.206+0000 7fc98dd4f640 1 -- 10.20.193.5:0/3536671404 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc988153930 msgr2=0x7fc9881f48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.206+0000 7fc98dd4f640 1 --2- 10.20.193.5:0/3536671404 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc988153930 0x7fc9881f48e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc97800c500 tx=0x7fc97800c9d0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.206+0000 7fc987fff640 1 -- 10.20.193.5:0/3536671404 reap_dead start 2026-02-17T21:30:47.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.206+0000 7fc98dd4f640 1 -- 10.20.193.5:0/3536671404 shutdown_connections 2026-02-17T21:30:47.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.206+0000 7fc98dd4f640 1 -- 10.20.193.5:0/3536671404 >> 10.20.193.5:0/3536671404 conn(0x7fc9880c9f40 msgr2=0x7fc98815c390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:47.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.206+0000 7fc98dd4f640 1 -- 10.20.193.5:0/3536671404 shutdown_connections 2026-02-17T21:30:47.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.206+0000 7fc98dd4f640 1 -- 10.20.193.5:0/3536671404 wait complete. 2026-02-17T21:30:47.212 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.206+0000 7fc98dd4f640 1 librados: shutdown 2026-02-17T21:30:47.217 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-17T21:30:47.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.282+0000 7f09fc1e7640 10 monclient: get_monmap_and_config 2026-02-17T21:30:47.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.282+0000 7f09fc1e7640 10 monclient: build_initial_monmap 2026-02-17T21:30:47.284 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.282+0000 7f09fc1e7640 10 monclient: monmap: 2026-02-17T21:30:47.285 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:47.285 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:47.285 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:47.283862+0000 2026-02-17T21:30:47.285 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:47.283862+0000 2026-02-17T21:30:47.285 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:47.285 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.285 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:47.285 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:47.285 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:47.285 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:47.285 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:47.286 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:47.286 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.282+0000 7f09fc1e7640 1 Processor -- start 2026-02-17T21:30:47.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.282+0000 7f09fc1e7640 1 -- start start 2026-02-17T21:30:47.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.282+0000 7f09fc1e7640 10 monclient: init 2026-02-17T21:30:47.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.283+0000 7f09fc1e7640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:47.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.283+0000 7f09fc1e7640 10 monclient: _add_conns ranks=[3,2,5,4,0,1] 2026-02-17T21:30:47.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.283+0000 7f09fc1e7640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f09f4152820 0x7f09f41593f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.283+0000 7f09fc1e7640 10 monclient(hunting): picked mon.noname-a con 0x7f09f4152820 addr v2:10.20.193.5:3300/0 2026-02-17T21:30:47.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.283+0000 7f09fc1e7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f09f4152c00 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:47.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.283+0000 7f09fc1e7640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f09f40738f0 0x7f09f40c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.283+0000 7f09fc1e7640 10 monclient(hunting): picked mon.noname-c con 0x7f09f40738f0 addr v2:10.20.193.135:3300/0 2026-02-17T21:30:47.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.283+0000 7f09fc1e7640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09f4073e90 con 0x7f09f4152c00 2026-02-17T21:30:47.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.283+0000 7f09fc1e7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:47.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.283+0000 7f09fc1e7640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f09f4159930 con 0x7f09f4152820 2026-02-17T21:30:47.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.283+0000 7f09fc1e7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:47.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.283+0000 7f09fc1e7640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f09f40c8550 con 0x7f09f40738f0 2026-02-17T21:30:47.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.283+0000 7f09fc1e7640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:47.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.283+0000 7f09fc1e7640 10 monclient(hunting): authenticate will time out at 1352.849251s 2026-02-17T21:30:47.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.283+0000 7f09f9f5c640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f09f4152820 0x7f09f41593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.283+0000 7f09fa75d640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f09f40738f0 0x7f09f40c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.283+0000 7f09f9f5c640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f09f4152820 0x7f09f41593f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48206/0 (socket says 10.20.193.5:48206) 2026-02-17T21:30:47.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.283+0000 7f09f9f5c640 1 -- 10.20.193.5:0/1832254106 learned_addr learned my addr 10.20.193.5:0/1832254106 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:47.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.283+0000 7f09f9f5c640 10 monclient(hunting): get_auth_request con 0x7f09f4152820 auth_method 0 2026-02-17T21:30:47.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.283+0000 7f09f9f5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:47.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.283+0000 7f09f9f5c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.283+0000 7f09f9f5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:47.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.284+0000 7f09f9f5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:47.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.284+0000 7f09f9f5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:47.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.284+0000 7f09f9f5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:47.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.284+0000 7f09fa75d640 10 monclient(hunting): get_auth_request con 0x7f09f40738f0 auth_method 0 2026-02-17T21:30:47.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.284+0000 7f09fa75d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:47.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.284+0000 7f09fa75d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.284+0000 7f09fa75d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:47.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.284+0000 7f09fa75d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:47.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.284+0000 7f09fa75d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:47.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.284+0000 7f09fa75d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:47.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.285+0000 7f09f9f5c640 10 monclient(hunting): handle_auth_done global_id 5175 payload 274 2026-02-17T21:30:47.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.285+0000 7f09f9f5c640 1 -- 10.20.193.5:0/1832254106 >> v2:10.20.193.135:3300/0 conn(0x7f09f40738f0 msgr2=0x7f09f40c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:47.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.285+0000 7f09f9f5c640 1 --2- 10.20.193.5:0/1832254106 >> v2:10.20.193.135:3300/0 conn(0x7f09f40738f0 0x7f09f40c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.285+0000 7f09f9f5c640 1 -- 10.20.193.5:0/1832254106 >> v1:10.20.193.135:6789/0 conn(0x7f09f4152c00 legacy=0x7f09f40c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.285+0000 7f09f9f5c640 10 monclient: _finish_hunting 0 2026-02-17T21:30:47.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.285+0000 7f09f9f5c640 1 monclient: found mon.noname-a 2026-02-17T21:30:47.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.285+0000 7f09f9f5c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:47.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.285+0000 7f09f9f5c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:47.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.285+0000 7f09f9f5c640 1 -- 10.20.193.5:0/1832254106 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f4074170 con 0x7f09f4152820 2026-02-17T21:30:47.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.286+0000 7f09f9f5c640 1 --2- 10.20.193.5:0/1832254106 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09f4152820 0x7f09f41593f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f09f4069ce0 tx=0x7f09e402ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=478409bebd289c85 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:47.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.287+0000 7f09f8f5a640 1 -- 10.20.193.5:0/1832254106 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e403c070 con 0x7f09f4152820 2026-02-17T21:30:47.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09f8f5a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:47.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09f8f5a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:47.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09f8f5a640 10 monclient: dump: 2026-02-17T21:30:47.300 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:47.300 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:47.300 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.301 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.301 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:47.301 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.301 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:47.301 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:47.301 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:47.301 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09f8f5a640 10 monclient: _finish_auth 0 2026-02-17T21:30:47.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09f8f5a640 10 monclient: _check_auth_tickets 2026-02-17T21:30:47.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09f8f5a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:47.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09f8f5a640 1 -- 10.20.193.5:0/1832254106 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e402fc70 con 0x7f09f4152820 2026-02-17T21:30:47.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09fc1e7640 5 monclient: authenticate success, global_id 5175 2026-02-17T21:30:47.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09fc1e7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:47.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09f8f5a640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:47.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09f8f5a640 1 -- 10.20.193.5:0/1832254106 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e4037660 con 0x7f09f4152820 2026-02-17T21:30:47.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09fc1e7640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:47.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09fc1e7640 4 set_mon_vals no callback set 2026-02-17T21:30:47.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09f8f5a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:47.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09f8f5a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:47.302 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09f8f5a640 10 monclient: dump: 2026-02-17T21:30:47.302 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:47.303 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:47.303 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.303 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.303 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:47.303 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.303 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:47.303 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:47.303 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:47.303 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.303 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09fc1e7640 10 monclient: shutdown 2026-02-17T21:30:47.303 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09fc1e7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:47.303 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09fc1e7640 1 -- 10.20.193.5:0/1832254106 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09f4152820 msgr2=0x7f09f41593f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09fc1e7640 1 --2- 10.20.193.5:0/1832254106 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09f4152820 0x7f09f41593f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f09f4069ce0 tx=0x7f09e402ef60 comp rx=0 tx=0).stop 2026-02-17T21:30:47.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09fc1e7640 1 -- 10.20.193.5:0/1832254106 shutdown_connections 2026-02-17T21:30:47.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09fc1e7640 1 --2- 10.20.193.5:0/1832254106 >> v2:10.20.193.135:3300/0 conn(0x7f09f40738f0 0x7f09f40c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09fc1e7640 1 --2- 10.20.193.5:0/1832254106 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09f4152820 0x7f09f41593f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09fc1e7640 1 -- 10.20.193.5:0/1832254106 >> 10.20.193.5:0/1832254106 conn(0x7f09f40c9f40 msgr2=0x7f09f40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:47.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09fc1e7640 1 -- 10.20.193.5:0/1832254106 shutdown_connections 2026-02-17T21:30:47.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09fc1e7640 1 -- 10.20.193.5:0/1832254106 wait complete. 2026-02-17T21:30:47.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09fc1e7640 10 monclient: build_initial_monmap 2026-02-17T21:30:47.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.288+0000 7f09fc1e7640 10 monclient: monmap: 2026-02-17T21:30:47.304 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:47.304 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:47.304 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:47.305 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:47.305 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:47.305 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.305 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:47.305 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:47.305 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:47.305 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.289+0000 7f09fc1e7640 1 librados: starting msgr at 2026-02-17T21:30:47.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.289+0000 7f09fc1e7640 1 librados: starting objecter 2026-02-17T21:30:47.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.289+0000 7f09fc1e7640 1 Processor -- start 2026-02-17T21:30:47.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.289+0000 7f09fc1e7640 1 -- start start 2026-02-17T21:30:47.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.289+0000 7f09fc1e7640 1 librados: setting wanted keys 2026-02-17T21:30:47.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.289+0000 7f09fc1e7640 1 librados: calling monclient init 2026-02-17T21:30:47.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.289+0000 7f09fc1e7640 10 monclient: init 2026-02-17T21:30:47.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.289+0000 7f09fc1e7640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:47.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.289+0000 7f09fc1e7640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:30:47.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.289+0000 7f09fc1e7640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f09f40738f0 0x7f09f4156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.289+0000 7f09fc1e7640 10 monclient(hunting): picked mon.noname-c con 0x7f09f40738f0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:47.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.289+0000 7f09fc1e7640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09f4152820 0x7f09f4148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.289+0000 7f09fc1e7640 10 monclient(hunting): picked mon.noname-a con 0x7f09f4152820 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:47.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.289+0000 7f09fc1e7640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f09f4152c00 0x7f09f41508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.289+0000 7f09fc1e7640 10 monclient(hunting): picked mon.noname-b con 0x7f09f4152c00 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:47.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.289+0000 7f09fc1e7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:47.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.289+0000 7f09fc1e7640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f09f4074a10 con 0x7f09f4152820 2026-02-17T21:30:47.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.289+0000 7f09fc1e7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:47.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.289+0000 7f09fc1e7640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f09f4074730 con 0x7f09f4152c00 2026-02-17T21:30:47.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.289+0000 7f09fc1e7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:47.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.289+0000 7f09fc1e7640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f09f4074cf0 con 0x7f09f40738f0 2026-02-17T21:30:47.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.289+0000 7f09fc1e7640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:47.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.289+0000 7f09fc1e7640 10 monclient(hunting): authenticate will time out at 1352.855555s 2026-02-17T21:30:47.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.289+0000 7f09f975b640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09f4152820 0x7f09f4148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.290+0000 7f09f975b640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09f4152820 0x7f09f4148430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48210/0 (socket says 10.20.193.5:48210) 2026-02-17T21:30:47.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.290+0000 7f09f975b640 1 -- 10.20.193.5:0/3856116179 learned_addr learned my addr 10.20.193.5:0/3856116179 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:47.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.290+0000 7f09f975b640 10 monclient(hunting): get_auth_request con 0x7f09f4152820 auth_method 0 2026-02-17T21:30:47.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.290+0000 7f09f975b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:47.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.290+0000 7f09f975b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.290+0000 7f09f975b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:47.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.290+0000 7f09f9f5c640 1 --2- 10.20.193.5:0/3856116179 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f09f40738f0 0x7f09f4156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.290+0000 7f09fa75d640 1 --2- 10.20.193.5:0/3856116179 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f09f4152c00 0x7f09f41508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.290+0000 7f09f9f5c640 10 monclient(hunting): get_auth_request con 0x7f09f40738f0 auth_method 0 2026-02-17T21:30:47.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.290+0000 7f09f9f5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:47.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.290+0000 7f09f9f5c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.290+0000 7f09f9f5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:47.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.290+0000 7f09f975b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:47.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.290+0000 7f09f975b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:47.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.290+0000 7f09f975b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:47.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.290+0000 7f09fa75d640 10 monclient(hunting): get_auth_request con 0x7f09f4152c00 auth_method 0 2026-02-17T21:30:47.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.290+0000 7f09fa75d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:47.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.290+0000 7f09fa75d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.290+0000 7f09fa75d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:47.308 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.290+0000 7f09f9f5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:47.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.290+0000 7f09f9f5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:47.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.290+0000 7f09f9f5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:47.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.290+0000 7f09fa75d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:47.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.290+0000 7f09fa75d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:47.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.290+0000 7f09fa75d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:47.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.291+0000 7f09f9f5c640 10 monclient(hunting): handle_auth_done global_id 5258 payload 824 2026-02-17T21:30:47.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.291+0000 7f09f9f5c640 1 -- 10.20.193.5:0/3856116179 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f09f4152c00 msgr2=0x7f09f41508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.291+0000 7f09f9f5c640 1 --2- 10.20.193.5:0/3856116179 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f09f4152c00 0x7f09f41508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.291+0000 7f09f9f5c640 1 -- 10.20.193.5:0/3856116179 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09f4152820 msgr2=0x7f09f4148430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.291+0000 7f09f9f5c640 1 --2- 10.20.193.5:0/3856116179 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09f4152820 0x7f09f4148430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.292+0000 7f09f9f5c640 10 monclient: _finish_hunting 0 2026-02-17T21:30:47.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.292+0000 7f09f9f5c640 1 monclient: found mon.noname-c 2026-02-17T21:30:47.309 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.292+0000 7f09f9f5c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:47.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.292+0000 7f09f9f5c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:47.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.292+0000 7f09f9f5c640 1 -- 10.20.193.5:0/3856116179 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f41f37a0 con 0x7f09f40738f0 2026-02-17T21:30:47.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.292+0000 7f09f9f5c640 1 --2- 10.20.193.5:0/3856116179 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f09f40738f0 0x7f09f4156850 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f09e4006fd0 tx=0x7f09e40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:47.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.292+0000 7f09e27fc640 10 client.?.objecter ms_handle_connect 0x7f09f40738f0 2026-02-17T21:30:47.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.292+0000 7f09e27fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:47.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.293+0000 7f09e27fc640 1 -- 10.20.193.5:0/3856116179 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e403c040 con 0x7f09f40738f0 2026-02-17T21:30:47.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.293+0000 7f09e27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:47.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.293+0000 7f09e27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:47.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.293+0000 7f09e27fc640 10 monclient: dump: 2026-02-17T21:30:47.310 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:47.310 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:47.310 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.311 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.311 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:47.311 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.311 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:47.311 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:47.311 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:47.311 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.294+0000 7f09e27fc640 10 monclient: _finish_auth 0 2026-02-17T21:30:47.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.294+0000 7f09e27fc640 10 monclient: _check_auth_tickets 2026-02-17T21:30:47.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.294+0000 7f09e27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:47.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.294+0000 7f09fc1e7640 5 monclient: authenticate success, global_id 5258 2026-02-17T21:30:47.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.294+0000 7f09fc1e7640 10 monclient: _renew_subs 2026-02-17T21:30:47.311 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.294+0000 7f09fc1e7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:47.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.294+0000 7f09fc1e7640 1 -- 10.20.193.5:0/3856116179 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09f41f3a40 con 0x7f09f40738f0 2026-02-17T21:30:47.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.294+0000 7f09fc1e7640 10 client.5258.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:47.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.294+0000 7f09fc1e7640 10 monclient: _renew_subs 2026-02-17T21:30:47.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.294+0000 7f09fc1e7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:47.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.294+0000 7f09fc1e7640 1 -- 10.20.193.5:0/3856116179 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09f41f4000 con 0x7f09f40738f0 2026-02-17T21:30:47.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.294+0000 7f09fc1e7640 1 librados: init done 2026-02-17T21:30:47.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.294+0000 7f09fc1e7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:47.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.294+0000 7f09fc1e7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:47.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.294+0000 7f09fc1e7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:47.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.294+0000 7f09fc1e7640 1 -- 10.20.193.5:0/3856116179 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09f41593f0 con 0x7f09f40738f0 2026-02-17T21:30:47.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.294+0000 7f09e27fc640 1 -- 10.20.193.5:0/3856116179 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e402fb30 con 0x7f09f40738f0 2026-02-17T21:30:47.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.294+0000 7f09e27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:47.312 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.294+0000 7f09e27fc640 1 -- 10.20.193.5:0/3856116179 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e4042830 con 0x7f09f40738f0 2026-02-17T21:30:47.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.294+0000 7f09e27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:47.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.294+0000 7f09e27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:47.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.294+0000 7f09e3fff640 4 set_mon_vals no callback set 2026-02-17T21:30:47.313 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.294+0000 7f09e27fc640 10 monclient: dump: 2026-02-17T21:30:47.313 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:47.313 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:47.313 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.313 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.313 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:47.313 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.313 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:47.313 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:47.314 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:47.314 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.400+0000 7f09e27fc640 1 -- 10.20.193.5:0/3856116179 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f09e40429d0 con 0x7f09f40738f0 2026-02-17T21:30:47.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.401+0000 7f09e27fc640 1 --2- 10.20.193.5:0/3856116179 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f09c4079280 0x7f09c407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.401+0000 7f09f975b640 1 --2- 10.20.193.5:0/3856116179 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f09c4079280 0x7f09c407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.401+0000 7f09f975b640 10 monclient: get_auth_request con 0x7f09c4079280 auth_method 0 2026-02-17T21:30:47.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.402+0000 7f09f975b640 1 --2- 10.20.193.5:0/3856116179 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f09c4079280 0x7f09c407b740 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f09f41f46c0 tx=0x7f09e8002990 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:47.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.402+0000 7f09e27fc640 10 client.5258.objecter ms_handle_connect 0x7f09c4079280 2026-02-17T21:30:47.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.403+0000 7f09e27fc640 1 -- 10.20.193.5:0/3856116179 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f09e4042cf0 con 0x7f09f40738f0 2026-02-17T21:30:47.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.403+0000 7f09e27fc640 10 client.5258.objecter ms_dispatch2 0x7f09f4000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:47.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.403+0000 7f09e27fc640 3 client.5258.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:47.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.403+0000 7f09e27fc640 3 client.5258.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:47.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.403+0000 7f09e27fc640 20 client.5258.objecter dump_active .. 0 homeless 2026-02-17T21:30:47.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.410+0000 7f09e27fc640 1 -- 10.20.193.5:0/3856116179 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f09e402fe20 con 0x7f09f40738f0 2026-02-17T21:30:47.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.410+0000 7f09e27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:47.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.410+0000 7f09e27fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:47.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.494+0000 7f09fc1e7640 1 -- 10.20.193.5:0/3856116179 --> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f09f40c7240 con 0x7f09c4079280 2026-02-17T21:30:47.497 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.495+0000 7f09e27fc640 1 -- 10.20.193.5:0/3856116179 <== mgr.4131 v2:10.20.193.176:6800/2898618020 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f09f40c7240 con 0x7f09c4079280 2026-02-17T21:30:47.497 INFO:teuthology.orchestra.run.trial005.stderr:instructed osd(s) 5 to deep-scrub 2026-02-17T21:30:47.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.496+0000 7f09fc1e7640 10 librados: watch_flush enter 2026-02-17T21:30:47.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.496+0000 7f09fc1e7640 10 librados: watch_flush exit 2026-02-17T21:30:47.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.496+0000 7f09fc1e7640 20 client.5258.objecter shutdown clearing up homeless session... 2026-02-17T21:30:47.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.496+0000 7f09fc1e7640 10 client.5258.objecter successfully canceled tick 2026-02-17T21:30:47.499 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.496+0000 7f09fc1e7640 1 -- 10.20.193.5:0/3856116179 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f09c4079280 msgr2=0x7f09c407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.496+0000 7f09fc1e7640 1 --2- 10.20.193.5:0/3856116179 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f09c4079280 0x7f09c407b740 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f09f41f46c0 tx=0x7f09e8002990 comp rx=0 tx=0).stop 2026-02-17T21:30:47.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.496+0000 7f09fc1e7640 10 monclient: shutdown 2026-02-17T21:30:47.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.496+0000 7f09fc1e7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:47.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.496+0000 7f09fc1e7640 1 -- 10.20.193.5:0/3856116179 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f09f40738f0 msgr2=0x7f09f4156850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.496+0000 7f09fc1e7640 1 --2- 10.20.193.5:0/3856116179 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f09f40738f0 0x7f09f4156850 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f09e4006fd0 tx=0x7f09e40047c0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.496+0000 7f09fc1e7640 1 -- 10.20.193.5:0/3856116179 shutdown_connections 2026-02-17T21:30:47.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.496+0000 7f09fc1e7640 1 --2- 10.20.193.5:0/3856116179 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f09c4079280 0x7f09c407b740 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.496+0000 7f09fc1e7640 1 --2- 10.20.193.5:0/3856116179 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f09f4152c00 0x7f09f41508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.496+0000 7f09fc1e7640 1 --2- 10.20.193.5:0/3856116179 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f09f4152820 0x7f09f4148430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.496+0000 7f09fc1e7640 1 --2- 10.20.193.5:0/3856116179 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f09f40738f0 0x7f09f4156850 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.500 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.496+0000 7f09fc1e7640 1 -- 10.20.193.5:0/3856116179 >> 10.20.193.5:0/3856116179 conn(0x7f09f40c9f40 msgr2=0x7f09f40c6100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:47.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.496+0000 7f09fc1e7640 1 -- 10.20.193.5:0/3856116179 shutdown_connections 2026-02-17T21:30:47.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.496+0000 7f09fc1e7640 1 -- 10.20.193.5:0/3856116179 wait complete. 2026-02-17T21:30:47.501 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.496+0000 7f09fc1e7640 1 librados: shutdown 2026-02-17T21:30:47.506 INFO:tasks.ceph:Scrubbing osd.9 2026-02-17T21:30:47.507 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:30:47.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.575+0000 7fd320722640 10 monclient: get_monmap_and_config 2026-02-17T21:30:47.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.575+0000 7fd320722640 10 monclient: build_initial_monmap 2026-02-17T21:30:47.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.575+0000 7fd320722640 10 monclient: monmap: 2026-02-17T21:30:47.577 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:47.578 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:47.578 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:47.576792+0000 2026-02-17T21:30:47.578 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:47.576792+0000 2026-02-17T21:30:47.578 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:47.578 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.578 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:47.578 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:47.578 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:47.578 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:47.578 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:47.578 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:47.578 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.575+0000 7fd320722640 1 Processor -- start 2026-02-17T21:30:47.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.575+0000 7fd320722640 1 -- start start 2026-02-17T21:30:47.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.575+0000 7fd320722640 10 monclient: init 2026-02-17T21:30:47.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.576+0000 7fd320722640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:47.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.576+0000 7fd320722640 10 monclient: _add_conns ranks=[1,0,2,4,3,5] 2026-02-17T21:30:47.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.576+0000 7fd320722640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fd31815c260 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:47.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.576+0000 7fd320722640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd3180c9b40 addr v1:10.20.193.5:6789/0 2026-02-17T21:30:47.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.576+0000 7fd320722640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd31815c640 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:47.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.576+0000 7fd320722640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3180c7370 con 0x7fd3180c9b40 2026-02-17T21:30:47.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.576+0000 7fd320722640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3180c7650 con 0x7fd31815c260 2026-02-17T21:30:47.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.576+0000 7fd320722640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd31815a090 con 0x7fd31815c640 2026-02-17T21:30:47.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.576+0000 7fd320722640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:47.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.576+0000 7fd320722640 10 monclient(hunting): authenticate will time out at 1353.142167s 2026-02-17T21:30:47.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.576+0000 7fd31dc96640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7fd3180c9b40 0x7fd3180c7e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:39906/0 (socket says 10.20.193.5:39906) 2026-02-17T21:30:47.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.576+0000 7fd31dc96640 1 -- 10.20.193.5:0/3636689723 learned_addr learned my addr 10.20.193.5:0/3636689723 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:47.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.577+0000 7fd31d495640 1 -- 10.20.193.5:0/3636689723 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1034212438 0 0) 0x7fd3180c7370 con 0x7fd3180c9b40 2026-02-17T21:30:47.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.577+0000 7fd31d495640 10 monclient(hunting): _negotiate 2026-02-17T21:30:47.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.577+0000 7fd31d495640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.577+0000 7fd31d495640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:47.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.577+0000 7fd31d495640 10 monclient(hunting): my global_id is 5181 2026-02-17T21:30:47.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.577+0000 7fd31d495640 1 -- 10.20.193.5:0/3636689723 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd300003620 con 0x7fd3180c9b40 2026-02-17T21:30:47.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.577+0000 7fd31d495640 1 -- 10.20.193.5:0/3636689723 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 927801562 0 0) 0x7fd3180c7650 con 0x7fd31815c260 2026-02-17T21:30:47.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.577+0000 7fd31d495640 10 monclient(hunting): _negotiate 2026-02-17T21:30:47.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.577+0000 7fd31d495640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.577+0000 7fd31d495640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:47.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.577+0000 7fd31d495640 10 monclient(hunting): my global_id is 5260 2026-02-17T21:30:47.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.577+0000 7fd31d495640 1 -- 10.20.193.5:0/3636689723 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3180c7370 con 0x7fd31815c260 2026-02-17T21:30:47.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.578+0000 7fd31d495640 1 -- 10.20.193.5:0/3636689723 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1695013449 0 0) 0x7fd31815a090 con 0x7fd31815c640 2026-02-17T21:30:47.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.578+0000 7fd31d495640 10 monclient(hunting): _negotiate 2026-02-17T21:30:47.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.578+0000 7fd31d495640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.578+0000 7fd31d495640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:47.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.578+0000 7fd31d495640 10 monclient(hunting): my global_id is 5261 2026-02-17T21:30:47.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.578+0000 7fd31d495640 1 -- 10.20.193.5:0/3636689723 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3180c7650 con 0x7fd31815c640 2026-02-17T21:30:47.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 1 -- 10.20.193.5:0/3636689723 <== mon.0 v1:10.20.193.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1816358317 0 0) 0x7fd300003620 con 0x7fd3180c9b40 2026-02-17T21:30:47.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 1 -- 10.20.193.5:0/3636689723 >> v1:10.20.193.135:6789/0 conn(0x7fd31815c640 legacy=0x7fd31815ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 1 -- 10.20.193.5:0/3636689723 >> v1:10.20.193.119:6789/0 conn(0x7fd31815c260 legacy=0x7fd3180c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 10 monclient: _finish_hunting 0 2026-02-17T21:30:47.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 1 monclient: found mon.noname-a-legacy 2026-02-17T21:30:47.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:47.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.5:6789/0 2026-02-17T21:30:47.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 1 -- 10.20.193.5:0/3636689723 --> v1:10.20.193.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31815a370 con 0x7fd3180c9b40 2026-02-17T21:30:47.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 10 monclient: _finish_auth 0 2026-02-17T21:30:47.588 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 10 monclient: _check_auth_tickets 2026-02-17T21:30:47.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:47.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 1 -- 10.20.193.5:0/3636689723 <== mon.0 v1:10.20.193.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3880376286 0 0) 0x7fd30c002f00 con 0x7fd3180c9b40 2026-02-17T21:30:47.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:47.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T21:30:47.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 10 monclient: dump: 2026-02-17T21:30:47.589 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:47.589 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:47.589 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.589 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.590 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:47.590 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.590 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:47.590 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:47.590 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:47.590 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] but i'm connected to v1:10.20.193.5:6789/0, reconnecting 2026-02-17T21:30:47.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:47.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 1 -- 10.20.193.5:0/3636689723 >> v1:10.20.193.5:6789/0 conn(0x7fd3180c9b40 legacy=0x7fd3180c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:30:47.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 1 --2- 10.20.193.5:0/3636689723 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd300003fe0 0x7fd300004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 10 monclient(hunting): picked mon.b con 0x7fd300003fe0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:47.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 1 --2- 10.20.193.5:0/3636689723 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd300004e40 0x7fd3000052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 10 monclient(hunting): picked mon.c con 0x7fd300004e40 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:47.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 1 --2- 10.20.193.5:0/3636689723 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd30000bd40 0x7fd30000e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 10 monclient(hunting): picked mon.a con 0x7fd30000bd40 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:47.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:47.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 1 -- 10.20.193.5:0/3636689723 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd30000e720 con 0x7fd30000bd40 2026-02-17T21:30:47.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:47.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 1 -- 10.20.193.5:0/3636689723 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd30000e8d0 con 0x7fd300003fe0 2026-02-17T21:30:47.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:47.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 1 -- 10.20.193.5:0/3636689723 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd30000ead0 con 0x7fd300004e40 2026-02-17T21:30:47.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:47.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.579+0000 7fd31d495640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:30:47.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.580+0000 7fd31e497640 1 --2- 10.20.193.5:0/3636689723 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd300003fe0 0x7fd300004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.580+0000 7fd31ec98640 1 --2- 10.20.193.5:0/3636689723 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd30000bd40 0x7fd30000e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.580+0000 7fd31dc96640 1 --2- 10.20.193.5:0/3636689723 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd300004e40 0x7fd3000052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.580+0000 7fd31e497640 10 monclient(hunting): get_auth_request con 0x7fd300003fe0 auth_method 0 2026-02-17T21:30:47.592 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.580+0000 7fd31e497640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:47.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.580+0000 7fd31e497640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.580+0000 7fd31e497640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:30:47.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.580+0000 7fd31dc96640 10 monclient(hunting): get_auth_request con 0x7fd300004e40 auth_method 0 2026-02-17T21:30:47.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.580+0000 7fd31dc96640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:47.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.580+0000 7fd31dc96640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.580+0000 7fd31dc96640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:30:47.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.581+0000 7fd31ec98640 10 monclient(hunting): get_auth_request con 0x7fd30000bd40 auth_method 0 2026-02-17T21:30:47.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.581+0000 7fd31ec98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:47.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.581+0000 7fd31ec98640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.593 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.581+0000 7fd31ec98640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:30:47.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.581+0000 7fd31e497640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:47.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.581+0000 7fd31e497640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:47.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.581+0000 7fd31e497640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:30:47.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.581+0000 7fd31dc96640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:47.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.581+0000 7fd31dc96640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:47.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.581+0000 7fd31dc96640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:30:47.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.581+0000 7fd31ec98640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:47.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.581+0000 7fd31ec98640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:47.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.581+0000 7fd31ec98640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:30:47.594 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.582+0000 7fd31dc96640 10 monclient(hunting): handle_auth_done global_id 5181 payload 293 2026-02-17T21:30:47.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.582+0000 7fd31dc96640 1 -- 10.20.193.5:0/3636689723 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd300003fe0 msgr2=0x7fd300004900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:47.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.582+0000 7fd31dc96640 1 --2- 10.20.193.5:0/3636689723 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd300003fe0 0x7fd300004900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.582+0000 7fd31dc96640 1 -- 10.20.193.5:0/3636689723 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd30000bd40 msgr2=0x7fd30000e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:47.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.582+0000 7fd31dc96640 1 --2- 10.20.193.5:0/3636689723 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd30000bd40 0x7fd30000e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.582+0000 7fd31dc96640 10 monclient: _finish_hunting 0 2026-02-17T21:30:47.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.582+0000 7fd31dc96640 1 monclient: found mon.c 2026-02-17T21:30:47.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.582+0000 7fd31dc96640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:47.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.582+0000 7fd31dc96640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:47.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.582+0000 7fd31dc96640 1 -- 10.20.193.5:0/3636689723 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd300003620 con 0x7fd300004e40 2026-02-17T21:30:47.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.582+0000 7fd31dc96640 10 monclient: _finish_auth 0 2026-02-17T21:30:47.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.582+0000 7fd31dc96640 10 monclient: _check_auth_tickets 2026-02-17T21:30:47.595 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.582+0000 7fd31dc96640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:47.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.582+0000 7fd31ec98640 1 -- 10.20.193.5:0/3636689723 reap_dead start 2026-02-17T21:30:47.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.582+0000 7fd320722640 5 monclient: authenticate success, global_id 5181 2026-02-17T21:30:47.596 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.582+0000 7fd320722640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:47.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.583+0000 7fd31dc96640 1 --2- 10.20.193.5:0/3636689723 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd300004e40 0x7fd3000052c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00c240 tx=0x7fd30c02f510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d25dcfbad06e2554 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:47.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.584+0000 7fd31d495640 1 -- 10.20.193.5:0/3636689723 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c007d20 con 0x7fd300004e40 2026-02-17T21:30:47.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.584+0000 7fd31d495640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:47.602 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.584+0000 7fd31d495640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:47.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.584+0000 7fd31d495640 10 monclient: dump: 2026-02-17T21:30:47.603 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:47.603 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:47.603 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.603 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.603 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:47.603 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.603 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:47.603 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:47.603 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:47.603 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.603 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.584+0000 7fd320722640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:47.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.584+0000 7fd31d495640 1 -- 10.20.193.5:0/3636689723 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd30c005bd0 con 0x7fd300004e40 2026-02-17T21:30:47.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.584+0000 7fd31d495640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:47.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.584+0000 7fd31d495640 1 -- 10.20.193.5:0/3636689723 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c007070 con 0x7fd300004e40 2026-02-17T21:30:47.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.584+0000 7fd31d495640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:47.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.584+0000 7fd31d495640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:47.604 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.584+0000 7fd31d495640 10 monclient: dump: 2026-02-17T21:30:47.604 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:47.604 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:47.604 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.604 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.604 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:47.605 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.605 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:47.605 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:47.605 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:47.605 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.585+0000 7fd320722640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:47.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.585+0000 7fd320722640 4 set_mon_vals no callback set 2026-02-17T21:30:47.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.585+0000 7fd320722640 10 monclient: shutdown 2026-02-17T21:30:47.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.585+0000 7fd320722640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:47.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.585+0000 7fd320722640 1 -- 10.20.193.5:0/3636689723 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd300004e40 msgr2=0x7fd3000052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.585+0000 7fd320722640 1 --2- 10.20.193.5:0/3636689723 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd300004e40 0x7fd3000052c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00c240 tx=0x7fd30c02f510 comp rx=0 tx=0).stop 2026-02-17T21:30:47.605 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.585+0000 7fd320722640 1 -- 10.20.193.5:0/3636689723 shutdown_connections 2026-02-17T21:30:47.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.585+0000 7fd320722640 1 --2- 10.20.193.5:0/3636689723 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd300004e40 0x7fd3000052c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.585+0000 7fd320722640 1 -- 10.20.193.5:0/3636689723 >> 10.20.193.5:0/3636689723 conn(0x7fd3180c9f60 msgr2=0x7fd3180ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:47.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.585+0000 7fd320722640 1 -- 10.20.193.5:0/3636689723 shutdown_connections 2026-02-17T21:30:47.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.585+0000 7fd320722640 1 -- 10.20.193.5:0/3636689723 wait complete. 2026-02-17T21:30:47.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd320722640 10 monclient: build_initial_monmap 2026-02-17T21:30:47.606 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd320722640 10 monclient: monmap: 2026-02-17T21:30:47.606 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:47.606 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:47.606 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:47.606 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:47.606 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:47.607 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.607 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:47.607 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:47.607 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:47.607 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd320722640 1 librados: starting msgr at 2026-02-17T21:30:47.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd320722640 1 librados: starting objecter 2026-02-17T21:30:47.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd320722640 1 Processor -- start 2026-02-17T21:30:47.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd320722640 1 -- start start 2026-02-17T21:30:47.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd320722640 1 librados: setting wanted keys 2026-02-17T21:30:47.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd320722640 1 librados: calling monclient init 2026-02-17T21:30:47.607 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd320722640 10 monclient: init 2026-02-17T21:30:47.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd320722640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:47.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd320722640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:30:47.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd320722640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd300004e40 0x7fd3181f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd320722640 10 monclient(hunting): picked mon.noname-b con 0x7fd300004e40 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:47.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd320722640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd3181f5580 0x7fd318073720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd320722640 10 monclient(hunting): picked mon.noname-c con 0x7fd3181f5580 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:47.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd320722640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd318145820 0x7fd3181513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd320722640 10 monclient(hunting): picked mon.noname-a con 0x7fd318145820 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:47.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd320722640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:47.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd320722640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd3180c6e60 con 0x7fd318145820 2026-02-17T21:30:47.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd320722640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:47.608 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd320722640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd3180c6ce0 con 0x7fd300004e40 2026-02-17T21:30:47.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd320722640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:47.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd320722640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd3180c6fe0 con 0x7fd3181f5580 2026-02-17T21:30:47.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd320722640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:47.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd320722640 10 monclient(hunting): authenticate will time out at 1353.152704s 2026-02-17T21:30:47.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.586+0000 7fd31ec98640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd318145820 0x7fd3181513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.587+0000 7fd31dc96640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd3181f5580 0x7fd318073720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.587+0000 7fd31e497640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd300004e40 0x7fd3181f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.587+0000 7fd31ec98640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd318145820 0x7fd3181513a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48236/0 (socket says 10.20.193.5:48236) 2026-02-17T21:30:47.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.587+0000 7fd31ec98640 1 -- 10.20.193.5:0/3921173209 learned_addr learned my addr 10.20.193.5:0/3921173209 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:47.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.587+0000 7fd31ec98640 10 monclient(hunting): get_auth_request con 0x7fd318145820 auth_method 0 2026-02-17T21:30:47.609 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.587+0000 7fd31ec98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:47.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.587+0000 7fd31ec98640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.587+0000 7fd31ec98640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:47.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.587+0000 7fd31dc96640 10 monclient(hunting): get_auth_request con 0x7fd3181f5580 auth_method 0 2026-02-17T21:30:47.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.587+0000 7fd31dc96640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:47.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.587+0000 7fd31dc96640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.587+0000 7fd31dc96640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:47.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.587+0000 7fd31e497640 10 monclient(hunting): get_auth_request con 0x7fd300004e40 auth_method 0 2026-02-17T21:30:47.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.587+0000 7fd31e497640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:47.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.587+0000 7fd31e497640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.587+0000 7fd31e497640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:47.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.587+0000 7fd31dc96640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:47.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.587+0000 7fd31dc96640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:47.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.587+0000 7fd31dc96640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:47.610 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.587+0000 7fd31ec98640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:47.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.587+0000 7fd31ec98640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:47.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.587+0000 7fd31ec98640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:47.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.587+0000 7fd31e497640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:47.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.587+0000 7fd31e497640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:47.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.587+0000 7fd31e497640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:47.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.588+0000 7fd31dc96640 10 monclient(hunting): handle_auth_done global_id 5264 payload 824 2026-02-17T21:30:47.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.588+0000 7fd31dc96640 1 -- 10.20.193.5:0/3921173209 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd300004e40 msgr2=0x7fd3181f4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.588+0000 7fd31dc96640 1 --2- 10.20.193.5:0/3921173209 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd300004e40 0x7fd3181f4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.588+0000 7fd31dc96640 1 -- 10.20.193.5:0/3921173209 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd318145820 msgr2=0x7fd3181513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.588+0000 7fd31dc96640 1 --2- 10.20.193.5:0/3921173209 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd318145820 0x7fd3181513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.588+0000 7fd31dc96640 10 monclient: _finish_hunting 0 2026-02-17T21:30:47.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.588+0000 7fd31dc96640 1 monclient: found mon.noname-c 2026-02-17T21:30:47.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.588+0000 7fd31dc96640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:47.611 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.588+0000 7fd31dc96640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:47.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.588+0000 7fd31dc96640 1 -- 10.20.193.5:0/3921173209 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3181f5080 con 0x7fd3181f5580 2026-02-17T21:30:47.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.589+0000 7fd31dc96640 1 --2- 10.20.193.5:0/3921173209 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd3181f5580 0x7fd318073720 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd30000eca0 tx=0x7fd3180c7820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:47.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.589+0000 7fd2feffd640 10 client.?.objecter ms_handle_connect 0x7fd3181f5580 2026-02-17T21:30:47.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.589+0000 7fd2feffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:47.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd2feffd640 1 -- 10.20.193.5:0/3921173209 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c004ae0 con 0x7fd3181f5580 2026-02-17T21:30:47.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd2feffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:47.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd2feffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:47.612 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd2feffd640 10 monclient: dump: 2026-02-17T21:30:47.612 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:47.612 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:47.612 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.612 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.612 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:47.612 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.612 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:47.613 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:47.613 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:47.613 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd2feffd640 10 monclient: _finish_auth 0 2026-02-17T21:30:47.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd2feffd640 10 monclient: _check_auth_tickets 2026-02-17T21:30:47.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd2feffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:47.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd2feffd640 1 -- 10.20.193.5:0/3921173209 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd30c004c80 con 0x7fd3181f5580 2026-02-17T21:30:47.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd320722640 5 monclient: authenticate success, global_id 5264 2026-02-17T21:30:47.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd320722640 10 monclient: _renew_subs 2026-02-17T21:30:47.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd320722640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:47.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd320722640 1 -- 10.20.193.5:0/3921173209 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd318074270 con 0x7fd3181f5580 2026-02-17T21:30:47.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd2feffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:47.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd2feffd640 1 -- 10.20.193.5:0/3921173209 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c007270 con 0x7fd3181f5580 2026-02-17T21:30:47.613 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd2feffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:47.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd2feffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:47.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd2feffd640 10 monclient: dump: 2026-02-17T21:30:47.614 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:47.614 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:47.614 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.614 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.614 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:47.614 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.614 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:47.614 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:47.614 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:47.614 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd31cc94640 4 set_mon_vals no callback set 2026-02-17T21:30:47.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd320722640 10 client.5264.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:47.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd320722640 10 monclient: _renew_subs 2026-02-17T21:30:47.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd320722640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:47.615 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd320722640 1 -- 10.20.193.5:0/3921173209 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd318144a60 con 0x7fd3181f5580 2026-02-17T21:30:47.615 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd320722640 1 librados: init done 2026-02-17T21:30:47.615 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd320722640 10 client.5264.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:47.615 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd320722640 15 client.5264.objecter _session_command_op_assign -1 1 2026-02-17T21:30:47.615 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd320722640 20 client.5264.objecter _get_session osd=-1 returning homeless 2026-02-17T21:30:47.615 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd320722640 10 client.5264.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:47.615 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd320722640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:47.615 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.591+0000 7fd320722640 1 -- 10.20.193.5:0/3921173209 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd318144810 con 0x7fd3181f5580 2026-02-17T21:30:47.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.603+0000 7fd2feffd640 1 -- 10.20.193.5:0/3921173209 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fd30c007410 con 0x7fd3181f5580 2026-02-17T21:30:47.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.604+0000 7fd2feffd640 1 --2- 10.20.193.5:0/3921173209 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd2e8079300 0x7fd2e807b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.604+0000 7fd31e497640 1 --2- 10.20.193.5:0/3921173209 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd2e8079300 0x7fd2e807b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.604+0000 7fd31e497640 10 monclient: get_auth_request con 0x7fd2e8079300 auth_method 0 2026-02-17T21:30:47.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.605+0000 7fd31e497640 1 --2- 10.20.193.5:0/3921173209 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd2e8079300 0x7fd2e807b7c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd3080056a0 tx=0x7fd308007dc0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:47.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.605+0000 7fd2feffd640 10 client.5264.objecter ms_handle_connect 0x7fd2e8079300 2026-02-17T21:30:47.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.605+0000 7fd2feffd640 1 -- 10.20.193.5:0/3921173209 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fd30c007730 con 0x7fd3181f5580 2026-02-17T21:30:47.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.605+0000 7fd2feffd640 10 client.5264.objecter ms_dispatch2 0x7fd318000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:47.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.605+0000 7fd2feffd640 3 client.5264.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:47.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.605+0000 7fd2feffd640 3 client.5264.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:47.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.605+0000 7fd2feffd640 10 client.5264.objecter checking command 1 2026-02-17T21:30:47.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.606+0000 7fd2feffd640 1 --2- 10.20.193.5:0/3921173209 >> [v2:10.20.193.119:6816/576833933,v1:10.20.193.119:6817/576833933] conn(0x7fd2e80817e0 0x7fd2e8083c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.606+0000 7fd2feffd640 20 client.5264.objecter _get_session s=0x7fd2e8081110 osd=9 3 2026-02-17T21:30:47.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.606+0000 7fd2feffd640 20 client.5264.objecter put_session s=0x7fd2e8081110 osd=9 3 2026-02-17T21:30:47.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.606+0000 7fd2feffd640 15 client.5264.objecter _session_command_op_remove -1 1 2026-02-17T21:30:47.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.606+0000 7fd2feffd640 20 client.5264.objecter _get_session s=0x7fd2e8081110 osd=9 3 2026-02-17T21:30:47.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.606+0000 7fd2feffd640 20 client.5264.objecter get_session s=0x7fd2e8081110 osd=9 3 2026-02-17T21:30:47.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.606+0000 7fd2feffd640 15 client.5264.objecter _session_command_op_assign 9 1 2026-02-17T21:30:47.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.606+0000 7fd2feffd640 20 client.5264.objecter put_session s=0x7fd2e8081110 osd=9 4 2026-02-17T21:30:47.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.606+0000 7fd2feffd640 10 client.5264.objecter _send_command 1 2026-02-17T21:30:47.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.606+0000 7fd2feffd640 1 -- 10.20.193.5:0/3921173209 --> [v2:10.20.193.119:6816/576833933,v1:10.20.193.119:6817/576833933] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd2e80842d0 con 0x7fd2e80817e0 2026-02-17T21:30:47.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.606+0000 7fd2feffd640 20 client.5264.objecter dump_active .. 0 homeless 2026-02-17T21:30:47.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.606+0000 7fd2feffd640 1 -- 10.20.193.5:0/3921173209 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd30c082a20 con 0x7fd3181f5580 2026-02-17T21:30:47.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.606+0000 7fd2feffd640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T21:30:47.618 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.606+0000 7fd31ec98640 1 --2- 10.20.193.5:0/3921173209 >> [v2:10.20.193.119:6816/576833933,v1:10.20.193.119:6817/576833933] conn(0x7fd2e80817e0 0x7fd2e8083c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.606+0000 7fd31ec98640 10 monclient: get_auth_request con 0x7fd2e80817e0 auth_method 0 2026-02-17T21:30:47.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.608+0000 7fd31ec98640 1 --2- 10.20.193.5:0/3921173209 >> [v2:10.20.193.119:6816/576833933,v1:10.20.193.119:6817/576833933] conn(0x7fd2e80817e0 0x7fd2e8083c00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:47.619 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.608+0000 7fd2feffd640 10 client.5264.objecter ms_handle_connect 0x7fd2e80817e0 2026-02-17T21:30:47.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.618+0000 7fd2feffd640 1 -- 10.20.193.5:0/3921173209 <== osd.9 v2:10.20.193.119:6816/576833933 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fd2e80842d0 con 0x7fd2e80817e0 2026-02-17T21:30:47.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.618+0000 7fd2feffd640 10 client.5264.objecter ms_dispatch2 0x7fd318000b90 command_reply(tid 1: 0 ) 2026-02-17T21:30:47.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.618+0000 7fd2feffd640 10 client.5264.objecter _finish_command 1 = system:0 2026-02-17T21:30:47.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.618+0000 7fd2feffd640 20 client.5264.objecter put_session s=0x7fd2e8081110 osd=9 4 2026-02-17T21:30:47.620 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.618+0000 7fd2feffd640 15 client.5264.objecter _session_command_op_remove 9 1 2026-02-17T21:30:47.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.624+0000 7fd320722640 10 client.5264.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:30:47.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.624+0000 7fd320722640 15 client.5264.objecter _session_command_op_assign -1 2 2026-02-17T21:30:47.626 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.624+0000 7fd320722640 20 client.5264.objecter _get_session s=0x7fd2e8081110 osd=9 3 2026-02-17T21:30:47.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.624+0000 7fd320722640 20 client.5264.objecter put_session s=0x7fd2e8081110 osd=9 3 2026-02-17T21:30:47.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.624+0000 7fd320722640 20 client.5264.objecter _get_session s=0x7fd2e8081110 osd=9 3 2026-02-17T21:30:47.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.624+0000 7fd320722640 15 client.5264.objecter _session_command_op_remove -1 2 2026-02-17T21:30:47.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.624+0000 7fd320722640 20 client.5264.objecter get_session s=0x7fd2e8081110 osd=9 3 2026-02-17T21:30:47.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.624+0000 7fd320722640 15 client.5264.objecter _session_command_op_assign 9 2 2026-02-17T21:30:47.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.624+0000 7fd320722640 20 client.5264.objecter put_session s=0x7fd2e8081110 osd=9 4 2026-02-17T21:30:47.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.624+0000 7fd320722640 10 client.5264.objecter _send_command 2 2026-02-17T21:30:47.627 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.624+0000 7fd320722640 1 -- 10.20.193.5:0/3921173209 --> [v2:10.20.193.119:6816/576833933,v1:10.20.193.119:6817/576833933] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd3180c7890 con 0x7fd2e80817e0 2026-02-17T21:30:47.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.630+0000 7fd2feffd640 1 -- 10.20.193.5:0/3921173209 <== osd.9 v2:10.20.193.119:6816/576833933 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd3180c7890 con 0x7fd2e80817e0 2026-02-17T21:30:47.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.630+0000 7fd2feffd640 10 client.5264.objecter ms_dispatch2 0x7fd318000b90 command_reply(tid 2: 0 ) 2026-02-17T21:30:47.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.630+0000 7fd2feffd640 10 client.5264.objecter _finish_command 2 = system:0 2026-02-17T21:30:47.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.630+0000 7fd2feffd640 20 client.5264.objecter put_session s=0x7fd2e8081110 osd=9 4 2026-02-17T21:30:47.633 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.630+0000 7fd2feffd640 15 client.5264.objecter _session_command_op_remove 9 2 2026-02-17T21:30:47.633 INFO:teuthology.orchestra.run.trial005.stdout:{ 2026-02-17T21:30:47.633 INFO:teuthology.orchestra.run.trial005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:30:47.634 INFO:teuthology.orchestra.run.trial005.stdout:} 2026-02-17T21:30:47.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.630+0000 7fd320722640 10 librados: watch_flush enter 2026-02-17T21:30:47.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.630+0000 7fd320722640 10 librados: watch_flush exit 2026-02-17T21:30:47.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.630+0000 7fd320722640 10 client.5264.objecter close_session for osd.9 2026-02-17T21:30:47.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.630+0000 7fd320722640 1 -- 10.20.193.5:0/3921173209 >> [v2:10.20.193.119:6816/576833933,v1:10.20.193.119:6817/576833933] conn(0x7fd2e80817e0 msgr2=0x7fd2e8083c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.630+0000 7fd320722640 1 --2- 10.20.193.5:0/3921173209 >> [v2:10.20.193.119:6816/576833933,v1:10.20.193.119:6817/576833933] conn(0x7fd2e80817e0 0x7fd2e8083c00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.630+0000 7fd320722640 20 client.5264.objecter put_session s=0x7fd2e8081110 osd=9 1 2026-02-17T21:30:47.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.630+0000 7fd320722640 20 client.5264.objecter shutdown clearing up homeless session... 2026-02-17T21:30:47.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.630+0000 7fd320722640 10 client.5264.objecter successfully canceled tick 2026-02-17T21:30:47.635 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.630+0000 7fd320722640 1 -- 10.20.193.5:0/3921173209 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd2e8079300 msgr2=0x7fd2e807b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.630+0000 7fd320722640 1 --2- 10.20.193.5:0/3921173209 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd2e8079300 0x7fd2e807b7c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd3080056a0 tx=0x7fd308007dc0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.630+0000 7fd320722640 10 monclient: shutdown 2026-02-17T21:30:47.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.630+0000 7fd320722640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:47.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.630+0000 7fd320722640 1 -- 10.20.193.5:0/3921173209 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd3181f5580 msgr2=0x7fd318073720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.630+0000 7fd320722640 1 --2- 10.20.193.5:0/3921173209 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd3181f5580 0x7fd318073720 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd30000eca0 tx=0x7fd3180c7820 comp rx=0 tx=0).stop 2026-02-17T21:30:47.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.630+0000 7fd31ec98640 1 -- 10.20.193.5:0/3921173209 reap_dead start 2026-02-17T21:30:47.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.630+0000 7fd320722640 1 -- 10.20.193.5:0/3921173209 shutdown_connections 2026-02-17T21:30:47.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.630+0000 7fd320722640 1 -- 10.20.193.5:0/3921173209 >> 10.20.193.5:0/3921173209 conn(0x7fd3180c9f60 msgr2=0x7fd31814bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:47.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.630+0000 7fd320722640 1 -- 10.20.193.5:0/3921173209 shutdown_connections 2026-02-17T21:30:47.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.630+0000 7fd320722640 1 -- 10.20.193.5:0/3921173209 wait complete. 2026-02-17T21:30:47.636 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.630+0000 7fd320722640 1 librados: shutdown 2026-02-17T21:30:47.640 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2026-02-17T21:30:47.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.707+0000 7feb28f40640 10 monclient: get_monmap_and_config 2026-02-17T21:30:47.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.707+0000 7feb28f40640 10 monclient: build_initial_monmap 2026-02-17T21:30:47.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.707+0000 7feb28f40640 10 monclient: monmap: 2026-02-17T21:30:47.709 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:47.709 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:47.710 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:47.708710+0000 2026-02-17T21:30:47.710 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:47.708710+0000 2026-02-17T21:30:47.710 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:47.710 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.710 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:47.710 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:47.710 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:47.710 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:47.710 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:47.710 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:47.710 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.707+0000 7feb28f40640 1 Processor -- start 2026-02-17T21:30:47.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.707+0000 7feb28f40640 1 -- start start 2026-02-17T21:30:47.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.707+0000 7feb28f40640 10 monclient: init 2026-02-17T21:30:47.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.708+0000 7feb28f40640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:47.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.708+0000 7feb28f40640 10 monclient: _add_conns ranks=[2,3,1,0,5,4] 2026-02-17T21:30:47.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.708+0000 7feb28f40640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7feb240c7170 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:47.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.708+0000 7feb28f40640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7feb240c7550 0x7feb240749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.708+0000 7feb28f40640 10 monclient(hunting): picked mon.noname-a con 0x7feb240c7550 addr v2:10.20.193.5:3300/0 2026-02-17T21:30:47.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.708+0000 7feb28f40640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7feb24074ef0 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:47.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.708+0000 7feb28f40640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb240c4fd0 con 0x7feb24074ef0 2026-02-17T21:30:47.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.708+0000 7feb28f40640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb2415a9a0 con 0x7feb240c7170 2026-02-17T21:30:47.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.708+0000 7feb28f40640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:47.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.708+0000 7feb28f40640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7feb240c8530 con 0x7feb240c7550 2026-02-17T21:30:47.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.708+0000 7feb28f40640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:47.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.708+0000 7feb28f40640 10 monclient(hunting): authenticate will time out at 1353.274230s 2026-02-17T21:30:47.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.708+0000 7feb22575640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7feb240c7170 0x7feb240c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:59640/0 (socket says 10.20.193.5:59640) 2026-02-17T21:30:47.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.708+0000 7feb22575640 1 -- 10.20.193.5:0/3532400831 learned_addr learned my addr 10.20.193.5:0/3532400831 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:47.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.710+0000 7feb21573640 1 -- 10.20.193.5:0/3532400831 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3389940072 0 0) 0x7feb240c4fd0 con 0x7feb24074ef0 2026-02-17T21:30:47.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.710+0000 7feb21573640 10 monclient(hunting): _negotiate 2026-02-17T21:30:47.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.710+0000 7feb21573640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.710+0000 7feb21573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:47.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.710+0000 7feb21573640 10 monclient(hunting): my global_id is 5266 2026-02-17T21:30:47.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.710+0000 7feb21573640 1 -- 10.20.193.5:0/3532400831 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb10003620 con 0x7feb24074ef0 2026-02-17T21:30:47.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.710+0000 7feb21573640 1 -- 10.20.193.5:0/3532400831 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3626468269 0 0) 0x7feb2415a9a0 con 0x7feb240c7170 2026-02-17T21:30:47.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.710+0000 7feb21573640 10 monclient(hunting): _negotiate 2026-02-17T21:30:47.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.710+0000 7feb21573640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.710+0000 7feb21573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:47.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.710+0000 7feb21573640 10 monclient(hunting): my global_id is 5267 2026-02-17T21:30:47.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.710+0000 7feb21573640 1 -- 10.20.193.5:0/3532400831 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb240c4fd0 con 0x7feb240c7170 2026-02-17T21:30:47.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.710+0000 7feb21d74640 1 --2- 10.20.193.5:0/3532400831 >> v2:10.20.193.5:3300/0 conn(0x7feb240c7550 0x7feb240749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.710+0000 7feb21d74640 10 monclient(hunting): get_auth_request con 0x7feb240c7550 auth_method 0 2026-02-17T21:30:47.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.710+0000 7feb21d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:47.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.710+0000 7feb21d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.710+0000 7feb21d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:47.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.710+0000 7feb21d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:47.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.710+0000 7feb21d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:47.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.710+0000 7feb21d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:47.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 1 -- 10.20.193.5:0/3532400831 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2844992898 0 0) 0x7feb10003620 con 0x7feb24074ef0 2026-02-17T21:30:47.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 1 -- 10.20.193.5:0/3532400831 >> v2:10.20.193.5:3300/0 conn(0x7feb240c7550 msgr2=0x7feb240749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:47.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 1 --2- 10.20.193.5:0/3532400831 >> v2:10.20.193.5:3300/0 conn(0x7feb240c7550 0x7feb240749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 1 -- 10.20.193.5:0/3532400831 >> v1:10.20.193.135:6789/0 conn(0x7feb240c7170 legacy=0x7feb240c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 10 monclient: _finish_hunting 0 2026-02-17T21:30:47.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 1 monclient: found mon.noname-b-legacy 2026-02-17T21:30:47.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:47.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.119:6789/0 2026-02-17T21:30:47.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 1 -- 10.20.193.5:0/3532400831 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb240c5270 con 0x7feb24074ef0 2026-02-17T21:30:47.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 10 monclient: _finish_auth 0 2026-02-17T21:30:47.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 10 monclient: _check_auth_tickets 2026-02-17T21:30:47.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:47.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 1 -- 10.20.193.5:0/3532400831 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3880376286 0 0) 0x7feb140032a0 con 0x7feb24074ef0 2026-02-17T21:30:47.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:47.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T21:30:47.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 10 monclient: dump: 2026-02-17T21:30:47.726 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:47.726 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:47.726 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.726 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.726 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:47.726 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.727 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:47.727 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:47.727 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:47.727 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] but i'm connected to v1:10.20.193.119:6789/0, reconnecting 2026-02-17T21:30:47.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:47.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 1 -- 10.20.193.5:0/3532400831 >> v1:10.20.193.119:6789/0 conn(0x7feb24074ef0 legacy=0x7feb240c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:30:47.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 1 --2- 10.20.193.5:0/3532400831 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7feb10004e30 0x7feb10005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 10 monclient(hunting): picked mon.c con 0x7feb10004e30 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:47.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 1 --2- 10.20.193.5:0/3532400831 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7feb100038a0 0x7feb10003d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 10 monclient(hunting): picked mon.a con 0x7feb100038a0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:47.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 1 --2- 10.20.193.5:0/3532400831 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7feb10004430 0x7feb1000bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 10 monclient(hunting): picked mon.b con 0x7feb10004430 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:47.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:47.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 1 -- 10.20.193.5:0/3532400831 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7feb240c8530 con 0x7feb100038a0 2026-02-17T21:30:47.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:47.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 1 -- 10.20.193.5:0/3532400831 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7feb1000c380 con 0x7feb10004430 2026-02-17T21:30:47.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:47.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 1 -- 10.20.193.5:0/3532400831 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7feb1000c580 con 0x7feb10004e30 2026-02-17T21:30:47.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:47.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.711+0000 7feb21573640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:30:47.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.712+0000 7feb22575640 1 --2- 10.20.193.5:0/3532400831 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7feb10004e30 0x7feb10005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.712+0000 7feb22575640 10 monclient(hunting): get_auth_request con 0x7feb10004e30 auth_method 0 2026-02-17T21:30:47.728 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.712+0000 7feb22575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:47.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.712+0000 7feb22575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.712+0000 7feb22575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:30:47.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.713+0000 7feb22575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:47.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.713+0000 7feb22575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:47.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.713+0000 7feb22575640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:30:47.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.713+0000 7feb22d76640 1 --2- 10.20.193.5:0/3532400831 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7feb10004430 0x7feb1000bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.713+0000 7feb21d74640 1 --2- 10.20.193.5:0/3532400831 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7feb100038a0 0x7feb10003d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.713+0000 7feb22d76640 10 monclient(hunting): get_auth_request con 0x7feb10004430 auth_method 0 2026-02-17T21:30:47.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.713+0000 7feb22d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:47.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.713+0000 7feb22d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.713+0000 7feb22d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:30:47.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.713+0000 7feb21d74640 10 monclient(hunting): get_auth_request con 0x7feb100038a0 auth_method 0 2026-02-17T21:30:47.729 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.713+0000 7feb21d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:47.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.713+0000 7feb21d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.713+0000 7feb21d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:30:47.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.713+0000 7feb22d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:47.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.713+0000 7feb22d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:47.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.713+0000 7feb22d76640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:30:47.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.713+0000 7feb21d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:47.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.713+0000 7feb21d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:47.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.713+0000 7feb21d74640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:30:47.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.714+0000 7feb22575640 10 monclient(hunting): handle_auth_done global_id 5266 payload 293 2026-02-17T21:30:47.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.714+0000 7feb22575640 1 -- 10.20.193.5:0/3532400831 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7feb10004430 msgr2=0x7feb1000bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:47.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.714+0000 7feb22575640 1 --2- 10.20.193.5:0/3532400831 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7feb10004430 0x7feb1000bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.730 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.714+0000 7feb22575640 1 -- 10.20.193.5:0/3532400831 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7feb100038a0 msgr2=0x7feb10003d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:47.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.714+0000 7feb22575640 1 --2- 10.20.193.5:0/3532400831 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7feb100038a0 0x7feb10003d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.714+0000 7feb22575640 10 monclient: _finish_hunting 0 2026-02-17T21:30:47.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.714+0000 7feb22575640 1 monclient: found mon.c 2026-02-17T21:30:47.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.714+0000 7feb22d76640 1 -- 10.20.193.5:0/3532400831 reap_dead start 2026-02-17T21:30:47.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.714+0000 7feb22575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:47.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.714+0000 7feb22575640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:47.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.714+0000 7feb22575640 1 -- 10.20.193.5:0/3532400831 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb10003620 con 0x7feb10004e30 2026-02-17T21:30:47.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.714+0000 7feb22575640 10 monclient: _finish_auth 0 2026-02-17T21:30:47.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.714+0000 7feb22575640 10 monclient: _check_auth_tickets 2026-02-17T21:30:47.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.714+0000 7feb22575640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:47.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.714+0000 7feb28f40640 5 monclient: authenticate success, global_id 5266 2026-02-17T21:30:47.731 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.714+0000 7feb28f40640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:47.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.715+0000 7feb22575640 1 --2- 10.20.193.5:0/3532400831 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7feb10004e30 0x7feb10005230 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7feb18003270 tx=0x7feb1802ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7ca19d58ba78885 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:47.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.717+0000 7feb21573640 1 -- 10.20.193.5:0/3532400831 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb18002e90 con 0x7feb10004e30 2026-02-17T21:30:47.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.717+0000 7feb21573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:47.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.717+0000 7feb21573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:47.732 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.717+0000 7feb21573640 10 monclient: dump: 2026-02-17T21:30:47.732 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:47.732 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:47.732 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.732 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.732 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:47.732 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.732 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:47.732 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:47.733 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:47.733 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.717+0000 7feb21573640 1 -- 10.20.193.5:0/3532400831 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb18033070 con 0x7feb10004e30 2026-02-17T21:30:47.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.717+0000 7feb21573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:47.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.717+0000 7feb21573640 1 -- 10.20.193.5:0/3532400831 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb18004de0 con 0x7feb10004e30 2026-02-17T21:30:47.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.717+0000 7feb21573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:47.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.717+0000 7feb21573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:47.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.717+0000 7feb21573640 10 monclient: dump: 2026-02-17T21:30:47.733 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:47.733 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:47.733 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.733 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.734 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:47.734 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.734 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:47.734 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:47.734 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:47.734 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.717+0000 7feb28f40640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:47.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.717+0000 7feb28f40640 4 set_mon_vals no callback set 2026-02-17T21:30:47.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.717+0000 7feb28f40640 10 monclient: shutdown 2026-02-17T21:30:47.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.717+0000 7feb28f40640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:47.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.717+0000 7feb28f40640 1 -- 10.20.193.5:0/3532400831 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7feb10004e30 msgr2=0x7feb10005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.734 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.717+0000 7feb28f40640 1 --2- 10.20.193.5:0/3532400831 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7feb10004e30 0x7feb10005230 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7feb18003270 tx=0x7feb1802ef90 comp rx=0 tx=0).stop 2026-02-17T21:30:47.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.717+0000 7feb28f40640 1 -- 10.20.193.5:0/3532400831 shutdown_connections 2026-02-17T21:30:47.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.717+0000 7feb28f40640 1 --2- 10.20.193.5:0/3532400831 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7feb10004e30 0x7feb10005230 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.717+0000 7feb28f40640 1 -- 10.20.193.5:0/3532400831 >> 10.20.193.5:0/3532400831 conn(0x7feb240c9f40 msgr2=0x7feb240ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:47.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.717+0000 7feb28f40640 1 -- 10.20.193.5:0/3532400831 shutdown_connections 2026-02-17T21:30:47.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.717+0000 7feb28f40640 1 -- 10.20.193.5:0/3532400831 wait complete. 2026-02-17T21:30:47.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.718+0000 7feb28f40640 10 monclient: build_initial_monmap 2026-02-17T21:30:47.735 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.718+0000 7feb28f40640 10 monclient: monmap: 2026-02-17T21:30:47.735 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:47.735 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:47.735 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:47.735 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:47.735 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:47.735 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.736 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:47.736 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:47.736 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:47.736 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.718+0000 7feb28f40640 1 librados: starting msgr at 2026-02-17T21:30:47.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.718+0000 7feb28f40640 1 librados: starting objecter 2026-02-17T21:30:47.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.718+0000 7feb28f40640 1 Processor -- start 2026-02-17T21:30:47.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.718+0000 7feb28f40640 1 -- start start 2026-02-17T21:30:47.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.718+0000 7feb28f40640 1 librados: setting wanted keys 2026-02-17T21:30:47.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.718+0000 7feb28f40640 1 librados: calling monclient init 2026-02-17T21:30:47.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.718+0000 7feb28f40640 10 monclient: init 2026-02-17T21:30:47.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.718+0000 7feb28f40640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:47.736 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.718+0000 7feb28f40640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:30:47.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.718+0000 7feb28f40640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7feb10004e30 0x7feb240c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.718+0000 7feb28f40640 10 monclient(hunting): picked mon.noname-b con 0x7feb10004e30 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:47.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.718+0000 7feb28f40640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7feb2415cdc0 0x7feb2414ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.718+0000 7feb28f40640 10 monclient(hunting): picked mon.noname-a con 0x7feb2415cdc0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:47.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.718+0000 7feb28f40640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7feb2415d240 0x7feb2414d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.718+0000 7feb28f40640 10 monclient(hunting): picked mon.noname-c con 0x7feb2415d240 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:47.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.718+0000 7feb28f40640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:47.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.718+0000 7feb28f40640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7feb240c7ee0 con 0x7feb2415cdc0 2026-02-17T21:30:47.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.718+0000 7feb28f40640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:47.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.718+0000 7feb28f40640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7feb240c5830 con 0x7feb10004e30 2026-02-17T21:30:47.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.718+0000 7feb28f40640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:47.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.718+0000 7feb28f40640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7feb240c81c0 con 0x7feb2415d240 2026-02-17T21:30:47.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.718+0000 7feb28f40640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:47.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.718+0000 7feb28f40640 10 monclient(hunting): authenticate will time out at 1353.284881s 2026-02-17T21:30:47.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb21d74640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7feb2415cdc0 0x7feb2414ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb22d76640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7feb2415d240 0x7feb2414d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb21d74640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7feb2415cdc0 0x7feb2414ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48260/0 (socket says 10.20.193.5:48260) 2026-02-17T21:30:47.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb21d74640 1 -- 10.20.193.5:0/1590256452 learned_addr learned my addr 10.20.193.5:0/1590256452 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:47.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb21d74640 10 monclient(hunting): get_auth_request con 0x7feb2415cdc0 auth_method 0 2026-02-17T21:30:47.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb21d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:47.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb21d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb21d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:47.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb22575640 1 --2- 10.20.193.5:0/1590256452 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7feb10004e30 0x7feb240c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb22d76640 10 monclient(hunting): get_auth_request con 0x7feb2415d240 auth_method 0 2026-02-17T21:30:47.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb22d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:47.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb22d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb22d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:47.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb22575640 10 monclient(hunting): get_auth_request con 0x7feb10004e30 auth_method 0 2026-02-17T21:30:47.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb22575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:47.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb22575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:47.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb22575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:47.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb21d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:47.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb21d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:47.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb21d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:47.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb22d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:47.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb22d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:47.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb22d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:47.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb22575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:47.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb22575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:47.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.719+0000 7feb22575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:47.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.721+0000 7feb22d76640 10 monclient(hunting): handle_auth_done global_id 5270 payload 824 2026-02-17T21:30:47.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.721+0000 7feb22d76640 1 -- 10.20.193.5:0/1590256452 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7feb10004e30 msgr2=0x7feb240c39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.721+0000 7feb22d76640 1 --2- 10.20.193.5:0/1590256452 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7feb10004e30 0x7feb240c39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.721+0000 7feb22d76640 1 -- 10.20.193.5:0/1590256452 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7feb2415cdc0 msgr2=0x7feb2414ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.721+0000 7feb22d76640 1 --2- 10.20.193.5:0/1590256452 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7feb2415cdc0 0x7feb2414ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.721+0000 7feb22d76640 10 monclient: _finish_hunting 0 2026-02-17T21:30:47.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.721+0000 7feb22d76640 1 monclient: found mon.noname-c 2026-02-17T21:30:47.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.721+0000 7feb22d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:47.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.721+0000 7feb22d76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:47.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.721+0000 7feb22d76640 1 -- 10.20.193.5:0/1590256452 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb240c2690 con 0x7feb2415d240 2026-02-17T21:30:47.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.722+0000 7feb22d76640 1 --2- 10.20.193.5:0/1590256452 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7feb2415d240 0x7feb2414d390 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7feb240c6960 tx=0x7feb1400a6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:47.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.722+0000 7feb0affd640 10 client.?.objecter ms_handle_connect 0x7feb2415d240 2026-02-17T21:30:47.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.722+0000 7feb0affd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:47.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.723+0000 7feb0affd640 1 -- 10.20.193.5:0/1590256452 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb14017020 con 0x7feb2415d240 2026-02-17T21:30:47.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.723+0000 7feb0affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:47.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.723+0000 7feb0affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:47.743 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.723+0000 7feb0affd640 10 monclient: dump: 2026-02-17T21:30:47.743 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:47.744 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:47.744 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.744 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.744 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:47.744 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.744 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:47.744 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:47.744 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:47.744 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.723+0000 7feb0affd640 10 monclient: _finish_auth 0 2026-02-17T21:30:47.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.723+0000 7feb0affd640 10 monclient: _check_auth_tickets 2026-02-17T21:30:47.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.723+0000 7feb0affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:47.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.723+0000 7feb0affd640 1 -- 10.20.193.5:0/1590256452 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb14005730 con 0x7feb2415d240 2026-02-17T21:30:47.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.723+0000 7feb0affd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:47.744 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.723+0000 7feb0affd640 1 -- 10.20.193.5:0/1590256452 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb14013630 con 0x7feb2415d240 2026-02-17T21:30:47.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.723+0000 7feb28f40640 5 monclient: authenticate success, global_id 5270 2026-02-17T21:30:47.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.723+0000 7feb28f40640 10 monclient: _renew_subs 2026-02-17T21:30:47.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.723+0000 7feb20d72640 4 set_mon_vals no callback set 2026-02-17T21:30:47.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.723+0000 7feb28f40640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:47.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.723+0000 7feb28f40640 1 -- 10.20.193.5:0/1590256452 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb240c2930 con 0x7feb2415d240 2026-02-17T21:30:47.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.723+0000 7feb0affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:47.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.723+0000 7feb0affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:47.745 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.723+0000 7feb0affd640 10 monclient: dump: 2026-02-17T21:30:47.745 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:47.745 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:47.745 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.745 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:47.745 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:47.745 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:47.745 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:47.745 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:47.746 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:47.746 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:47.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.723+0000 7feb28f40640 10 client.5270.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:47.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.723+0000 7feb28f40640 10 monclient: _renew_subs 2026-02-17T21:30:47.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.723+0000 7feb28f40640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:47.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.723+0000 7feb28f40640 1 -- 10.20.193.5:0/1590256452 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb240c2ef0 con 0x7feb2415d240 2026-02-17T21:30:47.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.723+0000 7feb28f40640 1 librados: init done 2026-02-17T21:30:47.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.724+0000 7feb28f40640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:47.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.724+0000 7feb28f40640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:47.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.724+0000 7feb28f40640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:47.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.724+0000 7feb28f40640 1 -- 10.20.193.5:0/1590256452 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb2415a9a0 con 0x7feb2415d240 2026-02-17T21:30:47.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.735+0000 7feb0affd640 1 -- 10.20.193.5:0/1590256452 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7feb140137d0 con 0x7feb2415d240 2026-02-17T21:30:47.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.736+0000 7feb0affd640 1 --2- 10.20.193.5:0/1590256452 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7feaf0079280 0x7feaf007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:47.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.736+0000 7feb22575640 1 --2- 10.20.193.5:0/1590256452 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7feaf0079280 0x7feaf007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:47.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.736+0000 7feb22575640 10 monclient: get_auth_request con 0x7feaf0079280 auth_method 0 2026-02-17T21:30:47.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.737+0000 7feb22575640 1 --2- 10.20.193.5:0/1590256452 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7feaf0079280 0x7feaf007b740 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7feb18036000 tx=0x7feb18007000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:47.746 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.737+0000 7feb0affd640 10 client.5270.objecter ms_handle_connect 0x7feaf0079280 2026-02-17T21:30:47.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.737+0000 7feb0affd640 1 -- 10.20.193.5:0/1590256452 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7feb1405e7e0 con 0x7feb2415d240 2026-02-17T21:30:47.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.737+0000 7feb0affd640 10 client.5270.objecter ms_dispatch2 0x7feb24000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:47.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.737+0000 7feb0affd640 3 client.5270.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:47.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.737+0000 7feb0affd640 3 client.5270.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:47.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.737+0000 7feb0affd640 20 client.5270.objecter dump_active .. 0 homeless 2026-02-17T21:30:47.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.838+0000 7feb0affd640 1 -- 10.20.193.5:0/1590256452 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7feb14021030 con 0x7feb2415d240 2026-02-17T21:30:47.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.838+0000 7feb0affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:47.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.838+0000 7feb0affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:47.923 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.921+0000 7feb28f40640 1 -- 10.20.193.5:0/1590256452 --> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "9", "target": ["mon-mgr", ""]}) -- 0x7feb24070d70 con 0x7feaf0079280 2026-02-17T21:30:47.924 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.921+0000 7feb0affd640 1 -- 10.20.193.5:0/1590256452 <== mgr.4131 v2:10.20.193.176:6800/2898618020 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 9 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7feb24070d70 con 0x7feaf0079280 2026-02-17T21:30:47.924 INFO:teuthology.orchestra.run.trial005.stderr:instructed osd(s) 9 to deep-scrub 2026-02-17T21:30:47.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.922+0000 7feb28f40640 10 librados: watch_flush enter 2026-02-17T21:30:47.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.922+0000 7feb28f40640 10 librados: watch_flush exit 2026-02-17T21:30:47.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.922+0000 7feb28f40640 20 client.5270.objecter shutdown clearing up homeless session... 2026-02-17T21:30:47.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.922+0000 7feb28f40640 10 client.5270.objecter successfully canceled tick 2026-02-17T21:30:47.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.922+0000 7feb28f40640 1 -- 10.20.193.5:0/1590256452 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7feaf0079280 msgr2=0x7feaf007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.922+0000 7feb28f40640 1 --2- 10.20.193.5:0/1590256452 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7feaf0079280 0x7feaf007b740 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7feb18036000 tx=0x7feb18007000 comp rx=0 tx=0).stop 2026-02-17T21:30:47.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.922+0000 7feb28f40640 10 monclient: shutdown 2026-02-17T21:30:47.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.922+0000 7feb28f40640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:47.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.922+0000 7feb28f40640 1 -- 10.20.193.5:0/1590256452 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7feb2415d240 msgr2=0x7feb2414d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:47.926 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.922+0000 7feb28f40640 1 --2- 10.20.193.5:0/1590256452 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7feb2415d240 0x7feb2414d390 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7feb240c6960 tx=0x7feb1400a6a0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.922+0000 7feb28f40640 1 -- 10.20.193.5:0/1590256452 shutdown_connections 2026-02-17T21:30:47.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.922+0000 7feb28f40640 1 --2- 10.20.193.5:0/1590256452 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7feaf0079280 0x7feaf007b740 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.922+0000 7feb28f40640 1 --2- 10.20.193.5:0/1590256452 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7feb2415d240 0x7feb2414d390 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.922+0000 7feb28f40640 1 --2- 10.20.193.5:0/1590256452 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7feb2415cdc0 0x7feb2414ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.922+0000 7feb28f40640 1 --2- 10.20.193.5:0/1590256452 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7feb10004e30 0x7feb240c39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:47.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.922+0000 7feb28f40640 1 -- 10.20.193.5:0/1590256452 >> 10.20.193.5:0/1590256452 conn(0x7feb240c9f40 msgr2=0x7feb240c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:47.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.922+0000 7feb28f40640 1 -- 10.20.193.5:0/1590256452 shutdown_connections 2026-02-17T21:30:47.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.922+0000 7feb28f40640 1 -- 10.20.193.5:0/1590256452 wait complete. 2026-02-17T21:30:47.927 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:47.922+0000 7feb28f40640 1 librados: shutdown 2026-02-17T21:30:47.933 INFO:tasks.ceph:Scrubbing osd.13 2026-02-17T21:30:47.934 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:30:48.005 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.002+0000 7f30b04a7640 10 monclient: get_monmap_and_config 2026-02-17T21:30:48.005 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.002+0000 7f30b04a7640 10 monclient: build_initial_monmap 2026-02-17T21:30:48.005 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.002+0000 7f30b04a7640 10 monclient: monmap: 2026-02-17T21:30:48.005 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:48.005 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.005 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:48.004428+0000 2026-02-17T21:30:48.005 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:48.004428+0000 2026-02-17T21:30:48.005 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:48.006 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.006 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:48.006 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:48.006 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:48.006 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:48.006 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:48.006 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:48.006 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.003+0000 7f30b04a7640 1 Processor -- start 2026-02-17T21:30:48.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.003+0000 7f30b04a7640 1 -- start start 2026-02-17T21:30:48.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.003+0000 7f30b04a7640 10 monclient: init 2026-02-17T21:30:48.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.003+0000 7f30b04a7640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:48.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.003+0000 7f30b04a7640 10 monclient: _add_conns ranks=[0,3,2,1,4,5] 2026-02-17T21:30:48.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.003+0000 7f30b04a7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f30a8152790 addr v1:10.20.193.5:6789/0 2026-02-17T21:30:48.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.003+0000 7f30b04a7640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f30a8152b70 0x7f30a80c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.003+0000 7f30b04a7640 10 monclient(hunting): picked mon.noname-a con 0x7f30a8152b70 addr v2:10.20.193.5:3300/0 2026-02-17T21:30:48.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.003+0000 7f30b04a7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f30a815ab90 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:48.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.003+0000 7f30b04a7640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30a80c73f0 con 0x7f30a8152790 2026-02-17T21:30:48.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.003+0000 7f30b04a7640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30a80c76d0 con 0x7f30a815ab90 2026-02-17T21:30:48.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.003+0000 7f30b04a7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.003+0000 7f30b04a7640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f30a815a700 con 0x7f30a8152b70 2026-02-17T21:30:48.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.003+0000 7f30b04a7640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:48.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.003+0000 7f30b04a7640 10 monclient(hunting): authenticate will time out at 1353.569836s 2026-02-17T21:30:48.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.004+0000 7f30ada1b640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f30a8152b70 0x7f30a80c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.004+0000 7f30aea1d640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f30a815ab90 0x7f30a815afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:59644/0 (socket says 10.20.193.5:59644) 2026-02-17T21:30:48.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.004+0000 7f30aea1d640 1 -- 10.20.193.5:0/1379602886 learned_addr learned my addr 10.20.193.5:0/1379602886 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:48.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.004+0000 7f30ada1b640 10 monclient(hunting): get_auth_request con 0x7f30a8152b70 auth_method 0 2026-02-17T21:30:48.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.004+0000 7f30ada1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:48.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.004+0000 7f30ada1b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.004+0000 7f30ada1b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.005+0000 7f30ada1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:48.010 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.005+0000 7f30ada1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:48.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.005+0000 7f30ada1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:48.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.005+0000 7f30ad21a640 1 -- 10.20.193.5:0/1379602886 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1544820674 0 0) 0x7f30a80c76d0 con 0x7f30a815ab90 2026-02-17T21:30:48.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.005+0000 7f30ad21a640 10 monclient(hunting): _negotiate 2026-02-17T21:30:48.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.005+0000 7f30ad21a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.005+0000 7f30ad21a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.005+0000 7f30ad21a640 10 monclient(hunting): my global_id is 5273 2026-02-17T21:30:48.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.005+0000 7f30ad21a640 1 -- 10.20.193.5:0/1379602886 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3090003620 con 0x7f30a815ab90 2026-02-17T21:30:48.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 1 -- 10.20.193.5:0/1379602886 <== mon.2 v1:10.20.193.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3704639286 0 0) 0x7f3090003620 con 0x7f30a815ab90 2026-02-17T21:30:48.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 1 -- 10.20.193.5:0/1379602886 >> v2:10.20.193.5:3300/0 conn(0x7f30a8152b70 msgr2=0x7f30a80c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:48.019 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 1 --2- 10.20.193.5:0/1379602886 >> v2:10.20.193.5:3300/0 conn(0x7f30a8152b70 0x7f30a80c6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.020 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 1 -- 10.20.193.5:0/1379602886 >> v1:10.20.193.5:6789/0 conn(0x7f30a8152790 legacy=0x7f30a80c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.020 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 10 monclient: _finish_hunting 0 2026-02-17T21:30:48.020 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 1 monclient: found mon.noname-c-legacy 2026-02-17T21:30:48.020 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:48.020 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.135:6789/0 2026-02-17T21:30:48.020 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 1 -- 10.20.193.5:0/1379602886 --> v1:10.20.193.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a815a0b0 con 0x7f30a815ab90 2026-02-17T21:30:48.020 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 10 monclient: _finish_auth 0 2026-02-17T21:30:48.020 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 10 monclient: _check_auth_tickets 2026-02-17T21:30:48.020 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:48.020 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 1 -- 10.20.193.5:0/1379602886 <== mon.2 v1:10.20.193.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3880376286 0 0) 0x7f30a4003280 con 0x7f30a815ab90 2026-02-17T21:30:48.020 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:48.021 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T21:30:48.021 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 10 monclient: dump: 2026-02-17T21:30:48.021 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:48.021 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.021 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.021 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.021 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:48.021 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.021 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:48.021 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:48.021 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:48.021 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 1 monclient: mon.c has (v2) addrs [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] but i'm connected to v1:10.20.193.135:6789/0, reconnecting 2026-02-17T21:30:48.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:48.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 1 -- 10.20.193.5:0/1379602886 >> v1:10.20.193.135:6789/0 conn(0x7f30a815ab90 legacy=0x7f30a815afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:30:48.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 1 --2- 10.20.193.5:0/1379602886 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3090003bf0 0x7f3090004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 10 monclient(hunting): picked mon.a con 0x7f3090003bf0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:48.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 1 --2- 10.20.193.5:0/1379602886 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3090004900 0x7f3090004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 10 monclient(hunting): picked mon.b con 0x7f3090004900 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:48.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 1 --2- 10.20.193.5:0/1379602886 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f30900054c0 0x7f309000bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 10 monclient(hunting): picked mon.c con 0x7f30900054c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:48.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 1 -- 10.20.193.5:0/1379602886 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f30a815a700 con 0x7f3090003bf0 2026-02-17T21:30:48.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 1 -- 10.20.193.5:0/1379602886 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f309000e5c0 con 0x7f3090004900 2026-02-17T21:30:48.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 1 -- 10.20.193.5:0/1379602886 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f309000e7c0 con 0x7f30900054c0 2026-02-17T21:30:48.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:48.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ad21a640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:30:48.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ada1b640 1 --2- 10.20.193.5:0/1379602886 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3090004900 0x7f3090004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ada1b640 10 monclient(hunting): get_auth_request con 0x7f3090004900 auth_method 0 2026-02-17T21:30:48.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ada1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:48.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ada1b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.007+0000 7f30ada1b640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:30:48.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.008+0000 7f30ada1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:48.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.008+0000 7f30aea1d640 1 --2- 10.20.193.5:0/1379602886 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f30900054c0 0x7f309000bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.008+0000 7f30ada1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:48.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.008+0000 7f30ada1b640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:30:48.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.008+0000 7f30aea1d640 10 monclient(hunting): get_auth_request con 0x7f30900054c0 auth_method 0 2026-02-17T21:30:48.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.008+0000 7f30aea1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:48.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.008+0000 7f30aea1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.008+0000 7f30aea1d640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:30:48.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.009+0000 7f30aea1d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:48.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.009+0000 7f30aea1d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:48.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.009+0000 7f30aea1d640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:30:48.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.009+0000 7f30ada1b640 10 monclient(hunting): handle_auth_done global_id 5273 payload 293 2026-02-17T21:30:48.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.009+0000 7f30ada1b640 1 -- 10.20.193.5:0/1379602886 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f30900054c0 msgr2=0x7f309000bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:48.024 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.009+0000 7f30ada1b640 1 --2- 10.20.193.5:0/1379602886 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f30900054c0 0x7f309000bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.009+0000 7f30ada1b640 1 -- 10.20.193.5:0/1379602886 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3090003bf0 msgr2=0x7f3090004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:48.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.009+0000 7f30ada1b640 1 --2- 10.20.193.5:0/1379602886 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3090003bf0 0x7f3090004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.009+0000 7f30ada1b640 10 monclient: _finish_hunting 0 2026-02-17T21:30:48.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.009+0000 7f30ada1b640 1 monclient: found mon.b 2026-02-17T21:30:48.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.009+0000 7f30ada1b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:48.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.009+0000 7f30ada1b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:48.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.009+0000 7f30ada1b640 1 -- 10.20.193.5:0/1379602886 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3090003620 con 0x7f3090004900 2026-02-17T21:30:48.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.009+0000 7f30ada1b640 10 monclient: _finish_auth 0 2026-02-17T21:30:48.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.009+0000 7f30ada1b640 10 monclient: _check_auth_tickets 2026-02-17T21:30:48.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.009+0000 7f30ada1b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:48.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.009+0000 7f30aea1d640 1 -- 10.20.193.5:0/1379602886 reap_dead start 2026-02-17T21:30:48.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.009+0000 7f30b04a7640 5 monclient: authenticate success, global_id 5273 2026-02-17T21:30:48.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.009+0000 7f30b04a7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:48.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.010+0000 7f30ada1b640 1 --2- 10.20.193.5:0/1379602886 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3090004900 0x7f3090004d80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f309c009bc0 tx=0x7f309c02f4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11ad84b867131a9e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:48.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.011+0000 7f30ad21a640 1 -- 10.20.193.5:0/1379602886 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c03c070 con 0x7f3090004900 2026-02-17T21:30:48.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.011+0000 7f30ad21a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:48.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.011+0000 7f30ad21a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:30:48.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.011+0000 7f30ad21a640 10 monclient: dump: 2026-02-17T21:30:48.026 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:48.026 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.026 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.026 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.026 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:48.026 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.026 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:48.027 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:48.027 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:48.027 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.011+0000 7f30b04a7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:48.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.012+0000 7f30ad21a640 1 -- 10.20.193.5:0/1379602886 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309c02fd00 con 0x7f3090004900 2026-02-17T21:30:48.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.012+0000 7f30ad21a640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:48.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.012+0000 7f30ad21a640 1 -- 10.20.193.5:0/1379602886 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c009790 con 0x7f3090004900 2026-02-17T21:30:48.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.012+0000 7f30ad21a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:48.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.012+0000 7f30ad21a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:30:48.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.012+0000 7f30ad21a640 10 monclient: dump: 2026-02-17T21:30:48.027 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:48.027 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.028 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.028 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.028 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:48.028 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.028 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:48.028 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:48.028 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:48.028 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.028 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.012+0000 7f30b04a7640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:48.028 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.012+0000 7f30b04a7640 4 set_mon_vals no callback set 2026-02-17T21:30:48.028 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.012+0000 7f30b04a7640 10 monclient: shutdown 2026-02-17T21:30:48.028 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.012+0000 7f30b04a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:48.028 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.012+0000 7f30b04a7640 1 -- 10.20.193.5:0/1379602886 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3090004900 msgr2=0x7f3090004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.029 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.012+0000 7f30b04a7640 1 --2- 10.20.193.5:0/1379602886 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3090004900 0x7f3090004d80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f309c009bc0 tx=0x7f309c02f4e0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.029 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.012+0000 7f30b04a7640 1 -- 10.20.193.5:0/1379602886 shutdown_connections 2026-02-17T21:30:48.029 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.012+0000 7f30b04a7640 1 --2- 10.20.193.5:0/1379602886 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3090004900 0x7f3090004d80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.029 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.012+0000 7f30b04a7640 1 -- 10.20.193.5:0/1379602886 >> 10.20.193.5:0/1379602886 conn(0x7f30a80c9f40 msgr2=0x7f30a80ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:48.029 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.012+0000 7f30b04a7640 1 -- 10.20.193.5:0/1379602886 shutdown_connections 2026-02-17T21:30:48.029 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.012+0000 7f30b04a7640 1 -- 10.20.193.5:0/1379602886 wait complete. 2026-02-17T21:30:48.029 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.013+0000 7f30b04a7640 10 monclient: build_initial_monmap 2026-02-17T21:30:48.029 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.013+0000 7f30b04a7640 10 monclient: monmap: 2026-02-17T21:30:48.029 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:48.029 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:48.029 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:48.029 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:48.030 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:48.030 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.030 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:48.030 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:48.030 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:48.030 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.013+0000 7f30b04a7640 1 librados: starting msgr at 2026-02-17T21:30:48.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.013+0000 7f30b04a7640 1 librados: starting objecter 2026-02-17T21:30:48.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.013+0000 7f30b04a7640 1 Processor -- start 2026-02-17T21:30:48.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.013+0000 7f30b04a7640 1 -- start start 2026-02-17T21:30:48.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.013+0000 7f30b04a7640 1 librados: setting wanted keys 2026-02-17T21:30:48.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.013+0000 7f30b04a7640 1 librados: calling monclient init 2026-02-17T21:30:48.030 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.013+0000 7f30b04a7640 10 monclient: init 2026-02-17T21:30:48.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.013+0000 7f30b04a7640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:48.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.013+0000 7f30b04a7640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:30:48.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.013+0000 7f30b04a7640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3090004900 0x7f30a81f41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.013+0000 7f30b04a7640 10 monclient(hunting): picked mon.noname-a con 0x7f3090004900 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:48.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.013+0000 7f30b04a7640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f30a80c3e00 0x7f30a81f60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.013+0000 7f30b04a7640 10 monclient(hunting): picked mon.noname-c con 0x7f30a80c3e00 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:48.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.013+0000 7f30b04a7640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f30a80c4280 0x7f30a81f6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.013+0000 7f30b04a7640 10 monclient(hunting): picked mon.noname-b con 0x7f30a80c4280 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:48.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.013+0000 7f30b04a7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.013+0000 7f30b04a7640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f30a80c9ca0 con 0x7f3090004900 2026-02-17T21:30:48.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.013+0000 7f30b04a7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.013+0000 7f30b04a7640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f30a80c9b20 con 0x7f30a80c4280 2026-02-17T21:30:48.031 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.013+0000 7f30b04a7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.013+0000 7f30b04a7640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f30a815afe0 con 0x7f30a80c3e00 2026-02-17T21:30:48.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.013+0000 7f30b04a7640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:48.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.013+0000 7f30b04a7640 10 monclient(hunting): authenticate will time out at 1353.579734s 2026-02-17T21:30:48.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30ada1b640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f30a80c3e00 0x7f30a81f60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30aea1d640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f30a80c4280 0x7f30a81f6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30ae21c640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3090004900 0x7f30a81f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30aea1d640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f30a80c4280 0x7f30a81f6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:35224/0 (socket says 10.20.193.5:35224) 2026-02-17T21:30:48.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30aea1d640 1 -- 10.20.193.5:0/442764371 learned_addr learned my addr 10.20.193.5:0/442764371 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:48.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30aea1d640 10 monclient(hunting): get_auth_request con 0x7f30a80c4280 auth_method 0 2026-02-17T21:30:48.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30aea1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:48.032 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30aea1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30aea1d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30ada1b640 10 monclient(hunting): get_auth_request con 0x7f30a80c3e00 auth_method 0 2026-02-17T21:30:48.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30ada1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:48.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30ada1b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30ada1b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30ae21c640 10 monclient(hunting): get_auth_request con 0x7f3090004900 auth_method 0 2026-02-17T21:30:48.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30ae21c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:48.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30ae21c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30ae21c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30aea1d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:48.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30aea1d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:48.033 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30aea1d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:48.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30ada1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:48.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30ada1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:48.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30ada1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:48.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30ae21c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:48.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30ae21c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:48.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.014+0000 7f30ae21c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:48.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.015+0000 7f30ada1b640 10 monclient(hunting): handle_auth_done global_id 5276 payload 824 2026-02-17T21:30:48.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.015+0000 7f30ada1b640 1 -- 10.20.193.5:0/442764371 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f30a80c4280 msgr2=0x7f30a81f6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.015+0000 7f30ada1b640 1 --2- 10.20.193.5:0/442764371 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f30a80c4280 0x7f30a81f6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.015+0000 7f30ada1b640 1 -- 10.20.193.5:0/442764371 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3090004900 msgr2=0x7f30a81f41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.015+0000 7f30ada1b640 1 --2- 10.20.193.5:0/442764371 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f3090004900 0x7f30a81f41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.015+0000 7f30ada1b640 10 monclient: _finish_hunting 0 2026-02-17T21:30:48.034 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.015+0000 7f30ada1b640 1 monclient: found mon.noname-c 2026-02-17T21:30:48.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.015+0000 7f30ada1b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:48.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.015+0000 7f30ada1b640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:48.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.015+0000 7f30ada1b640 1 -- 10.20.193.5:0/442764371 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a81f4d50 con 0x7f30a80c3e00 2026-02-17T21:30:48.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.016+0000 7f30ada1b640 1 --2- 10.20.193.5:0/442764371 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f30a80c3e00 0x7f30a81f60d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f309000e790 tx=0x7f309c004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:48.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.016+0000 7f308effd640 10 client.?.objecter ms_handle_connect 0x7f30a80c3e00 2026-02-17T21:30:48.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.016+0000 7f308effd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:48.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f308effd640 1 -- 10.20.193.5:0/442764371 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c03c040 con 0x7f30a80c3e00 2026-02-17T21:30:48.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f308effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:48.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f308effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:48.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f308effd640 10 monclient: dump: 2026-02-17T21:30:48.039 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:48.039 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.039 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.039 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.039 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:48.039 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.039 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:48.039 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:48.039 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:48.039 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f308effd640 10 monclient: _finish_auth 0 2026-02-17T21:30:48.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f308effd640 10 monclient: _check_auth_tickets 2026-02-17T21:30:48.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f308effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:48.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f308effd640 1 -- 10.20.193.5:0/442764371 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309c047070 con 0x7f30a80c3e00 2026-02-17T21:30:48.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f308effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:48.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f308effd640 1 -- 10.20.193.5:0/442764371 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c003b50 con 0x7f30a80c3e00 2026-02-17T21:30:48.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f308effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:48.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f308effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:48.040 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f308effd640 10 monclient: dump: 2026-02-17T21:30:48.040 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:48.040 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.040 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.040 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.040 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:48.040 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.040 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:48.040 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:48.041 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:48.041 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f30aca19640 4 set_mon_vals no callback set 2026-02-17T21:30:48.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f30b04a7640 5 monclient: authenticate success, global_id 5276 2026-02-17T21:30:48.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f30b04a7640 10 monclient: _renew_subs 2026-02-17T21:30:48.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f30b04a7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:48.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f30b04a7640 1 -- 10.20.193.5:0/442764371 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a81f5030 con 0x7f30a80c3e00 2026-02-17T21:30:48.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f30b04a7640 10 client.5276.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:48.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f30b04a7640 10 monclient: _renew_subs 2026-02-17T21:30:48.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f30b04a7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:48.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f30b04a7640 1 -- 10.20.193.5:0/442764371 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a81f55f0 con 0x7f30a80c3e00 2026-02-17T21:30:48.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f30b04a7640 1 librados: init done 2026-02-17T21:30:48.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f30b04a7640 10 client.5276.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:48.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f30b04a7640 15 client.5276.objecter _session_command_op_assign -1 1 2026-02-17T21:30:48.041 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f30b04a7640 20 client.5276.objecter _get_session osd=-1 returning homeless 2026-02-17T21:30:48.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f30b04a7640 10 client.5276.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:48.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f30b04a7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:48.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.018+0000 7f30b04a7640 1 -- 10.20.193.5:0/442764371 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f30a815b370 con 0x7f30a80c3e00 2026-02-17T21:30:48.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.029+0000 7f308effd640 1 -- 10.20.193.5:0/442764371 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f309c04c460 con 0x7f30a80c3e00 2026-02-17T21:30:48.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.030+0000 7f308effd640 1 --2- 10.20.193.5:0/442764371 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f30780792b0 0x7f307807b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.030+0000 7f30ae21c640 1 --2- 10.20.193.5:0/442764371 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f30780792b0 0x7f307807b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.030+0000 7f30ae21c640 10 monclient: get_auth_request con 0x7f30780792b0 auth_method 0 2026-02-17T21:30:48.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.030+0000 7f308effd640 10 client.5276.objecter ms_handle_connect 0x7f30780792b0 2026-02-17T21:30:48.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.030+0000 7f30ae21c640 1 --2- 10.20.193.5:0/442764371 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f30780792b0 0x7f307807b770 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f30a80517c0 tx=0x7f3098009040 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:48.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.031+0000 7f308effd640 1 -- 10.20.193.5:0/442764371 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f309c009810 con 0x7f30a80c3e00 2026-02-17T21:30:48.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.031+0000 7f308effd640 10 client.5276.objecter ms_dispatch2 0x7f30a8000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:48.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.031+0000 7f308effd640 3 client.5276.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:48.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.031+0000 7f308effd640 3 client.5276.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:48.042 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.032+0000 7f308effd640 10 client.5276.objecter checking command 1 2026-02-17T21:30:48.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.032+0000 7f308effd640 1 --2- 10.20.193.5:0/442764371 >> [v2:10.20.193.119:6808/1303925174,v1:10.20.193.119:6809/1303925174] conn(0x7f3078081790 0x7f3078083bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.032+0000 7f308effd640 20 client.5276.objecter _get_session s=0x7f30780810c0 osd=13 3 2026-02-17T21:30:48.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.032+0000 7f308effd640 20 client.5276.objecter put_session s=0x7f30780810c0 osd=13 3 2026-02-17T21:30:48.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.032+0000 7f308effd640 15 client.5276.objecter _session_command_op_remove -1 1 2026-02-17T21:30:48.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.032+0000 7f308effd640 20 client.5276.objecter _get_session s=0x7f30780810c0 osd=13 3 2026-02-17T21:30:48.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.032+0000 7f308effd640 20 client.5276.objecter get_session s=0x7f30780810c0 osd=13 3 2026-02-17T21:30:48.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.032+0000 7f308effd640 15 client.5276.objecter _session_command_op_assign 13 1 2026-02-17T21:30:48.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.032+0000 7f308effd640 20 client.5276.objecter put_session s=0x7f30780810c0 osd=13 4 2026-02-17T21:30:48.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.032+0000 7f308effd640 10 client.5276.objecter _send_command 1 2026-02-17T21:30:48.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.032+0000 7f308effd640 1 -- 10.20.193.5:0/442764371 --> [v2:10.20.193.119:6808/1303925174,v1:10.20.193.119:6809/1303925174] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3078084280 con 0x7f3078081790 2026-02-17T21:30:48.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.032+0000 7f308effd640 20 client.5276.objecter dump_active .. 0 homeless 2026-02-17T21:30:48.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.032+0000 7f308effd640 1 -- 10.20.193.5:0/442764371 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f309c0834e0 con 0x7f30a80c3e00 2026-02-17T21:30:48.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.032+0000 7f308effd640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T21:30:48.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.032+0000 7f30aea1d640 1 --2- 10.20.193.5:0/442764371 >> [v2:10.20.193.119:6808/1303925174,v1:10.20.193.119:6809/1303925174] conn(0x7f3078081790 0x7f3078083bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.032+0000 7f30aea1d640 10 monclient: get_auth_request con 0x7f3078081790 auth_method 0 2026-02-17T21:30:48.043 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.034+0000 7f30aea1d640 1 --2- 10.20.193.5:0/442764371 >> [v2:10.20.193.119:6808/1303925174,v1:10.20.193.119:6809/1303925174] conn(0x7f3078081790 0x7f3078083bb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.13 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:48.044 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.034+0000 7f308effd640 10 client.5276.objecter ms_handle_connect 0x7f3078081790 2026-02-17T21:30:48.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.045+0000 7f308effd640 1 -- 10.20.193.5:0/442764371 <== osd.13 v2:10.20.193.119:6808/1303925174 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f3078084280 con 0x7f3078081790 2026-02-17T21:30:48.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.045+0000 7f308effd640 10 client.5276.objecter ms_dispatch2 0x7f30a8000b90 command_reply(tid 1: 0 ) 2026-02-17T21:30:48.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.045+0000 7f308effd640 10 client.5276.objecter _finish_command 1 = system:0 2026-02-17T21:30:48.046 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.045+0000 7f308effd640 20 client.5276.objecter put_session s=0x7f30780810c0 osd=13 4 2026-02-17T21:30:48.047 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.045+0000 7f308effd640 15 client.5276.objecter _session_command_op_remove 13 1 2026-02-17T21:30:48.052 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.050+0000 7f30b04a7640 10 client.5276.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:30:48.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.050+0000 7f30b04a7640 15 client.5276.objecter _session_command_op_assign -1 2 2026-02-17T21:30:48.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.050+0000 7f30b04a7640 20 client.5276.objecter _get_session s=0x7f30780810c0 osd=13 3 2026-02-17T21:30:48.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.050+0000 7f30b04a7640 20 client.5276.objecter put_session s=0x7f30780810c0 osd=13 3 2026-02-17T21:30:48.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.050+0000 7f30b04a7640 20 client.5276.objecter _get_session s=0x7f30780810c0 osd=13 3 2026-02-17T21:30:48.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.050+0000 7f30b04a7640 15 client.5276.objecter _session_command_op_remove -1 2 2026-02-17T21:30:48.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.050+0000 7f30b04a7640 20 client.5276.objecter get_session s=0x7f30780810c0 osd=13 3 2026-02-17T21:30:48.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.050+0000 7f30b04a7640 15 client.5276.objecter _session_command_op_assign 13 2 2026-02-17T21:30:48.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.050+0000 7f30b04a7640 20 client.5276.objecter put_session s=0x7f30780810c0 osd=13 4 2026-02-17T21:30:48.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.050+0000 7f30b04a7640 10 client.5276.objecter _send_command 2 2026-02-17T21:30:48.053 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.050+0000 7f30b04a7640 1 -- 10.20.193.5:0/442764371 --> [v2:10.20.193.119:6808/1303925174,v1:10.20.193.119:6809/1303925174] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f30a815c310 con 0x7f3078081790 2026-02-17T21:30:48.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.058+0000 7f308effd640 1 -- 10.20.193.5:0/442764371 <== osd.13 v2:10.20.193.119:6808/1303925174 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f30a815c310 con 0x7f3078081790 2026-02-17T21:30:48.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.058+0000 7f308effd640 10 client.5276.objecter ms_dispatch2 0x7f30a8000b90 command_reply(tid 2: 0 ) 2026-02-17T21:30:48.059 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.058+0000 7f308effd640 10 client.5276.objecter _finish_command 2 = system:0 2026-02-17T21:30:48.060 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.058+0000 7f308effd640 20 client.5276.objecter put_session s=0x7f30780810c0 osd=13 4 2026-02-17T21:30:48.060 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.058+0000 7f308effd640 15 client.5276.objecter _session_command_op_remove 13 2 2026-02-17T21:30:48.060 INFO:teuthology.orchestra.run.trial005.stdout:{ 2026-02-17T21:30:48.060 INFO:teuthology.orchestra.run.trial005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:30:48.060 INFO:teuthology.orchestra.run.trial005.stdout:} 2026-02-17T21:30:48.061 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.058+0000 7f30b04a7640 10 librados: watch_flush enter 2026-02-17T21:30:48.062 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.058+0000 7f30b04a7640 10 librados: watch_flush exit 2026-02-17T21:30:48.062 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.058+0000 7f30b04a7640 10 client.5276.objecter close_session for osd.13 2026-02-17T21:30:48.062 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.058+0000 7f30b04a7640 1 -- 10.20.193.5:0/442764371 >> [v2:10.20.193.119:6808/1303925174,v1:10.20.193.119:6809/1303925174] conn(0x7f3078081790 msgr2=0x7f3078083bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.062 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.058+0000 7f30b04a7640 1 --2- 10.20.193.5:0/442764371 >> [v2:10.20.193.119:6808/1303925174,v1:10.20.193.119:6809/1303925174] conn(0x7f3078081790 0x7f3078083bb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.062 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.058+0000 7f30b04a7640 20 client.5276.objecter put_session s=0x7f30780810c0 osd=13 1 2026-02-17T21:30:48.062 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.058+0000 7f30b04a7640 20 client.5276.objecter shutdown clearing up homeless session... 2026-02-17T21:30:48.062 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.058+0000 7f30b04a7640 10 client.5276.objecter successfully canceled tick 2026-02-17T21:30:48.062 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.058+0000 7f30b04a7640 1 -- 10.20.193.5:0/442764371 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f30780792b0 msgr2=0x7f307807b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.062 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.058+0000 7f30b04a7640 1 --2- 10.20.193.5:0/442764371 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f30780792b0 0x7f307807b770 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f30a80517c0 tx=0x7f3098009040 comp rx=0 tx=0).stop 2026-02-17T21:30:48.062 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.058+0000 7f30b04a7640 10 monclient: shutdown 2026-02-17T21:30:48.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.058+0000 7f30b04a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:48.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.058+0000 7f30b04a7640 1 -- 10.20.193.5:0/442764371 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f30a80c3e00 msgr2=0x7f30a81f60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.058+0000 7f30b04a7640 1 --2- 10.20.193.5:0/442764371 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f30a80c3e00 0x7f30a81f60d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f309000e790 tx=0x7f309c004830 comp rx=0 tx=0).stop 2026-02-17T21:30:48.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.058+0000 7f30aea1d640 1 -- 10.20.193.5:0/442764371 reap_dead start 2026-02-17T21:30:48.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.058+0000 7f30b04a7640 1 -- 10.20.193.5:0/442764371 shutdown_connections 2026-02-17T21:30:48.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.058+0000 7f30b04a7640 1 -- 10.20.193.5:0/442764371 >> 10.20.193.5:0/442764371 conn(0x7f30a80c9f40 msgr2=0x7f30a815c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:48.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.058+0000 7f30b04a7640 1 -- 10.20.193.5:0/442764371 shutdown_connections 2026-02-17T21:30:48.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.058+0000 7f30b04a7640 1 -- 10.20.193.5:0/442764371 wait complete. 2026-02-17T21:30:48.063 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.058+0000 7f30b04a7640 1 librados: shutdown 2026-02-17T21:30:48.067 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 13 2026-02-17T21:30:48.136 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.134+0000 7f30121ed640 10 monclient: get_monmap_and_config 2026-02-17T21:30:48.136 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.134+0000 7f30121ed640 10 monclient: build_initial_monmap 2026-02-17T21:30:48.136 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.134+0000 7f30121ed640 10 monclient: monmap: 2026-02-17T21:30:48.137 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:48.137 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.137 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:48.135892+0000 2026-02-17T21:30:48.137 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:48.135892+0000 2026-02-17T21:30:48.137 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:48.137 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.137 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:48.137 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:48.137 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:48.137 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:48.137 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:48.138 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:48.138 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.134+0000 7f30121ed640 1 Processor -- start 2026-02-17T21:30:48.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.134+0000 7f30121ed640 1 -- start start 2026-02-17T21:30:48.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.134+0000 7f30121ed640 10 monclient: init 2026-02-17T21:30:48.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.135+0000 7f30121ed640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:48.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.135+0000 7f30121ed640 10 monclient: _add_conns ranks=[2,4,0,1,3,5] 2026-02-17T21:30:48.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.135+0000 7f30121ed640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f300c0c7170 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:48.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.135+0000 7f30121ed640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f300c0c7550 0x7f300c0749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.135+0000 7f30121ed640 10 monclient(hunting): picked mon.noname-b con 0x7f300c0c7550 addr v2:10.20.193.119:3300/0 2026-02-17T21:30:48.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.135+0000 7f30121ed640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f300c074ef0 addr v1:10.20.193.5:6789/0 2026-02-17T21:30:48.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.135+0000 7f30121ed640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f300c0c4fd0 con 0x7f300c074ef0 2026-02-17T21:30:48.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.135+0000 7f30121ed640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f300c15a9a0 con 0x7f300c0c7170 2026-02-17T21:30:48.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.135+0000 7f30121ed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.135+0000 7f30121ed640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f300c0c8530 con 0x7f300c0c7550 2026-02-17T21:30:48.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.135+0000 7f30121ed640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:48.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.135+0000 7f30121ed640 10 monclient(hunting): authenticate will time out at 1353.701217s 2026-02-17T21:30:48.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.135+0000 7f300bfff640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f300c074ef0 0x7f300c0c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:39914/0 (socket says 10.20.193.5:39914) 2026-02-17T21:30:48.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.135+0000 7f300bfff640 1 -- 10.20.193.5:0/1690182061 learned_addr learned my addr 10.20.193.5:0/1690182061 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:48.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.135+0000 7f300affd640 1 --2- 10.20.193.5:0/1690182061 >> v2:10.20.193.119:3300/0 conn(0x7f300c0c7550 0x7f300c0749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.135+0000 7f300affd640 10 monclient(hunting): get_auth_request con 0x7f300c0c7550 auth_method 0 2026-02-17T21:30:48.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.136+0000 7f300affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:48.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.136+0000 7f300affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.136+0000 7f300affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.136+0000 7f300affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:48.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.136+0000 7f300affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:48.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.136+0000 7f300affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:48.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.137+0000 7f300a7fc640 1 -- 10.20.193.5:0/1690182061 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4291043394 0 0) 0x7f300c0c4fd0 con 0x7f300c074ef0 2026-02-17T21:30:48.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.137+0000 7f300a7fc640 10 monclient(hunting): _negotiate 2026-02-17T21:30:48.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.137+0000 7f300a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.137+0000 7f300a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.137+0000 7f300a7fc640 10 monclient(hunting): my global_id is 5202 2026-02-17T21:30:48.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.137+0000 7f300a7fc640 1 -- 10.20.193.5:0/1690182061 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ff0003620 con 0x7f300c074ef0 2026-02-17T21:30:48.144 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.137+0000 7f300a7fc640 1 -- 10.20.193.5:0/1690182061 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3632812948 0 0) 0x7f300c15a9a0 con 0x7f300c0c7170 2026-02-17T21:30:48.144 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.137+0000 7f300a7fc640 10 monclient(hunting): _negotiate 2026-02-17T21:30:48.144 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.137+0000 7f300a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.144 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.137+0000 7f300a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.144 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.137+0000 7f300a7fc640 10 monclient(hunting): my global_id is 5279 2026-02-17T21:30:48.144 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.137+0000 7f300a7fc640 1 -- 10.20.193.5:0/1690182061 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f300c0c4fd0 con 0x7f300c0c7170 2026-02-17T21:30:48.144 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.137+0000 7f300affd640 10 monclient(hunting): handle_auth_done global_id 5275 payload 274 2026-02-17T21:30:48.144 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.137+0000 7f300affd640 1 -- 10.20.193.5:0/1690182061 >> v1:10.20.193.135:6789/0 conn(0x7f300c0c7170 legacy=0x7f300c0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.144 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.137+0000 7f300affd640 1 -- 10.20.193.5:0/1690182061 >> v1:10.20.193.5:6789/0 conn(0x7f300c074ef0 legacy=0x7f300c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.144 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.137+0000 7f300affd640 10 monclient: _finish_hunting 0 2026-02-17T21:30:48.144 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.137+0000 7f300affd640 1 monclient: found mon.noname-b 2026-02-17T21:30:48.145 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.137+0000 7f300affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:48.145 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.137+0000 7f300affd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:30:48.145 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.137+0000 7f300affd640 1 -- 10.20.193.5:0/1690182061 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f300c0c5270 con 0x7f300c0c7550 2026-02-17T21:30:48.145 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.138+0000 7f300affd640 1 --2- 10.20.193.5:0/1690182061 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f300c0c7550 0x7f300c0749b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc0098a0 tx=0x7f2ffc02ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55940f6780afc8cc server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:48.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.140+0000 7f300a7fc640 1 -- 10.20.193.5:0/1690182061 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc03c070 con 0x7f300c0c7550 2026-02-17T21:30:48.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.140+0000 7f300a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:48.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.140+0000 7f300a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:30:48.152 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.140+0000 7f300a7fc640 10 monclient: dump: 2026-02-17T21:30:48.152 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:48.152 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.152 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.152 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.152 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:48.152 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.152 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:48.153 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:48.153 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:48.153 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.140+0000 7f300a7fc640 10 monclient: _finish_auth 0 2026-02-17T21:30:48.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.140+0000 7f300a7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:30:48.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.140+0000 7f300a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:48.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.140+0000 7f300a7fc640 1 -- 10.20.193.5:0/1690182061 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ffc02fb70 con 0x7f300c0c7550 2026-02-17T21:30:48.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.140+0000 7f300a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:48.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.140+0000 7f30121ed640 5 monclient: authenticate success, global_id 5275 2026-02-17T21:30:48.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.140+0000 7f300a7fc640 1 -- 10.20.193.5:0/1690182061 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc037440 con 0x7f300c0c7550 2026-02-17T21:30:48.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.140+0000 7f30121ed640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:48.153 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.140+0000 7f30121ed640 4 set_mon_vals no callback set 2026-02-17T21:30:48.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.140+0000 7f300a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:48.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.140+0000 7f300a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:30:48.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.140+0000 7f300a7fc640 10 monclient: dump: 2026-02-17T21:30:48.154 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:48.154 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.154 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.154 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.154 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:48.154 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.154 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:48.154 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:48.154 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:48.155 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.141+0000 7f30121ed640 10 monclient: shutdown 2026-02-17T21:30:48.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.141+0000 7f30121ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:48.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.141+0000 7f30121ed640 1 -- 10.20.193.5:0/1690182061 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f300c0c7550 msgr2=0x7f300c0749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.141+0000 7f30121ed640 1 --2- 10.20.193.5:0/1690182061 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f300c0c7550 0x7f300c0749b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc0098a0 tx=0x7f2ffc02ee60 comp rx=0 tx=0).stop 2026-02-17T21:30:48.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.141+0000 7f30121ed640 1 -- 10.20.193.5:0/1690182061 shutdown_connections 2026-02-17T21:30:48.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.141+0000 7f30121ed640 1 --2- 10.20.193.5:0/1690182061 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f300c0c7550 0x7f300c0749b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.141+0000 7f30121ed640 1 -- 10.20.193.5:0/1690182061 >> 10.20.193.5:0/1690182061 conn(0x7f300c0c9f40 msgr2=0x7f300c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:48.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.141+0000 7f30121ed640 1 -- 10.20.193.5:0/1690182061 shutdown_connections 2026-02-17T21:30:48.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.141+0000 7f30121ed640 1 -- 10.20.193.5:0/1690182061 wait complete. 2026-02-17T21:30:48.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.141+0000 7f30121ed640 10 monclient: build_initial_monmap 2026-02-17T21:30:48.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.141+0000 7f30121ed640 10 monclient: monmap: 2026-02-17T21:30:48.156 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:48.156 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:48.156 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:48.156 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:48.156 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:48.156 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.156 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:48.156 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:48.156 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:48.156 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.142+0000 7f30121ed640 1 librados: starting msgr at 2026-02-17T21:30:48.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.142+0000 7f30121ed640 1 librados: starting objecter 2026-02-17T21:30:48.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.142+0000 7f30121ed640 1 Processor -- start 2026-02-17T21:30:48.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.142+0000 7f30121ed640 1 -- start start 2026-02-17T21:30:48.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.142+0000 7f30121ed640 1 librados: setting wanted keys 2026-02-17T21:30:48.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.142+0000 7f30121ed640 1 librados: calling monclient init 2026-02-17T21:30:48.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.142+0000 7f30121ed640 10 monclient: init 2026-02-17T21:30:48.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.142+0000 7f30121ed640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:48.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.142+0000 7f30121ed640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:30:48.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.142+0000 7f30121ed640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f300c074ef0 0x7f300c0c38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.142+0000 7f30121ed640 10 monclient(hunting): picked mon.noname-c con 0x7f300c074ef0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:48.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.142+0000 7f30121ed640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f300c0c7170 0x7f300c1f47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.142+0000 7f30121ed640 10 monclient(hunting): picked mon.noname-b con 0x7f300c0c7170 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:48.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.142+0000 7f30121ed640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f300c0c7550 0x7f300c15dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.142+0000 7f30121ed640 10 monclient(hunting): picked mon.noname-a con 0x7f300c0c7550 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:48.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.142+0000 7f30121ed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.142+0000 7f30121ed640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f300c0c7ee0 con 0x7f300c0c7550 2026-02-17T21:30:48.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.142+0000 7f30121ed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.142+0000 7f30121ed640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f300c0c5830 con 0x7f300c0c7170 2026-02-17T21:30:48.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.142+0000 7f30121ed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.142+0000 7f30121ed640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f300c0c81c0 con 0x7f300c074ef0 2026-02-17T21:30:48.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.142+0000 7f30121ed640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:48.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.142+0000 7f30121ed640 10 monclient(hunting): authenticate will time out at 1353.708609s 2026-02-17T21:30:48.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.142+0000 7f300bfff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f300c0c7550 0x7f300c15dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.143+0000 7f300b7fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f300c074ef0 0x7f300c0c38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.143+0000 7f300affd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f300c0c7170 0x7f300c1f47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.143+0000 7f300bfff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f300c0c7550 0x7f300c15dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48286/0 (socket says 10.20.193.5:48286) 2026-02-17T21:30:48.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.143+0000 7f300bfff640 1 -- 10.20.193.5:0/3929485432 learned_addr learned my addr 10.20.193.5:0/3929485432 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:48.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.143+0000 7f300bfff640 10 monclient(hunting): get_auth_request con 0x7f300c0c7550 auth_method 0 2026-02-17T21:30:48.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.143+0000 7f300bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:48.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.143+0000 7f300bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.143+0000 7f300bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.143+0000 7f300b7fe640 10 monclient(hunting): get_auth_request con 0x7f300c074ef0 auth_method 0 2026-02-17T21:30:48.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.143+0000 7f300b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:48.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.143+0000 7f300b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.143+0000 7f300b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.143+0000 7f300affd640 10 monclient(hunting): get_auth_request con 0x7f300c0c7170 auth_method 0 2026-02-17T21:30:48.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.143+0000 7f300affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:48.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.143+0000 7f300affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.143+0000 7f300affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.143+0000 7f300bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:48.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.143+0000 7f300bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:48.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.143+0000 7f300bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:48.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.143+0000 7f300affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:48.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.143+0000 7f300affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:48.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.143+0000 7f300affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:48.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.143+0000 7f300b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:48.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.143+0000 7f300b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:48.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.143+0000 7f300b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:48.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.144+0000 7f300bfff640 10 monclient(hunting): handle_auth_done global_id 5205 payload 824 2026-02-17T21:30:48.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.144+0000 7f300bfff640 1 -- 10.20.193.5:0/3929485432 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f300c074ef0 msgr2=0x7f300c0c38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.144+0000 7f300bfff640 1 --2- 10.20.193.5:0/3929485432 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f300c074ef0 0x7f300c0c38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.144+0000 7f300bfff640 1 -- 10.20.193.5:0/3929485432 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f300c0c7170 msgr2=0x7f300c1f47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.144+0000 7f300bfff640 1 --2- 10.20.193.5:0/3929485432 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f300c0c7170 0x7f300c1f47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.144+0000 7f300bfff640 10 monclient: _finish_hunting 0 2026-02-17T21:30:48.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.144+0000 7f300bfff640 1 monclient: found mon.noname-a 2026-02-17T21:30:48.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.144+0000 7f300bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:48.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.144+0000 7f300bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:48.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.144+0000 7f300bfff640 1 -- 10.20.193.5:0/3929485432 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f300c15e230 con 0x7f300c0c7550 2026-02-17T21:30:48.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.145+0000 7f300bfff640 1 --2- 10.20.193.5:0/3929485432 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f300c0c7550 0x7f300c15dcf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f300000cb60 tx=0x7f300000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:48.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.145+0000 7f2fe7fff640 10 client.?.objecter ms_handle_connect 0x7f300c0c7550 2026-02-17T21:30:48.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.145+0000 7f2fe7fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:48.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.147+0000 7f2fe7fff640 1 -- 10.20.193.5:0/3929485432 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300000ad50 con 0x7f300c0c7550 2026-02-17T21:30:48.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.147+0000 7f2fe7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:48.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.147+0000 7f2fe7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:48.161 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.147+0000 7f2fe7fff640 10 monclient: dump: 2026-02-17T21:30:48.162 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:48.162 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.162 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.162 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.162 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:48.162 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.162 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:48.162 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:48.162 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:48.162 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.147+0000 7f2fe7fff640 10 monclient: _finish_auth 0 2026-02-17T21:30:48.162 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.147+0000 7f2fe7fff640 10 monclient: _check_auth_tickets 2026-02-17T21:30:48.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.147+0000 7f2fe7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:48.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.147+0000 7f30121ed640 5 monclient: authenticate success, global_id 5205 2026-02-17T21:30:48.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.147+0000 7f2fe7fff640 1 -- 10.20.193.5:0/3929485432 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3000012400 con 0x7f300c0c7550 2026-02-17T21:30:48.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.147+0000 7f30121ed640 10 monclient: _renew_subs 2026-02-17T21:30:48.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.147+0000 7f30121ed640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:48.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.147+0000 7f30121ed640 1 -- 10.20.193.5:0/3929485432 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f300c0c2540 con 0x7f300c0c7550 2026-02-17T21:30:48.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.147+0000 7f2fe7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:48.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.147+0000 7f2fe7fff640 1 -- 10.20.193.5:0/3929485432 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30000127f0 con 0x7f300c0c7550 2026-02-17T21:30:48.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.147+0000 7f2fe7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:48.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.147+0000 7f2fe7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:48.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.147+0000 7f3009ffb640 4 set_mon_vals no callback set 2026-02-17T21:30:48.163 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.147+0000 7f2fe7fff640 10 monclient: dump: 2026-02-17T21:30:48.163 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:48.164 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.164 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.164 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.164 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:48.164 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.164 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:48.164 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:48.164 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:48.164 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.147+0000 7f30121ed640 10 client.5205.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:48.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.147+0000 7f30121ed640 10 monclient: _renew_subs 2026-02-17T21:30:48.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.147+0000 7f30121ed640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:48.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.147+0000 7f30121ed640 1 -- 10.20.193.5:0/3929485432 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f300c0c2b00 con 0x7f300c0c7550 2026-02-17T21:30:48.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.147+0000 7f30121ed640 1 librados: init done 2026-02-17T21:30:48.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.148+0000 7f30121ed640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:48.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.148+0000 7f30121ed640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:48.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.148+0000 7f30121ed640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:48.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.148+0000 7f30121ed640 1 -- 10.20.193.5:0/3929485432 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f300c15a9a0 con 0x7f300c0c7550 2026-02-17T21:30:48.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.159+0000 7f2fe7fff640 1 -- 10.20.193.5:0/3929485432 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f3000012990 con 0x7f300c0c7550 2026-02-17T21:30:48.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.160+0000 7f2fe7fff640 1 --2- 10.20.193.5:0/3929485432 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2fdc079300 0x7f2fdc07b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.160+0000 7f300b7fe640 1 --2- 10.20.193.5:0/3929485432 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2fdc079300 0x7f2fdc07b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.160+0000 7f300b7fe640 10 monclient: get_auth_request con 0x7f2fdc079300 auth_method 0 2026-02-17T21:30:48.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.160+0000 7f300b7fe640 1 --2- 10.20.193.5:0/3929485432 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2fdc079300 0x7f2fdc07b7c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8007fd0 tx=0x7f2ff8003d90 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:48.166 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.160+0000 7f2fe7fff640 10 client.5205.objecter ms_handle_connect 0x7f2fdc079300 2026-02-17T21:30:48.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.263+0000 7f2fe7fff640 1 -- 10.20.193.5:0/3929485432 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f300005ebf0 con 0x7f300c0c7550 2026-02-17T21:30:48.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.263+0000 7f2fe7fff640 10 client.5205.objecter ms_dispatch2 0x7f300c000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:48.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.263+0000 7f2fe7fff640 3 client.5205.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:48.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.263+0000 7f2fe7fff640 3 client.5205.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:48.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.263+0000 7f2fe7fff640 20 client.5205.objecter dump_active .. 0 homeless 2026-02-17T21:30:48.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.263+0000 7f2fe7fff640 1 -- 10.20.193.5:0/3929485432 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3000062bb0 con 0x7f300c0c7550 2026-02-17T21:30:48.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.263+0000 7f2fe7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:48.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.263+0000 7f2fe7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:48.347 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.345+0000 7f30121ed640 1 -- 10.20.193.5:0/3929485432 --> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "13", "target": ["mon-mgr", ""]}) -- 0x7f300c153d00 con 0x7f2fdc079300 2026-02-17T21:30:48.348 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.345+0000 7f2fe7fff640 1 -- 10.20.193.5:0/3929485432 <== mgr.4131 v2:10.20.193.176:6800/2898618020 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 13 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7f300c153d00 con 0x7f2fdc079300 2026-02-17T21:30:48.348 INFO:teuthology.orchestra.run.trial005.stderr:instructed osd(s) 13 to deep-scrub 2026-02-17T21:30:48.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.346+0000 7f30121ed640 10 librados: watch_flush enter 2026-02-17T21:30:48.349 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.346+0000 7f30121ed640 10 librados: watch_flush exit 2026-02-17T21:30:48.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.346+0000 7f30121ed640 20 client.5205.objecter shutdown clearing up homeless session... 2026-02-17T21:30:48.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.346+0000 7f30121ed640 10 client.5205.objecter successfully canceled tick 2026-02-17T21:30:48.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.346+0000 7f30121ed640 1 -- 10.20.193.5:0/3929485432 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2fdc079300 msgr2=0x7f2fdc07b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.346+0000 7f30121ed640 1 --2- 10.20.193.5:0/3929485432 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2fdc079300 0x7f2fdc07b7c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8007fd0 tx=0x7f2ff8003d90 comp rx=0 tx=0).stop 2026-02-17T21:30:48.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.346+0000 7f30121ed640 10 monclient: shutdown 2026-02-17T21:30:48.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.346+0000 7f30121ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:48.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.346+0000 7f30121ed640 1 -- 10.20.193.5:0/3929485432 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f300c0c7550 msgr2=0x7f300c15dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.346+0000 7f30121ed640 1 --2- 10.20.193.5:0/3929485432 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f300c0c7550 0x7f300c15dcf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f300000cb60 tx=0x7f300000a430 comp rx=0 tx=0).stop 2026-02-17T21:30:48.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.346+0000 7f30121ed640 1 -- 10.20.193.5:0/3929485432 shutdown_connections 2026-02-17T21:30:48.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.346+0000 7f30121ed640 1 --2- 10.20.193.5:0/3929485432 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2fdc079300 0x7f2fdc07b7c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.350 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.346+0000 7f30121ed640 1 --2- 10.20.193.5:0/3929485432 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f300c0c7550 0x7f300c15dcf0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.346+0000 7f30121ed640 1 --2- 10.20.193.5:0/3929485432 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f300c0c7170 0x7f300c1f47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.346+0000 7f30121ed640 1 --2- 10.20.193.5:0/3929485432 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f300c074ef0 0x7f300c0c38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.346+0000 7f30121ed640 1 -- 10.20.193.5:0/3929485432 >> 10.20.193.5:0/3929485432 conn(0x7f300c0c9f40 msgr2=0x7f300c0725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:48.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.346+0000 7f30121ed640 1 -- 10.20.193.5:0/3929485432 shutdown_connections 2026-02-17T21:30:48.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.346+0000 7f30121ed640 1 -- 10.20.193.5:0/3929485432 wait complete. 2026-02-17T21:30:48.351 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.346+0000 7f30121ed640 1 librados: shutdown 2026-02-17T21:30:48.357 INFO:tasks.ceph:Scrubbing osd.2 2026-02-17T21:30:48.357 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:30:48.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.425+0000 7fe0ed65d640 10 monclient: get_monmap_and_config 2026-02-17T21:30:48.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.425+0000 7fe0ed65d640 10 monclient: build_initial_monmap 2026-02-17T21:30:48.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.425+0000 7fe0ed65d640 10 monclient: monmap: 2026-02-17T21:30:48.427 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:48.427 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.427 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:48.426783+0000 2026-02-17T21:30:48.427 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:48.426783+0000 2026-02-17T21:30:48.427 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:48.427 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.427 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:48.427 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:48.427 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:48.427 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:48.427 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:48.427 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:48.427 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.425+0000 7fe0ed65d640 1 Processor -- start 2026-02-17T21:30:48.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.425+0000 7fe0ed65d640 1 -- start start 2026-02-17T21:30:48.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.425+0000 7fe0ed65d640 10 monclient: init 2026-02-17T21:30:48.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.426+0000 7fe0ed65d640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:48.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.426+0000 7fe0ed65d640 10 monclient: _add_conns ranks=[1,3,0,5,2,4] 2026-02-17T21:30:48.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.426+0000 7fe0ed65d640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fe0e8153930 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:48.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.426+0000 7fe0ed65d640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fe0e8153d10 0x7fe0e80c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.426+0000 7fe0ed65d640 10 monclient(hunting): picked mon.noname-a con 0x7fe0e8153d10 addr v2:10.20.193.5:3300/0 2026-02-17T21:30:48.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.426+0000 7fe0ed65d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe0e80c52d0 addr v1:10.20.193.5:6789/0 2026-02-17T21:30:48.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.426+0000 7fe0ed65d640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0e80c85a0 con 0x7fe0e80c52d0 2026-02-17T21:30:48.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.426+0000 7fe0ed65d640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0e80c8880 con 0x7fe0e8153930 2026-02-17T21:30:48.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.426+0000 7fe0ed65d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.426+0000 7fe0ed65d640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe0e80c8380 con 0x7fe0e8153d10 2026-02-17T21:30:48.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.426+0000 7fe0ed65d640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:48.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.426+0000 7fe0ed65d640 10 monclient(hunting): authenticate will time out at 1353.992325s 2026-02-17T21:30:48.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.426+0000 7fe0e67fc640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fe0e8153d10 0x7fe0e80c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.426+0000 7fe0e6ffd640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7fe0e8153930 0x7fe0e815b070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:41136/0 (socket says 10.20.193.5:41136) 2026-02-17T21:30:48.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.426+0000 7fe0e6ffd640 1 -- 10.20.193.5:0/166105105 learned_addr learned my addr 10.20.193.5:0/166105105 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:48.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.427+0000 7fe0e67fc640 10 monclient(hunting): get_auth_request con 0x7fe0e8153d10 auth_method 0 2026-02-17T21:30:48.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.427+0000 7fe0e67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:48.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.427+0000 7fe0e67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.427+0000 7fe0e67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.427+0000 7fe0e67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:48.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.427+0000 7fe0e67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:48.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.427+0000 7fe0e67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:48.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.428+0000 7fe0e5ffb640 1 -- 10.20.193.5:0/166105105 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2073914844 0 0) 0x7fe0e80c8880 con 0x7fe0e8153930 2026-02-17T21:30:48.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.428+0000 7fe0e5ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:30:48.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.428+0000 7fe0e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.428+0000 7fe0e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.428+0000 7fe0e5ffb640 10 monclient(hunting): my global_id is 5281 2026-02-17T21:30:48.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.428+0000 7fe0e5ffb640 1 -- 10.20.193.5:0/166105105 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0d4003620 con 0x7fe0e8153930 2026-02-17T21:30:48.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.428+0000 7fe0e67fc640 10 monclient(hunting): handle_auth_done global_id 5208 payload 274 2026-02-17T21:30:48.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.429+0000 7fe0e67fc640 1 -- 10.20.193.5:0/166105105 >> v1:10.20.193.119:6789/0 conn(0x7fe0e8153930 legacy=0x7fe0e815b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.429+0000 7fe0e67fc640 1 -- 10.20.193.5:0/166105105 >> v1:10.20.193.5:6789/0 conn(0x7fe0e80c52d0 legacy=0x7fe0e815d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.429+0000 7fe0e67fc640 10 monclient: _finish_hunting 0 2026-02-17T21:30:48.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.429+0000 7fe0e67fc640 1 monclient: found mon.noname-a 2026-02-17T21:30:48.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.429+0000 7fe0e67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:48.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.429+0000 7fe0e67fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:48.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.429+0000 7fe0e67fc640 1 -- 10.20.193.5:0/166105105 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e80c8b60 con 0x7fe0e8153d10 2026-02-17T21:30:48.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.431+0000 7fe0e67fc640 1 --2- 10.20.193.5:0/166105105 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe0e8153d10 0x7fe0e80c7e40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe0d00098a0 tx=0x7fe0d002ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cad5ea4c18d92d4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:48.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.433+0000 7fe0e5ffb640 1 -- 10.20.193.5:0/166105105 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d003c070 con 0x7fe0e8153d10 2026-02-17T21:30:48.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.433+0000 7fe0e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:48.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.433+0000 7fe0e5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:48.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.433+0000 7fe0e5ffb640 10 monclient: dump: 2026-02-17T21:30:48.435 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:48.435 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.435 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.435 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.435 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:48.435 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.435 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:48.435 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.433+0000 7fe0e5ffb640 10 monclient: _finish_auth 0 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.433+0000 7fe0e5ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.433+0000 7fe0e5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.433+0000 7fe0e5ffb640 1 -- 10.20.193.5:0/166105105 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d002fb70 con 0x7fe0e8153d10 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.433+0000 7fe0e5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.433+0000 7fe0ed65d640 5 monclient: authenticate success, global_id 5208 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.433+0000 7fe0e5ffb640 1 -- 10.20.193.5:0/166105105 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0037440 con 0x7fe0e8153d10 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.433+0000 7fe0ed65d640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.433+0000 7fe0ed65d640 4 set_mon_vals no callback set 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.433+0000 7fe0e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.433+0000 7fe0e5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.433+0000 7fe0e5ffb640 10 monclient: dump: 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.433+0000 7fe0ed65d640 10 monclient: shutdown 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.433+0000 7fe0ed65d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.433+0000 7fe0ed65d640 1 -- 10.20.193.5:0/166105105 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe0e8153d10 msgr2=0x7fe0e80c7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.433+0000 7fe0ed65d640 1 --2- 10.20.193.5:0/166105105 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe0e8153d10 0x7fe0e80c7e40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe0d00098a0 tx=0x7fe0d002ee60 comp rx=0 tx=0).stop 2026-02-17T21:30:48.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.433+0000 7fe0ed65d640 1 -- 10.20.193.5:0/166105105 shutdown_connections 2026-02-17T21:30:48.437 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.433+0000 7fe0ed65d640 1 --2- 10.20.193.5:0/166105105 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe0e8153d10 0x7fe0e80c7e40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.441 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.433+0000 7fe0ed65d640 1 -- 10.20.193.5:0/166105105 >> 10.20.193.5:0/166105105 conn(0x7fe0e80c9f40 msgr2=0x7fe0e80ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:48.441 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.433+0000 7fe0ed65d640 1 -- 10.20.193.5:0/166105105 shutdown_connections 2026-02-17T21:30:48.441 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.433+0000 7fe0ed65d640 1 -- 10.20.193.5:0/166105105 wait complete. 2026-02-17T21:30:48.441 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.434+0000 7fe0ed65d640 10 monclient: build_initial_monmap 2026-02-17T21:30:48.441 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.434+0000 7fe0ed65d640 10 monclient: monmap: 2026-02-17T21:30:48.441 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:48.441 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:48.441 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:48.441 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:48.441 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:48.442 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.442 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:48.442 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:48.442 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:48.442 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.434+0000 7fe0ed65d640 1 librados: starting msgr at 2026-02-17T21:30:48.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.434+0000 7fe0ed65d640 1 librados: starting objecter 2026-02-17T21:30:48.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.434+0000 7fe0ed65d640 1 Processor -- start 2026-02-17T21:30:48.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.434+0000 7fe0ed65d640 1 -- start start 2026-02-17T21:30:48.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.434+0000 7fe0ed65d640 1 librados: setting wanted keys 2026-02-17T21:30:48.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.434+0000 7fe0ed65d640 1 librados: calling monclient init 2026-02-17T21:30:48.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.434+0000 7fe0ed65d640 10 monclient: init 2026-02-17T21:30:48.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.434+0000 7fe0ed65d640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:48.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.434+0000 7fe0ed65d640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:30:48.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.434+0000 7fe0ed65d640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe0e80c52d0 0x7fe0e80cc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.434+0000 7fe0ed65d640 10 monclient(hunting): picked mon.noname-b con 0x7fe0e80c52d0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:48.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.434+0000 7fe0ed65d640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe0e8153930 0x7fe0e814de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.434+0000 7fe0ed65d640 10 monclient(hunting): picked mon.noname-c con 0x7fe0e8153930 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:48.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.434+0000 7fe0ed65d640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe0e8153d10 0x7fe0e814e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.434+0000 7fe0ed65d640 10 monclient(hunting): picked mon.noname-a con 0x7fe0e8153d10 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:48.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.434+0000 7fe0ed65d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.434+0000 7fe0ed65d640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e80c9120 con 0x7fe0e8153d10 2026-02-17T21:30:48.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.434+0000 7fe0ed65d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.443 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.434+0000 7fe0ed65d640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e80c9490 con 0x7fe0e80c52d0 2026-02-17T21:30:48.444 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.434+0000 7fe0ed65d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.444 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.434+0000 7fe0ed65d640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e80c7730 con 0x7fe0e8153930 2026-02-17T21:30:48.444 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.434+0000 7fe0ed65d640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:48.444 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.434+0000 7fe0ed65d640 10 monclient(hunting): authenticate will time out at 1354.000713s 2026-02-17T21:30:48.444 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e77fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe0e8153d10 0x7fe0e814e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.444 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e6ffd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe0e80c52d0 0x7fe0e80cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.444 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e77fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe0e8153d10 0x7fe0e814e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48304/0 (socket says 10.20.193.5:48304) 2026-02-17T21:30:48.444 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e77fe640 1 -- 10.20.193.5:0/3444001604 learned_addr learned my addr 10.20.193.5:0/3444001604 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:48.444 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e77fe640 10 monclient(hunting): get_auth_request con 0x7fe0e8153d10 auth_method 0 2026-02-17T21:30:48.444 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:48.444 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e67fc640 1 --2- 10.20.193.5:0/3444001604 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe0e8153930 0x7fe0e814de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e6ffd640 10 monclient(hunting): get_auth_request con 0x7fe0e80c52d0 auth_method 0 2026-02-17T21:30:48.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:48.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:48.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:48.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:48.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e67fc640 10 monclient(hunting): get_auth_request con 0x7fe0e8153930 auth_method 0 2026-02-17T21:30:48.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:48.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.445 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:48.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:48.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:48.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:48.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:48.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.435+0000 7fe0e67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:48.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.437+0000 7fe0e6ffd640 10 monclient(hunting): handle_auth_done global_id 5284 payload 824 2026-02-17T21:30:48.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.437+0000 7fe0e6ffd640 1 -- 10.20.193.5:0/3444001604 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe0e8153930 msgr2=0x7fe0e814de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.437+0000 7fe0e6ffd640 1 --2- 10.20.193.5:0/3444001604 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe0e8153930 0x7fe0e814de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.437+0000 7fe0e6ffd640 1 -- 10.20.193.5:0/3444001604 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe0e8153d10 msgr2=0x7fe0e814e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.437+0000 7fe0e6ffd640 1 --2- 10.20.193.5:0/3444001604 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe0e8153d10 0x7fe0e814e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.446 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.437+0000 7fe0e6ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:30:48.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.437+0000 7fe0e6ffd640 1 monclient: found mon.noname-b 2026-02-17T21:30:48.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.437+0000 7fe0e6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:48.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.437+0000 7fe0e6ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:30:48.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.437+0000 7fe0e6ffd640 1 -- 10.20.193.5:0/3444001604 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e8155470 con 0x7fe0e80c52d0 2026-02-17T21:30:48.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.438+0000 7fe0e6ffd640 1 --2- 10.20.193.5:0/3444001604 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe0e80c52d0 0x7fe0e80cc690 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00c500 tx=0x7fe0dc00c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:48.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.438+0000 7fe0c77fe640 10 client.?.objecter ms_handle_connect 0x7fe0e80c52d0 2026-02-17T21:30:48.447 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.438+0000 7fe0c77fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:48.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0c77fe640 1 -- 10.20.193.5:0/3444001604 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc017070 con 0x7fe0e80c52d0 2026-02-17T21:30:48.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0c77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:48.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0c77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:30:48.450 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0c77fe640 10 monclient: dump: 2026-02-17T21:30:48.450 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:48.450 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.450 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.450 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.450 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:48.450 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.450 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:48.450 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:48.450 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:48.450 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0c77fe640 10 monclient: _finish_auth 0 2026-02-17T21:30:48.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0c77fe640 10 monclient: _check_auth_tickets 2026-02-17T21:30:48.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0c77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:48.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0c77fe640 1 -- 10.20.193.5:0/3444001604 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0dc005de0 con 0x7fe0e80c52d0 2026-02-17T21:30:48.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0ed65d640 5 monclient: authenticate success, global_id 5284 2026-02-17T21:30:48.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0ed65d640 10 monclient: _renew_subs 2026-02-17T21:30:48.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0ed65d640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:48.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0ed65d640 1 -- 10.20.193.5:0/3444001604 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e81548f0 con 0x7fe0e80c52d0 2026-02-17T21:30:48.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0c77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:48.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0c77fe640 1 -- 10.20.193.5:0/3444001604 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc007270 con 0x7fe0e80c52d0 2026-02-17T21:30:48.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0c77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:48.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0e57fa640 4 set_mon_vals no callback set 2026-02-17T21:30:48.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0c77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:30:48.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0c77fe640 10 monclient: dump: 2026-02-17T21:30:48.452 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:48.452 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.452 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.452 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.452 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:48.452 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.452 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:48.452 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:48.452 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:48.452 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0ed65d640 10 client.5284.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:48.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0ed65d640 10 monclient: _renew_subs 2026-02-17T21:30:48.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0ed65d640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:48.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0ed65d640 1 -- 10.20.193.5:0/3444001604 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e8154eb0 con 0x7fe0e80c52d0 2026-02-17T21:30:48.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0ed65d640 1 librados: init done 2026-02-17T21:30:48.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0ed65d640 10 client.5284.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:48.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0ed65d640 15 client.5284.objecter _session_command_op_assign -1 1 2026-02-17T21:30:48.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0ed65d640 20 client.5284.objecter _get_session osd=-1 returning homeless 2026-02-17T21:30:48.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0ed65d640 10 client.5284.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:48.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0ed65d640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:48.453 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.440+0000 7fe0ed65d640 1 -- 10.20.193.5:0/3444001604 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe0e80c7e40 con 0x7fe0e80c52d0 2026-02-17T21:30:48.454 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.451+0000 7fe0c77fe640 1 -- 10.20.193.5:0/3444001604 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fe0dc007410 con 0x7fe0e80c52d0 2026-02-17T21:30:48.454 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.451+0000 7fe0c77fe640 1 --2- 10.20.193.5:0/3444001604 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe0b40792d0 0x7fe0b407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.454 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.452+0000 7fe0e67fc640 1 --2- 10.20.193.5:0/3444001604 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe0b40792d0 0x7fe0b407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.454 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.452+0000 7fe0e67fc640 10 monclient: get_auth_request con 0x7fe0b40792d0 auth_method 0 2026-02-17T21:30:48.455 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.452+0000 7fe0c77fe640 10 client.5284.objecter ms_handle_connect 0x7fe0b40792d0 2026-02-17T21:30:48.455 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.452+0000 7fe0e67fc640 1 --2- 10.20.193.5:0/3444001604 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe0b40792d0 0x7fe0b407b790 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0039000 tx=0x7fe0d0033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:48.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.454+0000 7fe0c77fe640 1 -- 10.20.193.5:0/3444001604 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fe0dc007730 con 0x7fe0e80c52d0 2026-02-17T21:30:48.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.454+0000 7fe0c77fe640 10 client.5284.objecter ms_dispatch2 0x7fe0e8000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:48.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.454+0000 7fe0c77fe640 3 client.5284.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:48.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.454+0000 7fe0c77fe640 3 client.5284.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:48.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.454+0000 7fe0c77fe640 10 client.5284.objecter checking command 1 2026-02-17T21:30:48.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.454+0000 7fe0c77fe640 1 --2- 10.20.193.5:0/3444001604 >> [v2:10.20.193.135:6824/692096764,v1:10.20.193.135:6825/692096764] conn(0x7fe0b4081810 0x7fe0b4083c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.454+0000 7fe0c77fe640 20 client.5284.objecter _get_session s=0x7fe0b4081140 osd=2 3 2026-02-17T21:30:48.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.454+0000 7fe0c77fe640 20 client.5284.objecter put_session s=0x7fe0b4081140 osd=2 3 2026-02-17T21:30:48.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.454+0000 7fe0c77fe640 15 client.5284.objecter _session_command_op_remove -1 1 2026-02-17T21:30:48.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.454+0000 7fe0c77fe640 20 client.5284.objecter _get_session s=0x7fe0b4081140 osd=2 3 2026-02-17T21:30:48.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.454+0000 7fe0c77fe640 20 client.5284.objecter get_session s=0x7fe0b4081140 osd=2 3 2026-02-17T21:30:48.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.454+0000 7fe0c77fe640 15 client.5284.objecter _session_command_op_assign 2 1 2026-02-17T21:30:48.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.454+0000 7fe0c77fe640 20 client.5284.objecter put_session s=0x7fe0b4081140 osd=2 4 2026-02-17T21:30:48.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.454+0000 7fe0c77fe640 10 client.5284.objecter _send_command 1 2026-02-17T21:30:48.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.454+0000 7fe0c77fe640 1 -- 10.20.193.5:0/3444001604 --> [v2:10.20.193.135:6824/692096764,v1:10.20.193.135:6825/692096764] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe0dc021e50 con 0x7fe0b4081810 2026-02-17T21:30:48.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.454+0000 7fe0c77fe640 20 client.5284.objecter dump_active .. 0 homeless 2026-02-17T21:30:48.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.454+0000 7fe0e77fe640 1 --2- 10.20.193.5:0/3444001604 >> [v2:10.20.193.135:6824/692096764,v1:10.20.193.135:6825/692096764] conn(0x7fe0b4081810 0x7fe0b4083c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.455+0000 7fe0e77fe640 10 monclient: get_auth_request con 0x7fe0b4081810 auth_method 0 2026-02-17T21:30:48.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.455+0000 7fe0c77fe640 1 -- 10.20.193.5:0/3444001604 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe0dc05d3e0 con 0x7fe0e80c52d0 2026-02-17T21:30:48.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.455+0000 7fe0c77fe640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T21:30:48.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.456+0000 7fe0e77fe640 1 --2- 10.20.193.5:0/3444001604 >> [v2:10.20.193.135:6824/692096764,v1:10.20.193.135:6825/692096764] conn(0x7fe0b4081810 0x7fe0b4083c30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:48.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.456+0000 7fe0c77fe640 10 client.5284.objecter ms_handle_connect 0x7fe0b4081810 2026-02-17T21:30:48.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.467+0000 7fe0c77fe640 1 -- 10.20.193.5:0/3444001604 <== osd.2 v2:10.20.193.135:6824/692096764 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fe0dc021e50 con 0x7fe0b4081810 2026-02-17T21:30:48.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.467+0000 7fe0c77fe640 10 client.5284.objecter ms_dispatch2 0x7fe0e8000b90 command_reply(tid 1: 0 ) 2026-02-17T21:30:48.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.467+0000 7fe0c77fe640 10 client.5284.objecter _finish_command 1 = system:0 2026-02-17T21:30:48.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.467+0000 7fe0c77fe640 20 client.5284.objecter put_session s=0x7fe0b4081140 osd=2 4 2026-02-17T21:30:48.469 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.467+0000 7fe0c77fe640 15 client.5284.objecter _session_command_op_remove 2 1 2026-02-17T21:30:48.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.473+0000 7fe0ed65d640 10 client.5284.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:30:48.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.473+0000 7fe0ed65d640 15 client.5284.objecter _session_command_op_assign -1 2 2026-02-17T21:30:48.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.473+0000 7fe0ed65d640 20 client.5284.objecter _get_session s=0x7fe0b4081140 osd=2 3 2026-02-17T21:30:48.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.473+0000 7fe0ed65d640 20 client.5284.objecter put_session s=0x7fe0b4081140 osd=2 3 2026-02-17T21:30:48.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.473+0000 7fe0ed65d640 20 client.5284.objecter _get_session s=0x7fe0b4081140 osd=2 3 2026-02-17T21:30:48.475 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.473+0000 7fe0ed65d640 15 client.5284.objecter _session_command_op_remove -1 2 2026-02-17T21:30:48.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.473+0000 7fe0ed65d640 20 client.5284.objecter get_session s=0x7fe0b4081140 osd=2 3 2026-02-17T21:30:48.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.473+0000 7fe0ed65d640 15 client.5284.objecter _session_command_op_assign 2 2 2026-02-17T21:30:48.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.473+0000 7fe0ed65d640 20 client.5284.objecter put_session s=0x7fe0b4081140 osd=2 4 2026-02-17T21:30:48.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.473+0000 7fe0ed65d640 10 client.5284.objecter _send_command 2 2026-02-17T21:30:48.476 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.473+0000 7fe0ed65d640 1 -- 10.20.193.5:0/3444001604 --> [v2:10.20.193.135:6824/692096764,v1:10.20.193.135:6825/692096764] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe0e814d780 con 0x7fe0b4081810 2026-02-17T21:30:48.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.479+0000 7fe0c77fe640 1 -- 10.20.193.5:0/3444001604 <== osd.2 v2:10.20.193.135:6824/692096764 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe0e814d780 con 0x7fe0b4081810 2026-02-17T21:30:48.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.479+0000 7fe0c77fe640 10 client.5284.objecter ms_dispatch2 0x7fe0e8000b90 command_reply(tid 2: 0 ) 2026-02-17T21:30:48.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.479+0000 7fe0c77fe640 10 client.5284.objecter _finish_command 2 = system:0 2026-02-17T21:30:48.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.479+0000 7fe0c77fe640 20 client.5284.objecter put_session s=0x7fe0b4081140 osd=2 4 2026-02-17T21:30:48.482 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.479+0000 7fe0c77fe640 15 client.5284.objecter _session_command_op_remove 2 2 2026-02-17T21:30:48.482 INFO:teuthology.orchestra.run.trial005.stdout:{ 2026-02-17T21:30:48.483 INFO:teuthology.orchestra.run.trial005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:30:48.483 INFO:teuthology.orchestra.run.trial005.stdout:} 2026-02-17T21:30:48.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.479+0000 7fe0ed65d640 10 librados: watch_flush enter 2026-02-17T21:30:48.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.479+0000 7fe0ed65d640 10 librados: watch_flush exit 2026-02-17T21:30:48.484 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.479+0000 7fe0ed65d640 10 client.5284.objecter close_session for osd.2 2026-02-17T21:30:48.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.479+0000 7fe0ed65d640 1 -- 10.20.193.5:0/3444001604 >> [v2:10.20.193.135:6824/692096764,v1:10.20.193.135:6825/692096764] conn(0x7fe0b4081810 msgr2=0x7fe0b4083c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.479+0000 7fe0ed65d640 1 --2- 10.20.193.5:0/3444001604 >> [v2:10.20.193.135:6824/692096764,v1:10.20.193.135:6825/692096764] conn(0x7fe0b4081810 0x7fe0b4083c30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.480+0000 7fe0ed65d640 20 client.5284.objecter put_session s=0x7fe0b4081140 osd=2 1 2026-02-17T21:30:48.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.480+0000 7fe0ed65d640 20 client.5284.objecter shutdown clearing up homeless session... 2026-02-17T21:30:48.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.480+0000 7fe0ed65d640 10 client.5284.objecter successfully canceled tick 2026-02-17T21:30:48.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.480+0000 7fe0ed65d640 1 -- 10.20.193.5:0/3444001604 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe0b40792d0 msgr2=0x7fe0b407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.480+0000 7fe0ed65d640 1 --2- 10.20.193.5:0/3444001604 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe0b40792d0 0x7fe0b407b790 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0039000 tx=0x7fe0d0033000 comp rx=0 tx=0).stop 2026-02-17T21:30:48.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.480+0000 7fe0ed65d640 10 monclient: shutdown 2026-02-17T21:30:48.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.480+0000 7fe0ed65d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:48.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.480+0000 7fe0ed65d640 1 -- 10.20.193.5:0/3444001604 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe0e80c52d0 msgr2=0x7fe0e80cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.485 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.480+0000 7fe0ed65d640 1 --2- 10.20.193.5:0/3444001604 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe0e80c52d0 0x7fe0e80cc690 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00c500 tx=0x7fe0dc00c9d0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.480+0000 7fe0e77fe640 1 -- 10.20.193.5:0/3444001604 reap_dead start 2026-02-17T21:30:48.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.480+0000 7fe0ed65d640 1 -- 10.20.193.5:0/3444001604 shutdown_connections 2026-02-17T21:30:48.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.480+0000 7fe0ed65d640 1 -- 10.20.193.5:0/3444001604 >> 10.20.193.5:0/3444001604 conn(0x7fe0e80c9f40 msgr2=0x7fe0e815b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:48.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.480+0000 7fe0ed65d640 1 -- 10.20.193.5:0/3444001604 shutdown_connections 2026-02-17T21:30:48.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.480+0000 7fe0ed65d640 1 -- 10.20.193.5:0/3444001604 wait complete. 2026-02-17T21:30:48.486 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.480+0000 7fe0ed65d640 1 librados: shutdown 2026-02-17T21:30:48.490 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-17T21:30:48.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.555+0000 7f06befb3640 10 monclient: get_monmap_and_config 2026-02-17T21:30:48.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.555+0000 7f06befb3640 10 monclient: build_initial_monmap 2026-02-17T21:30:48.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.555+0000 7f06befb3640 10 monclient: monmap: 2026-02-17T21:30:48.558 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:48.558 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.558 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:48.557272+0000 2026-02-17T21:30:48.558 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:48.557272+0000 2026-02-17T21:30:48.558 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:48.558 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.559 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:48.559 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:48.559 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:48.559 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:48.559 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:48.559 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:48.559 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.556+0000 7f06befb3640 1 Processor -- start 2026-02-17T21:30:48.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.556+0000 7f06befb3640 1 -- start start 2026-02-17T21:30:48.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.556+0000 7f06befb3640 10 monclient: init 2026-02-17T21:30:48.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.556+0000 7f06befb3640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:48.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.556+0000 7f06befb3640 10 monclient: _add_conns ranks=[1,5,0,4,3,2] 2026-02-17T21:30:48.562 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.556+0000 7f06befb3640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f06b80c7170 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:48.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.556+0000 7f06befb3640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f06b80c7550 0x7f06b80749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.556+0000 7f06befb3640 10 monclient(hunting): picked mon.noname-c con 0x7f06b80c7550 addr v2:10.20.193.135:3300/0 2026-02-17T21:30:48.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.556+0000 7f06befb3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f06b8074ef0 addr v1:10.20.193.5:6789/0 2026-02-17T21:30:48.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.556+0000 7f06befb3640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b80c4fd0 con 0x7f06b8074ef0 2026-02-17T21:30:48.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.556+0000 7f06befb3640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b815a9a0 con 0x7f06b80c7170 2026-02-17T21:30:48.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.556+0000 7f06befb3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.556+0000 7f06befb3640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f06b80c8530 con 0x7f06b80c7550 2026-02-17T21:30:48.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.556+0000 7f06befb3640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:48.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.556+0000 7f06befb3640 10 monclient(hunting): authenticate will time out at 1354.122668s 2026-02-17T21:30:48.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.557+0000 7f06bd529640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f06b8074ef0 0x7f06b80c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:39924/0 (socket says 10.20.193.5:39924) 2026-02-17T21:30:48.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.557+0000 7f06bd529640 1 -- 10.20.193.5:0/3687743637 learned_addr learned my addr 10.20.193.5:0/3687743637 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:48.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.557+0000 7f06affff640 1 --2- 10.20.193.5:0/3687743637 >> v2:10.20.193.135:3300/0 conn(0x7f06b80c7550 0x7f06b80749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.557+0000 7f06affff640 10 monclient(hunting): get_auth_request con 0x7f06b80c7550 auth_method 0 2026-02-17T21:30:48.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.557+0000 7f06affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:48.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.557+0000 7f06affff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.557+0000 7f06affff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.557+0000 7f06affff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:48.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.557+0000 7f06affff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:48.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.557+0000 7f06affff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:48.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.558+0000 7f06af7fe640 1 -- 10.20.193.5:0/3687743637 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2882168946 0 0) 0x7f06b815a9a0 con 0x7f06b80c7170 2026-02-17T21:30:48.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.558+0000 7f06af7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:30:48.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.558+0000 7f06af7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.558+0000 7f06af7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.558+0000 7f06af7fe640 10 monclient(hunting): my global_id is 5287 2026-02-17T21:30:48.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.558+0000 7f06af7fe640 1 -- 10.20.193.5:0/3687743637 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06a4003620 con 0x7f06b80c7170 2026-02-17T21:30:48.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.558+0000 7f06affff640 10 monclient(hunting): handle_auth_done global_id 5288 payload 274 2026-02-17T21:30:48.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.558+0000 7f06affff640 1 -- 10.20.193.5:0/3687743637 >> v1:10.20.193.119:6789/0 conn(0x7f06b80c7170 legacy=0x7f06b80c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.558+0000 7f06affff640 1 -- 10.20.193.5:0/3687743637 >> v1:10.20.193.5:6789/0 conn(0x7f06b8074ef0 legacy=0x7f06b80c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.558+0000 7f06af7fe640 1 -- 10.20.193.5:0/3687743637 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1847351070 0 0) 0x7f06b80c4fd0 con 0x7f06b8074ef0 2026-02-17T21:30:48.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.558+0000 7f06affff640 10 monclient: _finish_hunting 0 2026-02-17T21:30:48.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.558+0000 7f06affff640 1 monclient: found mon.noname-c 2026-02-17T21:30:48.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.558+0000 7f06affff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:48.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.558+0000 7f06affff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:48.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.558+0000 7f06affff640 1 -- 10.20.193.5:0/3687743637 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b80c5270 con 0x7f06b80c7550 2026-02-17T21:30:48.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.558+0000 7f06af7fe640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-17T21:30:48.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.559+0000 7f06affff640 1 --2- 10.20.193.5:0/3687743637 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f06b80c7550 0x7f06b80749b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f06a00098a0 tx=0x7f06a002ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97600494641bb73e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:48.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.561+0000 7f06af7fe640 1 -- 10.20.193.5:0/3687743637 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a003c070 con 0x7f06b80c7550 2026-02-17T21:30:48.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.561+0000 7f06af7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:48.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.561+0000 7f06af7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:48.572 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.561+0000 7f06af7fe640 10 monclient: dump: 2026-02-17T21:30:48.573 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:48.573 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.573 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.573 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.573 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:48.573 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.573 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:48.573 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:48.573 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:48.573 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.573 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.561+0000 7f06af7fe640 10 monclient: _finish_auth 0 2026-02-17T21:30:48.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.561+0000 7f06af7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:30:48.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.561+0000 7f06af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:48.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.561+0000 7f06af7fe640 1 -- 10.20.193.5:0/3687743637 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06a002fb70 con 0x7f06b80c7550 2026-02-17T21:30:48.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.561+0000 7f06af7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:48.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.561+0000 7f06befb3640 5 monclient: authenticate success, global_id 5288 2026-02-17T21:30:48.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.561+0000 7f06af7fe640 1 -- 10.20.193.5:0/3687743637 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a0037440 con 0x7f06b80c7550 2026-02-17T21:30:48.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.561+0000 7f06befb3640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:48.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.561+0000 7f06befb3640 4 set_mon_vals no callback set 2026-02-17T21:30:48.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.561+0000 7f06af7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:48.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.561+0000 7f06af7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:48.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.561+0000 7f06af7fe640 10 monclient: dump: 2026-02-17T21:30:48.574 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:48.575 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.575 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.575 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.575 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:48.575 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.575 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:48.575 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:48.575 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:48.575 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.561+0000 7f06befb3640 10 monclient: shutdown 2026-02-17T21:30:48.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.561+0000 7f06befb3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:48.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.561+0000 7f06befb3640 1 -- 10.20.193.5:0/3687743637 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f06b80c7550 msgr2=0x7f06b80749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.575 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.561+0000 7f06befb3640 1 --2- 10.20.193.5:0/3687743637 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f06b80c7550 0x7f06b80749b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f06a00098a0 tx=0x7f06a002ee60 comp rx=0 tx=0).stop 2026-02-17T21:30:48.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.561+0000 7f06befb3640 1 -- 10.20.193.5:0/3687743637 shutdown_connections 2026-02-17T21:30:48.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.561+0000 7f06befb3640 1 --2- 10.20.193.5:0/3687743637 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f06b80c7550 0x7f06b80749b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.561+0000 7f06befb3640 1 -- 10.20.193.5:0/3687743637 >> 10.20.193.5:0/3687743637 conn(0x7f06b80c9f40 msgr2=0x7f06b80ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:48.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.561+0000 7f06befb3640 1 -- 10.20.193.5:0/3687743637 shutdown_connections 2026-02-17T21:30:48.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.561+0000 7f06befb3640 1 -- 10.20.193.5:0/3687743637 wait complete. 2026-02-17T21:30:48.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.562+0000 7f06befb3640 10 monclient: build_initial_monmap 2026-02-17T21:30:48.576 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.562+0000 7f06befb3640 10 monclient: monmap: 2026-02-17T21:30:48.576 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:48.576 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:48.576 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:48.576 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:48.576 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:48.577 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.577 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:48.577 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:48.577 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:48.577 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.562+0000 7f06befb3640 1 librados: starting msgr at 2026-02-17T21:30:48.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.562+0000 7f06befb3640 1 librados: starting objecter 2026-02-17T21:30:48.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.562+0000 7f06befb3640 1 Processor -- start 2026-02-17T21:30:48.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.562+0000 7f06befb3640 1 -- start start 2026-02-17T21:30:48.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.562+0000 7f06befb3640 1 librados: setting wanted keys 2026-02-17T21:30:48.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.562+0000 7f06befb3640 1 librados: calling monclient init 2026-02-17T21:30:48.577 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.562+0000 7f06befb3640 10 monclient: init 2026-02-17T21:30:48.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.562+0000 7f06befb3640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:48.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.562+0000 7f06befb3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:30:48.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.562+0000 7f06befb3640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f06b8074ef0 0x7f06b80c1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.562+0000 7f06befb3640 10 monclient(hunting): picked mon.noname-a con 0x7f06b8074ef0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:48.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.562+0000 7f06befb3640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f06b80c7170 0x7f06b806e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.562+0000 7f06befb3640 10 monclient(hunting): picked mon.noname-b con 0x7f06b80c7170 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:48.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.562+0000 7f06befb3640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f06b80c7550 0x7f06b806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.562+0000 7f06befb3640 10 monclient(hunting): picked mon.noname-c con 0x7f06b80c7550 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:48.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.562+0000 7f06befb3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.562+0000 7f06befb3640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f06b80c7ee0 con 0x7f06b8074ef0 2026-02-17T21:30:48.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.562+0000 7f06befb3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.562+0000 7f06befb3640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f06b80c5830 con 0x7f06b80c7170 2026-02-17T21:30:48.578 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.562+0000 7f06befb3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.562+0000 7f06befb3640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f06b80c81c0 con 0x7f06b80c7550 2026-02-17T21:30:48.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.562+0000 7f06befb3640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:48.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.562+0000 7f06befb3640 10 monclient(hunting): authenticate will time out at 1354.128809s 2026-02-17T21:30:48.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06bcd28640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f06b8074ef0 0x7f06b80c1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06bd529640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f06b80c7550 0x7f06b806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06affff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f06b80c7170 0x7f06b806e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06bcd28640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f06b8074ef0 0x7f06b80c1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48318/0 (socket says 10.20.193.5:48318) 2026-02-17T21:30:48.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06bcd28640 1 -- 10.20.193.5:0/1066994462 learned_addr learned my addr 10.20.193.5:0/1066994462 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:48.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06bcd28640 10 monclient(hunting): get_auth_request con 0x7f06b8074ef0 auth_method 0 2026-02-17T21:30:48.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06bcd28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:48.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06bcd28640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.579 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06bcd28640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06bd529640 10 monclient(hunting): get_auth_request con 0x7f06b80c7550 auth_method 0 2026-02-17T21:30:48.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06bd529640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:48.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06bd529640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06bd529640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06affff640 10 monclient(hunting): get_auth_request con 0x7f06b80c7170 auth_method 0 2026-02-17T21:30:48.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:48.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06affff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06affff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06bcd28640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:48.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06bcd28640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:48.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06bcd28640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:48.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06bd529640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:48.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06bd529640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:48.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06bd529640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:48.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06affff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:48.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06affff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:48.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.563+0000 7f06affff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:48.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.564+0000 7f06bd529640 10 monclient(hunting): handle_auth_done global_id 5291 payload 824 2026-02-17T21:30:48.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.564+0000 7f06bd529640 1 -- 10.20.193.5:0/1066994462 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f06b80c7170 msgr2=0x7f06b806e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.564+0000 7f06bd529640 1 --2- 10.20.193.5:0/1066994462 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f06b80c7170 0x7f06b806e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.564+0000 7f06bd529640 1 -- 10.20.193.5:0/1066994462 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f06b8074ef0 msgr2=0x7f06b80c1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.564+0000 7f06bd529640 1 --2- 10.20.193.5:0/1066994462 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f06b8074ef0 0x7f06b80c1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.564+0000 7f06bd529640 10 monclient: _finish_hunting 0 2026-02-17T21:30:48.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.564+0000 7f06bd529640 1 monclient: found mon.noname-c 2026-02-17T21:30:48.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.564+0000 7f06bd529640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:48.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.564+0000 7f06bd529640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:48.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.564+0000 7f06bd529640 1 -- 10.20.193.5:0/1066994462 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b806d5f0 con 0x7f06b80c7550 2026-02-17T21:30:48.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.565+0000 7f06bd529640 1 --2- 10.20.193.5:0/1066994462 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f06b80c7550 0x7f06b806eeb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f06b400ca70 tx=0x7f06b400cf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:48.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.565+0000 7f06ad7fa640 10 client.?.objecter ms_handle_connect 0x7f06b80c7550 2026-02-17T21:30:48.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.565+0000 7f06ad7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:48.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06ad7fa640 1 -- 10.20.193.5:0/1066994462 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b400abe0 con 0x7f06b80c7550 2026-02-17T21:30:48.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:48.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06ad7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:48.582 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06ad7fa640 10 monclient: dump: 2026-02-17T21:30:48.582 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:48.582 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.582 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.583 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.583 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:48.583 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.583 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:48.583 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:48.583 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:48.583 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06ad7fa640 10 monclient: _finish_auth 0 2026-02-17T21:30:48.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06ad7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:30:48.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06ad7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:48.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06ad7fa640 1 -- 10.20.193.5:0/1066994462 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06b400ad80 con 0x7f06b80c7550 2026-02-17T21:30:48.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06befb3640 5 monclient: authenticate success, global_id 5291 2026-02-17T21:30:48.583 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06ad7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:48.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06ad7fa640 1 -- 10.20.193.5:0/1066994462 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b4012640 con 0x7f06b80c7550 2026-02-17T21:30:48.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:48.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06aeffd640 4 set_mon_vals no callback set 2026-02-17T21:30:48.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06ad7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:48.584 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06ad7fa640 10 monclient: dump: 2026-02-17T21:30:48.584 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:48.584 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.584 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.584 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.584 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:48.584 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.584 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:48.584 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:48.585 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:48.585 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06befb3640 10 monclient: _renew_subs 2026-02-17T21:30:48.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06befb3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:48.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06befb3640 1 -- 10.20.193.5:0/1066994462 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06b806d8d0 con 0x7f06b80c7550 2026-02-17T21:30:48.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06befb3640 10 client.5291.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:48.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06befb3640 10 monclient: _renew_subs 2026-02-17T21:30:48.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06befb3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:48.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06befb3640 1 -- 10.20.193.5:0/1066994462 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06b806de90 con 0x7f06b80c7550 2026-02-17T21:30:48.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06befb3640 1 librados: init done 2026-02-17T21:30:48.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06befb3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:48.585 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06befb3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:48.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06befb3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:48.586 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.567+0000 7f06befb3640 1 -- 10.20.193.5:0/1066994462 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06b815a9a0 con 0x7f06b80c7550 2026-02-17T21:30:48.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.580+0000 7f06ad7fa640 1 -- 10.20.193.5:0/1066994462 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f06b40127e0 con 0x7f06b80c7550 2026-02-17T21:30:48.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.580+0000 7f06ad7fa640 1 --2- 10.20.193.5:0/1066994462 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f06880792d0 0x7f068807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.580+0000 7f06bcd28640 1 --2- 10.20.193.5:0/1066994462 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f06880792d0 0x7f068807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.580+0000 7f06bcd28640 10 monclient: get_auth_request con 0x7f06880792d0 auth_method 0 2026-02-17T21:30:48.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.581+0000 7f06ad7fa640 10 client.5291.objecter ms_handle_connect 0x7f06880792d0 2026-02-17T21:30:48.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.581+0000 7f06bcd28640 1 --2- 10.20.193.5:0/1066994462 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f06880792d0 0x7f068807b790 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f06a8002960 tx=0x7f06a80028f0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:48.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.678+0000 7f06ad7fa640 1 -- 10.20.193.5:0/1066994462 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f06b405ebb0 con 0x7f06b80c7550 2026-02-17T21:30:48.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.678+0000 7f06ad7fa640 10 client.5291.objecter ms_dispatch2 0x7f06b8000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:48.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.678+0000 7f06ad7fa640 3 client.5291.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:48.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.678+0000 7f06ad7fa640 3 client.5291.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:48.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.678+0000 7f06ad7fa640 20 client.5291.objecter dump_active .. 0 homeless 2026-02-17T21:30:48.686 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.683+0000 7f06ad7fa640 1 -- 10.20.193.5:0/1066994462 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f06b4062b70 con 0x7f06b80c7550 2026-02-17T21:30:48.686 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.683+0000 7f06ad7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:48.686 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.683+0000 7f06ad7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:48.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.767+0000 7f06befb3640 1 -- 10.20.193.5:0/1066994462 --> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f06b8070d70 con 0x7f06880792d0 2026-02-17T21:30:48.770 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.767+0000 7f06ad7fa640 1 -- 10.20.193.5:0/1066994462 <== mgr.4131 v2:10.20.193.176:6800/2898618020 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f06b8070d70 con 0x7f06880792d0 2026-02-17T21:30:48.770 INFO:teuthology.orchestra.run.trial005.stderr:instructed osd(s) 2 to deep-scrub 2026-02-17T21:30:48.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.768+0000 7f06befb3640 10 librados: watch_flush enter 2026-02-17T21:30:48.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.768+0000 7f06befb3640 10 librados: watch_flush exit 2026-02-17T21:30:48.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.768+0000 7f06befb3640 20 client.5291.objecter shutdown clearing up homeless session... 2026-02-17T21:30:48.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.768+0000 7f06befb3640 10 client.5291.objecter successfully canceled tick 2026-02-17T21:30:48.772 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.768+0000 7f06befb3640 1 -- 10.20.193.5:0/1066994462 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f06880792d0 msgr2=0x7f068807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.768+0000 7f06befb3640 1 --2- 10.20.193.5:0/1066994462 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f06880792d0 0x7f068807b790 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f06a8002960 tx=0x7f06a80028f0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.768+0000 7f06befb3640 10 monclient: shutdown 2026-02-17T21:30:48.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.768+0000 7f06befb3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:48.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.768+0000 7f06befb3640 1 -- 10.20.193.5:0/1066994462 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f06b80c7550 msgr2=0x7f06b806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.768+0000 7f06befb3640 1 --2- 10.20.193.5:0/1066994462 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f06b80c7550 0x7f06b806eeb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f06b400ca70 tx=0x7f06b400cf40 comp rx=0 tx=0).stop 2026-02-17T21:30:48.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.768+0000 7f06befb3640 1 -- 10.20.193.5:0/1066994462 shutdown_connections 2026-02-17T21:30:48.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.768+0000 7f06befb3640 1 --2- 10.20.193.5:0/1066994462 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f06880792d0 0x7f068807b790 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.768+0000 7f06befb3640 1 --2- 10.20.193.5:0/1066994462 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f06b80c7550 0x7f06b806eeb0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.768+0000 7f06befb3640 1 --2- 10.20.193.5:0/1066994462 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f06b80c7170 0x7f06b806e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.768+0000 7f06befb3640 1 --2- 10.20.193.5:0/1066994462 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f06b8074ef0 0x7f06b80c1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.773 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.768+0000 7f06befb3640 1 -- 10.20.193.5:0/1066994462 >> 10.20.193.5:0/1066994462 conn(0x7f06b80c9f40 msgr2=0x7f06b8158b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:48.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.768+0000 7f06befb3640 1 -- 10.20.193.5:0/1066994462 shutdown_connections 2026-02-17T21:30:48.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.768+0000 7f06befb3640 1 -- 10.20.193.5:0/1066994462 wait complete. 2026-02-17T21:30:48.774 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.768+0000 7f06befb3640 1 librados: shutdown 2026-02-17T21:30:48.779 INFO:tasks.ceph:Scrubbing osd.6 2026-02-17T21:30:48.779 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:30:48.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.846+0000 7f025b836640 10 monclient: get_monmap_and_config 2026-02-17T21:30:48.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.846+0000 7f025b836640 10 monclient: build_initial_monmap 2026-02-17T21:30:48.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.846+0000 7f025b836640 10 monclient: monmap: 2026-02-17T21:30:48.849 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:48.849 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.849 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:48.848236+0000 2026-02-17T21:30:48.850 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:48.848236+0000 2026-02-17T21:30:48.850 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:48.850 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.850 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:48.850 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:48.850 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:48.850 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:48.850 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:48.850 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:48.850 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.846+0000 7f025b836640 1 Processor -- start 2026-02-17T21:30:48.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.847+0000 7f025b836640 1 -- start start 2026-02-17T21:30:48.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.847+0000 7f025b836640 10 monclient: init 2026-02-17T21:30:48.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.847+0000 7f025b836640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:48.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.847+0000 7f025b836640 10 monclient: _add_conns ranks=[3,5,1,0,4,2] 2026-02-17T21:30:48.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.847+0000 7f025b836640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f025415d3c0 0x7f025415d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.847+0000 7f025b836640 10 monclient(hunting): picked mon.noname-a con 0x7f025415d3c0 addr v2:10.20.193.5:3300/0 2026-02-17T21:30:48.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.847+0000 7f025b836640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f02540c94c0 0x7f025415b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.847+0000 7f025b836640 10 monclient(hunting): picked mon.noname-c con 0x7f02540c94c0 addr v2:10.20.193.135:3300/0 2026-02-17T21:30:48.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.847+0000 7f025b836640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f02540c7300 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:48.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.847+0000 7f025b836640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02540c7e60 con 0x7f02540c7300 2026-02-17T21:30:48.859 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.847+0000 7f025b836640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.847+0000 7f025b836640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f02540c8140 con 0x7f025415d3c0 2026-02-17T21:30:48.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.847+0000 7f025b836640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.847+0000 7f025b836640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f02540c8420 con 0x7f02540c94c0 2026-02-17T21:30:48.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.847+0000 7f025b836640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:48.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.847+0000 7f025b836640 10 monclient(hunting): authenticate will time out at 1354.413545s 2026-02-17T21:30:48.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.848+0000 7f02595ab640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f025415d3c0 0x7f025415d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.848+0000 7f0258daa640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f02540c94c0 0x7f025415b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.860 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.848+0000 7f0259dac640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f02540c7300 0x7f02540c52f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:41152/0 (socket says 10.20.193.5:41152) 2026-02-17T21:30:48.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.848+0000 7f0259dac640 1 -- 10.20.193.5:0/1787317918 learned_addr learned my addr 10.20.193.5:0/1787317918 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:48.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.848+0000 7f0258daa640 10 monclient(hunting): get_auth_request con 0x7f02540c94c0 auth_method 0 2026-02-17T21:30:48.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.848+0000 7f0258daa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:48.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.848+0000 7f0258daa640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.848+0000 7f0258daa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.848+0000 7f02595ab640 10 monclient(hunting): get_auth_request con 0x7f025415d3c0 auth_method 0 2026-02-17T21:30:48.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.848+0000 7f02595ab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:48.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.848+0000 7f02595ab640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.848+0000 7f02595ab640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.861 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.848+0000 7f0258daa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:48.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.848+0000 7f0258daa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:48.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.848+0000 7f0258daa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:48.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.848+0000 7f02595ab640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:48.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.848+0000 7f02595ab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:48.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.848+0000 7f02595ab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:48.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.849+0000 7f0243fff640 1 -- 10.20.193.5:0/1787317918 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4223076789 0 0) 0x7f02540c7e60 con 0x7f02540c7300 2026-02-17T21:30:48.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.849+0000 7f0243fff640 10 monclient(hunting): _negotiate 2026-02-17T21:30:48.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.849+0000 7f0243fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.862 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.849+0000 7f0243fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.849+0000 7f0243fff640 10 monclient(hunting): my global_id is 5293 2026-02-17T21:30:48.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.849+0000 7f0243fff640 1 -- 10.20.193.5:0/1787317918 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f023c003620 con 0x7f02540c7300 2026-02-17T21:30:48.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.849+0000 7f0258daa640 10 monclient(hunting): handle_auth_done global_id 5294 payload 274 2026-02-17T21:30:48.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.849+0000 7f0258daa640 1 -- 10.20.193.5:0/1787317918 >> v2:10.20.193.5:3300/0 conn(0x7f025415d3c0 msgr2=0x7f025415d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:48.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.849+0000 7f0258daa640 1 --2- 10.20.193.5:0/1787317918 >> v2:10.20.193.5:3300/0 conn(0x7f025415d3c0 0x7f025415d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.849+0000 7f0258daa640 1 -- 10.20.193.5:0/1787317918 >> v1:10.20.193.119:6789/0 conn(0x7f02540c7300 legacy=0x7f02540c52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.849+0000 7f0258daa640 10 monclient: _finish_hunting 0 2026-02-17T21:30:48.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.849+0000 7f0258daa640 1 monclient: found mon.noname-c 2026-02-17T21:30:48.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.849+0000 7f0258daa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:48.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.849+0000 7f0258daa640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:48.863 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.849+0000 7f0258daa640 1 -- 10.20.193.5:0/1787317918 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02540c8700 con 0x7f02540c94c0 2026-02-17T21:30:48.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.850+0000 7f0258daa640 1 --2- 10.20.193.5:0/1787317918 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f02540c94c0 0x7f025415b050 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0254069390 tx=0x7f024802ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac1cec990d716cf6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:48.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f0243fff640 1 -- 10.20.193.5:0/1787317918 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024803c070 con 0x7f02540c94c0 2026-02-17T21:30:48.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f0243fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:48.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f0243fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:48.864 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f0243fff640 10 monclient: dump: 2026-02-17T21:30:48.864 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:48.864 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.864 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.864 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.864 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:48.865 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.865 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:48.865 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:48.865 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:48.865 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f0243fff640 10 monclient: _finish_auth 0 2026-02-17T21:30:48.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f0243fff640 10 monclient: _check_auth_tickets 2026-02-17T21:30:48.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f0243fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:48.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f0243fff640 1 -- 10.20.193.5:0/1787317918 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f024802fc20 con 0x7f02540c94c0 2026-02-17T21:30:48.865 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f0243fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:48.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f025b836640 5 monclient: authenticate success, global_id 5294 2026-02-17T21:30:48.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f0243fff640 1 -- 10.20.193.5:0/1787317918 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0248037440 con 0x7f02540c94c0 2026-02-17T21:30:48.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f0243fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:48.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f0243fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:48.866 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f0243fff640 10 monclient: dump: 2026-02-17T21:30:48.866 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:48.866 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.866 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.866 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.866 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:48.866 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.867 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:48.867 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:48.867 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:48.867 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f025b836640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:48.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f025b836640 4 set_mon_vals no callback set 2026-02-17T21:30:48.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f025b836640 10 monclient: shutdown 2026-02-17T21:30:48.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f025b836640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:48.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f025b836640 1 -- 10.20.193.5:0/1787317918 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f02540c94c0 msgr2=0x7f025415b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f025b836640 1 --2- 10.20.193.5:0/1787317918 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f02540c94c0 0x7f025415b050 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0254069390 tx=0x7f024802ef10 comp rx=0 tx=0).stop 2026-02-17T21:30:48.867 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f025b836640 1 -- 10.20.193.5:0/1787317918 shutdown_connections 2026-02-17T21:30:48.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f025b836640 1 --2- 10.20.193.5:0/1787317918 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f02540c94c0 0x7f025415b050 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f025b836640 1 --2- 10.20.193.5:0/1787317918 >> v2:10.20.193.5:3300/0 conn(0x7f025415d3c0 0x7f025415d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f025b836640 1 -- 10.20.193.5:0/1787317918 >> 10.20.193.5:0/1787317918 conn(0x7f02540c9f60 msgr2=0x7f02540ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:48.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f025b836640 1 -- 10.20.193.5:0/1787317918 shutdown_connections 2026-02-17T21:30:48.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.852+0000 7f025b836640 1 -- 10.20.193.5:0/1787317918 wait complete. 2026-02-17T21:30:48.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.853+0000 7f025b836640 10 monclient: build_initial_monmap 2026-02-17T21:30:48.868 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.853+0000 7f025b836640 10 monclient: monmap: 2026-02-17T21:30:48.868 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:48.868 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:48.868 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:48.868 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:48.868 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:48.868 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.869 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:48.869 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:48.869 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:48.869 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.853+0000 7f025b836640 1 librados: starting msgr at 2026-02-17T21:30:48.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.853+0000 7f025b836640 1 librados: starting objecter 2026-02-17T21:30:48.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.853+0000 7f025b836640 1 Processor -- start 2026-02-17T21:30:48.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.853+0000 7f025b836640 1 -- start start 2026-02-17T21:30:48.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.853+0000 7f025b836640 1 librados: setting wanted keys 2026-02-17T21:30:48.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.853+0000 7f025b836640 1 librados: calling monclient init 2026-02-17T21:30:48.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.853+0000 7f025b836640 10 monclient: init 2026-02-17T21:30:48.869 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.853+0000 7f025b836640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:48.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.853+0000 7f025b836640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:30:48.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.853+0000 7f025b836640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f02540c7300 0x7f0254073f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.853+0000 7f025b836640 10 monclient(hunting): picked mon.noname-b con 0x7f02540c7300 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:48.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.853+0000 7f025b836640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f02540c94c0 0x7f02541f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.853+0000 7f025b836640 10 monclient(hunting): picked mon.noname-c con 0x7f02540c94c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:48.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.853+0000 7f025b836640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f025415d3c0 0x7f02541f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.853+0000 7f025b836640 10 monclient(hunting): picked mon.noname-a con 0x7f025415d3c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:48.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.853+0000 7f025b836640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.853+0000 7f025b836640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f02540c8fa0 con 0x7f025415d3c0 2026-02-17T21:30:48.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.853+0000 7f025b836640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.853+0000 7f025b836640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f02540c8cc0 con 0x7f02540c7300 2026-02-17T21:30:48.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.853+0000 7f025b836640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.870 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.853+0000 7f025b836640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f02540c5a00 con 0x7f02540c94c0 2026-02-17T21:30:48.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.853+0000 7f025b836640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:48.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.853+0000 7f025b836640 10 monclient(hunting): authenticate will time out at 1354.419995s 2026-02-17T21:30:48.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f0259dac640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f025415d3c0 0x7f02541f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f0258daa640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f02540c94c0 0x7f02541f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f0259dac640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f025415d3c0 0x7f02541f54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48336/0 (socket says 10.20.193.5:48336) 2026-02-17T21:30:48.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f0259dac640 1 -- 10.20.193.5:0/3686953401 learned_addr learned my addr 10.20.193.5:0/3686953401 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:48.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f0259dac640 10 monclient(hunting): get_auth_request con 0x7f025415d3c0 auth_method 0 2026-02-17T21:30:48.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f0259dac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:48.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f0259dac640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f0259dac640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f02595ab640 1 --2- 10.20.193.5:0/3686953401 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f02540c7300 0x7f0254073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.871 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f0258daa640 10 monclient(hunting): get_auth_request con 0x7f02540c94c0 auth_method 0 2026-02-17T21:30:48.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f0258daa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:48.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f0258daa640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f0258daa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f02595ab640 10 monclient(hunting): get_auth_request con 0x7f02540c7300 auth_method 0 2026-02-17T21:30:48.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f02595ab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:48.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f02595ab640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f02595ab640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f0259dac640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:48.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f0259dac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:48.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f0259dac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:48.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f0258daa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:48.872 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f0258daa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:48.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f0258daa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:48.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f02595ab640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:48.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f02595ab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:48.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.854+0000 7f02595ab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:48.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.856+0000 7f0258daa640 10 monclient(hunting): handle_auth_done global_id 5297 payload 824 2026-02-17T21:30:48.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.856+0000 7f0258daa640 1 -- 10.20.193.5:0/3686953401 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f02540c7300 msgr2=0x7f0254073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.856+0000 7f0258daa640 1 --2- 10.20.193.5:0/3686953401 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f02540c7300 0x7f0254073f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.856+0000 7f0258daa640 1 -- 10.20.193.5:0/3686953401 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f025415d3c0 msgr2=0x7f02541f54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.856+0000 7f0258daa640 1 --2- 10.20.193.5:0/3686953401 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f025415d3c0 0x7f02541f54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.856+0000 7f0258daa640 10 monclient: _finish_hunting 0 2026-02-17T21:30:48.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.856+0000 7f0258daa640 1 monclient: found mon.noname-c 2026-02-17T21:30:48.873 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.856+0000 7f0258daa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:48.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.856+0000 7f0258daa640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:48.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.856+0000 7f0258daa640 1 -- 10.20.193.5:0/3686953401 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0254158b70 con 0x7f02540c94c0 2026-02-17T21:30:48.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.857+0000 7f0258daa640 1 --2- 10.20.193.5:0/3686953401 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f02540c94c0 0x7f02541f4f60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0248036000 tx=0x7f02480047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:48.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.857+0000 7f0241ffb640 10 client.?.objecter ms_handle_connect 0x7f02540c94c0 2026-02-17T21:30:48.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.857+0000 7f0241ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:48.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.858+0000 7f0241ffb640 1 -- 10.20.193.5:0/3686953401 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024803c040 con 0x7f02540c94c0 2026-02-17T21:30:48.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.858+0000 7f0241ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:48.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.858+0000 7f0241ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:48.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.858+0000 7f0241ffb640 10 monclient: dump: 2026-02-17T21:30:48.878 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:48.878 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.878 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.878 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.879 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:48.879 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.879 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:48.879 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:48.879 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:48.879 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.858+0000 7f0241ffb640 10 monclient: _finish_auth 0 2026-02-17T21:30:48.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.858+0000 7f0241ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:30:48.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.858+0000 7f0241ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:48.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.858+0000 7f0241ffb640 1 -- 10.20.193.5:0/3686953401 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0248042450 con 0x7f02540c94c0 2026-02-17T21:30:48.879 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.858+0000 7f025b836640 5 monclient: authenticate success, global_id 5297 2026-02-17T21:30:48.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.858+0000 7f025b836640 10 monclient: _renew_subs 2026-02-17T21:30:48.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.858+0000 7f025b836640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:48.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.858+0000 7f025b836640 1 -- 10.20.193.5:0/3686953401 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0254158e50 con 0x7f02540c94c0 2026-02-17T21:30:48.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.858+0000 7f0241ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:48.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.858+0000 7f0241ffb640 1 -- 10.20.193.5:0/3686953401 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0248042820 con 0x7f02540c94c0 2026-02-17T21:30:48.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.858+0000 7f0241ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:48.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.858+0000 7f0241ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:48.880 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.858+0000 7f0241ffb640 10 monclient: dump: 2026-02-17T21:30:48.880 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:48.880 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.880 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.880 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.880 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:48.881 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.881 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:48.881 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:48.881 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:48.881 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.858+0000 7f02437fe640 4 set_mon_vals no callback set 2026-02-17T21:30:48.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.858+0000 7f025b836640 10 client.5297.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:48.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.858+0000 7f025b836640 10 monclient: _renew_subs 2026-02-17T21:30:48.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.858+0000 7f025b836640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:48.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.859+0000 7f025b836640 1 -- 10.20.193.5:0/3686953401 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02541f4760 con 0x7f02540c94c0 2026-02-17T21:30:48.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.859+0000 7f025b836640 1 librados: init done 2026-02-17T21:30:48.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.859+0000 7f025b836640 10 client.5297.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:48.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.859+0000 7f025b836640 15 client.5297.objecter _session_command_op_assign -1 1 2026-02-17T21:30:48.881 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.859+0000 7f025b836640 20 client.5297.objecter _get_session osd=-1 returning homeless 2026-02-17T21:30:48.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.859+0000 7f025b836640 10 client.5297.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:48.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.859+0000 7f025b836640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:48.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.859+0000 7f025b836640 1 -- 10.20.193.5:0/3686953401 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f02540c7750 con 0x7f02540c94c0 2026-02-17T21:30:48.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.871+0000 7f0241ffb640 1 -- 10.20.193.5:0/3686953401 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f02480429c0 con 0x7f02540c94c0 2026-02-17T21:30:48.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.872+0000 7f0241ffb640 1 --2- 10.20.193.5:0/3686953401 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0224079280 0x7f022407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.872+0000 7f02595ab640 1 --2- 10.20.193.5:0/3686953401 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0224079280 0x7f022407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.872+0000 7f02595ab640 10 monclient: get_auth_request con 0x7f0224079280 auth_method 0 2026-02-17T21:30:48.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.873+0000 7f0241ffb640 1 -- 10.20.193.5:0/3686953401 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f024802fae0 con 0x7f02540c94c0 2026-02-17T21:30:48.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.873+0000 7f0241ffb640 10 client.5297.objecter ms_dispatch2 0x7f0254000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:48.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.873+0000 7f0241ffb640 3 client.5297.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:48.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.873+0000 7f0241ffb640 3 client.5297.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:48.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.873+0000 7f02595ab640 1 --2- 10.20.193.5:0/3686953401 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0224079280 0x7f022407b740 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f02540c3d80 tx=0x7f0244009290 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:48.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.873+0000 7f0241ffb640 10 client.5297.objecter checking command 1 2026-02-17T21:30:48.882 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.873+0000 7f0241ffb640 1 --2- 10.20.193.5:0/3686953401 >> [v2:10.20.193.135:6808/1853988335,v1:10.20.193.135:6809/1853988335] conn(0x7f0224081760 0x7f0224083b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.873+0000 7f0241ffb640 20 client.5297.objecter _get_session s=0x7f0224081090 osd=6 3 2026-02-17T21:30:48.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.873+0000 7f0241ffb640 20 client.5297.objecter put_session s=0x7f0224081090 osd=6 3 2026-02-17T21:30:48.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.873+0000 7f0241ffb640 15 client.5297.objecter _session_command_op_remove -1 1 2026-02-17T21:30:48.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.873+0000 7f0241ffb640 20 client.5297.objecter _get_session s=0x7f0224081090 osd=6 3 2026-02-17T21:30:48.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.873+0000 7f0241ffb640 20 client.5297.objecter get_session s=0x7f0224081090 osd=6 3 2026-02-17T21:30:48.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.873+0000 7f0241ffb640 15 client.5297.objecter _session_command_op_assign 6 1 2026-02-17T21:30:48.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.873+0000 7f0241ffb640 20 client.5297.objecter put_session s=0x7f0224081090 osd=6 4 2026-02-17T21:30:48.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.873+0000 7f0241ffb640 10 client.5297.objecter _send_command 1 2026-02-17T21:30:48.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.873+0000 7f0241ffb640 1 -- 10.20.193.5:0/3686953401 --> [v2:10.20.193.135:6808/1853988335,v1:10.20.193.135:6809/1853988335] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f024804ee80 con 0x7f0224081760 2026-02-17T21:30:48.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.873+0000 7f0241ffb640 20 client.5297.objecter dump_active .. 0 homeless 2026-02-17T21:30:48.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.873+0000 7f0241ffb640 10 client.5297.objecter ms_handle_connect 0x7f0224079280 2026-02-17T21:30:48.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.873+0000 7f0241ffb640 1 -- 10.20.193.5:0/3686953401 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f0248083ac0 con 0x7f02540c94c0 2026-02-17T21:30:48.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.873+0000 7f0241ffb640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T21:30:48.883 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.873+0000 7f0259dac640 1 --2- 10.20.193.5:0/3686953401 >> [v2:10.20.193.135:6808/1853988335,v1:10.20.193.135:6809/1853988335] conn(0x7f0224081760 0x7f0224083b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.874+0000 7f0259dac640 10 monclient: get_auth_request con 0x7f0224081760 auth_method 0 2026-02-17T21:30:48.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.875+0000 7f0259dac640 1 --2- 10.20.193.5:0/3686953401 >> [v2:10.20.193.135:6808/1853988335,v1:10.20.193.135:6809/1853988335] conn(0x7f0224081760 0x7f0224083b80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:48.884 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.875+0000 7f0241ffb640 10 client.5297.objecter ms_handle_connect 0x7f0224081760 2026-02-17T21:30:48.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.887+0000 7f0241ffb640 1 -- 10.20.193.5:0/3686953401 <== osd.6 v2:10.20.193.135:6808/1853988335 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f024804ee80 con 0x7f0224081760 2026-02-17T21:30:48.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.887+0000 7f0241ffb640 10 client.5297.objecter ms_dispatch2 0x7f0254000b90 command_reply(tid 1: 0 ) 2026-02-17T21:30:48.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.887+0000 7f0241ffb640 10 client.5297.objecter _finish_command 1 = system:0 2026-02-17T21:30:48.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.887+0000 7f0241ffb640 20 client.5297.objecter put_session s=0x7f0224081090 osd=6 4 2026-02-17T21:30:48.889 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.887+0000 7f0241ffb640 15 client.5297.objecter _session_command_op_remove 6 1 2026-02-17T21:30:48.895 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.892+0000 7f025b836640 10 client.5297.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:30:48.895 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.892+0000 7f025b836640 15 client.5297.objecter _session_command_op_assign -1 2 2026-02-17T21:30:48.895 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.892+0000 7f025b836640 20 client.5297.objecter _get_session s=0x7f0224081090 osd=6 3 2026-02-17T21:30:48.895 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.892+0000 7f025b836640 20 client.5297.objecter put_session s=0x7f0224081090 osd=6 3 2026-02-17T21:30:48.895 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.892+0000 7f025b836640 20 client.5297.objecter _get_session s=0x7f0224081090 osd=6 3 2026-02-17T21:30:48.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.892+0000 7f025b836640 15 client.5297.objecter _session_command_op_remove -1 2 2026-02-17T21:30:48.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.892+0000 7f025b836640 20 client.5297.objecter get_session s=0x7f0224081090 osd=6 3 2026-02-17T21:30:48.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.892+0000 7f025b836640 15 client.5297.objecter _session_command_op_assign 6 2 2026-02-17T21:30:48.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.892+0000 7f025b836640 20 client.5297.objecter put_session s=0x7f0224081090 osd=6 4 2026-02-17T21:30:48.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.892+0000 7f025b836640 10 client.5297.objecter _send_command 2 2026-02-17T21:30:48.896 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.892+0000 7f025b836640 1 -- 10.20.193.5:0/3686953401 --> [v2:10.20.193.135:6808/1853988335,v1:10.20.193.135:6809/1853988335] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f025414ec20 con 0x7f0224081760 2026-02-17T21:30:48.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.899+0000 7f0241ffb640 1 -- 10.20.193.5:0/3686953401 <== osd.6 v2:10.20.193.135:6808/1853988335 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f025414ec20 con 0x7f0224081760 2026-02-17T21:30:48.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.899+0000 7f0241ffb640 10 client.5297.objecter ms_dispatch2 0x7f0254000b90 command_reply(tid 2: 0 ) 2026-02-17T21:30:48.901 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.899+0000 7f0241ffb640 10 client.5297.objecter _finish_command 2 = system:0 2026-02-17T21:30:48.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.899+0000 7f0241ffb640 20 client.5297.objecter put_session s=0x7f0224081090 osd=6 4 2026-02-17T21:30:48.902 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.899+0000 7f0241ffb640 15 client.5297.objecter _session_command_op_remove 6 2 2026-02-17T21:30:48.902 INFO:teuthology.orchestra.run.trial005.stdout:{ 2026-02-17T21:30:48.902 INFO:teuthology.orchestra.run.trial005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:30:48.902 INFO:teuthology.orchestra.run.trial005.stdout:} 2026-02-17T21:30:48.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.899+0000 7f025b836640 10 librados: watch_flush enter 2026-02-17T21:30:48.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.899+0000 7f025b836640 10 librados: watch_flush exit 2026-02-17T21:30:48.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.899+0000 7f025b836640 10 client.5297.objecter close_session for osd.6 2026-02-17T21:30:48.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.899+0000 7f025b836640 1 -- 10.20.193.5:0/3686953401 >> [v2:10.20.193.135:6808/1853988335,v1:10.20.193.135:6809/1853988335] conn(0x7f0224081760 msgr2=0x7f0224083b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.899+0000 7f025b836640 1 --2- 10.20.193.5:0/3686953401 >> [v2:10.20.193.135:6808/1853988335,v1:10.20.193.135:6809/1853988335] conn(0x7f0224081760 0x7f0224083b80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.899+0000 7f025b836640 20 client.5297.objecter put_session s=0x7f0224081090 osd=6 1 2026-02-17T21:30:48.904 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.899+0000 7f025b836640 20 client.5297.objecter shutdown clearing up homeless session... 2026-02-17T21:30:48.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.899+0000 7f025b836640 10 client.5297.objecter successfully canceled tick 2026-02-17T21:30:48.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.899+0000 7f025b836640 1 -- 10.20.193.5:0/3686953401 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0224079280 msgr2=0x7f022407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.899+0000 7f025b836640 1 --2- 10.20.193.5:0/3686953401 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f0224079280 0x7f022407b740 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f02540c3d80 tx=0x7f0244009290 comp rx=0 tx=0).stop 2026-02-17T21:30:48.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.899+0000 7f025b836640 10 monclient: shutdown 2026-02-17T21:30:48.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.899+0000 7f025b836640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:48.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.899+0000 7f025b836640 1 -- 10.20.193.5:0/3686953401 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f02540c94c0 msgr2=0x7f02541f4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.899+0000 7f025b836640 1 --2- 10.20.193.5:0/3686953401 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f02540c94c0 0x7f02541f4f60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0248036000 tx=0x7f02480047c0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.899+0000 7f0259dac640 1 -- 10.20.193.5:0/3686953401 reap_dead start 2026-02-17T21:30:48.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.899+0000 7f025b836640 1 -- 10.20.193.5:0/3686953401 shutdown_connections 2026-02-17T21:30:48.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.899+0000 7f025b836640 1 -- 10.20.193.5:0/3686953401 >> 10.20.193.5:0/3686953401 conn(0x7f02540c9f60 msgr2=0x7f025414ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:48.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.899+0000 7f025b836640 1 -- 10.20.193.5:0/3686953401 shutdown_connections 2026-02-17T21:30:48.905 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.899+0000 7f025b836640 1 -- 10.20.193.5:0/3686953401 wait complete. 2026-02-17T21:30:48.906 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.899+0000 7f025b836640 1 librados: shutdown 2026-02-17T21:30:48.909 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2026-02-17T21:30:48.979 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.976+0000 7f2bdd4ae640 10 monclient: get_monmap_and_config 2026-02-17T21:30:48.979 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.976+0000 7f2bdd4ae640 10 monclient: build_initial_monmap 2026-02-17T21:30:48.979 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.976+0000 7f2bdd4ae640 10 monclient: monmap: 2026-02-17T21:30:48.979 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:48.979 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.979 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:48.977930+0000 2026-02-17T21:30:48.980 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:48.977930+0000 2026-02-17T21:30:48.980 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:48.980 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.980 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:48.980 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:48.980 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:48.980 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:48.980 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:48.980 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:48.980 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.980 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.976+0000 7f2bdd4ae640 1 Processor -- start 2026-02-17T21:30:48.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.976+0000 7f2bdd4ae640 1 -- start start 2026-02-17T21:30:48.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.976+0000 7f2bdd4ae640 10 monclient: init 2026-02-17T21:30:48.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.977+0000 7f2bdd4ae640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:48.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.977+0000 7f2bdd4ae640 10 monclient: _add_conns ranks=[2,3,5,4,0,1] 2026-02-17T21:30:48.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.977+0000 7f2bdd4ae640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2bd80c7170 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:48.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.977+0000 7f2bdd4ae640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f2bd80c7550 0x7f2bd80749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.977+0000 7f2bdd4ae640 10 monclient(hunting): picked mon.noname-a con 0x7f2bd80c7550 addr v2:10.20.193.5:3300/0 2026-02-17T21:30:48.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.977+0000 7f2bdd4ae640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f2bd8074ef0 0x7f2bd80c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.977+0000 7f2bdd4ae640 10 monclient(hunting): picked mon.noname-c con 0x7f2bd8074ef0 addr v2:10.20.193.135:3300/0 2026-02-17T21:30:48.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.977+0000 7f2bdd4ae640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bd80c4fd0 con 0x7f2bd80c7170 2026-02-17T21:30:48.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.977+0000 7f2bdd4ae640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.989 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.977+0000 7f2bdd4ae640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2bd80c8530 con 0x7f2bd80c7550 2026-02-17T21:30:48.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.977+0000 7f2bdd4ae640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.977+0000 7f2bdd4ae640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f2bd815a9a0 con 0x7f2bd8074ef0 2026-02-17T21:30:48.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.977+0000 7f2bdd4ae640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:48.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.977+0000 7f2bdd4ae640 10 monclient(hunting): authenticate will time out at 1354.543210s 2026-02-17T21:30:48.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.977+0000 7f2bd67fc640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f2bd80c7550 0x7f2bd80749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.977+0000 7f2bd77fe640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f2bd8074ef0 0x7f2bd80c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.977+0000 7f2bd67fc640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f2bd80c7550 0x7f2bd80749b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48340/0 (socket says 10.20.193.5:48340) 2026-02-17T21:30:48.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.977+0000 7f2bd67fc640 1 -- 10.20.193.5:0/2185478253 learned_addr learned my addr 10.20.193.5:0/2185478253 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:48.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.977+0000 7f2bd67fc640 10 monclient(hunting): get_auth_request con 0x7f2bd80c7550 auth_method 0 2026-02-17T21:30:48.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.977+0000 7f2bd67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:48.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.977+0000 7f2bd67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.990 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.977+0000 7f2bd67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.977+0000 7f2bd67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:48.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.977+0000 7f2bd67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:48.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.978+0000 7f2bd67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:48.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.978+0000 7f2bd77fe640 10 monclient(hunting): get_auth_request con 0x7f2bd8074ef0 auth_method 0 2026-02-17T21:30:48.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.978+0000 7f2bd77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:48.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.978+0000 7f2bd77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:48.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.978+0000 7f2bd77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:48.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.978+0000 7f2bd77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:48.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.978+0000 7f2bd77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:48.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.978+0000 7f2bd77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:48.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.978+0000 7f2bd67fc640 10 monclient(hunting): handle_auth_done global_id 5229 payload 274 2026-02-17T21:30:48.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.978+0000 7f2bd67fc640 1 -- 10.20.193.5:0/2185478253 >> v2:10.20.193.135:3300/0 conn(0x7f2bd8074ef0 msgr2=0x7f2bd80c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:48.991 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.978+0000 7f2bd67fc640 1 --2- 10.20.193.5:0/2185478253 >> v2:10.20.193.135:3300/0 conn(0x7f2bd8074ef0 0x7f2bd80c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.978+0000 7f2bd67fc640 1 -- 10.20.193.5:0/2185478253 >> v1:10.20.193.135:6789/0 conn(0x7f2bd80c7170 legacy=0x7f2bd80c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.978+0000 7f2bd67fc640 10 monclient: _finish_hunting 0 2026-02-17T21:30:48.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.978+0000 7f2bd67fc640 1 monclient: found mon.noname-a 2026-02-17T21:30:48.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.978+0000 7f2bd67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:48.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.978+0000 7f2bd67fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:48.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.978+0000 7f2bd67fc640 1 -- 10.20.193.5:0/2185478253 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd80c5270 con 0x7f2bd80c7550 2026-02-17T21:30:48.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.979+0000 7f2bd67fc640 1 --2- 10.20.193.5:0/2185478253 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2bd80c7550 0x7f2bd80749b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2bd80c84a0 tx=0x7f2bc002eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df3d3800db6556f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:48.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bd5ffb640 1 -- 10.20.193.5:0/2185478253 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc003c070 con 0x7f2bd80c7550 2026-02-17T21:30:48.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bd5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:48.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bd5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:48.992 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bd5ffb640 10 monclient: dump: 2026-02-17T21:30:48.992 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:48.993 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.993 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.993 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.993 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:48.993 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.993 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:48.993 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:48.993 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:48.993 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.993 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bd5ffb640 10 monclient: _finish_auth 0 2026-02-17T21:30:48.993 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bd5ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:30:48.993 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bd5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:48.994 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bd5ffb640 1 -- 10.20.193.5:0/2185478253 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bc002fbe0 con 0x7f2bd80c7550 2026-02-17T21:30:48.994 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bd5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:48.994 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bdd4ae640 5 monclient: authenticate success, global_id 5229 2026-02-17T21:30:48.994 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bd5ffb640 1 -- 10.20.193.5:0/2185478253 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0037440 con 0x7f2bd80c7550 2026-02-17T21:30:48.994 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bdd4ae640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:48.994 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bdd4ae640 4 set_mon_vals no callback set 2026-02-17T21:30:48.994 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bd5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:48.994 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bd5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:48.994 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bd5ffb640 10 monclient: dump: 2026-02-17T21:30:48.994 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:48.994 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:48.994 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.994 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:48.995 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:48.995 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.995 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:48.995 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:48.995 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:48.995 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bdd4ae640 10 monclient: shutdown 2026-02-17T21:30:48.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bdd4ae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:48.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bdd4ae640 1 -- 10.20.193.5:0/2185478253 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2bd80c7550 msgr2=0x7f2bd80749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:48.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bdd4ae640 1 --2- 10.20.193.5:0/2185478253 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2bd80c7550 0x7f2bd80749b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2bd80c84a0 tx=0x7f2bc002eed0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bdd4ae640 1 -- 10.20.193.5:0/2185478253 shutdown_connections 2026-02-17T21:30:48.995 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bdd4ae640 1 --2- 10.20.193.5:0/2185478253 >> v2:10.20.193.135:3300/0 conn(0x7f2bd8074ef0 0x7f2bd80c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bdd4ae640 1 --2- 10.20.193.5:0/2185478253 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2bd80c7550 0x7f2bd80749b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:48.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bdd4ae640 1 -- 10.20.193.5:0/2185478253 >> 10.20.193.5:0/2185478253 conn(0x7f2bd80c9f40 msgr2=0x7f2bd80ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:48.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bdd4ae640 1 -- 10.20.193.5:0/2185478253 shutdown_connections 2026-02-17T21:30:48.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.981+0000 7f2bdd4ae640 1 -- 10.20.193.5:0/2185478253 wait complete. 2026-02-17T21:30:48.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.982+0000 7f2bdd4ae640 10 monclient: build_initial_monmap 2026-02-17T21:30:48.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.982+0000 7f2bdd4ae640 10 monclient: monmap: 2026-02-17T21:30:48.996 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:48.996 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:48.996 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:48.996 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:48.996 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:48.996 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:48.997 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:48.997 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:48.997 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:48.997 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:48.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.982+0000 7f2bdd4ae640 1 librados: starting msgr at 2026-02-17T21:30:48.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.982+0000 7f2bdd4ae640 1 librados: starting objecter 2026-02-17T21:30:48.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.982+0000 7f2bdd4ae640 1 Processor -- start 2026-02-17T21:30:48.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.982+0000 7f2bdd4ae640 1 -- start start 2026-02-17T21:30:48.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.982+0000 7f2bdd4ae640 1 librados: setting wanted keys 2026-02-17T21:30:48.997 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.982+0000 7f2bdd4ae640 1 librados: calling monclient init 2026-02-17T21:30:48.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.982+0000 7f2bdd4ae640 10 monclient: init 2026-02-17T21:30:48.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bdd4ae640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:48.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bdd4ae640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:30:48.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bdd4ae640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2bd8074ef0 0x7f2bd815d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bdd4ae640 10 monclient(hunting): picked mon.noname-b con 0x7f2bd8074ef0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:48.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bdd4ae640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2bd80c7170 0x7f2bd8156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bdd4ae640 10 monclient(hunting): picked mon.noname-c con 0x7f2bd80c7170 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:48.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bdd4ae640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2bd80c7550 0x7f2bd806d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:48.998 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bdd4ae640 10 monclient(hunting): picked mon.noname-a con 0x7f2bd80c7550 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:48.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bdd4ae640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bdd4ae640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd80c7ee0 con 0x7f2bd80c7550 2026-02-17T21:30:48.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bdd4ae640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bdd4ae640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd80c5830 con 0x7f2bd8074ef0 2026-02-17T21:30:48.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bdd4ae640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:48.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bdd4ae640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd80c81c0 con 0x7f2bd80c7170 2026-02-17T21:30:48.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bdd4ae640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:48.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bdd4ae640 10 monclient(hunting): authenticate will time out at 1354.549219s 2026-02-17T21:30:48.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bd77fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2bd80c7550 0x7f2bd806d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:48.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bd77fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2bd80c7550 0x7f2bd806d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48352/0 (socket says 10.20.193.5:48352) 2026-02-17T21:30:48.999 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bd77fe640 1 -- 10.20.193.5:0/2569775138 learned_addr learned my addr 10.20.193.5:0/2569775138 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:49.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bd77fe640 10 monclient(hunting): get_auth_request con 0x7f2bd80c7550 auth_method 0 2026-02-17T21:30:49.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bd77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:49.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bd77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:49.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bd77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:49.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bd6ffd640 1 --2- 10.20.193.5:0/2569775138 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2bd8074ef0 0x7f2bd815d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bd67fc640 1 --2- 10.20.193.5:0/2569775138 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2bd80c7170 0x7f2bd8156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bd6ffd640 10 monclient(hunting): get_auth_request con 0x7f2bd8074ef0 auth_method 0 2026-02-17T21:30:49.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bd6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:49.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bd6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:49.000 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bd6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:49.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bd77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:49.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bd77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:49.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.983+0000 7f2bd77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:49.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.984+0000 7f2bd67fc640 10 monclient(hunting): get_auth_request con 0x7f2bd80c7170 auth_method 0 2026-02-17T21:30:49.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.984+0000 7f2bd67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:49.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.984+0000 7f2bd67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:49.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.984+0000 7f2bd67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:49.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.984+0000 7f2bd6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:49.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.984+0000 7f2bd6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:49.001 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.984+0000 7f2bd6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:49.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.984+0000 7f2bd67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:49.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.984+0000 7f2bd67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:49.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.984+0000 7f2bd67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:49.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.985+0000 7f2bd77fe640 10 monclient(hunting): handle_auth_done global_id 5232 payload 824 2026-02-17T21:30:49.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.985+0000 7f2bd77fe640 1 -- 10.20.193.5:0/2569775138 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2bd80c7170 msgr2=0x7f2bd8156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.985+0000 7f2bd77fe640 1 --2- 10.20.193.5:0/2569775138 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2bd80c7170 0x7f2bd8156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.985+0000 7f2bd77fe640 1 -- 10.20.193.5:0/2569775138 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2bd8074ef0 msgr2=0x7f2bd815d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.985+0000 7f2bd77fe640 1 --2- 10.20.193.5:0/2569775138 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2bd8074ef0 0x7f2bd815d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.985+0000 7f2bd77fe640 10 monclient: _finish_hunting 0 2026-02-17T21:30:49.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.985+0000 7f2bd77fe640 1 monclient: found mon.noname-a 2026-02-17T21:30:49.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.985+0000 7f2bd77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:49.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.985+0000 7f2bd77fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:49.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.985+0000 7f2bd77fe640 1 -- 10.20.193.5:0/2569775138 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd8155ba0 con 0x7f2bd80c7550 2026-02-17T21:30:49.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.986+0000 7f2bd77fe640 1 --2- 10.20.193.5:0/2569775138 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2bd80c7550 0x7f2bd806d5f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2bc800efc0 tx=0x7f2bc800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:49.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.986+0000 7f2bb77fe640 10 client.?.objecter ms_handle_connect 0x7f2bd80c7550 2026-02-17T21:30:49.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.986+0000 7f2bb77fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:49.005 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bb77fe640 1 -- 10.20.193.5:0/2569775138 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8018020 con 0x7f2bd80c7550 2026-02-17T21:30:49.005 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bb77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:49.005 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bb77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:49.005 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bb77fe640 10 monclient: dump: 2026-02-17T21:30:49.006 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:49.006 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:49.006 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.006 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.006 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:49.006 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.006 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:49.006 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:49.006 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:49.006 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.006 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bb77fe640 10 monclient: _finish_auth 0 2026-02-17T21:30:49.006 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bb77fe640 10 monclient: _check_auth_tickets 2026-02-17T21:30:49.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bb77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:49.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bb77fe640 1 -- 10.20.193.5:0/2569775138 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bc8014480 con 0x7f2bd80c7550 2026-02-17T21:30:49.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bdd4ae640 5 monclient: authenticate success, global_id 5232 2026-02-17T21:30:49.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bdd4ae640 10 monclient: _renew_subs 2026-02-17T21:30:49.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bdd4ae640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:49.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bdd4ae640 1 -- 10.20.193.5:0/2569775138 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bd806f470 con 0x7f2bd80c7550 2026-02-17T21:30:49.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bb77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:49.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bb77fe640 1 -- 10.20.193.5:0/2569775138 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8014870 con 0x7f2bd80c7550 2026-02-17T21:30:49.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bb77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:49.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bb77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:49.007 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bb77fe640 10 monclient: dump: 2026-02-17T21:30:49.007 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:49.008 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:49.008 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.008 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.008 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:49.008 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.008 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:49.008 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:49.008 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:49.008 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bd57fa640 4 set_mon_vals no callback set 2026-02-17T21:30:49.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bdd4ae640 10 client.5232.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:49.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bdd4ae640 10 monclient: _renew_subs 2026-02-17T21:30:49.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bdd4ae640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:49.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bdd4ae640 1 -- 10.20.193.5:0/2569775138 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bd81560f0 con 0x7f2bd80c7550 2026-02-17T21:30:49.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bdd4ae640 1 librados: init done 2026-02-17T21:30:49.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bdd4ae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:49.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bdd4ae640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:49.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bdd4ae640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:49.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:48.990+0000 7f2bdd4ae640 1 -- 10.20.193.5:0/2569775138 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bd80749b0 con 0x7f2bd80c7550 2026-02-17T21:30:49.098 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.096+0000 7f2bb77fe640 1 -- 10.20.193.5:0/2569775138 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f2bc8014a10 con 0x7f2bd80c7550 2026-02-17T21:30:49.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.096+0000 7f2bb77fe640 1 --2- 10.20.193.5:0/2569775138 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2ba40792d0 0x7f2ba407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:49.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.097+0000 7f2bd6ffd640 1 --2- 10.20.193.5:0/2569775138 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2ba40792d0 0x7f2ba407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.097+0000 7f2bd6ffd640 10 monclient: get_auth_request con 0x7f2ba40792d0 auth_method 0 2026-02-17T21:30:49.099 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.097+0000 7f2bd6ffd640 1 --2- 10.20.193.5:0/2569775138 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2ba40792d0 0x7f2ba407b790 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2bd80c51a0 tx=0x7f2bcc007f50 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:49.100 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.097+0000 7f2bb77fe640 10 client.5232.objecter ms_handle_connect 0x7f2ba40792d0 2026-02-17T21:30:49.106 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.104+0000 7f2bb77fe640 1 -- 10.20.193.5:0/2569775138 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f2bc805f1d0 con 0x7f2bd80c7550 2026-02-17T21:30:49.106 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.104+0000 7f2bb77fe640 10 client.5232.objecter ms_dispatch2 0x7f2bd8000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:49.106 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.104+0000 7f2bb77fe640 3 client.5232.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:49.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.104+0000 7f2bb77fe640 3 client.5232.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:49.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.104+0000 7f2bb77fe640 20 client.5232.objecter dump_active .. 0 homeless 2026-02-17T21:30:49.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.104+0000 7f2bb77fe640 1 -- 10.20.193.5:0/2569775138 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2bc8022030 con 0x7f2bd80c7550 2026-02-17T21:30:49.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.104+0000 7f2bb77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:49.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.104+0000 7f2bb77fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:49.189 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.187+0000 7f2bdd4ae640 1 -- 10.20.193.5:0/2569775138 --> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f2bd81546f0 con 0x7f2ba40792d0 2026-02-17T21:30:49.190 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.187+0000 7f2bb77fe640 1 -- 10.20.193.5:0/2569775138 <== mgr.4131 v2:10.20.193.176:6800/2898618020 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2bcc002b90 con 0x7f2ba40792d0 2026-02-17T21:30:49.190 INFO:teuthology.orchestra.run.trial005.stderr:instructed osd(s) 6 to deep-scrub 2026-02-17T21:30:49.191 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.188+0000 7f2bdd4ae640 10 librados: watch_flush enter 2026-02-17T21:30:49.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.188+0000 7f2bdd4ae640 10 librados: watch_flush exit 2026-02-17T21:30:49.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.188+0000 7f2bdd4ae640 20 client.5232.objecter shutdown clearing up homeless session... 2026-02-17T21:30:49.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.188+0000 7f2bdd4ae640 10 client.5232.objecter successfully canceled tick 2026-02-17T21:30:49.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.188+0000 7f2bdd4ae640 1 -- 10.20.193.5:0/2569775138 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2ba40792d0 msgr2=0x7f2ba407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.188+0000 7f2bdd4ae640 1 --2- 10.20.193.5:0/2569775138 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2ba40792d0 0x7f2ba407b790 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2bd80c51a0 tx=0x7f2bcc007f50 comp rx=0 tx=0).stop 2026-02-17T21:30:49.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.188+0000 7f2bdd4ae640 10 monclient: shutdown 2026-02-17T21:30:49.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.188+0000 7f2bdd4ae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:49.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.188+0000 7f2bdd4ae640 1 -- 10.20.193.5:0/2569775138 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2bd80c7550 msgr2=0x7f2bd806d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.188+0000 7f2bdd4ae640 1 --2- 10.20.193.5:0/2569775138 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2bd80c7550 0x7f2bd806d5f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2bc800efc0 tx=0x7f2bc800c490 comp rx=0 tx=0).stop 2026-02-17T21:30:49.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.188+0000 7f2bdd4ae640 1 -- 10.20.193.5:0/2569775138 shutdown_connections 2026-02-17T21:30:49.192 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.188+0000 7f2bdd4ae640 1 --2- 10.20.193.5:0/2569775138 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f2ba40792d0 0x7f2ba407b790 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.188+0000 7f2bdd4ae640 1 --2- 10.20.193.5:0/2569775138 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f2bd80c7550 0x7f2bd806d5f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.188+0000 7f2bdd4ae640 1 --2- 10.20.193.5:0/2569775138 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f2bd80c7170 0x7f2bd8156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.188+0000 7f2bdd4ae640 1 --2- 10.20.193.5:0/2569775138 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2bd8074ef0 0x7f2bd815d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.188+0000 7f2bdd4ae640 1 -- 10.20.193.5:0/2569775138 >> 10.20.193.5:0/2569775138 conn(0x7f2bd80c9f40 msgr2=0x7f2bd80cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:49.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.188+0000 7f2bdd4ae640 1 -- 10.20.193.5:0/2569775138 shutdown_connections 2026-02-17T21:30:49.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.188+0000 7f2bdd4ae640 1 -- 10.20.193.5:0/2569775138 wait complete. 2026-02-17T21:30:49.193 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.188+0000 7f2bdd4ae640 1 librados: shutdown 2026-02-17T21:30:49.199 INFO:tasks.ceph:Scrubbing osd.10 2026-02-17T21:30:49.199 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:30:49.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.268+0000 7fac8e62b640 10 monclient: get_monmap_and_config 2026-02-17T21:30:49.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.268+0000 7fac8e62b640 10 monclient: build_initial_monmap 2026-02-17T21:30:49.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.268+0000 7fac8e62b640 10 monclient: monmap: 2026-02-17T21:30:49.271 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:49.271 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:49.271 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:49.270547+0000 2026-02-17T21:30:49.271 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:49.270547+0000 2026-02-17T21:30:49.272 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:49.272 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.272 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:49.272 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:49.272 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:49.272 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:49.272 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:49.272 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:49.272 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.269+0000 7fac8e62b640 1 Processor -- start 2026-02-17T21:30:49.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.269+0000 7fac8e62b640 1 -- start start 2026-02-17T21:30:49.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.269+0000 7fac8e62b640 10 monclient: init 2026-02-17T21:30:49.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.269+0000 7fac8e62b640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:49.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.269+0000 7fac8e62b640 10 monclient: _add_conns ranks=[3,1,4,0,2,5] 2026-02-17T21:30:49.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.269+0000 7fac8e62b640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fac88152570 0x7fac8815d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:49.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.269+0000 7fac8e62b640 10 monclient(hunting): picked mon.noname-a con 0x7fac88152570 addr v2:10.20.193.5:3300/0 2026-02-17T21:30:49.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.269+0000 7fac8e62b640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fac88152950 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:49.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.269+0000 7fac8e62b640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fac8815fa20 0x7fac880744d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:49.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.269+0000 7fac8e62b640 10 monclient(hunting): picked mon.noname-b con 0x7fac8815fa20 addr v2:10.20.193.119:3300/0 2026-02-17T21:30:49.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.269+0000 7fac8e62b640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac88073150 con 0x7fac88152950 2026-02-17T21:30:49.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.269+0000 7fac8e62b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:49.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.269+0000 7fac8e62b640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fac88074040 con 0x7fac88152570 2026-02-17T21:30:49.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.269+0000 7fac8e62b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:49.276 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.269+0000 7fac8e62b640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fac88073430 con 0x7fac8815fa20 2026-02-17T21:30:49.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.269+0000 7fac8e62b640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:49.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.269+0000 7fac8e62b640 10 monclient(hunting): authenticate will time out at 1354.835991s 2026-02-17T21:30:49.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.270+0000 7fac8cba1640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fac8815fa20 0x7fac880744d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.270+0000 7fac87fff640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fac88152570 0x7fac8815d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.270+0000 7fac87fff640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fac88152570 0x7fac8815d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48356/0 (socket says 10.20.193.5:48356) 2026-02-17T21:30:49.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.270+0000 7fac87fff640 1 -- 10.20.193.5:0/4051999794 learned_addr learned my addr 10.20.193.5:0/4051999794 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:49.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.270+0000 7fac87fff640 10 monclient(hunting): get_auth_request con 0x7fac88152570 auth_method 0 2026-02-17T21:30:49.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.270+0000 7fac87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:49.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.270+0000 7fac87fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:49.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.270+0000 7fac87fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:49.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.270+0000 7fac8cba1640 10 monclient(hunting): get_auth_request con 0x7fac8815fa20 auth_method 0 2026-02-17T21:30:49.277 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.270+0000 7fac8cba1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:49.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.270+0000 7fac8cba1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:49.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.270+0000 7fac8cba1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:49.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.271+0000 7fac87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:49.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.271+0000 7fac87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:49.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.271+0000 7fac87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:49.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.271+0000 7fac8cba1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:49.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.271+0000 7fac8cba1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:49.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.271+0000 7fac8cba1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:49.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.272+0000 7fac8cba1640 10 monclient(hunting): handle_auth_done global_id 5302 payload 274 2026-02-17T21:30:49.278 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.272+0000 7fac8cba1640 1 -- 10.20.193.5:0/4051999794 >> v2:10.20.193.5:3300/0 conn(0x7fac88152570 msgr2=0x7fac8815d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:49.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.272+0000 7fac8cba1640 1 --2- 10.20.193.5:0/4051999794 >> v2:10.20.193.5:3300/0 conn(0x7fac88152570 0x7fac8815d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.272+0000 7fac8cba1640 1 -- 10.20.193.5:0/4051999794 >> v1:10.20.193.119:6789/0 conn(0x7fac88152950 legacy=0x7fac8815f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.272+0000 7fac8cba1640 10 monclient: _finish_hunting 0 2026-02-17T21:30:49.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.272+0000 7fac8cba1640 1 monclient: found mon.noname-b 2026-02-17T21:30:49.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.272+0000 7fac8cba1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:49.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.272+0000 7fac8cba1640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:30:49.279 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.272+0000 7fac8cba1640 1 -- 10.20.193.5:0/4051999794 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac88073710 con 0x7fac8815fa20 2026-02-17T21:30:49.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.274+0000 7fac8cba1640 1 --2- 10.20.193.5:0/4051999794 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fac8815fa20 0x7fac880744d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fac88160010 tx=0x7fac7c02f250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e24c4ba074d72ee server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:49.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.275+0000 7fac86ffd640 1 -- 10.20.193.5:0/4051999794 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c03c070 con 0x7fac8815fa20 2026-02-17T21:30:49.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.275+0000 7fac86ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:49.287 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.275+0000 7fac86ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:30:49.288 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.275+0000 7fac86ffd640 10 monclient: dump: 2026-02-17T21:30:49.288 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:49.288 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:49.288 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.288 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.288 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:49.288 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.288 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:49.288 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:49.288 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:49.288 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.275+0000 7fac86ffd640 10 monclient: _finish_auth 0 2026-02-17T21:30:49.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.275+0000 7fac86ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:30:49.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.275+0000 7fac86ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:49.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.275+0000 7fac86ffd640 1 -- 10.20.193.5:0/4051999794 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac7c037440 con 0x7fac8815fa20 2026-02-17T21:30:49.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.275+0000 7fac86ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:49.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.275+0000 7fac86ffd640 1 -- 10.20.193.5:0/4051999794 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c037810 con 0x7fac8815fa20 2026-02-17T21:30:49.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.275+0000 7fac86ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:49.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.275+0000 7fac86ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:30:49.289 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.275+0000 7fac86ffd640 10 monclient: dump: 2026-02-17T21:30:49.289 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:49.289 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:49.289 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.290 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.290 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:49.290 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.290 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:49.290 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:49.290 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:49.290 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.275+0000 7fac8e62b640 5 monclient: authenticate success, global_id 5302 2026-02-17T21:30:49.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.275+0000 7fac8e62b640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:49.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.275+0000 7fac8e62b640 4 set_mon_vals no callback set 2026-02-17T21:30:49.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.276+0000 7fac8e62b640 10 monclient: shutdown 2026-02-17T21:30:49.290 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.276+0000 7fac8e62b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:49.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.276+0000 7fac8e62b640 1 -- 10.20.193.5:0/4051999794 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fac8815fa20 msgr2=0x7fac880744d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.276+0000 7fac8e62b640 1 --2- 10.20.193.5:0/4051999794 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fac8815fa20 0x7fac880744d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fac88160010 tx=0x7fac7c02f250 comp rx=0 tx=0).stop 2026-02-17T21:30:49.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.276+0000 7fac8e62b640 1 -- 10.20.193.5:0/4051999794 shutdown_connections 2026-02-17T21:30:49.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.276+0000 7fac8e62b640 1 --2- 10.20.193.5:0/4051999794 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fac8815fa20 0x7fac880744d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.276+0000 7fac8e62b640 1 --2- 10.20.193.5:0/4051999794 >> v2:10.20.193.5:3300/0 conn(0x7fac88152570 0x7fac8815d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.276+0000 7fac8e62b640 1 -- 10.20.193.5:0/4051999794 >> 10.20.193.5:0/4051999794 conn(0x7fac880ca6c0 msgr2=0x7fac880caad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:49.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.276+0000 7fac8e62b640 1 -- 10.20.193.5:0/4051999794 shutdown_connections 2026-02-17T21:30:49.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.276+0000 7fac8e62b640 1 -- 10.20.193.5:0/4051999794 wait complete. 2026-02-17T21:30:49.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.276+0000 7fac8e62b640 10 monclient: build_initial_monmap 2026-02-17T21:30:49.291 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.276+0000 7fac8e62b640 10 monclient: monmap: 2026-02-17T21:30:49.291 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:49.291 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:49.292 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:49.292 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:49.292 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:49.292 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.292 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:49.292 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:49.292 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:49.292 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.276+0000 7fac8e62b640 1 librados: starting msgr at 2026-02-17T21:30:49.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.276+0000 7fac8e62b640 1 librados: starting objecter 2026-02-17T21:30:49.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.276+0000 7fac8e62b640 1 Processor -- start 2026-02-17T21:30:49.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac8e62b640 1 -- start start 2026-02-17T21:30:49.292 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac8e62b640 1 librados: setting wanted keys 2026-02-17T21:30:49.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac8e62b640 1 librados: calling monclient init 2026-02-17T21:30:49.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac8e62b640 10 monclient: init 2026-02-17T21:30:49.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac8e62b640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:49.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac8e62b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:30:49.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac8e62b640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fac88152570 0x7fac8814d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:49.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac8e62b640 10 monclient(hunting): picked mon.noname-c con 0x7fac88152570 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:49.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac8e62b640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fac88152950 0x7fac881f3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:49.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac8e62b640 10 monclient(hunting): picked mon.noname-a con 0x7fac88152950 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:49.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac8e62b640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fac8815fa20 0x7fac881f4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:49.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac8e62b640 10 monclient(hunting): picked mon.noname-b con 0x7fac8815fa20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:49.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac8e62b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:49.293 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac8e62b640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fac88072d40 con 0x7fac88152950 2026-02-17T21:30:49.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac8e62b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:49.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac8e62b640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fac88073cd0 con 0x7fac8815fa20 2026-02-17T21:30:49.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac8e62b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:49.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac8e62b640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fac88072ec0 con 0x7fac88152570 2026-02-17T21:30:49.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac8e62b640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:49.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac8e62b640 10 monclient(hunting): authenticate will time out at 1354.843442s 2026-02-17T21:30:49.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac877fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fac88152950 0x7fac881f3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac8cba1640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fac8815fa20 0x7fac881f4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac87fff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fac88152570 0x7fac8814d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac877fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fac88152950 0x7fac881f3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48362/0 (socket says 10.20.193.5:48362) 2026-02-17T21:30:49.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac877fe640 1 -- 10.20.193.5:0/3318932611 learned_addr learned my addr 10.20.193.5:0/3318932611 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:49.294 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac877fe640 10 monclient(hunting): get_auth_request con 0x7fac88152950 auth_method 0 2026-02-17T21:30:49.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:49.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac877fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:49.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:49.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac8cba1640 10 monclient(hunting): get_auth_request con 0x7fac8815fa20 auth_method 0 2026-02-17T21:30:49.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac8cba1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:49.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac8cba1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:49.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.277+0000 7fac8cba1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:49.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.278+0000 7fac87fff640 10 monclient(hunting): get_auth_request con 0x7fac88152570 auth_method 0 2026-02-17T21:30:49.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.278+0000 7fac87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:49.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.278+0000 7fac87fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:49.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.278+0000 7fac87fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:49.295 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.278+0000 7fac877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:49.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.278+0000 7fac877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:49.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.278+0000 7fac877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:49.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.278+0000 7fac8cba1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:49.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.278+0000 7fac8cba1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:49.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.278+0000 7fac8cba1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:49.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.278+0000 7fac87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:49.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.278+0000 7fac87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:49.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.278+0000 7fac87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:49.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.279+0000 7fac8cba1640 10 monclient(hunting): handle_auth_done global_id 5308 payload 824 2026-02-17T21:30:49.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.279+0000 7fac8cba1640 1 -- 10.20.193.5:0/3318932611 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fac88152570 msgr2=0x7fac8814d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.279+0000 7fac8cba1640 1 --2- 10.20.193.5:0/3318932611 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fac88152570 0x7fac8814d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.296 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.279+0000 7fac8cba1640 1 -- 10.20.193.5:0/3318932611 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fac88152950 msgr2=0x7fac881f3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.279+0000 7fac8cba1640 1 --2- 10.20.193.5:0/3318932611 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fac88152950 0x7fac881f3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.279+0000 7fac8cba1640 10 monclient: _finish_hunting 0 2026-02-17T21:30:49.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.279+0000 7fac8cba1640 1 monclient: found mon.noname-b 2026-02-17T21:30:49.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.279+0000 7fac8cba1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:49.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.279+0000 7fac8cba1640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:30:49.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.279+0000 7fac8cba1640 1 -- 10.20.193.5:0/3318932611 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac881f7100 con 0x7fac8815fa20 2026-02-17T21:30:49.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.280+0000 7fac8cba1640 1 --2- 10.20.193.5:0/3318932611 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fac8815fa20 0x7fac881f4430 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fac7c036000 tx=0x7fac7c004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:49.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.280+0000 7fac84ff9640 10 client.?.objecter ms_handle_connect 0x7fac8815fa20 2026-02-17T21:30:49.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.280+0000 7fac84ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:49.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.281+0000 7fac84ff9640 1 -- 10.20.193.5:0/3318932611 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c03c050 con 0x7fac8815fa20 2026-02-17T21:30:49.297 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.281+0000 7fac84ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:49.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.281+0000 7fac84ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:30:49.298 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.281+0000 7fac84ff9640 10 monclient: dump: 2026-02-17T21:30:49.298 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:49.298 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:49.298 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.298 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.298 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:49.298 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.298 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:49.298 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:49.298 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:49.298 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.281+0000 7fac84ff9640 10 monclient: _finish_auth 0 2026-02-17T21:30:49.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.281+0000 7fac84ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:30:49.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.281+0000 7fac84ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:49.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.281+0000 7fac8e62b640 5 monclient: authenticate success, global_id 5308 2026-02-17T21:30:49.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.281+0000 7fac8e62b640 10 monclient: _renew_subs 2026-02-17T21:30:49.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.281+0000 7fac8e62b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:49.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.281+0000 7fac8e62b640 1 -- 10.20.193.5:0/3318932611 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac881f73e0 con 0x7fac8815fa20 2026-02-17T21:30:49.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.281+0000 7fac8e62b640 10 client.5308.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:49.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.281+0000 7fac8e62b640 10 monclient: _renew_subs 2026-02-17T21:30:49.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.281+0000 7fac8e62b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:49.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.281+0000 7fac8e62b640 1 -- 10.20.193.5:0/3318932611 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac881f79a0 con 0x7fac8815fa20 2026-02-17T21:30:49.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.281+0000 7fac8e62b640 1 librados: init done 2026-02-17T21:30:49.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.282+0000 7fac84ff9640 1 -- 10.20.193.5:0/3318932611 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac7c048070 con 0x7fac8815fa20 2026-02-17T21:30:49.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.282+0000 7fac84ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:49.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.282+0000 7fac84ff9640 1 -- 10.20.193.5:0/3318932611 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c041a10 con 0x7fac8815fa20 2026-02-17T21:30:49.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.282+0000 7fac84ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:49.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.282+0000 7fac84ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:30:49.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.282+0000 7fac867fc640 4 set_mon_vals no callback set 2026-02-17T21:30:49.300 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.282+0000 7fac84ff9640 10 monclient: dump: 2026-02-17T21:30:49.300 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:49.300 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:49.300 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.300 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.300 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:49.301 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.301 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:49.301 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:49.301 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:49.301 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.282+0000 7fac8e62b640 10 client.5308.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:49.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.282+0000 7fac8e62b640 15 client.5308.objecter _session_command_op_assign -1 1 2026-02-17T21:30:49.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.282+0000 7fac8e62b640 20 client.5308.objecter _get_session osd=-1 returning homeless 2026-02-17T21:30:49.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.282+0000 7fac8e62b640 10 client.5308.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:49.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.282+0000 7fac8e62b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:49.301 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.282+0000 7fac8e62b640 1 -- 10.20.193.5:0/3318932611 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fac8815daa0 con 0x7fac8815fa20 2026-02-17T21:30:49.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.293+0000 7fac84ff9640 1 -- 10.20.193.5:0/3318932611 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fac7c041bb0 con 0x7fac8815fa20 2026-02-17T21:30:49.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.294+0000 7fac84ff9640 1 --2- 10.20.193.5:0/3318932611 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fac58079280 0x7fac5807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:49.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.294+0000 7fac87fff640 1 --2- 10.20.193.5:0/3318932611 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fac58079280 0x7fac5807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.294+0000 7fac87fff640 10 monclient: get_auth_request con 0x7fac58079280 auth_method 0 2026-02-17T21:30:49.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.295+0000 7fac87fff640 1 --2- 10.20.193.5:0/3318932611 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fac58079280 0x7fac5807b740 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fac74006fd0 tx=0x7fac74009340 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:49.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.295+0000 7fac84ff9640 10 client.5308.objecter ms_handle_connect 0x7fac58079280 2026-02-17T21:30:49.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.295+0000 7fac84ff9640 1 -- 10.20.193.5:0/3318932611 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fac7c0be380 con 0x7fac8815fa20 2026-02-17T21:30:49.304 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.295+0000 7fac84ff9640 10 client.5308.objecter ms_dispatch2 0x7fac88000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:49.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.295+0000 7fac84ff9640 3 client.5308.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:49.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.295+0000 7fac84ff9640 3 client.5308.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:49.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.295+0000 7fac84ff9640 10 client.5308.objecter checking command 1 2026-02-17T21:30:49.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.295+0000 7fac84ff9640 1 --2- 10.20.193.5:0/3318932611 >> [v2:10.20.193.135:6800/3469915965,v1:10.20.193.135:6801/3469915965] conn(0x7fac58081760 0x7fac58083b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:49.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.295+0000 7fac84ff9640 20 client.5308.objecter _get_session s=0x7fac58081090 osd=10 3 2026-02-17T21:30:49.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.295+0000 7fac84ff9640 20 client.5308.objecter put_session s=0x7fac58081090 osd=10 3 2026-02-17T21:30:49.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.295+0000 7fac84ff9640 15 client.5308.objecter _session_command_op_remove -1 1 2026-02-17T21:30:49.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.295+0000 7fac84ff9640 20 client.5308.objecter _get_session s=0x7fac58081090 osd=10 3 2026-02-17T21:30:49.305 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.295+0000 7fac84ff9640 20 client.5308.objecter get_session s=0x7fac58081090 osd=10 3 2026-02-17T21:30:49.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.295+0000 7fac84ff9640 15 client.5308.objecter _session_command_op_assign 10 1 2026-02-17T21:30:49.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.295+0000 7fac84ff9640 20 client.5308.objecter put_session s=0x7fac58081090 osd=10 4 2026-02-17T21:30:49.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.295+0000 7fac84ff9640 10 client.5308.objecter _send_command 1 2026-02-17T21:30:49.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.295+0000 7fac84ff9640 1 -- 10.20.193.5:0/3318932611 --> [v2:10.20.193.135:6800/3469915965,v1:10.20.193.135:6801/3469915965] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac7c037440 con 0x7fac58081760 2026-02-17T21:30:49.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.295+0000 7fac84ff9640 20 client.5308.objecter dump_active .. 0 homeless 2026-02-17T21:30:49.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.295+0000 7fac84ff9640 1 -- 10.20.193.5:0/3318932611 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fac7c084e30 con 0x7fac8815fa20 2026-02-17T21:30:49.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.295+0000 7fac84ff9640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T21:30:49.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.296+0000 7fac877fe640 1 --2- 10.20.193.5:0/3318932611 >> [v2:10.20.193.135:6800/3469915965,v1:10.20.193.135:6801/3469915965] conn(0x7fac58081760 0x7fac58083b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.296+0000 7fac877fe640 10 monclient: get_auth_request con 0x7fac58081760 auth_method 0 2026-02-17T21:30:49.306 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.299+0000 7fac84ff9640 10 client.5308.objecter ms_handle_connect 0x7fac58081760 2026-02-17T21:30:49.307 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.299+0000 7fac877fe640 1 --2- 10.20.193.5:0/3318932611 >> [v2:10.20.193.135:6800/3469915965,v1:10.20.193.135:6801/3469915965] conn(0x7fac58081760 0x7fac58083b80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:49.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.309+0000 7fac84ff9640 1 -- 10.20.193.5:0/3318932611 <== osd.10 v2:10.20.193.135:6800/3469915965 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fac7c037440 con 0x7fac58081760 2026-02-17T21:30:49.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.309+0000 7fac84ff9640 10 client.5308.objecter ms_dispatch2 0x7fac88000b90 command_reply(tid 1: 0 ) 2026-02-17T21:30:49.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.309+0000 7fac84ff9640 10 client.5308.objecter _finish_command 1 = system:0 2026-02-17T21:30:49.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.309+0000 7fac84ff9640 20 client.5308.objecter put_session s=0x7fac58081090 osd=10 4 2026-02-17T21:30:49.310 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.309+0000 7fac84ff9640 15 client.5308.objecter _session_command_op_remove 10 1 2026-02-17T21:30:49.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.314+0000 7fac8e62b640 10 client.5308.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:30:49.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.314+0000 7fac8e62b640 15 client.5308.objecter _session_command_op_assign -1 2 2026-02-17T21:30:49.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.314+0000 7fac8e62b640 20 client.5308.objecter _get_session s=0x7fac58081090 osd=10 3 2026-02-17T21:30:49.316 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.314+0000 7fac8e62b640 20 client.5308.objecter put_session s=0x7fac58081090 osd=10 3 2026-02-17T21:30:49.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.314+0000 7fac8e62b640 20 client.5308.objecter _get_session s=0x7fac58081090 osd=10 3 2026-02-17T21:30:49.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.314+0000 7fac8e62b640 15 client.5308.objecter _session_command_op_remove -1 2 2026-02-17T21:30:49.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.314+0000 7fac8e62b640 20 client.5308.objecter get_session s=0x7fac58081090 osd=10 3 2026-02-17T21:30:49.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.314+0000 7fac8e62b640 15 client.5308.objecter _session_command_op_assign 10 2 2026-02-17T21:30:49.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.314+0000 7fac8e62b640 20 client.5308.objecter put_session s=0x7fac58081090 osd=10 4 2026-02-17T21:30:49.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.314+0000 7fac8e62b640 10 client.5308.objecter _send_command 2 2026-02-17T21:30:49.317 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.314+0000 7fac8e62b640 1 -- 10.20.193.5:0/3318932611 --> [v2:10.20.193.135:6800/3469915965,v1:10.20.193.135:6801/3469915965] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fac880715d0 con 0x7fac58081760 2026-02-17T21:30:49.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.321+0000 7fac84ff9640 1 -- 10.20.193.5:0/3318932611 <== osd.10 v2:10.20.193.135:6800/3469915965 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fac880715d0 con 0x7fac58081760 2026-02-17T21:30:49.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.321+0000 7fac84ff9640 10 client.5308.objecter ms_dispatch2 0x7fac88000b90 command_reply(tid 2: 0 ) 2026-02-17T21:30:49.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.321+0000 7fac84ff9640 10 client.5308.objecter _finish_command 2 = system:0 2026-02-17T21:30:49.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.321+0000 7fac84ff9640 20 client.5308.objecter put_session s=0x7fac58081090 osd=10 4 2026-02-17T21:30:49.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.321+0000 7fac84ff9640 15 client.5308.objecter _session_command_op_remove 10 2 2026-02-17T21:30:49.324 INFO:teuthology.orchestra.run.trial005.stdout:{ 2026-02-17T21:30:49.324 INFO:teuthology.orchestra.run.trial005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:30:49.324 INFO:teuthology.orchestra.run.trial005.stdout:} 2026-02-17T21:30:49.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.321+0000 7fac8e62b640 10 librados: watch_flush enter 2026-02-17T21:30:49.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.321+0000 7fac8e62b640 10 librados: watch_flush exit 2026-02-17T21:30:49.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.321+0000 7fac8e62b640 10 client.5308.objecter close_session for osd.10 2026-02-17T21:30:49.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.321+0000 7fac8e62b640 1 -- 10.20.193.5:0/3318932611 >> [v2:10.20.193.135:6800/3469915965,v1:10.20.193.135:6801/3469915965] conn(0x7fac58081760 msgr2=0x7fac58083b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.321+0000 7fac8e62b640 1 --2- 10.20.193.5:0/3318932611 >> [v2:10.20.193.135:6800/3469915965,v1:10.20.193.135:6801/3469915965] conn(0x7fac58081760 0x7fac58083b80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.321+0000 7fac8e62b640 20 client.5308.objecter put_session s=0x7fac58081090 osd=10 1 2026-02-17T21:30:49.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.321+0000 7fac8e62b640 20 client.5308.objecter shutdown clearing up homeless session... 2026-02-17T21:30:49.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.321+0000 7fac8e62b640 10 client.5308.objecter successfully canceled tick 2026-02-17T21:30:49.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.321+0000 7fac8e62b640 1 -- 10.20.193.5:0/3318932611 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fac58079280 msgr2=0x7fac5807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.321+0000 7fac8e62b640 1 --2- 10.20.193.5:0/3318932611 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fac58079280 0x7fac5807b740 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fac74006fd0 tx=0x7fac74009340 comp rx=0 tx=0).stop 2026-02-17T21:30:49.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.321+0000 7fac8e62b640 10 monclient: shutdown 2026-02-17T21:30:49.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.321+0000 7fac8e62b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:49.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.321+0000 7fac8e62b640 1 -- 10.20.193.5:0/3318932611 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fac8815fa20 msgr2=0x7fac881f4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.321+0000 7fac8e62b640 1 --2- 10.20.193.5:0/3318932611 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fac8815fa20 0x7fac881f4430 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fac7c036000 tx=0x7fac7c004b40 comp rx=0 tx=0).stop 2026-02-17T21:30:49.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.321+0000 7fac8cba1640 1 -- 10.20.193.5:0/3318932611 reap_dead start 2026-02-17T21:30:49.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.321+0000 7fac8e62b640 1 -- 10.20.193.5:0/3318932611 shutdown_connections 2026-02-17T21:30:49.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.321+0000 7fac8e62b640 1 -- 10.20.193.5:0/3318932611 >> 10.20.193.5:0/3318932611 conn(0x7fac880ca6c0 msgr2=0x7fac880704d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:49.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.321+0000 7fac8e62b640 1 -- 10.20.193.5:0/3318932611 shutdown_connections 2026-02-17T21:30:49.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.321+0000 7fac8e62b640 1 -- 10.20.193.5:0/3318932611 wait complete. 2026-02-17T21:30:49.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.321+0000 7fac8e62b640 1 librados: shutdown 2026-02-17T21:30:49.331 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 10 2026-02-17T21:30:49.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.398+0000 7f18d0d55640 10 monclient: get_monmap_and_config 2026-02-17T21:30:49.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.398+0000 7f18d0d55640 10 monclient: build_initial_monmap 2026-02-17T21:30:49.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.398+0000 7f18d0d55640 10 monclient: monmap: 2026-02-17T21:30:49.401 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:49.401 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:49.401 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:49.400567+0000 2026-02-17T21:30:49.402 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:49.400567+0000 2026-02-17T21:30:49.402 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:49.402 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.402 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:49.402 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:49.402 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:49.402 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:49.402 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:49.402 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:49.402 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.399+0000 7f18d0d55640 1 Processor -- start 2026-02-17T21:30:49.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.399+0000 7f18d0d55640 1 -- start start 2026-02-17T21:30:49.405 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.399+0000 7f18d0d55640 10 monclient: init 2026-02-17T21:30:49.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.399+0000 7f18d0d55640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:49.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.399+0000 7f18d0d55640 10 monclient: _add_conns ranks=[3,4,1,2,5,0] 2026-02-17T21:30:49.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.399+0000 7f18d0d55640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f18cc152820 0x7f18cc1593f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:49.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.399+0000 7f18d0d55640 10 monclient(hunting): picked mon.noname-a con 0x7f18cc152820 addr v2:10.20.193.5:3300/0 2026-02-17T21:30:49.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.399+0000 7f18d0d55640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f18cc152c00 0x7f18cc0c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:49.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.399+0000 7f18d0d55640 10 monclient(hunting): picked mon.noname-b con 0x7f18cc152c00 addr v2:10.20.193.119:3300/0 2026-02-17T21:30:49.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.399+0000 7f18d0d55640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f18cc0738f0 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:49.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.399+0000 7f18d0d55640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18cc073e90 con 0x7f18cc0738f0 2026-02-17T21:30:49.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.399+0000 7f18d0d55640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:49.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.399+0000 7f18d0d55640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f18cc159930 con 0x7f18cc152820 2026-02-17T21:30:49.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.399+0000 7f18d0d55640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:49.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.399+0000 7f18d0d55640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f18cc074170 con 0x7f18cc152c00 2026-02-17T21:30:49.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.399+0000 7f18d0d55640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:49.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.399+0000 7f18d0d55640 10 monclient(hunting): authenticate will time out at 1354.965862s 2026-02-17T21:30:49.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.400+0000 7f18ca575640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f18cc152820 0x7f18cc1593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.400+0000 7f18ca575640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f18cc152820 0x7f18cc1593f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48376/0 (socket says 10.20.193.5:48376) 2026-02-17T21:30:49.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.400+0000 7f18ca575640 1 -- 10.20.193.5:0/3151191313 learned_addr learned my addr 10.20.193.5:0/3151191313 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:49.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.400+0000 7f18ca575640 10 monclient(hunting): get_auth_request con 0x7f18cc152820 auth_method 0 2026-02-17T21:30:49.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.400+0000 7f18ca575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:49.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.400+0000 7f18ca575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:49.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.400+0000 7f18ca575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:49.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.400+0000 7f18ca575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:49.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.400+0000 7f18ca575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:49.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.400+0000 7f18ca575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:49.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.400+0000 7f18c9d74640 1 --2- 10.20.193.5:0/3151191313 >> v2:10.20.193.119:3300/0 conn(0x7f18cc152c00 0x7f18cc0c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.401+0000 7f18c9d74640 10 monclient(hunting): get_auth_request con 0x7f18cc152c00 auth_method 0 2026-02-17T21:30:49.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.401+0000 7f18c9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:49.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.401+0000 7f18c9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:49.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.401+0000 7f18c9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:49.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.401+0000 7f18ca575640 10 monclient(hunting): handle_auth_done global_id 5241 payload 274 2026-02-17T21:30:49.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.401+0000 7f18ca575640 1 -- 10.20.193.5:0/3151191313 >> v2:10.20.193.119:3300/0 conn(0x7f18cc152c00 msgr2=0x7f18cc0c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:49.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.401+0000 7f18ca575640 1 --2- 10.20.193.5:0/3151191313 >> v2:10.20.193.119:3300/0 conn(0x7f18cc152c00 0x7f18cc0c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.401+0000 7f18ca575640 1 -- 10.20.193.5:0/3151191313 >> v1:10.20.193.119:6789/0 conn(0x7f18cc0738f0 legacy=0x7f18cc0c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:49.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.401+0000 7f18ca575640 10 monclient: _finish_hunting 0 2026-02-17T21:30:49.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.401+0000 7f18ca575640 1 monclient: found mon.noname-a 2026-02-17T21:30:49.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.401+0000 7f18ca575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:49.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.401+0000 7f18ca575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:49.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.401+0000 7f18ca575640 1 -- 10.20.193.5:0/3151191313 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18cc074450 con 0x7f18cc152820 2026-02-17T21:30:49.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.402+0000 7f18ca575640 1 --2- 10.20.193.5:0/3151191313 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f18cc152820 0x7f18cc1593f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0cb010 tx=0x7f18c002ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d5c6be6284b49 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:49.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18c9573640 1 -- 10.20.193.5:0/3151191313 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c003c070 con 0x7f18cc152820 2026-02-17T21:30:49.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18c9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:49.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18c9573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:49.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18c9573640 10 monclient: dump: 2026-02-17T21:30:49.417 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:49.417 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:49.417 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.417 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.417 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:49.418 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.418 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:49.418 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:49.418 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:49.418 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18c9573640 10 monclient: _finish_auth 0 2026-02-17T21:30:49.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18c9573640 10 monclient: _check_auth_tickets 2026-02-17T21:30:49.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18c9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:49.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18c9573640 1 -- 10.20.193.5:0/3151191313 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c002fbd0 con 0x7f18cc152820 2026-02-17T21:30:49.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18d0d55640 5 monclient: authenticate success, global_id 5241 2026-02-17T21:30:49.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18d0d55640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:49.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18c9573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:49.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18c9573640 1 -- 10.20.193.5:0/3151191313 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c0037440 con 0x7f18cc152820 2026-02-17T21:30:49.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18c9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:49.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18c9573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:49.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18c9573640 10 monclient: dump: 2026-02-17T21:30:49.419 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:49.419 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:49.419 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.419 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.419 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:49.419 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.419 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:49.419 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:49.420 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:49.420 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18d0d55640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:49.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18d0d55640 4 set_mon_vals no callback set 2026-02-17T21:30:49.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18d0d55640 10 monclient: shutdown 2026-02-17T21:30:49.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18d0d55640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:49.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18d0d55640 1 -- 10.20.193.5:0/3151191313 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f18cc152820 msgr2=0x7f18cc1593f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18d0d55640 1 --2- 10.20.193.5:0/3151191313 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f18cc152820 0x7f18cc1593f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0cb010 tx=0x7f18c002ef60 comp rx=0 tx=0).stop 2026-02-17T21:30:49.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18d0d55640 1 -- 10.20.193.5:0/3151191313 shutdown_connections 2026-02-17T21:30:49.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18d0d55640 1 --2- 10.20.193.5:0/3151191313 >> v2:10.20.193.119:3300/0 conn(0x7f18cc152c00 0x7f18cc0c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18d0d55640 1 --2- 10.20.193.5:0/3151191313 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f18cc152820 0x7f18cc1593f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18d0d55640 1 -- 10.20.193.5:0/3151191313 >> 10.20.193.5:0/3151191313 conn(0x7f18cc0c9f40 msgr2=0x7f18cc0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:49.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18d0d55640 1 -- 10.20.193.5:0/3151191313 shutdown_connections 2026-02-17T21:30:49.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.404+0000 7f18d0d55640 1 -- 10.20.193.5:0/3151191313 wait complete. 2026-02-17T21:30:49.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.405+0000 7f18d0d55640 10 monclient: build_initial_monmap 2026-02-17T21:30:49.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.405+0000 7f18d0d55640 10 monclient: monmap: 2026-02-17T21:30:49.421 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:49.421 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:49.421 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:49.421 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:49.421 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:49.421 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.421 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:49.422 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:49.422 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:49.422 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.405+0000 7f18d0d55640 1 librados: starting msgr at 2026-02-17T21:30:49.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.405+0000 7f18d0d55640 1 librados: starting objecter 2026-02-17T21:30:49.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.405+0000 7f18d0d55640 1 Processor -- start 2026-02-17T21:30:49.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.405+0000 7f18d0d55640 1 -- start start 2026-02-17T21:30:49.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.405+0000 7f18d0d55640 1 librados: setting wanted keys 2026-02-17T21:30:49.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.405+0000 7f18d0d55640 1 librados: calling monclient init 2026-02-17T21:30:49.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.405+0000 7f18d0d55640 10 monclient: init 2026-02-17T21:30:49.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18d0d55640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:49.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18d0d55640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:30:49.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18d0d55640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f18cc0738f0 0x7f18cc06e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:49.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18d0d55640 10 monclient(hunting): picked mon.noname-a con 0x7f18cc0738f0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:49.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18d0d55640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f18cc152820 0x7f18cc1478b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:49.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18d0d55640 10 monclient(hunting): picked mon.noname-c con 0x7f18cc152820 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:49.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18d0d55640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f18cc152c00 0x7f18cc147df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:49.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18d0d55640 10 monclient(hunting): picked mon.noname-b con 0x7f18cc152c00 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:49.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18d0d55640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:49.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18d0d55640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc074cf0 con 0x7f18cc0738f0 2026-02-17T21:30:49.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18d0d55640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:49.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18d0d55640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc074a10 con 0x7f18cc152c00 2026-02-17T21:30:49.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18d0d55640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:49.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18d0d55640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc0c8380 con 0x7f18cc152820 2026-02-17T21:30:49.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18d0d55640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:49.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18d0d55640 10 monclient(hunting): authenticate will time out at 1354.972078s 2026-02-17T21:30:49.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18ca575640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f18cc0738f0 0x7f18cc06e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18cad76640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f18cc152c00 0x7f18cc147df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18ca575640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f18cc0738f0 0x7f18cc06e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48384/0 (socket says 10.20.193.5:48384) 2026-02-17T21:30:49.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18ca575640 1 -- 10.20.193.5:0/1673062190 learned_addr learned my addr 10.20.193.5:0/1673062190 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:49.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18ca575640 10 monclient(hunting): get_auth_request con 0x7f18cc0738f0 auth_method 0 2026-02-17T21:30:49.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18ca575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:49.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18ca575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:49.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18ca575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:49.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18c9d74640 1 --2- 10.20.193.5:0/1673062190 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f18cc152820 0x7f18cc1478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18cad76640 10 monclient(hunting): get_auth_request con 0x7f18cc152c00 auth_method 0 2026-02-17T21:30:49.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18cad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:49.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18cad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:49.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18cad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:49.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18ca575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:49.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18ca575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:49.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18ca575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:49.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18c9d74640 10 monclient(hunting): get_auth_request con 0x7f18cc152820 auth_method 0 2026-02-17T21:30:49.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18c9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:49.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18c9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:49.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18c9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:49.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18cad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:49.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.406+0000 7f18cad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:49.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.407+0000 7f18cad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:49.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.407+0000 7f18c9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:49.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.407+0000 7f18c9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:49.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.407+0000 7f18c9d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:49.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.408+0000 7f18ca575640 10 monclient(hunting): handle_auth_done global_id 5244 payload 824 2026-02-17T21:30:49.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.408+0000 7f18ca575640 1 -- 10.20.193.5:0/1673062190 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f18cc152820 msgr2=0x7f18cc1478b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.408+0000 7f18ca575640 1 --2- 10.20.193.5:0/1673062190 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f18cc152820 0x7f18cc1478b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.408+0000 7f18ca575640 1 -- 10.20.193.5:0/1673062190 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f18cc152c00 msgr2=0x7f18cc147df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.408+0000 7f18ca575640 1 --2- 10.20.193.5:0/1673062190 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f18cc152c00 0x7f18cc147df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.408+0000 7f18ca575640 10 monclient: _finish_hunting 0 2026-02-17T21:30:49.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.408+0000 7f18ca575640 1 monclient: found mon.noname-a 2026-02-17T21:30:49.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.408+0000 7f18ca575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:49.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.408+0000 7f18ca575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:49.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.408+0000 7f18ca575640 1 -- 10.20.193.5:0/1673062190 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18cc06d340 con 0x7f18cc0738f0 2026-02-17T21:30:49.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.409+0000 7f18ca575640 1 --2- 10.20.193.5:0/1673062190 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f18cc0738f0 0x7f18cc06e960 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f18c002f470 tx=0x7f18c00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:49.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.409+0000 7f18b2ffd640 10 client.?.objecter ms_handle_connect 0x7f18cc0738f0 2026-02-17T21:30:49.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.409+0000 7f18b2ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:49.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.410+0000 7f18b2ffd640 1 -- 10.20.193.5:0/1673062190 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c0047070 con 0x7f18cc0738f0 2026-02-17T21:30:49.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.410+0000 7f18b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:49.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.410+0000 7f18b2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:49.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.410+0000 7f18b2ffd640 10 monclient: dump: 2026-02-17T21:30:49.427 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:49.427 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:49.427 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.428 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.428 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:49.428 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.428 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:49.428 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:49.428 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:49.428 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.410+0000 7f18b2ffd640 10 monclient: _finish_auth 0 2026-02-17T21:30:49.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.410+0000 7f18b2ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:30:49.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.410+0000 7f18b2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:49.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.410+0000 7f18b2ffd640 1 -- 10.20.193.5:0/1673062190 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c0042630 con 0x7f18cc0738f0 2026-02-17T21:30:49.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.410+0000 7f18b2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:49.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.410+0000 7f18b2ffd640 1 -- 10.20.193.5:0/1673062190 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c003c040 con 0x7f18cc0738f0 2026-02-17T21:30:49.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.410+0000 7f18b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:49.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.410+0000 7f18b2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:49.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.410+0000 7f18c8d72640 4 set_mon_vals no callback set 2026-02-17T21:30:49.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.410+0000 7f18b2ffd640 10 monclient: dump: 2026-02-17T21:30:49.429 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:49.429 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:49.429 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.429 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.429 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:49.429 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.429 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:49.429 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:49.430 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:49.430 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.410+0000 7f18d0d55640 5 monclient: authenticate success, global_id 5244 2026-02-17T21:30:49.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.410+0000 7f18d0d55640 10 monclient: _renew_subs 2026-02-17T21:30:49.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.410+0000 7f18d0d55640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:49.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.410+0000 7f18d0d55640 1 -- 10.20.193.5:0/1673062190 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18cc06d5e0 con 0x7f18cc0738f0 2026-02-17T21:30:49.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.410+0000 7f18d0d55640 10 client.5244.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:49.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.410+0000 7f18d0d55640 10 monclient: _renew_subs 2026-02-17T21:30:49.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.410+0000 7f18d0d55640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:49.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.410+0000 7f18d0d55640 1 -- 10.20.193.5:0/1673062190 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18cc06dba0 con 0x7f18cc0738f0 2026-02-17T21:30:49.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.410+0000 7f18d0d55640 1 librados: init done 2026-02-17T21:30:49.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.411+0000 7f18d0d55640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:49.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.411+0000 7f18d0d55640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:49.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.411+0000 7f18d0d55640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:49.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.411+0000 7f18d0d55640 1 -- 10.20.193.5:0/1673062190 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18cc15d0b0 con 0x7f18cc0738f0 2026-02-17T21:30:49.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.422+0000 7f18b2ffd640 1 -- 10.20.193.5:0/1673062190 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f18c004c440 con 0x7f18cc0738f0 2026-02-17T21:30:49.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.422+0000 7f18b2ffd640 1 --2- 10.20.193.5:0/1673062190 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1898079300 0x7f189807b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:49.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.423+0000 7f18c9d74640 1 --2- 10.20.193.5:0/1673062190 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1898079300 0x7f189807b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.423+0000 7f18c9d74640 10 monclient: get_auth_request con 0x7f1898079300 auth_method 0 2026-02-17T21:30:49.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.423+0000 7f18c9d74640 1 --2- 10.20.193.5:0/1673062190 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1898079300 0x7f189807b7c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f18cc14c820 tx=0x7f18b4008040 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:49.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.423+0000 7f18b2ffd640 10 client.5244.objecter ms_handle_connect 0x7f1898079300 2026-02-17T21:30:49.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.424+0000 7f18b2ffd640 1 -- 10.20.193.5:0/1673062190 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f18c002fad0 con 0x7f18cc0738f0 2026-02-17T21:30:49.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.424+0000 7f18b2ffd640 10 client.5244.objecter ms_dispatch2 0x7f18cc000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:49.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.424+0000 7f18b2ffd640 3 client.5244.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:49.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.424+0000 7f18b2ffd640 3 client.5244.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:49.433 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.424+0000 7f18b2ffd640 20 client.5244.objecter dump_active .. 0 homeless 2026-02-17T21:30:49.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.527+0000 7f18b2ffd640 1 -- 10.20.193.5:0/1673062190 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f18cc15d0b0 con 0x7f18cc0738f0 2026-02-17T21:30:49.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.527+0000 7f18b2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:49.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.527+0000 7f18b2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:49.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.611+0000 7f18d0d55640 1 -- 10.20.193.5:0/1673062190 --> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "10", "target": ["mon-mgr", ""]}) -- 0x7f18cc0c6b10 con 0x7f1898079300 2026-02-17T21:30:49.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.611+0000 7f18b2ffd640 1 -- 10.20.193.5:0/1673062190 <== mgr.4131 v2:10.20.193.176:6800/2898618020 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 10 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7f18cc0c6b10 con 0x7f1898079300 2026-02-17T21:30:49.614 INFO:teuthology.orchestra.run.trial005.stderr:instructed osd(s) 10 to deep-scrub 2026-02-17T21:30:49.615 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.612+0000 7f18d0d55640 10 librados: watch_flush enter 2026-02-17T21:30:49.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.612+0000 7f18d0d55640 10 librados: watch_flush exit 2026-02-17T21:30:49.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.612+0000 7f18d0d55640 20 client.5244.objecter shutdown clearing up homeless session... 2026-02-17T21:30:49.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.612+0000 7f18d0d55640 10 client.5244.objecter successfully canceled tick 2026-02-17T21:30:49.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.612+0000 7f18d0d55640 1 -- 10.20.193.5:0/1673062190 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1898079300 msgr2=0x7f189807b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.612+0000 7f18d0d55640 1 --2- 10.20.193.5:0/1673062190 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1898079300 0x7f189807b7c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f18cc14c820 tx=0x7f18b4008040 comp rx=0 tx=0).stop 2026-02-17T21:30:49.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.612+0000 7f18d0d55640 10 monclient: shutdown 2026-02-17T21:30:49.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.612+0000 7f18d0d55640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:49.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.612+0000 7f18d0d55640 1 -- 10.20.193.5:0/1673062190 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f18cc0738f0 msgr2=0x7f18cc06e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.612+0000 7f18d0d55640 1 --2- 10.20.193.5:0/1673062190 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f18cc0738f0 0x7f18cc06e960 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f18c002f470 tx=0x7f18c00047c0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.612+0000 7f18d0d55640 1 -- 10.20.193.5:0/1673062190 shutdown_connections 2026-02-17T21:30:49.616 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.612+0000 7f18d0d55640 1 --2- 10.20.193.5:0/1673062190 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f1898079300 0x7f189807b7c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.612+0000 7f18d0d55640 1 --2- 10.20.193.5:0/1673062190 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f18cc152c00 0x7f18cc147df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.612+0000 7f18d0d55640 1 --2- 10.20.193.5:0/1673062190 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f18cc152820 0x7f18cc1478b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.612+0000 7f18d0d55640 1 --2- 10.20.193.5:0/1673062190 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f18cc0738f0 0x7f18cc06e960 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.612+0000 7f18d0d55640 1 -- 10.20.193.5:0/1673062190 >> 10.20.193.5:0/1673062190 conn(0x7f18cc0c9f40 msgr2=0x7f18cc0c7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:49.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.612+0000 7f18d0d55640 1 -- 10.20.193.5:0/1673062190 shutdown_connections 2026-02-17T21:30:49.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.612+0000 7f18d0d55640 1 -- 10.20.193.5:0/1673062190 wait complete. 2026-02-17T21:30:49.617 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.612+0000 7f18d0d55640 1 librados: shutdown 2026-02-17T21:30:49.623 INFO:tasks.ceph:Scrubbing osd.14 2026-02-17T21:30:49.624 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:30:49.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.692+0000 7fe95ef7e640 10 monclient: get_monmap_and_config 2026-02-17T21:30:49.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.692+0000 7fe95ef7e640 10 monclient: build_initial_monmap 2026-02-17T21:30:49.694 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.692+0000 7fe95ef7e640 10 monclient: monmap: 2026-02-17T21:30:49.694 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:49.695 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:49.695 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:49.693821+0000 2026-02-17T21:30:49.695 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:49.693821+0000 2026-02-17T21:30:49.695 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:49.695 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.695 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:49.695 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:49.695 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:49.695 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:49.695 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:49.695 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:49.696 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.698 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.692+0000 7fe95ef7e640 1 Processor -- start 2026-02-17T21:30:49.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.692+0000 7fe95ef7e640 1 -- start start 2026-02-17T21:30:49.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.692+0000 7fe95ef7e640 10 monclient: init 2026-02-17T21:30:49.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.693+0000 7fe95ef7e640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:49.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.693+0000 7fe95ef7e640 10 monclient: _add_conns ranks=[4,2,0,1,3,5] 2026-02-17T21:30:49.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.693+0000 7fe95ef7e640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fe95815d3c0 0x7fe95815d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:49.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.693+0000 7fe95ef7e640 10 monclient(hunting): picked mon.noname-b con 0x7fe95815d3c0 addr v2:10.20.193.119:3300/0 2026-02-17T21:30:49.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.693+0000 7fe95ef7e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe9580c94c0 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:49.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.693+0000 7fe95ef7e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe95815b050 addr v1:10.20.193.5:6789/0 2026-02-17T21:30:49.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.693+0000 7fe95ef7e640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe95815b4a0 con 0x7fe95815b050 2026-02-17T21:30:49.699 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.693+0000 7fe95ef7e640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9580c7e60 con 0x7fe9580c94c0 2026-02-17T21:30:49.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.693+0000 7fe95ef7e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:49.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.693+0000 7fe95ef7e640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fe9580c8140 con 0x7fe95815d3c0 2026-02-17T21:30:49.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.693+0000 7fe95ef7e640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:49.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.693+0000 7fe95ef7e640 10 monclient(hunting): authenticate will time out at 1355.259144s 2026-02-17T21:30:49.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.693+0000 7fe95d4f4640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7fe95815b050 0x7fe9580c52f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:39928/0 (socket says 10.20.193.5:39928) 2026-02-17T21:30:49.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.693+0000 7fe95d4f4640 1 -- 10.20.193.5:0/1283306978 learned_addr learned my addr 10.20.193.5:0/1283306978 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:49.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.693+0000 7fe95ccf3640 1 --2- 10.20.193.5:0/1283306978 >> v2:10.20.193.119:3300/0 conn(0x7fe95815d3c0 0x7fe95815d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.693+0000 7fe95ccf3640 10 monclient(hunting): get_auth_request con 0x7fe95815d3c0 auth_method 0 2026-02-17T21:30:49.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.693+0000 7fe95ccf3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:49.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.693+0000 7fe95ccf3640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:49.700 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.693+0000 7fe95ccf3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:49.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.694+0000 7fe95ccf3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:49.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.694+0000 7fe95ccf3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:49.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.694+0000 7fe95ccf3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:49.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.695+0000 7fe94f7fe640 1 -- 10.20.193.5:0/1283306978 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2726537832 0 0) 0x7fe95815b4a0 con 0x7fe95815b050 2026-02-17T21:30:49.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.695+0000 7fe94f7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:30:49.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.695+0000 7fe94f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:49.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.695+0000 7fe94f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:49.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.695+0000 7fe94f7fe640 10 monclient(hunting): my global_id is 5247 2026-02-17T21:30:49.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.695+0000 7fe94f7fe640 1 -- 10.20.193.5:0/1283306978 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe944003620 con 0x7fe95815b050 2026-02-17T21:30:49.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.695+0000 7fe95ccf3640 10 monclient(hunting): handle_auth_done global_id 5317 payload 274 2026-02-17T21:30:49.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.695+0000 7fe95ccf3640 1 -- 10.20.193.5:0/1283306978 >> v1:10.20.193.135:6789/0 conn(0x7fe9580c94c0 legacy=0x7fe9580c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.701 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.695+0000 7fe94f7fe640 1 -- 10.20.193.5:0/1283306978 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3450355939 0 0) 0x7fe9580c7e60 con 0x7fe9580c94c0 2026-02-17T21:30:49.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.695+0000 7fe95ccf3640 1 -- 10.20.193.5:0/1283306978 >> v1:10.20.193.5:6789/0 conn(0x7fe95815b050 legacy=0x7fe9580c52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.695+0000 7fe95ccf3640 10 monclient: _finish_hunting 0 2026-02-17T21:30:49.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.695+0000 7fe95ccf3640 1 monclient: found mon.noname-b 2026-02-17T21:30:49.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.695+0000 7fe95ccf3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:49.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.695+0000 7fe95ccf3640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:30:49.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.695+0000 7fe95ccf3640 1 -- 10.20.193.5:0/1283306978 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9580c8420 con 0x7fe95815d3c0 2026-02-17T21:30:49.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.695+0000 7fe94f7fe640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-17T21:30:49.702 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.696+0000 7fe95ccf3640 1 --2- 10.20.193.5:0/1283306978 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe95815d3c0 0x7fe95815d7a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe9480098a0 tx=0x7fe94802ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5feba1874e0230c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:49.708 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.698+0000 7fe94f7fe640 1 -- 10.20.193.5:0/1283306978 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94803c070 con 0x7fe95815d3c0 2026-02-17T21:30:49.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.698+0000 7fe94f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:49.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.698+0000 7fe94f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:30:49.709 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.698+0000 7fe94f7fe640 10 monclient: dump: 2026-02-17T21:30:49.709 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:49.709 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:49.709 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.709 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.709 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:49.709 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.709 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:49.709 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:49.710 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:49.710 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.698+0000 7fe94f7fe640 10 monclient: _finish_auth 0 2026-02-17T21:30:49.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.698+0000 7fe94f7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:30:49.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.698+0000 7fe94f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:49.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.698+0000 7fe94f7fe640 1 -- 10.20.193.5:0/1283306978 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe94802fca0 con 0x7fe95815d3c0 2026-02-17T21:30:49.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.698+0000 7fe94f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:49.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.698+0000 7fe95ef7e640 5 monclient: authenticate success, global_id 5317 2026-02-17T21:30:49.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.698+0000 7fe94f7fe640 1 -- 10.20.193.5:0/1283306978 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe948037660 con 0x7fe95815d3c0 2026-02-17T21:30:49.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.698+0000 7fe94f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:49.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.698+0000 7fe94f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:30:49.710 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.698+0000 7fe94f7fe640 10 monclient: dump: 2026-02-17T21:30:49.711 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:49.711 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:49.711 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.711 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.711 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:49.711 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.711 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:49.711 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:49.711 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:49.711 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.698+0000 7fe95ef7e640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:49.711 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.698+0000 7fe95ef7e640 4 set_mon_vals no callback set 2026-02-17T21:30:49.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.698+0000 7fe95ef7e640 10 monclient: shutdown 2026-02-17T21:30:49.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.698+0000 7fe95ef7e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:49.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.698+0000 7fe95ef7e640 1 -- 10.20.193.5:0/1283306978 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe95815d3c0 msgr2=0x7fe95815d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.698+0000 7fe95ef7e640 1 --2- 10.20.193.5:0/1283306978 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe95815d3c0 0x7fe95815d7a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe9480098a0 tx=0x7fe94802ef90 comp rx=0 tx=0).stop 2026-02-17T21:30:49.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.698+0000 7fe95ef7e640 1 -- 10.20.193.5:0/1283306978 shutdown_connections 2026-02-17T21:30:49.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.698+0000 7fe95ef7e640 1 --2- 10.20.193.5:0/1283306978 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe95815d3c0 0x7fe95815d7a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.698+0000 7fe95ef7e640 1 -- 10.20.193.5:0/1283306978 >> 10.20.193.5:0/1283306978 conn(0x7fe9580c9f60 msgr2=0x7fe9580ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:49.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.698+0000 7fe95ef7e640 1 -- 10.20.193.5:0/1283306978 shutdown_connections 2026-02-17T21:30:49.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.698+0000 7fe95ef7e640 1 -- 10.20.193.5:0/1283306978 wait complete. 2026-02-17T21:30:49.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.699+0000 7fe95ef7e640 10 monclient: build_initial_monmap 2026-02-17T21:30:49.712 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.699+0000 7fe95ef7e640 10 monclient: monmap: 2026-02-17T21:30:49.712 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:49.713 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:49.713 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:49.713 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:49.713 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:49.713 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.713 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:49.713 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:49.713 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:49.713 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.699+0000 7fe95ef7e640 1 librados: starting msgr at 2026-02-17T21:30:49.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.699+0000 7fe95ef7e640 1 librados: starting objecter 2026-02-17T21:30:49.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.699+0000 7fe95ef7e640 1 Processor -- start 2026-02-17T21:30:49.713 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.699+0000 7fe95ef7e640 1 -- start start 2026-02-17T21:30:49.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.699+0000 7fe95ef7e640 1 librados: setting wanted keys 2026-02-17T21:30:49.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.699+0000 7fe95ef7e640 1 librados: calling monclient init 2026-02-17T21:30:49.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.699+0000 7fe95ef7e640 10 monclient: init 2026-02-17T21:30:49.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.699+0000 7fe95ef7e640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:49.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.699+0000 7fe95ef7e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:30:49.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.699+0000 7fe95ef7e640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe9580c94c0 0x7fe95814c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:49.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.699+0000 7fe95ef7e640 10 monclient(hunting): picked mon.noname-b con 0x7fe9580c94c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:49.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.699+0000 7fe95ef7e640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe95815b050 0x7fe958141870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:49.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.699+0000 7fe95ef7e640 10 monclient(hunting): picked mon.noname-a con 0x7fe95815b050 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:49.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.699+0000 7fe95ef7e640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe95815d3c0 0x7fe9581f1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:49.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.699+0000 7fe95ef7e640 10 monclient(hunting): picked mon.noname-c con 0x7fe95815d3c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:49.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe95ef7e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:49.714 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe95ef7e640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe9580c8cc0 con 0x7fe95815b050 2026-02-17T21:30:49.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe95ef7e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:49.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe95ef7e640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe9580c89e0 con 0x7fe9580c94c0 2026-02-17T21:30:49.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe95ef7e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:49.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe95ef7e640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe9580c8fa0 con 0x7fe95815d3c0 2026-02-17T21:30:49.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe95ef7e640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:49.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe95ef7e640 10 monclient(hunting): authenticate will time out at 1355.266008s 2026-02-17T21:30:49.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe94ffff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe95815b050 0x7fe958141870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe95d4f4640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe95815d3c0 0x7fe9581f1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe94ffff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe95815b050 0x7fe958141870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48394/0 (socket says 10.20.193.5:48394) 2026-02-17T21:30:49.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe94ffff640 1 -- 10.20.193.5:0/2213564301 learned_addr learned my addr 10.20.193.5:0/2213564301 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:49.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe94ffff640 10 monclient(hunting): get_auth_request con 0x7fe95815b050 auth_method 0 2026-02-17T21:30:49.715 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe94ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:49.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe94ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:49.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe94ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:49.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe95ccf3640 1 --2- 10.20.193.5:0/2213564301 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe9580c94c0 0x7fe95814c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe95d4f4640 10 monclient(hunting): get_auth_request con 0x7fe95815d3c0 auth_method 0 2026-02-17T21:30:49.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe95d4f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:49.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe95d4f4640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:49.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe95d4f4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:49.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe95ccf3640 10 monclient(hunting): get_auth_request con 0x7fe9580c94c0 auth_method 0 2026-02-17T21:30:49.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe95ccf3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:49.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe95ccf3640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:49.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe95ccf3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:49.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe94ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:49.716 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe94ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:49.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe94ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:49.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe95d4f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:49.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.700+0000 7fe95d4f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:49.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.701+0000 7fe95d4f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:49.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.701+0000 7fe95ccf3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:49.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.701+0000 7fe95ccf3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:49.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.701+0000 7fe95ccf3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:49.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.702+0000 7fe94ffff640 10 monclient(hunting): handle_auth_done global_id 5250 payload 824 2026-02-17T21:30:49.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.702+0000 7fe94ffff640 1 -- 10.20.193.5:0/2213564301 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe95815d3c0 msgr2=0x7fe9581f1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.702+0000 7fe94ffff640 1 --2- 10.20.193.5:0/2213564301 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe95815d3c0 0x7fe9581f1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.702+0000 7fe94ffff640 1 -- 10.20.193.5:0/2213564301 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe9580c94c0 msgr2=0x7fe95814c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.717 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.702+0000 7fe94ffff640 1 --2- 10.20.193.5:0/2213564301 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe9580c94c0 0x7fe95814c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.718 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.702+0000 7fe94ffff640 10 monclient: _finish_hunting 0 2026-02-17T21:30:49.718 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.702+0000 7fe94ffff640 1 monclient: found mon.noname-a 2026-02-17T21:30:49.718 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.702+0000 7fe94ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:49.718 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.702+0000 7fe94ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:49.718 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.702+0000 7fe94ffff640 1 -- 10.20.193.5:0/2213564301 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9581f6b00 con 0x7fe95815b050 2026-02-17T21:30:49.718 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.703+0000 7fe94ffff640 1 --2- 10.20.193.5:0/2213564301 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe95815b050 0x7fe958141870 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe94000c700 tx=0x7fe94000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:49.718 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.703+0000 7fe94d7fa640 10 client.?.objecter ms_handle_connect 0x7fe95815b050 2026-02-17T21:30:49.718 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.703+0000 7fe94d7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:49.718 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe94d7fa640 1 -- 10.20.193.5:0/2213564301 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe940017070 con 0x7fe95815b050 2026-02-17T21:30:49.718 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe94d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:49.718 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe94d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:49.718 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe94d7fa640 10 monclient: dump: 2026-02-17T21:30:49.718 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:49.719 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:49.719 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.719 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.719 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:49.719 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.719 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:49.719 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:49.719 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:49.719 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.719 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe94d7fa640 10 monclient: _finish_auth 0 2026-02-17T21:30:49.719 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe94d7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:30:49.719 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe94d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:49.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe94d7fa640 1 -- 10.20.193.5:0/2213564301 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe940005270 con 0x7fe95815b050 2026-02-17T21:30:49.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe94d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:49.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe94d7fa640 1 -- 10.20.193.5:0/2213564301 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe940003670 con 0x7fe95815b050 2026-02-17T21:30:49.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe94d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:49.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe94d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:49.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe94effd640 4 set_mon_vals no callback set 2026-02-17T21:30:49.720 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe94d7fa640 10 monclient: dump: 2026-02-17T21:30:49.720 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:49.720 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:49.720 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.720 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.720 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:49.721 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.721 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:49.721 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:49.721 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:49.721 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.721 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe95ef7e640 5 monclient: authenticate success, global_id 5250 2026-02-17T21:30:49.721 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe95ef7e640 10 monclient: _renew_subs 2026-02-17T21:30:49.721 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe95ef7e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:49.721 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe95ef7e640 1 -- 10.20.193.5:0/2213564301 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9581f5780 con 0x7fe95815b050 2026-02-17T21:30:49.721 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe95ef7e640 10 client.5250.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:49.721 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe95ef7e640 10 monclient: _renew_subs 2026-02-17T21:30:49.721 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe95ef7e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:49.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe95ef7e640 1 -- 10.20.193.5:0/2213564301 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9581f5d40 con 0x7fe95815b050 2026-02-17T21:30:49.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe95ef7e640 1 librados: init done 2026-02-17T21:30:49.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe95ef7e640 10 client.5250.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:49.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe95ef7e640 15 client.5250.objecter _session_command_op_assign -1 1 2026-02-17T21:30:49.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe95ef7e640 20 client.5250.objecter _get_session osd=-1 returning homeless 2026-02-17T21:30:49.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe95ef7e640 10 client.5250.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:49.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe95ef7e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:49.722 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.705+0000 7fe95ef7e640 1 -- 10.20.193.5:0/2213564301 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe95815d7a0 con 0x7fe95815b050 2026-02-17T21:30:49.724 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.717+0000 7fe94d7fa640 1 -- 10.20.193.5:0/2213564301 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fe94000a640 con 0x7fe95815b050 2026-02-17T21:30:49.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.717+0000 7fe94d7fa640 1 --2- 10.20.193.5:0/2213564301 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe9280792d0 0x7fe92807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:49.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.717+0000 7fe95ccf3640 1 --2- 10.20.193.5:0/2213564301 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe9280792d0 0x7fe92807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.717+0000 7fe95ccf3640 10 monclient: get_auth_request con 0x7fe9280792d0 auth_method 0 2026-02-17T21:30:49.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.718+0000 7fe95ccf3640 1 --2- 10.20.193.5:0/2213564301 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe9280792d0 0x7fe92807b790 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe948039000 tx=0x7fe948033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:49.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.718+0000 7fe94d7fa640 10 client.5250.objecter ms_handle_connect 0x7fe9280792d0 2026-02-17T21:30:49.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.719+0000 7fe94d7fa640 1 -- 10.20.193.5:0/2213564301 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fe94005db40 con 0x7fe95815b050 2026-02-17T21:30:49.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.719+0000 7fe94d7fa640 10 client.5250.objecter ms_dispatch2 0x7fe958000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:49.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.719+0000 7fe94d7fa640 3 client.5250.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:49.725 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.719+0000 7fe94d7fa640 3 client.5250.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:49.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.719+0000 7fe94d7fa640 10 client.5250.objecter checking command 1 2026-02-17T21:30:49.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.719+0000 7fe94d7fa640 1 --2- 10.20.193.5:0/2213564301 >> [v2:10.20.193.135:6816/1552304264,v1:10.20.193.135:6817/1552304264] conn(0x7fe9280817b0 0x7fe928083bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:49.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.719+0000 7fe94d7fa640 20 client.5250.objecter _get_session s=0x7fe9280810e0 osd=14 3 2026-02-17T21:30:49.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.719+0000 7fe94d7fa640 20 client.5250.objecter put_session s=0x7fe9280810e0 osd=14 3 2026-02-17T21:30:49.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.719+0000 7fe94d7fa640 15 client.5250.objecter _session_command_op_remove -1 1 2026-02-17T21:30:49.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.719+0000 7fe94d7fa640 20 client.5250.objecter _get_session s=0x7fe9280810e0 osd=14 3 2026-02-17T21:30:49.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.719+0000 7fe94d7fa640 20 client.5250.objecter get_session s=0x7fe9280810e0 osd=14 3 2026-02-17T21:30:49.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.719+0000 7fe94d7fa640 15 client.5250.objecter _session_command_op_assign 14 1 2026-02-17T21:30:49.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.719+0000 7fe94d7fa640 20 client.5250.objecter put_session s=0x7fe9280810e0 osd=14 4 2026-02-17T21:30:49.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.719+0000 7fe94d7fa640 10 client.5250.objecter _send_command 1 2026-02-17T21:30:49.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.719+0000 7fe94d7fa640 1 -- 10.20.193.5:0/2213564301 --> [v2:10.20.193.135:6816/1552304264,v1:10.20.193.135:6817/1552304264] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe9280842a0 con 0x7fe9280817b0 2026-02-17T21:30:49.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.719+0000 7fe94d7fa640 20 client.5250.objecter dump_active .. 0 homeless 2026-02-17T21:30:49.726 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.719+0000 7fe94d7fa640 1 -- 10.20.193.5:0/2213564301 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe94005df00 con 0x7fe95815b050 2026-02-17T21:30:49.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.719+0000 7fe94d7fa640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T21:30:49.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.719+0000 7fe95d4f4640 1 --2- 10.20.193.5:0/2213564301 >> [v2:10.20.193.135:6816/1552304264,v1:10.20.193.135:6817/1552304264] conn(0x7fe9280817b0 0x7fe928083bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.720+0000 7fe95d4f4640 10 monclient: get_auth_request con 0x7fe9280817b0 auth_method 0 2026-02-17T21:30:49.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.721+0000 7fe95d4f4640 1 --2- 10.20.193.5:0/2213564301 >> [v2:10.20.193.135:6816/1552304264,v1:10.20.193.135:6817/1552304264] conn(0x7fe9280817b0 0x7fe928083bd0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.14 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:49.727 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.721+0000 7fe94d7fa640 10 client.5250.objecter ms_handle_connect 0x7fe9280817b0 2026-02-17T21:30:49.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.731+0000 7fe94d7fa640 1 -- 10.20.193.5:0/2213564301 <== osd.14 v2:10.20.193.135:6816/1552304264 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fe9280842a0 con 0x7fe9280817b0 2026-02-17T21:30:49.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.731+0000 7fe94d7fa640 10 client.5250.objecter ms_dispatch2 0x7fe958000b90 command_reply(tid 1: 0 ) 2026-02-17T21:30:49.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.731+0000 7fe94d7fa640 10 client.5250.objecter _finish_command 1 = system:0 2026-02-17T21:30:49.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.731+0000 7fe94d7fa640 20 client.5250.objecter put_session s=0x7fe9280810e0 osd=14 4 2026-02-17T21:30:49.733 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.731+0000 7fe94d7fa640 15 client.5250.objecter _session_command_op_remove 14 1 2026-02-17T21:30:49.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.738+0000 7fe95ef7e640 10 client.5250.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:30:49.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.738+0000 7fe95ef7e640 15 client.5250.objecter _session_command_op_assign -1 2 2026-02-17T21:30:49.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.738+0000 7fe95ef7e640 20 client.5250.objecter _get_session s=0x7fe9280810e0 osd=14 3 2026-02-17T21:30:49.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.738+0000 7fe95ef7e640 20 client.5250.objecter put_session s=0x7fe9280810e0 osd=14 3 2026-02-17T21:30:49.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.738+0000 7fe95ef7e640 20 client.5250.objecter _get_session s=0x7fe9280810e0 osd=14 3 2026-02-17T21:30:49.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.738+0000 7fe95ef7e640 15 client.5250.objecter _session_command_op_remove -1 2 2026-02-17T21:30:49.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.738+0000 7fe95ef7e640 20 client.5250.objecter get_session s=0x7fe9280810e0 osd=14 3 2026-02-17T21:30:49.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.738+0000 7fe95ef7e640 15 client.5250.objecter _session_command_op_assign 14 2 2026-02-17T21:30:49.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.738+0000 7fe95ef7e640 20 client.5250.objecter put_session s=0x7fe9280810e0 osd=14 4 2026-02-17T21:30:49.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.738+0000 7fe95ef7e640 10 client.5250.objecter _send_command 2 2026-02-17T21:30:49.741 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.738+0000 7fe95ef7e640 1 -- 10.20.193.5:0/2213564301 --> [v2:10.20.193.135:6816/1552304264,v1:10.20.193.135:6817/1552304264] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe958142660 con 0x7fe9280817b0 2026-02-17T21:30:49.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.745+0000 7fe94d7fa640 1 -- 10.20.193.5:0/2213564301 <== osd.14 v2:10.20.193.135:6816/1552304264 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe958142660 con 0x7fe9280817b0 2026-02-17T21:30:49.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.745+0000 7fe94d7fa640 10 client.5250.objecter ms_dispatch2 0x7fe958000b90 command_reply(tid 2: 0 ) 2026-02-17T21:30:49.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.745+0000 7fe94d7fa640 10 client.5250.objecter _finish_command 2 = system:0 2026-02-17T21:30:49.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.745+0000 7fe94d7fa640 20 client.5250.objecter put_session s=0x7fe9280810e0 osd=14 4 2026-02-17T21:30:49.747 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.745+0000 7fe94d7fa640 15 client.5250.objecter _session_command_op_remove 14 2 2026-02-17T21:30:49.748 INFO:teuthology.orchestra.run.trial005.stdout:{ 2026-02-17T21:30:49.748 INFO:teuthology.orchestra.run.trial005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:30:49.748 INFO:teuthology.orchestra.run.trial005.stdout:} 2026-02-17T21:30:49.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.745+0000 7fe95ef7e640 10 librados: watch_flush enter 2026-02-17T21:30:49.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.745+0000 7fe95ef7e640 10 librados: watch_flush exit 2026-02-17T21:30:49.749 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.745+0000 7fe95ef7e640 10 client.5250.objecter close_session for osd.14 2026-02-17T21:30:49.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.745+0000 7fe95ef7e640 1 -- 10.20.193.5:0/2213564301 >> [v2:10.20.193.135:6816/1552304264,v1:10.20.193.135:6817/1552304264] conn(0x7fe9280817b0 msgr2=0x7fe928083bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.745+0000 7fe95ef7e640 1 --2- 10.20.193.5:0/2213564301 >> [v2:10.20.193.135:6816/1552304264,v1:10.20.193.135:6817/1552304264] conn(0x7fe9280817b0 0x7fe928083bd0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.745+0000 7fe95ef7e640 20 client.5250.objecter put_session s=0x7fe9280810e0 osd=14 1 2026-02-17T21:30:49.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.745+0000 7fe95ef7e640 20 client.5250.objecter shutdown clearing up homeless session... 2026-02-17T21:30:49.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.745+0000 7fe95ef7e640 10 client.5250.objecter successfully canceled tick 2026-02-17T21:30:49.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.745+0000 7fe95ef7e640 1 -- 10.20.193.5:0/2213564301 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe9280792d0 msgr2=0x7fe92807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.745+0000 7fe95ef7e640 1 --2- 10.20.193.5:0/2213564301 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe9280792d0 0x7fe92807b790 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe948039000 tx=0x7fe948033000 comp rx=0 tx=0).stop 2026-02-17T21:30:49.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.745+0000 7fe95ef7e640 10 monclient: shutdown 2026-02-17T21:30:49.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.745+0000 7fe95ef7e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:49.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.745+0000 7fe95ef7e640 1 -- 10.20.193.5:0/2213564301 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe95815b050 msgr2=0x7fe958141870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.750 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.745+0000 7fe95ef7e640 1 --2- 10.20.193.5:0/2213564301 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe95815b050 0x7fe958141870 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe94000c700 tx=0x7fe94000cbd0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.745+0000 7fe95d4f4640 1 -- 10.20.193.5:0/2213564301 reap_dead start 2026-02-17T21:30:49.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.745+0000 7fe95ef7e640 1 -- 10.20.193.5:0/2213564301 shutdown_connections 2026-02-17T21:30:49.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.745+0000 7fe95ef7e640 1 -- 10.20.193.5:0/2213564301 >> 10.20.193.5:0/2213564301 conn(0x7fe9580c9f60 msgr2=0x7fe95814f090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:49.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.745+0000 7fe95ef7e640 1 -- 10.20.193.5:0/2213564301 shutdown_connections 2026-02-17T21:30:49.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.745+0000 7fe95ef7e640 1 -- 10.20.193.5:0/2213564301 wait complete. 2026-02-17T21:30:49.751 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.745+0000 7fe95ef7e640 1 librados: shutdown 2026-02-17T21:30:49.755 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 14 2026-02-17T21:30:49.825 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.822+0000 7fd467904640 10 monclient: get_monmap_and_config 2026-02-17T21:30:49.825 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.822+0000 7fd467904640 10 monclient: build_initial_monmap 2026-02-17T21:30:49.825 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.822+0000 7fd467904640 10 monclient: monmap: 2026-02-17T21:30:49.825 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:49.825 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:49.825 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:49.824553+0000 2026-02-17T21:30:49.825 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:49.824553+0000 2026-02-17T21:30:49.826 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:49.826 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.826 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:49.826 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:49.826 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:49.826 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:49.826 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:49.826 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:49.826 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.823+0000 7fd467904640 1 Processor -- start 2026-02-17T21:30:49.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.823+0000 7fd467904640 1 -- start start 2026-02-17T21:30:49.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.823+0000 7fd467904640 10 monclient: init 2026-02-17T21:30:49.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.823+0000 7fd467904640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:49.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.823+0000 7fd467904640 10 monclient: _add_conns ranks=[1,5,0,2,4,3] 2026-02-17T21:30:49.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.823+0000 7fd467904640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fd46014f280 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:49.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.823+0000 7fd467904640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fd46014f660 0x7fd4600c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:49.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.823+0000 7fd467904640 10 monclient(hunting): picked mon.noname-c con 0x7fd46014f660 addr v2:10.20.193.135:3300/0 2026-02-17T21:30:49.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.823+0000 7fd467904640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd46015abc0 addr v1:10.20.193.5:6789/0 2026-02-17T21:30:49.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.823+0000 7fd467904640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4600c7390 con 0x7fd46015abc0 2026-02-17T21:30:49.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.823+0000 7fd467904640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4600c7670 con 0x7fd46014f280 2026-02-17T21:30:49.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.823+0000 7fd467904640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:49.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.823+0000 7fd467904640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd4600c7950 con 0x7fd46014f660 2026-02-17T21:30:49.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.823+0000 7fd467904640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:49.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.823+0000 7fd467904640 10 monclient(hunting): authenticate will time out at 1355.389936s 2026-02-17T21:30:49.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.824+0000 7fd464e78640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fd46014f660 0x7fd4600c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.824+0000 7fd465679640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7fd46014f280 0x7fd4600c7e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:41184/0 (socket says 10.20.193.5:41184) 2026-02-17T21:30:49.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.824+0000 7fd465679640 1 -- 10.20.193.5:0/2693564377 learned_addr learned my addr 10.20.193.5:0/2693564377 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:49.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.824+0000 7fd464e78640 10 monclient(hunting): get_auth_request con 0x7fd46014f660 auth_method 0 2026-02-17T21:30:49.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.824+0000 7fd464e78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:49.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.824+0000 7fd464e78640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:49.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.824+0000 7fd464e78640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:49.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.824+0000 7fd464e78640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:49.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.824+0000 7fd464e78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:49.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.824+0000 7fd464e78640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:49.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.825+0000 7fd44ffff640 1 -- 10.20.193.5:0/2693564377 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4082892542 0 0) 0x7fd4600c7670 con 0x7fd46014f280 2026-02-17T21:30:49.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.825+0000 7fd44ffff640 10 monclient(hunting): _negotiate 2026-02-17T21:30:49.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.825+0000 7fd44ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:49.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.825+0000 7fd44ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:49.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.825+0000 7fd44ffff640 10 monclient(hunting): my global_id is 5323 2026-02-17T21:30:49.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.825+0000 7fd44ffff640 1 -- 10.20.193.5:0/2693564377 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd448003620 con 0x7fd46014f280 2026-02-17T21:30:49.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.825+0000 7fd44ffff640 1 -- 10.20.193.5:0/2693564377 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1748722669 0 0) 0x7fd4600c7390 con 0x7fd46015abc0 2026-02-17T21:30:49.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.825+0000 7fd44ffff640 10 monclient(hunting): _negotiate 2026-02-17T21:30:49.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.825+0000 7fd44ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:49.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.825+0000 7fd44ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:49.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.825+0000 7fd44ffff640 10 monclient(hunting): my global_id is 5253 2026-02-17T21:30:49.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.825+0000 7fd44ffff640 1 -- 10.20.193.5:0/2693564377 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4600c7670 con 0x7fd46015abc0 2026-02-17T21:30:49.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.825+0000 7fd464e78640 10 monclient(hunting): handle_auth_done global_id 5321 payload 274 2026-02-17T21:30:49.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.825+0000 7fd464e78640 1 -- 10.20.193.5:0/2693564377 >> v1:10.20.193.119:6789/0 conn(0x7fd46014f280 legacy=0x7fd4600c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.825+0000 7fd464e78640 1 -- 10.20.193.5:0/2693564377 >> v1:10.20.193.5:6789/0 conn(0x7fd46015abc0 legacy=0x7fd46015afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.825+0000 7fd464e78640 10 monclient: _finish_hunting 0 2026-02-17T21:30:49.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.825+0000 7fd464e78640 1 monclient: found mon.noname-c 2026-02-17T21:30:49.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.825+0000 7fd464e78640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:49.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.825+0000 7fd464e78640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:49.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.825+0000 7fd464e78640 1 -- 10.20.193.5:0/2693564377 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd46015a0e0 con 0x7fd46014f660 2026-02-17T21:30:49.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.826+0000 7fd464e78640 1 --2- 10.20.193.5:0/2693564377 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd46014f660 0x7fd4600c6a00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd4540098a0 tx=0x7fd45402ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e742c58204629ea server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:49.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.828+0000 7fd44ffff640 1 -- 10.20.193.5:0/2693564377 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45403c070 con 0x7fd46014f660 2026-02-17T21:30:49.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.828+0000 7fd44ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:49.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.828+0000 7fd44ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:49.842 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.828+0000 7fd44ffff640 10 monclient: dump: 2026-02-17T21:30:49.842 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:49.842 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:49.842 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.842 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.842 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:49.842 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.842 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:49.843 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:49.843 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:49.843 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.828+0000 7fd44ffff640 10 monclient: _finish_auth 0 2026-02-17T21:30:49.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.828+0000 7fd44ffff640 10 monclient: _check_auth_tickets 2026-02-17T21:30:49.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.828+0000 7fd44ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:49.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.828+0000 7fd44ffff640 1 -- 10.20.193.5:0/2693564377 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd45402fc10 con 0x7fd46014f660 2026-02-17T21:30:49.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.828+0000 7fd44ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:49.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.828+0000 7fd467904640 5 monclient: authenticate success, global_id 5321 2026-02-17T21:30:49.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.828+0000 7fd44ffff640 1 -- 10.20.193.5:0/2693564377 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd454037440 con 0x7fd46014f660 2026-02-17T21:30:49.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.828+0000 7fd467904640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:49.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.828+0000 7fd44ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:49.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.828+0000 7fd467904640 4 set_mon_vals no callback set 2026-02-17T21:30:49.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.828+0000 7fd44ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:49.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.828+0000 7fd44ffff640 10 monclient: dump: 2026-02-17T21:30:49.844 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:49.844 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:49.844 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.844 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.844 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:49.844 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.845 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:49.845 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:49.845 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:49.845 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.845 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.828+0000 7fd467904640 10 monclient: shutdown 2026-02-17T21:30:49.845 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.828+0000 7fd467904640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:49.845 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.828+0000 7fd467904640 1 -- 10.20.193.5:0/2693564377 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd46014f660 msgr2=0x7fd4600c6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.845 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.828+0000 7fd467904640 1 --2- 10.20.193.5:0/2693564377 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd46014f660 0x7fd4600c6a00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd4540098a0 tx=0x7fd45402ef00 comp rx=0 tx=0).stop 2026-02-17T21:30:49.845 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.828+0000 7fd467904640 1 -- 10.20.193.5:0/2693564377 shutdown_connections 2026-02-17T21:30:49.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.828+0000 7fd467904640 1 --2- 10.20.193.5:0/2693564377 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd46014f660 0x7fd4600c6a00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.828+0000 7fd467904640 1 -- 10.20.193.5:0/2693564377 >> 10.20.193.5:0/2693564377 conn(0x7fd4600c9f20 msgr2=0x7fd4600ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:49.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.828+0000 7fd467904640 1 -- 10.20.193.5:0/2693564377 shutdown_connections 2026-02-17T21:30:49.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.828+0000 7fd467904640 1 -- 10.20.193.5:0/2693564377 wait complete. 2026-02-17T21:30:49.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.829+0000 7fd467904640 10 monclient: build_initial_monmap 2026-02-17T21:30:49.846 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.829+0000 7fd467904640 10 monclient: monmap: 2026-02-17T21:30:49.846 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:49.846 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:49.846 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:49.846 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:49.846 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:49.847 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.847 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:49.847 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:49.847 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:49.847 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.829+0000 7fd467904640 1 librados: starting msgr at 2026-02-17T21:30:49.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.829+0000 7fd467904640 1 librados: starting objecter 2026-02-17T21:30:49.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.829+0000 7fd467904640 1 Processor -- start 2026-02-17T21:30:49.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.829+0000 7fd467904640 1 -- start start 2026-02-17T21:30:49.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.829+0000 7fd467904640 1 librados: setting wanted keys 2026-02-17T21:30:49.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.829+0000 7fd467904640 1 librados: calling monclient init 2026-02-17T21:30:49.847 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.829+0000 7fd467904640 10 monclient: init 2026-02-17T21:30:49.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd467904640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:49.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd467904640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:30:49.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd467904640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd46014f280 0x7fd460142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:49.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd467904640 10 monclient(hunting): picked mon.noname-b con 0x7fd46014f280 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:49.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd467904640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd46014f660 0x7fd4601f3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:49.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd467904640 10 monclient(hunting): picked mon.noname-c con 0x7fd46014f660 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:49.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd467904640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd46015abc0 0x7fd46014cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:49.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd467904640 10 monclient(hunting): picked mon.noname-a con 0x7fd46015abc0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:49.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd467904640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:49.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd467904640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd4600c9b70 con 0x7fd46015abc0 2026-02-17T21:30:49.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd467904640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:49.848 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd467904640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd46015a730 con 0x7fd46014f280 2026-02-17T21:30:49.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd467904640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:49.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd467904640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd4600c9cf0 con 0x7fd46014f660 2026-02-17T21:30:49.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd467904640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:49.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd467904640 10 monclient(hunting): authenticate will time out at 1355.396105s 2026-02-17T21:30:49.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd465e7a640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd46015abc0 0x7fd46014cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd464e78640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd46014f660 0x7fd4601f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd465e7a640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd46015abc0 0x7fd46014cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48406/0 (socket says 10.20.193.5:48406) 2026-02-17T21:30:49.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd465e7a640 1 -- 10.20.193.5:0/3440417235 learned_addr learned my addr 10.20.193.5:0/3440417235 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:49.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd465e7a640 10 monclient(hunting): get_auth_request con 0x7fd46015abc0 auth_method 0 2026-02-17T21:30:49.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd465e7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:49.849 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd465e7a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:49.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd465e7a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:49.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd464e78640 10 monclient(hunting): get_auth_request con 0x7fd46014f660 auth_method 0 2026-02-17T21:30:49.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd464e78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:49.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd464e78640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:49.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd464e78640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:49.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd465679640 1 --2- 10.20.193.5:0/3440417235 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd46014f280 0x7fd460142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd465e7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:49.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd465e7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:49.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd465e7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:49.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd464e78640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:49.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd464e78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:49.850 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd464e78640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:49.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd465679640 10 monclient(hunting): get_auth_request con 0x7fd46014f280 auth_method 0 2026-02-17T21:30:49.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd465679640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:49.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd465679640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:49.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.830+0000 7fd465679640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:49.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.831+0000 7fd465679640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:49.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.831+0000 7fd465679640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:49.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.831+0000 7fd465679640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:49.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.832+0000 7fd464e78640 10 monclient(hunting): handle_auth_done global_id 5324 payload 824 2026-02-17T21:30:49.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.832+0000 7fd464e78640 1 -- 10.20.193.5:0/3440417235 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd46014f280 msgr2=0x7fd460142180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.832+0000 7fd464e78640 1 --2- 10.20.193.5:0/3440417235 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd46014f280 0x7fd460142180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.832+0000 7fd464e78640 1 -- 10.20.193.5:0/3440417235 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd46015abc0 msgr2=0x7fd46014cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:49.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.832+0000 7fd464e78640 1 --2- 10.20.193.5:0/3440417235 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd46015abc0 0x7fd46014cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:49.851 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.832+0000 7fd464e78640 10 monclient: _finish_hunting 0 2026-02-17T21:30:49.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.832+0000 7fd464e78640 1 monclient: found mon.noname-c 2026-02-17T21:30:49.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.832+0000 7fd464e78640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:49.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.832+0000 7fd464e78640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:49.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.832+0000 7fd464e78640 1 -- 10.20.193.5:0/3440417235 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4601f7310 con 0x7fd46014f660 2026-02-17T21:30:49.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.833+0000 7fd464e78640 1 --2- 10.20.193.5:0/3440417235 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd46014f660 0x7fd4601f3390 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd454036000 tx=0x7fd4540047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:49.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.833+0000 7fd44dffb640 10 client.?.objecter ms_handle_connect 0x7fd46014f660 2026-02-17T21:30:49.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.833+0000 7fd44dffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:49.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.834+0000 7fd44dffb640 1 -- 10.20.193.5:0/3440417235 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd454046020 con 0x7fd46014f660 2026-02-17T21:30:49.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.834+0000 7fd44dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:49.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.834+0000 7fd44dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:49.852 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.834+0000 7fd44dffb640 10 monclient: dump: 2026-02-17T21:30:49.852 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:49.853 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:49.853 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.853 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.853 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:49.853 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.853 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:49.853 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:49.853 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:49.853 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.834+0000 7fd44dffb640 10 monclient: _finish_auth 0 2026-02-17T21:30:49.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.834+0000 7fd44dffb640 10 monclient: _check_auth_tickets 2026-02-17T21:30:49.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.834+0000 7fd44dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:49.853 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.834+0000 7fd44dffb640 1 -- 10.20.193.5:0/3440417235 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd454042420 con 0x7fd46014f660 2026-02-17T21:30:49.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.834+0000 7fd467904640 5 monclient: authenticate success, global_id 5324 2026-02-17T21:30:49.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.834+0000 7fd467904640 10 monclient: _renew_subs 2026-02-17T21:30:49.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.834+0000 7fd467904640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:49.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.834+0000 7fd467904640 1 -- 10.20.193.5:0/3440417235 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4601f75f0 con 0x7fd46014f660 2026-02-17T21:30:49.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.834+0000 7fd44dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:49.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.834+0000 7fd44dffb640 1 -- 10.20.193.5:0/3440417235 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45403c040 con 0x7fd46014f660 2026-02-17T21:30:49.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.834+0000 7fd44dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:49.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.834+0000 7fd44dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:49.854 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.834+0000 7fd44dffb640 10 monclient: dump: 2026-02-17T21:30:49.854 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:49.854 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:49.854 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.855 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:49.855 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:49.855 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:49.855 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:49.855 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:49.855 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:49.855 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:49.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.834+0000 7fd44f7fe640 4 set_mon_vals no callback set 2026-02-17T21:30:49.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.834+0000 7fd467904640 10 client.5324.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:49.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.834+0000 7fd467904640 10 monclient: _renew_subs 2026-02-17T21:30:49.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.834+0000 7fd467904640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:49.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.834+0000 7fd467904640 1 -- 10.20.193.5:0/3440417235 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4601451d0 con 0x7fd46014f660 2026-02-17T21:30:49.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.834+0000 7fd467904640 1 librados: init done 2026-02-17T21:30:49.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.835+0000 7fd467904640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:49.855 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.835+0000 7fd467904640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:49.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.835+0000 7fd467904640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:49.856 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.835+0000 7fd467904640 1 -- 10.20.193.5:0/3440417235 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4600cb560 con 0x7fd46014f660 2026-02-17T21:30:49.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.846+0000 7fd44dffb640 1 -- 10.20.193.5:0/3440417235 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fd45403f030 con 0x7fd46014f660 2026-02-17T21:30:49.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.847+0000 7fd44dffb640 1 --2- 10.20.193.5:0/3440417235 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd430079300 0x7fd43007b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:49.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.847+0000 7fd465679640 1 --2- 10.20.193.5:0/3440417235 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd430079300 0x7fd43007b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:49.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.847+0000 7fd465679640 10 monclient: get_auth_request con 0x7fd430079300 auth_method 0 2026-02-17T21:30:49.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.848+0000 7fd465679640 1 --2- 10.20.193.5:0/3440417235 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd430079300 0x7fd43007b7c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd450007b60 tx=0x7fd450007ab0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:49.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.848+0000 7fd44dffb640 10 client.5324.objecter ms_handle_connect 0x7fd430079300 2026-02-17T21:30:49.857 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.848+0000 7fd44dffb640 1 -- 10.20.193.5:0/3440417235 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fd454083450 con 0x7fd46014f660 2026-02-17T21:30:49.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.848+0000 7fd44dffb640 10 client.5324.objecter ms_dispatch2 0x7fd460000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:49.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.848+0000 7fd44dffb640 3 client.5324.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:49.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.848+0000 7fd44dffb640 3 client.5324.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:49.858 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.848+0000 7fd44dffb640 20 client.5324.objecter dump_active .. 0 homeless 2026-02-17T21:30:49.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.948+0000 7fd44dffb640 1 -- 10.20.193.5:0/3440417235 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd454050030 con 0x7fd46014f660 2026-02-17T21:30:49.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.948+0000 7fd44dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:49.951 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:49.948+0000 7fd44dffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:50.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.032+0000 7fd467904640 1 -- 10.20.193.5:0/3440417235 --> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "14", "target": ["mon-mgr", ""]}) -- 0x7fd460143760 con 0x7fd430079300 2026-02-17T21:30:50.035 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.032+0000 7fd44dffb640 1 -- 10.20.193.5:0/3440417235 <== mgr.4131 v2:10.20.193.176:6800/2898618020 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 14 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7fd460143760 con 0x7fd430079300 2026-02-17T21:30:50.035 INFO:teuthology.orchestra.run.trial005.stderr:instructed osd(s) 14 to deep-scrub 2026-02-17T21:30:50.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.034+0000 7fd467904640 10 librados: watch_flush enter 2026-02-17T21:30:50.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.034+0000 7fd467904640 10 librados: watch_flush exit 2026-02-17T21:30:50.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.034+0000 7fd467904640 20 client.5324.objecter shutdown clearing up homeless session... 2026-02-17T21:30:50.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.034+0000 7fd467904640 10 client.5324.objecter successfully canceled tick 2026-02-17T21:30:50.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.034+0000 7fd467904640 1 -- 10.20.193.5:0/3440417235 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd430079300 msgr2=0x7fd43007b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.037 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.034+0000 7fd467904640 1 --2- 10.20.193.5:0/3440417235 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd430079300 0x7fd43007b7c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd450007b60 tx=0x7fd450007ab0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.034+0000 7fd467904640 10 monclient: shutdown 2026-02-17T21:30:50.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.034+0000 7fd467904640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:50.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.034+0000 7fd467904640 1 -- 10.20.193.5:0/3440417235 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd46014f660 msgr2=0x7fd4601f3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.034+0000 7fd467904640 1 --2- 10.20.193.5:0/3440417235 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd46014f660 0x7fd4601f3390 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd454036000 tx=0x7fd4540047c0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.034+0000 7fd467904640 1 -- 10.20.193.5:0/3440417235 shutdown_connections 2026-02-17T21:30:50.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.034+0000 7fd467904640 1 --2- 10.20.193.5:0/3440417235 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fd430079300 0x7fd43007b7c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.034+0000 7fd467904640 1 --2- 10.20.193.5:0/3440417235 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fd46015abc0 0x7fd46014cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.034+0000 7fd467904640 1 --2- 10.20.193.5:0/3440417235 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fd46014f660 0x7fd4601f3390 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.034+0000 7fd467904640 1 --2- 10.20.193.5:0/3440417235 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd46014f280 0x7fd460142180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.034+0000 7fd467904640 1 -- 10.20.193.5:0/3440417235 >> 10.20.193.5:0/3440417235 conn(0x7fd4600c9f20 msgr2=0x7fd46014dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:50.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.034+0000 7fd467904640 1 -- 10.20.193.5:0/3440417235 shutdown_connections 2026-02-17T21:30:50.038 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.034+0000 7fd467904640 1 -- 10.20.193.5:0/3440417235 wait complete. 2026-02-17T21:30:50.039 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.034+0000 7fd467904640 1 librados: shutdown 2026-02-17T21:30:50.045 INFO:tasks.ceph:Scrubbing osd.3 2026-02-17T21:30:50.045 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:30:50.116 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.114+0000 7fe9ecc56640 10 monclient: get_monmap_and_config 2026-02-17T21:30:50.116 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.114+0000 7fe9ecc56640 10 monclient: build_initial_monmap 2026-02-17T21:30:50.116 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.114+0000 7fe9ecc56640 10 monclient: monmap: 2026-02-17T21:30:50.116 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:50.116 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.117 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:50.115735+0000 2026-02-17T21:30:50.117 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:50.115735+0000 2026-02-17T21:30:50.117 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:50.117 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.117 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:50.117 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:50.117 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:50.117 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:50.117 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:50.117 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:50.117 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.120 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.114+0000 7fe9ecc56640 1 Processor -- start 2026-02-17T21:30:50.120 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.114+0000 7fe9ecc56640 1 -- start start 2026-02-17T21:30:50.120 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.114+0000 7fe9ecc56640 10 monclient: init 2026-02-17T21:30:50.120 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.115+0000 7fe9ecc56640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:50.120 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.115+0000 7fe9ecc56640 10 monclient: _add_conns ranks=[2,0,1,4,5,3] 2026-02-17T21:30:50.120 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.115+0000 7fe9ecc56640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe9e8153930 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:50.120 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.115+0000 7fe9ecc56640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe9e8153d10 addr v1:10.20.193.5:6789/0 2026-02-17T21:30:50.120 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.115+0000 7fe9ecc56640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fe9e80c7e40 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:50.121 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.115+0000 7fe9ecc56640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9e80c85a0 con 0x7fe9e8153d10 2026-02-17T21:30:50.121 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.115+0000 7fe9ecc56640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9e80c8880 con 0x7fe9e80c7e40 2026-02-17T21:30:50.121 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.115+0000 7fe9ecc56640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9e80c8b60 con 0x7fe9e8153930 2026-02-17T21:30:50.121 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.115+0000 7fe9ecc56640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:50.121 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.115+0000 7fe9ecc56640 10 monclient(hunting): authenticate will time out at 1355.681158s 2026-02-17T21:30:50.121 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.115+0000 7fe9e5d74640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7fe9e8153d10 0x7fe9e80c52d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:39954/0 (socket says 10.20.193.5:39954) 2026-02-17T21:30:50.121 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.115+0000 7fe9e5d74640 1 -- 10.20.193.5:0/524562073 learned_addr learned my addr 10.20.193.5:0/524562073 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:50.121 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.116+0000 7fe9e5573640 1 -- 10.20.193.5:0/524562073 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2309197037 0 0) 0x7fe9e80c85a0 con 0x7fe9e8153d10 2026-02-17T21:30:50.121 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.116+0000 7fe9e5573640 10 monclient(hunting): _negotiate 2026-02-17T21:30:50.121 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.116+0000 7fe9e5573640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.121 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.116+0000 7fe9e5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:50.122 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.116+0000 7fe9e5573640 10 monclient(hunting): my global_id is 5259 2026-02-17T21:30:50.122 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.116+0000 7fe9e5573640 1 -- 10.20.193.5:0/524562073 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9d4003620 con 0x7fe9e8153d10 2026-02-17T21:30:50.122 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.116+0000 7fe9e5573640 1 -- 10.20.193.5:0/524562073 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 854144390 0 0) 0x7fe9e80c8880 con 0x7fe9e80c7e40 2026-02-17T21:30:50.122 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.116+0000 7fe9e5573640 10 monclient(hunting): _negotiate 2026-02-17T21:30:50.122 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.116+0000 7fe9e5573640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.122 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.116+0000 7fe9e5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:50.122 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.116+0000 7fe9e5573640 10 monclient(hunting): my global_id is 5329 2026-02-17T21:30:50.122 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.116+0000 7fe9e5573640 1 -- 10.20.193.5:0/524562073 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9e80c85a0 con 0x7fe9e80c7e40 2026-02-17T21:30:50.122 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.117+0000 7fe9e5573640 1 -- 10.20.193.5:0/524562073 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2729752903 0 0) 0x7fe9e80c8b60 con 0x7fe9e8153930 2026-02-17T21:30:50.122 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.117+0000 7fe9e5573640 10 monclient(hunting): _negotiate 2026-02-17T21:30:50.122 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.117+0000 7fe9e5573640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.122 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.117+0000 7fe9e5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:50.123 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.117+0000 7fe9e5573640 10 monclient(hunting): my global_id is 5327 2026-02-17T21:30:50.123 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.117+0000 7fe9e5573640 1 -- 10.20.193.5:0/524562073 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9e80c8880 con 0x7fe9e8153930 2026-02-17T21:30:50.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 1 -- 10.20.193.5:0/524562073 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 836320285 0 0) 0x7fe9e80c85a0 con 0x7fe9e80c7e40 2026-02-17T21:30:50.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 1 -- 10.20.193.5:0/524562073 >> v1:10.20.193.135:6789/0 conn(0x7fe9e8153930 legacy=0x7fe9e815b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 1 -- 10.20.193.5:0/524562073 >> v1:10.20.193.5:6789/0 conn(0x7fe9e8153d10 legacy=0x7fe9e80c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 10 monclient: _finish_hunting 0 2026-02-17T21:30:50.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 1 monclient: found mon.noname-b-legacy 2026-02-17T21:30:50.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:50.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.119:6789/0 2026-02-17T21:30:50.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 1 -- 10.20.193.5:0/524562073 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e80c8e40 con 0x7fe9e80c7e40 2026-02-17T21:30:50.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 10 monclient: _finish_auth 0 2026-02-17T21:30:50.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 10 monclient: _check_auth_tickets 2026-02-17T21:30:50.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:50.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 1 -- 10.20.193.5:0/524562073 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3880376286 0 0) 0x7fe9d8003260 con 0x7fe9e80c7e40 2026-02-17T21:30:50.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:50.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T21:30:50.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 10 monclient: dump: 2026-02-17T21:30:50.134 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:50.134 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.134 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.134 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.134 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:50.134 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.134 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:50.134 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:50.134 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:50.135 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] but i'm connected to v1:10.20.193.119:6789/0, reconnecting 2026-02-17T21:30:50.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:50.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 1 -- 10.20.193.5:0/524562073 >> v1:10.20.193.119:6789/0 conn(0x7fe9e80c7e40 legacy=0x7fe9e815d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:30:50.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 1 --2- 10.20.193.5:0/524562073 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe9d4003fe0 0x7fe9d4004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 10 monclient(hunting): picked mon.b con 0x7fe9d4003fe0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:50.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 1 --2- 10.20.193.5:0/524562073 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe9d4004e40 0x7fe9d40052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 10 monclient(hunting): picked mon.a con 0x7fe9d4004e40 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:50.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 1 --2- 10.20.193.5:0/524562073 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe9d4009ab0 0x7fe9d400bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.136 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 10 monclient(hunting): picked mon.c con 0x7fe9d4009ab0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:50.136 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:50.136 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 1 -- 10.20.193.5:0/524562073 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d400c570 con 0x7fe9d4004e40 2026-02-17T21:30:50.136 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:50.136 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 1 -- 10.20.193.5:0/524562073 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d400c6f0 con 0x7fe9d4003fe0 2026-02-17T21:30:50.136 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:50.136 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 1 -- 10.20.193.5:0/524562073 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d400c8f0 con 0x7fe9d4009ab0 2026-02-17T21:30:50.136 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:50.136 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.118+0000 7fe9e5573640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:30:50.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.119+0000 7fe9e6d76640 1 --2- 10.20.193.5:0/524562073 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe9d4009ab0 0x7fe9d400bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.119+0000 7fe9e5d74640 1 --2- 10.20.193.5:0/524562073 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe9d4004e40 0x7fe9d40052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.119+0000 7fe9e6575640 1 --2- 10.20.193.5:0/524562073 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe9d4003fe0 0x7fe9d4004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.120+0000 7fe9e6d76640 10 monclient(hunting): get_auth_request con 0x7fe9d4009ab0 auth_method 0 2026-02-17T21:30:50.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.120+0000 7fe9e6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:50.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.120+0000 7fe9e6d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.120+0000 7fe9e6d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:30:50.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.120+0000 7fe9e5d74640 10 monclient(hunting): get_auth_request con 0x7fe9d4004e40 auth_method 0 2026-02-17T21:30:50.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.120+0000 7fe9e5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:50.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.120+0000 7fe9e5d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.120+0000 7fe9e5d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:30:50.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.120+0000 7fe9e5d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:50.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.120+0000 7fe9e5d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:50.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.120+0000 7fe9e5d74640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:30:50.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.120+0000 7fe9e6575640 10 monclient(hunting): get_auth_request con 0x7fe9d4003fe0 auth_method 0 2026-02-17T21:30:50.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.120+0000 7fe9e6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:50.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.120+0000 7fe9e6575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.120+0000 7fe9e6575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:30:50.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.120+0000 7fe9e6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:50.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.120+0000 7fe9e6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:50.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.120+0000 7fe9e6d76640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:30:50.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.120+0000 7fe9e6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:50.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.120+0000 7fe9e6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:50.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.120+0000 7fe9e6575640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:30:50.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.121+0000 7fe9e5d74640 10 monclient(hunting): handle_auth_done global_id 5329 payload 293 2026-02-17T21:30:50.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.121+0000 7fe9e5d74640 1 -- 10.20.193.5:0/524562073 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe9d4009ab0 msgr2=0x7fe9d400bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:50.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.121+0000 7fe9e5d74640 1 --2- 10.20.193.5:0/524562073 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe9d4009ab0 0x7fe9d400bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.121+0000 7fe9e5d74640 1 -- 10.20.193.5:0/524562073 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe9d4003fe0 msgr2=0x7fe9d4004900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:50.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.121+0000 7fe9e5d74640 1 --2- 10.20.193.5:0/524562073 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe9d4003fe0 0x7fe9d4004900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.121+0000 7fe9e5d74640 10 monclient: _finish_hunting 0 2026-02-17T21:30:50.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.121+0000 7fe9e5d74640 1 monclient: found mon.a 2026-02-17T21:30:50.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.121+0000 7fe9e5d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:50.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.121+0000 7fe9e5d74640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:50.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.121+0000 7fe9e5d74640 1 -- 10.20.193.5:0/524562073 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e80c85a0 con 0x7fe9d4004e40 2026-02-17T21:30:50.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.121+0000 7fe9e6d76640 1 -- 10.20.193.5:0/524562073 reap_dead start 2026-02-17T21:30:50.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.121+0000 7fe9e5d74640 10 monclient: _finish_auth 0 2026-02-17T21:30:50.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.121+0000 7fe9e5d74640 10 monclient: _check_auth_tickets 2026-02-17T21:30:50.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.121+0000 7fe9e5d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:50.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.121+0000 7fe9ecc56640 5 monclient: authenticate success, global_id 5329 2026-02-17T21:30:50.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.121+0000 7fe9ecc56640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:50.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.122+0000 7fe9e5d74640 1 --2- 10.20.193.5:0/524562073 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe9d4004e40 0x7fe9d40052c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0003370 tx=0x7fe9d002f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b202b180559ed46e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:50.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.124+0000 7fe9e5573640 1 -- 10.20.193.5:0/524562073 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0002f90 con 0x7fe9d4004e40 2026-02-17T21:30:50.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.124+0000 7fe9e5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:50.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.124+0000 7fe9e5573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:50.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.124+0000 7fe9e5573640 10 monclient: dump: 2026-02-17T21:30:50.140 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:50.140 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.140 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.140 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.141 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:50.141 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.141 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:50.141 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:50.141 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:50.141 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.124+0000 7fe9e5573640 1 -- 10.20.193.5:0/524562073 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9d0033070 con 0x7fe9d4004e40 2026-02-17T21:30:50.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.124+0000 7fe9ecc56640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:50.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.124+0000 7fe9e5573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:50.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.124+0000 7fe9e5573640 1 -- 10.20.193.5:0/524562073 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0004de0 con 0x7fe9d4004e40 2026-02-17T21:30:50.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.124+0000 7fe9ecc56640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:50.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.124+0000 7fe9ecc56640 4 set_mon_vals no callback set 2026-02-17T21:30:50.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.124+0000 7fe9e5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:50.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.124+0000 7fe9e5573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:50.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.124+0000 7fe9e5573640 10 monclient: dump: 2026-02-17T21:30:50.142 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:50.142 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.142 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.142 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.142 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:50.142 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.142 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:50.142 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:50.142 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:50.143 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.124+0000 7fe9ecc56640 10 monclient: shutdown 2026-02-17T21:30:50.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.124+0000 7fe9ecc56640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:50.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.124+0000 7fe9ecc56640 1 -- 10.20.193.5:0/524562073 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe9d4004e40 msgr2=0x7fe9d40052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.124+0000 7fe9ecc56640 1 --2- 10.20.193.5:0/524562073 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe9d4004e40 0x7fe9d40052c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0003370 tx=0x7fe9d002f070 comp rx=0 tx=0).stop 2026-02-17T21:30:50.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.124+0000 7fe9ecc56640 1 -- 10.20.193.5:0/524562073 shutdown_connections 2026-02-17T21:30:50.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.124+0000 7fe9ecc56640 1 --2- 10.20.193.5:0/524562073 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe9d4004e40 0x7fe9d40052c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.124+0000 7fe9ecc56640 1 -- 10.20.193.5:0/524562073 >> 10.20.193.5:0/524562073 conn(0x7fe9e80c9f40 msgr2=0x7fe9e80ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:50.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.124+0000 7fe9ecc56640 1 -- 10.20.193.5:0/524562073 shutdown_connections 2026-02-17T21:30:50.143 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.124+0000 7fe9ecc56640 1 -- 10.20.193.5:0/524562073 wait complete. 2026-02-17T21:30:50.144 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9ecc56640 10 monclient: build_initial_monmap 2026-02-17T21:30:50.144 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9ecc56640 10 monclient: monmap: 2026-02-17T21:30:50.144 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:50.144 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:50.144 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:50.144 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:50.144 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:50.144 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.144 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:50.144 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:50.144 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:50.145 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.145 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9ecc56640 1 librados: starting msgr at 2026-02-17T21:30:50.145 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9ecc56640 1 librados: starting objecter 2026-02-17T21:30:50.145 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9ecc56640 1 Processor -- start 2026-02-17T21:30:50.145 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9ecc56640 1 -- start start 2026-02-17T21:30:50.145 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9ecc56640 1 librados: setting wanted keys 2026-02-17T21:30:50.145 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9ecc56640 1 librados: calling monclient init 2026-02-17T21:30:50.145 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9ecc56640 10 monclient: init 2026-02-17T21:30:50.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9ecc56640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:50.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9ecc56640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:30:50.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9ecc56640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe9d4004e40 0x7fe9e81f22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9ecc56640 10 monclient(hunting): picked mon.noname-a con 0x7fe9d4004e40 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:50.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9ecc56640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe9e80ccb90 0x7fe9e8145180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9ecc56640 10 monclient(hunting): picked mon.noname-b con 0x7fe9e80ccb90 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:50.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9ecc56640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe9e81456c0 0x7fe9e80cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9ecc56640 10 monclient(hunting): picked mon.noname-c con 0x7fe9e81456c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:50.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9ecc56640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:50.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9ecc56640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e80c8250 con 0x7fe9d4004e40 2026-02-17T21:30:50.146 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9ecc56640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:50.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9ecc56640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e80c9490 con 0x7fe9e80ccb90 2026-02-17T21:30:50.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9ecc56640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:50.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9ecc56640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e80c7730 con 0x7fe9e81456c0 2026-02-17T21:30:50.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9ecc56640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:50.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9ecc56640 10 monclient(hunting): authenticate will time out at 1355.691726s 2026-02-17T21:30:50.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.125+0000 7fe9e6575640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe9d4004e40 0x7fe9e81f22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.126+0000 7fe9e5d74640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe9e80ccb90 0x7fe9e8145180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.126+0000 7fe9e6d76640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe9e81456c0 0x7fe9e80cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.147 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.126+0000 7fe9e6575640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe9d4004e40 0x7fe9e81f22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48416/0 (socket says 10.20.193.5:48416) 2026-02-17T21:30:50.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.126+0000 7fe9e6575640 1 -- 10.20.193.5:0/3011701783 learned_addr learned my addr 10.20.193.5:0/3011701783 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:50.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.126+0000 7fe9e6575640 10 monclient(hunting): get_auth_request con 0x7fe9d4004e40 auth_method 0 2026-02-17T21:30:50.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.126+0000 7fe9e6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:50.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.126+0000 7fe9e6575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.126+0000 7fe9e6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:50.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.126+0000 7fe9e6d76640 10 monclient(hunting): get_auth_request con 0x7fe9e81456c0 auth_method 0 2026-02-17T21:30:50.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.126+0000 7fe9e6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:50.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.126+0000 7fe9e6d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.126+0000 7fe9e6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:50.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.126+0000 7fe9e5d74640 10 monclient(hunting): get_auth_request con 0x7fe9e80ccb90 auth_method 0 2026-02-17T21:30:50.148 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.126+0000 7fe9e5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:50.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.126+0000 7fe9e5d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.126+0000 7fe9e5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:50.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.126+0000 7fe9e6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:50.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.126+0000 7fe9e6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:50.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.126+0000 7fe9e6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:50.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.126+0000 7fe9e6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:50.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.126+0000 7fe9e6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:50.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.126+0000 7fe9e6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:50.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.126+0000 7fe9e5d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:50.149 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.126+0000 7fe9e5d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:50.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.126+0000 7fe9e5d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:50.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.127+0000 7fe9e6d76640 10 monclient(hunting): handle_auth_done global_id 5330 payload 824 2026-02-17T21:30:50.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.127+0000 7fe9e6d76640 1 -- 10.20.193.5:0/3011701783 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe9e80ccb90 msgr2=0x7fe9e8145180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.127+0000 7fe9e6d76640 1 --2- 10.20.193.5:0/3011701783 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe9e80ccb90 0x7fe9e8145180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.127+0000 7fe9e6d76640 1 -- 10.20.193.5:0/3011701783 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe9d4004e40 msgr2=0x7fe9e81f22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.127+0000 7fe9e6d76640 1 --2- 10.20.193.5:0/3011701783 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe9d4004e40 0x7fe9e81f22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.127+0000 7fe9e6d76640 10 monclient: _finish_hunting 0 2026-02-17T21:30:50.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.127+0000 7fe9e6d76640 1 monclient: found mon.noname-c 2026-02-17T21:30:50.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.127+0000 7fe9e6d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:50.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.127+0000 7fe9e6d76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:50.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.127+0000 7fe9e6d76640 1 -- 10.20.193.5:0/3011701783 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e80726d0 con 0x7fe9e81456c0 2026-02-17T21:30:50.150 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.128+0000 7fe9e6d76640 1 --2- 10.20.193.5:0/3011701783 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe9e81456c0 0x7fe9e80cb7c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe9e80cacb0 tx=0x7fe9d800a600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:50.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.128+0000 7fe9ceffd640 10 client.?.objecter ms_handle_connect 0x7fe9e81456c0 2026-02-17T21:30:50.151 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.128+0000 7fe9ceffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:50.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ceffd640 1 -- 10.20.193.5:0/3011701783 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d800ac70 con 0x7fe9e81456c0 2026-02-17T21:30:50.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:50.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ceffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:50.154 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ceffd640 10 monclient: dump: 2026-02-17T21:30:50.154 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:50.154 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.154 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.154 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.154 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:50.155 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.155 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:50.155 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:50.155 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:50.155 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ceffd640 10 monclient: _finish_auth 0 2026-02-17T21:30:50.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ceffd640 10 monclient: _check_auth_tickets 2026-02-17T21:30:50.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:50.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ceffd640 1 -- 10.20.193.5:0/3011701783 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9d8019070 con 0x7fe9e81456c0 2026-02-17T21:30:50.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ceffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:50.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ceffd640 1 -- 10.20.193.5:0/3011701783 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8013610 con 0x7fe9e81456c0 2026-02-17T21:30:50.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ecc56640 5 monclient: authenticate success, global_id 5330 2026-02-17T21:30:50.155 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ecc56640 10 monclient: _renew_subs 2026-02-17T21:30:50.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9e4d72640 4 set_mon_vals no callback set 2026-02-17T21:30:50.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ecc56640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:50.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ecc56640 1 -- 10.20.193.5:0/3011701783 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e80729b0 con 0x7fe9e81456c0 2026-02-17T21:30:50.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:50.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ceffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:50.156 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ceffd640 10 monclient: dump: 2026-02-17T21:30:50.156 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:50.156 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.156 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.156 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.156 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:50.156 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.156 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:50.156 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:50.156 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:50.156 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ecc56640 10 client.5330.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:50.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ecc56640 10 monclient: _renew_subs 2026-02-17T21:30:50.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ecc56640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:50.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ecc56640 1 -- 10.20.193.5:0/3011701783 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e8072f70 con 0x7fe9e81456c0 2026-02-17T21:30:50.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ecc56640 1 librados: init done 2026-02-17T21:30:50.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ecc56640 10 client.5330.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:50.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ecc56640 15 client.5330.objecter _session_command_op_assign -1 1 2026-02-17T21:30:50.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ecc56640 20 client.5330.objecter _get_session osd=-1 returning homeless 2026-02-17T21:30:50.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ecc56640 10 client.5330.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:50.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ecc56640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:50.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.130+0000 7fe9ecc56640 1 -- 10.20.193.5:0/3011701783 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe9e815b070 con 0x7fe9e81456c0 2026-02-17T21:30:50.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.141+0000 7fe9ceffd640 1 -- 10.20.193.5:0/3011701783 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fe9d80139c0 con 0x7fe9e81456c0 2026-02-17T21:30:50.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.142+0000 7fe9ceffd640 1 --2- 10.20.193.5:0/3011701783 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe9b4079280 0x7fe9b407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.142+0000 7fe9e6575640 1 --2- 10.20.193.5:0/3011701783 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe9b4079280 0x7fe9b407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.157 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.142+0000 7fe9e6575640 10 monclient: get_auth_request con 0x7fe9b4079280 auth_method 0 2026-02-17T21:30:50.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.143+0000 7fe9ceffd640 1 -- 10.20.193.5:0/3011701783 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fe9d80988f0 con 0x7fe9e81456c0 2026-02-17T21:30:50.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.143+0000 7fe9ceffd640 10 client.5330.objecter ms_dispatch2 0x7fe9e8000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:50.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.143+0000 7fe9ceffd640 3 client.5330.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:50.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.143+0000 7fe9ceffd640 3 client.5330.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:50.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.143+0000 7fe9ceffd640 10 client.5330.objecter checking command 1 2026-02-17T21:30:50.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.143+0000 7fe9ceffd640 1 --2- 10.20.193.5:0/3011701783 >> [v2:10.20.193.176:6818/1862950168,v1:10.20.193.176:6819/1862950168] conn(0x7fe9b4081760 0x7fe9b4083b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.143+0000 7fe9ceffd640 20 client.5330.objecter _get_session s=0x7fe9b4081090 osd=3 3 2026-02-17T21:30:50.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.143+0000 7fe9ceffd640 20 client.5330.objecter put_session s=0x7fe9b4081090 osd=3 3 2026-02-17T21:30:50.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.143+0000 7fe9ceffd640 15 client.5330.objecter _session_command_op_remove -1 1 2026-02-17T21:30:50.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.143+0000 7fe9ceffd640 20 client.5330.objecter _get_session s=0x7fe9b4081090 osd=3 3 2026-02-17T21:30:50.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.143+0000 7fe9ceffd640 20 client.5330.objecter get_session s=0x7fe9b4081090 osd=3 3 2026-02-17T21:30:50.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.143+0000 7fe9ceffd640 15 client.5330.objecter _session_command_op_assign 3 1 2026-02-17T21:30:50.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.143+0000 7fe9ceffd640 20 client.5330.objecter put_session s=0x7fe9b4081090 osd=3 4 2026-02-17T21:30:50.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.143+0000 7fe9ceffd640 10 client.5330.objecter _send_command 1 2026-02-17T21:30:50.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.143+0000 7fe9ceffd640 1 -- 10.20.193.5:0/3011701783 --> [v2:10.20.193.176:6818/1862950168,v1:10.20.193.176:6819/1862950168] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe9d8004ea0 con 0x7fe9b4081760 2026-02-17T21:30:50.158 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.143+0000 7fe9ceffd640 20 client.5330.objecter dump_active .. 0 homeless 2026-02-17T21:30:50.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.143+0000 7fe9ceffd640 10 client.5330.objecter ms_handle_connect 0x7fe9b4079280 2026-02-17T21:30:50.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.143+0000 7fe9e6575640 1 --2- 10.20.193.5:0/3011701783 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe9b4079280 0x7fe9b407b740 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc011310 tx=0x7fe9dc005100 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:50.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.144+0000 7fe9e5d74640 1 --2- 10.20.193.5:0/3011701783 >> [v2:10.20.193.176:6818/1862950168,v1:10.20.193.176:6819/1862950168] conn(0x7fe9b4081760 0x7fe9b4083b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.144+0000 7fe9e5d74640 10 monclient: get_auth_request con 0x7fe9b4081760 auth_method 0 2026-02-17T21:30:50.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.144+0000 7fe9ceffd640 1 -- 10.20.193.5:0/3011701783 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe9d805f280 con 0x7fe9e81456c0 2026-02-17T21:30:50.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.144+0000 7fe9ceffd640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T21:30:50.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.145+0000 7fe9ceffd640 10 client.5330.objecter ms_handle_connect 0x7fe9b4081760 2026-02-17T21:30:50.159 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.145+0000 7fe9e5d74640 1 --2- 10.20.193.5:0/3011701783 >> [v2:10.20.193.176:6818/1862950168,v1:10.20.193.176:6819/1862950168] conn(0x7fe9b4081760 0x7fe9b4083b80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:50.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.155+0000 7fe9ceffd640 1 -- 10.20.193.5:0/3011701783 <== osd.3 v2:10.20.193.176:6818/1862950168 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fe9d8004ea0 con 0x7fe9b4081760 2026-02-17T21:30:50.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.155+0000 7fe9ceffd640 10 client.5330.objecter ms_dispatch2 0x7fe9e8000b90 command_reply(tid 1: 0 ) 2026-02-17T21:30:50.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.155+0000 7fe9ceffd640 10 client.5330.objecter _finish_command 1 = system:0 2026-02-17T21:30:50.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.155+0000 7fe9ceffd640 20 client.5330.objecter put_session s=0x7fe9b4081090 osd=3 4 2026-02-17T21:30:50.160 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.155+0000 7fe9ceffd640 15 client.5330.objecter _session_command_op_remove 3 1 2026-02-17T21:30:50.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.162+0000 7fe9ecc56640 10 client.5330.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:30:50.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.162+0000 7fe9ecc56640 15 client.5330.objecter _session_command_op_assign -1 2 2026-02-17T21:30:50.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.162+0000 7fe9ecc56640 20 client.5330.objecter _get_session s=0x7fe9b4081090 osd=3 3 2026-02-17T21:30:50.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.162+0000 7fe9ecc56640 20 client.5330.objecter put_session s=0x7fe9b4081090 osd=3 3 2026-02-17T21:30:50.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.162+0000 7fe9ecc56640 20 client.5330.objecter _get_session s=0x7fe9b4081090 osd=3 3 2026-02-17T21:30:50.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.162+0000 7fe9ecc56640 15 client.5330.objecter _session_command_op_remove -1 2 2026-02-17T21:30:50.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.162+0000 7fe9ecc56640 20 client.5330.objecter get_session s=0x7fe9b4081090 osd=3 3 2026-02-17T21:30:50.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.162+0000 7fe9ecc56640 15 client.5330.objecter _session_command_op_assign 3 2 2026-02-17T21:30:50.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.162+0000 7fe9ecc56640 20 client.5330.objecter put_session s=0x7fe9b4081090 osd=3 4 2026-02-17T21:30:50.164 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.162+0000 7fe9ecc56640 10 client.5330.objecter _send_command 2 2026-02-17T21:30:50.165 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.162+0000 7fe9ecc56640 1 -- 10.20.193.5:0/3011701783 --> [v2:10.20.193.176:6818/1862950168,v1:10.20.193.176:6819/1862950168] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe9e8154180 con 0x7fe9b4081760 2026-02-17T21:30:50.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.168+0000 7fe9ceffd640 1 -- 10.20.193.5:0/3011701783 <== osd.3 v2:10.20.193.176:6818/1862950168 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe9e8154180 con 0x7fe9b4081760 2026-02-17T21:30:50.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.168+0000 7fe9ceffd640 10 client.5330.objecter ms_dispatch2 0x7fe9e8000b90 command_reply(tid 2: 0 ) 2026-02-17T21:30:50.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.168+0000 7fe9ceffd640 10 client.5330.objecter _finish_command 2 = system:0 2026-02-17T21:30:50.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.168+0000 7fe9ceffd640 20 client.5330.objecter put_session s=0x7fe9b4081090 osd=3 4 2026-02-17T21:30:50.171 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.168+0000 7fe9ceffd640 15 client.5330.objecter _session_command_op_remove 3 2 2026-02-17T21:30:50.171 INFO:teuthology.orchestra.run.trial005.stdout:{ 2026-02-17T21:30:50.171 INFO:teuthology.orchestra.run.trial005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:30:50.171 INFO:teuthology.orchestra.run.trial005.stdout:} 2026-02-17T21:30:50.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.168+0000 7fe9ecc56640 10 librados: watch_flush enter 2026-02-17T21:30:50.172 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.168+0000 7fe9ecc56640 10 librados: watch_flush exit 2026-02-17T21:30:50.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.168+0000 7fe9ecc56640 10 client.5330.objecter close_session for osd.3 2026-02-17T21:30:50.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.168+0000 7fe9ecc56640 1 -- 10.20.193.5:0/3011701783 >> [v2:10.20.193.176:6818/1862950168,v1:10.20.193.176:6819/1862950168] conn(0x7fe9b4081760 msgr2=0x7fe9b4083b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.168+0000 7fe9ecc56640 1 --2- 10.20.193.5:0/3011701783 >> [v2:10.20.193.176:6818/1862950168,v1:10.20.193.176:6819/1862950168] conn(0x7fe9b4081760 0x7fe9b4083b80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.168+0000 7fe9ecc56640 20 client.5330.objecter put_session s=0x7fe9b4081090 osd=3 1 2026-02-17T21:30:50.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.168+0000 7fe9ecc56640 20 client.5330.objecter shutdown clearing up homeless session... 2026-02-17T21:30:50.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.168+0000 7fe9ecc56640 10 client.5330.objecter successfully canceled tick 2026-02-17T21:30:50.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.168+0000 7fe9ecc56640 1 -- 10.20.193.5:0/3011701783 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe9b4079280 msgr2=0x7fe9b407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.168+0000 7fe9ecc56640 1 --2- 10.20.193.5:0/3011701783 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe9b4079280 0x7fe9b407b740 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc011310 tx=0x7fe9dc005100 comp rx=0 tx=0).stop 2026-02-17T21:30:50.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.168+0000 7fe9ecc56640 10 monclient: shutdown 2026-02-17T21:30:50.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.168+0000 7fe9ecc56640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:50.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.168+0000 7fe9ecc56640 1 -- 10.20.193.5:0/3011701783 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe9e81456c0 msgr2=0x7fe9e80cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.168+0000 7fe9ecc56640 1 --2- 10.20.193.5:0/3011701783 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe9e81456c0 0x7fe9e80cb7c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe9e80cacb0 tx=0x7fe9d800a600 comp rx=0 tx=0).stop 2026-02-17T21:30:50.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.168+0000 7fe9e6d76640 1 -- 10.20.193.5:0/3011701783 reap_dead start 2026-02-17T21:30:50.173 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.169+0000 7fe9ecc56640 1 -- 10.20.193.5:0/3011701783 shutdown_connections 2026-02-17T21:30:50.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.169+0000 7fe9ecc56640 1 -- 10.20.193.5:0/3011701783 >> 10.20.193.5:0/3011701783 conn(0x7fe9e80c9f40 msgr2=0x7fe9e815d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:50.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.169+0000 7fe9ecc56640 1 -- 10.20.193.5:0/3011701783 shutdown_connections 2026-02-17T21:30:50.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.169+0000 7fe9ecc56640 1 -- 10.20.193.5:0/3011701783 wait complete. 2026-02-17T21:30:50.174 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.169+0000 7fe9ecc56640 1 librados: shutdown 2026-02-17T21:30:50.178 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-17T21:30:50.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.244+0000 7f8b033d3640 10 monclient: get_monmap_and_config 2026-02-17T21:30:50.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.244+0000 7f8b033d3640 10 monclient: build_initial_monmap 2026-02-17T21:30:50.246 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.244+0000 7f8b033d3640 10 monclient: monmap: 2026-02-17T21:30:50.247 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:50.247 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.247 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:50.245733+0000 2026-02-17T21:30:50.247 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:50.245733+0000 2026-02-17T21:30:50.247 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:50.247 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.247 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:50.247 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:50.247 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:50.248 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:50.248 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:50.248 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:50.248 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.244+0000 7f8b033d3640 1 Processor -- start 2026-02-17T21:30:50.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.244+0000 7f8b033d3640 1 -- start start 2026-02-17T21:30:50.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.244+0000 7f8b033d3640 10 monclient: init 2026-02-17T21:30:50.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.245+0000 7f8b033d3640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:50.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.245+0000 7f8b033d3640 10 monclient: _add_conns ranks=[1,0,5,4,3,2] 2026-02-17T21:30:50.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.245+0000 7f8b033d3640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f8afc0c7170 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:50.251 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.245+0000 7f8b033d3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8afc0c7550 addr v1:10.20.193.5:6789/0 2026-02-17T21:30:50.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.245+0000 7f8b033d3640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f8afc0c89c0 0x7f8afc0c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.245+0000 7f8b033d3640 10 monclient(hunting): picked mon.noname-c con 0x7f8afc0c89c0 addr v2:10.20.193.135:3300/0 2026-02-17T21:30:50.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.245+0000 7f8b033d3640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8afc0c4fd0 con 0x7f8afc0c7550 2026-02-17T21:30:50.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.245+0000 7f8b033d3640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8afc15a9a0 con 0x7f8afc0c7170 2026-02-17T21:30:50.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.245+0000 7f8b033d3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:50.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.245+0000 7f8b033d3640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f8afc0c8530 con 0x7f8afc0c89c0 2026-02-17T21:30:50.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.245+0000 7f8b033d3640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:50.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.245+0000 7f8b033d3640 10 monclient(hunting): authenticate will time out at 1355.811121s 2026-02-17T21:30:50.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.245+0000 7f8b00947640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7f8afc0c7550 0x7f8afc0749b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:39956/0 (socket says 10.20.193.5:39956) 2026-02-17T21:30:50.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.245+0000 7f8b00947640 1 -- 10.20.193.5:0/828632371 learned_addr learned my addr 10.20.193.5:0/828632371 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:50.252 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.245+0000 7f8b01949640 1 --2- 10.20.193.5:0/828632371 >> v2:10.20.193.135:3300/0 conn(0x7f8afc0c89c0 0x7f8afc0c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.245+0000 7f8b01949640 10 monclient(hunting): get_auth_request con 0x7f8afc0c89c0 auth_method 0 2026-02-17T21:30:50.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.245+0000 7f8b01949640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:50.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.245+0000 7f8b01949640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.245+0000 7f8b01949640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:50.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.246+0000 7f8b01949640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:50.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.246+0000 7f8b01949640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:50.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.246+0000 7f8b01949640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:50.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.246+0000 7f8b01949640 10 monclient(hunting): handle_auth_done global_id 5333 payload 274 2026-02-17T21:30:50.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.246+0000 7f8b01949640 1 -- 10.20.193.5:0/828632371 >> v1:10.20.193.119:6789/0 conn(0x7f8afc0c7170 legacy=0x7f8afc0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.253 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.246+0000 7f8b01949640 1 -- 10.20.193.5:0/828632371 >> v1:10.20.193.5:6789/0 conn(0x7f8afc0c7550 legacy=0x7f8afc0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.246+0000 7f8b01949640 10 monclient: _finish_hunting 0 2026-02-17T21:30:50.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.246+0000 7f8b01949640 1 monclient: found mon.noname-c 2026-02-17T21:30:50.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.246+0000 7f8aebfff640 1 -- 10.20.193.5:0/828632371 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 678849377 0 0) 0x7f8afc15a9a0 con 0x7f8afc0c7170 2026-02-17T21:30:50.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.246+0000 7f8b01949640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:50.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.246+0000 7f8b01949640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:50.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.246+0000 7f8b01949640 1 -- 10.20.193.5:0/828632371 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8afc0c5270 con 0x7f8afc0c89c0 2026-02-17T21:30:50.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.246+0000 7f8aebfff640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-17T21:30:50.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.247+0000 7f8b01949640 1 --2- 10.20.193.5:0/828632371 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8afc0c89c0 0x7f8afc0c8e70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8af8009d90 tx=0x7f8af802f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34c160c5346bc301 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:50.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.248+0000 7f8aebfff640 1 -- 10.20.193.5:0/828632371 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af803c070 con 0x7f8afc0c89c0 2026-02-17T21:30:50.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.248+0000 7f8aebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:50.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.248+0000 7f8aebfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:50.254 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.248+0000 7f8aebfff640 10 monclient: dump: 2026-02-17T21:30:50.255 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:50.255 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.255 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.255 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.255 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:50.255 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.255 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:50.255 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:50.255 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:50.255 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.248+0000 7f8aebfff640 10 monclient: _finish_auth 0 2026-02-17T21:30:50.255 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.248+0000 7f8aebfff640 10 monclient: _check_auth_tickets 2026-02-17T21:30:50.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.248+0000 7f8aebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:50.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.248+0000 7f8b033d3640 5 monclient: authenticate success, global_id 5333 2026-02-17T21:30:50.256 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.248+0000 7f8b033d3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:50.263 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.249+0000 7f8aebfff640 1 -- 10.20.193.5:0/828632371 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af8037440 con 0x7f8afc0c89c0 2026-02-17T21:30:50.263 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.249+0000 7f8aebfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:50.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.249+0000 7f8aebfff640 1 -- 10.20.193.5:0/828632371 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af8037810 con 0x7f8afc0c89c0 2026-02-17T21:30:50.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.249+0000 7f8aebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:50.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.249+0000 7f8aebfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:50.264 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.249+0000 7f8aebfff640 10 monclient: dump: 2026-02-17T21:30:50.264 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:50.264 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.264 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.264 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.264 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:50.265 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.265 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:50.265 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:50.265 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:50.265 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.249+0000 7f8b033d3640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:50.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.249+0000 7f8b033d3640 4 set_mon_vals no callback set 2026-02-17T21:30:50.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.249+0000 7f8b033d3640 10 monclient: shutdown 2026-02-17T21:30:50.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.249+0000 7f8b033d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:50.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.249+0000 7f8b033d3640 1 -- 10.20.193.5:0/828632371 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8afc0c89c0 msgr2=0x7f8afc0c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.265 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.249+0000 7f8b033d3640 1 --2- 10.20.193.5:0/828632371 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8afc0c89c0 0x7f8afc0c8e70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8af8009d90 tx=0x7f8af802f230 comp rx=0 tx=0).stop 2026-02-17T21:30:50.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.249+0000 7f8b033d3640 1 -- 10.20.193.5:0/828632371 shutdown_connections 2026-02-17T21:30:50.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.249+0000 7f8b033d3640 1 --2- 10.20.193.5:0/828632371 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8afc0c89c0 0x7f8afc0c8e70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.249+0000 7f8b033d3640 1 -- 10.20.193.5:0/828632371 >> 10.20.193.5:0/828632371 conn(0x7f8afc0c9f40 msgr2=0x7f8afc0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:50.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.249+0000 7f8b033d3640 1 -- 10.20.193.5:0/828632371 shutdown_connections 2026-02-17T21:30:50.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.249+0000 7f8b033d3640 1 -- 10.20.193.5:0/828632371 wait complete. 2026-02-17T21:30:50.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.250+0000 7f8b033d3640 10 monclient: build_initial_monmap 2026-02-17T21:30:50.266 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.250+0000 7f8b033d3640 10 monclient: monmap: 2026-02-17T21:30:50.266 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:50.266 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:50.266 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:50.267 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:50.267 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:50.267 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.267 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:50.267 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:50.267 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:50.267 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.250+0000 7f8b033d3640 1 librados: starting msgr at 2026-02-17T21:30:50.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.250+0000 7f8b033d3640 1 librados: starting objecter 2026-02-17T21:30:50.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.250+0000 7f8b033d3640 1 Processor -- start 2026-02-17T21:30:50.267 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.250+0000 7f8b033d3640 1 -- start start 2026-02-17T21:30:50.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.250+0000 7f8b033d3640 1 librados: setting wanted keys 2026-02-17T21:30:50.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.250+0000 7f8b033d3640 1 librados: calling monclient init 2026-02-17T21:30:50.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.250+0000 7f8b033d3640 10 monclient: init 2026-02-17T21:30:50.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b033d3640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:50.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b033d3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:30:50.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b033d3640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8afc0c7170 0x7f8afc15d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b033d3640 10 monclient(hunting): picked mon.noname-a con 0x7f8afc0c7170 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:50.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b033d3640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8afc0c7550 0x7f8afc0be910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b033d3640 10 monclient(hunting): picked mon.noname-b con 0x7f8afc0c7550 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:50.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b033d3640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8afc0c89c0 0x7f8afc0bee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b033d3640 10 monclient(hunting): picked mon.noname-c con 0x7f8afc0c89c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:50.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b033d3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:50.268 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b033d3640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc0c5830 con 0x7f8afc0c7170 2026-02-17T21:30:50.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b033d3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:50.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b033d3640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc0c93b0 con 0x7f8afc0c7550 2026-02-17T21:30:50.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b033d3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:50.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b033d3640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc0c7ee0 con 0x7f8afc0c89c0 2026-02-17T21:30:50.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b033d3640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:50.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b033d3640 10 monclient(hunting): authenticate will time out at 1355.817090s 2026-02-17T21:30:50.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b01148640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8afc0c7170 0x7f8afc15d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b01949640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8afc0c89c0 0x7f8afc0bee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b00947640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8afc0c7550 0x7f8afc0be910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b01148640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8afc0c7170 0x7f8afc15d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48426/0 (socket says 10.20.193.5:48426) 2026-02-17T21:30:50.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b01148640 1 -- 10.20.193.5:0/1820679847 learned_addr learned my addr 10.20.193.5:0/1820679847 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:50.269 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b01148640 10 monclient(hunting): get_auth_request con 0x7f8afc0c7170 auth_method 0 2026-02-17T21:30:50.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b01148640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:50.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b01148640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b01148640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:50.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b01949640 10 monclient(hunting): get_auth_request con 0x7f8afc0c89c0 auth_method 0 2026-02-17T21:30:50.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b01949640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:50.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b01949640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b01949640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:50.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b00947640 10 monclient(hunting): get_auth_request con 0x7f8afc0c7550 auth_method 0 2026-02-17T21:30:50.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b00947640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:50.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b00947640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b00947640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:50.270 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b01148640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:50.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b01148640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:50.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b01148640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:50.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b01949640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:50.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b01949640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:50.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b01949640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:50.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b00947640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:50.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b00947640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:50.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.251+0000 7f8b00947640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:50.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.253+0000 7f8b01949640 10 monclient(hunting): handle_auth_done global_id 5336 payload 824 2026-02-17T21:30:50.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.253+0000 7f8b01949640 1 -- 10.20.193.5:0/1820679847 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8afc0c7550 msgr2=0x7f8afc0be910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.253+0000 7f8b01949640 1 --2- 10.20.193.5:0/1820679847 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8afc0c7550 0x7f8afc0be910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.271 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.253+0000 7f8b01949640 1 -- 10.20.193.5:0/1820679847 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8afc0c7170 msgr2=0x7f8afc15d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.253+0000 7f8b01949640 1 --2- 10.20.193.5:0/1820679847 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8afc0c7170 0x7f8afc15d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.253+0000 7f8b01949640 10 monclient: _finish_hunting 0 2026-02-17T21:30:50.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.253+0000 7f8b01949640 1 monclient: found mon.noname-c 2026-02-17T21:30:50.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.253+0000 7f8b01949640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:50.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.253+0000 7f8b01949640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:50.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.253+0000 7f8b01949640 1 -- 10.20.193.5:0/1820679847 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8afc0c2ec0 con 0x7f8afc0c89c0 2026-02-17T21:30:50.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.254+0000 7f8b01949640 1 --2- 10.20.193.5:0/1820679847 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8afc0c89c0 0x7f8afc0bee50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8af8036000 tx=0x7f8af8004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:50.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.254+0000 7f8ae9ffb640 10 client.?.objecter ms_handle_connect 0x7f8afc0c89c0 2026-02-17T21:30:50.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.254+0000 7f8ae9ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:50.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.254+0000 7f8ae9ffb640 1 -- 10.20.193.5:0/1820679847 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af803c050 con 0x7f8afc0c89c0 2026-02-17T21:30:50.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.254+0000 7f8ae9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:50.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.254+0000 7f8ae9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:50.272 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.254+0000 7f8ae9ffb640 10 monclient: dump: 2026-02-17T21:30:50.273 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:50.273 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.273 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.273 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.273 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:50.273 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.273 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:50.273 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:50.273 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:50.273 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.255+0000 7f8ae9ffb640 10 monclient: _finish_auth 0 2026-02-17T21:30:50.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.255+0000 7f8ae9ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:30:50.273 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.255+0000 7f8ae9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:50.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.255+0000 7f8b033d3640 5 monclient: authenticate success, global_id 5336 2026-02-17T21:30:50.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.255+0000 7f8b033d3640 10 monclient: _renew_subs 2026-02-17T21:30:50.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.255+0000 7f8b033d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:50.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.255+0000 7f8b033d3640 1 -- 10.20.193.5:0/1820679847 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8afc0c3180 con 0x7f8afc0c89c0 2026-02-17T21:30:50.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.255+0000 7f8b033d3640 10 client.5336.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:50.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.255+0000 7f8b033d3640 10 monclient: _renew_subs 2026-02-17T21:30:50.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.255+0000 7f8b033d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:50.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.255+0000 7f8b033d3640 1 -- 10.20.193.5:0/1820679847 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8afc0c3740 con 0x7f8afc0c89c0 2026-02-17T21:30:50.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.255+0000 7f8b033d3640 1 librados: init done 2026-02-17T21:30:50.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.255+0000 7f8b033d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:50.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.255+0000 7f8b033d3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:50.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.255+0000 7f8b033d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:50.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.255+0000 7f8b033d3640 1 -- 10.20.193.5:0/1820679847 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8afc0c81c0 con 0x7f8afc0c89c0 2026-02-17T21:30:50.274 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.255+0000 7f8ae9ffb640 1 -- 10.20.193.5:0/1820679847 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af803d040 con 0x7f8afc0c89c0 2026-02-17T21:30:50.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.255+0000 7f8ae9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:50.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.255+0000 7f8aeb7fe640 4 set_mon_vals no callback set 2026-02-17T21:30:50.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.255+0000 7f8ae9ffb640 1 -- 10.20.193.5:0/1820679847 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af8035b00 con 0x7f8afc0c89c0 2026-02-17T21:30:50.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.255+0000 7f8ae9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:50.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.255+0000 7f8ae9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:50.275 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.255+0000 7f8ae9ffb640 10 monclient: dump: 2026-02-17T21:30:50.275 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:50.275 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.275 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.275 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.275 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:50.275 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.275 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:50.275 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:50.276 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:50.276 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.365 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.363+0000 7f8ae9ffb640 1 -- 10.20.193.5:0/1820679847 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f8af8035ca0 con 0x7f8afc0c89c0 2026-02-17T21:30:50.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.363+0000 7f8ae9ffb640 1 --2- 10.20.193.5:0/1820679847 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8acc079280 0x7f8acc07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.363+0000 7f8b01148640 1 --2- 10.20.193.5:0/1820679847 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8acc079280 0x7f8acc07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.363+0000 7f8b01148640 10 monclient: get_auth_request con 0x7f8acc079280 auth_method 0 2026-02-17T21:30:50.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.364+0000 7f8ae9ffb640 10 client.5336.objecter ms_handle_connect 0x7f8acc079280 2026-02-17T21:30:50.366 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.364+0000 7f8b01148640 1 --2- 10.20.193.5:0/1820679847 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8acc079280 0x7f8acc07b740 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8aec003fd0 tx=0x7f8aec002a80 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:50.367 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.365+0000 7f8ae9ffb640 1 -- 10.20.193.5:0/1820679847 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f8af80bde80 con 0x7f8afc0c89c0 2026-02-17T21:30:50.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.365+0000 7f8ae9ffb640 10 client.5336.objecter ms_dispatch2 0x7f8afc000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:50.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.365+0000 7f8ae9ffb640 3 client.5336.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:50.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.365+0000 7f8ae9ffb640 3 client.5336.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:50.368 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.365+0000 7f8ae9ffb640 20 client.5336.objecter dump_active .. 0 homeless 2026-02-17T21:30:50.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.371+0000 7f8ae9ffb640 1 -- 10.20.193.5:0/1820679847 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8af80883c0 con 0x7f8afc0c89c0 2026-02-17T21:30:50.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.371+0000 7f8ae9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:50.374 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.371+0000 7f8ae9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:50.456 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.454+0000 7f8b033d3640 1 -- 10.20.193.5:0/1820679847 --> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f8afc074eb0 con 0x7f8acc079280 2026-02-17T21:30:50.457 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.454+0000 7f8ae9ffb640 1 -- 10.20.193.5:0/1820679847 <== mgr.4131 v2:10.20.193.176:6800/2898618020 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8afc074eb0 con 0x7f8acc079280 2026-02-17T21:30:50.457 INFO:teuthology.orchestra.run.trial005.stderr:instructed osd(s) 3 to deep-scrub 2026-02-17T21:30:50.458 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.455+0000 7f8b033d3640 10 librados: watch_flush enter 2026-02-17T21:30:50.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.455+0000 7f8b033d3640 10 librados: watch_flush exit 2026-02-17T21:30:50.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.455+0000 7f8b033d3640 20 client.5336.objecter shutdown clearing up homeless session... 2026-02-17T21:30:50.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.455+0000 7f8b033d3640 10 client.5336.objecter successfully canceled tick 2026-02-17T21:30:50.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.455+0000 7f8b033d3640 1 -- 10.20.193.5:0/1820679847 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8acc079280 msgr2=0x7f8acc07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.455+0000 7f8b033d3640 1 --2- 10.20.193.5:0/1820679847 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8acc079280 0x7f8acc07b740 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8aec003fd0 tx=0x7f8aec002a80 comp rx=0 tx=0).stop 2026-02-17T21:30:50.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.455+0000 7f8b033d3640 10 monclient: shutdown 2026-02-17T21:30:50.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.455+0000 7f8b033d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:50.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.455+0000 7f8b033d3640 1 -- 10.20.193.5:0/1820679847 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8afc0c89c0 msgr2=0x7f8afc0bee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.455+0000 7f8b033d3640 1 --2- 10.20.193.5:0/1820679847 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8afc0c89c0 0x7f8afc0bee50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8af8036000 tx=0x7f8af8004b40 comp rx=0 tx=0).stop 2026-02-17T21:30:50.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.455+0000 7f8b033d3640 1 -- 10.20.193.5:0/1820679847 shutdown_connections 2026-02-17T21:30:50.459 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.455+0000 7f8b033d3640 1 --2- 10.20.193.5:0/1820679847 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8acc079280 0x7f8acc07b740 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.455+0000 7f8b033d3640 1 --2- 10.20.193.5:0/1820679847 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f8afc0c89c0 0x7f8afc0bee50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.455+0000 7f8b033d3640 1 --2- 10.20.193.5:0/1820679847 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8afc0c7550 0x7f8afc0be910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.455+0000 7f8b033d3640 1 --2- 10.20.193.5:0/1820679847 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f8afc0c7170 0x7f8afc15d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.455+0000 7f8b033d3640 1 -- 10.20.193.5:0/1820679847 >> 10.20.193.5:0/1820679847 conn(0x7f8afc0c9f40 msgr2=0x7f8afc0cca20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:50.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.455+0000 7f8b033d3640 1 -- 10.20.193.5:0/1820679847 shutdown_connections 2026-02-17T21:30:50.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.455+0000 7f8b033d3640 1 -- 10.20.193.5:0/1820679847 wait complete. 2026-02-17T21:30:50.460 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.455+0000 7f8b033d3640 1 librados: shutdown 2026-02-17T21:30:50.466 INFO:tasks.ceph:Scrubbing osd.7 2026-02-17T21:30:50.466 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:30:50.535 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.533+0000 7fe73a101640 10 monclient: get_monmap_and_config 2026-02-17T21:30:50.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.533+0000 7fe73a101640 10 monclient: build_initial_monmap 2026-02-17T21:30:50.536 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.533+0000 7fe73a101640 10 monclient: monmap: 2026-02-17T21:30:50.536 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:50.536 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.536 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:50.534794+0000 2026-02-17T21:30:50.536 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:50.534794+0000 2026-02-17T21:30:50.536 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:50.536 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.536 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:50.536 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:50.537 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:50.537 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:50.537 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:50.537 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:50.537 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.533+0000 7fe73a101640 1 Processor -- start 2026-02-17T21:30:50.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.533+0000 7fe73a101640 1 -- start start 2026-02-17T21:30:50.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.533+0000 7fe73a101640 10 monclient: init 2026-02-17T21:30:50.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.534+0000 7fe73a101640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:50.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.534+0000 7fe73a101640 10 monclient: _add_conns ranks=[0,4,1,2,5,3] 2026-02-17T21:30:50.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.534+0000 7fe73a101640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe73415d3c0 addr v1:10.20.193.5:6789/0 2026-02-17T21:30:50.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.534+0000 7fe73a101640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fe7340c94c0 0x7fe73415d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.534+0000 7fe73a101640 10 monclient(hunting): picked mon.noname-b con 0x7fe7340c94c0 addr v2:10.20.193.119:3300/0 2026-02-17T21:30:50.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.534+0000 7fe73a101640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fe73415b050 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:50.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.534+0000 7fe73a101640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe73415b4e0 con 0x7fe73415d3c0 2026-02-17T21:30:50.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.534+0000 7fe73a101640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7340c7e60 con 0x7fe73415b050 2026-02-17T21:30:50.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.534+0000 7fe73a101640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:50.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.534+0000 7fe73a101640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fe7340c8140 con 0x7fe7340c94c0 2026-02-17T21:30:50.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.534+0000 7fe73a101640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:50.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.534+0000 7fe73a101640 10 monclient(hunting): authenticate will time out at 1356.100081s 2026-02-17T21:30:50.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.534+0000 7fe7337fe640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7fe73415d3c0 0x7fe7340c7300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:39966/0 (socket says 10.20.193.5:39966) 2026-02-17T21:30:50.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.534+0000 7fe7337fe640 1 -- 10.20.193.5:0/3195379431 learned_addr learned my addr 10.20.193.5:0/3195379431 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:50.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.534+0000 7fe732ffd640 1 --2- 10.20.193.5:0/3195379431 >> v2:10.20.193.119:3300/0 conn(0x7fe7340c94c0 0x7fe73415d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.534+0000 7fe732ffd640 10 monclient(hunting): get_auth_request con 0x7fe7340c94c0 auth_method 0 2026-02-17T21:30:50.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.534+0000 7fe732ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:50.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.534+0000 7fe732ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.534+0000 7fe732ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:50.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.535+0000 7fe732ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:50.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.535+0000 7fe732ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:50.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.535+0000 7fe732ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:50.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.535+0000 7fe7327fc640 1 -- 10.20.193.5:0/3195379431 <== mon.0 v1:10.20.193.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 387685662 0 0) 0x7fe73415b4e0 con 0x7fe73415d3c0 2026-02-17T21:30:50.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.535+0000 7fe7327fc640 10 monclient(hunting): _negotiate 2026-02-17T21:30:50.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.535+0000 7fe7327fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.535+0000 7fe7327fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:50.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.535+0000 7fe7327fc640 10 monclient(hunting): my global_id is 5271 2026-02-17T21:30:50.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.535+0000 7fe7327fc640 1 -- 10.20.193.5:0/3195379431 --> v1:10.20.193.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe718003620 con 0x7fe73415d3c0 2026-02-17T21:30:50.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.536+0000 7fe732ffd640 10 monclient(hunting): handle_auth_done global_id 5341 payload 274 2026-02-17T21:30:50.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.536+0000 7fe732ffd640 1 -- 10.20.193.5:0/3195379431 >> v1:10.20.193.119:6789/0 conn(0x7fe73415b050 legacy=0x7fe7340c52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.536+0000 7fe732ffd640 1 -- 10.20.193.5:0/3195379431 >> v1:10.20.193.5:6789/0 conn(0x7fe73415d3c0 legacy=0x7fe7340c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.536+0000 7fe732ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:30:50.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.536+0000 7fe732ffd640 1 monclient: found mon.noname-b 2026-02-17T21:30:50.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.536+0000 7fe732ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:50.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.536+0000 7fe732ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:30:50.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.536+0000 7fe732ffd640 1 -- 10.20.193.5:0/3195379431 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7340c8420 con 0x7fe7340c94c0 2026-02-17T21:30:50.548 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.538+0000 7fe732ffd640 1 --2- 10.20.193.5:0/3195379431 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe7340c94c0 0x7fe73415d7a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe7240098a0 tx=0x7fe72402ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df3c139dc56afb25 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:50.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe7327fc640 1 -- 10.20.193.5:0/3195379431 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72403c070 con 0x7fe7340c94c0 2026-02-17T21:30:50.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe7327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:50.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe7327fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:30:50.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe7327fc640 10 monclient: dump: 2026-02-17T21:30:50.549 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:50.549 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.549 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.549 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.550 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:50.550 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.550 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:50.550 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:50.550 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:50.550 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe7327fc640 10 monclient: _finish_auth 0 2026-02-17T21:30:50.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe7327fc640 10 monclient: _check_auth_tickets 2026-02-17T21:30:50.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe7327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:50.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe7327fc640 1 -- 10.20.193.5:0/3195379431 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe72402fca0 con 0x7fe7340c94c0 2026-02-17T21:30:50.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe73a101640 5 monclient: authenticate success, global_id 5341 2026-02-17T21:30:50.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe73a101640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:50.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe7327fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:50.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe7327fc640 1 -- 10.20.193.5:0/3195379431 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe724037660 con 0x7fe7340c94c0 2026-02-17T21:30:50.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe7327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:50.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe7327fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:30:50.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe7327fc640 10 monclient: dump: 2026-02-17T21:30:50.551 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:50.551 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.551 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.552 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.552 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:50.552 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.552 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:50.552 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:50.552 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:50.552 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe73a101640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:50.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe73a101640 4 set_mon_vals no callback set 2026-02-17T21:30:50.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe73a101640 10 monclient: shutdown 2026-02-17T21:30:50.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe73a101640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:50.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe73a101640 1 -- 10.20.193.5:0/3195379431 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe7340c94c0 msgr2=0x7fe73415d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe73a101640 1 --2- 10.20.193.5:0/3195379431 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe7340c94c0 0x7fe73415d7a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe7240098a0 tx=0x7fe72402ef90 comp rx=0 tx=0).stop 2026-02-17T21:30:50.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe73a101640 1 -- 10.20.193.5:0/3195379431 shutdown_connections 2026-02-17T21:30:50.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe73a101640 1 --2- 10.20.193.5:0/3195379431 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe7340c94c0 0x7fe73415d7a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe73a101640 1 -- 10.20.193.5:0/3195379431 >> 10.20.193.5:0/3195379431 conn(0x7fe7340c9f60 msgr2=0x7fe7340ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:50.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe73a101640 1 -- 10.20.193.5:0/3195379431 shutdown_connections 2026-02-17T21:30:50.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.540+0000 7fe73a101640 1 -- 10.20.193.5:0/3195379431 wait complete. 2026-02-17T21:30:50.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.541+0000 7fe73a101640 10 monclient: build_initial_monmap 2026-02-17T21:30:50.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.541+0000 7fe73a101640 10 monclient: monmap: 2026-02-17T21:30:50.554 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:50.554 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:50.554 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:50.554 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:50.554 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:50.554 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.554 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:50.554 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:50.554 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:50.554 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.541+0000 7fe73a101640 1 librados: starting msgr at 2026-02-17T21:30:50.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.541+0000 7fe73a101640 1 librados: starting objecter 2026-02-17T21:30:50.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.541+0000 7fe73a101640 1 Processor -- start 2026-02-17T21:30:50.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.541+0000 7fe73a101640 1 -- start start 2026-02-17T21:30:50.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.541+0000 7fe73a101640 1 librados: setting wanted keys 2026-02-17T21:30:50.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.541+0000 7fe73a101640 1 librados: calling monclient init 2026-02-17T21:30:50.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.541+0000 7fe73a101640 10 monclient: init 2026-02-17T21:30:50.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe73a101640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:50.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe73a101640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:30:50.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe73a101640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe7340c94c0 0x7fe7341f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe73a101640 10 monclient(hunting): picked mon.noname-a con 0x7fe7340c94c0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:50.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe73a101640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe73415b050 0x7fe73406de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe73a101640 10 monclient(hunting): picked mon.noname-c con 0x7fe73415b050 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:50.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe73a101640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe73415d3c0 0x7fe7341f6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe73a101640 10 monclient(hunting): picked mon.noname-b con 0x7fe73415d3c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:50.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe73a101640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:50.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe73a101640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe7340c8cc0 con 0x7fe7340c94c0 2026-02-17T21:30:50.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe73a101640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:50.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe73a101640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe7340c89e0 con 0x7fe73415d3c0 2026-02-17T21:30:50.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe73a101640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:50.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe73a101640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe7340c8fa0 con 0x7fe73415b050 2026-02-17T21:30:50.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe73a101640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:50.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe73a101640 10 monclient(hunting): authenticate will time out at 1356.108108s 2026-02-17T21:30:50.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe7337fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe7340c94c0 0x7fe7341f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe733fff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe73415d3c0 0x7fe7341f6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe7337fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe7340c94c0 0x7fe7341f4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48428/0 (socket says 10.20.193.5:48428) 2026-02-17T21:30:50.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe7337fe640 1 -- 10.20.193.5:0/4262596773 learned_addr learned my addr 10.20.193.5:0/4262596773 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:50.556 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe7337fe640 10 monclient(hunting): get_auth_request con 0x7fe7340c94c0 auth_method 0 2026-02-17T21:30:50.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe7337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:50.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe7337fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe7337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:50.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe733fff640 10 monclient(hunting): get_auth_request con 0x7fe73415d3c0 auth_method 0 2026-02-17T21:30:50.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe732ffd640 1 --2- 10.20.193.5:0/4262596773 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe73415b050 0x7fe73406de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe733fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:50.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe733fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe733fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:50.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe7337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:50.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe7337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:50.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe7337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:50.557 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe732ffd640 10 monclient(hunting): get_auth_request con 0x7fe73415b050 auth_method 0 2026-02-17T21:30:50.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe732ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:50.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe732ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe732ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:50.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe733fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:50.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe733fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:50.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.542+0000 7fe733fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:50.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.543+0000 7fe732ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:50.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.543+0000 7fe732ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:50.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.543+0000 7fe732ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:50.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.544+0000 7fe7337fe640 10 monclient(hunting): handle_auth_done global_id 5274 payload 824 2026-02-17T21:30:50.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.544+0000 7fe7337fe640 1 -- 10.20.193.5:0/4262596773 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe73415b050 msgr2=0x7fe73406de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.544+0000 7fe7337fe640 1 --2- 10.20.193.5:0/4262596773 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe73415b050 0x7fe73406de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.558 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.544+0000 7fe7337fe640 1 -- 10.20.193.5:0/4262596773 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe73415d3c0 msgr2=0x7fe7341f6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.544+0000 7fe7337fe640 1 --2- 10.20.193.5:0/4262596773 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe73415d3c0 0x7fe7341f6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.544+0000 7fe7337fe640 10 monclient: _finish_hunting 0 2026-02-17T21:30:50.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.544+0000 7fe7337fe640 1 monclient: found mon.noname-a 2026-02-17T21:30:50.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.544+0000 7fe7337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:50.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.544+0000 7fe7337fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:50.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.544+0000 7fe7337fe640 1 -- 10.20.193.5:0/4262596773 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7341f3a30 con 0x7fe7340c94c0 2026-02-17T21:30:50.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.545+0000 7fe7337fe640 1 --2- 10.20.193.5:0/4262596773 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe7340c94c0 0x7fe7341f4e30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe72000c550 tx=0x7fe72000ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:50.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.545+0000 7fe70ffff640 10 client.?.objecter ms_handle_connect 0x7fe7340c94c0 2026-02-17T21:30:50.559 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.545+0000 7fe70ffff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:50.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe70ffff640 1 -- 10.20.193.5:0/4262596773 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe720005de0 con 0x7fe7340c94c0 2026-02-17T21:30:50.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe70ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:50.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe70ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:50.563 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe70ffff640 10 monclient: dump: 2026-02-17T21:30:50.564 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:50.564 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.564 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.564 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.564 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:50.564 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.564 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:50.564 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:50.564 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:50.564 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe70ffff640 10 monclient: _finish_auth 0 2026-02-17T21:30:50.564 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe70ffff640 10 monclient: _check_auth_tickets 2026-02-17T21:30:50.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe70ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:50.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe70ffff640 1 -- 10.20.193.5:0/4262596773 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe720007070 con 0x7fe7340c94c0 2026-02-17T21:30:50.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe73a101640 5 monclient: authenticate success, global_id 5274 2026-02-17T21:30:50.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe73a101640 10 monclient: _renew_subs 2026-02-17T21:30:50.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe73a101640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:50.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe73a101640 1 -- 10.20.193.5:0/4262596773 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7341f7a20 con 0x7fe7340c94c0 2026-02-17T21:30:50.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe70ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:50.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe70ffff640 1 -- 10.20.193.5:0/4262596773 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe720007460 con 0x7fe7340c94c0 2026-02-17T21:30:50.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe70ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:50.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe70ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:50.565 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe70ffff640 10 monclient: dump: 2026-02-17T21:30:50.565 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:50.566 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.566 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.566 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.566 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:50.566 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.566 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:50.566 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:50.566 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:50.566 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe731ffb640 4 set_mon_vals no callback set 2026-02-17T21:30:50.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe73a101640 10 client.5274.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:50.566 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe73a101640 10 monclient: _renew_subs 2026-02-17T21:30:50.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe73a101640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:50.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe73a101640 1 -- 10.20.193.5:0/4262596773 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7341f3cd0 con 0x7fe7340c94c0 2026-02-17T21:30:50.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe73a101640 1 librados: init done 2026-02-17T21:30:50.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe73a101640 10 client.5274.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:50.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe73a101640 15 client.5274.objecter _session_command_op_assign -1 1 2026-02-17T21:30:50.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe73a101640 20 client.5274.objecter _get_session osd=-1 returning homeless 2026-02-17T21:30:50.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe73a101640 10 client.5274.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:50.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe73a101640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:50.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.547+0000 7fe73a101640 1 -- 10.20.193.5:0/4262596773 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe73415d7a0 con 0x7fe7340c94c0 2026-02-17T21:30:50.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.558+0000 7fe70ffff640 1 -- 10.20.193.5:0/4262596773 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fe720007600 con 0x7fe7340c94c0 2026-02-17T21:30:50.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.559+0000 7fe70ffff640 1 --2- 10.20.193.5:0/4262596773 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe7040792d0 0x7fe70407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.559+0000 7fe732ffd640 1 --2- 10.20.193.5:0/4262596773 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe7040792d0 0x7fe70407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.567 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.559+0000 7fe732ffd640 10 monclient: get_auth_request con 0x7fe7040792d0 auth_method 0 2026-02-17T21:30:50.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.559+0000 7fe732ffd640 1 --2- 10.20.193.5:0/4262596773 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe7040792d0 0x7fe70407b790 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe724039000 tx=0x7fe724033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:50.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.559+0000 7fe70ffff640 10 client.5274.objecter ms_handle_connect 0x7fe7040792d0 2026-02-17T21:30:50.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.560+0000 7fe70ffff640 1 -- 10.20.193.5:0/4262596773 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fe72005e250 con 0x7fe7340c94c0 2026-02-17T21:30:50.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.560+0000 7fe70ffff640 10 client.5274.objecter ms_dispatch2 0x7fe734000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:50.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.560+0000 7fe70ffff640 3 client.5274.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:50.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.560+0000 7fe70ffff640 3 client.5274.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:50.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.560+0000 7fe70ffff640 10 client.5274.objecter checking command 1 2026-02-17T21:30:50.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.560+0000 7fe70ffff640 1 --2- 10.20.193.5:0/4262596773 >> [v2:10.20.193.176:6826/1604873931,v1:10.20.193.176:6827/1604873931] conn(0x7fe7040817b0 0x7fe704083bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.560+0000 7fe70ffff640 20 client.5274.objecter _get_session s=0x7fe7040810e0 osd=7 3 2026-02-17T21:30:50.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.560+0000 7fe70ffff640 20 client.5274.objecter put_session s=0x7fe7040810e0 osd=7 3 2026-02-17T21:30:50.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.560+0000 7fe70ffff640 15 client.5274.objecter _session_command_op_remove -1 1 2026-02-17T21:30:50.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.560+0000 7fe70ffff640 20 client.5274.objecter _get_session s=0x7fe7040810e0 osd=7 3 2026-02-17T21:30:50.568 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.560+0000 7fe70ffff640 20 client.5274.objecter get_session s=0x7fe7040810e0 osd=7 3 2026-02-17T21:30:50.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.560+0000 7fe70ffff640 15 client.5274.objecter _session_command_op_assign 7 1 2026-02-17T21:30:50.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.560+0000 7fe70ffff640 20 client.5274.objecter put_session s=0x7fe7040810e0 osd=7 4 2026-02-17T21:30:50.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.560+0000 7fe70ffff640 10 client.5274.objecter _send_command 1 2026-02-17T21:30:50.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.560+0000 7fe70ffff640 1 -- 10.20.193.5:0/4262596773 --> [v2:10.20.193.176:6826/1604873931,v1:10.20.193.176:6827/1604873931] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe7040842a0 con 0x7fe7040817b0 2026-02-17T21:30:50.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.560+0000 7fe70ffff640 20 client.5274.objecter dump_active .. 0 homeless 2026-02-17T21:30:50.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.560+0000 7fe733fff640 1 --2- 10.20.193.5:0/4262596773 >> [v2:10.20.193.176:6826/1604873931,v1:10.20.193.176:6827/1604873931] conn(0x7fe7040817b0 0x7fe704083bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.561+0000 7fe70ffff640 1 -- 10.20.193.5:0/4262596773 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe72005e610 con 0x7fe7340c94c0 2026-02-17T21:30:50.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.561+0000 7fe70ffff640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T21:30:50.569 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.561+0000 7fe733fff640 10 monclient: get_auth_request con 0x7fe7040817b0 auth_method 0 2026-02-17T21:30:50.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.563+0000 7fe733fff640 1 --2- 10.20.193.5:0/4262596773 >> [v2:10.20.193.176:6826/1604873931,v1:10.20.193.176:6827/1604873931] conn(0x7fe7040817b0 0x7fe704083bd0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:50.570 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.563+0000 7fe70ffff640 10 client.5274.objecter ms_handle_connect 0x7fe7040817b0 2026-02-17T21:30:50.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.572+0000 7fe70ffff640 1 -- 10.20.193.5:0/4262596773 <== osd.7 v2:10.20.193.176:6826/1604873931 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fe7040842a0 con 0x7fe7040817b0 2026-02-17T21:30:50.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.572+0000 7fe70ffff640 10 client.5274.objecter ms_dispatch2 0x7fe734000b90 command_reply(tid 1: 0 ) 2026-02-17T21:30:50.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.572+0000 7fe70ffff640 10 client.5274.objecter _finish_command 1 = system:0 2026-02-17T21:30:50.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.572+0000 7fe70ffff640 20 client.5274.objecter put_session s=0x7fe7040810e0 osd=7 4 2026-02-17T21:30:50.574 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.572+0000 7fe70ffff640 15 client.5274.objecter _session_command_op_remove 7 1 2026-02-17T21:30:50.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.577+0000 7fe73a101640 10 client.5274.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:30:50.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.577+0000 7fe73a101640 15 client.5274.objecter _session_command_op_assign -1 2 2026-02-17T21:30:50.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.577+0000 7fe73a101640 20 client.5274.objecter _get_session s=0x7fe7040810e0 osd=7 3 2026-02-17T21:30:50.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.577+0000 7fe73a101640 20 client.5274.objecter put_session s=0x7fe7040810e0 osd=7 3 2026-02-17T21:30:50.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.577+0000 7fe73a101640 20 client.5274.objecter _get_session s=0x7fe7040810e0 osd=7 3 2026-02-17T21:30:50.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.577+0000 7fe73a101640 15 client.5274.objecter _session_command_op_remove -1 2 2026-02-17T21:30:50.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.577+0000 7fe73a101640 20 client.5274.objecter get_session s=0x7fe7040810e0 osd=7 3 2026-02-17T21:30:50.580 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.577+0000 7fe73a101640 15 client.5274.objecter _session_command_op_assign 7 2 2026-02-17T21:30:50.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.577+0000 7fe73a101640 20 client.5274.objecter put_session s=0x7fe7040810e0 osd=7 4 2026-02-17T21:30:50.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.577+0000 7fe73a101640 10 client.5274.objecter _send_command 2 2026-02-17T21:30:50.581 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.577+0000 7fe73a101640 1 -- 10.20.193.5:0/4262596773 --> [v2:10.20.193.176:6826/1604873931,v1:10.20.193.176:6827/1604873931] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe7340cc050 con 0x7fe7040817b0 2026-02-17T21:30:50.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.585+0000 7fe70ffff640 1 -- 10.20.193.5:0/4262596773 <== osd.7 v2:10.20.193.176:6826/1604873931 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe7340cc050 con 0x7fe7040817b0 2026-02-17T21:30:50.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.585+0000 7fe70ffff640 10 client.5274.objecter ms_dispatch2 0x7fe734000b90 command_reply(tid 2: 0 ) 2026-02-17T21:30:50.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.585+0000 7fe70ffff640 10 client.5274.objecter _finish_command 2 = system:0 2026-02-17T21:30:50.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.585+0000 7fe70ffff640 20 client.5274.objecter put_session s=0x7fe7040810e0 osd=7 4 2026-02-17T21:30:50.587 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.585+0000 7fe70ffff640 15 client.5274.objecter _session_command_op_remove 7 2 2026-02-17T21:30:50.587 INFO:teuthology.orchestra.run.trial005.stdout:{ 2026-02-17T21:30:50.588 INFO:teuthology.orchestra.run.trial005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:30:50.588 INFO:teuthology.orchestra.run.trial005.stdout:} 2026-02-17T21:30:50.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.585+0000 7fe73a101640 10 librados: watch_flush enter 2026-02-17T21:30:50.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.585+0000 7fe73a101640 10 librados: watch_flush exit 2026-02-17T21:30:50.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.585+0000 7fe73a101640 10 client.5274.objecter close_session for osd.7 2026-02-17T21:30:50.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.585+0000 7fe73a101640 1 -- 10.20.193.5:0/4262596773 >> [v2:10.20.193.176:6826/1604873931,v1:10.20.193.176:6827/1604873931] conn(0x7fe7040817b0 msgr2=0x7fe704083bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.589 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.585+0000 7fe73a101640 1 --2- 10.20.193.5:0/4262596773 >> [v2:10.20.193.176:6826/1604873931,v1:10.20.193.176:6827/1604873931] conn(0x7fe7040817b0 0x7fe704083bd0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.585+0000 7fe73a101640 20 client.5274.objecter put_session s=0x7fe7040810e0 osd=7 1 2026-02-17T21:30:50.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.585+0000 7fe73a101640 20 client.5274.objecter shutdown clearing up homeless session... 2026-02-17T21:30:50.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.585+0000 7fe73a101640 10 client.5274.objecter successfully canceled tick 2026-02-17T21:30:50.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.585+0000 7fe73a101640 1 -- 10.20.193.5:0/4262596773 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe7040792d0 msgr2=0x7fe70407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.585+0000 7fe73a101640 1 --2- 10.20.193.5:0/4262596773 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe7040792d0 0x7fe70407b790 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe724039000 tx=0x7fe724033000 comp rx=0 tx=0).stop 2026-02-17T21:30:50.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.585+0000 7fe73a101640 10 monclient: shutdown 2026-02-17T21:30:50.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.585+0000 7fe73a101640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:50.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.585+0000 7fe73a101640 1 -- 10.20.193.5:0/4262596773 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe7340c94c0 msgr2=0x7fe7341f4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.585+0000 7fe73a101640 1 --2- 10.20.193.5:0/4262596773 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe7340c94c0 0x7fe7341f4e30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe72000c550 tx=0x7fe72000ca20 comp rx=0 tx=0).stop 2026-02-17T21:30:50.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.585+0000 7fe733fff640 1 -- 10.20.193.5:0/4262596773 reap_dead start 2026-02-17T21:30:50.590 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.585+0000 7fe73a101640 1 -- 10.20.193.5:0/4262596773 shutdown_connections 2026-02-17T21:30:50.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.585+0000 7fe73a101640 1 -- 10.20.193.5:0/4262596773 >> 10.20.193.5:0/4262596773 conn(0x7fe7340c9f60 msgr2=0x7fe73414eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:50.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.585+0000 7fe73a101640 1 -- 10.20.193.5:0/4262596773 shutdown_connections 2026-02-17T21:30:50.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.585+0000 7fe73a101640 1 -- 10.20.193.5:0/4262596773 wait complete. 2026-02-17T21:30:50.591 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.585+0000 7fe73a101640 1 librados: shutdown 2026-02-17T21:30:50.595 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2026-02-17T21:30:50.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.659+0000 7f807e48f640 10 monclient: get_monmap_and_config 2026-02-17T21:30:50.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.659+0000 7f807e48f640 10 monclient: build_initial_monmap 2026-02-17T21:30:50.662 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.659+0000 7f807e48f640 10 monclient: monmap: 2026-02-17T21:30:50.662 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:50.662 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.662 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:50.661321+0000 2026-02-17T21:30:50.662 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:50.661321+0000 2026-02-17T21:30:50.662 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:50.663 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.663 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:50.663 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:50.663 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:50.663 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:50.663 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:50.663 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:50.663 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.660+0000 7f807e48f640 1 Processor -- start 2026-02-17T21:30:50.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.660+0000 7f807e48f640 1 -- start start 2026-02-17T21:30:50.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.660+0000 7f807e48f640 10 monclient: init 2026-02-17T21:30:50.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.660+0000 7f807e48f640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:50.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.660+0000 7f807e48f640 10 monclient: _add_conns ranks=[2,5,3,0,1,4] 2026-02-17T21:30:50.666 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.660+0000 7f807e48f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f807814e920 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:50.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.660+0000 7f807e48f640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f807815b290 0x7f8078159640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.660+0000 7f807e48f640 10 monclient(hunting): picked mon.noname-c con 0x7f807815b290 addr v2:10.20.193.135:3300/0 2026-02-17T21:30:50.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.660+0000 7f807e48f640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f807814ed00 0x7f80780c9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.660+0000 7f807e48f640 10 monclient(hunting): picked mon.noname-a con 0x7f807814ed00 addr v2:10.20.193.5:3300/0 2026-02-17T21:30:50.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.660+0000 7f807e48f640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8078159f10 con 0x7f807814e920 2026-02-17T21:30:50.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.660+0000 7f807e48f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:50.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.660+0000 7f807e48f640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f807815a1f0 con 0x7f807814ed00 2026-02-17T21:30:50.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.660+0000 7f807e48f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:50.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.660+0000 7f807e48f640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f807815a4d0 con 0x7f807815b290 2026-02-17T21:30:50.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.660+0000 7f807e48f640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:50.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.660+0000 7f807e48f640 10 monclient(hunting): authenticate will time out at 1356.226909s 2026-02-17T21:30:50.667 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.661+0000 7f807ca05640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f807814ed00 0x7f80780c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.661+0000 7f80777fe640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f807815b290 0x7f8078159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.661+0000 7f807ca05640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f807814ed00 0x7f80780c9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48440/0 (socket says 10.20.193.5:48440) 2026-02-17T21:30:50.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.661+0000 7f807ca05640 1 -- 10.20.193.5:0/3068362731 learned_addr learned my addr 10.20.193.5:0/3068362731 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:50.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.661+0000 7f807ca05640 10 monclient(hunting): get_auth_request con 0x7f807814ed00 auth_method 0 2026-02-17T21:30:50.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.661+0000 7f807ca05640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:50.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.661+0000 7f807ca05640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.661+0000 7f807ca05640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:50.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.661+0000 7f80777fe640 10 monclient(hunting): get_auth_request con 0x7f807815b290 auth_method 0 2026-02-17T21:30:50.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.661+0000 7f80777fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:50.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.661+0000 7f80777fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.661+0000 7f80777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:50.668 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.661+0000 7f807ca05640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:50.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.661+0000 7f807ca05640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:50.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.661+0000 7f807ca05640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:50.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.662+0000 7f80777fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:50.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.662+0000 7f80777fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:50.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.662+0000 7f80777fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:50.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.662+0000 7f807ca05640 10 monclient(hunting): handle_auth_done global_id 5277 payload 274 2026-02-17T21:30:50.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.662+0000 7f807ca05640 1 -- 10.20.193.5:0/3068362731 >> v2:10.20.193.135:3300/0 conn(0x7f807815b290 msgr2=0x7f8078159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:50.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.662+0000 7f807ca05640 1 --2- 10.20.193.5:0/3068362731 >> v2:10.20.193.135:3300/0 conn(0x7f807815b290 0x7f8078159640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.662+0000 7f807ca05640 1 -- 10.20.193.5:0/3068362731 >> v1:10.20.193.135:6789/0 conn(0x7f807814e920 legacy=0x7f80781560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.662+0000 7f807ca05640 10 monclient: _finish_hunting 0 2026-02-17T21:30:50.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.662+0000 7f807ca05640 1 monclient: found mon.noname-a 2026-02-17T21:30:50.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.662+0000 7f807ca05640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:50.669 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.662+0000 7f807ca05640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:50.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.662+0000 7f807ca05640 1 -- 10.20.193.5:0/3068362731 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f807815a7b0 con 0x7f807814ed00 2026-02-17T21:30:50.670 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.663+0000 7f807ca05640 1 --2- 10.20.193.5:0/3068362731 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f807814ed00 0x7f80780c9610 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8078075310 tx=0x7f806c030470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33688f2cdd7e220a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:50.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.665+0000 7f8076ffd640 1 -- 10.20.193.5:0/3068362731 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c03c070 con 0x7f807814ed00 2026-02-17T21:30:50.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.665+0000 7f8076ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:50.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.666+0000 7f8076ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:50.676 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.666+0000 7f8076ffd640 10 monclient: dump: 2026-02-17T21:30:50.676 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:50.676 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.676 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.676 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.676 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:50.677 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.677 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:50.677 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:50.677 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:50.677 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.666+0000 7f8076ffd640 10 monclient: _finish_auth 0 2026-02-17T21:30:50.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.666+0000 7f8076ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:30:50.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.666+0000 7f8076ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:50.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.666+0000 7f8076ffd640 1 -- 10.20.193.5:0/3068362731 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f806c008540 con 0x7f807814ed00 2026-02-17T21:30:50.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.666+0000 7f807e48f640 5 monclient: authenticate success, global_id 5277 2026-02-17T21:30:50.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.666+0000 7f807e48f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:50.677 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.666+0000 7f8076ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:50.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.666+0000 7f8076ffd640 1 -- 10.20.193.5:0/3068362731 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c008910 con 0x7f807814ed00 2026-02-17T21:30:50.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.666+0000 7f8076ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:50.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.666+0000 7f8076ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:50.678 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.666+0000 7f8076ffd640 10 monclient: dump: 2026-02-17T21:30:50.678 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:50.678 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.678 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.678 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.678 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:50.678 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.678 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:50.678 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:50.679 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:50.679 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.666+0000 7f807e48f640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:50.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.666+0000 7f807e48f640 4 set_mon_vals no callback set 2026-02-17T21:30:50.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.666+0000 7f807e48f640 10 monclient: shutdown 2026-02-17T21:30:50.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.666+0000 7f807e48f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:50.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.666+0000 7f807e48f640 1 -- 10.20.193.5:0/3068362731 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f807814ed00 msgr2=0x7f80780c9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.666+0000 7f807e48f640 1 --2- 10.20.193.5:0/3068362731 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f807814ed00 0x7f80780c9610 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8078075310 tx=0x7f806c030470 comp rx=0 tx=0).stop 2026-02-17T21:30:50.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.666+0000 7f807e48f640 1 -- 10.20.193.5:0/3068362731 shutdown_connections 2026-02-17T21:30:50.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.666+0000 7f807e48f640 1 --2- 10.20.193.5:0/3068362731 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f807814ed00 0x7f80780c9610 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.666+0000 7f807e48f640 1 --2- 10.20.193.5:0/3068362731 >> v2:10.20.193.135:3300/0 conn(0x7f807815b290 0x7f8078159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.679 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.666+0000 7f807e48f640 1 -- 10.20.193.5:0/3068362731 >> 10.20.193.5:0/3068362731 conn(0x7f80780c9f40 msgr2=0x7f80780ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:50.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.666+0000 7f807e48f640 1 -- 10.20.193.5:0/3068362731 shutdown_connections 2026-02-17T21:30:50.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.666+0000 7f807e48f640 1 -- 10.20.193.5:0/3068362731 wait complete. 2026-02-17T21:30:50.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.667+0000 7f807e48f640 10 monclient: build_initial_monmap 2026-02-17T21:30:50.680 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.667+0000 7f807e48f640 10 monclient: monmap: 2026-02-17T21:30:50.680 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:50.680 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:50.680 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:50.680 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:50.680 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:50.680 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.680 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:50.680 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:50.680 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:50.681 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.667+0000 7f807e48f640 1 librados: starting msgr at 2026-02-17T21:30:50.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.667+0000 7f807e48f640 1 librados: starting objecter 2026-02-17T21:30:50.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.667+0000 7f807e48f640 1 Processor -- start 2026-02-17T21:30:50.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.667+0000 7f807e48f640 1 -- start start 2026-02-17T21:30:50.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.667+0000 7f807e48f640 1 librados: setting wanted keys 2026-02-17T21:30:50.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.667+0000 7f807e48f640 1 librados: calling monclient init 2026-02-17T21:30:50.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.667+0000 7f807e48f640 10 monclient: init 2026-02-17T21:30:50.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.667+0000 7f807e48f640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:50.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.667+0000 7f807e48f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:30:50.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.667+0000 7f807e48f640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f807814e920 0x7f80781f2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.667+0000 7f807e48f640 10 monclient(hunting): picked mon.noname-b con 0x7f807814e920 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:50.681 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.667+0000 7f807e48f640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f807814ed00 0x7f80781f34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.682 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.667+0000 7f807e48f640 10 monclient(hunting): picked mon.noname-a con 0x7f807814ed00 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:50.682 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.667+0000 7f807e48f640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f807815b290 0x7f80781f3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.682 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.667+0000 7f807e48f640 10 monclient(hunting): picked mon.noname-c con 0x7f807815b290 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:50.682 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.667+0000 7f807e48f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:50.682 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.667+0000 7f807e48f640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8078159b80 con 0x7f807814ed00 2026-02-17T21:30:50.682 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.667+0000 7f807e48f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:50.682 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.667+0000 7f807e48f640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f807815ad70 con 0x7f807814e920 2026-02-17T21:30:50.682 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.667+0000 7f807e48f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:50.682 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.667+0000 7f807e48f640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f80780c88b0 con 0x7f807815b290 2026-02-17T21:30:50.682 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.667+0000 7f807e48f640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:50.682 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.667+0000 7f807e48f640 10 monclient(hunting): authenticate will time out at 1356.233850s 2026-02-17T21:30:50.682 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f80777fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f807814ed00 0x7f80781f34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.682 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f8077fff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f807814e920 0x7f80781f2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.683 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f807ca05640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f807815b290 0x7f80781f3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.683 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f80777fe640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f807814ed00 0x7f80781f34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48444/0 (socket says 10.20.193.5:48444) 2026-02-17T21:30:50.683 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f80777fe640 1 -- 10.20.193.5:0/1983511449 learned_addr learned my addr 10.20.193.5:0/1983511449 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:50.683 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f80777fe640 10 monclient(hunting): get_auth_request con 0x7f807814ed00 auth_method 0 2026-02-17T21:30:50.683 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f80777fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:50.683 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f80777fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.683 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f80777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:50.683 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f8077fff640 10 monclient(hunting): get_auth_request con 0x7f807814e920 auth_method 0 2026-02-17T21:30:50.683 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f8077fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:50.683 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f8077fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.683 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f8077fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:50.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f807ca05640 10 monclient(hunting): get_auth_request con 0x7f807815b290 auth_method 0 2026-02-17T21:30:50.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f807ca05640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:50.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f807ca05640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f807ca05640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:50.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f80777fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:50.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f80777fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:50.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f80777fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:50.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f8077fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:50.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f8077fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:50.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f8077fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:50.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f807ca05640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:50.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f807ca05640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:50.684 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.668+0000 7f807ca05640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:50.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.670+0000 7f807ca05640 10 monclient(hunting): handle_auth_done global_id 5348 payload 824 2026-02-17T21:30:50.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.670+0000 7f807ca05640 1 -- 10.20.193.5:0/1983511449 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f807814e920 msgr2=0x7f80781f2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.670+0000 7f807ca05640 1 --2- 10.20.193.5:0/1983511449 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f807814e920 0x7f80781f2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.670+0000 7f807ca05640 1 -- 10.20.193.5:0/1983511449 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f807814ed00 msgr2=0x7f80781f34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.670+0000 7f807ca05640 1 --2- 10.20.193.5:0/1983511449 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f807814ed00 0x7f80781f34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.670+0000 7f807ca05640 10 monclient: _finish_hunting 0 2026-02-17T21:30:50.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.670+0000 7f807ca05640 1 monclient: found mon.noname-c 2026-02-17T21:30:50.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.670+0000 7f807ca05640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:50.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.670+0000 7f807ca05640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:50.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.670+0000 7f807ca05640 1 -- 10.20.193.5:0/1983511449 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f807814afc0 con 0x7f807815b290 2026-02-17T21:30:50.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.671+0000 7f807ca05640 1 --2- 10.20.193.5:0/1983511449 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f807815b290 0x7f80781f3e70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f806c036000 tx=0x7f806c004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:50.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.671+0000 7f8074ff9640 10 client.?.objecter ms_handle_connect 0x7f807815b290 2026-02-17T21:30:50.685 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.671+0000 7f8074ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:50.686 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.672+0000 7f8074ff9640 1 -- 10.20.193.5:0/1983511449 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c03c040 con 0x7f807815b290 2026-02-17T21:30:50.686 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.672+0000 7f8074ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:50.686 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.672+0000 7f8074ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:50.686 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.672+0000 7f8074ff9640 10 monclient: dump: 2026-02-17T21:30:50.686 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:50.686 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.686 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.686 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.686 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:50.686 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.686 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:50.686 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:50.686 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:50.687 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.687 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.672+0000 7f8074ff9640 10 monclient: _finish_auth 0 2026-02-17T21:30:50.687 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.672+0000 7f8074ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:30:50.687 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.672+0000 7f8074ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:50.687 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.672+0000 7f807e48f640 5 monclient: authenticate success, global_id 5348 2026-02-17T21:30:50.687 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.672+0000 7f807e48f640 10 monclient: _renew_subs 2026-02-17T21:30:50.687 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.672+0000 7f807e48f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:50.687 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.672+0000 7f807e48f640 1 -- 10.20.193.5:0/1983511449 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f807814b2a0 con 0x7f807815b290 2026-02-17T21:30:50.687 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.672+0000 7f807e48f640 10 client.5348.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:50.687 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.672+0000 7f807e48f640 10 monclient: _renew_subs 2026-02-17T21:30:50.687 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.672+0000 7f807e48f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:50.687 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.672+0000 7f807e48f640 1 -- 10.20.193.5:0/1983511449 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f807814b860 con 0x7f807815b290 2026-02-17T21:30:50.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.672+0000 7f807e48f640 1 librados: init done 2026-02-17T21:30:50.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.672+0000 7f807e48f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:50.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.672+0000 7f807e48f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:50.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.672+0000 7f807e48f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:50.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.672+0000 7f807e48f640 1 -- 10.20.193.5:0/1983511449 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8078159640 con 0x7f807815b290 2026-02-17T21:30:50.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.673+0000 7f8074ff9640 1 -- 10.20.193.5:0/1983511449 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f806c047070 con 0x7f807815b290 2026-02-17T21:30:50.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.673+0000 7f8074ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:50.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.673+0000 7f8074ff9640 1 -- 10.20.193.5:0/1983511449 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c008ca0 con 0x7f807815b290 2026-02-17T21:30:50.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.673+0000 7f8074ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:50.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.673+0000 7f8074ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:50.688 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.673+0000 7f8074ff9640 10 monclient: dump: 2026-02-17T21:30:50.688 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:50.688 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.689 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.689 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.689 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:50.689 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.689 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:50.689 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:50.689 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:50.689 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.689 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.673+0000 7f80767fc640 4 set_mon_vals no callback set 2026-02-17T21:30:50.780 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.778+0000 7f8074ff9640 1 -- 10.20.193.5:0/1983511449 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f806c03f030 con 0x7f807815b290 2026-02-17T21:30:50.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.779+0000 7f8074ff9640 1 --2- 10.20.193.5:0/1983511449 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8048079280 0x7f804807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.779+0000 7f8077fff640 1 --2- 10.20.193.5:0/1983511449 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8048079280 0x7f804807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.781 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.779+0000 7f8077fff640 10 monclient: get_auth_request con 0x7f8048079280 auth_method 0 2026-02-17T21:30:50.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.779+0000 7f8074ff9640 10 client.5348.objecter ms_handle_connect 0x7f8048079280 2026-02-17T21:30:50.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.779+0000 7f8077fff640 1 --2- 10.20.193.5:0/1983511449 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8048079280 0x7f804807b740 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8078148a70 tx=0x7f8064007f30 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:50.782 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.781+0000 7f8074ff9640 1 -- 10.20.193.5:0/1983511449 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f806c0bd770 con 0x7f807815b290 2026-02-17T21:30:50.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.781+0000 7f8074ff9640 10 client.5348.objecter ms_dispatch2 0x7f8078000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:50.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.781+0000 7f8074ff9640 3 client.5348.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:50.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.781+0000 7f8074ff9640 3 client.5348.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:50.783 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.781+0000 7f8074ff9640 20 client.5348.objecter dump_active .. 0 homeless 2026-02-17T21:30:50.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.786+0000 7f8074ff9640 1 -- 10.20.193.5:0/1983511449 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f806c087d00 con 0x7f807815b290 2026-02-17T21:30:50.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.786+0000 7f8074ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:50.788 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.786+0000 7f8074ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:50.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.871+0000 7f807e48f640 1 -- 10.20.193.5:0/1983511449 --> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f80780c7740 con 0x7f8048079280 2026-02-17T21:30:50.874 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.873+0000 7f8074ff9640 1 -- 10.20.193.5:0/1983511449 <== mgr.4131 v2:10.20.193.176:6800/2898618020 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f80780c7740 con 0x7f8048079280 2026-02-17T21:30:50.874 INFO:teuthology.orchestra.run.trial005.stderr:instructed osd(s) 7 to deep-scrub 2026-02-17T21:30:50.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.873+0000 7f807e48f640 10 librados: watch_flush enter 2026-02-17T21:30:50.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.873+0000 7f807e48f640 10 librados: watch_flush exit 2026-02-17T21:30:50.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.873+0000 7f807e48f640 20 client.5348.objecter shutdown clearing up homeless session... 2026-02-17T21:30:50.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.873+0000 7f807e48f640 10 client.5348.objecter successfully canceled tick 2026-02-17T21:30:50.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.873+0000 7f807e48f640 1 -- 10.20.193.5:0/1983511449 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8048079280 msgr2=0x7f804807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.873+0000 7f807e48f640 1 --2- 10.20.193.5:0/1983511449 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8048079280 0x7f804807b740 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8078148a70 tx=0x7f8064007f30 comp rx=0 tx=0).stop 2026-02-17T21:30:50.876 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.873+0000 7f807e48f640 10 monclient: shutdown 2026-02-17T21:30:50.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.873+0000 7f807e48f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:50.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.873+0000 7f807e48f640 1 -- 10.20.193.5:0/1983511449 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f807815b290 msgr2=0x7f80781f3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.873+0000 7f807e48f640 1 --2- 10.20.193.5:0/1983511449 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f807815b290 0x7f80781f3e70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f806c036000 tx=0x7f806c004b40 comp rx=0 tx=0).stop 2026-02-17T21:30:50.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.873+0000 7f807e48f640 1 -- 10.20.193.5:0/1983511449 shutdown_connections 2026-02-17T21:30:50.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.873+0000 7f807e48f640 1 --2- 10.20.193.5:0/1983511449 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f8048079280 0x7f804807b740 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.873+0000 7f807e48f640 1 --2- 10.20.193.5:0/1983511449 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f807815b290 0x7f80781f3e70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.873+0000 7f807e48f640 1 --2- 10.20.193.5:0/1983511449 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f807814ed00 0x7f80781f34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.873+0000 7f807e48f640 1 --2- 10.20.193.5:0/1983511449 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f807814e920 0x7f80781f2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.873+0000 7f807e48f640 1 -- 10.20.193.5:0/1983511449 >> 10.20.193.5:0/1983511449 conn(0x7f80780c9f40 msgr2=0x7f807815c050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:50.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.873+0000 7f807e48f640 1 -- 10.20.193.5:0/1983511449 shutdown_connections 2026-02-17T21:30:50.877 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.873+0000 7f807e48f640 1 -- 10.20.193.5:0/1983511449 wait complete. 2026-02-17T21:30:50.878 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.873+0000 7f807e48f640 1 librados: shutdown 2026-02-17T21:30:50.884 INFO:tasks.ceph:Scrubbing osd.11 2026-02-17T21:30:50.884 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:30:50.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.953+0000 7fc9d2fed640 10 monclient: get_monmap_and_config 2026-02-17T21:30:50.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.953+0000 7fc9d2fed640 10 monclient: build_initial_monmap 2026-02-17T21:30:50.956 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.953+0000 7fc9d2fed640 10 monclient: monmap: 2026-02-17T21:30:50.956 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:50.956 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.956 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:50.955434+0000 2026-02-17T21:30:50.956 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:50.955434+0000 2026-02-17T21:30:50.956 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:50.956 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.956 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:50.957 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:50.957 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:50.957 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:50.957 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:50.957 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:50.957 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.960 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.954+0000 7fc9d2fed640 1 Processor -- start 2026-02-17T21:30:50.960 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.954+0000 7fc9d2fed640 1 -- start start 2026-02-17T21:30:50.960 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.954+0000 7fc9d2fed640 10 monclient: init 2026-02-17T21:30:50.960 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.954+0000 7fc9d2fed640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:50.960 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.954+0000 7fc9d2fed640 10 monclient: _add_conns ranks=[0,3,5,1,4,2] 2026-02-17T21:30:50.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.954+0000 7fc9d2fed640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc9cc15c260 addr v1:10.20.193.5:6789/0 2026-02-17T21:30:50.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.954+0000 7fc9d2fed640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fc9cc0c9b40 0x7fc9cc15c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.954+0000 7fc9d2fed640 10 monclient(hunting): picked mon.noname-a con 0x7fc9cc0c9b40 addr v2:10.20.193.5:3300/0 2026-02-17T21:30:50.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.954+0000 7fc9d2fed640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fc9cc0c7e60 0x7fc9cc15ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.954+0000 7fc9d2fed640 10 monclient(hunting): picked mon.noname-c con 0x7fc9cc0c7e60 addr v2:10.20.193.135:3300/0 2026-02-17T21:30:50.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.954+0000 7fc9d2fed640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9cc0c7370 con 0x7fc9cc15c260 2026-02-17T21:30:50.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.954+0000 7fc9d2fed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:50.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.954+0000 7fc9d2fed640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc9cc0c7930 con 0x7fc9cc0c9b40 2026-02-17T21:30:50.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.954+0000 7fc9d2fed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:50.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.954+0000 7fc9d2fed640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7fc9cc15a6e0 con 0x7fc9cc0c7e60 2026-02-17T21:30:50.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.954+0000 7fc9d2fed640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:50.961 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.954+0000 7fc9d2fed640 10 monclient(hunting): authenticate will time out at 1356.520932s 2026-02-17T21:30:50.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.955+0000 7fc9c3fff640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fc9cc0c9b40 0x7fc9cc15c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.955+0000 7fc9d1563640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7fc9cc0c7e60 0x7fc9cc15ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.955+0000 7fc9d0d62640 1 --1- >> v1:10.20.193.5:6789/0 conn(0x7fc9cc15c260 0x7fc9cc0c6ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.5:6789/0 says I am v1:10.20.193.5:39968/0 (socket says 10.20.193.5:39968) 2026-02-17T21:30:50.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.955+0000 7fc9d0d62640 1 -- 10.20.193.5:0/4277697576 learned_addr learned my addr 10.20.193.5:0/4277697576 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:50.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.955+0000 7fc9d1563640 10 monclient(hunting): get_auth_request con 0x7fc9cc0c7e60 auth_method 0 2026-02-17T21:30:50.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.955+0000 7fc9d1563640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:50.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.955+0000 7fc9d1563640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.955+0000 7fc9d1563640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:50.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.955+0000 7fc9c3fff640 10 monclient(hunting): get_auth_request con 0x7fc9cc0c9b40 auth_method 0 2026-02-17T21:30:50.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.955+0000 7fc9c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:50.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.955+0000 7fc9c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.962 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.955+0000 7fc9c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:50.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.956+0000 7fc9d1563640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:50.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.956+0000 7fc9d1563640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:50.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.956+0000 7fc9d1563640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:50.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.956+0000 7fc9c3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:50.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.956+0000 7fc9c3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:50.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.956+0000 7fc9c3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:50.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.957+0000 7fc9d1563640 10 monclient(hunting): handle_auth_done global_id 5351 payload 274 2026-02-17T21:30:50.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.957+0000 7fc9d1563640 1 -- 10.20.193.5:0/4277697576 >> v2:10.20.193.5:3300/0 conn(0x7fc9cc0c9b40 msgr2=0x7fc9cc15c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:50.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.957+0000 7fc9d1563640 1 --2- 10.20.193.5:0/4277697576 >> v2:10.20.193.5:3300/0 conn(0x7fc9cc0c9b40 0x7fc9cc15c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.957+0000 7fc9d1563640 1 -- 10.20.193.5:0/4277697576 >> v1:10.20.193.5:6789/0 conn(0x7fc9cc15c260 legacy=0x7fc9cc0c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.957+0000 7fc9d1563640 10 monclient: _finish_hunting 0 2026-02-17T21:30:50.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.957+0000 7fc9d1563640 1 monclient: found mon.noname-c 2026-02-17T21:30:50.963 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.957+0000 7fc9d1563640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:50.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.957+0000 7fc9d1563640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:50.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.957+0000 7fc9d1563640 1 -- 10.20.193.5:0/4277697576 --> v2:10.20.193.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9cc0c7650 con 0x7fc9cc0c7e60 2026-02-17T21:30:50.964 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.958+0000 7fc9d1563640 1 --2- 10.20.193.5:0/4277697576 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc9cc0c7e60 0x7fc9cc15ab70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0c6050 tx=0x7fc9c802f250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ec30cb5d3e48878 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:50.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.959+0000 7fc9c37fe640 1 -- 10.20.193.5:0/4277697576 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c803c070 con 0x7fc9cc0c7e60 2026-02-17T21:30:50.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9c37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:50.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9c37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:50.968 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9c37fe640 10 monclient: dump: 2026-02-17T21:30:50.969 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:50.969 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.969 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.969 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.969 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:50.969 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.969 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:50.969 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:50.969 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:50.969 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.969 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9c37fe640 10 monclient: _finish_auth 0 2026-02-17T21:30:50.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9c37fe640 10 monclient: _check_auth_tickets 2026-02-17T21:30:50.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9c37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:50.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9c37fe640 1 -- 10.20.193.5:0/4277697576 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9c8037440 con 0x7fc9cc0c7e60 2026-02-17T21:30:50.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9d2fed640 5 monclient: authenticate success, global_id 5351 2026-02-17T21:30:50.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9d2fed640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:50.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9c37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:50.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9d2fed640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:50.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9d2fed640 4 set_mon_vals no callback set 2026-02-17T21:30:50.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9c37fe640 1 -- 10.20.193.5:0/4277697576 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c8037810 con 0x7fc9cc0c7e60 2026-02-17T21:30:50.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9c37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:50.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9c37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:50.970 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9c37fe640 10 monclient: dump: 2026-02-17T21:30:50.971 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:50.971 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.971 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.971 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.971 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:50.971 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.971 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:50.971 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:50.971 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:50.971 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9d2fed640 10 monclient: shutdown 2026-02-17T21:30:50.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9d2fed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:50.971 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9d2fed640 1 -- 10.20.193.5:0/4277697576 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc9cc0c7e60 msgr2=0x7fc9cc15ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9d2fed640 1 --2- 10.20.193.5:0/4277697576 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc9cc0c7e60 0x7fc9cc15ab70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0c6050 tx=0x7fc9c802f250 comp rx=0 tx=0).stop 2026-02-17T21:30:50.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9d2fed640 1 -- 10.20.193.5:0/4277697576 shutdown_connections 2026-02-17T21:30:50.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9d2fed640 1 --2- 10.20.193.5:0/4277697576 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc9cc0c7e60 0x7fc9cc15ab70 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9d2fed640 1 --2- 10.20.193.5:0/4277697576 >> v2:10.20.193.5:3300/0 conn(0x7fc9cc0c9b40 0x7fc9cc15c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9d2fed640 1 -- 10.20.193.5:0/4277697576 >> 10.20.193.5:0/4277697576 conn(0x7fc9cc0c9f60 msgr2=0x7fc9cc0ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:50.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9d2fed640 1 -- 10.20.193.5:0/4277697576 shutdown_connections 2026-02-17T21:30:50.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9d2fed640 1 -- 10.20.193.5:0/4277697576 wait complete. 2026-02-17T21:30:50.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9d2fed640 10 monclient: build_initial_monmap 2026-02-17T21:30:50.972 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.960+0000 7fc9d2fed640 10 monclient: monmap: 2026-02-17T21:30:50.972 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:50.972 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:50.972 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:50.973 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:50.973 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:50.973 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.973 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:50.973 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:50.973 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:50.973 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.961+0000 7fc9d2fed640 1 librados: starting msgr at 2026-02-17T21:30:50.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.961+0000 7fc9d2fed640 1 librados: starting objecter 2026-02-17T21:30:50.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.961+0000 7fc9d2fed640 1 Processor -- start 2026-02-17T21:30:50.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.961+0000 7fc9d2fed640 1 -- start start 2026-02-17T21:30:50.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.961+0000 7fc9d2fed640 1 librados: setting wanted keys 2026-02-17T21:30:50.973 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.961+0000 7fc9d2fed640 1 librados: calling monclient init 2026-02-17T21:30:50.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.961+0000 7fc9d2fed640 10 monclient: init 2026-02-17T21:30:50.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.961+0000 7fc9d2fed640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:50.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.961+0000 7fc9d2fed640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:30:50.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.961+0000 7fc9d2fed640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc9cc0c7e60 0x7fc9cc1400d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.961+0000 7fc9d2fed640 10 monclient(hunting): picked mon.noname-b con 0x7fc9cc0c7e60 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:50.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.961+0000 7fc9d2fed640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc9cc0c9b40 0x7fc9cc073f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.961+0000 7fc9d2fed640 10 monclient(hunting): picked mon.noname-c con 0x7fc9cc0c9b40 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:50.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.961+0000 7fc9d2fed640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc9cc15c260 0x7fc9cc1f1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.961+0000 7fc9d2fed640 10 monclient(hunting): picked mon.noname-a con 0x7fc9cc15c260 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:50.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.961+0000 7fc9d2fed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:50.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.961+0000 7fc9d2fed640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc0c8290 con 0x7fc9cc15c260 2026-02-17T21:30:50.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.961+0000 7fc9d2fed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:50.974 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.961+0000 7fc9d2fed640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc15a370 con 0x7fc9cc0c7e60 2026-02-17T21:30:50.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.961+0000 7fc9d2fed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:50.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.961+0000 7fc9d2fed640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc0c8410 con 0x7fc9cc0c9b40 2026-02-17T21:30:50.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.961+0000 7fc9d2fed640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:50.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.961+0000 7fc9d2fed640 10 monclient(hunting): authenticate will time out at 1356.527692s 2026-02-17T21:30:50.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.961+0000 7fc9d1563640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc9cc15c260 0x7fc9cc1f1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.961+0000 7fc9c3fff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc9cc0c9b40 0x7fc9cc073f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.962+0000 7fc9d0d62640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc9cc0c7e60 0x7fc9cc1400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.962+0000 7fc9d1563640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc9cc15c260 0x7fc9cc1f1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48462/0 (socket says 10.20.193.5:48462) 2026-02-17T21:30:50.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.962+0000 7fc9d1563640 1 -- 10.20.193.5:0/164728073 learned_addr learned my addr 10.20.193.5:0/164728073 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:50.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.962+0000 7fc9d1563640 10 monclient(hunting): get_auth_request con 0x7fc9cc15c260 auth_method 0 2026-02-17T21:30:50.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.962+0000 7fc9d1563640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:50.975 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.962+0000 7fc9d1563640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.962+0000 7fc9d1563640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:50.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.962+0000 7fc9c3fff640 10 monclient(hunting): get_auth_request con 0x7fc9cc0c9b40 auth_method 0 2026-02-17T21:30:50.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.962+0000 7fc9c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:50.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.962+0000 7fc9c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.962+0000 7fc9c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:50.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.962+0000 7fc9c3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:50.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.962+0000 7fc9c3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:50.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.962+0000 7fc9c3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:50.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.962+0000 7fc9d0d62640 10 monclient(hunting): get_auth_request con 0x7fc9cc0c7e60 auth_method 0 2026-02-17T21:30:50.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.962+0000 7fc9d0d62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:50.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.962+0000 7fc9d0d62640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:50.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.962+0000 7fc9d0d62640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:50.976 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.962+0000 7fc9d1563640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:50.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.962+0000 7fc9d1563640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:50.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.962+0000 7fc9d1563640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:50.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.962+0000 7fc9d0d62640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:50.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.962+0000 7fc9d0d62640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:50.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.962+0000 7fc9d0d62640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:50.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.963+0000 7fc9c3fff640 10 monclient(hunting): handle_auth_done global_id 5354 payload 824 2026-02-17T21:30:50.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.963+0000 7fc9c3fff640 1 -- 10.20.193.5:0/164728073 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc9cc0c7e60 msgr2=0x7fc9cc1400d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.963+0000 7fc9c3fff640 1 --2- 10.20.193.5:0/164728073 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc9cc0c7e60 0x7fc9cc1400d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.963+0000 7fc9c3fff640 1 -- 10.20.193.5:0/164728073 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc9cc15c260 msgr2=0x7fc9cc1f1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:50.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.963+0000 7fc9c3fff640 1 --2- 10.20.193.5:0/164728073 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fc9cc15c260 0x7fc9cc1f1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:50.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.963+0000 7fc9c3fff640 10 monclient: _finish_hunting 0 2026-02-17T21:30:50.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.963+0000 7fc9c3fff640 1 monclient: found mon.noname-c 2026-02-17T21:30:50.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.963+0000 7fc9c3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:50.977 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.963+0000 7fc9c3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.135:3300/0 2026-02-17T21:30:50.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.963+0000 7fc9c3fff640 1 -- 10.20.193.5:0/164728073 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9cc1f28f0 con 0x7fc9cc0c9b40 2026-02-17T21:30:50.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.964+0000 7fc9c3fff640 1 --2- 10.20.193.5:0/164728073 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc9cc0c9b40 0x7fc9cc073f50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400e8a0 tx=0x7fc9b400ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:50.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.964+0000 7fc9c17fa640 10 client.?.objecter ms_handle_connect 0x7fc9cc0c9b40 2026-02-17T21:30:50.978 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.964+0000 7fc9c17fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:50.980 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.966+0000 7fc9c17fa640 1 -- 10.20.193.5:0/164728073 <== mon.2 v2:10.20.193.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4017070 con 0x7fc9cc0c9b40 2026-02-17T21:30:50.980 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.966+0000 7fc9c17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:50.980 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.966+0000 7fc9c17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:30:50.980 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.966+0000 7fc9c17fa640 10 monclient: dump: 2026-02-17T21:30:50.980 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:50.980 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.980 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.980 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.980 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:50.980 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.981 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:50.981 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:50.981 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:50.981 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.966+0000 7fc9c17fa640 10 monclient: _finish_auth 0 2026-02-17T21:30:50.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.966+0000 7fc9c17fa640 10 monclient: _check_auth_tickets 2026-02-17T21:30:50.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.966+0000 7fc9c17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:50.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.966+0000 7fc9d2fed640 5 monclient: authenticate success, global_id 5354 2026-02-17T21:30:50.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.966+0000 7fc9c17fa640 1 -- 10.20.193.5:0/164728073 <== mon.2 v2:10.20.193.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b400c940 con 0x7fc9cc0c9b40 2026-02-17T21:30:50.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.966+0000 7fc9c17fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:50.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.966+0000 7fc9c17fa640 1 -- 10.20.193.5:0/164728073 <== mon.2 v2:10.20.193.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b400cd10 con 0x7fc9cc0c9b40 2026-02-17T21:30:50.981 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.966+0000 7fc9d2fed640 10 monclient: _renew_subs 2026-02-17T21:30:50.982 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.966+0000 7fc9d2fed640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:50.982 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.966+0000 7fc9c2ffd640 4 set_mon_vals no callback set 2026-02-17T21:30:50.982 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.966+0000 7fc9d2fed640 1 -- 10.20.193.5:0/164728073 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9cc1f2bd0 con 0x7fc9cc0c9b40 2026-02-17T21:30:50.982 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.966+0000 7fc9c17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:50.982 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.966+0000 7fc9c17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:30:50.982 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.966+0000 7fc9c17fa640 10 monclient: dump: 2026-02-17T21:30:50.982 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:50.982 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:50.982 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.982 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:50.982 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:50.982 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:50.982 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:50.983 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:50.983 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:50.983 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:50.983 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.966+0000 7fc9d2fed640 10 client.5354.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:50.983 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.966+0000 7fc9d2fed640 10 monclient: _renew_subs 2026-02-17T21:30:50.983 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.966+0000 7fc9d2fed640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:50.983 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.966+0000 7fc9d2fed640 1 -- 10.20.193.5:0/164728073 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9cc158450 con 0x7fc9cc0c9b40 2026-02-17T21:30:50.983 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.966+0000 7fc9d2fed640 1 librados: init done 2026-02-17T21:30:50.983 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.967+0000 7fc9d2fed640 10 client.5354.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:50.983 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.967+0000 7fc9d2fed640 15 client.5354.objecter _session_command_op_assign -1 1 2026-02-17T21:30:50.983 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.967+0000 7fc9d2fed640 20 client.5354.objecter _get_session osd=-1 returning homeless 2026-02-17T21:30:50.983 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.967+0000 7fc9d2fed640 10 client.5354.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:50.984 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.967+0000 7fc9d2fed640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.135:3300/0 2026-02-17T21:30:50.984 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.967+0000 7fc9d2fed640 1 -- 10.20.193.5:0/164728073 --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc9cc15c640 con 0x7fc9cc0c9b40 2026-02-17T21:30:50.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.978+0000 7fc9c17fa640 1 -- 10.20.193.5:0/164728073 <== mon.2 v2:10.20.193.135:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fc9b4026480 con 0x7fc9cc0c9b40 2026-02-17T21:30:50.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.978+0000 7fc9c17fa640 1 --2- 10.20.193.5:0/164728073 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc99c0792d0 0x7fc99c07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.979+0000 7fc9d0d62640 1 --2- 10.20.193.5:0/164728073 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc99c0792d0 0x7fc99c07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.979+0000 7fc9d0d62640 1 -- 10.20.193.5:0/164728073 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc99c0792d0 msgr2=0x7fc99c07b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T21:30:50.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.979+0000 7fc9d0d62640 1 -- 10.20.193.5:0/164728073 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc99c0792d0 msgr2=0x7fc99c07b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T21:30:50.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.979+0000 7fc9d0d62640 1 --2- 10.20.193.5:0/164728073 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc99c0792d0 0x7fc99c07b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:30:50.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.979+0000 7fc9d0d62640 1 --2- 10.20.193.5:0/164728073 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc99c0792d0 0x7fc99c07b790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:30:50.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.980+0000 7fc9c17fa640 1 -- 10.20.193.5:0/164728073 <== mon.2 v2:10.20.193.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fc9b405e670 con 0x7fc9cc0c9b40 2026-02-17T21:30:50.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.980+0000 7fc9c17fa640 10 client.5354.objecter ms_dispatch2 0x7fc9cc000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:50.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.980+0000 7fc9c17fa640 3 client.5354.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:50.986 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.980+0000 7fc9c17fa640 3 client.5354.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:50.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.980+0000 7fc9c17fa640 10 client.5354.objecter checking command 1 2026-02-17T21:30:50.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.980+0000 7fc9c17fa640 1 --2- 10.20.193.5:0/164728073 >> [v2:10.20.193.176:6802/3067818664,v1:10.20.193.176:6803/3067818664] conn(0x7fc99c0817b0 0x7fc99c083bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:50.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.980+0000 7fc9c17fa640 20 client.5354.objecter _get_session s=0x7fc99c0810e0 osd=11 3 2026-02-17T21:30:50.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.980+0000 7fc9c17fa640 20 client.5354.objecter put_session s=0x7fc99c0810e0 osd=11 3 2026-02-17T21:30:50.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.980+0000 7fc9c17fa640 15 client.5354.objecter _session_command_op_remove -1 1 2026-02-17T21:30:50.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.980+0000 7fc9c17fa640 20 client.5354.objecter _get_session s=0x7fc99c0810e0 osd=11 3 2026-02-17T21:30:50.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.980+0000 7fc9c17fa640 20 client.5354.objecter get_session s=0x7fc99c0810e0 osd=11 3 2026-02-17T21:30:50.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.980+0000 7fc9c17fa640 15 client.5354.objecter _session_command_op_assign 11 1 2026-02-17T21:30:50.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.980+0000 7fc9c17fa640 20 client.5354.objecter put_session s=0x7fc99c0810e0 osd=11 4 2026-02-17T21:30:50.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.980+0000 7fc9c17fa640 10 client.5354.objecter _send_command 1 2026-02-17T21:30:50.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.980+0000 7fc9c17fa640 1 -- 10.20.193.5:0/164728073 --> [v2:10.20.193.176:6802/3067818664,v1:10.20.193.176:6803/3067818664] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc99c0842a0 con 0x7fc99c0817b0 2026-02-17T21:30:50.987 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.980+0000 7fc9c17fa640 20 client.5354.objecter dump_active .. 0 homeless 2026-02-17T21:30:50.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.981+0000 7fc9c17fa640 1 -- 10.20.193.5:0/164728073 <== mon.2 v2:10.20.193.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc9b405ea30 con 0x7fc9cc0c9b40 2026-02-17T21:30:50.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.981+0000 7fc9c17fa640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T21:30:50.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.981+0000 7fc9d1563640 1 --2- 10.20.193.5:0/164728073 >> [v2:10.20.193.176:6802/3067818664,v1:10.20.193.176:6803/3067818664] conn(0x7fc99c0817b0 0x7fc99c083bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:50.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.981+0000 7fc9d1563640 10 monclient: get_auth_request con 0x7fc99c0817b0 auth_method 0 2026-02-17T21:30:50.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.983+0000 7fc9d1563640 1 --2- 10.20.193.5:0/164728073 >> [v2:10.20.193.176:6802/3067818664,v1:10.20.193.176:6803/3067818664] conn(0x7fc99c0817b0 0x7fc99c083bd0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:50.988 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.983+0000 7fc9c17fa640 10 client.5354.objecter ms_handle_connect 0x7fc99c0817b0 2026-02-17T21:30:50.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.994+0000 7fc9c17fa640 1 -- 10.20.193.5:0/164728073 <== osd.11 v2:10.20.193.176:6802/3067818664 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fc99c0842a0 con 0x7fc99c0817b0 2026-02-17T21:30:50.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.994+0000 7fc9c17fa640 10 client.5354.objecter ms_dispatch2 0x7fc9cc000b90 command_reply(tid 1: 0 ) 2026-02-17T21:30:50.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.994+0000 7fc9c17fa640 10 client.5354.objecter _finish_command 1 = system:0 2026-02-17T21:30:50.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.994+0000 7fc9c17fa640 20 client.5354.objecter put_session s=0x7fc99c0810e0 osd=11 4 2026-02-17T21:30:50.996 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.994+0000 7fc9c17fa640 15 client.5354.objecter _session_command_op_remove 11 1 2026-02-17T21:30:51.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.999+0000 7fc9d2fed640 10 client.5354.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:30:51.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.999+0000 7fc9d2fed640 15 client.5354.objecter _session_command_op_assign -1 2 2026-02-17T21:30:51.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.999+0000 7fc9d2fed640 20 client.5354.objecter _get_session s=0x7fc99c0810e0 osd=11 3 2026-02-17T21:30:51.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.999+0000 7fc9d2fed640 20 client.5354.objecter put_session s=0x7fc99c0810e0 osd=11 3 2026-02-17T21:30:51.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.999+0000 7fc9d2fed640 20 client.5354.objecter _get_session s=0x7fc99c0810e0 osd=11 3 2026-02-17T21:30:51.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.999+0000 7fc9d2fed640 15 client.5354.objecter _session_command_op_remove -1 2 2026-02-17T21:30:51.002 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.999+0000 7fc9d2fed640 20 client.5354.objecter get_session s=0x7fc99c0810e0 osd=11 3 2026-02-17T21:30:51.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.999+0000 7fc9d2fed640 15 client.5354.objecter _session_command_op_assign 11 2 2026-02-17T21:30:51.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.999+0000 7fc9d2fed640 20 client.5354.objecter put_session s=0x7fc99c0810e0 osd=11 4 2026-02-17T21:30:51.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.999+0000 7fc9d2fed640 10 client.5354.objecter _send_command 2 2026-02-17T21:30:51.003 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:50.999+0000 7fc9d2fed640 1 -- 10.20.193.5:0/164728073 --> [v2:10.20.193.176:6802/3067818664,v1:10.20.193.176:6803/3067818664] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc9cc158a10 con 0x7fc99c0817b0 2026-02-17T21:30:51.008 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.007+0000 7fc9c17fa640 1 -- 10.20.193.5:0/164728073 <== osd.11 v2:10.20.193.176:6802/3067818664 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc9cc158a10 con 0x7fc99c0817b0 2026-02-17T21:30:51.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.007+0000 7fc9c17fa640 10 client.5354.objecter ms_dispatch2 0x7fc9cc000b90 command_reply(tid 2: 0 ) 2026-02-17T21:30:51.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.007+0000 7fc9c17fa640 10 client.5354.objecter _finish_command 2 = system:0 2026-02-17T21:30:51.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.007+0000 7fc9c17fa640 20 client.5354.objecter put_session s=0x7fc99c0810e0 osd=11 4 2026-02-17T21:30:51.009 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.007+0000 7fc9c17fa640 15 client.5354.objecter _session_command_op_remove 11 2 2026-02-17T21:30:51.009 INFO:teuthology.orchestra.run.trial005.stdout:{ 2026-02-17T21:30:51.009 INFO:teuthology.orchestra.run.trial005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:30:51.010 INFO:teuthology.orchestra.run.trial005.stdout:} 2026-02-17T21:30:51.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.007+0000 7fc9d2fed640 10 librados: watch_flush enter 2026-02-17T21:30:51.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.007+0000 7fc9d2fed640 10 librados: watch_flush exit 2026-02-17T21:30:51.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.007+0000 7fc9d2fed640 10 client.5354.objecter close_session for osd.11 2026-02-17T21:30:51.011 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.007+0000 7fc9d2fed640 1 -- 10.20.193.5:0/164728073 >> [v2:10.20.193.176:6802/3067818664,v1:10.20.193.176:6803/3067818664] conn(0x7fc99c0817b0 msgr2=0x7fc99c083bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.007+0000 7fc9d2fed640 1 --2- 10.20.193.5:0/164728073 >> [v2:10.20.193.176:6802/3067818664,v1:10.20.193.176:6803/3067818664] conn(0x7fc99c0817b0 0x7fc99c083bd0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.007+0000 7fc9d2fed640 20 client.5354.objecter put_session s=0x7fc99c0810e0 osd=11 1 2026-02-17T21:30:51.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.007+0000 7fc9d2fed640 20 client.5354.objecter shutdown clearing up homeless session... 2026-02-17T21:30:51.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.007+0000 7fc9d2fed640 10 client.5354.objecter successfully canceled tick 2026-02-17T21:30:51.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.007+0000 7fc9d2fed640 1 -- 10.20.193.5:0/164728073 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc99c0792d0 msgr2=0x7fc99c07b790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T21:30:51.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.007+0000 7fc9d2fed640 1 --2- 10.20.193.5:0/164728073 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fc99c0792d0 0x7fc99c07b790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.007+0000 7fc9d2fed640 10 monclient: shutdown 2026-02-17T21:30:51.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.007+0000 7fc9d2fed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:51.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.007+0000 7fc9d2fed640 1 -- 10.20.193.5:0/164728073 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc9cc0c9b40 msgr2=0x7fc9cc073f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.007+0000 7fc9d2fed640 1 --2- 10.20.193.5:0/164728073 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fc9cc0c9b40 0x7fc9cc073f50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400e8a0 tx=0x7fc9b400ed70 comp rx=0 tx=0).stop 2026-02-17T21:30:51.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.007+0000 7fc9d1563640 1 -- 10.20.193.5:0/164728073 reap_dead start 2026-02-17T21:30:51.012 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.007+0000 7fc9d2fed640 1 -- 10.20.193.5:0/164728073 shutdown_connections 2026-02-17T21:30:51.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.007+0000 7fc9d2fed640 1 -- 10.20.193.5:0/164728073 >> 10.20.193.5:0/164728073 conn(0x7fc9cc0c9f60 msgr2=0x7fc9cc0c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:51.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.007+0000 7fc9d2fed640 1 -- 10.20.193.5:0/164728073 shutdown_connections 2026-02-17T21:30:51.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.007+0000 7fc9d2fed640 1 -- 10.20.193.5:0/164728073 wait complete. 2026-02-17T21:30:51.013 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.007+0000 7fc9d2fed640 1 librados: shutdown 2026-02-17T21:30:51.017 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 11 2026-02-17T21:30:51.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.086+0000 7f23dffff640 10 monclient: get_monmap_and_config 2026-02-17T21:30:51.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.086+0000 7f23dffff640 10 monclient: build_initial_monmap 2026-02-17T21:30:51.088 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.086+0000 7f23dffff640 10 monclient: monmap: 2026-02-17T21:30:51.088 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:51.088 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:51.088 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:51.087699+0000 2026-02-17T21:30:51.089 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:51.087699+0000 2026-02-17T21:30:51.089 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:51.089 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:51.089 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:51.089 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:51.089 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:51.089 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:51.089 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:51.089 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:51.089 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:51.092 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.086+0000 7f23dffff640 1 Processor -- start 2026-02-17T21:30:51.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.086+0000 7f23dffff640 1 -- start start 2026-02-17T21:30:51.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.086+0000 7f23dffff640 10 monclient: init 2026-02-17T21:30:51.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.087+0000 7f23dffff640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:51.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.087+0000 7f23dffff640 10 monclient: _add_conns ranks=[3,1,2,5,4,0] 2026-02-17T21:30:51.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.087+0000 7f23dffff640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f23e0153680 0x7f23e0159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:51.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.087+0000 7f23dffff640 10 monclient(hunting): picked mon.noname-a con 0x7f23e0153680 addr v2:10.20.193.5:3300/0 2026-02-17T21:30:51.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.087+0000 7f23dffff640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f23e0153a60 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:51.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.087+0000 7f23dffff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f23e006fcd0 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:51.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.087+0000 7f23dffff640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23e00c40a0 con 0x7f23e0153a60 2026-02-17T21:30:51.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.087+0000 7f23dffff640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23e0159e40 con 0x7f23e006fcd0 2026-02-17T21:30:51.093 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.087+0000 7f23dffff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:51.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.087+0000 7f23dffff640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f23e00c7b50 con 0x7f23e0153680 2026-02-17T21:30:51.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.087+0000 7f23dffff640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:51.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.087+0000 7f23dffff640 10 monclient(hunting): authenticate will time out at 1356.653111s 2026-02-17T21:30:51.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.087+0000 7f23deffd640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f23e0153680 0x7f23e0159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:51.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.087+0000 7f23de7fc640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f23e0153a60 0x7f23e00c85a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:41200/0 (socket says 10.20.193.5:41200) 2026-02-17T21:30:51.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.087+0000 7f23df7fe640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f23e006fcd0 0x7f23e0070160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:59702/0 (socket says 10.20.193.5:59702) 2026-02-17T21:30:51.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.087+0000 7f23de7fc640 1 -- 10.20.193.5:0/1834445148 learned_addr learned my addr 10.20.193.5:0/1834445148 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:51.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.087+0000 7f23deffd640 10 monclient(hunting): get_auth_request con 0x7f23e0153680 auth_method 0 2026-02-17T21:30:51.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.087+0000 7f23deffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:51.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.087+0000 7f23deffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:51.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.087+0000 7f23deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:51.094 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.088+0000 7f23deffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:51.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.088+0000 7f23deffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:51.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.088+0000 7f23deffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:51.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.088+0000 7f23ddffb640 1 -- 10.20.193.5:0/1834445148 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 904377667 0 0) 0x7f23e00c40a0 con 0x7f23e0153a60 2026-02-17T21:30:51.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.088+0000 7f23ddffb640 10 monclient(hunting): _negotiate 2026-02-17T21:30:51.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.088+0000 7f23ddffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:51.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.088+0000 7f23ddffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:51.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.088+0000 7f23ddffb640 10 monclient(hunting): my global_id is 5356 2026-02-17T21:30:51.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.088+0000 7f23ddffb640 1 -- 10.20.193.5:0/1834445148 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23cc003620 con 0x7f23e0153a60 2026-02-17T21:30:51.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.088+0000 7f23deffd640 10 monclient(hunting): handle_auth_done global_id 5292 payload 274 2026-02-17T21:30:51.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.088+0000 7f23deffd640 1 -- 10.20.193.5:0/1834445148 >> v1:10.20.193.135:6789/0 conn(0x7f23e006fcd0 legacy=0x7f23e0070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.088+0000 7f23deffd640 1 -- 10.20.193.5:0/1834445148 >> v1:10.20.193.119:6789/0 conn(0x7f23e0153a60 legacy=0x7f23e00c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.095 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.088+0000 7f23deffd640 10 monclient: _finish_hunting 0 2026-02-17T21:30:51.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.088+0000 7f23deffd640 1 monclient: found mon.noname-a 2026-02-17T21:30:51.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.088+0000 7f23deffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:51.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.088+0000 7f23deffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:51.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.088+0000 7f23deffd640 1 -- 10.20.193.5:0/1834445148 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e015a110 con 0x7f23e0153680 2026-02-17T21:30:51.096 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.089+0000 7f23deffd640 1 --2- 10.20.193.5:0/1834445148 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f23e0153680 0x7f23e0159900 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f23d40098a0 tx=0x7f23d402ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c9d5ae56b28277 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:51.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.091+0000 7f23ddffb640 1 -- 10.20.193.5:0/1834445148 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d403c070 con 0x7f23e0153680 2026-02-17T21:30:51.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.091+0000 7f23ddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:51.102 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.091+0000 7f23ddffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:51.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.091+0000 7f23ddffb640 10 monclient: dump: 2026-02-17T21:30:51.103 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:51.103 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:51.103 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.103 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.103 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:51.103 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:51.103 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:51.103 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:51.103 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:51.103 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:51.103 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.091+0000 7f23ddffb640 10 monclient: _finish_auth 0 2026-02-17T21:30:51.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.091+0000 7f23ddffb640 10 monclient: _check_auth_tickets 2026-02-17T21:30:51.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.091+0000 7f23ddffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:51.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.091+0000 7f23ddffb640 1 -- 10.20.193.5:0/1834445148 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d402fb70 con 0x7f23e0153680 2026-02-17T21:30:51.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.091+0000 7f23ddffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:51.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.091+0000 7f23ddffb640 1 -- 10.20.193.5:0/1834445148 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d4037440 con 0x7f23e0153680 2026-02-17T21:30:51.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.091+0000 7f23dffff640 5 monclient: authenticate success, global_id 5292 2026-02-17T21:30:51.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.091+0000 7f23dffff640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:51.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.091+0000 7f23dffff640 4 set_mon_vals no callback set 2026-02-17T21:30:51.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.091+0000 7f23ddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:51.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.091+0000 7f23ddffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:51.104 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.091+0000 7f23ddffb640 10 monclient: dump: 2026-02-17T21:30:51.104 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:51.105 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:51.105 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.105 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.105 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:51.105 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:51.105 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:51.105 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:51.105 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:51.105 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:51.105 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.091+0000 7f23dffff640 10 monclient: shutdown 2026-02-17T21:30:51.105 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.091+0000 7f23dffff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:51.105 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.091+0000 7f23dffff640 1 -- 10.20.193.5:0/1834445148 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f23e0153680 msgr2=0x7f23e0159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.106 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.091+0000 7f23dffff640 1 --2- 10.20.193.5:0/1834445148 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f23e0153680 0x7f23e0159900 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f23d40098a0 tx=0x7f23d402ee60 comp rx=0 tx=0).stop 2026-02-17T21:30:51.106 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.091+0000 7f23dffff640 1 -- 10.20.193.5:0/1834445148 shutdown_connections 2026-02-17T21:30:51.106 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.091+0000 7f23dffff640 1 --2- 10.20.193.5:0/1834445148 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f23e0153680 0x7f23e0159900 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.106 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.091+0000 7f23dffff640 1 -- 10.20.193.5:0/1834445148 >> 10.20.193.5:0/1834445148 conn(0x7f23e00cd5c0 msgr2=0x7f23e00cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:51.106 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.091+0000 7f23dffff640 1 -- 10.20.193.5:0/1834445148 shutdown_connections 2026-02-17T21:30:51.106 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.092+0000 7f23dffff640 1 -- 10.20.193.5:0/1834445148 wait complete. 2026-02-17T21:30:51.106 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.092+0000 7f23dffff640 10 monclient: build_initial_monmap 2026-02-17T21:30:51.106 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.092+0000 7f23dffff640 10 monclient: monmap: 2026-02-17T21:30:51.106 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:51.106 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:51.106 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:51.106 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:51.107 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:51.107 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:51.107 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:51.107 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:51.107 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:51.107 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:51.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.092+0000 7f23dffff640 1 librados: starting msgr at 2026-02-17T21:30:51.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.092+0000 7f23dffff640 1 librados: starting objecter 2026-02-17T21:30:51.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.092+0000 7f23dffff640 1 Processor -- start 2026-02-17T21:30:51.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.092+0000 7f23dffff640 1 -- start start 2026-02-17T21:30:51.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.092+0000 7f23dffff640 1 librados: setting wanted keys 2026-02-17T21:30:51.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.092+0000 7f23dffff640 1 librados: calling monclient init 2026-02-17T21:30:51.107 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.092+0000 7f23dffff640 10 monclient: init 2026-02-17T21:30:51.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23dffff640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:51.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23dffff640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:30:51.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23dffff640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f23e006fcd0 0x7f23e014d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:51.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23dffff640 10 monclient(hunting): picked mon.noname-a con 0x7f23e006fcd0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:51.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23dffff640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f23e0153680 0x7f23e0159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:51.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23dffff640 10 monclient(hunting): picked mon.noname-c con 0x7f23e0153680 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:51.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23dffff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f23e0153a60 0x7f23e01f4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:51.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23dffff640 10 monclient(hunting): picked mon.noname-b con 0x7f23e0153a60 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:51.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23dffff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:51.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23dffff640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f23e015a6d0 con 0x7f23e006fcd0 2026-02-17T21:30:51.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23dffff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:51.108 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23dffff640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f23e00c8110 con 0x7f23e0153a60 2026-02-17T21:30:51.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23dffff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:51.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23dffff640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f23e00c7da0 con 0x7f23e0153680 2026-02-17T21:30:51.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23dffff640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:51.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23dffff640 10 monclient(hunting): authenticate will time out at 1356.659260s 2026-02-17T21:30:51.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23deffd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f23e006fcd0 0x7f23e014d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:51.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23df7fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f23e0153a60 0x7f23e01f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:51.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23de7fc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f23e0153680 0x7f23e0159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:51.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23deffd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f23e006fcd0 0x7f23e014d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48490/0 (socket says 10.20.193.5:48490) 2026-02-17T21:30:51.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23deffd640 1 -- 10.20.193.5:0/1748949683 learned_addr learned my addr 10.20.193.5:0/1748949683 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:51.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23deffd640 10 monclient(hunting): get_auth_request con 0x7f23e006fcd0 auth_method 0 2026-02-17T21:30:51.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23deffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:51.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23deffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:51.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:51.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23df7fe640 10 monclient(hunting): get_auth_request con 0x7f23e0153a60 auth_method 0 2026-02-17T21:30:51.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23df7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:51.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23df7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:51.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23df7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:51.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23de7fc640 10 monclient(hunting): get_auth_request con 0x7f23e0153680 auth_method 0 2026-02-17T21:30:51.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23de7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:51.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23de7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:51.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23de7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:51.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23deffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:51.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23deffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:51.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.093+0000 7f23deffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:51.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.094+0000 7f23df7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:51.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.094+0000 7f23df7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:51.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.094+0000 7f23df7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:51.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.094+0000 7f23de7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:51.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.094+0000 7f23de7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:51.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.094+0000 7f23de7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:51.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.095+0000 7f23deffd640 10 monclient(hunting): handle_auth_done global_id 5295 payload 824 2026-02-17T21:30:51.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.095+0000 7f23deffd640 1 -- 10.20.193.5:0/1748949683 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f23e0153680 msgr2=0x7f23e0159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.095+0000 7f23deffd640 1 --2- 10.20.193.5:0/1748949683 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f23e0153680 0x7f23e0159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.095+0000 7f23deffd640 1 -- 10.20.193.5:0/1748949683 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f23e0153a60 msgr2=0x7f23e01f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.111 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.095+0000 7f23deffd640 1 --2- 10.20.193.5:0/1748949683 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f23e0153a60 0x7f23e01f4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.095+0000 7f23deffd640 10 monclient: _finish_hunting 0 2026-02-17T21:30:51.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.095+0000 7f23deffd640 1 monclient: found mon.noname-a 2026-02-17T21:30:51.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.095+0000 7f23deffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:51.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.095+0000 7f23deffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:51.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.095+0000 7f23deffd640 1 -- 10.20.193.5:0/1748949683 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e014de70 con 0x7f23e006fcd0 2026-02-17T21:30:51.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.096+0000 7f23deffd640 1 --2- 10.20.193.5:0/1748949683 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f23e006fcd0 0x7f23e014d730 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f23d402f390 tx=0x7f23d40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:51.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.096+0000 7f23bf7fe640 10 client.?.objecter ms_handle_connect 0x7f23e006fcd0 2026-02-17T21:30:51.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.096+0000 7f23bf7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:51.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.097+0000 7f23bf7fe640 1 -- 10.20.193.5:0/1748949683 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d403c040 con 0x7f23e006fcd0 2026-02-17T21:30:51.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.097+0000 7f23bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:51.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.097+0000 7f23bf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:51.112 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.097+0000 7f23bf7fe640 10 monclient: dump: 2026-02-17T21:30:51.112 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:51.113 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:51.113 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.113 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.113 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:51.113 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:51.113 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:51.113 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:51.113 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:51.113 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:51.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.097+0000 7f23bf7fe640 10 monclient: _finish_auth 0 2026-02-17T21:30:51.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.097+0000 7f23bf7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:30:51.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.097+0000 7f23bf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:51.113 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.097+0000 7f23bf7fe640 1 -- 10.20.193.5:0/1748949683 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d4042630 con 0x7f23e006fcd0 2026-02-17T21:30:51.114 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.097+0000 7f23bf7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:51.114 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.097+0000 7f23bf7fe640 1 -- 10.20.193.5:0/1748949683 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d4042a20 con 0x7f23e006fcd0 2026-02-17T21:30:51.114 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.097+0000 7f23dffff640 5 monclient: authenticate success, global_id 5295 2026-02-17T21:30:51.114 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.097+0000 7f23dffff640 10 monclient: _renew_subs 2026-02-17T21:30:51.114 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.097+0000 7f23dd7fa640 4 set_mon_vals no callback set 2026-02-17T21:30:51.114 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.097+0000 7f23dffff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:51.114 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.097+0000 7f23dffff640 1 -- 10.20.193.5:0/1748949683 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e014e150 con 0x7f23e006fcd0 2026-02-17T21:30:51.114 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.097+0000 7f23bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:51.114 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.097+0000 7f23bf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:51.114 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.097+0000 7f23bf7fe640 10 monclient: dump: 2026-02-17T21:30:51.114 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:51.114 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:51.115 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.115 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.115 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:51.115 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:51.115 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:51.115 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:51.115 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:51.115 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:51.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.098+0000 7f23dffff640 10 client.5295.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:51.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.098+0000 7f23dffff640 10 monclient: _renew_subs 2026-02-17T21:30:51.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.098+0000 7f23dffff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:51.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.098+0000 7f23dffff640 1 -- 10.20.193.5:0/1748949683 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e014e710 con 0x7f23e006fcd0 2026-02-17T21:30:51.116 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.098+0000 7f23dffff640 1 librados: init done 2026-02-17T21:30:51.116 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.098+0000 7f23dffff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:51.116 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.098+0000 7f23dffff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:51.116 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.098+0000 7f23dffff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:51.116 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.098+0000 7f23dffff640 1 -- 10.20.193.5:0/1748949683 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e015bf00 con 0x7f23e006fcd0 2026-02-17T21:30:51.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.109+0000 7f23bf7fe640 1 -- 10.20.193.5:0/1748949683 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f23d404b450 con 0x7f23e006fcd0 2026-02-17T21:30:51.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.109+0000 7f23bf7fe640 1 --2- 10.20.193.5:0/1748949683 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f23ac0792d0 0x7f23ac07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:51.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.110+0000 7f23de7fc640 1 --2- 10.20.193.5:0/1748949683 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f23ac0792d0 0x7f23ac07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:51.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.110+0000 7f23de7fc640 10 monclient: get_auth_request con 0x7f23ac0792d0 auth_method 0 2026-02-17T21:30:51.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.110+0000 7f23de7fc640 1 --2- 10.20.193.5:0/1748949683 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f23ac0792d0 0x7f23ac07b790 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f23e00ccde0 tx=0x7f23c8007dd0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:51.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.110+0000 7f23bf7fe640 10 client.5295.objecter ms_handle_connect 0x7f23ac0792d0 2026-02-17T21:30:51.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.111+0000 7f23bf7fe640 1 -- 10.20.193.5:0/1748949683 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f23d402fab0 con 0x7f23e006fcd0 2026-02-17T21:30:51.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.111+0000 7f23bf7fe640 10 client.5295.objecter ms_dispatch2 0x7f23e0000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:51.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.111+0000 7f23bf7fe640 3 client.5295.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:51.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.111+0000 7f23bf7fe640 3 client.5295.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:51.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.111+0000 7f23bf7fe640 20 client.5295.objecter dump_active .. 0 homeless 2026-02-17T21:30:51.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.212+0000 7f23bf7fe640 1 -- 10.20.193.5:0/1748949683 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f23d4086ba0 con 0x7f23e006fcd0 2026-02-17T21:30:51.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.212+0000 7f23bf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:51.215 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.212+0000 7f23bf7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:51.299 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.296+0000 7f23dffff640 1 -- 10.20.193.5:0/1748949683 --> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "11", "target": ["mon-mgr", ""]}) -- 0x7f23e00c45d0 con 0x7f23ac0792d0 2026-02-17T21:30:51.319 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.296+0000 7f23bf7fe640 1 -- 10.20.193.5:0/1748949683 <== mgr.4131 v2:10.20.193.176:6800/2898618020 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 11 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7f23e00c45d0 con 0x7f23ac0792d0 2026-02-17T21:30:51.320 INFO:teuthology.orchestra.run.trial005.stderr:instructed osd(s) 11 to deep-scrub 2026-02-17T21:30:51.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.297+0000 7f23dffff640 10 librados: watch_flush enter 2026-02-17T21:30:51.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.297+0000 7f23dffff640 10 librados: watch_flush exit 2026-02-17T21:30:51.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.297+0000 7f23dffff640 20 client.5295.objecter shutdown clearing up homeless session... 2026-02-17T21:30:51.322 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.297+0000 7f23dffff640 10 client.5295.objecter successfully canceled tick 2026-02-17T21:30:51.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.297+0000 7f23dffff640 1 -- 10.20.193.5:0/1748949683 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f23ac0792d0 msgr2=0x7f23ac07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.297+0000 7f23dffff640 1 --2- 10.20.193.5:0/1748949683 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f23ac0792d0 0x7f23ac07b790 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f23e00ccde0 tx=0x7f23c8007dd0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.297+0000 7f23dffff640 10 monclient: shutdown 2026-02-17T21:30:51.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.297+0000 7f23dffff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:51.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.297+0000 7f23dffff640 1 -- 10.20.193.5:0/1748949683 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f23e006fcd0 msgr2=0x7f23e014d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.297+0000 7f23dffff640 1 --2- 10.20.193.5:0/1748949683 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f23e006fcd0 0x7f23e014d730 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f23d402f390 tx=0x7f23d40047c0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.297+0000 7f23dffff640 1 -- 10.20.193.5:0/1748949683 shutdown_connections 2026-02-17T21:30:51.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.297+0000 7f23dffff640 1 --2- 10.20.193.5:0/1748949683 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f23ac0792d0 0x7f23ac07b790 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.297+0000 7f23dffff640 1 --2- 10.20.193.5:0/1748949683 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f23e0153a60 0x7f23e01f4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.297+0000 7f23dffff640 1 --2- 10.20.193.5:0/1748949683 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f23e0153680 0x7f23e0159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.297+0000 7f23dffff640 1 --2- 10.20.193.5:0/1748949683 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f23e006fcd0 0x7f23e014d730 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.297+0000 7f23dffff640 1 -- 10.20.193.5:0/1748949683 >> 10.20.193.5:0/1748949683 conn(0x7f23e00cd5c0 msgr2=0x7f23e00cc330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:51.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.297+0000 7f23dffff640 1 -- 10.20.193.5:0/1748949683 shutdown_connections 2026-02-17T21:30:51.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.297+0000 7f23dffff640 1 -- 10.20.193.5:0/1748949683 wait complete. 2026-02-17T21:30:51.324 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.297+0000 7f23dffff640 1 librados: shutdown 2026-02-17T21:30:51.324 INFO:tasks.ceph:Scrubbing osd.15 2026-02-17T21:30:51.325 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:30:51.395 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.393+0000 7fb48b4d6640 10 monclient: get_monmap_and_config 2026-02-17T21:30:51.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.393+0000 7fb48b4d6640 10 monclient: build_initial_monmap 2026-02-17T21:30:51.396 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.393+0000 7fb48b4d6640 10 monclient: monmap: 2026-02-17T21:30:51.396 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:51.396 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:51.396 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:51.395342+0000 2026-02-17T21:30:51.396 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:51.395342+0000 2026-02-17T21:30:51.396 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:51.396 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:51.397 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:51.397 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:51.397 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:51.397 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:51.397 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:51.397 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:51.397 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:51.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.394+0000 7fb48b4d6640 1 Processor -- start 2026-02-17T21:30:51.400 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.394+0000 7fb48b4d6640 1 -- start start 2026-02-17T21:30:51.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.394+0000 7fb48b4d6640 10 monclient: init 2026-02-17T21:30:51.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.394+0000 7fb48b4d6640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:51.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.394+0000 7fb48b4d6640 10 monclient: _add_conns ranks=[1,2,3,4,0,5] 2026-02-17T21:30:51.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.395+0000 7fb48b4d6640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fb4841505e0 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:51.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.395+0000 7fb48b4d6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb4840c5a70 addr v1:10.20.193.135:6789/0 2026-02-17T21:30:51.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.395+0000 7fb48b4d6640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fb4840c9bc0 0x7fb484076460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:51.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.395+0000 7fb48b4d6640 10 monclient(hunting): picked mon.noname-a con 0x7fb4840c9bc0 addr v2:10.20.193.5:3300/0 2026-02-17T21:30:51.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.395+0000 7fb48b4d6640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4840c6060 con 0x7fb4841505e0 2026-02-17T21:30:51.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.395+0000 7fb48b4d6640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4840c86f0 con 0x7fb4840c5a70 2026-02-17T21:30:51.401 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.395+0000 7fb48b4d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:51.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.395+0000 7fb48b4d6640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb4840c9020 con 0x7fb4840c9bc0 2026-02-17T21:30:51.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.395+0000 7fb48b4d6640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:51.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.395+0000 7fb48b4d6640 10 monclient(hunting): authenticate will time out at 1356.961078s 2026-02-17T21:30:51.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.395+0000 7fb489a4c640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fb4840c9bc0 0x7fb484076460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:51.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.395+0000 7fb48924b640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7fb4841505e0 0x7fb4840c78a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:41206/0 (socket says 10.20.193.5:41206) 2026-02-17T21:30:51.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.395+0000 7fb48924b640 1 -- 10.20.193.5:0/2307576398 learned_addr learned my addr 10.20.193.5:0/2307576398 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:51.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.395+0000 7fb489a4c640 10 monclient(hunting): get_auth_request con 0x7fb4840c9bc0 auth_method 0 2026-02-17T21:30:51.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.395+0000 7fb489a4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:51.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.395+0000 7fb489a4c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:51.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.395+0000 7fb489a4c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:51.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.396+0000 7fb489a4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:51.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.396+0000 7fb489a4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:51.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.396+0000 7fb489a4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:51.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.396+0000 7fb473fff640 1 -- 10.20.193.5:0/2307576398 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3157038406 0 0) 0x7fb4840c6060 con 0x7fb4841505e0 2026-02-17T21:30:51.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.396+0000 7fb473fff640 10 monclient(hunting): _negotiate 2026-02-17T21:30:51.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.396+0000 7fb473fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:51.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.396+0000 7fb473fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:51.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.396+0000 7fb473fff640 10 monclient(hunting): my global_id is 5362 2026-02-17T21:30:51.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.396+0000 7fb473fff640 1 -- 10.20.193.5:0/2307576398 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb46c003620 con 0x7fb4841505e0 2026-02-17T21:30:51.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.396+0000 7fb473fff640 1 -- 10.20.193.5:0/2307576398 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2077075966 0 0) 0x7fb4840c86f0 con 0x7fb4840c5a70 2026-02-17T21:30:51.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.396+0000 7fb473fff640 10 monclient(hunting): _negotiate 2026-02-17T21:30:51.403 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.396+0000 7fb473fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:51.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.396+0000 7fb473fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:51.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.396+0000 7fb473fff640 10 monclient(hunting): my global_id is 5363 2026-02-17T21:30:51.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.396+0000 7fb473fff640 1 -- 10.20.193.5:0/2307576398 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4840c6060 con 0x7fb4840c5a70 2026-02-17T21:30:51.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.397+0000 7fb489a4c640 10 monclient(hunting): handle_auth_done global_id 5298 payload 274 2026-02-17T21:30:51.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.397+0000 7fb489a4c640 1 -- 10.20.193.5:0/2307576398 >> v1:10.20.193.135:6789/0 conn(0x7fb4840c5a70 legacy=0x7fb4840c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.397+0000 7fb489a4c640 1 -- 10.20.193.5:0/2307576398 >> v1:10.20.193.119:6789/0 conn(0x7fb4841505e0 legacy=0x7fb4840c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.397+0000 7fb489a4c640 10 monclient: _finish_hunting 0 2026-02-17T21:30:51.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.397+0000 7fb489a4c640 1 monclient: found mon.noname-a 2026-02-17T21:30:51.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.397+0000 7fb489a4c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:51.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.397+0000 7fb489a4c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:51.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.397+0000 7fb489a4c640 1 -- 10.20.193.5:0/2307576398 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4840c89d0 con 0x7fb4840c9bc0 2026-02-17T21:30:51.404 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.397+0000 7fb489a4c640 1 --2- 10.20.193.5:0/2307576398 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb4840c9bc0 0x7fb484076460 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb4800098a0 tx=0x7fb48002ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185f9707f5eb1af7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:51.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.399+0000 7fb473fff640 1 -- 10.20.193.5:0/2307576398 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48003c070 con 0x7fb4840c9bc0 2026-02-17T21:30:51.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.399+0000 7fb473fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:51.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.399+0000 7fb473fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:51.411 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.399+0000 7fb473fff640 10 monclient: dump: 2026-02-17T21:30:51.411 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:51.411 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:51.411 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.411 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.411 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:51.411 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:51.411 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:51.411 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:51.411 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:51.412 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:51.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.399+0000 7fb473fff640 10 monclient: _finish_auth 0 2026-02-17T21:30:51.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.399+0000 7fb473fff640 10 monclient: _check_auth_tickets 2026-02-17T21:30:51.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.399+0000 7fb473fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:51.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.399+0000 7fb473fff640 1 -- 10.20.193.5:0/2307576398 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb48002fb70 con 0x7fb4840c9bc0 2026-02-17T21:30:51.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.399+0000 7fb48b4d6640 5 monclient: authenticate success, global_id 5298 2026-02-17T21:30:51.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.399+0000 7fb473fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:51.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.399+0000 7fb473fff640 1 -- 10.20.193.5:0/2307576398 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb480037440 con 0x7fb4840c9bc0 2026-02-17T21:30:51.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.399+0000 7fb48b4d6640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:51.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.399+0000 7fb48b4d6640 4 set_mon_vals no callback set 2026-02-17T21:30:51.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.399+0000 7fb473fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:51.412 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.399+0000 7fb473fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:51.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.399+0000 7fb473fff640 10 monclient: dump: 2026-02-17T21:30:51.413 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:51.413 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:51.413 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.413 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.413 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:51.413 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:51.413 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:51.413 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:51.413 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:51.413 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:51.413 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.399+0000 7fb48b4d6640 10 monclient: shutdown 2026-02-17T21:30:51.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.399+0000 7fb48b4d6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:51.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.399+0000 7fb48b4d6640 1 -- 10.20.193.5:0/2307576398 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb4840c9bc0 msgr2=0x7fb484076460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.399+0000 7fb48b4d6640 1 --2- 10.20.193.5:0/2307576398 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb4840c9bc0 0x7fb484076460 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb4800098a0 tx=0x7fb48002ee60 comp rx=0 tx=0).stop 2026-02-17T21:30:51.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.399+0000 7fb48b4d6640 1 -- 10.20.193.5:0/2307576398 shutdown_connections 2026-02-17T21:30:51.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.399+0000 7fb48b4d6640 1 --2- 10.20.193.5:0/2307576398 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb4840c9bc0 0x7fb484076460 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.399+0000 7fb48b4d6640 1 -- 10.20.193.5:0/2307576398 >> 10.20.193.5:0/2307576398 conn(0x7fb4840ca6e0 msgr2=0x7fb4840caac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:51.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.400+0000 7fb48b4d6640 1 -- 10.20.193.5:0/2307576398 shutdown_connections 2026-02-17T21:30:51.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.400+0000 7fb48b4d6640 1 -- 10.20.193.5:0/2307576398 wait complete. 2026-02-17T21:30:51.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.400+0000 7fb48b4d6640 10 monclient: build_initial_monmap 2026-02-17T21:30:51.414 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.400+0000 7fb48b4d6640 10 monclient: monmap: 2026-02-17T21:30:51.414 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:51.414 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:51.415 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:51.415 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:51.415 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:51.415 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:51.415 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:51.415 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:51.415 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:51.415 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:51.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.400+0000 7fb48b4d6640 1 librados: starting msgr at 2026-02-17T21:30:51.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.400+0000 7fb48b4d6640 1 librados: starting objecter 2026-02-17T21:30:51.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.400+0000 7fb48b4d6640 1 Processor -- start 2026-02-17T21:30:51.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.400+0000 7fb48b4d6640 1 -- start start 2026-02-17T21:30:51.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.400+0000 7fb48b4d6640 1 librados: setting wanted keys 2026-02-17T21:30:51.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.400+0000 7fb48b4d6640 1 librados: calling monclient init 2026-02-17T21:30:51.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.400+0000 7fb48b4d6640 10 monclient: init 2026-02-17T21:30:51.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48b4d6640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:51.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48b4d6640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:30:51.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48b4d6640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb4840c5a70 0x7fb484144d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:51.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48b4d6640 10 monclient(hunting): picked mon.noname-c con 0x7fb4840c5a70 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:51.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48b4d6640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb4840c9bc0 0x7fb48406f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:51.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48b4d6640 10 monclient(hunting): picked mon.noname-b con 0x7fb4840c9bc0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:51.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48b4d6640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb4841505e0 0x7fb48406f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:51.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48b4d6640 10 monclient(hunting): picked mon.noname-a con 0x7fb4841505e0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:51.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48b4d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:51.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48b4d6640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb4840c7fb0 con 0x7fb4841505e0 2026-02-17T21:30:51.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48b4d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:51.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48b4d6640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb4840c6340 con 0x7fb4840c9bc0 2026-02-17T21:30:51.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48b4d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:51.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48b4d6640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb4840c8130 con 0x7fb4840c5a70 2026-02-17T21:30:51.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48b4d6640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:51.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48b4d6640 10 monclient(hunting): authenticate will time out at 1356.967080s 2026-02-17T21:30:51.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb489a4c640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb4841505e0 0x7fb48406f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:51.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb488a4a640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb4840c9bc0 0x7fb48406f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:51.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48924b640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb4840c5a70 0x7fb484144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:51.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48924b640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb4840c5a70 0x7fb484144d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.135:3300/0 says I am v2:10.20.193.5:36536/0 (socket says 10.20.193.5:36536) 2026-02-17T21:30:51.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48924b640 1 -- 10.20.193.5:0/834910909 learned_addr learned my addr 10.20.193.5:0/834910909 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:51.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48924b640 10 monclient(hunting): get_auth_request con 0x7fb4840c5a70 auth_method 0 2026-02-17T21:30:51.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48924b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:51.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48924b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:51.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48924b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:51.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb489a4c640 10 monclient(hunting): get_auth_request con 0x7fb4841505e0 auth_method 0 2026-02-17T21:30:51.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb489a4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:51.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb489a4c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:51.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb489a4c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:51.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb488a4a640 10 monclient(hunting): get_auth_request con 0x7fb4840c9bc0 auth_method 0 2026-02-17T21:30:51.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb488a4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:51.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb488a4a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:51.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb488a4a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:51.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48924b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:51.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48924b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:51.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb48924b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:51.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb488a4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:51.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb488a4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:51.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb488a4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:51.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb489a4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:51.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb489a4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:51.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.401+0000 7fb489a4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:51.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.403+0000 7fb488a4a640 10 monclient(hunting): handle_auth_done global_id 5365 payload 824 2026-02-17T21:30:51.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.403+0000 7fb488a4a640 1 -- 10.20.193.5:0/834910909 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb4840c5a70 msgr2=0x7fb484144d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.403+0000 7fb488a4a640 1 --2- 10.20.193.5:0/834910909 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fb4840c5a70 0x7fb484144d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.403+0000 7fb488a4a640 1 -- 10.20.193.5:0/834910909 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb4841505e0 msgr2=0x7fb48406f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.403+0000 7fb488a4a640 1 --2- 10.20.193.5:0/834910909 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fb4841505e0 0x7fb48406f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.403+0000 7fb488a4a640 10 monclient: _finish_hunting 0 2026-02-17T21:30:51.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.403+0000 7fb488a4a640 1 monclient: found mon.noname-b 2026-02-17T21:30:51.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.403+0000 7fb488a4a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:51.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.403+0000 7fb488a4a640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:30:51.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.403+0000 7fb488a4a640 1 -- 10.20.193.5:0/834910909 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4841f4d00 con 0x7fb4840c9bc0 2026-02-17T21:30:51.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.404+0000 7fb488a4a640 1 --2- 10.20.193.5:0/834910909 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb4840c9bc0 0x7fb48406f340 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb47800c500 tx=0x7fb47800c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:51.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.404+0000 7fb471ffb640 10 client.?.objecter ms_handle_connect 0x7fb4840c9bc0 2026-02-17T21:30:51.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.404+0000 7fb471ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:51.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb471ffb640 1 -- 10.20.193.5:0/834910909 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4780052d0 con 0x7fb4840c9bc0 2026-02-17T21:30:51.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb471ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:51.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb471ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:30:51.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb471ffb640 10 monclient: dump: 2026-02-17T21:30:51.420 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:51.421 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:51.421 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.421 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.421 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:51.421 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:51.421 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:51.421 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:51.421 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:51.421 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:51.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb471ffb640 10 monclient: _finish_auth 0 2026-02-17T21:30:51.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb471ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:30:51.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb471ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:51.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb471ffb640 1 -- 10.20.193.5:0/834910909 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb478005490 con 0x7fb4840c9bc0 2026-02-17T21:30:51.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb48b4d6640 5 monclient: authenticate success, global_id 5365 2026-02-17T21:30:51.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb471ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:51.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb471ffb640 1 -- 10.20.193.5:0/834910909 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb478003930 con 0x7fb4840c9bc0 2026-02-17T21:30:51.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb471ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:51.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb471ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:30:51.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb471ffb640 10 monclient: dump: 2026-02-17T21:30:51.422 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:51.422 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:51.422 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.422 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.423 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:51.423 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:51.423 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:51.423 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:51.423 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:51.423 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:51.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb4737fe640 4 set_mon_vals no callback set 2026-02-17T21:30:51.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb48b4d6640 10 monclient: _renew_subs 2026-02-17T21:30:51.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb48b4d6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:51.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb48b4d6640 1 -- 10.20.193.5:0/834910909 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4841f4180 con 0x7fb4840c9bc0 2026-02-17T21:30:51.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb48b4d6640 10 client.5365.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:51.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb48b4d6640 10 monclient: _renew_subs 2026-02-17T21:30:51.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb48b4d6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:51.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb48b4d6640 1 -- 10.20.193.5:0/834910909 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4841f4740 con 0x7fb4840c9bc0 2026-02-17T21:30:51.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb48b4d6640 1 librados: init done 2026-02-17T21:30:51.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb48b4d6640 10 client.5365.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:51.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb48b4d6640 15 client.5365.objecter _session_command_op_assign -1 1 2026-02-17T21:30:51.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb48b4d6640 20 client.5365.objecter _get_session osd=-1 returning homeless 2026-02-17T21:30:51.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb48b4d6640 10 client.5365.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:51.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb48b4d6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:51.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.406+0000 7fb48b4d6640 1 -- 10.20.193.5:0/834910909 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb4841509c0 con 0x7fb4840c9bc0 2026-02-17T21:30:51.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.417+0000 7fb471ffb640 1 -- 10.20.193.5:0/834910909 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fb478003ad0 con 0x7fb4840c9bc0 2026-02-17T21:30:51.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.418+0000 7fb471ffb640 1 --2- 10.20.193.5:0/834910909 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb4540792d0 0x7fb45407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:51.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.418+0000 7fb48924b640 1 --2- 10.20.193.5:0/834910909 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb4540792d0 0x7fb45407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:51.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.418+0000 7fb48924b640 10 monclient: get_auth_request con 0x7fb4540792d0 auth_method 0 2026-02-17T21:30:51.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.419+0000 7fb48924b640 1 --2- 10.20.193.5:0/834910909 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb4540792d0 0x7fb45407b790 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb474005d00 tx=0x7fb474009040 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:51.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.419+0000 7fb471ffb640 10 client.5365.objecter ms_handle_connect 0x7fb4540792d0 2026-02-17T21:30:51.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.419+0000 7fb471ffb640 1 -- 10.20.193.5:0/834910909 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fb47805e3b0 con 0x7fb4840c9bc0 2026-02-17T21:30:51.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.419+0000 7fb471ffb640 10 client.5365.objecter ms_dispatch2 0x7fb484000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:51.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.419+0000 7fb471ffb640 3 client.5365.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:51.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.419+0000 7fb471ffb640 3 client.5365.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:51.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.419+0000 7fb471ffb640 10 client.5365.objecter checking command 1 2026-02-17T21:30:51.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.419+0000 7fb471ffb640 1 --2- 10.20.193.5:0/834910909 >> [v2:10.20.193.176:6810/1976318959,v1:10.20.193.176:6811/1976318959] conn(0x7fb4540817b0 0x7fb454083bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:51.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.419+0000 7fb471ffb640 20 client.5365.objecter _get_session s=0x7fb4540810e0 osd=15 3 2026-02-17T21:30:51.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.419+0000 7fb471ffb640 20 client.5365.objecter put_session s=0x7fb4540810e0 osd=15 3 2026-02-17T21:30:51.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.419+0000 7fb471ffb640 15 client.5365.objecter _session_command_op_remove -1 1 2026-02-17T21:30:51.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.419+0000 7fb471ffb640 20 client.5365.objecter _get_session s=0x7fb4540810e0 osd=15 3 2026-02-17T21:30:51.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.419+0000 7fb471ffb640 20 client.5365.objecter get_session s=0x7fb4540810e0 osd=15 3 2026-02-17T21:30:51.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.419+0000 7fb471ffb640 15 client.5365.objecter _session_command_op_assign 15 1 2026-02-17T21:30:51.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.419+0000 7fb471ffb640 20 client.5365.objecter put_session s=0x7fb4540810e0 osd=15 4 2026-02-17T21:30:51.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.419+0000 7fb471ffb640 10 client.5365.objecter _send_command 1 2026-02-17T21:30:51.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.419+0000 7fb471ffb640 1 -- 10.20.193.5:0/834910909 --> [v2:10.20.193.176:6810/1976318959,v1:10.20.193.176:6811/1976318959] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb478018e70 con 0x7fb4540817b0 2026-02-17T21:30:51.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.419+0000 7fb471ffb640 20 client.5365.objecter dump_active .. 0 homeless 2026-02-17T21:30:51.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.420+0000 7fb489a4c640 1 --2- 10.20.193.5:0/834910909 >> [v2:10.20.193.176:6810/1976318959,v1:10.20.193.176:6811/1976318959] conn(0x7fb4540817b0 0x7fb454083bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:51.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.420+0000 7fb471ffb640 1 -- 10.20.193.5:0/834910909 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb47805e770 con 0x7fb4840c9bc0 2026-02-17T21:30:51.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.420+0000 7fb471ffb640 10 monclient: handle_get_version_reply finishing 1 version 35 2026-02-17T21:30:51.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.420+0000 7fb489a4c640 10 monclient: get_auth_request con 0x7fb4540817b0 auth_method 0 2026-02-17T21:30:51.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.422+0000 7fb489a4c640 1 --2- 10.20.193.5:0/834910909 >> [v2:10.20.193.176:6810/1976318959,v1:10.20.193.176:6811/1976318959] conn(0x7fb4540817b0 0x7fb454083bd0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.15 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:51.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.422+0000 7fb471ffb640 10 client.5365.objecter ms_handle_connect 0x7fb4540817b0 2026-02-17T21:30:51.435 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.433+0000 7fb471ffb640 1 -- 10.20.193.5:0/834910909 <== osd.15 v2:10.20.193.176:6810/1976318959 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fb478018e70 con 0x7fb4540817b0 2026-02-17T21:30:51.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.433+0000 7fb471ffb640 10 client.5365.objecter ms_dispatch2 0x7fb484000b90 command_reply(tid 1: 0 ) 2026-02-17T21:30:51.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.433+0000 7fb471ffb640 10 client.5365.objecter _finish_command 1 = system:0 2026-02-17T21:30:51.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.433+0000 7fb471ffb640 20 client.5365.objecter put_session s=0x7fb4540810e0 osd=15 4 2026-02-17T21:30:51.436 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.433+0000 7fb471ffb640 15 client.5365.objecter _session_command_op_remove 15 1 2026-02-17T21:30:51.441 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.439+0000 7fb48b4d6640 10 client.5365.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:30:51.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.439+0000 7fb48b4d6640 15 client.5365.objecter _session_command_op_assign -1 2 2026-02-17T21:30:51.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.439+0000 7fb48b4d6640 20 client.5365.objecter _get_session s=0x7fb4540810e0 osd=15 3 2026-02-17T21:30:51.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.439+0000 7fb48b4d6640 20 client.5365.objecter put_session s=0x7fb4540810e0 osd=15 3 2026-02-17T21:30:51.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.439+0000 7fb48b4d6640 20 client.5365.objecter _get_session s=0x7fb4540810e0 osd=15 3 2026-02-17T21:30:51.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.439+0000 7fb48b4d6640 15 client.5365.objecter _session_command_op_remove -1 2 2026-02-17T21:30:51.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.439+0000 7fb48b4d6640 20 client.5365.objecter get_session s=0x7fb4540810e0 osd=15 3 2026-02-17T21:30:51.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.439+0000 7fb48b4d6640 15 client.5365.objecter _session_command_op_assign 15 2 2026-02-17T21:30:51.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.439+0000 7fb48b4d6640 20 client.5365.objecter put_session s=0x7fb4540810e0 osd=15 4 2026-02-17T21:30:51.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.439+0000 7fb48b4d6640 10 client.5365.objecter _send_command 2 2026-02-17T21:30:51.442 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.439+0000 7fb48b4d6640 1 -- 10.20.193.5:0/834910909 --> [v2:10.20.193.176:6810/1976318959,v1:10.20.193.176:6811/1976318959] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb4840c4b10 con 0x7fb4540817b0 2026-02-17T21:30:51.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.446+0000 7fb471ffb640 1 -- 10.20.193.5:0/834910909 <== osd.15 v2:10.20.193.176:6810/1976318959 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb4840c4b10 con 0x7fb4540817b0 2026-02-17T21:30:51.448 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.446+0000 7fb471ffb640 10 client.5365.objecter ms_dispatch2 0x7fb484000b90 command_reply(tid 2: 0 ) 2026-02-17T21:30:51.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.446+0000 7fb471ffb640 10 client.5365.objecter _finish_command 2 = system:0 2026-02-17T21:30:51.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.446+0000 7fb471ffb640 20 client.5365.objecter put_session s=0x7fb4540810e0 osd=15 4 2026-02-17T21:30:51.449 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.446+0000 7fb471ffb640 15 client.5365.objecter _session_command_op_remove 15 2 2026-02-17T21:30:51.449 INFO:teuthology.orchestra.run.trial005.stdout:{ 2026-02-17T21:30:51.449 INFO:teuthology.orchestra.run.trial005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:30:51.449 INFO:teuthology.orchestra.run.trial005.stdout:} 2026-02-17T21:30:51.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.446+0000 7fb48b4d6640 10 librados: watch_flush enter 2026-02-17T21:30:51.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.446+0000 7fb48b4d6640 10 librados: watch_flush exit 2026-02-17T21:30:51.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.446+0000 7fb48b4d6640 10 client.5365.objecter close_session for osd.15 2026-02-17T21:30:51.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.446+0000 7fb48b4d6640 1 -- 10.20.193.5:0/834910909 >> [v2:10.20.193.176:6810/1976318959,v1:10.20.193.176:6811/1976318959] conn(0x7fb4540817b0 msgr2=0x7fb454083bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.446+0000 7fb48b4d6640 1 --2- 10.20.193.5:0/834910909 >> [v2:10.20.193.176:6810/1976318959,v1:10.20.193.176:6811/1976318959] conn(0x7fb4540817b0 0x7fb454083bd0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.446+0000 7fb48b4d6640 20 client.5365.objecter put_session s=0x7fb4540810e0 osd=15 1 2026-02-17T21:30:51.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.446+0000 7fb48b4d6640 20 client.5365.objecter shutdown clearing up homeless session... 2026-02-17T21:30:51.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.446+0000 7fb48b4d6640 10 client.5365.objecter successfully canceled tick 2026-02-17T21:30:51.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.446+0000 7fb48b4d6640 1 -- 10.20.193.5:0/834910909 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb4540792d0 msgr2=0x7fb45407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.451 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.446+0000 7fb48b4d6640 1 --2- 10.20.193.5:0/834910909 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fb4540792d0 0x7fb45407b790 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb474005d00 tx=0x7fb474009040 comp rx=0 tx=0).stop 2026-02-17T21:30:51.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.446+0000 7fb48b4d6640 10 monclient: shutdown 2026-02-17T21:30:51.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.446+0000 7fb48b4d6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:51.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.446+0000 7fb48b4d6640 1 -- 10.20.193.5:0/834910909 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb4840c9bc0 msgr2=0x7fb48406f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.446+0000 7fb48b4d6640 1 --2- 10.20.193.5:0/834910909 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb4840c9bc0 0x7fb48406f340 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb47800c500 tx=0x7fb47800c9d0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.446+0000 7fb489a4c640 1 -- 10.20.193.5:0/834910909 reap_dead start 2026-02-17T21:30:51.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.446+0000 7fb48b4d6640 1 -- 10.20.193.5:0/834910909 shutdown_connections 2026-02-17T21:30:51.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.446+0000 7fb48b4d6640 1 -- 10.20.193.5:0/834910909 >> 10.20.193.5:0/834910909 conn(0x7fb4840ca6e0 msgr2=0x7fb4840c4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:51.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.446+0000 7fb48b4d6640 1 -- 10.20.193.5:0/834910909 shutdown_connections 2026-02-17T21:30:51.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.446+0000 7fb48b4d6640 1 -- 10.20.193.5:0/834910909 wait complete. 2026-02-17T21:30:51.452 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.446+0000 7fb48b4d6640 1 librados: shutdown 2026-02-17T21:30:51.456 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 15 2026-02-17T21:30:51.524 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.522+0000 7f996d111640 10 monclient: get_monmap_and_config 2026-02-17T21:30:51.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.522+0000 7f996d111640 10 monclient: build_initial_monmap 2026-02-17T21:30:51.525 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.522+0000 7f996d111640 10 monclient: monmap: 2026-02-17T21:30:51.525 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:51.525 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:51.525 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:51.524136+0000 2026-02-17T21:30:51.525 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:51.524136+0000 2026-02-17T21:30:51.525 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:51.525 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:51.525 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:51.525 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:51.525 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:51.526 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:51.526 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:51.526 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:51.526 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:51.528 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.522+0000 7f996d111640 1 Processor -- start 2026-02-17T21:30:51.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.522+0000 7f996d111640 1 -- start start 2026-02-17T21:30:51.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.522+0000 7f996d111640 10 monclient: init 2026-02-17T21:30:51.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.523+0000 7f996d111640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:51.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.523+0000 7f996d111640 10 monclient: _add_conns ranks=[3,0,1,2,4,5] 2026-02-17T21:30:51.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.523+0000 7f996d111640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f996815d370 0x7f996815d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:51.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.523+0000 7f996d111640 10 monclient(hunting): picked mon.noname-a con 0x7f996815d370 addr v2:10.20.193.5:3300/0 2026-02-17T21:30:51.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.523+0000 7f996d111640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f99680c7e20 addr v1:10.20.193.5:6789/0 2026-02-17T21:30:51.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.523+0000 7f996d111640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f99680c74c0 addr v1:10.20.193.119:6789/0 2026-02-17T21:30:51.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.523+0000 7f996d111640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99680c8350 con 0x7f99680c7e20 2026-02-17T21:30:51.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.523+0000 7f996d111640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99680c8630 con 0x7f99680c74c0 2026-02-17T21:30:51.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.523+0000 7f996d111640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:51.529 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.523+0000 7f996d111640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f996815b710 con 0x7f996815d370 2026-02-17T21:30:51.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.523+0000 7f996d111640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:51.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.523+0000 7f996d111640 10 monclient(hunting): authenticate will time out at 1357.089457s 2026-02-17T21:30:51.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.523+0000 7f9966d76640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f996815d370 0x7f996815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:51.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.523+0000 7f9967577640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f99680c74c0 0x7f99680c52b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.5:41208/0 (socket says 10.20.193.5:41208) 2026-02-17T21:30:51.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.523+0000 7f9967577640 1 -- 10.20.193.5:0/1893504678 learned_addr learned my addr 10.20.193.5:0/1893504678 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:30:51.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.524+0000 7f9966d76640 10 monclient(hunting): get_auth_request con 0x7f996815d370 auth_method 0 2026-02-17T21:30:51.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.524+0000 7f9966d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:51.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.524+0000 7f9966d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:51.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.524+0000 7f9966d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:51.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.524+0000 7f9966d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:51.530 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.524+0000 7f9966d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:51.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.524+0000 7f9966d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:51.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.525+0000 7f9965d74640 1 -- 10.20.193.5:0/1893504678 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1380257101 0 0) 0x7f99680c8630 con 0x7f99680c74c0 2026-02-17T21:30:51.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.525+0000 7f9965d74640 10 monclient(hunting): _negotiate 2026-02-17T21:30:51.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.525+0000 7f9965d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:51.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.525+0000 7f9965d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:51.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.525+0000 7f9965d74640 10 monclient(hunting): my global_id is 5368 2026-02-17T21:30:51.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.525+0000 7f9965d74640 1 -- 10.20.193.5:0/1893504678 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9954003620 con 0x7f99680c74c0 2026-02-17T21:30:51.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.525+0000 7f9966d76640 10 monclient(hunting): handle_auth_done global_id 5304 payload 274 2026-02-17T21:30:51.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.525+0000 7f9966d76640 1 -- 10.20.193.5:0/1893504678 >> v1:10.20.193.119:6789/0 conn(0x7f99680c74c0 legacy=0x7f99680c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.525+0000 7f9966d76640 1 -- 10.20.193.5:0/1893504678 >> v1:10.20.193.5:6789/0 conn(0x7f99680c7e20 legacy=0x7f996815b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.525+0000 7f9966d76640 10 monclient: _finish_hunting 0 2026-02-17T21:30:51.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.525+0000 7f9966d76640 1 monclient: found mon.noname-a 2026-02-17T21:30:51.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.525+0000 7f9966d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:51.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.525+0000 7f9966d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:51.532 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.525+0000 7f9966d76640 1 -- 10.20.193.5:0/1893504678 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99680c8910 con 0x7f996815d370 2026-02-17T21:30:51.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.527+0000 7f9966d76640 1 --2- 10.20.193.5:0/1893504678 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f996815d370 0x7f996815d750 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f995c0098a0 tx=0x7f995c02ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5768749137d986d1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:51.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.529+0000 7f9965d74640 1 -- 10.20.193.5:0/1893504678 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c03c070 con 0x7f996815d370 2026-02-17T21:30:51.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.529+0000 7f9965d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:51.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.529+0000 7f9965d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:51.537 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.529+0000 7f9965d74640 10 monclient: dump: 2026-02-17T21:30:51.537 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:51.537 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:51.538 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.538 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.538 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:51.538 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:51.538 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:51.538 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:51.538 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:51.538 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:51.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.529+0000 7f9965d74640 10 monclient: _finish_auth 0 2026-02-17T21:30:51.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.529+0000 7f9965d74640 10 monclient: _check_auth_tickets 2026-02-17T21:30:51.538 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.529+0000 7f9965d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:51.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.529+0000 7f9965d74640 1 -- 10.20.193.5:0/1893504678 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995c02fb70 con 0x7f996815d370 2026-02-17T21:30:51.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.529+0000 7f996d111640 5 monclient: authenticate success, global_id 5304 2026-02-17T21:30:51.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.529+0000 7f996d111640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:30:51.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.529+0000 7f9965d74640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:51.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.529+0000 7f9965d74640 1 -- 10.20.193.5:0/1893504678 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c037440 con 0x7f996815d370 2026-02-17T21:30:51.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.529+0000 7f9965d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:51.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.529+0000 7f9965d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:51.539 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.529+0000 7f9965d74640 10 monclient: dump: 2026-02-17T21:30:51.539 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:51.539 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:51.539 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.539 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.540 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:51.540 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:51.540 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:51.540 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:51.540 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:51.540 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:51.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.529+0000 7f996d111640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:51.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.529+0000 7f996d111640 4 set_mon_vals no callback set 2026-02-17T21:30:51.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.530+0000 7f996d111640 10 monclient: shutdown 2026-02-17T21:30:51.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.530+0000 7f996d111640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:51.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.530+0000 7f996d111640 1 -- 10.20.193.5:0/1893504678 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f996815d370 msgr2=0x7f996815d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.540 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.530+0000 7f996d111640 1 --2- 10.20.193.5:0/1893504678 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f996815d370 0x7f996815d750 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f995c0098a0 tx=0x7f995c02ee60 comp rx=0 tx=0).stop 2026-02-17T21:30:51.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.530+0000 7f996d111640 1 -- 10.20.193.5:0/1893504678 shutdown_connections 2026-02-17T21:30:51.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.530+0000 7f996d111640 1 --2- 10.20.193.5:0/1893504678 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f996815d370 0x7f996815d750 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.530+0000 7f996d111640 1 -- 10.20.193.5:0/1893504678 >> 10.20.193.5:0/1893504678 conn(0x7f99680c9f20 msgr2=0x7f99680ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:51.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.530+0000 7f996d111640 1 -- 10.20.193.5:0/1893504678 shutdown_connections 2026-02-17T21:30:51.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.530+0000 7f996d111640 1 -- 10.20.193.5:0/1893504678 wait complete. 2026-02-17T21:30:51.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.530+0000 7f996d111640 10 monclient: build_initial_monmap 2026-02-17T21:30:51.541 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.530+0000 7f996d111640 10 monclient: monmap: 2026-02-17T21:30:51.541 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:51.541 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:51.541 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:51.541 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:51.541 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:51.542 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:51.542 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:51.542 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:51.542 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:51.542 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:51.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.530+0000 7f996d111640 1 librados: starting msgr at 2026-02-17T21:30:51.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.530+0000 7f996d111640 1 librados: starting objecter 2026-02-17T21:30:51.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.530+0000 7f996d111640 1 Processor -- start 2026-02-17T21:30:51.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.530+0000 7f996d111640 1 -- start start 2026-02-17T21:30:51.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.530+0000 7f996d111640 1 librados: setting wanted keys 2026-02-17T21:30:51.542 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.530+0000 7f996d111640 1 librados: calling monclient init 2026-02-17T21:30:51.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.530+0000 7f996d111640 10 monclient: init 2026-02-17T21:30:51.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f996d111640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:51.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f996d111640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:30:51.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f996d111640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f99680c74c0 0x7f9968073d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:51.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f996d111640 10 monclient(hunting): picked mon.noname-c con 0x7f99680c74c0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:51.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f996d111640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f99680c7e20 0x7f99681f1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:51.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f996d111640 10 monclient(hunting): picked mon.noname-b con 0x7f99680c7e20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:51.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f996d111640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f996815d370 0x7f9968143a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:51.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f996d111640 10 monclient(hunting): picked mon.noname-a con 0x7f996815d370 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:51.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f996d111640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:51.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f996d111640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f99680c8ed0 con 0x7f996815d370 2026-02-17T21:30:51.543 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f996d111640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:51.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f996d111640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f99680c9240 con 0x7f99680c7e20 2026-02-17T21:30:51.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f996d111640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:51.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f996d111640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f99680c96d0 con 0x7f99680c74c0 2026-02-17T21:30:51.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f996d111640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:51.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f996d111640 10 monclient(hunting): authenticate will time out at 1357.097273s 2026-02-17T21:30:51.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f9967577640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f996815d370 0x7f9968143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:51.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f9967577640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f996815d370 0x7f9968143a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48540/0 (socket says 10.20.193.5:48540) 2026-02-17T21:30:51.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f9967577640 1 -- 10.20.193.5:0/4265620001 learned_addr learned my addr 10.20.193.5:0/4265620001 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:51.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f9967577640 10 monclient(hunting): get_auth_request con 0x7f996815d370 auth_method 0 2026-02-17T21:30:51.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f9967577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:51.544 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f9967577640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:51.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f9967577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:51.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f9966d76640 1 --2- 10.20.193.5:0/4265620001 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f99680c74c0 0x7f9968073d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:51.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f9966575640 1 --2- 10.20.193.5:0/4265620001 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f99680c7e20 0x7f99681f1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:51.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f9967577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:51.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f9967577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:51.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f9967577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:51.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f9966d76640 10 monclient(hunting): get_auth_request con 0x7f99680c74c0 auth_method 0 2026-02-17T21:30:51.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f9966d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:51.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f9966d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:51.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f9966d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:51.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f9966575640 10 monclient(hunting): get_auth_request con 0x7f99680c7e20 auth_method 0 2026-02-17T21:30:51.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f9966575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:51.545 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f9966575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:51.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.531+0000 7f9966575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:51.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.532+0000 7f9966d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:51.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.532+0000 7f9966d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:51.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.532+0000 7f9966d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:51.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.532+0000 7f9966575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:51.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.532+0000 7f9966575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:51.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.532+0000 7f9966575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:51.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.533+0000 7f9967577640 10 monclient(hunting): handle_auth_done global_id 5310 payload 824 2026-02-17T21:30:51.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.533+0000 7f9967577640 1 -- 10.20.193.5:0/4265620001 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f99680c74c0 msgr2=0x7f9968073d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.533+0000 7f9967577640 1 --2- 10.20.193.5:0/4265620001 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f99680c74c0 0x7f9968073d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.546 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.533+0000 7f9967577640 1 -- 10.20.193.5:0/4265620001 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f99680c7e20 msgr2=0x7f99681f1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.533+0000 7f9967577640 1 --2- 10.20.193.5:0/4265620001 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f99680c7e20 0x7f99681f1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.533+0000 7f9967577640 10 monclient: _finish_hunting 0 2026-02-17T21:30:51.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.533+0000 7f9967577640 1 monclient: found mon.noname-a 2026-02-17T21:30:51.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.533+0000 7f9967577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:51.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.533+0000 7f9967577640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:30:51.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.533+0000 7f9967577640 1 -- 10.20.193.5:0/4265620001 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9968072a00 con 0x7f996815d370 2026-02-17T21:30:51.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.534+0000 7f9967577640 1 --2- 10.20.193.5:0/4265620001 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f996815d370 0x7f9968143a80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f995800cb40 tx=0x7f995800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:51.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.534+0000 7f99477fe640 10 client.?.objecter ms_handle_connect 0x7f996815d370 2026-02-17T21:30:51.547 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.534+0000 7f99477fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:51.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.535+0000 7f99477fe640 1 -- 10.20.193.5:0/4265620001 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995800ad50 con 0x7f996815d370 2026-02-17T21:30:51.549 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.535+0000 7f99477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:51.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.535+0000 7f99477fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:30:51.550 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.535+0000 7f99477fe640 10 monclient: dump: 2026-02-17T21:30:51.550 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:51.550 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:51.550 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.550 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.550 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:51.550 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:51.550 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:51.550 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:51.550 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:51.550 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:51.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.535+0000 7f99477fe640 10 monclient: _finish_auth 0 2026-02-17T21:30:51.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.535+0000 7f99477fe640 10 monclient: _check_auth_tickets 2026-02-17T21:30:51.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.535+0000 7f99477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:51.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.535+0000 7f99477fe640 1 -- 10.20.193.5:0/4265620001 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9958012400 con 0x7f996815d370 2026-02-17T21:30:51.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.535+0000 7f99477fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:51.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.535+0000 7f99477fe640 1 -- 10.20.193.5:0/4265620001 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99580127f0 con 0x7f996815d370 2026-02-17T21:30:51.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.535+0000 7f996d111640 5 monclient: authenticate success, global_id 5310 2026-02-17T21:30:51.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.535+0000 7f9965573640 4 set_mon_vals no callback set 2026-02-17T21:30:51.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.535+0000 7f996d111640 10 monclient: _renew_subs 2026-02-17T21:30:51.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.535+0000 7f996d111640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:51.551 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.535+0000 7f996d111640 1 -- 10.20.193.5:0/4265620001 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9968072ce0 con 0x7f996815d370 2026-02-17T21:30:51.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.535+0000 7f99477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:51.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.535+0000 7f99477fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:30:51.552 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.535+0000 7f99477fe640 10 monclient: dump: 2026-02-17T21:30:51.552 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:51.552 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:51.552 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.552 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.552 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:51.552 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:51.552 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:51.552 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:51.552 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:51.553 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:51.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.535+0000 7f996d111640 10 client.5310.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:51.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.535+0000 7f996d111640 10 monclient: _renew_subs 2026-02-17T21:30:51.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.535+0000 7f996d111640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:51.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.535+0000 7f996d111640 1 -- 10.20.193.5:0/4265620001 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99680732a0 con 0x7f996815d370 2026-02-17T21:30:51.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.535+0000 7f996d111640 1 librados: init done 2026-02-17T21:30:51.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.536+0000 7f996d111640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:51.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.536+0000 7f996d111640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:51.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.536+0000 7f996d111640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:30:51.553 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.536+0000 7f996d111640 1 -- 10.20.193.5:0/4265620001 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f996815d750 con 0x7f996815d370 2026-02-17T21:30:51.554 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.548+0000 7f99477fe640 1 -- 10.20.193.5:0/4265620001 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f9958012990 con 0x7f996815d370 2026-02-17T21:30:51.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.548+0000 7f99477fe640 1 --2- 10.20.193.5:0/4265620001 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f99340792d0 0x7f993407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:51.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.549+0000 7f9966d76640 1 --2- 10.20.193.5:0/4265620001 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f99340792d0 0x7f993407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:51.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.549+0000 7f9966d76640 10 monclient: get_auth_request con 0x7f99340792d0 auth_method 0 2026-02-17T21:30:51.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.549+0000 7f9966d76640 1 --2- 10.20.193.5:0/4265620001 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f99340792d0 0x7f993407b790 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f995c039000 tx=0x7f995c033000 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:51.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.549+0000 7f99477fe640 10 client.5310.objecter ms_handle_connect 0x7f99340792d0 2026-02-17T21:30:51.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.550+0000 7f99477fe640 1 -- 10.20.193.5:0/4265620001 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f995805ec30 con 0x7f996815d370 2026-02-17T21:30:51.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.550+0000 7f99477fe640 10 client.5310.objecter ms_dispatch2 0x7f9968000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:51.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.550+0000 7f99477fe640 3 client.5310.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:51.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.550+0000 7f99477fe640 3 client.5310.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:51.555 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.550+0000 7f99477fe640 20 client.5310.objecter dump_active .. 0 homeless 2026-02-17T21:30:51.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.652+0000 7f99477fe640 1 -- 10.20.193.5:0/4265620001 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9958062bf0 con 0x7f996815d370 2026-02-17T21:30:51.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.652+0000 7f99477fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:51.654 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.652+0000 7f99477fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:51.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.734+0000 7f996d111640 1 -- 10.20.193.5:0/4265620001 --> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "15", "target": ["mon-mgr", ""]}) -- 0x7f9968070e40 con 0x7f99340792d0 2026-02-17T21:30:51.737 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.734+0000 7f99477fe640 1 -- 10.20.193.5:0/4265620001 <== mgr.4131 v2:10.20.193.176:6800/2898618020 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 15 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7f9968070e40 con 0x7f99340792d0 2026-02-17T21:30:51.737 INFO:teuthology.orchestra.run.trial005.stderr:instructed osd(s) 15 to deep-scrub 2026-02-17T21:30:51.738 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.735+0000 7f996d111640 10 librados: watch_flush enter 2026-02-17T21:30:51.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.735+0000 7f996d111640 10 librados: watch_flush exit 2026-02-17T21:30:51.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.735+0000 7f996d111640 20 client.5310.objecter shutdown clearing up homeless session... 2026-02-17T21:30:51.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.735+0000 7f996d111640 10 client.5310.objecter successfully canceled tick 2026-02-17T21:30:51.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.735+0000 7f996d111640 1 -- 10.20.193.5:0/4265620001 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f99340792d0 msgr2=0x7f993407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.735+0000 7f996d111640 1 --2- 10.20.193.5:0/4265620001 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f99340792d0 0x7f993407b790 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f995c039000 tx=0x7f995c033000 comp rx=0 tx=0).stop 2026-02-17T21:30:51.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.735+0000 7f996d111640 10 monclient: shutdown 2026-02-17T21:30:51.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.735+0000 7f996d111640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:51.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.735+0000 7f996d111640 1 -- 10.20.193.5:0/4265620001 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f996815d370 msgr2=0x7f9968143a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.735+0000 7f996d111640 1 --2- 10.20.193.5:0/4265620001 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f996815d370 0x7f9968143a80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f995800cb40 tx=0x7f995800a430 comp rx=0 tx=0).stop 2026-02-17T21:30:51.739 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.735+0000 7f996d111640 1 -- 10.20.193.5:0/4265620001 shutdown_connections 2026-02-17T21:30:51.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.735+0000 7f996d111640 1 --2- 10.20.193.5:0/4265620001 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f99340792d0 0x7f993407b790 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.735+0000 7f996d111640 1 --2- 10.20.193.5:0/4265620001 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f996815d370 0x7f9968143a80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.735+0000 7f996d111640 1 --2- 10.20.193.5:0/4265620001 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f99680c7e20 0x7f99681f1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.735+0000 7f996d111640 1 --2- 10.20.193.5:0/4265620001 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f99680c74c0 0x7f9968073d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.735+0000 7f996d111640 1 -- 10.20.193.5:0/4265620001 >> 10.20.193.5:0/4265620001 conn(0x7f99680c9f20 msgr2=0x7f996815af00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:51.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.735+0000 7f996d111640 1 -- 10.20.193.5:0/4265620001 shutdown_connections 2026-02-17T21:30:51.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.735+0000 7f996d111640 1 -- 10.20.193.5:0/4265620001 wait complete. 2026-02-17T21:30:51.740 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.735+0000 7f996d111640 1 librados: shutdown 2026-02-17T21:30:51.747 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T21:30:51.813 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.811+0000 7f4cbc676640 10 monclient: get_monmap_and_config 2026-02-17T21:30:51.813 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.811+0000 7f4cbc676640 10 monclient: build_initial_monmap 2026-02-17T21:30:51.813 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.811+0000 7f4cbc676640 10 monclient: monmap: 2026-02-17T21:30:51.814 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:51.814 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:51.814 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:30:51.812917+0000 2026-02-17T21:30:51.814 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:30:51.812917+0000 2026-02-17T21:30:51.814 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:51.814 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:51.814 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:30:51.814 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:30:51.814 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:30:51.814 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:30:51.814 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:30:51.815 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:30:51.815 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:51.817 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.811+0000 7f4cbc676640 1 Processor -- start 2026-02-17T21:30:51.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.811+0000 7f4cbc676640 1 -- start start 2026-02-17T21:30:51.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.811+0000 7f4cbc676640 10 monclient: init 2026-02-17T21:30:51.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.812+0000 7f4cbc676640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:51.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.812+0000 7f4cbc676640 10 monclient: _add_conns ranks=[0,3,4,1,5,2] 2026-02-17T21:30:51.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.812+0000 7f4cbc676640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4cb40c7170 addr v1:10.20.193.5:6789/0 2026-02-17T21:30:51.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.812+0000 7f4cbc676640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f4cb40c7550 0x7f4cb40749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:51.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.812+0000 7f4cbc676640 10 monclient(hunting): picked mon.noname-a con 0x7f4cb40c7550 addr v2:10.20.193.5:3300/0 2026-02-17T21:30:51.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.812+0000 7f4cbc676640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f4cb4074ef0 0x7f4cb40c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:51.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.812+0000 7f4cbc676640 10 monclient(hunting): picked mon.noname-b con 0x7f4cb4074ef0 addr v2:10.20.193.119:3300/0 2026-02-17T21:30:51.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.812+0000 7f4cbc676640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cb40c4fd0 con 0x7f4cb40c7170 2026-02-17T21:30:51.818 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.812+0000 7f4cbc676640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:51.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.812+0000 7f4cbc676640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7f4cb40c8530 con 0x7f4cb40c7550 2026-02-17T21:30:51.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.812+0000 7f4cbc676640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:51.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.812+0000 7f4cbc676640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f4cb415a9a0 con 0x7f4cb4074ef0 2026-02-17T21:30:51.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.812+0000 7f4cbc676640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:51.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.812+0000 7f4cbc676640 10 monclient(hunting): authenticate will time out at 1357.378472s 2026-02-17T21:30:51.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.812+0000 7f4cb9bea640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f4cb40c7550 0x7f4cb40749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:51.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.812+0000 7f4cbabec640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f4cb4074ef0 0x7f4cb40c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:51.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.813+0000 7f4cb9bea640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7f4cb40c7550 0x7f4cb40749b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48546/0 (socket says 10.20.193.5:48546) 2026-02-17T21:30:51.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.813+0000 7f4cb9bea640 1 -- 10.20.193.5:0/1644687067 learned_addr learned my addr 10.20.193.5:0/1644687067 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:51.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.813+0000 7f4cb9bea640 10 monclient(hunting): get_auth_request con 0x7f4cb40c7550 auth_method 0 2026-02-17T21:30:51.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.813+0000 7f4cb9bea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:51.819 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.813+0000 7f4cb9bea640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:51.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.813+0000 7f4cb9bea640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:51.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.813+0000 7f4cbabec640 10 monclient(hunting): get_auth_request con 0x7f4cb4074ef0 auth_method 0 2026-02-17T21:30:51.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.813+0000 7f4cbabec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:51.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.813+0000 7f4cbabec640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:51.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.813+0000 7f4cbabec640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:51.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.813+0000 7f4cbabec640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:51.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.813+0000 7f4cbabec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:51.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.813+0000 7f4cbabec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:51.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.813+0000 7f4cb9bea640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:51.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.813+0000 7f4cb9bea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:51.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.813+0000 7f4cb9bea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:51.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.814+0000 7f4cbabec640 10 monclient(hunting): handle_auth_done global_id 5374 payload 274 2026-02-17T21:30:51.820 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.814+0000 7f4cbabec640 1 -- 10.20.193.5:0/1644687067 >> v2:10.20.193.5:3300/0 conn(0x7f4cb40c7550 msgr2=0x7f4cb40749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:30:51.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.814+0000 7f4cbabec640 1 --2- 10.20.193.5:0/1644687067 >> v2:10.20.193.5:3300/0 conn(0x7f4cb40c7550 0x7f4cb40749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.814+0000 7f4cbabec640 1 -- 10.20.193.5:0/1644687067 >> v1:10.20.193.5:6789/0 conn(0x7f4cb40c7170 legacy=0x7f4cb40c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.814+0000 7f4cbabec640 10 monclient: _finish_hunting 0 2026-02-17T21:30:51.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.814+0000 7f4cbabec640 1 monclient: found mon.noname-b 2026-02-17T21:30:51.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.814+0000 7f4cbabec640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:51.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.814+0000 7f4cbabec640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:30:51.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.814+0000 7f4cbabec640 1 -- 10.20.193.5:0/1644687067 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb40c5270 con 0x7f4cb4074ef0 2026-02-17T21:30:51.821 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.815+0000 7f4cbabec640 1 --2- 10.20.193.5:0/1644687067 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4cb4074ef0 0x7f4cb40c89c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4cb40c84a0 tx=0x7f4cb002f1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2071702f6d331f29 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:51.827 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cb93e9640 1 -- 10.20.193.5:0/1644687067 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb003c070 con 0x7f4cb4074ef0 2026-02-17T21:30:51.827 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cb93e9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:51.827 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cb93e9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:30:51.827 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cb93e9640 10 monclient: dump: 2026-02-17T21:30:51.827 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:51.827 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:51.828 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.828 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.828 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:51.828 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:51.828 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:51.828 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:51.828 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:51.828 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:51.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cb93e9640 10 monclient: _finish_auth 0 2026-02-17T21:30:51.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cb93e9640 10 monclient: _check_auth_tickets 2026-02-17T21:30:51.828 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cb93e9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:51.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cb93e9640 1 -- 10.20.193.5:0/1644687067 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb0037440 con 0x7f4cb4074ef0 2026-02-17T21:30:51.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cb93e9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:51.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cbc676640 5 monclient: authenticate success, global_id 5374 2026-02-17T21:30:51.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cb93e9640 1 -- 10.20.193.5:0/1644687067 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0037810 con 0x7f4cb4074ef0 2026-02-17T21:30:51.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cbc676640 10 monclient: get_monmap_and_config success 2026-02-17T21:30:51.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cb93e9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:51.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cbc676640 4 set_mon_vals no callback set 2026-02-17T21:30:51.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cb93e9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:30:51.829 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cb93e9640 10 monclient: dump: 2026-02-17T21:30:51.829 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:51.829 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:51.829 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.829 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.830 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:51.830 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:51.830 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:51.830 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:51.830 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:51.830 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:51.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cbc676640 10 monclient: shutdown 2026-02-17T21:30:51.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cbc676640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:51.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cbc676640 1 -- 10.20.193.5:0/1644687067 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4cb4074ef0 msgr2=0x7f4cb40c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cbc676640 1 --2- 10.20.193.5:0/1644687067 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4cb4074ef0 0x7f4cb40c89c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4cb40c84a0 tx=0x7f4cb002f1c0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cbc676640 1 -- 10.20.193.5:0/1644687067 shutdown_connections 2026-02-17T21:30:51.830 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cbc676640 1 --2- 10.20.193.5:0/1644687067 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4cb4074ef0 0x7f4cb40c89c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cbc676640 1 --2- 10.20.193.5:0/1644687067 >> v2:10.20.193.5:3300/0 conn(0x7f4cb40c7550 0x7f4cb40749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cbc676640 1 -- 10.20.193.5:0/1644687067 >> 10.20.193.5:0/1644687067 conn(0x7f4cb40c9f40 msgr2=0x7f4cb40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:51.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cbc676640 1 -- 10.20.193.5:0/1644687067 shutdown_connections 2026-02-17T21:30:51.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.817+0000 7f4cbc676640 1 -- 10.20.193.5:0/1644687067 wait complete. 2026-02-17T21:30:51.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.818+0000 7f4cbc676640 10 monclient: build_initial_monmap 2026-02-17T21:30:51.831 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.818+0000 7f4cbc676640 10 monclient: monmap: 2026-02-17T21:30:51.831 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:30:51.831 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:30:51.831 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:30:51.831 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:30:51.831 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:30:51.831 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:51.831 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:30:51.832 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:30:51.832 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:30:51.832 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:51.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.818+0000 7f4cbc676640 1 librados: starting msgr at 2026-02-17T21:30:51.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.818+0000 7f4cbc676640 1 librados: starting objecter 2026-02-17T21:30:51.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.818+0000 7f4cbc676640 1 Processor -- start 2026-02-17T21:30:51.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.818+0000 7f4cbc676640 1 -- start start 2026-02-17T21:30:51.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.818+0000 7f4cbc676640 1 librados: setting wanted keys 2026-02-17T21:30:51.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.818+0000 7f4cbc676640 1 librados: calling monclient init 2026-02-17T21:30:51.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.818+0000 7f4cbc676640 10 monclient: init 2026-02-17T21:30:51.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.818+0000 7f4cbc676640 10 monclient: _reopen_session rank -1 2026-02-17T21:30:51.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.818+0000 7f4cbc676640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:30:51.832 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.818+0000 7f4cbc676640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f4cb4074ef0 0x7f4cb41556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:51.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.818+0000 7f4cbc676640 10 monclient(hunting): picked mon.noname-a con 0x7f4cb4074ef0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:30:51.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.818+0000 7f4cbc676640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f4cb40c7170 0x7f4cb4156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:51.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.818+0000 7f4cbc676640 10 monclient(hunting): picked mon.noname-c con 0x7f4cb40c7170 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:30:51.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.818+0000 7f4cbc676640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4cb40c7550 0x7f4cb41f6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:51.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.818+0000 7f4cbc676640 10 monclient(hunting): picked mon.noname-b con 0x7f4cb40c7550 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:30:51.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.818+0000 7f4cbc676640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:51.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.818+0000 7f4cbc676640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb40c7ee0 con 0x7f4cb4074ef0 2026-02-17T21:30:51.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.818+0000 7f4cbc676640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:51.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.818+0000 7f4cbc676640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb40c5830 con 0x7f4cb40c7550 2026-02-17T21:30:51.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.818+0000 7f4cbc676640 10 monclient(hunting): start opening mon connection 2026-02-17T21:30:51.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.818+0000 7f4cbc676640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb40c81c0 con 0x7f4cb40c7170 2026-02-17T21:30:51.833 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.818+0000 7f4cbc676640 10 monclient(hunting): _renew_subs 2026-02-17T21:30:51.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.818+0000 7f4cbc676640 10 monclient(hunting): authenticate will time out at 1357.384880s 2026-02-17T21:30:51.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cba3eb640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f4cb4074ef0 0x7f4cb41556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:51.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cbabec640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4cb40c7550 0x7f4cb41f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:51.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cb9bea640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f4cb40c7170 0x7f4cb4156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:51.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cba3eb640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f4cb4074ef0 0x7f4cb41556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:48552/0 (socket says 10.20.193.5:48552) 2026-02-17T21:30:51.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cba3eb640 1 -- 10.20.193.5:0/921865512 learned_addr learned my addr 10.20.193.5:0/921865512 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:30:51.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cba3eb640 10 monclient(hunting): get_auth_request con 0x7f4cb4074ef0 auth_method 0 2026-02-17T21:30:51.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cba3eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:51.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cba3eb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:51.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cba3eb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:51.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cbabec640 10 monclient(hunting): get_auth_request con 0x7f4cb40c7550 auth_method 0 2026-02-17T21:30:51.834 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cbabec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:51.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cbabec640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:51.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cbabec640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:51.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cb9bea640 10 monclient(hunting): get_auth_request con 0x7f4cb40c7170 auth_method 0 2026-02-17T21:30:51.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cb9bea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:30:51.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cb9bea640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:30:51.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cb9bea640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:30:51.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cbabec640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:51.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cbabec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:51.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cbabec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:51.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cba3eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:51.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cba3eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:51.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cba3eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:51.835 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cb9bea640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:30:51.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cb9bea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:30:51.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.819+0000 7f4cb9bea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:30:51.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.820+0000 7f4cbabec640 10 monclient(hunting): handle_auth_done global_id 5377 payload 824 2026-02-17T21:30:51.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.820+0000 7f4cbabec640 1 -- 10.20.193.5:0/921865512 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f4cb40c7170 msgr2=0x7f4cb4156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.820+0000 7f4cbabec640 1 --2- 10.20.193.5:0/921865512 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f4cb40c7170 0x7f4cb4156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.820+0000 7f4cbabec640 1 -- 10.20.193.5:0/921865512 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f4cb4074ef0 msgr2=0x7f4cb41556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:51.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.820+0000 7f4cbabec640 1 --2- 10.20.193.5:0/921865512 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f4cb4074ef0 0x7f4cb41556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:51.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.820+0000 7f4cbabec640 10 monclient: _finish_hunting 0 2026-02-17T21:30:51.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.820+0000 7f4cbabec640 1 monclient: found mon.noname-b 2026-02-17T21:30:51.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.820+0000 7f4cbabec640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:30:51.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.820+0000 7f4cbabec640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:30:51.836 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.820+0000 7f4cbabec640 1 -- 10.20.193.5:0/921865512 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb4154320 con 0x7f4cb40c7550 2026-02-17T21:30:51.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.821+0000 7f4cbabec640 1 --2- 10.20.193.5:0/921865512 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4cb40c7550 0x7f4cb41f6340 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0036000 tx=0x7f4cb0004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:51.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.821+0000 7f4c9affd640 10 client.?.objecter ms_handle_connect 0x7f4cb40c7550 2026-02-17T21:30:51.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.821+0000 7f4c9affd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:30:51.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.823+0000 7f4c9affd640 1 -- 10.20.193.5:0/921865512 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb003c050 con 0x7f4cb40c7550 2026-02-17T21:30:51.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.823+0000 7f4c9affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:51.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.823+0000 7f4c9affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:30:51.837 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.823+0000 7f4c9affd640 10 monclient: dump: 2026-02-17T21:30:51.837 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:51.837 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:51.837 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.837 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.837 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:51.838 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:51.838 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:51.838 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:51.838 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:51.838 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:51.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.823+0000 7f4c9affd640 10 monclient: _finish_auth 0 2026-02-17T21:30:51.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.823+0000 7f4c9affd640 10 monclient: _check_auth_tickets 2026-02-17T21:30:51.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.823+0000 7f4c9affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:30:51.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.823+0000 7f4c9affd640 1 -- 10.20.193.5:0/921865512 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb0048070 con 0x7f4cb40c7550 2026-02-17T21:30:51.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.823+0000 7f4c9affd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:30:51.838 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.823+0000 7f4c9affd640 1 -- 10.20.193.5:0/921865512 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0041a70 con 0x7f4cb40c7550 2026-02-17T21:30:51.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.823+0000 7f4c9affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:30:51.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.823+0000 7f4c9affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:30:51.839 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.823+0000 7f4c9affd640 10 monclient: dump: 2026-02-17T21:30:51.839 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:30:51.839 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:30:51.839 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.839 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:30:51.839 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:30:51.839 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:30:51.839 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:30:51.839 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:30:51.840 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:30:51.840 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:30:51.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.823+0000 7f4cb8be8640 4 set_mon_vals no callback set 2026-02-17T21:30:51.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.823+0000 7f4cbc676640 5 monclient: authenticate success, global_id 5377 2026-02-17T21:30:51.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.823+0000 7f4cbc676640 10 monclient: _renew_subs 2026-02-17T21:30:51.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.823+0000 7f4cbc676640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:51.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.823+0000 7f4cbc676640 1 -- 10.20.193.5:0/921865512 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb4154600 con 0x7f4cb40c7550 2026-02-17T21:30:51.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.823+0000 7f4cbc676640 10 client.5377.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:30:51.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.823+0000 7f4cbc676640 10 monclient: _renew_subs 2026-02-17T21:30:51.840 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.823+0000 7f4cbc676640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:51.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.823+0000 7f4cbc676640 1 -- 10.20.193.5:0/921865512 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb4154bc0 con 0x7f4cb40c7550 2026-02-17T21:30:51.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.823+0000 7f4cbc676640 1 librados: init done 2026-02-17T21:30:51.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.824+0000 7f4cbc676640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:51.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.824+0000 7f4cbc676640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:51.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.824+0000 7f4cbc676640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:30:51.841 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.824+0000 7f4cbc676640 1 -- 10.20.193.5:0/921865512 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cb4072b50 con 0x7f4cb40c7550 2026-02-17T21:30:51.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.835+0000 7f4c9affd640 1 -- 10.20.193.5:0/921865512 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f4cb0041c10 con 0x7f4cb40c7550 2026-02-17T21:30:51.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.836+0000 7f4c9affd640 1 --2- 10.20.193.5:0/921865512 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4c840792d0 0x7f4c8407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:30:51.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.836+0000 7f4cba3eb640 1 --2- 10.20.193.5:0/921865512 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4c840792d0 0x7f4c8407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:30:51.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.836+0000 7f4cba3eb640 10 monclient: get_auth_request con 0x7f4c840792d0 auth_method 0 2026-02-17T21:30:51.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.836+0000 7f4cba3eb640 1 --2- 10.20.193.5:0/921865512 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4c840792d0 0x7f4c8407b790 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4ca40055d0 tx=0x7f4ca4002990 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:30:51.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.836+0000 7f4c9affd640 10 client.5377.objecter ms_handle_connect 0x7f4c840792d0 2026-02-17T21:30:51.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.837+0000 7f4c9affd640 1 -- 10.20.193.5:0/921865512 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f4cb0084780 con 0x7f4cb40c7550 2026-02-17T21:30:51.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.837+0000 7f4c9affd640 10 client.5377.objecter ms_dispatch2 0x7f4cb4000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:30:51.843 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.837+0000 7f4c9affd640 3 client.5377.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:30:51.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.837+0000 7f4c9affd640 3 client.5377.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:30:51.844 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.837+0000 7f4c9affd640 20 client.5377.objecter dump_active .. 0 homeless 2026-02-17T21:30:51.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.938+0000 7f4c9affd640 1 -- 10.20.193.5:0/921865512 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4cb00ee9f0 con 0x7f4cb40c7550 2026-02-17T21:30:51.940 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.938+0000 7f4c9affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:30:51.941 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:51.938+0000 7f4c9affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:30:52.022 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:52.020+0000 7f4cbc676640 1 -- 10.20.193.5:0/921865512 --> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4cb4076dc0 con 0x7f4c840792d0 2026-02-17T21:30:52.023 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:52.021+0000 7f4c9affd640 1 -- 10.20.193.5:0/921865512 <== mgr.4131 v2:10.20.193.176:6800/2898618020 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+43983 (secure 0 0 0) 0x7f4cb4076dc0 con 0x7f4c840792d0 2026-02-17T21:30:52.024 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:30:52.025 INFO:teuthology.orchestra.run.trial005.stderr:dumped all 2026-02-17T21:30:52.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:52.021+0000 7f4cbc676640 10 librados: watch_flush enter 2026-02-17T21:30:52.025 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:52.021+0000 7f4cbc676640 10 librados: watch_flush exit 2026-02-17T21:30:52.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:52.021+0000 7f4cbc676640 20 client.5377.objecter shutdown clearing up homeless session... 2026-02-17T21:30:52.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:52.021+0000 7f4cbc676640 10 client.5377.objecter successfully canceled tick 2026-02-17T21:30:52.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:52.021+0000 7f4cbc676640 1 -- 10.20.193.5:0/921865512 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4c840792d0 msgr2=0x7f4c8407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:52.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:52.021+0000 7f4cbc676640 1 --2- 10.20.193.5:0/921865512 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4c840792d0 0x7f4c8407b790 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4ca40055d0 tx=0x7f4ca4002990 comp rx=0 tx=0).stop 2026-02-17T21:30:52.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:52.021+0000 7f4cbc676640 10 monclient: shutdown 2026-02-17T21:30:52.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:52.021+0000 7f4cbc676640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:30:52.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:52.021+0000 7f4cbc676640 1 -- 10.20.193.5:0/921865512 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4cb40c7550 msgr2=0x7f4cb41f6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:30:52.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:52.021+0000 7f4cbc676640 1 --2- 10.20.193.5:0/921865512 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4cb40c7550 0x7f4cb41f6340 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0036000 tx=0x7f4cb0004b40 comp rx=0 tx=0).stop 2026-02-17T21:30:52.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:52.022+0000 7f4cbc676640 1 -- 10.20.193.5:0/921865512 shutdown_connections 2026-02-17T21:30:52.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:52.022+0000 7f4cbc676640 1 --2- 10.20.193.5:0/921865512 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f4c840792d0 0x7f4c8407b790 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:52.026 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:52.022+0000 7f4cbc676640 1 --2- 10.20.193.5:0/921865512 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4cb40c7550 0x7f4cb41f6340 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:52.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:52.022+0000 7f4cbc676640 1 --2- 10.20.193.5:0/921865512 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f4cb40c7170 0x7f4cb4156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:52.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:52.022+0000 7f4cbc676640 1 --2- 10.20.193.5:0/921865512 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f4cb4074ef0 0x7f4cb41556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:30:52.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:52.022+0000 7f4cbc676640 1 -- 10.20.193.5:0/921865512 >> 10.20.193.5:0/921865512 conn(0x7f4cb40c9f40 msgr2=0x7f4cb4153310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:30:52.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:52.022+0000 7f4cbc676640 1 -- 10.20.193.5:0/921865512 shutdown_connections 2026-02-17T21:30:52.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:52.022+0000 7f4cbc676640 1 -- 10.20.193.5:0/921865512 wait complete. 2026-02-17T21:30:52.027 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:30:52.022+0000 7f4cbc676640 1 librados: shutdown 2026-02-17T21:30:52.032 INFO:teuthology.orchestra.run.trial005.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2026-02-17T21:30:51.564113+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":10,"kb":1509949440,"kb_used":438148,"kb_used_data":6744,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511292,"statfs":{"total":1546188226560,"available":1545739563008,"internally_reserved":0,"allocated":6905856,"data_stored":3428134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25504,"internal_metadata":441424992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":139,"apply_latency_ms":139,"commit_latency_ns":139000000,"apply_latency_ns":139000000},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001860"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:27:45.672446+0000","last_change":"2026-02-17T21:25:34.688050+0000","last_active":"2026-02-17T21:27:45.672446+0000","last_peered":"2026-02-17T21:27:45.672446+0000","last_clean":"2026-02-17T21:27:45.672446+0000","last_became_active":"2026-02-17T21:25:32.292871+0000","last_became_peered":"2026-02-17T21:25:32.292871+0000","last_unstale":"2026-02-17T21:27:45.672446+0000","last_undegraded":"2026-02-17T21:27:45.672446+0000","last_fullsized":"2026-02-17T21:27:45.672446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T01:55:40.877834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038010112999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:30:48.214570+0000","last_change":"2026-02-17T21:30:48.217454+0000","last_active":"2026-02-17T21:30:48.214570+0000","last_peered":"2026-02-17T21:30:48.214570+0000","last_clean":"2026-02-17T21:30:48.214570+0000","last_became_active":"2026-02-17T21:25:31.984749+0000","last_became_peered":"2026-02-17T21:25:31.984749+0000","last_unstale":"2026-02-17T21:30:48.214570+0000","last_undegraded":"2026-02-17T21:30:48.214570+0000","last_fullsized":"2026-02-17T21:30:48.214570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:30:48.210993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:30:48.210993+0000","last_clean_scrub_stamp":"2026-02-17T21:30:48.210993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T07:02:30.793910+0000","scrub_duration":213,"objects_trimmed":0,"snaptrim_duration":0.037066832000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:30:49.433863+0000","last_change":"2026-02-17T21:30:49.436566+0000","last_active":"2026-02-17T21:30:49.433863+0000","last_peered":"2026-02-17T21:30:49.433863+0000","last_clean":"2026-02-17T21:30:49.433863+0000","last_became_active":"2026-02-17T21:25:32.229048+0000","last_became_peered":"2026-02-17T21:25:32.229048+0000","last_unstale":"2026-02-17T21:30:49.433863+0000","last_undegraded":"2026-02-17T21:30:49.433863+0000","last_fullsized":"2026-02-17T21:30:49.433863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:30:49.431055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:30:49.431055+0000","last_clean_scrub_stamp":"2026-02-17T21:30:49.431055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:29:20.145598+0000","scrub_duration":158,"objects_trimmed":0,"snaptrim_duration":0.041957774000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:30:48.230974+0000","last_change":"2026-02-17T21:30:48.236009+0000","last_active":"2026-02-17T21:30:48.230974+0000","last_peered":"2026-02-17T21:30:48.230974+0000","last_clean":"2026-02-17T21:30:48.230974+0000","last_became_active":"2026-02-17T21:25:32.009122+0000","last_became_peered":"2026-02-17T21:25:32.009122+0000","last_unstale":"2026-02-17T21:30:48.230974+0000","last_undegraded":"2026-02-17T21:30:48.230974+0000","last_fullsized":"2026-02-17T21:30:48.230974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:30:48.225994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:30:48.225994+0000","last_clean_scrub_stamp":"2026-02-17T21:30:48.225994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T04:46:07.516541+0000","scrub_duration":159,"objects_trimmed":0,"snaptrim_duration":0.032898110000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"34'2","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:29:45.514227+0000","last_change":"2026-02-17T21:25:34.887379+0000","last_active":"2026-02-17T21:29:45.514227+0000","last_peered":"2026-02-17T21:29:45.514227+0000","last_clean":"2026-02-17T21:29:45.514227+0000","last_became_active":"2026-02-17T21:25:32.016451+0000","last_became_peered":"2026-02-17T21:25:32.016451+0000","last_unstale":"2026-02-17T21:29:45.514227+0000","last_undegraded":"2026-02-17T21:29:45.514227+0000","last_fullsized":"2026-02-17T21:29:45.514227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046646930000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:30:48.012018+0000","last_change":"2026-02-17T21:30:48.012379+0000","last_active":"2026-02-17T21:30:48.012018+0000","last_peered":"2026-02-17T21:30:48.012018+0000","last_clean":"2026-02-17T21:30:48.012018+0000","last_became_active":"2026-02-17T21:25:31.944529+0000","last_became_peered":"2026-02-17T21:25:31.944529+0000","last_unstale":"2026-02-17T21:30:48.012018+0000","last_undegraded":"2026-02-17T21:30:48.012018+0000","last_fullsized":"2026-02-17T21:30:48.012018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:30:48.010115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:30:48.010115+0000","last_clean_scrub_stamp":"2026-02-17T21:30:48.010115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T05:51:33.406887+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0.030826864999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:29:35.509847+0000","last_change":"2026-02-17T21:25:34.893210+0000","last_active":"2026-02-17T21:29:35.509847+0000","last_peered":"2026-02-17T21:29:35.509847+0000","last_clean":"2026-02-17T21:29:35.509847+0000","last_became_active":"2026-02-17T21:25:31.969947+0000","last_became_peered":"2026-02-17T21:25:31.969947+0000","last_unstale":"2026-02-17T21:29:35.509847+0000","last_undegraded":"2026-02-17T21:29:35.509847+0000","last_fullsized":"2026-02-17T21:29:35.509847+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:25:30.742114+0000","last_clean_scrub_stamp":"2026-02-17T21:25:30.742114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063724551000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"35'2","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:30:46.537284+0000","last_change":"2026-02-17T21:30:46.542427+0000","last_active":"2026-02-17T21:30:46.537284+0000","last_peered":"2026-02-17T21:30:46.537284+0000","last_clean":"2026-02-17T21:30:46.537284+0000","last_became_active":"2026-02-17T21:25:31.956011+0000","last_became_peered":"2026-02-17T21:25:31.956011+0000","last_unstale":"2026-02-17T21:30:46.537284+0000","last_undegraded":"2026-02-17T21:30:46.537284+0000","last_fullsized":"2026-02-17T21:30:46.537284+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2026-02-17T21:30:46.534376+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2026-02-17T21:30:46.534376+0000","last_clean_scrub_stamp":"2026-02-17T21:30:46.534376+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T04:36:01.174953+0000","scrub_duration":276,"objects_trimmed":0,"snaptrim_duration":0.036103899000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,15],"acting":[4,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"35'34","reported_seq":79,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:30:47.200305+0000","last_change":"2026-02-17T21:30:47.205614+0000","last_active":"2026-02-17T21:30:47.200305+0000","last_peered":"2026-02-17T21:30:47.200305+0000","last_clean":"2026-02-17T21:30:47.200305+0000","last_became_active":"2026-02-17T21:25:26.779982+0000","last_became_peered":"2026-02-17T21:25:26.779982+0000","last_unstale":"2026-02-17T21:30:47.200305+0000","last_undegraded":"2026-02-17T21:30:47.200305+0000","last_fullsized":"2026-02-17T21:30:47.200305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'34","last_scrub_stamp":"2026-02-17T21:30:47.196928+0000","last_deep_scrub":"35'34","last_deep_scrub_stamp":"2026-02-17T21:30:47.196928+0000","last_clean_scrub_stamp":"2026-02-17T21:30:47.196928+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:22:52.504376+0000","scrub_duration":268,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":16,"acting":16,"num_store_stats":9},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":28,"seq":120259084359,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[" osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":28,"seq":120259084358,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27589058},"hb_peers":[0,1,3,4,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":28,"seq":120259084358,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":782336,"data_stored":562366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[2,4,5,6,7,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":22,"seq":94489280580,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[" osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":24,"seq":103079215172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,4,5,6,7,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":5,"up_from":22,"seq":94489280581,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,4,6,7,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27589068},"hb_peers":[3,4,5,6,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":23,"seq":98784247877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27589061},"hb_peers":[0,2,5,6,7,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":24,"seq":103079215171,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,5,6,7,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":26,"seq":111669149765,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,4,5,6,7,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":12,"up_from":24,"seq":103079215173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,5,6,7,9,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":26,"seq":111669149768,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":164545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[3,5,6,7,8,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117064,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":385024,"data_stored":164545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[2,4,5,6,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":27,"seq":115964117064,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,4,5,7,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[]},{"osd":2,"up_from":28,"seq":120259084359,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":782336,"data_stored":562366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,4,5,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084359,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T21:30:52.039 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-17T21:25:30.742114+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=21, tm_min=25, tm_sec=30, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=21, tm_min=30, tm_sec=43, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T21:30:52.039 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-17T21:25:30.742114+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=21, tm_min=25, tm_sec=30, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=21, tm_min=30, tm_sec=43, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T21:30:52.039 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-17T21:25:30.742114+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=21, tm_min=25, tm_sec=30, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=21, tm_min=30, tm_sec=43, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T21:30:52.039 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-17T21:30:57.729 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:07:37.355 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:57.757 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:07:37.343 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:57.758 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:07:37.344 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:57.758 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:07:37.384 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:57.758 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:07:37.382 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:57.760 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:07:37.384 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:57.767 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:07:37.353 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:57.768 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:07:37.392 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:30:57.769 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:07:37.394 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:12.040 DEBUG:teuthology.orchestra.run.trial005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T21:31:12.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.108+0000 7f6cf1dd3640 10 monclient: get_monmap_and_config 2026-02-17T21:31:12.109 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.108+0000 7f6cf1dd3640 10 monclient: build_initial_monmap 2026-02-17T21:31:12.110 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.108+0000 7f6cf1dd3640 10 monclient: monmap: 2026-02-17T21:31:12.110 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:31:12.110 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:31:12.110 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:31:12.109056+0000 2026-02-17T21:31:12.110 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:31:12.109056+0000 2026-02-17T21:31:12.110 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:31:12.110 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:31:12.110 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:31:12.110 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:31:12.111 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:31:12.111 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:31:12.111 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:31:12.111 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:31:12.111 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:31:12.114 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.108+0000 7f6cf1dd3640 1 Processor -- start 2026-02-17T21:31:12.114 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.108+0000 7f6cf1dd3640 1 -- start start 2026-02-17T21:31:12.114 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.108+0000 7f6cf1dd3640 10 monclient: init 2026-02-17T21:31:12.114 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.109+0000 7f6cf1dd3640 10 monclient: _reopen_session rank -1 2026-02-17T21:31:12.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.109+0000 7f6cf1dd3640 10 monclient: _add_conns ranks=[2,4,5,1,3,0] 2026-02-17T21:31:12.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.109+0000 7f6cf1dd3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6cec155fb0 addr v1:10.20.193.135:6789/0 2026-02-17T21:31:12.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.109+0000 7f6cf1dd3640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f6cec06e5b0 0x7f6cec0ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:31:12.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.109+0000 7f6cf1dd3640 10 monclient(hunting): picked mon.noname-b con 0x7f6cec06e5b0 addr v2:10.20.193.119:3300/0 2026-02-17T21:31:12.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.109+0000 7f6cf1dd3640 1 --2- >> v2:10.20.193.135:3300/0 conn(0x7f6cec0ce8d0 0x7f6cec15f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:31:12.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.109+0000 7f6cf1dd3640 10 monclient(hunting): picked mon.noname-c con 0x7f6cec0ce8d0 addr v2:10.20.193.135:3300/0 2026-02-17T21:31:12.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.109+0000 7f6cf1dd3640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cec0ced00 con 0x7f6cec155fb0 2026-02-17T21:31:12.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.109+0000 7f6cf1dd3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:31:12.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.109+0000 7f6cf1dd3640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f6cec0cb950 con 0x7f6cec06e5b0 2026-02-17T21:31:12.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.109+0000 7f6cf1dd3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:31:12.115 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.109+0000 7f6cf1dd3640 1 -- --> v2:10.20.193.135:3300/0 -- mon_getmap magic: 0 -- 0x7f6cec0cbc30 con 0x7f6cec0ce8d0 2026-02-17T21:31:12.116 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.109+0000 7f6cf1dd3640 10 monclient(hunting): _renew_subs 2026-02-17T21:31:12.116 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.109+0000 7f6cf1dd3640 10 monclient(hunting): authenticate will time out at 1377.674455s 2026-02-17T21:31:12.116 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.109+0000 7f6ceaffd640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f6cec06e5b0 0x7f6cec0ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:31:12.116 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.110+0000 7f6ceb7fe640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7f6cec155fb0 0x7f6cec0cd610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:54764/0 (socket says 10.20.193.5:54764) 2026-02-17T21:31:12.116 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.110+0000 7f6ceb7fe640 1 -- 10.20.193.5:0/248152470 learned_addr learned my addr 10.20.193.5:0/248152470 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:31:12.116 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.110+0000 7f6ceaffd640 10 monclient(hunting): get_auth_request con 0x7f6cec06e5b0 auth_method 0 2026-02-17T21:31:12.116 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.110+0000 7f6ceaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:31:12.116 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.110+0000 7f6ceaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:31:12.116 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.110+0000 7f6ceaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:31:12.116 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.110+0000 7f6ceaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:31:12.116 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.110+0000 7f6ceaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:31:12.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.110+0000 7f6cebfff640 1 --2- 10.20.193.5:0/248152470 >> v2:10.20.193.135:3300/0 conn(0x7f6cec0ce8d0 0x7f6cec15f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:31:12.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.110+0000 7f6ceaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:31:12.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.110+0000 7f6ceb7fe640 1 -- 10.20.193.5:0/248152470 >> v1:10.20.193.135:6789/0 conn(0x7f6cec155fb0 legacy=0x7f6cec0cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-17T21:31:12.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.110+0000 7f6ceb7fe640 1 -- 10.20.193.5:0/248152470 >> v1:10.20.193.135:6789/0 conn(0x7f6cec155fb0 legacy=0x7f6cec0cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T21:31:12.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.110+0000 7f6ceb7fe640 1 --1- 10.20.193.5:0/248152470 >> v1:10.20.193.135:6789/0 conn(0x7f6cec155fb0 0x7f6cec0cd610 :-1 s=OPENED pgs=299 cs=1 l=1).handle_message read tag failed 2026-02-17T21:31:12.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.110+0000 7f6ceb7fe640 1 --1- 10.20.193.5:0/248152470 >> v1:10.20.193.135:6789/0 conn(0x7f6cec155fb0 0x7f6cec0cd610 :-1 s=OPENED pgs=299 cs=1 l=1).fault on lossy channel, failing 2026-02-17T21:31:12.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.110+0000 7f6cea7fc640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.135:6789/0 2026-02-17T21:31:12.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.111+0000 7f6cebfff640 10 monclient(hunting): get_auth_request con 0x7f6cec0ce8d0 auth_method 0 2026-02-17T21:31:12.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.111+0000 7f6cebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:31:12.117 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.111+0000 7f6cebfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:31:12.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.111+0000 7f6cebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:31:12.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.111+0000 7f6ceaffd640 10 monclient(hunting): handle_auth_done global_id 5380 payload 274 2026-02-17T21:31:12.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.111+0000 7f6ceaffd640 1 -- 10.20.193.5:0/248152470 >> v2:10.20.193.135:3300/0 conn(0x7f6cec0ce8d0 msgr2=0x7f6cec15f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:31:12.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.111+0000 7f6ceaffd640 1 --2- 10.20.193.5:0/248152470 >> v2:10.20.193.135:3300/0 conn(0x7f6cec0ce8d0 0x7f6cec15f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:31:12.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.111+0000 7f6ceaffd640 1 -- 10.20.193.5:0/248152470 >> v1:10.20.193.135:6789/0 conn(0x7f6cec155fb0 legacy=0x7f6cec0cd610 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T21:31:12.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.111+0000 7f6ceaffd640 10 monclient: _finish_hunting 0 2026-02-17T21:31:12.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.111+0000 7f6ceaffd640 1 monclient: found mon.noname-b 2026-02-17T21:31:12.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.111+0000 7f6ceaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:31:12.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.111+0000 7f6ceaffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:31:12.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.111+0000 7f6ceaffd640 1 -- 10.20.193.5:0/248152470 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cec0ccd60 con 0x7f6cec06e5b0 2026-02-17T21:31:12.118 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.112+0000 7f6ceaffd640 1 --2- 10.20.193.5:0/248152470 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6cec06e5b0 0x7f6cec0ce390 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6cec074110 tx=0x7f6cdc02ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fac5cf40b63fff28 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:31:12.126 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cea7fc640 1 -- 10.20.193.5:0/248152470 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc03c070 con 0x7f6cec06e5b0 2026-02-17T21:31:12.126 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:31:12.126 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cea7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:31:12.126 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cea7fc640 10 monclient: dump: 2026-02-17T21:31:12.127 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:31:12.127 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:31:12.127 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:31:12.127 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:31:12.127 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:31:12.127 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:31:12.127 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:31:12.127 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:31:12.127 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:31:12.127 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:31:12.127 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cea7fc640 10 monclient: _finish_auth 0 2026-02-17T21:31:12.128 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cea7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:31:12.128 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:31:12.128 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cea7fc640 1 -- 10.20.193.5:0/248152470 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cdc02fa40 con 0x7f6cec06e5b0 2026-02-17T21:31:12.128 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cf1dd3640 5 monclient: authenticate success, global_id 5380 2026-02-17T21:31:12.128 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cf1dd3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:31:12.128 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cea7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:31:12.128 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cf1dd3640 10 monclient: get_monmap_and_config success 2026-02-17T21:31:12.128 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cf1dd3640 4 set_mon_vals no callback set 2026-02-17T21:31:12.128 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cea7fc640 1 -- 10.20.193.5:0/248152470 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc02fe10 con 0x7f6cec06e5b0 2026-02-17T21:31:12.129 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:31:12.129 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cea7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:31:12.129 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cea7fc640 10 monclient: dump: 2026-02-17T21:31:12.129 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:31:12.129 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:31:12.129 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:31:12.129 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:31:12.129 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:31:12.129 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:31:12.129 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:31:12.130 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:31:12.130 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:31:12.130 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:31:12.130 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cf1dd3640 10 monclient: shutdown 2026-02-17T21:31:12.130 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cf1dd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:31:12.130 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cf1dd3640 1 -- 10.20.193.5:0/248152470 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6cec06e5b0 msgr2=0x7f6cec0ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:31:12.130 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cf1dd3640 1 --2- 10.20.193.5:0/248152470 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6cec06e5b0 0x7f6cec0ce390 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6cec074110 tx=0x7f6cdc02ed30 comp rx=0 tx=0).stop 2026-02-17T21:31:12.130 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cf1dd3640 1 -- 10.20.193.5:0/248152470 shutdown_connections 2026-02-17T21:31:12.130 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cf1dd3640 1 --2- 10.20.193.5:0/248152470 >> v2:10.20.193.135:3300/0 conn(0x7f6cec0ce8d0 0x7f6cec15f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:31:12.130 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cf1dd3640 1 --2- 10.20.193.5:0/248152470 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6cec06e5b0 0x7f6cec0ce390 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:31:12.130 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cf1dd3640 1 -- 10.20.193.5:0/248152470 >> 10.20.193.5:0/248152470 conn(0x7f6cec06da90 msgr2=0x7f6cec06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:31:12.131 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cf1dd3640 1 -- 10.20.193.5:0/248152470 shutdown_connections 2026-02-17T21:31:12.131 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.114+0000 7f6cf1dd3640 1 -- 10.20.193.5:0/248152470 wait complete. 2026-02-17T21:31:12.131 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.115+0000 7f6cf1dd3640 10 monclient: build_initial_monmap 2026-02-17T21:31:12.131 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.115+0000 7f6cf1dd3640 10 monclient: monmap: 2026-02-17T21:31:12.131 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:31:12.131 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:31:12.131 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:31:12.131 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:31:12.131 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:31:12.131 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:31:12.132 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:31:12.132 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:31:12.132 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:31:12.132 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:31:12.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.115+0000 7f6cf1dd3640 1 librados: starting msgr at 2026-02-17T21:31:12.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.115+0000 7f6cf1dd3640 1 librados: starting objecter 2026-02-17T21:31:12.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.115+0000 7f6cf1dd3640 1 Processor -- start 2026-02-17T21:31:12.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.115+0000 7f6cf1dd3640 1 -- start start 2026-02-17T21:31:12.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.115+0000 7f6cf1dd3640 1 librados: setting wanted keys 2026-02-17T21:31:12.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.115+0000 7f6cf1dd3640 1 librados: calling monclient init 2026-02-17T21:31:12.132 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.115+0000 7f6cf1dd3640 10 monclient: init 2026-02-17T21:31:12.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.115+0000 7f6cf1dd3640 10 monclient: _reopen_session rank -1 2026-02-17T21:31:12.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.115+0000 7f6cf1dd3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:31:12.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.115+0000 7f6cf1dd3640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6cec06e5b0 0x7f6cec15f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:31:12.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.115+0000 7f6cf1dd3640 10 monclient(hunting): picked mon.noname-c con 0x7f6cec06e5b0 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:31:12.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.115+0000 7f6cf1dd3640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6cec0ce8d0 0x7f6cec145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:31:12.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.115+0000 7f6cf1dd3640 10 monclient(hunting): picked mon.noname-a con 0x7f6cec0ce8d0 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:31:12.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.115+0000 7f6cf1dd3640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6cec155fb0 0x7f6cec15d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:31:12.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.115+0000 7f6cf1dd3640 10 monclient(hunting): picked mon.noname-b con 0x7f6cec155fb0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:31:12.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.115+0000 7f6cf1dd3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:31:12.133 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.115+0000 7f6cf1dd3640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6cec156390 con 0x7f6cec0ce8d0 2026-02-17T21:31:12.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.115+0000 7f6cf1dd3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:31:12.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.115+0000 7f6cf1dd3640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6cec0cd320 con 0x7f6cec155fb0 2026-02-17T21:31:12.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.115+0000 7f6cf1dd3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:31:12.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.115+0000 7f6cf1dd3640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6cec1603d0 con 0x7f6cec06e5b0 2026-02-17T21:31:12.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.115+0000 7f6cf1dd3640 10 monclient(hunting): _renew_subs 2026-02-17T21:31:12.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.115+0000 7f6cf1dd3640 10 monclient(hunting): authenticate will time out at 1377.680874s 2026-02-17T21:31:12.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6ceb7fe640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6cec06e5b0 0x7f6cec15f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:31:12.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6cebfff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6cec155fb0 0x7f6cec15d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:31:12.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6ceaffd640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6cec0ce8d0 0x7f6cec145e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:31:12.134 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6cebfff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6cec155fb0 0x7f6cec15d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.5:53556/0 (socket says 10.20.193.5:53556) 2026-02-17T21:31:12.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6cebfff640 1 -- 10.20.193.5:0/3299893547 learned_addr learned my addr 10.20.193.5:0/3299893547 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:31:12.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6cebfff640 10 monclient(hunting): get_auth_request con 0x7f6cec155fb0 auth_method 0 2026-02-17T21:31:12.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6cebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:31:12.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6cebfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:31:12.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6cebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:31:12.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6ceb7fe640 10 monclient(hunting): get_auth_request con 0x7f6cec06e5b0 auth_method 0 2026-02-17T21:31:12.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6ceb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:31:12.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6ceb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:31:12.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6ceb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:31:12.135 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6ceaffd640 10 monclient(hunting): get_auth_request con 0x7f6cec0ce8d0 auth_method 0 2026-02-17T21:31:12.136 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6ceaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:31:12.136 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6ceaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:31:12.136 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6ceaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:31:12.136 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6cebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:31:12.136 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6cebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:31:12.136 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6cebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:31:12.136 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6ceb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:31:12.136 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6ceb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:31:12.136 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6ceb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:31:12.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6ceaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:31:12.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6ceaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:31:12.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.116+0000 7f6ceaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:31:12.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.118+0000 7f6cebfff640 10 monclient(hunting): handle_auth_done global_id 5383 payload 824 2026-02-17T21:31:12.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.118+0000 7f6cebfff640 1 -- 10.20.193.5:0/3299893547 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6cec06e5b0 msgr2=0x7f6cec15f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:31:12.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.118+0000 7f6cebfff640 1 --2- 10.20.193.5:0/3299893547 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6cec06e5b0 0x7f6cec15f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:31:12.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.118+0000 7f6cebfff640 1 -- 10.20.193.5:0/3299893547 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6cec0ce8d0 msgr2=0x7f6cec145e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:31:12.137 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.118+0000 7f6cebfff640 1 --2- 10.20.193.5:0/3299893547 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6cec0ce8d0 0x7f6cec145e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:31:12.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.118+0000 7f6cebfff640 10 monclient: _finish_hunting 0 2026-02-17T21:31:12.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.118+0000 7f6cebfff640 1 monclient: found mon.noname-b 2026-02-17T21:31:12.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.118+0000 7f6cebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:31:12.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.118+0000 7f6cebfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T21:31:12.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.118+0000 7f6cebfff640 1 -- 10.20.193.5:0/3299893547 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cec14bed0 con 0x7f6cec155fb0 2026-02-17T21:31:12.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.119+0000 7f6cebfff640 1 --2- 10.20.193.5:0/3299893547 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6cec155fb0 0x7f6cec15d340 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0007d90 tx=0x7f6ce000e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:31:12.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.119+0000 7f6cc7fff640 10 client.?.objecter ms_handle_connect 0x7f6cec155fb0 2026-02-17T21:31:12.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.119+0000 7f6cc7fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:31:12.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cc7fff640 1 -- 10.20.193.5:0/3299893547 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0014420 con 0x7f6cec155fb0 2026-02-17T21:31:12.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cc7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:31:12.138 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cc7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:31:12.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cc7fff640 10 monclient: dump: 2026-02-17T21:31:12.139 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:31:12.139 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:31:12.139 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:31:12.139 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:31:12.139 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:31:12.139 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:31:12.139 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:31:12.139 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:31:12.139 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:31:12.139 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:31:12.139 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cc7fff640 10 monclient: _finish_auth 0 2026-02-17T21:31:12.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cc7fff640 10 monclient: _check_auth_tickets 2026-02-17T21:31:12.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cc7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:31:12.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cc7fff640 1 -- 10.20.193.5:0/3299893547 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ce0019070 con 0x7f6cec155fb0 2026-02-17T21:31:12.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cf1dd3640 5 monclient: authenticate success, global_id 5383 2026-02-17T21:31:12.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cf1dd3640 10 monclient: _renew_subs 2026-02-17T21:31:12.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cf1dd3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:31:12.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cf1dd3640 1 -- 10.20.193.5:0/3299893547 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cec14c1b0 con 0x7f6cec155fb0 2026-02-17T21:31:12.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cc7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:31:12.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cc7fff640 1 -- 10.20.193.5:0/3299893547 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0014800 con 0x7f6cec155fb0 2026-02-17T21:31:12.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cc7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:31:12.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cc7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:31:12.140 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6ce9ffb640 4 set_mon_vals no callback set 2026-02-17T21:31:12.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cc7fff640 10 monclient: dump: 2026-02-17T21:31:12.141 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:31:12.141 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:31:12.141 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:31:12.141 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:31:12.141 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:31:12.141 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:31:12.141 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:31:12.141 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:31:12.141 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:31:12.141 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:31:12.141 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cf1dd3640 10 client.5383.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:31:12.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cf1dd3640 10 monclient: _renew_subs 2026-02-17T21:31:12.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cf1dd3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:31:12.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cf1dd3640 1 -- 10.20.193.5:0/3299893547 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cec0cfbb0 con 0x7f6cec155fb0 2026-02-17T21:31:12.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cf1dd3640 1 librados: init done 2026-02-17T21:31:12.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cf1dd3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:31:12.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cf1dd3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:31:12.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cf1dd3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T21:31:12.142 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.121+0000 7f6cf1dd3640 1 -- 10.20.193.5:0/3299893547 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cec160690 con 0x7f6cec155fb0 2026-02-17T21:31:12.229 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.228+0000 7f6cc7fff640 1 -- 10.20.193.5:0/3299893547 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7f6ce00149a0 con 0x7f6cec155fb0 2026-02-17T21:31:12.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.229+0000 7f6cc7fff640 1 --2- 10.20.193.5:0/3299893547 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6cbc0792d0 0x7f6cbc07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:31:12.230 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.229+0000 7f6ceb7fe640 1 --2- 10.20.193.5:0/3299893547 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6cbc0792d0 0x7f6cbc07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:31:12.231 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.229+0000 7f6ceb7fe640 10 monclient: get_auth_request con 0x7f6cbc0792d0 auth_method 0 2026-02-17T21:31:12.231 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.230+0000 7f6ceb7fe640 1 --2- 10.20.193.5:0/3299893547 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6cbc0792d0 0x7f6cbc07b790 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8002770 tx=0x7f6cd8009040 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:31:12.231 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.230+0000 7f6cc7fff640 10 client.5383.objecter ms_handle_connect 0x7f6cbc0792d0 2026-02-17T21:31:12.232 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.230+0000 7f6cc7fff640 1 -- 10.20.193.5:0/3299893547 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7f6ce005f310 con 0x7f6cec155fb0 2026-02-17T21:31:12.232 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.230+0000 7f6cc7fff640 10 client.5383.objecter ms_dispatch2 0x7f6cec000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:31:12.232 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.230+0000 7f6cc7fff640 3 client.5383.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:31:12.232 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.230+0000 7f6cc7fff640 3 client.5383.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:31:12.232 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.230+0000 7f6cc7fff640 20 client.5383.objecter dump_active .. 0 homeless 2026-02-17T21:31:12.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.237+0000 7f6cc7fff640 1 -- 10.20.193.5:0/3299893547 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6cec160690 con 0x7f6cec155fb0 2026-02-17T21:31:12.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.237+0000 7f6cc7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:31:12.238 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.237+0000 7f6cc7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:31:12.321 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.320+0000 7f6cf1dd3640 1 -- 10.20.193.5:0/3299893547 --> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6cec08f9d0 con 0x7f6cbc0792d0 2026-02-17T21:31:12.323 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.322+0000 7f6cc7fff640 1 -- 10.20.193.5:0/3299893547 <== mgr.4131 v2:10.20.193.176:6800/2898618020 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+43941 (secure 0 0 0) 0x7f6cec08f9d0 con 0x7f6cbc0792d0 2026-02-17T21:31:12.324 INFO:teuthology.orchestra.run.trial005.stdout: 2026-02-17T21:31:12.325 INFO:teuthology.orchestra.run.trial005.stderr:dumped all 2026-02-17T21:31:12.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.323+0000 7f6cf1dd3640 10 librados: watch_flush enter 2026-02-17T21:31:12.325 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.323+0000 7f6cf1dd3640 10 librados: watch_flush exit 2026-02-17T21:31:12.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.323+0000 7f6cf1dd3640 20 client.5383.objecter shutdown clearing up homeless session... 2026-02-17T21:31:12.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.323+0000 7f6cf1dd3640 10 client.5383.objecter successfully canceled tick 2026-02-17T21:31:12.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.323+0000 7f6cf1dd3640 1 -- 10.20.193.5:0/3299893547 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6cbc0792d0 msgr2=0x7f6cbc07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:31:12.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.323+0000 7f6cf1dd3640 1 --2- 10.20.193.5:0/3299893547 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6cbc0792d0 0x7f6cbc07b790 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8002770 tx=0x7f6cd8009040 comp rx=0 tx=0).stop 2026-02-17T21:31:12.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.323+0000 7f6cf1dd3640 10 monclient: shutdown 2026-02-17T21:31:12.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.323+0000 7f6cf1dd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:31:12.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.323+0000 7f6cf1dd3640 1 -- 10.20.193.5:0/3299893547 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6cec155fb0 msgr2=0x7f6cec15d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:31:12.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.323+0000 7f6cf1dd3640 1 --2- 10.20.193.5:0/3299893547 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6cec155fb0 0x7f6cec15d340 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0007d90 tx=0x7f6ce000e4b0 comp rx=0 tx=0).stop 2026-02-17T21:31:12.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.323+0000 7f6cf1dd3640 1 -- 10.20.193.5:0/3299893547 shutdown_connections 2026-02-17T21:31:12.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.323+0000 7f6cf1dd3640 1 --2- 10.20.193.5:0/3299893547 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7f6cbc0792d0 0x7f6cbc07b790 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:31:12.326 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.323+0000 7f6cf1dd3640 1 --2- 10.20.193.5:0/3299893547 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6cec155fb0 0x7f6cec15d340 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:31:12.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.323+0000 7f6cf1dd3640 1 --2- 10.20.193.5:0/3299893547 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7f6cec0ce8d0 0x7f6cec145e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:31:12.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.323+0000 7f6cf1dd3640 1 --2- 10.20.193.5:0/3299893547 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7f6cec06e5b0 0x7f6cec15f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:31:12.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.323+0000 7f6cf1dd3640 1 -- 10.20.193.5:0/3299893547 >> 10.20.193.5:0/3299893547 conn(0x7f6cec06da90 msgr2=0x7f6cec150b70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:31:12.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.323+0000 7f6cf1dd3640 1 -- 10.20.193.5:0/3299893547 shutdown_connections 2026-02-17T21:31:12.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.323+0000 7f6cf1dd3640 1 -- 10.20.193.5:0/3299893547 wait complete. 2026-02-17T21:31:12.327 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.323+0000 7f6cf1dd3640 1 librados: shutdown 2026-02-17T21:31:12.333 INFO:teuthology.orchestra.run.trial005.stdout:{"pg_ready":true,"pg_map":{"version":237,"stamp":"2026-02-17T21:31:11.567369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":10,"kb":1509949440,"kb_used":438136,"kb_used_data":6744,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511304,"statfs":{"total":1546188226560,"available":1545739575296,"internally_reserved":0,"allocated":6905856,"data_stored":3428134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25504,"internal_metadata":441424992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002028"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:30:52.208159+0000","last_change":"2026-02-17T21:30:52.211259+0000","last_active":"2026-02-17T21:30:52.208159+0000","last_peered":"2026-02-17T21:30:52.208159+0000","last_clean":"2026-02-17T21:30:52.208159+0000","last_became_active":"2026-02-17T21:25:32.292871+0000","last_became_peered":"2026-02-17T21:25:32.292871+0000","last_unstale":"2026-02-17T21:30:52.208159+0000","last_undegraded":"2026-02-17T21:30:52.208159+0000","last_fullsized":"2026-02-17T21:30:52.208159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:30:52.205136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:30:52.205136+0000","last_clean_scrub_stamp":"2026-02-17T21:30:52.205136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:59:44.502173+0000","scrub_duration":150,"objects_trimmed":0,"snaptrim_duration":0.038010112999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:30:48.214570+0000","last_change":"2026-02-17T21:30:48.217454+0000","last_active":"2026-02-17T21:30:48.214570+0000","last_peered":"2026-02-17T21:30:48.214570+0000","last_clean":"2026-02-17T21:30:48.214570+0000","last_became_active":"2026-02-17T21:25:31.984749+0000","last_became_peered":"2026-02-17T21:25:31.984749+0000","last_unstale":"2026-02-17T21:30:48.214570+0000","last_undegraded":"2026-02-17T21:30:48.214570+0000","last_fullsized":"2026-02-17T21:30:48.214570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:30:48.210993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:30:48.210993+0000","last_clean_scrub_stamp":"2026-02-17T21:30:48.210993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T07:02:30.793910+0000","scrub_duration":213,"objects_trimmed":0,"snaptrim_duration":0.037066832000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:30:49.433863+0000","last_change":"2026-02-17T21:30:49.436566+0000","last_active":"2026-02-17T21:30:49.433863+0000","last_peered":"2026-02-17T21:30:49.433863+0000","last_clean":"2026-02-17T21:30:49.433863+0000","last_became_active":"2026-02-17T21:25:32.229048+0000","last_became_peered":"2026-02-17T21:25:32.229048+0000","last_unstale":"2026-02-17T21:30:49.433863+0000","last_undegraded":"2026-02-17T21:30:49.433863+0000","last_fullsized":"2026-02-17T21:30:49.433863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:30:49.431055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:30:49.431055+0000","last_clean_scrub_stamp":"2026-02-17T21:30:49.431055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:29:20.145598+0000","scrub_duration":158,"objects_trimmed":0,"snaptrim_duration":0.041957774000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:30:48.230974+0000","last_change":"2026-02-17T21:30:48.236009+0000","last_active":"2026-02-17T21:30:48.230974+0000","last_peered":"2026-02-17T21:30:48.230974+0000","last_clean":"2026-02-17T21:30:48.230974+0000","last_became_active":"2026-02-17T21:25:32.009122+0000","last_became_peered":"2026-02-17T21:25:32.009122+0000","last_unstale":"2026-02-17T21:30:48.230974+0000","last_undegraded":"2026-02-17T21:30:48.230974+0000","last_fullsized":"2026-02-17T21:30:48.230974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:30:48.225994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:30:48.225994+0000","last_clean_scrub_stamp":"2026-02-17T21:30:48.225994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T04:46:07.516541+0000","scrub_duration":159,"objects_trimmed":0,"snaptrim_duration":0.032898110000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"35'3","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:30:52.404115+0000","last_change":"2026-02-17T21:30:52.404965+0000","last_active":"2026-02-17T21:30:52.404115+0000","last_peered":"2026-02-17T21:30:52.404115+0000","last_clean":"2026-02-17T21:30:52.404115+0000","last_became_active":"2026-02-17T21:25:32.016451+0000","last_became_peered":"2026-02-17T21:25:32.016451+0000","last_unstale":"2026-02-17T21:30:52.404115+0000","last_undegraded":"2026-02-17T21:30:52.404115+0000","last_fullsized":"2026-02-17T21:30:52.404115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2026-02-17T21:30:52.402801+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2026-02-17T21:30:52.402801+0000","last_clean_scrub_stamp":"2026-02-17T21:30:52.402801+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T05:29:23.475468+0000","scrub_duration":106,"objects_trimmed":0,"snaptrim_duration":0.046646930000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:30:48.012018+0000","last_change":"2026-02-17T21:30:48.012379+0000","last_active":"2026-02-17T21:30:48.012018+0000","last_peered":"2026-02-17T21:30:48.012018+0000","last_clean":"2026-02-17T21:30:48.012018+0000","last_became_active":"2026-02-17T21:25:31.944529+0000","last_became_peered":"2026-02-17T21:25:31.944529+0000","last_unstale":"2026-02-17T21:30:48.012018+0000","last_undegraded":"2026-02-17T21:30:48.012018+0000","last_fullsized":"2026-02-17T21:30:48.012018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:30:48.010115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:30:48.010115+0000","last_clean_scrub_stamp":"2026-02-17T21:30:48.010115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T05:51:33.406887+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0.030826864999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:30:51.430617+0000","last_change":"2026-02-17T21:30:51.435395+0000","last_active":"2026-02-17T21:30:51.430617+0000","last_peered":"2026-02-17T21:30:51.430617+0000","last_clean":"2026-02-17T21:30:51.430617+0000","last_became_active":"2026-02-17T21:25:31.969947+0000","last_became_peered":"2026-02-17T21:25:31.969947+0000","last_unstale":"2026-02-17T21:30:51.430617+0000","last_undegraded":"2026-02-17T21:30:51.430617+0000","last_fullsized":"2026-02-17T21:30:51.430617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:30:51.427543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:30:51.427543+0000","last_clean_scrub_stamp":"2026-02-17T21:30:51.427543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:34:34.760973+0000","scrub_duration":117,"objects_trimmed":0,"snaptrim_duration":0.063724551000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"35'2","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:30:46.537284+0000","last_change":"2026-02-17T21:30:46.542427+0000","last_active":"2026-02-17T21:30:46.537284+0000","last_peered":"2026-02-17T21:30:46.537284+0000","last_clean":"2026-02-17T21:30:46.537284+0000","last_became_active":"2026-02-17T21:25:31.956011+0000","last_became_peered":"2026-02-17T21:25:31.956011+0000","last_unstale":"2026-02-17T21:30:46.537284+0000","last_undegraded":"2026-02-17T21:30:46.537284+0000","last_fullsized":"2026-02-17T21:30:46.537284+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2026-02-17T21:30:46.534376+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2026-02-17T21:30:46.534376+0000","last_clean_scrub_stamp":"2026-02-17T21:30:46.534376+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T04:36:01.174953+0000","scrub_duration":276,"objects_trimmed":0,"snaptrim_duration":0.036103899000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,15],"acting":[4,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"35'34","reported_seq":79,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T21:30:47.200305+0000","last_change":"2026-02-17T21:30:47.205614+0000","last_active":"2026-02-17T21:30:47.200305+0000","last_peered":"2026-02-17T21:30:47.200305+0000","last_clean":"2026-02-17T21:30:47.200305+0000","last_became_active":"2026-02-17T21:25:26.779982+0000","last_became_peered":"2026-02-17T21:25:26.779982+0000","last_unstale":"2026-02-17T21:30:47.200305+0000","last_undegraded":"2026-02-17T21:30:47.200305+0000","last_fullsized":"2026-02-17T21:30:47.200305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'34","last_scrub_stamp":"2026-02-17T21:30:47.196928+0000","last_deep_scrub":"35'34","last_deep_scrub_stamp":"2026-02-17T21:30:47.196928+0000","last_clean_scrub_stamp":"2026-02-17T21:30:47.196928+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:22:52.504376+0000","scrub_duration":268,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":9},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":28,"seq":120259084363,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,6,7,8,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":28,"seq":120259084362,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27589058},"hb_peers":[0,1,3,4,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":28,"seq":120259084362,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":782336,"data_stored":562366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[2,4,5,6,7,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":22,"seq":94489280584,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":24,"seq":103079215176,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,4,5,6,7,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":5,"up_from":22,"seq":94489280585,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,4,6,7,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":23,"seq":98784247880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27589068},"hb_peers":[3,4,5,6,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":23,"seq":98784247881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27589061},"hb_peers":[0,2,5,6,7,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":24,"seq":103079215175,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,5,6,7,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":26,"seq":111669149769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,4,5,6,7,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":12,"up_from":24,"seq":103079215177,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,5,6,7,9,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":26,"seq":111669149772,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":385024,"data_stored":164545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[3,5,6,7,8,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117068,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":385024,"data_stored":164545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[2,4,5,6,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":27,"seq":115964117068,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,4,5,7,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":28,"seq":120259084363,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":782336,"data_stored":562366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,4,5,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084363,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":380928,"data_stored":164526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T21:31:12.336 DEBUG:teuthology.orchestra.run.trial005:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-17T21:31:12.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.401+0000 7fe188268640 10 monclient: get_monmap_and_config 2026-02-17T21:31:12.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.401+0000 7fe188268640 10 monclient: build_initial_monmap 2026-02-17T21:31:12.402 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.401+0000 7fe188268640 10 monclient: monmap: 2026-02-17T21:31:12.403 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:31:12.403 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:31:12.403 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:31:12.401956+0000 2026-02-17T21:31:12.403 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:31:12.401956+0000 2026-02-17T21:31:12.403 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:31:12.403 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:31:12.403 INFO:teuthology.orchestra.run.trial005.stderr:0: v1:10.20.193.5:6789/0 mon.noname-a-legacy 2026-02-17T21:31:12.403 INFO:teuthology.orchestra.run.trial005.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b-legacy 2026-02-17T21:31:12.403 INFO:teuthology.orchestra.run.trial005.stderr:2: v1:10.20.193.135:6789/0 mon.noname-c-legacy 2026-02-17T21:31:12.403 INFO:teuthology.orchestra.run.trial005.stderr:3: v2:10.20.193.5:3300/0 mon.noname-a 2026-02-17T21:31:12.403 INFO:teuthology.orchestra.run.trial005.stderr:4: v2:10.20.193.119:3300/0 mon.noname-b 2026-02-17T21:31:12.403 INFO:teuthology.orchestra.run.trial005.stderr:5: v2:10.20.193.135:3300/0 mon.noname-c 2026-02-17T21:31:12.404 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:31:12.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.401+0000 7fe188268640 1 Processor -- start 2026-02-17T21:31:12.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.401+0000 7fe188268640 1 -- start start 2026-02-17T21:31:12.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.401+0000 7fe188268640 10 monclient: init 2026-02-17T21:31:12.406 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.402+0000 7fe188268640 10 monclient: _reopen_session rank -1 2026-02-17T21:31:12.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.402+0000 7fe188268640 10 monclient: _add_conns ranks=[0,2,3,5,1,4] 2026-02-17T21:31:12.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.402+0000 7fe188268640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe18015d370 addr v1:10.20.193.5:6789/0 2026-02-17T21:31:12.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.402+0000 7fe188268640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe1800c7e20 addr v1:10.20.193.135:6789/0 2026-02-17T21:31:12.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.402+0000 7fe188268640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fe1800c59c0 0x7fe18015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:31:12.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.402+0000 7fe188268640 10 monclient(hunting): picked mon.noname-a con 0x7fe1800c59c0 addr v2:10.20.193.5:3300/0 2026-02-17T21:31:12.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.402+0000 7fe188268640 1 -- --> v1:10.20.193.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1800c8350 con 0x7fe18015d370 2026-02-17T21:31:12.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.402+0000 7fe188268640 1 -- --> v1:10.20.193.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1800c8630 con 0x7fe1800c7e20 2026-02-17T21:31:12.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.402+0000 7fe188268640 10 monclient(hunting): start opening mon connection 2026-02-17T21:31:12.407 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.402+0000 7fe188268640 1 -- --> v2:10.20.193.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe18015b710 con 0x7fe1800c59c0 2026-02-17T21:31:12.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.402+0000 7fe188268640 10 monclient(hunting): _renew_subs 2026-02-17T21:31:12.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.402+0000 7fe188268640 10 monclient(hunting): authenticate will time out at 1377.967282s 2026-02-17T21:31:12.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.402+0000 7fe1867de640 1 --2- >> v2:10.20.193.5:3300/0 conn(0x7fe1800c59c0 0x7fe18015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:31:12.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.402+0000 7fe1857dc640 1 --1- >> v1:10.20.193.135:6789/0 conn(0x7fe1800c7e20 0x7fe1800c52b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.135:6789/0 says I am v1:10.20.193.5:54776/0 (socket says 10.20.193.5:54776) 2026-02-17T21:31:12.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.402+0000 7fe1857dc640 1 -- 10.20.193.5:0/881676117 learned_addr learned my addr 10.20.193.5:0/881676117 (peer_addr_for_me v1:10.20.193.5:0/0) 2026-02-17T21:31:12.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.403+0000 7fe1867de640 10 monclient(hunting): get_auth_request con 0x7fe1800c59c0 auth_method 0 2026-02-17T21:31:12.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.403+0000 7fe1867de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:31:12.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.403+0000 7fe1867de640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:31:12.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.403+0000 7fe1867de640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:31:12.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.403+0000 7fe1867de640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:31:12.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.403+0000 7fe1867de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:31:12.408 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.403+0000 7fe1867de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:31:12.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.404+0000 7fe184fdb640 1 -- 10.20.193.5:0/881676117 <== mon.2 v1:10.20.193.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2343518478 0 0) 0x7fe1800c8630 con 0x7fe1800c7e20 2026-02-17T21:31:12.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.404+0000 7fe184fdb640 10 monclient(hunting): _negotiate 2026-02-17T21:31:12.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.404+0000 7fe184fdb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:31:12.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.404+0000 7fe184fdb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:31:12.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.404+0000 7fe184fdb640 10 monclient(hunting): my global_id is 5384 2026-02-17T21:31:12.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.404+0000 7fe184fdb640 1 -- 10.20.193.5:0/881676117 --> v1:10.20.193.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe168003620 con 0x7fe1800c7e20 2026-02-17T21:31:12.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.404+0000 7fe1867de640 10 monclient(hunting): handle_auth_done global_id 5325 payload 274 2026-02-17T21:31:12.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.404+0000 7fe1867de640 1 -- 10.20.193.5:0/881676117 >> v1:10.20.193.135:6789/0 conn(0x7fe1800c7e20 legacy=0x7fe1800c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:31:12.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.404+0000 7fe1867de640 1 -- 10.20.193.5:0/881676117 >> v1:10.20.193.5:6789/0 conn(0x7fe18015d370 legacy=0x7fe18015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:31:12.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.404+0000 7fe1867de640 10 monclient: _finish_hunting 0 2026-02-17T21:31:12.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.404+0000 7fe1867de640 1 monclient: found mon.noname-a 2026-02-17T21:31:12.409 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.404+0000 7fe1867de640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:31:12.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.404+0000 7fe1867de640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:31:12.410 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.404+0000 7fe1867de640 1 -- 10.20.193.5:0/881676117 --> v2:10.20.193.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1800c8910 con 0x7fe1800c59c0 2026-02-17T21:31:12.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.406+0000 7fe1867de640 1 --2- 10.20.193.5:0/881676117 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe1800c59c0 0x7fe18015d750 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009d90 tx=0x7fe17c02f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feed6359aa799da5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:31:12.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.408+0000 7fe184fdb640 1 -- 10.20.193.5:0/881676117 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17c03c070 con 0x7fe1800c59c0 2026-02-17T21:31:12.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.408+0000 7fe184fdb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:31:12.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.408+0000 7fe184fdb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:31:12.415 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.408+0000 7fe184fdb640 10 monclient: dump: 2026-02-17T21:31:12.415 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:31:12.415 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:31:12.416 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:31:12.416 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:31:12.416 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:31:12.416 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:31:12.416 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:31:12.416 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:31:12.416 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:31:12.416 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:31:12.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.408+0000 7fe184fdb640 10 monclient: _finish_auth 0 2026-02-17T21:31:12.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.408+0000 7fe184fdb640 10 monclient: _check_auth_tickets 2026-02-17T21:31:12.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.408+0000 7fe184fdb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:31:12.416 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.408+0000 7fe184fdb640 1 -- 10.20.193.5:0/881676117 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe17c037440 con 0x7fe1800c59c0 2026-02-17T21:31:12.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.408+0000 7fe184fdb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:31:12.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.408+0000 7fe184fdb640 1 -- 10.20.193.5:0/881676117 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17c037810 con 0x7fe1800c59c0 2026-02-17T21:31:12.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.408+0000 7fe188268640 5 monclient: authenticate success, global_id 5325 2026-02-17T21:31:12.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.408+0000 7fe188268640 10 monclient: get_monmap_and_config success 2026-02-17T21:31:12.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.408+0000 7fe188268640 4 set_mon_vals no callback set 2026-02-17T21:31:12.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.408+0000 7fe184fdb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:31:12.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.408+0000 7fe184fdb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:31:12.417 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.408+0000 7fe184fdb640 10 monclient: dump: 2026-02-17T21:31:12.417 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:31:12.417 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:31:12.417 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:31:12.417 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:31:12.418 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:31:12.418 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:31:12.418 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:31:12.418 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:31:12.418 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:31:12.418 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:31:12.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.409+0000 7fe188268640 10 monclient: shutdown 2026-02-17T21:31:12.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.409+0000 7fe188268640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:31:12.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.409+0000 7fe188268640 1 -- 10.20.193.5:0/881676117 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe1800c59c0 msgr2=0x7fe18015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:31:12.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.409+0000 7fe188268640 1 --2- 10.20.193.5:0/881676117 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe1800c59c0 0x7fe18015d750 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009d90 tx=0x7fe17c02f230 comp rx=0 tx=0).stop 2026-02-17T21:31:12.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.409+0000 7fe188268640 1 -- 10.20.193.5:0/881676117 shutdown_connections 2026-02-17T21:31:12.418 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.409+0000 7fe188268640 1 --2- 10.20.193.5:0/881676117 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe1800c59c0 0x7fe18015d750 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:31:12.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.409+0000 7fe188268640 1 -- 10.20.193.5:0/881676117 >> 10.20.193.5:0/881676117 conn(0x7fe1800c9f20 msgr2=0x7fe1800ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:31:12.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.409+0000 7fe188268640 1 -- 10.20.193.5:0/881676117 shutdown_connections 2026-02-17T21:31:12.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.409+0000 7fe188268640 1 -- 10.20.193.5:0/881676117 wait complete. 2026-02-17T21:31:12.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.409+0000 7fe188268640 10 monclient: build_initial_monmap 2026-02-17T21:31:12.419 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.409+0000 7fe188268640 10 monclient: monmap: 2026-02-17T21:31:12.419 INFO:teuthology.orchestra.run.trial005.stderr:epoch 0 2026-02-17T21:31:12.419 INFO:teuthology.orchestra.run.trial005.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:31:12.419 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 0.000000 2026-02-17T21:31:12.419 INFO:teuthology.orchestra.run.trial005.stderr:created 0.000000 2026-02-17T21:31:12.419 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 0 (unknown) 2026-02-17T21:31:12.419 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:31:12.419 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.noname-a 2026-02-17T21:31:12.419 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T21:31:12.420 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.noname-c 2026-02-17T21:31:12.420 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:31:12.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.409+0000 7fe188268640 1 librados: starting msgr at 2026-02-17T21:31:12.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.409+0000 7fe188268640 1 librados: starting objecter 2026-02-17T21:31:12.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe188268640 1 Processor -- start 2026-02-17T21:31:12.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe188268640 1 -- start start 2026-02-17T21:31:12.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe188268640 1 librados: setting wanted keys 2026-02-17T21:31:12.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe188268640 1 librados: calling monclient init 2026-02-17T21:31:12.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe188268640 10 monclient: init 2026-02-17T21:31:12.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe188268640 10 monclient: _reopen_session rank -1 2026-02-17T21:31:12.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe188268640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:31:12.420 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe188268640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe1800c59c0 0x7fe1800729d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:31:12.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe188268640 10 monclient(hunting): picked mon.noname-b con 0x7fe1800c59c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T21:31:12.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe188268640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe1800c7e20 0x7fe1800741f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:31:12.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe188268640 10 monclient(hunting): picked mon.noname-c con 0x7fe1800c7e20 addr [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] 2026-02-17T21:31:12.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe188268640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe18015d370 0x7fe1800c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:31:12.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe188268640 10 monclient(hunting): picked mon.noname-a con 0x7fe18015d370 addr [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] 2026-02-17T21:31:12.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe188268640 10 monclient(hunting): start opening mon connection 2026-02-17T21:31:12.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe188268640 1 -- --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe1800c8ed0 con 0x7fe18015d370 2026-02-17T21:31:12.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe188268640 10 monclient(hunting): start opening mon connection 2026-02-17T21:31:12.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe188268640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe1800c9240 con 0x7fe1800c59c0 2026-02-17T21:31:12.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe188268640 10 monclient(hunting): start opening mon connection 2026-02-17T21:31:12.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe188268640 1 -- --> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe1800c96d0 con 0x7fe1800c7e20 2026-02-17T21:31:12.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe188268640 10 monclient(hunting): _renew_subs 2026-02-17T21:31:12.421 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe188268640 10 monclient(hunting): authenticate will time out at 1377.975481s 2026-02-17T21:31:12.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe1867de640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe18015d370 0x7fe1800c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:31:12.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe1857dc640 1 --2- >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe1800c7e20 0x7fe1800741f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:31:12.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe1867de640 1 --2- >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe18015d370 0x7fe1800c4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.5:3300/0 says I am v2:10.20.193.5:54036/0 (socket says 10.20.193.5:54036) 2026-02-17T21:31:12.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe1867de640 1 -- 10.20.193.5:0/754783286 learned_addr learned my addr 10.20.193.5:0/754783286 (peer_addr_for_me v2:10.20.193.5:0/0) 2026-02-17T21:31:12.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe1867de640 10 monclient(hunting): get_auth_request con 0x7fe18015d370 auth_method 0 2026-02-17T21:31:12.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe1867de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:31:12.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe1867de640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:31:12.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe1867de640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:31:12.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.410+0000 7fe185fdd640 1 --2- 10.20.193.5:0/754783286 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe1800c59c0 0x7fe1800729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:31:12.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.411+0000 7fe1867de640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:31:12.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.411+0000 7fe1867de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:31:12.422 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.411+0000 7fe1867de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:31:12.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.411+0000 7fe1857dc640 10 monclient(hunting): get_auth_request con 0x7fe1800c7e20 auth_method 0 2026-02-17T21:31:12.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.411+0000 7fe1857dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:31:12.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.411+0000 7fe1857dc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:31:12.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.411+0000 7fe1857dc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:31:12.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.411+0000 7fe185fdd640 10 monclient(hunting): get_auth_request con 0x7fe1800c59c0 auth_method 0 2026-02-17T21:31:12.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.411+0000 7fe185fdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:31:12.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.411+0000 7fe185fdd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:31:12.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.411+0000 7fe185fdd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:31:12.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.411+0000 7fe1857dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:31:12.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.411+0000 7fe1857dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:31:12.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.411+0000 7fe1857dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:31:12.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.411+0000 7fe185fdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:31:12.423 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.411+0000 7fe185fdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:31:12.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.411+0000 7fe185fdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:31:12.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.412+0000 7fe1867de640 10 monclient(hunting): handle_auth_done global_id 5328 payload 824 2026-02-17T21:31:12.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.412+0000 7fe1867de640 1 -- 10.20.193.5:0/754783286 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe1800c7e20 msgr2=0x7fe1800741f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:31:12.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.412+0000 7fe1867de640 1 --2- 10.20.193.5:0/754783286 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe1800c7e20 0x7fe1800741f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:31:12.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.412+0000 7fe1867de640 1 -- 10.20.193.5:0/754783286 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe1800c59c0 msgr2=0x7fe1800729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:31:12.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.412+0000 7fe1867de640 1 --2- 10.20.193.5:0/754783286 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe1800c59c0 0x7fe1800729d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:31:12.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.412+0000 7fe1867de640 10 monclient: _finish_hunting 0 2026-02-17T21:31:12.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.412+0000 7fe1867de640 1 monclient: found mon.noname-a 2026-02-17T21:31:12.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.412+0000 7fe1867de640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:31:12.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.412+0000 7fe1867de640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.5:3300/0 2026-02-17T21:31:12.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.412+0000 7fe1867de640 1 -- 10.20.193.5:0/754783286 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1801f2080 con 0x7fe18015d370 2026-02-17T21:31:12.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.413+0000 7fe1867de640 1 --2- 10.20.193.5:0/754783286 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe18015d370 0x7fe1800c4a10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009d90 tx=0x7fe17c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:31:12.424 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.413+0000 7fe16e7fc640 10 client.?.objecter ms_handle_connect 0x7fe18015d370 2026-02-17T21:31:12.425 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.413+0000 7fe16e7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:31:12.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe16e7fc640 1 -- 10.20.193.5:0/754783286 <== mon.0 v2:10.20.193.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17c03c050 con 0x7fe18015d370 2026-02-17T21:31:12.426 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe16e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:31:12.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe16e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:31:12.427 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe16e7fc640 10 monclient: dump: 2026-02-17T21:31:12.427 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:31:12.427 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:31:12.427 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:31:12.427 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:31:12.427 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:31:12.427 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:31:12.427 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:31:12.427 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:31:12.427 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:31:12.427 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:31:12.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe16e7fc640 10 monclient: _finish_auth 0 2026-02-17T21:31:12.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe16e7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:31:12.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe16e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:31:12.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe16e7fc640 1 -- 10.20.193.5:0/754783286 <== mon.0 v2:10.20.193.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe17c048070 con 0x7fe18015d370 2026-02-17T21:31:12.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe16e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:31:12.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe16e7fc640 1 -- 10.20.193.5:0/754783286 <== mon.0 v2:10.20.193.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17c041a30 con 0x7fe18015d370 2026-02-17T21:31:12.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe16e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:31:12.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe16e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:31:12.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe16ffff640 4 set_mon_vals no callback set 2026-02-17T21:31:12.428 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe16e7fc640 10 monclient: dump: 2026-02-17T21:31:12.428 INFO:teuthology.orchestra.run.trial005.stderr:epoch 1 2026-02-17T21:31:12.428 INFO:teuthology.orchestra.run.trial005.stderr:fsid b1be373b-56c5-4b5b-a965-9bcc20042691 2026-02-17T21:31:12.428 INFO:teuthology.orchestra.run.trial005.stderr:last_changed 2026-02-17T21:21:58.582912+0000 2026-02-17T21:31:12.429 INFO:teuthology.orchestra.run.trial005.stderr:created 2026-02-17T21:21:58.582912+0000 2026-02-17T21:31:12.429 INFO:teuthology.orchestra.run.trial005.stderr:min_mon_release 19 (squid) 2026-02-17T21:31:12.429 INFO:teuthology.orchestra.run.trial005.stderr:election_strategy: 1 2026-02-17T21:31:12.429 INFO:teuthology.orchestra.run.trial005.stderr:0: [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] mon.a 2026-02-17T21:31:12.429 INFO:teuthology.orchestra.run.trial005.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T21:31:12.429 INFO:teuthology.orchestra.run.trial005.stderr:2: [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] mon.c 2026-02-17T21:31:12.429 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:31:12.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe188268640 5 monclient: authenticate success, global_id 5328 2026-02-17T21:31:12.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe188268640 10 monclient: _renew_subs 2026-02-17T21:31:12.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe188268640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:31:12.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe188268640 1 -- 10.20.193.5:0/754783286 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe180073150 con 0x7fe18015d370 2026-02-17T21:31:12.429 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe188268640 10 client.5328.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:31:12.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe188268640 10 monclient: _renew_subs 2026-02-17T21:31:12.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe188268640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:31:12.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe188268640 1 -- 10.20.193.5:0/754783286 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe180073710 con 0x7fe18015d370 2026-02-17T21:31:12.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe188268640 1 librados: init done 2026-02-17T21:31:12.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe188268640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:31:12.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe188268640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:31:12.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe188268640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:31:12.430 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.415+0000 7fe188268640 1 -- 10.20.193.5:0/754783286 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe18015d750 con 0x7fe18015d370 2026-02-17T21:31:12.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.427+0000 7fe16e7fc640 1 -- 10.20.193.5:0/754783286 <== mon.0 v2:10.20.193.5:3300/0 4 ==== mgrmap(e 7) ==== 100245+0+0 (secure 0 0 0) 0x7fe17c041bd0 con 0x7fe18015d370 2026-02-17T21:31:12.431 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.427+0000 7fe16e7fc640 1 --2- 10.20.193.5:0/754783286 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe1500792d0 0x7fe15007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:31:12.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.428+0000 7fe185fdd640 1 --2- 10.20.193.5:0/754783286 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe1500792d0 0x7fe15007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:31:12.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.428+0000 7fe185fdd640 10 monclient: get_auth_request con 0x7fe1500792d0 auth_method 0 2026-02-17T21:31:12.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.428+0000 7fe185fdd640 1 --2- 10.20.193.5:0/754783286 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe1500792d0 0x7fe15007b790 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe170002770 tx=0x7fe170007ef0 comp rx=0 tx=0).ready entity=mgr.4131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:31:12.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.428+0000 7fe16e7fc640 10 client.5328.objecter ms_handle_connect 0x7fe1500792d0 2026-02-17T21:31:12.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.429+0000 7fe16e7fc640 1 -- 10.20.193.5:0/754783286 <== mon.0 v2:10.20.193.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 8944+0+0 (secure 0 0 0) 0x7fe17c084760 con 0x7fe18015d370 2026-02-17T21:31:12.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.429+0000 7fe16e7fc640 10 client.5328.objecter ms_dispatch2 0x7fe180000b90 osd_map(35..35 src has 1..35) 2026-02-17T21:31:12.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.429+0000 7fe16e7fc640 3 client.5328.objecter handle_osd_map got epochs [35,35] > 0 2026-02-17T21:31:12.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.429+0000 7fe16e7fc640 3 client.5328.objecter handle_osd_map decoding full epoch 35 2026-02-17T21:31:12.432 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.429+0000 7fe16e7fc640 20 client.5328.objecter dump_active .. 0 homeless 2026-02-17T21:31:12.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.529+0000 7fe16e7fc640 1 -- 10.20.193.5:0/754783286 <== mon.0 v2:10.20.193.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe17c088720 con 0x7fe18015d370 2026-02-17T21:31:12.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.529+0000 7fe16e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:31:12.531 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.529+0000 7fe16e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:31:12.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.612+0000 7fe188268640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-17T21:31:12.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.612+0000 7fe188268640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-17T21:31:12.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.612+0000 7fe188268640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.5:3300/0 2026-02-17T21:31:12.614 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.612+0000 7fe188268640 1 -- 10.20.193.5:0/754783286 --> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fe180071130 con 0x7fe18015d370 2026-02-17T21:31:12.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.659+0000 7fe16e7fc640 1 -- 10.20.193.5:0/754783286 <== mon.0 v2:10.20.193.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v11)=0 v11) ==== 123+0+0 (secure 0 0 0) 0x7fe17c08ca20 con 0x7fe18015d370 2026-02-17T21:31:12.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.659+0000 7fe16e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-17T21:31:12.660 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.659+0000 7fe16e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:31:12.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.661+0000 7fe188268640 10 librados: watch_flush enter 2026-02-17T21:31:12.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.661+0000 7fe188268640 10 librados: watch_flush exit 2026-02-17T21:31:12.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.661+0000 7fe188268640 20 client.5328.objecter shutdown clearing up homeless session... 2026-02-17T21:31:12.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.661+0000 7fe188268640 10 client.5328.objecter successfully canceled tick 2026-02-17T21:31:12.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.661+0000 7fe188268640 1 -- 10.20.193.5:0/754783286 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe1500792d0 msgr2=0x7fe15007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:31:12.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.661+0000 7fe188268640 1 --2- 10.20.193.5:0/754783286 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe1500792d0 0x7fe15007b790 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe170002770 tx=0x7fe170007ef0 comp rx=0 tx=0).stop 2026-02-17T21:31:12.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.661+0000 7fe188268640 10 monclient: shutdown 2026-02-17T21:31:12.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.661+0000 7fe188268640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:31:12.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.661+0000 7fe188268640 1 -- 10.20.193.5:0/754783286 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe18015d370 msgr2=0x7fe1800c4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:31:12.664 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.661+0000 7fe188268640 1 --2- 10.20.193.5:0/754783286 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe18015d370 0x7fe1800c4a10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009d90 tx=0x7fe17c004b40 comp rx=0 tx=0).stop 2026-02-17T21:31:12.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.661+0000 7fe188268640 1 -- 10.20.193.5:0/754783286 shutdown_connections 2026-02-17T21:31:12.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.661+0000 7fe188268640 1 --2- 10.20.193.5:0/754783286 >> [v2:10.20.193.176:6800/2898618020,v1:10.20.193.176:6801/2898618020] conn(0x7fe1500792d0 0x7fe15007b790 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:31:12.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.661+0000 7fe188268640 1 --2- 10.20.193.5:0/754783286 >> [v2:10.20.193.5:3300/0,v1:10.20.193.5:6789/0] conn(0x7fe18015d370 0x7fe1800c4a10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:31:12.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.661+0000 7fe188268640 1 --2- 10.20.193.5:0/754783286 >> [v2:10.20.193.135:3300/0,v1:10.20.193.135:6789/0] conn(0x7fe1800c7e20 0x7fe1800741f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:31:12.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.661+0000 7fe188268640 1 --2- 10.20.193.5:0/754783286 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe1800c59c0 0x7fe1800729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:31:12.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.661+0000 7fe188268640 1 -- 10.20.193.5:0/754783286 >> 10.20.193.5:0/754783286 conn(0x7fe1800c9f20 msgr2=0x7fe18015c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:31:12.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.661+0000 7fe188268640 1 -- 10.20.193.5:0/754783286 shutdown_connections 2026-02-17T21:31:12.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.661+0000 7fe188268640 1 -- 10.20.193.5:0/754783286 wait complete. 2026-02-17T21:31:12.665 INFO:teuthology.orchestra.run.trial005.stderr:2026-02-17T21:31:12.661+0000 7fe188268640 1 librados: shutdown 2026-02-17T21:31:12.671 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa/tasks/ceph.py", line 1922, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa/tasks/ceph.py", line 1484, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa/tasks/ceph_manager.py", line 3303, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy 2026-02-17T21:31:12.674 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-17T21:31:12.675 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-17T21:31:12.675 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-17T21:31:12.675 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:31:12.683 INFO:tasks.ceph.osd.0.trial005.stderr:2026-02-17T21:31:12.676+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 (PID: 26908) UID: 0 2026-02-17T21:31:12.683 INFO:tasks.ceph.osd.0.trial005.stderr:2026-02-17T21:31:12.677+0000 c69b640 -1 osd.0 35 *** Got signal Terminated *** 2026-02-17T21:31:17.782 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:07:57.407 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:17.784 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:07:57.410 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:17.794 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:07:57.420 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:17.813 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:07:57.399 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:17.813 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:07:57.437 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:17.816 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:07:57.402 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:17.817 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:07:57.441 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:17.826 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:07:57.412 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:17.826 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:07:57.450 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:18.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2026-02-17T21:31:18.777 INFO:tasks.ceph.osd.0:Stopped 2026-02-17T21:31:18.777 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-17T21:31:18.778 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:31:18.785 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:31:18.779+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 (PID: 26910) UID: 0 2026-02-17T21:31:18.785 INFO:tasks.ceph.osd.4.trial005.stderr:2026-02-17T21:31:18.780+0000 c69b640 -1 osd.4 37 *** Got signal Terminated *** 2026-02-17T21:31:24.879 INFO:tasks.ceph.osd.4:Stopped 2026-02-17T21:31:24.879 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2026-02-17T21:31:24.880 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:31:24.887 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:31:24.881+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.8.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 8 (PID: 26962) UID: 0 2026-02-17T21:31:24.887 INFO:tasks.ceph.osd.8.trial005.stderr:2026-02-17T21:31:24.882+0000 c69b640 -1 osd.8 39 *** Got signal Terminated *** 2026-02-17T21:31:25.508 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2026-02-17T21:31:25.508 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2026-02-17T21:31:30.981 INFO:tasks.ceph.osd.8:Stopped 2026-02-17T21:31:30.981 DEBUG:tasks.ceph.osd.12:waiting for process to exit 2026-02-17T21:31:30.982 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:31:30.989 INFO:tasks.ceph.osd.12.trial005.stderr:2026-02-17T21:31:30.982+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.12.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 12 (PID: 26963) UID: 0 2026-02-17T21:31:30.989 INFO:tasks.ceph.osd.12.trial005.stderr:2026-02-17T21:31:30.983+0000 c69b640 -1 osd.12 41 *** Got signal Terminated *** 2026-02-17T21:31:32.102 INFO:tasks.ceph.osd.12.trial005.stderr:2026-02-17T21:31:32.098+0000 a697640 -1 monclient: get_auth_request but no auth handler is set up 2026-02-17T21:31:32.324 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.8 is failed for ~0s 2026-02-17T21:31:32.324 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2026-02-17T21:31:37.083 INFO:tasks.ceph.osd.12:Stopped 2026-02-17T21:31:37.084 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-17T21:31:37.084 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:31:37.091 INFO:tasks.ceph.osd.1.trial119.stderr:2026-02-17T21:31:37.084+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 (PID: 26506) UID: 0 2026-02-17T21:31:37.091 INFO:tasks.ceph.osd.1.trial119.stderr:2026-02-17T21:31:37.085+0000 c69b640 -1 osd.1 42 *** Got signal Terminated *** 2026-02-17T21:31:37.810 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:08:17.436 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:37.812 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:08:17.438 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:37.823 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:08:17.448 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:37.840 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:08:17.464 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:37.842 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:08:17.466 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:37.842 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:08:17.428 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:37.843 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:08:17.429 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:37.853 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:08:17.477 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:37.854 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:08:17.440 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:39.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.8 has been restored 2026-02-17T21:31:43.186 INFO:tasks.ceph.osd.1:Stopped 2026-02-17T21:31:43.186 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-17T21:31:43.186 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:31:43.193 INFO:tasks.ceph.osd.5.trial119.stderr:2026-02-17T21:31:43.187+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 (PID: 26510) UID: 0 2026-02-17T21:31:43.194 INFO:tasks.ceph.osd.5.trial119.stderr:2026-02-17T21:31:43.187+0000 c69b640 -1 osd.5 44 *** Got signal Terminated *** 2026-02-17T21:31:49.289 INFO:tasks.ceph.osd.5:Stopped 2026-02-17T21:31:49.289 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2026-02-17T21:31:49.289 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:31:49.297 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:31:49.290+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.9.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 9 (PID: 26511) UID: 0 2026-02-17T21:31:49.297 INFO:tasks.ceph.osd.9.trial119.stderr:2026-02-17T21:31:49.291+0000 c69b640 -1 osd.9 46 *** Got signal Terminated *** 2026-02-17T21:31:55.391 INFO:tasks.ceph.osd.9:Stopped 2026-02-17T21:31:55.392 DEBUG:tasks.ceph.osd.13:waiting for process to exit 2026-02-17T21:31:55.392 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:31:55.399 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:31:55.392+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.13.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 13 (PID: 26512) UID: 0 2026-02-17T21:31:55.400 INFO:tasks.ceph.osd.13.trial119.stderr:2026-02-17T21:31:55.393+0000 c69b640 -1 osd.13 48 *** Got signal Terminated *** 2026-02-17T21:31:57.849 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:08:37.474 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:57.850 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:08:37.476 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:57.863 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:08:37.488 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:57.878 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:08:37.502 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:57.879 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:08:37.465 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:57.881 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:08:37.505 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:57.882 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:08:37.468 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:57.892 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:08:37.516 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:57.893 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:08:37.479 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:31:58.475 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.13 is failed for ~0s 2026-02-17T21:32:01.494 INFO:tasks.ceph.osd.13:Stopped 2026-02-17T21:32:01.494 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-17T21:32:01.495 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:32:01.501 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:32:01.495+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 (PID: 26757) UID: 0 2026-02-17T21:32:01.502 INFO:tasks.ceph.osd.2.trial135.stderr:2026-02-17T21:32:01.496+0000 c69b640 -1 osd.2 49 *** Got signal Terminated *** 2026-02-17T21:32:04.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2026-02-17T21:32:04.685 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.13 has been restored 2026-02-17T21:32:07.596 INFO:tasks.ceph.osd.2:Stopped 2026-02-17T21:32:07.596 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2026-02-17T21:32:07.596 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:32:07.603 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:32:07.597+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 (PID: 26759) UID: 0 2026-02-17T21:32:07.603 INFO:tasks.ceph.osd.6.trial135.stderr:2026-02-17T21:32:07.598+0000 c69b640 -1 osd.6 50 *** Got signal Terminated *** 2026-02-17T21:32:10.894 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2026-02-17T21:32:17.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2026-02-17T21:32:17.879 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:08:57.504 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:32:17.880 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:08:57.506 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:32:17.889 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:08:57.515 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:32:17.906 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:08:57.530 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:32:17.907 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:08:57.531 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:32:17.907 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:08:57.493 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:32:17.908 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:08:57.494 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:32:17.917 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:08:57.541 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:32:17.920 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:08:57.506 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:32:19.800 INFO:tasks.ceph.osd.6:Stopped 2026-02-17T21:32:19.801 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2026-02-17T21:32:19.801 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:32:19.808 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:32:19.801+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.10.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 10 (PID: 26762) UID: 0 2026-02-17T21:32:19.808 INFO:tasks.ceph.osd.10.trial135.stderr:2026-02-17T21:32:19.802+0000 c69b640 -1 osd.10 52 *** Got signal Terminated *** 2026-02-17T21:32:23.012 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.10 is failed for ~0s 2026-02-17T21:32:23.013 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2026-02-17T21:32:25.902 INFO:tasks.ceph.osd.10:Stopped 2026-02-17T21:32:25.902 DEBUG:tasks.ceph.osd.14:waiting for process to exit 2026-02-17T21:32:25.902 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:32:25.910 INFO:tasks.ceph.osd.14.trial135.stderr:2026-02-17T21:32:25.903+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.14.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 14 (PID: 26764) UID: 0 2026-02-17T21:32:25.910 INFO:tasks.ceph.osd.14.trial135.stderr:2026-02-17T21:32:25.904+0000 c69b640 -1 osd.14 53 *** Got signal Terminated *** 2026-02-17T21:32:28.921 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.14 is failed for ~0s 2026-02-17T21:32:28.922 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.10 has been restored 2026-02-17T21:32:32.004 INFO:tasks.ceph.osd.14:Stopped 2026-02-17T21:32:32.004 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-17T21:32:32.004 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:32:32.022 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:32:32.013+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 (PID: 26814) UID: 0 2026-02-17T21:32:32.024 INFO:tasks.ceph.osd.3.trial176.stderr:2026-02-17T21:32:32.014+0000 c69b640 -1 osd.3 54 *** Got signal Terminated *** 2026-02-17T21:32:34.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.14 has been restored 2026-02-17T21:32:37.884 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:09:17.509 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:32:37.911 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:09:17.535 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:32:37.911 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:09:17.536 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:32:37.912 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:09:17.536 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:32:37.920 INFO:tasks.ceph.mon.a.trial005.stderr:==00:00:09:17.546 26616== Warning: unimplemented fcntl command: 1036 2026-02-17T21:32:37.921 INFO:tasks.ceph.mon.b.trial119.stderr:==00:00:09:17.545 26273== Warning: unimplemented fcntl command: 1036 2026-02-17T21:32:37.937 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:09:17.523 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:32:37.938 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:09:17.524 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:32:37.947 INFO:tasks.ceph.mon.c.trial135.stderr:==00:00:09:17.533 26523== Warning: unimplemented fcntl command: 1036 2026-02-17T21:32:38.106 INFO:tasks.ceph.osd.3:Stopped 2026-02-17T21:32:38.107 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2026-02-17T21:32:38.107 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:32:38.114 INFO:tasks.ceph.osd.7.trial176.stderr:2026-02-17T21:32:38.105+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 (PID: 26817) UID: 0 2026-02-17T21:32:38.114 INFO:tasks.ceph.osd.7.trial176.stderr:2026-02-17T21:32:38.106+0000 c69b640 -1 osd.7 54 *** Got signal Terminated *** 2026-02-17T21:32:44.209 INFO:tasks.ceph.osd.7:Stopped 2026-02-17T21:32:44.209 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2026-02-17T21:32:44.209 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:32:44.216 INFO:tasks.ceph.osd.11.trial176.stderr:2026-02-17T21:32:44.208+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.11.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 11 (PID: 26818) UID: 0 2026-02-17T21:32:44.217 INFO:tasks.ceph.osd.11.trial176.stderr:2026-02-17T21:32:44.209+0000 c69b640 -1 osd.11 54 *** Got signal Terminated *** 2026-02-17T21:32:46.244 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.11 is failed for ~0s 2026-02-17T21:32:50.311 INFO:tasks.ceph.osd.11:Stopped 2026-02-17T21:32:50.312 DEBUG:tasks.ceph.osd.15:waiting for process to exit 2026-02-17T21:32:50.312 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:32:50.319 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:32:50.311+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.15.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 15 (PID: 26821) UID: 0 2026-02-17T21:32:50.319 INFO:tasks.ceph.osd.15.trial176.stderr:2026-02-17T21:32:50.311+0000 c69b640 -1 osd.15 54 *** Got signal Terminated *** 2026-02-17T21:32:51.848 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.11 has been restored 2026-02-17T21:32:56.413 INFO:tasks.ceph.osd.15:Stopped 2026-02-17T21:32:56.413 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-17T21:32:56.414 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2026-02-17T21:32:56.414 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:32:56.444 INFO:tasks.ceph.mgr.y:Stopped 2026-02-17T21:32:56.444 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-17T21:32:56.444 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:32:56.445 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:32:56.441+0000 7f4fa189e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i x (PID: 25716) UID: 0 2026-02-17T21:32:56.445 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T21:32:56.441+0000 7f4fa189e640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2026-02-17T21:32:56.477 INFO:tasks.ceph.mgr.x:Stopped 2026-02-17T21:32:56.477 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-17T21:32:56.477 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T21:32:56.477 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:32:56.493 INFO:tasks.ceph.mon.a.trial005.stderr:2026-02-17T21:32:56.486+0000 aca4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 26614) UID: 0 2026-02-17T21:32:56.494 INFO:tasks.ceph.mon.a.trial005.stderr:2026-02-17T21:32:56.486+0000 aca4640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-17T21:32:57.123 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2026-02-17T21:33:02.326 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~5s 2026-02-17T21:33:02.578 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T21:33:02.579 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-17T21:33:02.579 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:33:02.587 INFO:tasks.ceph.mon.b.trial119.stderr:2026-02-17T21:33:02.579+0000 aca4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 26271) UID: 0 2026-02-17T21:33:02.588 INFO:tasks.ceph.mon.b.trial119.stderr:2026-02-17T21:33:02.580+0000 aca4640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2026-02-17T21:33:07.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2026-02-17T21:33:07.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2026-02-17T21:33:08.681 INFO:tasks.ceph.mon.b:Stopped 2026-02-17T21:33:08.682 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T21:33:08.682 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:33:08.689 INFO:tasks.ceph.mon.c.trial135.stderr:2026-02-17T21:33:08.682+0000 aca4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 26521) UID: 0 2026-02-17T21:33:08.690 INFO:tasks.ceph.mon.c.trial135.stderr:2026-02-17T21:33:08.683+0000 aca4640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2026-02-17T21:33:12.429 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2026-02-17T21:33:12.429 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2026-02-17T21:33:14.783 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T21:33:14.784 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-17T21:33:14.784 DEBUG:teuthology.orchestra.run.trial005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | head -n 1 2026-02-17T21:33:14.814 INFO:teuthology.orchestra.run.trial005.stdout:2026-02-17T21:25:19.886518+0000 mon.a (mon.0) 165 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2026-02-17T21:33:14.814 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2026-02-17T21:33:14.815 DEBUG:teuthology.orchestra.run.trial005:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | head -n 1 2026-02-17T21:33:14.881 DEBUG:teuthology.orchestra.run.trial005:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | head -n 1 2026-02-17T21:33:14.946 DEBUG:teuthology.orchestra.run.trial005:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | head -n 1 2026-02-17T21:33:15.011 INFO:teuthology.orchestra.run.trial005.stdout:2026-02-17T21:25:19.886518+0000 mon.a (mon.0) 165 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2026-02-17T21:33:15.012 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial005.front.sepia.ceph.com 2026-02-17T21:33:15.012 DEBUG:teuthology.orchestra.run.trial005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-17T21:33:15.079 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial005.front.sepia.ceph.com 2026-02-17T21:33:15.080 DEBUG:teuthology.orchestra.run.trial005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-17T21:33:15.147 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@trial005.front.sepia.ceph.com 2026-02-17T21:33:15.147 DEBUG:teuthology.orchestra.run.trial005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2026-02-17T21:33:15.215 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-12 on ubuntu@trial005.front.sepia.ceph.com 2026-02-17T21:33:15.215 DEBUG:teuthology.orchestra.run.trial005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-12 2026-02-17T21:33:15.285 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial119.front.sepia.ceph.com 2026-02-17T21:33:15.285 DEBUG:teuthology.orchestra.run.trial119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-17T21:33:15.319 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial119.front.sepia.ceph.com 2026-02-17T21:33:15.319 DEBUG:teuthology.orchestra.run.trial119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-17T21:33:15.386 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@trial119.front.sepia.ceph.com 2026-02-17T21:33:15.386 DEBUG:teuthology.orchestra.run.trial119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2026-02-17T21:33:15.457 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-13 on ubuntu@trial119.front.sepia.ceph.com 2026-02-17T21:33:15.457 DEBUG:teuthology.orchestra.run.trial119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-13 2026-02-17T21:33:15.524 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial135.front.sepia.ceph.com 2026-02-17T21:33:15.524 DEBUG:teuthology.orchestra.run.trial135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-17T21:33:15.564 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@trial135.front.sepia.ceph.com 2026-02-17T21:33:15.564 DEBUG:teuthology.orchestra.run.trial135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2026-02-17T21:33:15.634 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@trial135.front.sepia.ceph.com 2026-02-17T21:33:15.634 DEBUG:teuthology.orchestra.run.trial135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2026-02-17T21:33:15.703 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-14 on ubuntu@trial135.front.sepia.ceph.com 2026-02-17T21:33:15.703 DEBUG:teuthology.orchestra.run.trial135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-14 2026-02-17T21:33:15.821 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial176.front.sepia.ceph.com 2026-02-17T21:33:15.822 DEBUG:teuthology.orchestra.run.trial176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-17T21:33:15.855 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@trial176.front.sepia.ceph.com 2026-02-17T21:33:15.855 DEBUG:teuthology.orchestra.run.trial176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2026-02-17T21:33:15.923 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@trial176.front.sepia.ceph.com 2026-02-17T21:33:15.923 DEBUG:teuthology.orchestra.run.trial176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2026-02-17T21:33:16.006 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-15 on ubuntu@trial176.front.sepia.ceph.com 2026-02-17T21:33:16.006 DEBUG:teuthology.orchestra.run.trial176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-15 2026-02-17T21:33:16.077 INFO:tasks.ceph:Archiving mon data... 2026-02-17T21:33:16.078 DEBUG:teuthology.misc:Transferring archived files from trial005:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53902/data/mon.a.tgz 2026-02-17T21:33:16.078 DEBUG:teuthology.orchestra.run.trial005:> mktemp 2026-02-17T21:33:16.095 INFO:teuthology.orchestra.run.trial005.stdout:/tmp/tmp.Zugjaw0Urn 2026-02-17T21:33:16.095 DEBUG:teuthology.orchestra.run.trial005:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Zugjaw0Urn 2026-02-17T21:33:16.215 DEBUG:teuthology.orchestra.run.trial005:> sudo chmod 0666 /tmp/tmp.Zugjaw0Urn 2026-02-17T21:33:16.296 DEBUG:teuthology.orchestra.remote:trial005:/tmp/tmp.Zugjaw0Urn is 495KB 2026-02-17T21:33:16.394 DEBUG:teuthology.orchestra.run.trial005:> rm -fr /tmp/tmp.Zugjaw0Urn 2026-02-17T21:33:16.411 DEBUG:teuthology.misc:Transferring archived files from trial119:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53902/data/mon.b.tgz 2026-02-17T21:33:16.411 DEBUG:teuthology.orchestra.run.trial119:> mktemp 2026-02-17T21:33:16.429 INFO:teuthology.orchestra.run.trial119.stdout:/tmp/tmp.EV0YV9JO05 2026-02-17T21:33:16.430 DEBUG:teuthology.orchestra.run.trial119:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.EV0YV9JO05 2026-02-17T21:33:16.546 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod 0666 /tmp/tmp.EV0YV9JO05 2026-02-17T21:33:16.629 DEBUG:teuthology.orchestra.remote:trial119:/tmp/tmp.EV0YV9JO05 is 496KB 2026-02-17T21:33:16.725 DEBUG:teuthology.orchestra.run.trial119:> rm -fr /tmp/tmp.EV0YV9JO05 2026-02-17T21:33:16.742 DEBUG:teuthology.misc:Transferring archived files from trial135:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53902/data/mon.c.tgz 2026-02-17T21:33:16.742 DEBUG:teuthology.orchestra.run.trial135:> mktemp 2026-02-17T21:33:16.760 INFO:teuthology.orchestra.run.trial135.stdout:/tmp/tmp.rrRtKahbBK 2026-02-17T21:33:16.761 DEBUG:teuthology.orchestra.run.trial135:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.rrRtKahbBK 2026-02-17T21:33:16.878 DEBUG:teuthology.orchestra.run.trial135:> sudo chmod 0666 /tmp/tmp.rrRtKahbBK 2026-02-17T21:33:16.963 DEBUG:teuthology.orchestra.remote:trial135:/tmp/tmp.rrRtKahbBK is 496KB 2026-02-17T21:33:17.058 DEBUG:teuthology.orchestra.run.trial135:> rm -fr /tmp/tmp.rrRtKahbBK 2026-02-17T21:33:17.075 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-17T21:33:17.076 DEBUG:teuthology.orchestra.run.trial005:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T21:33:17.078 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T21:33:17.081 DEBUG:teuthology.orchestra.run.trial135:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T21:33:17.118 DEBUG:teuthology.orchestra.run.trial176:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T21:33:17.410 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable malloc malloc _dl_new_object 2026-02-17T21:33:17.430 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2026-02-17T21:33:18.155 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-17T21:33:18.156 INFO:tasks.ceph:Archiving crash dumps... 2026-02-17T21:33:18.162 DEBUG:teuthology.misc:Transferring archived files from trial005:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53902/remote/trial005/crash 2026-02-17T21:33:18.163 DEBUG:teuthology.orchestra.run.trial005:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T21:33:18.189 DEBUG:teuthology.misc:Transferring archived files from trial119:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53902/remote/trial119/crash 2026-02-17T21:33:18.190 DEBUG:teuthology.orchestra.run.trial119:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T21:33:18.217 DEBUG:teuthology.misc:Transferring archived files from trial135:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53902/remote/trial135/crash 2026-02-17T21:33:18.218 DEBUG:teuthology.orchestra.run.trial135:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T21:33:18.245 DEBUG:teuthology.misc:Transferring archived files from trial176:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53902/remote/trial176/crash 2026-02-17T21:33:18.246 DEBUG:teuthology.orchestra.run.trial176:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T21:33:18.274 INFO:tasks.ceph:Compressing logs... 2026-02-17T21:33:18.274 DEBUG:teuthology.orchestra.run.trial005:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T21:33:18.277 DEBUG:teuthology.orchestra.run.trial119:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T21:33:18.279 DEBUG:teuthology.orchestra.run.trial135:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T21:33:18.290 DEBUG:teuthology.orchestra.run.trial176:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T21:33:18.300 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40386.log 2026-02-17T21:33:18.300 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34244.log 2026-02-17T21:33:18.300 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35371.log 2026-02-17T21:33:18.307 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-17T21:33:18.307 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.5.log 2026-02-17T21:33:18.308 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.13.log 2026-02-17T21:33:18.308 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/valgrind/osd.5.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.1.log 2026-02-17T21:33:18.308 INFO:teuthology.orchestra.run.trial119.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.5.log.gz 2026-02-17T21:33:18.308 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose/var/log/ceph/valgrind/osd.13.log: -- /var/log/ceph/valgrind/osd.9.log 2026-02-17T21:33:18.308 INFO:teuthology.orchestra.run.trial119.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.13.log.gz 2026-02-17T21:33:18.308 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/valgrind/osd.1.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2026-02-17T21:33:18.308 INFO:teuthology.orchestra.run.trial119.stderr: 68.3% -- replaced with /var/log/ceph/valgrind/osd.1.log.gz 2026-02-17T21:33:18.308 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/valgrind/osd.9.log: gzip -5 --verbose -- 68.2% /var/log/ceph/ceph.audit.log -- replaced with /var/log/ceph/valgrind/osd.9.log.gz 2026-02-17T21:33:18.308 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T21:33:18.308 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-17T21:33:18.309 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/valgrind/mon.b.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.13.log 2026-02-17T21:33:18.309 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-mon.b.log: 94.2% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2026-02-17T21:33:18.309 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-17T21:33:18.309 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T21:33:18.309 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-osd.13.log: /var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2026-02-17T21:33:18.309 INFO:teuthology.orchestra.run.trial119.stderr: 90.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T21:33:18.309 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-osd.9.log: 89.6% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T21:33:18.320 INFO:teuthology.orchestra.run.trial135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-17T21:33:18.320 INFO:teuthology.orchestra.run.trial135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-17T21:33:18.320 INFO:teuthology.orchestra.run.trial135.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.2.log 2026-02-17T21:33:18.320 INFO:teuthology.orchestra.run.trial135.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.6.log 2026-02-17T21:33:18.320 INFO:teuthology.orchestra.run.trial135.stderr:/var/log/ceph/valgrind/osd.2.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.14.log 2026-02-17T21:33:18.321 INFO:teuthology.orchestra.run.trial135.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.2.log.gz 2026-02-17T21:33:18.321 INFO:teuthology.orchestra.run.trial135.stderr:/var/log/ceph/valgrind/osd.6.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.10.log 2026-02-17T21:33:18.321 INFO:teuthology.orchestra.run.trial135.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.6.log.gz 2026-02-17T21:33:18.321 INFO:teuthology.orchestra.run.trial135.stderr:/var/log/ceph/valgrind/osd.14.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2026-02-17T21:33:18.321 INFO:teuthology.orchestra.run.trial135.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.14.log.gz 2026-02-17T21:33:18.321 INFO:teuthology.orchestra.run.trial135.stderr:/var/log/ceph/valgrind/osd.10.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.10.log 2026-02-17T21:33:18.321 INFO:teuthology.orchestra.run.trial135.stderr: 67.9% -- replaced with /var/log/ceph/valgrind/osd.10.log.gz 2026-02-17T21:33:18.321 INFO:teuthology.orchestra.run.trial135.stderr:/var/log/ceph/valgrind/mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.14.log 2026-02-17T21:33:18.322 INFO:teuthology.orchestra.run.trial135.stderr:/var/log/ceph/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T21:33:18.322 INFO:teuthology.orchestra.run.trial135.stderr: 94.2% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2026-02-17T21:33:18.322 INFO:teuthology.orchestra.run.trial135.stderr:/var/log/ceph/ceph-osd.14.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2026-02-17T21:33:18.322 INFO:teuthology.orchestra.run.trial135.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T21:33:18.322 INFO:teuthology.orchestra.run.trial135.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph.log: 90.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T21:33:18.322 INFO:teuthology.orchestra.run.trial135.stderr: 89.6% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T21:33:18.351 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26182.log 2026-02-17T21:33:18.352 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-17T21:33:18.352 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.26182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26648.log 2026-02-17T21:33:18.352 INFO:teuthology.orchestra.run.trial176.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.26182.log.gz 2026-02-17T21:33:18.352 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26379.log 2026-02-17T21:33:18.352 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.26648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26475.log 2026-02-17T21:33:18.352 INFO:teuthology.orchestra.run.trial176.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.26648.log.gz 2026-02-17T21:33:18.352 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2026-02-17T21:33:18.352 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.26379.log: /var/log/ceph/ceph-client.admin.26475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25969.log 2026-02-17T21:33:18.352 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-osd.7.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.26379.log.gz 2026-02-17T21:33:18.352 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.7.log 2026-02-17T21:33:18.352 INFO:teuthology.orchestra.run.trial176.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.26475.log.gz 2026-02-17T21:33:18.352 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.25969.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.11.log 2026-02-17T21:33:18.352 INFO:teuthology.orchestra.run.trial176.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.25969.log.gz 2026-02-17T21:33:18.353 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/valgrind/osd.7.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.15.log 2026-02-17T21:33:18.353 INFO:teuthology.orchestra.run.trial176.stderr: 67.9% -- replaced with /var/log/ceph/valgrind/osd.7.log.gz 2026-02-17T21:33:18.353 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/valgrind/osd.11.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.3.log 2026-02-17T21:33:18.353 INFO:teuthology.orchestra.run.trial176.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.11.log.gz 2026-02-17T21:33:18.353 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/valgrind/osd.15.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.11.log 2026-02-17T21:33:18.353 INFO:teuthology.orchestra.run.trial176.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.15.log.gz 2026-02-17T21:33:18.353 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/valgrind/osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26229.log 2026-02-17T21:33:18.353 INFO:teuthology.orchestra.run.trial176.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.3.log.gz 2026-02-17T21:33:18.353 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26276.log 2026-02-17T21:33:18.353 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.26229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26428.log 2026-02-17T21:33:18.353 INFO:teuthology.orchestra.run.trial176.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.26229.log.gz 2026-02-17T21:33:18.353 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.26276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26696.log 2026-02-17T21:33:18.353 INFO:teuthology.orchestra.run.trial176.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.26276.log.gz 2026-02-17T21:33:18.353 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.26428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26016.log 2026-02-17T21:33:18.353 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.26696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25915.log 2026-02-17T21:33:18.353 INFO:teuthology.orchestra.run.trial176.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.26428.log.gz 2026-02-17T21:33:18.353 INFO:teuthology.orchestra.run.trial176.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.26696.log.gz 2026-02-17T21:33:18.354 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5/var/log/ceph/ceph-client.admin.26016.log: --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-17T21:33:18.354 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.25915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26527.log 2026-02-17T21:33:18.354 INFO:teuthology.orchestra.run.trial176.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.26016.log.gz 2026-02-17T21:33:18.354 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-mgr.x.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.25915.log.gz 2026-02-17T21:33:18.354 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26063.log 2026-02-17T21:33:18.354 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.26527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26323.log 2026-02-17T21:33:18.354 INFO:teuthology.orchestra.run.trial176.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.26527.log.gz 2026-02-17T21:33:18.354 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.26063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25864.log 2026-02-17T21:33:18.354 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.26323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26135.log 2026-02-17T21:33:18.354 INFO:teuthology.orchestra.run.trial176.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.26063.log.gz 2026-02-17T21:33:18.354 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.25864.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.15.log 2026-02-17T21:33:18.354 INFO:teuthology.orchestra.run.trial176.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.26323.log.gz 2026-02-17T21:33:18.354 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.26135.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.25864.log.gz 2026-02-17T21:33:18.354 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-osd.15.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.26135.log.gz 2026-02-17T21:33:18.355 INFO:teuthology.orchestra.run.trial119.stderr: 90.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-17T21:33:18.361 INFO:teuthology.orchestra.run.trial135.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.10.log.gz 2026-02-17T21:33:18.364 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.40386.log: /var/log/ceph/ceph-client.admin.34244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34832.log 2026-02-17T21:33:18.364 INFO:teuthology.orchestra.run.trial005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40386.log.gz 2026-02-17T21:33:18.364 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.35371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33042.log 2026-02-17T21:33:18.364 INFO:teuthology.orchestra.run.trial005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34244.log.gz 2026-02-17T21:33:18.364 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33156.log 2026-02-17T21:33:18.364 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.34832.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35371.log.gz 2026-02-17T21:33:18.364 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.33042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33736.log 2026-02-17T21:33:18.364 INFO:teuthology.orchestra.run.trial005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34832.log.gz 2026-02-17T21:33:18.364 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.33156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40141.log 2026-02-17T21:33:18.364 INFO:teuthology.orchestra.run.trial005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33042.log.gz 2026-02-17T21:33:18.364 INFO:teuthology.orchestra.run.trial005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33156.log.gz 2026-02-17T21:33:18.364 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.33736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31102.log 2026-02-17T21:33:18.364 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.40141.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33736.log.gz 2026-02-17T21:33:18.364 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-17T21:33:18.364 INFO:teuthology.orchestra.run.trial005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40141.log.gz 2026-02-17T21:33:18.364 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40727.log 2026-02-17T21:33:18.364 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.31102.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34685.log 2026-02-17T21:33:18.364 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.40727.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31102.log.gz 2026-02-17T21:33:18.364 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38131.log 2026-02-17T21:33:18.364 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.34685.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40727.log.gz 2026-02-17T21:33:18.364 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31741.log 2026-02-17T21:33:18.364 INFO:teuthology.orchestra.run.trial005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34685.log.gz 2026-02-17T21:33:18.364 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.38131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34538.log 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.31741.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.38131.log.gz -5 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39406.log 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.34538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36057.log 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31741.log.gz 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.39406.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34538.log.gz 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33341.log 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.36057.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39406.log.gz 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35028.log 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.33341.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36057.log.gz 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35175.log 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.35028.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33341.log.gz 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31755.log 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35028.log.gz 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.35175.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.31755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37739.log 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35175.log.gz 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31755.log.gz 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37396.log 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.37739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36266.log 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.37396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39700.log 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37739.log.gz 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37396.log.gz 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.36266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35126.log 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.39700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35322.log 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36266.log.gz 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.35126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39504.log 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39700.log.gz 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35126.log.gz 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.35322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34293.log 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.39504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37249.log 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35322.log.gz 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.34293.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39504.log.gz 2026-02-17T21:33:18.365 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37984.log 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr: 87.4%/var/log/ceph/ceph-client.admin.37249.log: -- replaced with /var/log/ceph/ceph-client.admin.34293.log.gz 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32950.log 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37249.log.gz 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.37984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38328.log 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.32950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32539.log 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37984.log.gz 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32950.log.gz 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.38328.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.32539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39210.log 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38328.log.gz 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-mgr.y.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32539.log.gz 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37935.log 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.39210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39945.log 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.37935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31749.log 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39210.log.gz 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.39945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31756.log 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37935.log.gz 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33616.log 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.31749.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39945.log.gz 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.31756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38180.log 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31749.log.gz 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.33616.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20317.log 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31756.log.gz 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.38180.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33616.log.gz 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33338.log 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38180.log.gz 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph.tmp-client.admin.20317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37200.log 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20317.log.gz 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.33338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36906.log 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33338.log.gz/var/log/ceph/ceph-client.admin.37200.log: 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32519.log 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37200.log.gz 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.36906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31255.log 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.32519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39063.log 2026-02-17T21:33:18.366 INFO:teuthology.orchestra.run.trial005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36906.log.gz 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.31255.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32519.log.gz 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35420.log 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr: 88.1%/var/log/ceph/ceph-client.admin.39063.log: -- replaced with /var/log/ceph/ceph-client.admin.31255.log.gz 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38230.log 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.35420.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39063.log.gz 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31744.log 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.38230.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35420.log.gz 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38426.log 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.31744.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38230.log.gz 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36316.log 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.38426.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31744.log.gz 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36168.log 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.36316.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38426.log.gz 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39259.log 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36316.log.gz 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.36168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34881.log 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.39259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34176.log 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36168.log.gz 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.34881.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39259.log.gz 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33041.log 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34881.log.gz 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33530.log 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.34176.log: /var/log/ceph/ceph-client.admin.33041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37641.log 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34176.log.gz 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.33530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32512.log 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33041.log.gz 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.37641.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33530.log.gz 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38720.log 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.32512.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37641.log.gz 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37298.log 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32512.log.gz 2026-02-17T21:33:18.367 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.38720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32502.log 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.37298.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38720.log.gz 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31757.log 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37298.log.gz 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.32502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34783.log 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.31757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39896.log 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32502.log.gz 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.34783.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31757.log.gz 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35616.log 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34783.log.gz 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.39896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30708.log 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.35616.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39896.log.gz 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31032.log 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35616.log.gz 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.30708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34489.log 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.30708.log.gz 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.31032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35910.log 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.34489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33845.log 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31032.log.gz 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.35910.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34489.log.gz 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38279.log 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35910.log.gz 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.33845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40582.log 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.38279.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33845.log.gz 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32542.log 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.40582.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38279.log.gz 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36414.log 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40582.log.gz 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.32542.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.0.log 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.36414.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.12.log 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.32542.log.gz 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/valgrind/osd.0.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36414.log.gz 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.8.log 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr: 67.9% -- replaced with /var/log/ceph/valgrind/osd.0.log.gz 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr:gzip/var/log/ceph/valgrind/osd.12.log: -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr: 68.1% -- replaced with /var/log/ceph/valgrind/osd.12.log.gz 2026-02-17T21:33:18.368 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/valgrind/osd.8.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.4.log 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.8.log.gz 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34587.log 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/valgrind/osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32494.log 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr: 94.2% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr: 68.3% -- replaced with /var/log/ceph/valgrind/osd.4.log.gz 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.34587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27915.log 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.32494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30980.log 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34587.log.gz 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.27915.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.32494.log.gz 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33705.log 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.30980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35665.log 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27915.log.gz 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.33705.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30980.log.gz 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36808.log 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.35665.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33705.log.gz 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28206.log 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.36808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34636.log 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35665.log.gz 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.28206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34342.log 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36808.log.gz 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.28206.log.gz 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.34636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39749.log 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.34342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31758.log 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34636.log.gz 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.39749.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34342.log.gz 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40239.log 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27063.log 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.31758.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39749.log.gz 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.40239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31725.log 2026-02-17T21:33:18.369 INFO:teuthology.orchestra.run.trial005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31758.log.gz 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.27063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33339.log 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40239.log.gz 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.31725.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.27063.log.gz -5 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40092.log 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.33339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33207.log 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31725.log.gz 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.40092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30569.log 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33339.log.gz 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.33207.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40092.log.gz 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35273.log 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33207.log.gz 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.30569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34391.log 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.35273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40337.log 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30569.log.gz 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.34391.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35273.log.gz 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32527.log 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.40337.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34391.log.gz 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31733.log 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40337.log.gz 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.32527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37837.log 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.31733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39112.log 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32527.log.gz 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.37837.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31733.log.gz 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36710.log 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37837.log.gz 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37445.log 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.39112.log: /var/log/ceph/ceph-client.admin.36710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38622.log 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.37445.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39112.log.gz 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36710.log.gz 2026-02-17T21:33:18.370 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36512.log 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37445.log.gz 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.38622.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.12.log 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.36512.log: gzip -5 87.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.38622.log.gz /var/log/ceph/ceph-client.admin.34734.log 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-osd.12.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32515.log 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36512.log.gz 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.34734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39308.log 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34734.log.gz 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.32515.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.39308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35567.log 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32515.log.gz 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-osd.4.log: gzip 87.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.39308.log.gz --verbose 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr: -- /var/log/ceph/ceph-client.admin.33852.log 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.35567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32541.log 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35567.log.gz 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.33852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34069.log 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.32541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39651.log 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.33852.log.gz 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32541.log.gz 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.34069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32921.log 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34069.log.gz 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.39651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38818.log 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.32921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39357.log 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39651.log.gz 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.38818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36955.log 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32921.log.gz 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.39357.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38818.log.gz 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36106.log 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.36955.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39357.log.gz 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31753.log 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.36106.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36955.log.gz 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37102.log 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37151.log 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.31753.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36106.log.gz 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.37102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32536.log 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.31753.log.gz 2026-02-17T21:33:18.371 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.37151.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37102.log.gz 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34979.log 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.32536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32532.log 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37151.log.gz 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32536.log.gz 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.34979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36365.log 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.32532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38671.log 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34979.log.gz 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.36365.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.32532.log.gz 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37788.log 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.38671.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36365.log.gz 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40631.log 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38671.log.gz 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.37788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31754.log 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.40631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36217.log 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37788.log.gz 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.31754.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40631.log.gz 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.36217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36857.log 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.31754.log.gz 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33964.log 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36217.log.gz 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.36857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34930.log 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36857.log.gz 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40680.log 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.33964.log: /var/log/ceph/ceph-client.admin.34930.log: 90.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38769.log 2026-02-17T21:33:18.372 INFO:teuthology.orchestra.run.trial005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33964.log.gz 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34930.log.gz 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.40680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39602.log 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.38769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38082.log 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40680.log.gz 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.39602.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38769.log.gz 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32521.log 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39602.log.gz 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.38082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39994.log 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.32521.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38082.log.gz 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38867.log 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32521.log.gz 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.39994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30616.log 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39994.log.gz 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.38867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36610.log 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.30616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38573.log 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38867.log.gz 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.36610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40435.log 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30616.log.gz 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.38573.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36610.log.gz 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26994.log 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38573.log.gz 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.40435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33970.log 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.26994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39014.log 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40435.log.gz 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.33970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36660.log 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.26994.log.gz 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.39014.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33970.log.gz 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36463.log 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39014.log.gz 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.36660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32538.log 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.36463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35714.log 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36660.log.gz 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr:gzip/var/log/ceph/ceph-client.admin.32538.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31720.log 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36463.log.gz 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.35714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31206.log 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.32538.log.gz 2026-02-17T21:33:18.373 INFO:teuthology.orchestra.run.trial005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35714.log.gz 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.31720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40484.log 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.31720.log.gz 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.31206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35224.log 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31206.log.gz 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.40484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40288.log 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.35224.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40484.log.gz 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40190.log 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35224.log.gz 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.40288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33340.log 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.40190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37494.log 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40288.log.gz 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.33340.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40190.log.gz 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39847.log 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33340.log.gz 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36008.log 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.37494.log: /var/log/ceph/ceph-client.admin.39847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39798.log 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37494.log.gz 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.36008.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39847.log.gz 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27218.log 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.39798.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36008.log.gz 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37347.log 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39798.log.gz 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.27218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37543.log 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.37347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31129.log 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27218.log.gz 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.37543.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37347.log.gz 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38965.log 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.31129.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37543.log.gz 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35861.log 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.38965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38524.log 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.35861.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31129.log.gz 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37690.log 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38965.log.gz 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.38524.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35861.log.gz 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40533.log 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38524.log.gz 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.37690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37004.log 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.40533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33577.log 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37690.log.gz 2026-02-17T21:33:18.374 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.37004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35518.log 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40533.log.gz 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.33577.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37004.log.gz 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33853.log 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.35518.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33577.log.gz 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30523.log 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35518.log.gz 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.33853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31718.log 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33853.log.gz 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.30523.log: 91.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32501.log 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30523.log.gz 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.31718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37053.log 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.32501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34100.log 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31718.log.gz 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.32501.log.gz 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.37053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39161.log 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31740.log 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.34100.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37053.log.gz 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.39161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35959.log 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34100.log.gz 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.31740.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39161.log.gz 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35469.log 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31740.log.gz 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.35959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33521.log 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35959.log.gz 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.35469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40043.log 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.33521.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.35469.log.gz -5 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37592.log 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.40043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35812.log 87.7% 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33521.log.gz 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40043.log.gz 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.37592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32540.log 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.35812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35763.log 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37592.log.gz 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.32540.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35812.log.gz 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.32540.log.gz 2026-02-17T21:33:18.375 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.35763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36759.log 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38377.log 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35763.log.gz 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.36759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36561.log 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36759.log.gz 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.38377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30300.log 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr: 89.6% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.36561.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38377.log.gz 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.8.log 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.30300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31304.log 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36561.log.gz 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39455.log 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30300.log.gz 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.31304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37886.log 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.39455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31732.log 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31304.log.gz 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39455.log.gz 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.37886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33449.log 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.31732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30662.log 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37886.log.gz 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.33449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31716.log 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31732.log.gz 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33449.log.gz 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.30662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34068.log 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.31716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38916.log 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30662.log.gz 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.34068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38475.log 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31716.log.gz 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34068.log.gz 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.38916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34440.log 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.38475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35077.log 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38916.log.gz 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.34440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38033.log 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38475.log.gz 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.35077.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34440.log.gz 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26667.log 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.38033.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35077.log.gz 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27017.log 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38033.log.gz 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.26667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32504.log 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.27017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30754.log 2026-02-17T21:33:18.376 INFO:teuthology.orchestra.run.trial005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27017.log.gz 2026-02-17T21:33:18.377 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.32504.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.26667.log.gz 2026-02-17T21:33:18.377 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33071.log 2026-02-17T21:33:18.377 INFO:teuthology.orchestra.run.trial005.stderr: 87.2%/var/log/ceph/ceph-client.admin.30754.log: -- replaced with /var/log/ceph/ceph-client.admin.32504.log.gz 2026-02-17T21:33:18.377 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39553.log 2026-02-17T21:33:18.377 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.33071.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.30754.log.gz 2026-02-17T21:33:18.377 INFO:teuthology.orchestra.run.trial005.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.33071.log.gz 2026-02-17T21:33:18.377 INFO:teuthology.orchestra.run.trial005.stderr:/var/log/ceph/ceph-client.admin.39553.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39553.log.gz 2026-02-17T21:33:18.377 INFO:teuthology.orchestra.run.trial135.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-17T21:33:18.377 INFO:teuthology.orchestra.run.trial135.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.14.log.gz 2026-02-17T21:33:18.377 INFO:teuthology.orchestra.run.trial119.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-17T21:33:18.377 INFO:teuthology.orchestra.run.trial119.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.13.log.gz 2026-02-17T21:33:18.377 INFO:teuthology.orchestra.run.trial119.stderr: 90.7% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2026-02-17T21:33:18.385 INFO:teuthology.orchestra.run.trial005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-17T21:33:18.385 INFO:teuthology.orchestra.run.trial135.stderr: 90.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2026-02-17T21:33:18.389 INFO:teuthology.orchestra.run.trial005.stderr: 90.9% -- replaced with /var/log/ceph/ceph-osd.12.log.gz 2026-02-17T21:33:18.397 INFO:teuthology.orchestra.run.trial176.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-17T21:33:18.402 INFO:teuthology.orchestra.run.trial119.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-17T21:33:18.404 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T21:33:18.404 INFO:teuthology.orchestra.run.trial119.stderr:real 0m0.112s 2026-02-17T21:33:18.404 INFO:teuthology.orchestra.run.trial119.stderr:user 0m0.327s 2026-02-17T21:33:18.404 INFO:teuthology.orchestra.run.trial119.stderr:sys 0m0.034s 2026-02-17T21:33:18.405 INFO:teuthology.orchestra.run.trial176.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.15.log.gz 2026-02-17T21:33:18.405 INFO:teuthology.orchestra.run.trial176.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2026-02-17T21:33:18.406 INFO:teuthology.orchestra.run.trial005.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2026-02-17T21:33:18.408 INFO:teuthology.orchestra.run.trial176.stderr: 90.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-17T21:33:18.410 INFO:teuthology.orchestra.run.trial176.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.11.log.gz 2026-02-17T21:33:18.411 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T21:33:18.411 INFO:teuthology.orchestra.run.trial176.stderr:real 0m0.076s 2026-02-17T21:33:18.411 INFO:teuthology.orchestra.run.trial176.stderr:user 0m0.292s 2026-02-17T21:33:18.411 INFO:teuthology.orchestra.run.trial176.stderr:sys 0m0.035s 2026-02-17T21:33:18.420 INFO:teuthology.orchestra.run.trial135.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-17T21:33:18.422 INFO:teuthology.orchestra.run.trial135.stderr: 2026-02-17T21:33:18.422 INFO:teuthology.orchestra.run.trial135.stderr:real 0m0.118s 2026-02-17T21:33:18.422 INFO:teuthology.orchestra.run.trial135.stderr:user 0m0.327s 2026-02-17T21:33:18.422 INFO:teuthology.orchestra.run.trial135.stderr:sys 0m0.041s 2026-02-17T21:33:18.488 INFO:teuthology.orchestra.run.trial005.stderr: 89.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-17T21:33:18.490 INFO:teuthology.orchestra.run.trial005.stderr: 2026-02-17T21:33:18.490 INFO:teuthology.orchestra.run.trial005.stderr:real 0m0.199s 2026-02-17T21:33:18.490 INFO:teuthology.orchestra.run.trial005.stderr:user 0m0.455s 2026-02-17T21:33:18.490 INFO:teuthology.orchestra.run.trial005.stderr:sys 0m0.159s 2026-02-17T21:33:18.490 INFO:tasks.ceph:Archiving logs... 2026-02-17T21:33:18.490 DEBUG:teuthology.misc:Transferring archived files from trial005:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53902/remote/trial005/log 2026-02-17T21:33:18.492 DEBUG:teuthology.orchestra.run.trial005:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T21:33:18.779 DEBUG:teuthology.misc:Transferring archived files from trial119:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53902/remote/trial119/log 2026-02-17T21:33:18.780 DEBUG:teuthology.orchestra.run.trial119:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T21:33:18.879 DEBUG:teuthology.misc:Transferring archived files from trial135:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53902/remote/trial135/log 2026-02-17T21:33:18.880 DEBUG:teuthology.orchestra.run.trial135:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T21:33:18.966 DEBUG:teuthology.misc:Transferring archived files from trial176:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53902/remote/trial176/log 2026-02-17T21:33:18.967 DEBUG:teuthology.orchestra.run.trial176:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T21:33:19.053 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa/tasks/ceph.py", line 329, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa/tasks/ceph.py", line 1922, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa/tasks/ceph.py", line 1484, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa/tasks/ceph_manager.py", line 3303, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa/tasks/ceph.py", line 1919, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/contextutil.py", line 56, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/contextutil.py", line 48, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc _dl_new_object 2026-02-17T21:33:19.055 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-17T21:33:19.079 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T21:33:19.093 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T21:33:19.094 DEBUG:teuthology.orchestra.run.trial005:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T21:33:19.096 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T21:33:19.098 DEBUG:teuthology.orchestra.run.trial135:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T21:33:19.100 DEBUG:teuthology.orchestra.run.trial176:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T21:33:19.368 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T21:33:19.379 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T21:33:19.379 DEBUG:teuthology.orchestra.run.trial005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T21:33:19.381 DEBUG:teuthology.orchestra.run.trial119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T21:33:19.383 DEBUG:teuthology.orchestra.run.trial135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T21:33:19.384 DEBUG:teuthology.orchestra.run.trial176:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T21:33:19.395 INFO:teuthology.orchestra.run.trial005.stderr:bash: line 1: ntpq: command not found 2026-02-17T21:33:19.397 INFO:teuthology.orchestra.run.trial119.stderr:bash: line 1: ntpq: command not found 2026-02-17T21:33:19.398 INFO:teuthology.orchestra.run.trial135.stderr:bash: line 1: ntpq: command not found 2026-02-17T21:33:19.401 INFO:teuthology.orchestra.run.trial176.stderr:bash: line 1: ntpq: command not found 2026-02-17T21:33:19.417 INFO:teuthology.orchestra.run.trial135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T21:33:19.417 INFO:teuthology.orchestra.run.trial135.stdout:=============================================================================== 2026-02-17T21:33:19.417 INFO:teuthology.orchestra.run.trial135.stdout:^- 66.42.71.197.vultruserco> 3 7 377 72 -332us[ -311us] +/- 45ms 2026-02-17T21:33:19.417 INFO:teuthology.orchestra.run.trial135.stdout:^* pool-138-89-14-60.mad.ea> 1 7 155 1 -154us[ -132us] +/- 3114us 2026-02-17T21:33:19.417 INFO:teuthology.orchestra.run.trial135.stdout:^- 69-10-208-170.rainiercon> 2 6 377 6 -1199us[-1177us] +/- 83ms 2026-02-17T21:33:19.417 INFO:teuthology.orchestra.run.trial135.stdout:^+ 50.205.57.38 1 6 377 7 +413us[ +435us] +/- 4760us 2026-02-17T21:33:19.418 INFO:teuthology.orchestra.run.trial119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T21:33:19.418 INFO:teuthology.orchestra.run.trial119.stdout:=============================================================================== 2026-02-17T21:33:19.418 INFO:teuthology.orchestra.run.trial119.stdout:^+ 172-235-154-118.ip.linod> 4 7 377 71 -2297us[-2297us] +/- 59ms 2026-02-17T21:33:19.418 INFO:teuthology.orchestra.run.trial119.stdout:^* s2-b.time.mci1.us.rozint> 2 7 377 73 +364us[ +529us] +/- 23ms 2026-02-17T21:33:19.418 INFO:teuthology.orchestra.run.trial119.stdout:^- jmpxus.no.sigint.today 3 7 207 65 +2266us[+2266us] +/- 160ms 2026-02-17T21:33:19.419 INFO:teuthology.orchestra.run.trial119.stdout:^+ lax1.us.ntp.li 2 7 377 75 +2445us[+2610us] +/- 35ms 2026-02-17T21:33:19.427 INFO:teuthology.orchestra.run.trial176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T21:33:19.428 INFO:teuthology.orchestra.run.trial176.stdout:=============================================================================== 2026-02-17T21:33:19.428 INFO:teuthology.orchestra.run.trial176.stdout:^- 24-111-79-186-dynamic.mi> 2 7 377 72 +1623us[+1525us] +/- 80ms 2026-02-17T21:33:19.428 INFO:teuthology.orchestra.run.trial176.stdout:^+ owners.kjsl.com 2 7 377 8 -728us[ -728us] +/- 41ms 2026-02-17T21:33:19.428 INFO:teuthology.orchestra.run.trial176.stdout:^- ntp11.kernfusion.at 2 7 377 72 -1536us[-1634us] +/- 73ms 2026-02-17T21:33:19.428 INFO:teuthology.orchestra.run.trial176.stdout:^* 144.202.62.209.vultruser> 2 6 377 71 -349us[ -447us] +/- 16ms 2026-02-17T21:33:19.433 INFO:teuthology.orchestra.run.trial005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T21:33:19.433 INFO:teuthology.orchestra.run.trial005.stdout:=============================================================================== 2026-02-17T21:33:19.433 INFO:teuthology.orchestra.run.trial005.stdout:^- 170-187-142-180.ip.linod> 2 7 377 72 -11ms[ -11ms] +/- 77ms 2026-02-17T21:33:19.433 INFO:teuthology.orchestra.run.trial005.stdout:^- 204.2.134.172 3 6 377 75 -385us[ -211us] +/- 105ms 2026-02-17T21:33:19.433 INFO:teuthology.orchestra.run.trial005.stdout:^* time.cloudflare.com 3 6 377 7 +54us[ +197us] +/- 6655us 2026-02-17T21:33:19.433 INFO:teuthology.orchestra.run.trial005.stdout:^+ 66.59.198.178 2 7 377 72 +599us[ +732us] +/- 15ms 2026-02-17T21:33:19.434 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T21:33:19.445 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T21:33:19.445 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T21:33:19.460 DEBUG:teuthology.orchestra.run.trial005:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T21:33:19.520 DEBUG:teuthology.orchestra.run.trial119:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T21:33:19.564 DEBUG:teuthology.orchestra.run.trial135:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T21:33:19.607 DEBUG:teuthology.orchestra.run.trial176:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T21:33:19.651 DEBUG:teuthology.orchestra.run.trial005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T21:33:19.677 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:33:19.677 DEBUG:teuthology.orchestra.run.trial119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T21:33:19.703 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:33:19.703 DEBUG:teuthology.orchestra.run.trial135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T21:33:19.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:33:19.729 DEBUG:teuthology.orchestra.run.trial176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T21:33:19.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:33:19.755 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T21:33:19.767 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T21:33:19.780 INFO:teuthology.task.internal:Duration was 1144.457156 seconds 2026-02-17T21:33:19.780 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T21:33:19.793 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T21:33:19.793 DEBUG:teuthology.orchestra.run.trial005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T21:33:19.795 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T21:33:19.797 DEBUG:teuthology.orchestra.run.trial135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T21:33:19.799 DEBUG:teuthology.orchestra.run.trial176:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T21:33:19.830 INFO:teuthology.orchestra.run.trial005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T21:33:19.832 INFO:teuthology.orchestra.run.trial119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T21:33:19.834 INFO:teuthology.orchestra.run.trial176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T21:33:19.835 INFO:teuthology.orchestra.run.trial135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T21:33:20.312 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T21:33:20.313 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial005.front.sepia.ceph.com 2026-02-17T21:33:20.313 DEBUG:teuthology.orchestra.run.trial005:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T21:33:20.334 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial119.front.sepia.ceph.com 2026-02-17T21:33:20.334 DEBUG:teuthology.orchestra.run.trial119:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T21:33:20.372 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial135.front.sepia.ceph.com 2026-02-17T21:33:20.372 DEBUG:teuthology.orchestra.run.trial135:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T21:33:20.393 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial176.front.sepia.ceph.com 2026-02-17T21:33:20.394 DEBUG:teuthology.orchestra.run.trial176:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T21:33:20.414 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T21:33:20.415 DEBUG:teuthology.orchestra.run.trial005:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T21:33:20.418 DEBUG:teuthology.orchestra.run.trial119:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T21:33:20.420 DEBUG:teuthology.orchestra.run.trial135:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T21:33:20.436 DEBUG:teuthology.orchestra.run.trial176:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T21:33:20.497 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T21:33:20.497 DEBUG:teuthology.orchestra.run.trial005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T21:33:20.500 DEBUG:teuthology.orchestra.run.trial119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T21:33:20.504 DEBUG:teuthology.orchestra.run.trial135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T21:33:20.519 DEBUG:teuthology.orchestra.run.trial176:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T21:33:20.520 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T21:33:20.521 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T21:33:20.522 INFO:teuthology.orchestra.run.trial005.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T21:33:20.522 INFO:teuthology.orchestra.run.trial005.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T21:33:20.522 INFO:teuthology.orchestra.run.trial005.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T21:33:20.525 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T21:33:20.526 INFO:teuthology.orchestra.run.trial005.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 89.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T21:33:20.526 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T21:33:20.527 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T21:33:20.527 INFO:teuthology.orchestra.run.trial119.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T21:33:20.527 INFO:teuthology.orchestra.run.trial119.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T21:33:20.529 INFO:teuthology.orchestra.run.trial119.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 88.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T21:33:20.541 INFO:teuthology.orchestra.run.trial135.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T21:33:20.542 INFO:teuthology.orchestra.run.trial135.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T21:33:20.542 INFO:teuthology.orchestra.run.trial135.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T21:33:20.543 INFO:teuthology.orchestra.run.trial135.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T21:33:20.543 INFO:teuthology.orchestra.run.trial135.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T21:33:20.546 INFO:teuthology.orchestra.run.trial135.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 88.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T21:33:20.563 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T21:33:20.564 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T21:33:20.564 INFO:teuthology.orchestra.run.trial176.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T21:33:20.565 INFO:teuthology.orchestra.run.trial176.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T21:33:20.565 INFO:teuthology.orchestra.run.trial176.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T21:33:20.567 INFO:teuthology.orchestra.run.trial176.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 88.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T21:33:20.569 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T21:33:20.587 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T21:33:20.587 DEBUG:teuthology.orchestra.run.trial005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T21:33:20.612 DEBUG:teuthology.orchestra.run.trial119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T21:33:20.636 DEBUG:teuthology.orchestra.run.trial135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T21:33:20.662 DEBUG:teuthology.orchestra.run.trial176:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T21:33:20.689 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T21:33:20.705 DEBUG:teuthology.orchestra.run.trial005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T21:33:20.708 DEBUG:teuthology.orchestra.run.trial119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T21:33:20.711 DEBUG:teuthology.orchestra.run.trial135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T21:33:20.714 DEBUG:teuthology.orchestra.run.trial176:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T21:33:20.731 INFO:teuthology.orchestra.run.trial005.stdout:kernel.core_pattern = core 2026-02-17T21:33:20.734 INFO:teuthology.orchestra.run.trial119.stdout:kernel.core_pattern = core 2026-02-17T21:33:20.735 INFO:teuthology.orchestra.run.trial135.stdout:kernel.core_pattern = core 2026-02-17T21:33:20.752 INFO:teuthology.orchestra.run.trial176.stdout:kernel.core_pattern = core 2026-02-17T21:33:20.764 DEBUG:teuthology.orchestra.run.trial005:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T21:33:20.804 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:33:20.805 DEBUG:teuthology.orchestra.run.trial119:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T21:33:20.821 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:33:20.822 DEBUG:teuthology.orchestra.run.trial135:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T21:33:20.839 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:33:20.840 DEBUG:teuthology.orchestra.run.trial176:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T21:33:20.856 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:33:20.857 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T21:33:20.870 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T21:33:20.871 DEBUG:teuthology.misc:Transferring archived files from trial005:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53902/remote/trial005 2026-02-17T21:33:20.871 DEBUG:teuthology.orchestra.run.trial005:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T21:33:20.904 DEBUG:teuthology.misc:Transferring archived files from trial119:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53902/remote/trial119 2026-02-17T21:33:20.904 DEBUG:teuthology.orchestra.run.trial119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T21:33:20.937 DEBUG:teuthology.misc:Transferring archived files from trial135:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53902/remote/trial135 2026-02-17T21:33:20.938 DEBUG:teuthology.orchestra.run.trial135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T21:33:20.971 DEBUG:teuthology.misc:Transferring archived files from trial176:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53902/remote/trial176 2026-02-17T21:33:20.971 DEBUG:teuthology.orchestra.run.trial176:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T21:33:21.005 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T21:33:21.005 DEBUG:teuthology.orchestra.run.trial005:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T21:33:21.008 DEBUG:teuthology.orchestra.run.trial119:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T21:33:21.011 DEBUG:teuthology.orchestra.run.trial135:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T21:33:21.013 DEBUG:teuthology.orchestra.run.trial176:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T21:33:21.053 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T21:33:21.074 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T21:33:21.074 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T21:33:21.090 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T21:33:21.090 DEBUG:teuthology.orchestra.run.trial005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T21:33:21.093 DEBUG:teuthology.orchestra.run.trial119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T21:33:21.096 DEBUG:teuthology.orchestra.run.trial135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T21:33:21.099 DEBUG:teuthology.orchestra.run.trial176:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T21:33:21.107 INFO:teuthology.orchestra.run.trial005.stdout: 786514 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 21:33 /home/ubuntu/cephtest 2026-02-17T21:33:21.110 INFO:teuthology.orchestra.run.trial119.stdout: 786514 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 21:33 /home/ubuntu/cephtest 2026-02-17T21:33:21.113 INFO:teuthology.orchestra.run.trial135.stdout: 786514 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 21:33 /home/ubuntu/cephtest 2026-02-17T21:33:21.116 INFO:teuthology.orchestra.run.trial176.stdout: 786514 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 21:33 /home/ubuntu/cephtest 2026-02-17T21:33:21.118 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T21:33:21.134 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T21:33:21.174 INFO:teuthology.run:Summary data: description: rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} duration: 1144.4571561813354 failure_reason: '"2026-02-17T21:25:19.886518+0000 mon.a (mon.0) 165 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT)" in cluster log' flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-17T21:33:21.174 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T21:33:21.288 INFO:teuthology.run:FAIL